[INFO] GE(618570,python3.9):2025-04-03-09:27:04.053.699 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.053.839 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.053.869 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.053.883 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.053.897 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.053.910 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.053.923 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.053.938 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.053.951 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.053.963 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.053.972 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.053.984 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.053.994 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.004 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.015 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.029 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.038 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.049 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.061 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.070 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.081 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_UINT8,DT_INT16,DT_INT64,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.091 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.104 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.123 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.135 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T1 for Required input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.144 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.163 [ir_data_type_symbol_store.cc:240]618570 DeclareSymbol:Bind symbol T1 with ordered list-dtypes [DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_INT4,DT_UINT8,DT_INT8,DT_INT16,DT_INT16,DT_INT32,DT_INT32,DT_INT32,DT_INT32,DT_INT64,DT_INT64,DT_FLOAT,DT_BFLOAT16,DT_BFLOAT16,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.175 [ir_data_type_symbol_store.cc:240]618570 DeclareSymbol:Bind symbol T2 with ordered list-dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,DT_INT32,DT_INT16,DT_FLOAT,DT_INT32,DT_INT16,DT_INT8,DT_UINT8,DT_INT4,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT,DT_FLOAT,DT_INT64,DT_INT16,DT_FLOAT16,DT_INT32,DT_FLOAT,DT_BFLOAT16,DT_FLOAT,DT_INT32,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.186 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.195 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.207 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.220 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.229 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.239 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.249 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.258 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.268 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.278 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.287 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.298 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.310 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.319 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.329 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.340 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.349 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.363 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.374 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.383 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.395 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.405 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.414 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.424 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.434 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T1 for Required input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.443 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.453 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.462 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.472 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.483 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.493 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.503 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.512 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.523 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.533 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.542 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.551 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.563 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.573 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.582 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.592 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.601 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.611 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.631 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.641 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.652 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.664 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.673 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.683 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.693 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.702 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.712 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.722 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.731 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.742 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.753 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.762 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.771 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.781 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.791 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.800 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.809 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.819 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.830 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.842 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.851 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.860 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.870 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.884 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.893 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.903 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.913 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.922 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.931 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.941 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.954 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.963 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.972 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.982 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.054.992 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.001 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.009 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.019 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.029 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.038 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.047 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.059 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.068 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.079 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.088 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.097 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.107 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.117 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.131 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.140 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.150 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.160 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.170 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.180 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.188 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x3
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.197 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.206 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.219 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.228 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.237 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.247 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.256 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.268 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.277 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.286 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.296 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.305 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.315 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.324 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.333 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.343 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.352 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.363 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.373 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.385 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.396 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.405 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.415 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.424 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.433 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.443 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.452 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.464 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.473 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.489 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.501 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Dynamic input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.510 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.521 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.533 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.543 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T2 for Required input x2
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.552 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T2 for Required input x3
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.560 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.570 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_UINT8,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.580 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.590 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.599 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T2 for Required input x2
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.608 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T2 for Required input x3
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.617 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.631 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_UINT8,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.641 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.652 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.661 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.672 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.682 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.691 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.702 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.713 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.723 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.731 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.745 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.767 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.780 [ir_data_type_symbol_store.cc:173]618570 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.789 [ir_data_type_symbol_store.cc:219]618570 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.055.804 [ir_data_type_symbol_store.cc:182]618570 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] ATRACE(618570,python3.9):2025-04-03-09:27:04.061.972 [awatchdog_core.c:99](tid:618570) watchdog get platform host side
[INFO] ATRACE(618570,python3.9):2025-04-03-09:27:04.062.123 [awatchdog_monitor.c:127](tid:618570) create monitor thread successfully, tid :281470172323744 
[INFO] ATRACE(618570,python3.9):2025-04-03-09:27:04.062.139 [awatchdog_monitor.c:226](tid:618570) AwdMonitorInit
[INFO] ATRACE(618570,python3.9):2025-04-03-09:27:04.062.309 [trace_attr.c:99](tid:618570) doesn't set env ASCEND_LOG_DEVICE_FLUSH_TIMEOUT, use default timeout=0ms.
[INFO] ATRACE(618570,python3.9):2025-04-03-09:27:04.062.322 [trace_attr.c:189](tid:618570) attr init success, timeout=0ms.
[WARNING] ATRACE(618570,python3.9):2025-04-03-09:27:04.062.332 [trace_system_api.c:115](tid:618570) env ASCEND_WORK_PATH is null.
[INFO] ATRACE(618570,python3.9):2025-04-03-09:27:04.062.379 [trace_recorder.c:40](tid:618570) home_directory=/home/jenkins.
[INFO] ATRACE(618570,python3.9):2025-04-03-09:27:04.062.399 [trace_recorder.c:121](tid:618570) use root path: /home/jenkins/ascend
[INFO] ATRACE(618570,python3.9):2025-04-03-09:27:04.062.408 [trace_event.c:151](tid:618570) init trace event success
[INFO] ATRACE(618570,python3.9):2025-04-03-09:27:04.062.448 [atrace_client_core.c:185](tid:618570) atrace client init success.
[INFO] ATRACE(618570,python3.9):2025-04-03-09:27:04.063.757 [stacktrace_dumper.c:218](tid:618570) path = /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/bin/asc_dumper
[WARNING] ATRACE(618570,python3.9):2025-04-03-09:27:04.063.773 [trace_system_api.c:115](tid:618570) env ASCEND_COREDUMP_SIGNAL is null.
[INFO] ATRACE(618570,python3.9):2025-04-03-09:27:04.063.850 [stacktrace_signal.c:165](tid:618570) register signal handler for signo 2 succeed.
[INFO] ATRACE(618570,python3.9):2025-04-03-09:27:04.063.862 [stacktrace_signal.c:165](tid:618570) register signal handler for signo 15 succeed.
[INFO] ATRACE(618570,python3.9):2025-04-03-09:27:04.063.871 [stacktrace_signal.c:165](tid:618570) register signal handler for signo 3 succeed.
[INFO] ATRACE(618570,python3.9):2025-04-03-09:27:04.063.879 [stacktrace_signal.c:165](tid:618570) register signal handler for signo 4 succeed.
[INFO] ATRACE(618570,python3.9):2025-04-03-09:27:04.063.887 [stacktrace_signal.c:165](tid:618570) register signal handler for signo 5 succeed.
[INFO] ATRACE(618570,python3.9):2025-04-03-09:27:04.063.895 [stacktrace_signal.c:165](tid:618570) register signal handler for signo 6 succeed.
[INFO] ATRACE(618570,python3.9):2025-04-03-09:27:04.063.903 [stacktrace_signal.c:165](tid:618570) register signal handler for signo 7 succeed.
[INFO] ATRACE(618570,python3.9):2025-04-03-09:27:04.063.911 [stacktrace_signal.c:165](tid:618570) register signal handler for signo 8 succeed.
[INFO] ATRACE(618570,python3.9):2025-04-03-09:27:04.063.919 [stacktrace_signal.c:165](tid:618570) register signal handler for signo 11 succeed.
[INFO] ATRACE(618570,python3.9):2025-04-03-09:27:04.063.927 [stacktrace_signal.c:165](tid:618570) register signal handler for signo 24 succeed.
[INFO] ATRACE(618570,python3.9):2025-04-03-09:27:04.063.935 [stacktrace_signal.c:165](tid:618570) register signal handler for signo 25 succeed.
[INFO] ATRACE(618570,python3.9):2025-04-03-09:27:04.063.943 [stacktrace_signal.c:165](tid:618570) register signal handler for signo 31 succeed.
[INFO] ATRACE(618570,python3.9):2025-04-03-09:27:04.063.951 [stacktrace_signal.c:165](tid:618570) register signal handler for signo 35 succeed.
[INFO] ATRACE(618570,python3.9):2025-04-03-09:27:04.063.958 [stacktrace_signal.c:168](tid:618570) trace signal init succeed.
[INFO] ATRACE(618570,python3.9):2025-04-03-09:27:04.063.965 [trace_core.c:51](tid:618570) trace init success.
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.064.558 [task_fail_callback_data_manager.cc:58] 618570 TaskFailCallBackManager: Constructor.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.073.079 [operator_factory_impl.cc:232]618570 RegisterInferShapeV2Func:operator infer shape v2 funcs init
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.073.106 [operator_factory_impl.cc:246]618570 RegisterInferShapeRangeFunc:operator infer shape range funcs init
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.073.115 [operator_factory_impl.cc:239]618570 RegisterInferDataTypeFunc:operator infer data type funcs init
[INFO] HCCL(618570,python3.9):2025-04-03-09:27:04.079.547 [adapter_rts.cc:2720] [618570][adapter_rts.cc][CallBackInitRts] g_deviceType [6] g_deviceLogicId [-1] g_devicePhyId [-1]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.095.559 [op_impl_registry.cc:122]618570 RegisterOpImplToRegistry:Op type[Allreduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.095.607 [op_impl_registry.cc:122]618570 RegisterOpImplToRegistry:Op type[Reduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.095.630 [op_impl_registry.cc:122]618570 RegisterOpImplToRegistry:Op type[ReduceScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] PROFILING(618570,python3.9):2025-04-03-09:27:04.106.196 [prof_cann_plugin.cpp:256] (tid:618570) Register module[6] callback.
[INFO] OP(618570,python3.9):2025-04-03-09:27:04.155.512 [nnopbase_args_pool.cpp:123][NNOP][GetCacheSizeLimit][618570] cachelimit is 10000
[INFO] OP(618570,python3.9):2025-04-03-09:27:04.159.480 [op_dfx.cpp:230][NNOP][RecordOpArgCallback][618570] RecordOpArgCallback, get record op arg flag = 0
[INFO] OP(618570,python3.9):2025-04-03-09:27:04.159.524 [op_dfx.cpp:54][NNOP][SystemConfig][618570] enable debug kernel flag 0.
[INFO] PROFILING(618570,python3.9):2025-04-03-09:27:04.159.537 [prof_cann_plugin.cpp:256] (tid:618570) Register module[61] callback.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.208.120 [mem_manager.cc:138]618570 RegisterAllocatorManager:MemManager RegisterAllocatorManager.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.214.462 [cache_policy.cc:47]618570 Create:[CachePolicy] Create CachePolicy with match_policy: 0, aging_policy: 0 success;
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.227.453 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for AddN.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.227.574 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for BatchMatMulV2.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.227.667 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Add.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.227.687 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Mul.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.227.703 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Less.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.227.718 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Sub.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.227.732 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for RealDiv.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.227.746 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Equal.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.227.762 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for NotEqual.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.227.778 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Greater.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.227.793 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Maximum.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.227.808 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Minimum.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.227.823 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for LogicalAnd.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.227.838 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for LogicalOr.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.227.853 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Div.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.227.867 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for LessEqual.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.227.881 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for SquaredDifference.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.227.898 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for GreaterEqual.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.227.912 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for DivNoNan.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.227.926 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for LeakyReluGrad.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.228.015 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for ClipByValue.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.228.099 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for ConcatV2.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.228.117 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for ConcatV2D.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.228.221 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Abs.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.228.249 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Relu.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.228.265 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for IsNan.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.228.280 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Sign.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.228.296 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Exp.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.228.310 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Cast.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.228.324 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for LogicalNot.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.228.340 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Neg.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.228.354 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Sqrt.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.228.370 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Rsqrt.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.228.385 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Pow.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.228.399 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for ZerosLike.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.228.413 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Sigmoid.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.228.428 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for BiasAdd.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.228.446 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Square.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.228.462 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Erf.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.228.479 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Reciprocal.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.228.495 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for LeakyRelu.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.228.510 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Tanh.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.228.592 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for ExpandDims.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.228.679 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Fill.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.228.769 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for GatherV2.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.228.861 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for LayerNorm.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.228.945 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for MatMul.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.228.966 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for MatMulV2.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.229.048 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Pack.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.229.140 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Pad.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.229.161 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for PadD.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.229.243 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Range.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.229.327 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for ReduceSum.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.229.347 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for ReduceMax.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.229.372 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for ReduceMin.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.229.389 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for ReduceProd.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.229.404 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for ReduceMean.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.229.421 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for ReduceAll.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.229.439 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for ReduceAny.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.229.454 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for ReduceSumD.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.229.468 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for ReduceMaxD.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.229.492 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for ReduceMinD.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.229.507 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for ReduceProdD.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.229.521 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for ReduceMeanD.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.229.537 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for ReduceAllD.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.229.553 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for ReduceAnyD.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.229.634 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Reshape.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.229.718 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Select.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.229.800 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Slice.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.229.882 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Split.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.229.902 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for SplitV.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.229.918 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for SplitD.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.229.934 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for SplitVD.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.230.026 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Squeeze.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.230.113 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for StridedSliceD.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.230.131 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for StridedSlice.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.230.219 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Tile.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.230.239 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for TileD.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.230.318 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Transpose.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.230.402 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for TransposeD.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.230.489 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Unpack.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.230.572 [addn.cc:29]618570 InferSymbolShape:Register infer symbol shape for Unsqueeze.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.230.868 [symbolic_kernel_factory.cc:27]618570 RegisterCreator:Register host symbolic kernel for node type ConcatV2D
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.230.953 [symbolic_kernel_factory.cc:27]618570 RegisterCreator:Register host symbolic kernel for node type ExpandDims
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.231.053 [symbolic_kernel_factory.cc:27]618570 RegisterCreator:Register host symbolic kernel for node type Fill
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.231.131 [symbolic_kernel_factory.cc:27]618570 RegisterCreator:Register host symbolic kernel for node type Pack
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.231.208 [symbolic_kernel_factory.cc:27]618570 RegisterCreator:Register host symbolic kernel for node type ReduceProd
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.231.287 [symbolic_kernel_factory.cc:27]618570 RegisterCreator:Register host symbolic kernel for node type Shape
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.231.368 [symbolic_kernel_factory.cc:27]618570 RegisterCreator:Register host symbolic kernel for node type Squeeze
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.231.445 [symbolic_kernel_factory.cc:27]618570 RegisterCreator:Register host symbolic kernel for node type StridedSlice
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.231.455 [symbolic_kernel_factory.cc:27]618570 RegisterCreator:Register host symbolic kernel for node type StridedSliceD
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.231.532 [symbolic_kernel_factory.cc:27]618570 RegisterCreator:Register host symbolic kernel for node type Tile
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.231.612 [symbolic_kernel_factory.cc:27]618570 RegisterCreator:Register host symbolic kernel for node type Unpack
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.231.689 [symbolic_kernel_factory.cc:27]618570 RegisterCreator:Register host symbolic kernel for node type Unsqueeze
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.237.617 [process_node_engine_manager.cc:140]618570 RegisterEngine:Register ProcessNodeEngine id:PS success.
[INFO] GE(618570,python3.9):2025-04-03-09:27:04.237.723 [process_node_engine_manager.cc:140]618570 RegisterEngine:Register ProcessNodeEngine id:NPU success.
[INFO] DVPP(618570,python3.9):2025-04-03-09:27:04.243.678 [PlatformInfo.cpp:85][DVPP] [InitPara:85] [T2] chip type is 5.
[INFO] DVPP(618570,python3.9):2025-04-03-09:27:04.243.706 [PlatformInfo.cpp:94][DVPP] [InitPara:94] [T2] run mode is 1.
[INFO] DVPP(618570,python3.9):2025-04-03-09:27:04.244.212 [dvpp_dev_hdc.cpp:750][WRAP] [StartHostPacketCountTimer:750] [tid:618570] start packet count timer
[INFO] PROFILING(618570,python3.9):2025-04-03-09:27:04.264.868 [prof_atls_plugin.cpp:117] (tid:618570) RegisterProfileCallback, callback type is 7
[INFO] PROFILING(618570,python3.9):2025-04-03-09:27:04.264.903 [prof_atls_plugin.cpp:117] (tid:618570) RegisterProfileCallback, callback type is 8
[INFO] ASCENDCL(618570,python3.9):2025-04-03-09:27:04.367.220 [acl.cpp:753]618570 aclrtGetSocName: start to execute aclrtGetSocName.
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.367.283 [runtime_keeper.cc:78] 618570 GetDeviceType: hardwareVersion=0x503
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.370.602 [plugin_old_arch.cc:16] 618570 ConstructRuntimeImpl: RuntimeImpl construct success, rt = 0xaaaae5c954c0
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.370.630 [runtime_keeper.cc:149] 618570 CreateRuntimeImpl: Open libruntime_v100.so success
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.370.639 [runtime_keeper.cc:221] 618570 BootRuntime: new Runtime ok, Runtime_alloc_size 12600.
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.370.661 [runtime.cc:1387] 618570 CheckHaveDevice: hardwareVersion=0x503
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.370.683 [runtime.cc:1163] 618570 InitChipAndSocType: Runtime init: device type=5, soc type=18, arch type=0, havedevice=1
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.370.701 [npu_driver.cc:4062] 618570 CheckSqcqIsSupportDevMem: sqcq support dev mem
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.370.713 [runtime.cc:5096] 618570 GetVisibleDevices: ASCEND_RT_VISIBLE_DEVICES param was not set
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.370.722 [runtime.cc:1173] 618570 InitApiImpile: ApiImpl:Runtime_alloc_size 8
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.370.751 [runtime.cc:1183] 618570 InitLogger: Logger:Runtime_alloc_size 32
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.370.763 [runtime.cc:1193] 618570 InitApiProfiler: RProfiler:Runtime_alloc_size 176
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.370.772 [profiler.cc:84] 618570 Init: Init ok, Runtime_alloc_size 48
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.370.784 [runtime.cc:1209] 618570 InitApiErrorDecorator: ApiErrorDecorator:Runtime_alloc_size 16.
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.370.793 [runtime.cc:1219] 618570 InitThreadGuard: Runtime init:new ThreadGuard ok, Runtime_alloc_size 104.
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.370.801 [runtime.cc:1230] 618570 InitStreamObserver: EngineStreamObserver:Runtime_alloc_size 8.
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.370.809 [runtime.cc:1242] 618570 InitAicpuStreamIdBitmap: Bitmap(1024):Runtime_alloc_size 72.
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.370.818 [runtime.cc:1264] 618570 InitCbSubscribe: The thread group num is 1024
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.370.826 [runtime.cc:1270] 618570 InitCbSubscribe: Runtime init:new CbSubscribe ok, Runtime_alloc_size 304.
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.370.919 [runtime.cc:109] 618570 Init: ObjAllocator alloc success, Runtime_alloc_size 160000(bytes)
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.371.276 [runtime.cc:121] 618570 Init: ObjAllocator alloc success, Runtime_alloc_size 960000(bytes)
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.371.346 [runtime.cc:1314] 618570 InitLabelAllocator: Runtime init:new LabelAllocator ok, Runtime_alloc_size 131152.
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.371.357 [runtime.cc:1322] 618570 InitSetRuntimeVersion: set runtime api ver success
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.371.476 [runtime.cc:1338] 618570 InitNpuCollectPath: NPU_COLLECT_PATH is not set!
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.371.535 [utils.cc:105] 618570 GetDriverPath: driver path is [Driver_Install_Path_Param=/usr/local/Ascend].
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.371.585 [runtime.cc:1664] 618570 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.371.614 [runtime.cc:1688] 618570 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.371.628 [runtime.cc:1953] 618570 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=preload_stack_16KB.
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.371.650 [runtime.cc:1477] 618570 FindAndRegisterDcacheLockOp: register lock op success
[INFO] PROFILING(618570,python3.9):2025-04-03-09:27:04.371.664 [prof_atls_plugin.cpp:210] (tid:618570) Module[7] register callback of ctrl handle.
[WARNING] RUNTIME(618570,python3.9):2025-04-03-09:27:04.371.676 [heterogenous.cc:19] 618570 ReadHeterogenousModeFromConfigIni: can not read ASCEND_LATEST_INSTALL_PATH! isHeterogenous=0.
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:04.371.699 [api_c_soc.cc:70] 618570 rtGetSocVersion: soc version is Ascend910B3
[INFO] ASCENDCL(618570,python3.9):2025-04-03-09:27:04.371.709 [acl.cpp:115]618570 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618570,python3.9):2025-04-03-09:27:04.371.718 [acl.cpp:760]618570 aclrtGetSocName: execute aclrtGetSocName successfully
[INFO] ASCENDCL(618570,python3.9):2025-04-03-09:27:04.435.878 [acl.cpp:753]618570 aclrtGetSocName: start to execute aclrtGetSocName.
[INFO] ASCENDCL(618570,python3.9):2025-04-03-09:27:04.435.915 [acl.cpp:115]618570 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618570,python3.9):2025-04-03-09:27:04.435.926 [acl.cpp:760]618570 aclrtGetSocName: execute aclrtGetSocName successfully
[WARNING] FE(618570,python3.9):2025-04-03-09:27:05.304.509 [platform_info.cpp:853]618570 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend310P5."
[WARNING] FE(618570,python3.9):2025-04-03-09:27:05.306.292 [platform_info.cpp:853]618570 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9362."
[WARNING] FE(618570,python3.9):2025-04-03-09:27:05.325.589 [platform_info.cpp:853]618570 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_95."
[WARNING] FE(618570,python3.9):2025-04-03-09:27:05.334.323 [platform_info.cpp:853]618570 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9382."
[WARNING] FE(618570,python3.9):2025-04-03-09:27:05.337.245 [platform_info.cpp:853]618570 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9361."
[WARNING] FE(618570,python3.9):2025-04-03-09:27:05.340.230 [platform_info.cpp:853]618570 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_5591."
[WARNING] FE(618570,python3.9):2025-04-03-09:27:05.367.791 [platform_info.cpp:853]618570 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9392."
[WARNING] FE(618570,python3.9):2025-04-03-09:27:05.382.271 [platform_info.cpp:853]618570 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend310P7."
[INFO] TBE(618570,python3.9):2025-04-03-09:27:06.219.117 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:59][decorator] Fusion pass[conv2d_data_rm_build_pass] of stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618570,python3.9):2025-04-03-09:27:06.220.883 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_conv3d] of op type[Conv3D] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618570,python3.9):2025-04-03-09:27:06.221.014 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:59][decorator] Fusion pass[trans_shape_depthwise_conv2d] of stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618570,python3.9):2025-04-03-09:27:06.223.219 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_for_elemwise] of op type[None] op pattern[ElemWise] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618570,python3.9):2025-04-03-09:27:06.223.353 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_for_broadcast] of op type[None] op pattern[Broadcast] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618570,python3.9):2025-04-03-09:27:06.223.466 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_biasadd] of op type[BiasAdd] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618570,python3.9):2025-04-03-09:27:06.223.575 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_requant_s16] of op type[AscendRequantS16] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618570,python3.9):2025-04-03-09:27:06.223.682 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_bninference] of op type[BNInferenceD] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618570,python3.9):2025-04-03-09:27:06.224.818 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_fully_connection] of op type[FullyConnection] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618570,python3.9):2025-04-03-09:27:06.224.951 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_fully_connection_compress] of op type[FullyConnectionCompress] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618570,python3.9):2025-04-03-09:27:06.226.873 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmul_bias_shape] of op type[MatMulV2] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618570,python3.9):2025-04-03-09:27:06.227.002 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmul_bias_shape] of op type[MatMul] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618570,python3.9):2025-04-03-09:27:06.227.116 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmulcompress_bias_shape] of op type[MatMulV2Compress] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618570,python3.9):2025-04-03-09:27:06.227.224 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_batch_matmul_shape] of op type[BatchMatMulV2] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618570,python3.9):2025-04-03-09:27:06.227.327 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_batch_matmul_shape] of op type[BatchMatMul] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618570,python3.9):2025-04-03-09:27:06.227.433 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_transdata_fixpipe] of op type[None] op pattern[BatchMatmul] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[WARNING] TBE(618570,python3.9):2025-04-03-09:27:06.829.989 [../../../../../../latest/python/site-packages/te/platform/cce_policy.py:50][OpImplPolicy] te.platform.cce_policy.OpImplPolicy is deprecated, use te_fusion.fusion_util.OpImplPolicy instead.
[INFO] TBE(618570,python3.9):2025-04-03-09:27:10.771.362 [../../../../../../latest/python/site-packages/tbe/common/rl_bank/dynamic_op_filter.py:373][_need_to_tune_all_op] Auto search dynamic filter info: tune_all_op is False.
[INFO] GE(618570,python3.9):2025-04-03-09:27:11.065.758 [ops_kernel_builder_registry.cc:55]618570 OpsKernelBuilderRegistrar:Register kernel lib name = ops_kernel_info_hccl
[INFO] GE(618570,python3.9):2025-04-03-09:27:11.065.837 [ops_kernel_builder_registry.cc:28]618570 Register:Register OpsKernelBuilder successfully, kernel lib name = ops_kernel_info_hccl
[WARNING] TBE(618570,python3.9):2025-04-03-09:27:11.899.840 [../../../../../../latest/python/site-packages/te/tik/__init__.py:51][<module>] 'from te import tik' is deprecated, please replace it with 'from tbe import tik'.
============================= test session starts ==============================
platform linux -- Python 3.9.19, pytest-6.2.5, py-1.11.0, pluggy-1.5.0
rootdir: /home/jenkins/mindspore/testcases/testcases/tests/st/lccl, configfile: ../../../../../../sault/virtual_test/virtualenv_0013/sault/config/pytest.ini
plugins: requests-mock-1.12.1, hydra-core-1.3.2, mock-3.14.0, forked-1.6.0, xdist-1.32.0
collected 1 item

test_all.py [INFO] ASCENDCL(618570,python3.9):2025-04-03-09:27:13.672.547 [acl.cpp:753]618570 aclrtGetSocName: start to execute aclrtGetSocName.
[INFO] ASCENDCL(618570,python3.9):2025-04-03-09:27:13.672.586 [acl.cpp:115]618570 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618570,python3.9):2025-04-03-09:27:13.672.600 [acl.cpp:760]618570 aclrtGetSocName: execute aclrtGetSocName successfully
[WARNING] ME(618570:281473456106976,MainProcess):2025-04-03-09:27:13.673.502 [mindspore/context.py:1401] For 'context.set_context', the parameter 'device_target' will be deprecated and removed in a future version. Please use the api mindspore.set_device() instead.
[INFO] ASCENDCL(618570,python3.9):2025-04-03-09:27:13.673.713 [acl.cpp:753]618570 aclrtGetSocName: start to execute aclrtGetSocName.
[INFO] ASCENDCL(618570,python3.9):2025-04-03-09:27:13.673.734 [acl.cpp:115]618570 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618570,python3.9):2025-04-03-09:27:13.673.745 [acl.cpp:760]618570 aclrtGetSocName: execute aclrtGetSocName successfully
[INFO] DEBUG(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:14.184.546 [mindspore/ccsrc/debug/data_dump/data_dumper.cc:43] CpuDumpRegister] Register DataDumper for cpu backend.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.212 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.318 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.346 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.363 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.378 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.395 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.410 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.422 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.437 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.450 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.461 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.475 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.489 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.500 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.513 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.527 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.538 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.551 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.588 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.600 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.616 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_UINT8,DT_INT16,DT_INT64,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.628 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.639 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.652 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.665 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T1 for Required input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.676 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.697 [ir_data_type_symbol_store.cc:240]618638 DeclareSymbol:Bind symbol T1 with ordered list-dtypes [DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_INT4,DT_UINT8,DT_INT8,DT_INT16,DT_INT16,DT_INT32,DT_INT32,DT_INT32,DT_INT32,DT_INT64,DT_INT64,DT_FLOAT,DT_BFLOAT16,DT_BFLOAT16,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.713 [ir_data_type_symbol_store.cc:240]618638 DeclareSymbol:Bind symbol T2 with ordered list-dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,DT_INT32,DT_INT16,DT_FLOAT,DT_INT32,DT_INT16,DT_INT8,DT_UINT8,DT_INT4,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT,DT_FLOAT,DT_INT64,DT_INT16,DT_FLOAT16,DT_INT32,DT_FLOAT,DT_BFLOAT16,DT_FLOAT,DT_INT32,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.726 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.737 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.749 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.763 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.775 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.786 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.799 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.810 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.823 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.835 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.846 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.858 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.876 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.887 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.899 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.911 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.921 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.933 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.946 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.957 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.969 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.981 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.561.992 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.003 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.015 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T1 for Required input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.026 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.039 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.051 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.063 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.074 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.085 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.097 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.108 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.120 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.132 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.144 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.156 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.169 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.184 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.195 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.207 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.218 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.232 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.244 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.254 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.266 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.279 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.290 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.301 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.313 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.323 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.335 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.348 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.359 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.371 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.383 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.393 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.404 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.416 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.428 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.438 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.449 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.465 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.482 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.494 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.504 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.516 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.528 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.538 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.549 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.561 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.572 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.585 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.596 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.608 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.619 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.630 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.641 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.652 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.664 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.675 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.685 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.696 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.712 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.723 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.734 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.746 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.757 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.769 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.784 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.794 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.807 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.820 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.832 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.843 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.853 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.865 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.877 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.887 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.898 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x3
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.908 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.919 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.933 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.946 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.957 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.968 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.979 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.562.991 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.002 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.012 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.024 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.035 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.047 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.064 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.078 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.090 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.102 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.114 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.125 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.135 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.147 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.158 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.170 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.182 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.193 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.205 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.216 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.228 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.239 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.255 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.271 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Dynamic input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.282 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.295 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.308 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.319 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T2 for Required input x2
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.329 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T2 for Required input x3
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.340 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.351 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_UINT8,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.366 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.381 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.392 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T2 for Required input x2
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.403 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T2 for Required input x3
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.413 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.424 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_UINT8,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.436 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.448 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.459 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.472 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.484 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.496 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.509 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.521 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.532 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.542 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.558 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.580 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.592 [ir_data_type_symbol_store.cc:173]618638 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.603 [ir_data_type_symbol_store.cc:219]618638 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.563.619 [ir_data_type_symbol_store.cc:182]618638 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] ATRACE(618638,python3.9):2025-04-03-09:27:14.569.445 [awatchdog_core.c:99](tid:618638) watchdog get platform host side
[INFO] ATRACE(618638,python3.9):2025-04-03-09:27:14.569.597 [awatchdog_monitor.c:127](tid:618638) create monitor thread successfully, tid :281473251815328 
[INFO] ATRACE(618638,python3.9):2025-04-03-09:27:14.569.613 [awatchdog_monitor.c:226](tid:618638) AwdMonitorInit
[INFO] ATRACE(618638,python3.9):2025-04-03-09:27:14.569.773 [trace_attr.c:99](tid:618638) doesn't set env ASCEND_LOG_DEVICE_FLUSH_TIMEOUT, use default timeout=0ms.
[INFO] ATRACE(618638,python3.9):2025-04-03-09:27:14.569.787 [trace_attr.c:189](tid:618638) attr init success, timeout=0ms.
[WARNING] ATRACE(618638,python3.9):2025-04-03-09:27:14.569.800 [trace_system_api.c:115](tid:618638) env ASCEND_WORK_PATH is null.
[INFO] ATRACE(618638,python3.9):2025-04-03-09:27:14.569.848 [trace_recorder.c:40](tid:618638) home_directory=/home/jenkins.
[INFO] ATRACE(618638,python3.9):2025-04-03-09:27:14.569.861 [trace_recorder.c:121](tid:618638) use root path: /home/jenkins/ascend
[INFO] ATRACE(618638,python3.9):2025-04-03-09:27:14.569.872 [trace_event.c:151](tid:618638) init trace event success
[INFO] ATRACE(618638,python3.9):2025-04-03-09:27:14.569.907 [atrace_client_core.c:185](tid:618638) atrace client init success.
[INFO] ATRACE(618638,python3.9):2025-04-03-09:27:14.570.914 [stacktrace_dumper.c:218](tid:618638) path = /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/bin/asc_dumper
[WARNING] ATRACE(618638,python3.9):2025-04-03-09:27:14.570.930 [trace_system_api.c:115](tid:618638) env ASCEND_COREDUMP_SIGNAL is null.
[INFO] ATRACE(618638,python3.9):2025-04-03-09:27:14.570.996 [stacktrace_signal.c:165](tid:618638) register signal handler for signo 2 succeed.
[INFO] ATRACE(618638,python3.9):2025-04-03-09:27:14.571.009 [stacktrace_signal.c:165](tid:618638) register signal handler for signo 15 succeed.
[INFO] ATRACE(618638,python3.9):2025-04-03-09:27:14.571.020 [stacktrace_signal.c:165](tid:618638) register signal handler for signo 3 succeed.
[INFO] ATRACE(618638,python3.9):2025-04-03-09:27:14.571.030 [stacktrace_signal.c:165](tid:618638) register signal handler for signo 4 succeed.
[INFO] ATRACE(618638,python3.9):2025-04-03-09:27:14.571.040 [stacktrace_signal.c:165](tid:618638) register signal handler for signo 5 succeed.
[INFO] ATRACE(618638,python3.9):2025-04-03-09:27:14.571.050 [stacktrace_signal.c:165](tid:618638) register signal handler for signo 6 succeed.
[INFO] ATRACE(618638,python3.9):2025-04-03-09:27:14.571.060 [stacktrace_signal.c:165](tid:618638) register signal handler for signo 7 succeed.
[INFO] ATRACE(618638,python3.9):2025-04-03-09:27:14.571.070 [stacktrace_signal.c:165](tid:618638) register signal handler for signo 8 succeed.
[INFO] ATRACE(618638,python3.9):2025-04-03-09:27:14.571.080 [stacktrace_signal.c:165](tid:618638) register signal handler for signo 11 succeed.
[INFO] ATRACE(618638,python3.9):2025-04-03-09:27:14.571.089 [stacktrace_signal.c:165](tid:618638) register signal handler for signo 24 succeed.
[INFO] ATRACE(618638,python3.9):2025-04-03-09:27:14.571.099 [stacktrace_signal.c:165](tid:618638) register signal handler for signo 25 succeed.
[INFO] ATRACE(618638,python3.9):2025-04-03-09:27:14.571.107 [stacktrace_signal.c:165](tid:618638) register signal handler for signo 31 succeed.
[INFO] ATRACE(618638,python3.9):2025-04-03-09:27:14.571.117 [stacktrace_signal.c:165](tid:618638) register signal handler for signo 35 succeed.
[INFO] ATRACE(618638,python3.9):2025-04-03-09:27:14.571.126 [stacktrace_signal.c:168](tid:618638) trace signal init succeed.
[INFO] ATRACE(618638,python3.9):2025-04-03-09:27:14.571.134 [trace_core.c:51](tid:618638) trace init success.
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.571.721 [task_fail_callback_data_manager.cc:58] 618638 TaskFailCallBackManager: Constructor.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.580.216 [operator_factory_impl.cc:232]618638 RegisterInferShapeV2Func:operator infer shape v2 funcs init
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.580.245 [operator_factory_impl.cc:246]618638 RegisterInferShapeRangeFunc:operator infer shape range funcs init
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.580.256 [operator_factory_impl.cc:239]618638 RegisterInferDataTypeFunc:operator infer data type funcs init
[INFO] HCCL(618638,python3.9):2025-04-03-09:27:14.586.665 [adapter_rts.cc:2720] [618638][adapter_rts.cc][CallBackInitRts] g_deviceType [6] g_deviceLogicId [-1] g_devicePhyId [-1]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.602.592 [op_impl_registry.cc:122]618638 RegisterOpImplToRegistry:Op type[Allreduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.602.642 [op_impl_registry.cc:122]618638 RegisterOpImplToRegistry:Op type[Reduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.602.666 [op_impl_registry.cc:122]618638 RegisterOpImplToRegistry:Op type[ReduceScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] PROFILING(618638,python3.9):2025-04-03-09:27:14.613.293 [prof_cann_plugin.cpp:256] (tid:618638) Register module[6] callback.
[INFO] OP(618638,python3.9):2025-04-03-09:27:14.662.238 [nnopbase_args_pool.cpp:123][NNOP][GetCacheSizeLimit][618638] cachelimit is 10000
[INFO] OP(618638,python3.9):2025-04-03-09:27:14.666.191 [op_dfx.cpp:230][NNOP][RecordOpArgCallback][618638] RecordOpArgCallback, get record op arg flag = 0
[INFO] OP(618638,python3.9):2025-04-03-09:27:14.666.238 [op_dfx.cpp:54][NNOP][SystemConfig][618638] enable debug kernel flag 0.
[INFO] PROFILING(618638,python3.9):2025-04-03-09:27:14.666.253 [prof_cann_plugin.cpp:256] (tid:618638) Register module[61] callback.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.714.540 [mem_manager.cc:138]618638 RegisterAllocatorManager:MemManager RegisterAllocatorManager.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.720.836 [cache_policy.cc:47]618638 Create:[CachePolicy] Create CachePolicy with match_policy: 0, aging_policy: 0 success;
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.733.747 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for AddN.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.733.872 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for BatchMatMulV2.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.733.964 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Add.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.733.987 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Mul.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.011 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Less.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.029 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Sub.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.046 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for RealDiv.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.063 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Equal.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.080 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for NotEqual.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.097 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Greater.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.115 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Maximum.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.131 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Minimum.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.148 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for LogicalAnd.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.165 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for LogicalOr.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.181 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Div.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.197 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for LessEqual.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.214 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for SquaredDifference.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.232 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for GreaterEqual.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.278 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for DivNoNan.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.296 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for LeakyReluGrad.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.386 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for ClipByValue.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.477 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for ConcatV2.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.497 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for ConcatV2D.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.578 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Abs.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.599 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Relu.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.616 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for IsNan.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.636 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Sign.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.653 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Exp.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.669 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Cast.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.686 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for LogicalNot.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.703 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Neg.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.720 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Sqrt.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.737 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Rsqrt.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.754 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Pow.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.770 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for ZerosLike.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.787 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Sigmoid.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.803 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for BiasAdd.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.820 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Square.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.838 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Erf.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.857 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Reciprocal.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.874 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for LeakyRelu.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.890 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Tanh.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.734.977 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for ExpandDims.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.735.061 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Fill.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.735.145 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for GatherV2.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.735.237 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for LayerNorm.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.735.325 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for MatMul.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.735.348 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for MatMulV2.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.735.441 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Pack.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.735.530 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Pad.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.735.553 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for PadD.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.735.634 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Range.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.735.719 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for ReduceSum.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.735.739 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for ReduceMax.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.735.756 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for ReduceMin.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.735.773 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for ReduceProd.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.735.790 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for ReduceMean.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.735.807 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for ReduceAll.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.735.823 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for ReduceAny.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.735.841 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for ReduceSumD.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.735.858 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for ReduceMaxD.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.735.877 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for ReduceMinD.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.735.894 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for ReduceProdD.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.735.914 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for ReduceMeanD.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.735.932 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for ReduceAllD.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.735.948 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for ReduceAnyD.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.736.031 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Reshape.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.736.115 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Select.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.736.218 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Slice.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.736.309 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Split.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.736.331 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for SplitV.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.736.349 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for SplitD.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.736.366 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for SplitVD.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.736.449 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Squeeze.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.736.537 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for StridedSliceD.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.736.559 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for StridedSlice.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.736.644 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Tile.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.736.665 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for TileD.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.736.753 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Transpose.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.736.845 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for TransposeD.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.736.932 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Unpack.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.737.015 [addn.cc:29]618638 InferSymbolShape:Register infer symbol shape for Unsqueeze.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.737.303 [symbolic_kernel_factory.cc:27]618638 RegisterCreator:Register host symbolic kernel for node type ConcatV2D
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.737.387 [symbolic_kernel_factory.cc:27]618638 RegisterCreator:Register host symbolic kernel for node type ExpandDims
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.737.469 [symbolic_kernel_factory.cc:27]618638 RegisterCreator:Register host symbolic kernel for node type Fill
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.737.557 [symbolic_kernel_factory.cc:27]618638 RegisterCreator:Register host symbolic kernel for node type Pack
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.737.639 [symbolic_kernel_factory.cc:27]618638 RegisterCreator:Register host symbolic kernel for node type ReduceProd
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.737.719 [symbolic_kernel_factory.cc:27]618638 RegisterCreator:Register host symbolic kernel for node type Shape
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.737.800 [symbolic_kernel_factory.cc:27]618638 RegisterCreator:Register host symbolic kernel for node type Squeeze
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.737.879 [symbolic_kernel_factory.cc:27]618638 RegisterCreator:Register host symbolic kernel for node type StridedSlice
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.737.892 [symbolic_kernel_factory.cc:27]618638 RegisterCreator:Register host symbolic kernel for node type StridedSliceD
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.737.970 [symbolic_kernel_factory.cc:27]618638 RegisterCreator:Register host symbolic kernel for node type Tile
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.738.055 [symbolic_kernel_factory.cc:27]618638 RegisterCreator:Register host symbolic kernel for node type Unpack
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.738.137 [symbolic_kernel_factory.cc:27]618638 RegisterCreator:Register host symbolic kernel for node type Unsqueeze
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.743.996 [process_node_engine_manager.cc:140]618638 RegisterEngine:Register ProcessNodeEngine id:PS success.
[INFO] GE(618638,python3.9):2025-04-03-09:27:14.744.108 [process_node_engine_manager.cc:140]618638 RegisterEngine:Register ProcessNodeEngine id:NPU success.
[INFO] DVPP(618638,python3.9):2025-04-03-09:27:14.750.047 [PlatformInfo.cpp:85][DVPP] [InitPara:85] [T2] chip type is 5.
[INFO] DVPP(618638,python3.9):2025-04-03-09:27:14.750.079 [PlatformInfo.cpp:94][DVPP] [InitPara:94] [T2] run mode is 1.
[INFO] DVPP(618638,python3.9):2025-04-03-09:27:14.750.475 [dvpp_dev_hdc.cpp:750][WRAP] [StartHostPacketCountTimer:750] [tid:618638] start packet count timer
[INFO] PROFILING(618638,python3.9):2025-04-03-09:27:14.770.494 [prof_atls_plugin.cpp:117] (tid:618638) RegisterProfileCallback, callback type is 7
[INFO] PROFILING(618638,python3.9):2025-04-03-09:27:14.770.537 [prof_atls_plugin.cpp:117] (tid:618638) RegisterProfileCallback, callback type is 8
[INFO] ME(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:14.832.479 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:377] LoadPlugin] Load libmindspore_ascend plugin file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/libmindspore_ascend.so.2 success.
[INFO] ME(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:14.832.833 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:377] LoadPlugin] Load libmindspore_ops_ascend plugin file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/libmindspore_ops_ascend.so success.
[INFO] ME(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:14.867.925 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:377] LoadPlugin] Load libmindspore_ops_host plugin file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/libmindspore_ops_host.so success.
[INFO] CORE(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:14.868.064 [mindspore/core/utils/ms_context.cc:165] set_backend_policy] ms set context backend policy:ge
[INFO] DEVICE(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:14.868.670 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_base_symbol.cc:63] LoadAclBaseApiSymbol] Load acl base api success!
[INFO] DEVICE(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:14.870.001 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_compiler_symbol.cc:39] LoadAclOpCompilerApiSymbol] Load acl op compiler api success!
[INFO] DEVICE(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:14.870.062 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_mdl_symbol.cc:115] LoadAclMdlApiSymbol] Load acl mdl api success!
[INFO] DEVICE(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:14.870.092 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_op_symbol.cc:55] LoadAclOpApiSymbol] Load ascend op api success!
[INFO] DEVICE(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:14.870.166 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_prof_symbol.cc:49] LoadProfApiSymbol] Load acl prof api success!
[INFO] DEVICE(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:14.870.191 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_rt_allocator_symbol.cc:48] LoadAclAllocatorApiSymbol] Load acl allocator api success!
[INFO] DEVICE(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:14.870.230 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_rt_symbol.cc:149] LoadAclRtApiSymbol] Load acl rt api success!
[INFO] DEVICE(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:14.870.250 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_symbol.cc:34] LoadAclApiSymbol] Load acl base api success!
[INFO] DEVICE(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:14.871.678 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_tdt_symbol.cc:82] LoadAcltdtApiSymbol] Load acl tdt api success!
[INFO] DEVICE(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:14.871.706 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/symbol_utils.cc:79] LoadAscendApiSymbols] Load ascend api success!
[INFO] ASCENDCL(618638,python3.9):2025-04-03-09:27:14.871.734 [acl.cpp:753]618638 aclrtGetSocName: start to execute aclrtGetSocName.
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.871.786 [runtime_keeper.cc:78] 618638 GetDeviceType: hardwareVersion=0x503
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.875.051 [plugin_old_arch.cc:16] 618638 ConstructRuntimeImpl: RuntimeImpl construct success, rt = 0xaaab1c8df6b0
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.875.082 [runtime_keeper.cc:149] 618638 CreateRuntimeImpl: Open libruntime_v100.so success
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.875.092 [runtime_keeper.cc:221] 618638 BootRuntime: new Runtime ok, Runtime_alloc_size 12600.
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.875.120 [runtime.cc:1387] 618638 CheckHaveDevice: hardwareVersion=0x503
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.875.144 [runtime.cc:1163] 618638 InitChipAndSocType: Runtime init: device type=5, soc type=18, arch type=0, havedevice=1
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.875.164 [npu_driver.cc:4062] 618638 CheckSqcqIsSupportDevMem: sqcq support dev mem
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.875.179 [runtime.cc:5096] 618638 GetVisibleDevices: ASCEND_RT_VISIBLE_DEVICES param was not set
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.875.190 [runtime.cc:1173] 618638 InitApiImpile: ApiImpl:Runtime_alloc_size 8
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.875.200 [runtime.cc:1183] 618638 InitLogger: Logger:Runtime_alloc_size 32
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.875.213 [runtime.cc:1193] 618638 InitApiProfiler: RProfiler:Runtime_alloc_size 176
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.875.234 [profiler.cc:84] 618638 Init: Init ok, Runtime_alloc_size 48
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.875.249 [runtime.cc:1209] 618638 InitApiErrorDecorator: ApiErrorDecorator:Runtime_alloc_size 16.
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.875.259 [runtime.cc:1219] 618638 InitThreadGuard: Runtime init:new ThreadGuard ok, Runtime_alloc_size 104.
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.875.269 [runtime.cc:1230] 618638 InitStreamObserver: EngineStreamObserver:Runtime_alloc_size 8.
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.875.279 [runtime.cc:1242] 618638 InitAicpuStreamIdBitmap: Bitmap(1024):Runtime_alloc_size 72.
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.875.290 [runtime.cc:1264] 618638 InitCbSubscribe: The thread group num is 1024
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.875.300 [runtime.cc:1270] 618638 InitCbSubscribe: Runtime init:new CbSubscribe ok, Runtime_alloc_size 304.
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.875.399 [runtime.cc:109] 618638 Init: ObjAllocator alloc success, Runtime_alloc_size 160000(bytes)
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.875.750 [runtime.cc:121] 618638 Init: ObjAllocator alloc success, Runtime_alloc_size 960000(bytes)
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.875.816 [runtime.cc:1314] 618638 InitLabelAllocator: Runtime init:new LabelAllocator ok, Runtime_alloc_size 131152.
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.875.829 [runtime.cc:1322] 618638 InitSetRuntimeVersion: set runtime api ver success
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.875.932 [runtime.cc:1338] 618638 InitNpuCollectPath: NPU_COLLECT_PATH is not set!
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.875.989 [utils.cc:105] 618638 GetDriverPath: driver path is [Driver_Install_Path_Param=/usr/local/Ascend].
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.876.038 [runtime.cc:1664] 618638 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.876.069 [runtime.cc:1688] 618638 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.876.085 [runtime.cc:1953] 618638 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=preload_stack_16KB.
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.876.109 [runtime.cc:1477] 618638 FindAndRegisterDcacheLockOp: register lock op success
[INFO] PROFILING(618638,python3.9):2025-04-03-09:27:14.876.125 [prof_atls_plugin.cpp:210] (tid:618638) Module[7] register callback of ctrl handle.
[WARNING] RUNTIME(618638,python3.9):2025-04-03-09:27:14.876.139 [heterogenous.cc:19] 618638 ReadHeterogenousModeFromConfigIni: can not read ASCEND_LATEST_INSTALL_PATH! isHeterogenous=0.
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:14.876.174 [api_c_soc.cc:70] 618638 rtGetSocVersion: soc version is Ascend910B3
[INFO] ASCENDCL(618638,python3.9):2025-04-03-09:27:14.876.189 [acl.cpp:115]618638 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618638,python3.9):2025-04-03-09:27:14.876.200 [acl.cpp:760]618638 aclrtGetSocName: execute aclrtGetSocName successfully
[INFO] DEVICE(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:14.876.230 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:408] SetContextSocVersion] The soc version :Ascend910B3
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:14.904.715 [mindspore/ccsrc/pybind_api/utils/log_adapter_py.cc:27] PyExceptionInitializer] Set exception handler
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:14.934.842 [mindspore/ccsrc/pybind_api/init.cc:250] pybind11_init__c_expression] Start GraphExecutorPy...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:14.935.265 [mindspore/ccsrc/pybind_api/init.cc:316] pybind11_init__c_expression] Start JitExecutorPy...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:14.935.670 [mindspore/ccsrc/pybind_api/init.cc:381] pybind11_init__c_expression] Start ParallelContext...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:14.936.452 [mindspore/ccsrc/pybind_api/init.cc:515] pybind11_init__c_expression] Start CostModelContext...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:14.936.846 [mindspore/ccsrc/pybind_api/init.cc:617] pybind11_init__c_expression] Start OffloadContext...
[INFO] DEVICE(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:14.938.373 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/symbol_utils.cc:65] LoadAscendApiSymbols] Ascend api is already loaded.
[INFO] ASCENDCL(618638,python3.9):2025-04-03-09:27:14.938.415 [acl.cpp:753]618638 aclrtGetSocName: start to execute aclrtGetSocName.
[INFO] ASCENDCL(618638,python3.9):2025-04-03-09:27:14.938.438 [acl.cpp:115]618638 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618638,python3.9):2025-04-03-09:27:14.938.450 [acl.cpp:760]618638 aclrtGetSocName: execute aclrtGetSocName successfully
[INFO] DEVICE(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:14.938.470 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:408] SetContextSocVersion] The soc version :Ascend910B3
[WARNING] FE(618638,python3.9):2025-04-03-09:27:15.893.754 [platform_info.cpp:853]618638 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend310P5."
[WARNING] FE(618638,python3.9):2025-04-03-09:27:15.895.514 [platform_info.cpp:853]618638 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9362."
[WARNING] FE(618638,python3.9):2025-04-03-09:27:15.915.087 [platform_info.cpp:853]618638 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_95."
[WARNING] FE(618638,python3.9):2025-04-03-09:27:15.923.757 [platform_info.cpp:853]618638 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9382."
[WARNING] FE(618638,python3.9):2025-04-03-09:27:15.926.664 [platform_info.cpp:853]618638 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9361."
[WARNING] FE(618638,python3.9):2025-04-03-09:27:15.929.631 [platform_info.cpp:853]618638 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_5591."
[WARNING] FE(618638,python3.9):2025-04-03-09:27:15.957.095 [platform_info.cpp:853]618638 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9392."
[WARNING] FE(618638,python3.9):2025-04-03-09:27:15.971.426 [platform_info.cpp:853]618638 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend310P7."
[INFO] TBE(618638,python3.9):2025-04-03-09:27:16.735.768 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:59][decorator] Fusion pass[conv2d_data_rm_build_pass] of stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618638,python3.9):2025-04-03-09:27:16.737.434 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_conv3d] of op type[Conv3D] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618638,python3.9):2025-04-03-09:27:16.737.566 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:59][decorator] Fusion pass[trans_shape_depthwise_conv2d] of stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618638,python3.9):2025-04-03-09:27:16.739.675 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_for_elemwise] of op type[None] op pattern[ElemWise] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618638,python3.9):2025-04-03-09:27:16.739.807 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_for_broadcast] of op type[None] op pattern[Broadcast] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618638,python3.9):2025-04-03-09:27:16.739.921 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_biasadd] of op type[BiasAdd] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618638,python3.9):2025-04-03-09:27:16.740.057 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_requant_s16] of op type[AscendRequantS16] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618638,python3.9):2025-04-03-09:27:16.740.179 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_bninference] of op type[BNInferenceD] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618638,python3.9):2025-04-03-09:27:16.741.201 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_fully_connection] of op type[FullyConnection] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618638,python3.9):2025-04-03-09:27:16.741.331 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_fully_connection_compress] of op type[FullyConnectionCompress] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618638,python3.9):2025-04-03-09:27:16.743.127 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmul_bias_shape] of op type[MatMulV2] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618638,python3.9):2025-04-03-09:27:16.743.256 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmul_bias_shape] of op type[MatMul] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618638,python3.9):2025-04-03-09:27:16.743.368 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmulcompress_bias_shape] of op type[MatMulV2Compress] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618638,python3.9):2025-04-03-09:27:16.743.475 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_batch_matmul_shape] of op type[BatchMatMulV2] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618638,python3.9):2025-04-03-09:27:16.743.576 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_batch_matmul_shape] of op type[BatchMatMul] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618638,python3.9):2025-04-03-09:27:16.743.679 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_transdata_fixpipe] of op type[None] op pattern[BatchMatmul] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[WARNING] TBE(618638,python3.9):2025-04-03-09:27:17.326.992 [../../../../../../latest/python/site-packages/te/platform/cce_policy.py:50][OpImplPolicy] te.platform.cce_policy.OpImplPolicy is deprecated, use te_fusion.fusion_util.OpImplPolicy instead.
/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for <class 'numpy.float64'> type is zero.
  setattr(self, word, getattr(machar, word).flat[0])
/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for <class 'numpy.float64'> type is zero.
  return self._float_to_str(self.smallest_subnormal)
/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for <class 'numpy.float32'> type is zero.
  setattr(self, word, getattr(machar, word).flat[0])
/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for <class 'numpy.float32'> type is zero.
  return self._float_to_str(self.smallest_subnormal)
[INFO] TBE(618638,python3.9):2025-04-03-09:27:21.137.683 [../../../../../../latest/python/site-packages/tbe/common/rl_bank/dynamic_op_filter.py:373][_need_to_tune_all_op] Auto search dynamic filter info: tune_all_op is False.
[INFO] CORE(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:21.383.291 [mindspore/core/utils/ms_context.cc:306] SetDeviceTargetFromInner] ms set context device target:Ascend
[INFO] PARALLEL(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:21.383.345 [mindspore/ccsrc/frontend/parallel/costmodel_context.cc:30] GetInstance] Create costmodel_context
[INFO] CORE(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:21.383.366 [mindspore/core/utils/ms_context.cc:310] SetDeviceTargetFromInner] Set memory_optimize_level to O0 as default on other device
[INFO] GE(618638,python3.9):2025-04-03-09:27:21.429.293 [ops_kernel_builder_registry.cc:55]618638 OpsKernelBuilderRegistrar:Register kernel lib name = ops_kernel_info_hccl
[INFO] GE(618638,python3.9):2025-04-03-09:27:21.429.374 [ops_kernel_builder_registry.cc:28]618638 Register:Register OpsKernelBuilder successfully, kernel lib name = ops_kernel_info_hccl
[INFO] CORE(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:21.459.610 [mindspore/core/utils/ms_context.cc:839] UseNewBackend] Use the new backend.
[INFO] DEVICE(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:21.459.673 [mindspore/ccsrc/runtime/pynative/lazy_fusion.cc:27] Init] Start init lazy fusion.
[INFO] KERNEL(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:21.459.723 [mindspore/ccsrc/plugin/device/ascend/kernel/dvm/lazy_fusion_flags.cc:174] LazyFusionFlags] lazy_fusion_flags :{"disable_ops":[],"dump_as_text":false,"enable_ops_only":[],"flush_threshold":100,"online_tuning":false,"opt_level":0,"synchronize":false}
[INFO] KERNEL(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:21.459.741 [mindspore/ccsrc/plugin/device/ascend/kernel/dvm/lazy_fusion_op.cc:1636] LazyFusionAscendInit] Skip init lazy fusion.
[INFO] DEVICE(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:21.459.755 [mindspore/ccsrc/runtime/pynative/lazy_fusion.cc:31] Init] End init lazy fusion.
[WARNING] TBE(618638,python3.9):2025-04-03-09:27:22.153.306 [../../../../../../latest/python/site-packages/te/tik/__init__.py:51][<module>] 'from te import tik' is deprecated, please replace it with 'from tbe import tik'.
[INFO] ME(618638:281473865735648,MainProcess):2025-04-03-09:27:23.711.908 [mindspore/profiler/common/registry.py:36] registered module: CpuProfiler with name: CPU
[INFO] ME(618638:281473865735648,MainProcess):2025-04-03-09:27:23.712.467 [mindspore/profiler/common/registry.py:36] registered module: GpuProfiler with name: GPU
[INFO] ME(618638:281473865735648,MainProcess):2025-04-03-09:27:23.721.884 [mindspore/profiler/common/registry.py:36] registered module: NpuProfiler with name: Ascend
[INFO] ME(618638:281473865735648,MainProcess):2025-04-03-09:27:23.867.788 [mindspore/parallel/cluster/process_entity/_utils.py:107] IP address found on this node. Address info:{'family': 'inet', 'local': '127.0.0.1', 'prefixlen': 8, 'scope': 'host', 'label': 'lo', 'valid_life_time': 4294967295, 'preferred_life_time': 4294967295}. Found address:127.0.0.1
[WARNING] ME(618638:281473865735648,MainProcess):2025-04-03-09:27:23.868.819 [mindspore/parallel/cluster/process_entity/_api.py:219] mindx is not installed, using original mindspore recovery strategy.: No module named 'taskd'
Start worker process with rank id:0, log file:./output_allreduce/worker_0.log. Environment variable [RANK_ID=0] is exported.
Start worker process with rank id:1, log file:./output_allreduce/worker_1.log. Environment variable [RANK_ID=1] is exported.
Start worker process with rank id:2, log file:./output_allreduce/worker_2.log. Environment variable [RANK_ID=2] is exported.
Start worker process with rank id:3, log file:./output_allreduce/worker_3.log. Environment variable [RANK_ID=3] is exported.
Start worker process with rank id:4, log file:./output_allreduce/worker_4.log. Environment variable [RANK_ID=4] is exported.
Start worker process with rank id:5, log file:./output_allreduce/worker_5.log. Environment variable [RANK_ID=5] is exported.
Start worker process with rank id:6, log file:./output_allreduce/worker_6.log. Environment variable [RANK_ID=6] is exported.
Start worker process with rank id:7, log file:./output_allreduce/worker_7.log. Environment variable [RANK_ID=7] is exported.
[WARNING] ME(618638:281473865735648,MainProcess):2025-04-03-09:27:24.303.786 [mindspore/parallel/cluster/process_entity/_api.py:246] Distributed job is spawned. Waiting all processes to exit...
[INFO] DEBUG(618646,ffff85d12de0,python3.9):2025-04-03-09:27:25.176.888 [mindspore/ccsrc/debug/data_dump/data_dumper.cc:43] CpuDumpRegister] Register DataDumper for cpu backend.
[INFO] CORE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:25.191.222 [mindspore/core/utils/ms_context.cc:105] SetDeviceId] Set MS_CTX_DEVICE_ID by env DEVICE_ID to: 0
[INFO] DEBUG(618650,ffffbf562de0,python3.9):2025-04-03-09:27:25.193.409 [mindspore/ccsrc/debug/data_dump/data_dumper.cc:43] CpuDumpRegister] Register DataDumper for cpu backend.
[INFO] CORE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:25.211.306 [mindspore/core/utils/ms_context.cc:105] SetDeviceId] Set MS_CTX_DEVICE_ID by env DEVICE_ID to: 1
[INFO] DEBUG(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:25.288.964 [mindspore/ccsrc/debug/data_dump/data_dumper.cc:43] CpuDumpRegister] Register DataDumper for cpu backend.
[INFO] CORE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:25.304.286 [mindspore/core/utils/ms_context.cc:105] SetDeviceId] Set MS_CTX_DEVICE_ID by env DEVICE_ID to: 2
[INFO] DEBUG(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:25.307.044 [mindspore/ccsrc/debug/data_dump/data_dumper.cc:43] CpuDumpRegister] Register DataDumper for cpu backend.
[INFO] CORE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:25.320.602 [mindspore/core/utils/ms_context.cc:105] SetDeviceId] Set MS_CTX_DEVICE_ID by env DEVICE_ID to: 3
[INFO] DEBUG(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:25.357.620 [mindspore/ccsrc/debug/data_dump/data_dumper.cc:43] CpuDumpRegister] Register DataDumper for cpu backend.
[INFO] CORE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:25.371.114 [mindspore/core/utils/ms_context.cc:105] SetDeviceId] Set MS_CTX_DEVICE_ID by env DEVICE_ID to: 4
[INFO] DEBUG(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:25.408.068 [mindspore/ccsrc/debug/data_dump/data_dumper.cc:43] CpuDumpRegister] Register DataDumper for cpu backend.
[INFO] CORE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:25.421.668 [mindspore/core/utils/ms_context.cc:105] SetDeviceId] Set MS_CTX_DEVICE_ID by env DEVICE_ID to: 5
[INFO] DEBUG(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:25.435.309 [mindspore/ccsrc/debug/data_dump/data_dumper.cc:43] CpuDumpRegister] Register DataDumper for cpu backend.
[INFO] CORE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:25.448.766 [mindspore/core/utils/ms_context.cc:105] SetDeviceId] Set MS_CTX_DEVICE_ID by env DEVICE_ID to: 6
[INFO] DEBUG(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:25.490.796 [mindspore/ccsrc/debug/data_dump/data_dumper.cc:43] CpuDumpRegister] Register DataDumper for cpu backend.
[INFO] CORE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:25.504.204 [mindspore/core/utils/ms_context.cc:105] SetDeviceId] Set MS_CTX_DEVICE_ID by env DEVICE_ID to: 7
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.586.797 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.586.993 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.039 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.058 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.079 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.099 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.122 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.140 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.158 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.176 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.193 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.209 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.226 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.243 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.259 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.278 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.294 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.309 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.327 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.343 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.358 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_UINT8,DT_INT16,DT_INT64,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.393 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.409 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.424 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.441 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T1 for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.454 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.479 [ir_data_type_symbol_store.cc:240]618646 DeclareSymbol:Bind symbol T1 with ordered list-dtypes [DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_INT4,DT_UINT8,DT_INT8,DT_INT16,DT_INT16,DT_INT32,DT_INT32,DT_INT32,DT_INT32,DT_INT64,DT_INT64,DT_FLOAT,DT_BFLOAT16,DT_BFLOAT16,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.500 [ir_data_type_symbol_store.cc:240]618646 DeclareSymbol:Bind symbol T2 with ordered list-dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,DT_INT32,DT_INT16,DT_FLOAT,DT_INT32,DT_INT16,DT_INT8,DT_UINT8,DT_INT4,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT,DT_FLOAT,DT_INT64,DT_INT16,DT_FLOAT16,DT_INT32,DT_FLOAT,DT_BFLOAT16,DT_FLOAT,DT_INT32,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.519 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.535 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.549 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.568 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.584 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.597 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.614 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.630 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.643 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.663 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.678 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.692 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.709 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.725 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.739 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.760 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.773 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.789 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.808 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.824 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.837 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.854 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.866 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.882 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.896 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T1 for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.911 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.926 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.941 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.957 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.973 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.587.987 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.004 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.019 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.033 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.049 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.062 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.078 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.095 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.110 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.123 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.144 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.187 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.208 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.227 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.243 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.256 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.271 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.286 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.300 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.316 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.330 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.345 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.362 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.377 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.390 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.406 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.419 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.434 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.447 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.464 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.479 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.492 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.508 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.525 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.541 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.554 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.575 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.588 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.604 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.617 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.633 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.647 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.660 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.675 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.691 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.705 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.721 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.733 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.749 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.763 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.778 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.790 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.803 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.825 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.841 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.854 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.870 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.884 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.900 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.916 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.927 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.951 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.965 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.983 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.588.999 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.011 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.024 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.038 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.054 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.065 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x3
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.079 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.094 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.110 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.125 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.137 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.155 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.171 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.186 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.201 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.213 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.229 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.242 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.259 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.272 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.286 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.301 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.317 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.339 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.352 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.367 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.381 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.396 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.411 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.422 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.434 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.452 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.468 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.483 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.499 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.518 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.538 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Dynamic input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.554 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.570 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.587 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.603 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T2 for Required input x2
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.615 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T2 for Required input x3
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.631 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.645 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_UINT8,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.661 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.675 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.691 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T2 for Required input x2
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.711 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T2 for Required input x3
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.723 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.739 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_UINT8,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.754 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.772 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.784 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.802 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.818 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.831 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.850 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.867 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.880 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.895 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.912 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.942 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.958 [ir_data_type_symbol_store.cc:173]618646 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.971 [ir_data_type_symbol_store.cc:219]618646 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.589.991 [ir_data_type_symbol_store.cc:182]618646 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:25.596.834 [awatchdog_core.c:99](tid:618646) watchdog get platform host side
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:25.597.019 [awatchdog_monitor.c:127](tid:618646) create monitor thread successfully, tid :281472289578912 
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:25.597.043 [awatchdog_monitor.c:226](tid:618646) AwdMonitorInit
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:25.597.241 [trace_attr.c:99](tid:618646) doesn't set env ASCEND_LOG_DEVICE_FLUSH_TIMEOUT, use default timeout=0ms.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:25.597.272 [trace_attr.c:189](tid:618646) attr init success, timeout=0ms.
[WARNING] ATRACE(618646,python3.9):2025-04-03-09:27:25.597.287 [trace_system_api.c:115](tid:618646) env ASCEND_WORK_PATH is null.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:25.597.347 [trace_recorder.c:40](tid:618646) home_directory=/home/jenkins.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:25.597.365 [trace_recorder.c:121](tid:618646) use root path: /home/jenkins/ascend
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:25.597.377 [trace_event.c:151](tid:618646) init trace event success
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:25.597.428 [atrace_client_core.c:185](tid:618646) atrace client init success.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:25.598.720 [stacktrace_dumper.c:218](tid:618646) path = /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/bin/asc_dumper
[WARNING] ATRACE(618646,python3.9):2025-04-03-09:27:25.598.744 [trace_system_api.c:115](tid:618646) env ASCEND_COREDUMP_SIGNAL is null.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:25.598.839 [stacktrace_signal.c:165](tid:618646) register signal handler for signo 2 succeed.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:25.598.857 [stacktrace_signal.c:165](tid:618646) register signal handler for signo 15 succeed.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:25.598.869 [stacktrace_signal.c:165](tid:618646) register signal handler for signo 3 succeed.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:25.598.881 [stacktrace_signal.c:165](tid:618646) register signal handler for signo 4 succeed.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:25.598.895 [stacktrace_signal.c:165](tid:618646) register signal handler for signo 5 succeed.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:25.598.907 [stacktrace_signal.c:165](tid:618646) register signal handler for signo 6 succeed.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:25.598.919 [stacktrace_signal.c:165](tid:618646) register signal handler for signo 7 succeed.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:25.598.933 [stacktrace_signal.c:165](tid:618646) register signal handler for signo 8 succeed.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:25.598.945 [stacktrace_signal.c:165](tid:618646) register signal handler for signo 11 succeed.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:25.598.959 [stacktrace_signal.c:165](tid:618646) register signal handler for signo 24 succeed.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:25.598.970 [stacktrace_signal.c:165](tid:618646) register signal handler for signo 25 succeed.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:25.598.983 [stacktrace_signal.c:165](tid:618646) register signal handler for signo 31 succeed.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:25.598.998 [stacktrace_signal.c:165](tid:618646) register signal handler for signo 35 succeed.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:25.599.009 [stacktrace_signal.c:168](tid:618646) trace signal init succeed.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:25.599.020 [trace_core.c:51](tid:618646) trace init success.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.599.711 [task_fail_callback_data_manager.cc:58] 618646 TaskFailCallBackManager: Constructor.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.609.544 [operator_factory_impl.cc:232]618646 RegisterInferShapeV2Func:operator infer shape v2 funcs init
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.609.579 [operator_factory_impl.cc:246]618646 RegisterInferShapeRangeFunc:operator infer shape range funcs init
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.609.590 [operator_factory_impl.cc:239]618646 RegisterInferDataTypeFunc:operator infer data type funcs init
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:25.616.833 [adapter_rts.cc:2720] [618646][adapter_rts.cc][CallBackInitRts] g_deviceType [6] g_deviceLogicId [-1] g_devicePhyId [-1]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.104 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.226 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.277 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.299 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.321 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.340 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.357 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.379 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.398 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.417 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.434 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.455 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.473 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.491 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.513 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.533 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.550 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.567 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.586 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.604 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.620 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_UINT8,DT_INT16,DT_INT64,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.667 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.686 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.706 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.725 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T1 for Required input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.742 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.774 [ir_data_type_symbol_store.cc:240]618650 DeclareSymbol:Bind symbol T1 with ordered list-dtypes [DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_INT4,DT_UINT8,DT_INT8,DT_INT16,DT_INT16,DT_INT32,DT_INT32,DT_INT32,DT_INT32,DT_INT64,DT_INT64,DT_FLOAT,DT_BFLOAT16,DT_BFLOAT16,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.795 [ir_data_type_symbol_store.cc:240]618650 DeclareSymbol:Bind symbol T2 with ordered list-dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,DT_INT32,DT_INT16,DT_FLOAT,DT_INT32,DT_INT16,DT_INT8,DT_UINT8,DT_INT4,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT,DT_FLOAT,DT_INT64,DT_INT16,DT_FLOAT16,DT_INT32,DT_FLOAT,DT_BFLOAT16,DT_FLOAT,DT_INT32,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.814 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.831 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.847 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.867 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.884 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.898 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.917 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.934 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.948 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.966 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.982 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.625.998 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.017 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.034 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.049 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.073 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.087 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.102 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.120 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.137 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.153 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.171 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.186 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.200 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.218 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T1 for Required input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.235 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.250 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.267 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.283 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.301 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.319 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.338 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.356 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.371 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.388 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.405 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.423 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.440 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.457 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.471 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.494 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.508 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.526 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.545 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.562 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.577 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.597 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.613 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.628 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.643 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.659 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.672 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.688 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.705 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.724 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.741 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.760 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.772 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.788 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.806 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.824 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.838 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.856 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.873 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.891 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.908 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.939 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.959 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.977 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.626.990 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.009 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.028 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.045 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.059 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.073 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.091 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.108 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.123 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.141 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.160 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.177 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.191 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.210 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.229 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.246 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.260 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.281 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.298 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.314 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.331 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.346 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.372 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.391 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.407 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.426 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.443 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.456 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.475 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.492 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.504 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x3
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.518 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.533 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.553 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.570 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.583 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.601 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.621 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.639 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.657 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.670 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.687 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.705 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.719 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.736 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.750 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.768 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.787 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.811 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.825 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.840 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.858 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.875 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.890 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.907 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.920 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.934 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.949 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.968 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.627.985 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.005 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.028 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Dynamic input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.045 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.062 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.081 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.098 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T2 for Required input x2
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.112 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T2 for Required input x3
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.129 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.142 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_UINT8,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.201 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.226 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.243 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T2 for Required input x2
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.273 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T2 for Required input x3
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.293 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.314 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_UINT8,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.333 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.351 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.368 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.385 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.402 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.419 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.436 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.455 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.472 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.492 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.511 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.543 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.561 [ir_data_type_symbol_store.cc:173]618650 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.579 [ir_data_type_symbol_store.cc:219]618650 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.628.602 [ir_data_type_symbol_store.cc:182]618650 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.632.684 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Allreduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.632.759 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Reduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.632.789 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:25.635.738 [awatchdog_core.c:99](tid:618650) watchdog get platform host side
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:25.635.910 [awatchdog_monitor.c:127](tid:618650) create monitor thread successfully, tid :281473254596512 
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:25.635.936 [awatchdog_monitor.c:226](tid:618650) AwdMonitorInit
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:25.636.134 [trace_attr.c:99](tid:618650) doesn't set env ASCEND_LOG_DEVICE_FLUSH_TIMEOUT, use default timeout=0ms.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:25.636.215 [trace_attr.c:189](tid:618650) attr init success, timeout=0ms.
[WARNING] ATRACE(618650,python3.9):2025-04-03-09:27:25.636.239 [trace_system_api.c:115](tid:618650) env ASCEND_WORK_PATH is null.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:25.636.306 [trace_recorder.c:40](tid:618650) home_directory=/home/jenkins.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:25.636.325 [trace_recorder.c:121](tid:618650) use root path: /home/jenkins/ascend
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:25.636.338 [trace_event.c:151](tid:618650) init trace event success
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:25.636.390 [atrace_client_core.c:185](tid:618650) atrace client init success.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:25.637.758 [stacktrace_dumper.c:218](tid:618650) path = /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/bin/asc_dumper
[WARNING] ATRACE(618650,python3.9):2025-04-03-09:27:25.637.782 [trace_system_api.c:115](tid:618650) env ASCEND_COREDUMP_SIGNAL is null.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:25.637.868 [stacktrace_signal.c:165](tid:618650) register signal handler for signo 2 succeed.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:25.637.888 [stacktrace_signal.c:165](tid:618650) register signal handler for signo 15 succeed.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:25.637.902 [stacktrace_signal.c:165](tid:618650) register signal handler for signo 3 succeed.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:25.637.916 [stacktrace_signal.c:165](tid:618650) register signal handler for signo 4 succeed.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:25.637.932 [stacktrace_signal.c:165](tid:618650) register signal handler for signo 5 succeed.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:25.637.945 [stacktrace_signal.c:165](tid:618650) register signal handler for signo 6 succeed.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:25.637.958 [stacktrace_signal.c:165](tid:618650) register signal handler for signo 7 succeed.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:25.637.975 [stacktrace_signal.c:165](tid:618650) register signal handler for signo 8 succeed.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:25.637.990 [stacktrace_signal.c:165](tid:618650) register signal handler for signo 11 succeed.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:25.638.007 [stacktrace_signal.c:165](tid:618650) register signal handler for signo 24 succeed.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:25.638.021 [stacktrace_signal.c:165](tid:618650) register signal handler for signo 25 succeed.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:25.638.038 [stacktrace_signal.c:165](tid:618650) register signal handler for signo 31 succeed.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:25.638.051 [stacktrace_signal.c:165](tid:618650) register signal handler for signo 35 succeed.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:25.638.064 [stacktrace_signal.c:168](tid:618650) trace signal init succeed.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:25.638.079 [trace_core.c:51](tid:618650) trace init success.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:25.638.802 [task_fail_callback_data_manager.cc:58] 618650 TaskFailCallBackManager: Constructor.
[INFO] PROFILING(618646,python3.9):2025-04-03-09:27:25.643.739 [prof_cann_plugin.cpp:256] (tid:618646) Register module[6] callback.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.649.287 [operator_factory_impl.cc:232]618650 RegisterInferShapeV2Func:operator infer shape v2 funcs init
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.649.325 [operator_factory_impl.cc:246]618650 RegisterInferShapeRangeFunc:operator infer shape range funcs init
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.649.338 [operator_factory_impl.cc:239]618650 RegisterInferDataTypeFunc:operator infer data type funcs init
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:25.656.915 [adapter_rts.cc:2720] [618650][adapter_rts.cc][CallBackInitRts] g_deviceType [6] g_deviceLogicId [-1] g_devicePhyId [-1]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.673.236 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Allreduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.673.299 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Reduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.673.332 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] PROFILING(618650,python3.9):2025-04-03-09:27:25.684.722 [prof_cann_plugin.cpp:256] (tid:618650) Register module[6] callback.
[INFO] OP(618646,python3.9):2025-04-03-09:27:25.694.080 [nnopbase_args_pool.cpp:123][NNOP][GetCacheSizeLimit][618646] cachelimit is 10000
[INFO] OP(618646,python3.9):2025-04-03-09:27:25.697.968 [op_dfx.cpp:230][NNOP][RecordOpArgCallback][618646] RecordOpArgCallback, get record op arg flag = 0
[INFO] OP(618646,python3.9):2025-04-03-09:27:25.698.015 [op_dfx.cpp:54][NNOP][SystemConfig][618646] enable debug kernel flag 0.
[INFO] PROFILING(618646,python3.9):2025-04-03-09:27:25.698.035 [prof_cann_plugin.cpp:256] (tid:618646) Register module[61] callback.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.715.933 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.032 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.078 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.102 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.124 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.145 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.205 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.221 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.234 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.251 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.269 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.285 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.304 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.321 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.336 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.356 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.371 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.391 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.410 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.424 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.436 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_UINT8,DT_INT16,DT_INT64,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.481 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.496 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.515 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.533 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T1 for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.550 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.580 [ir_data_type_symbol_store.cc:240]618654 DeclareSymbol:Bind symbol T1 with ordered list-dtypes [DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_INT4,DT_UINT8,DT_INT8,DT_INT16,DT_INT16,DT_INT32,DT_INT32,DT_INT32,DT_INT32,DT_INT64,DT_INT64,DT_FLOAT,DT_BFLOAT16,DT_BFLOAT16,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.600 [ir_data_type_symbol_store.cc:240]618654 DeclareSymbol:Bind symbol T2 with ordered list-dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,DT_INT32,DT_INT16,DT_FLOAT,DT_INT32,DT_INT16,DT_INT8,DT_UINT8,DT_INT4,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT,DT_FLOAT,DT_INT64,DT_INT16,DT_FLOAT16,DT_INT32,DT_FLOAT,DT_BFLOAT16,DT_FLOAT,DT_INT32,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.618 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.632 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.649 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.671 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.688 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.703 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.721 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.735 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.752 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.767 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.782 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.797 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.817 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.832 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.848 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.871 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.884 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.899 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.914 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.930 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.943 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.958 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.974 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.716.989 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.007 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T1 for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.021 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.039 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.052 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.070 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.084 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.100 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.116 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.134 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.149 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.165 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.178 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.195 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.209 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.225 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.244 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.267 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.281 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.295 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.312 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.326 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.342 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.358 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.374 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.389 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.406 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.421 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.436 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.451 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.465 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.481 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.495 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.512 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.524 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.541 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.558 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.572 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.587 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.602 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.618 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.632 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.648 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.678 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.693 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.708 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.724 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.738 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.755 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.769 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.785 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.798 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.813 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.829 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.841 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.858 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.875 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.890 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.905 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.919 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.934 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.950 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.963 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.979 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.717.995 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.012 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.028 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.041 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.069 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.083 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.099 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.115 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.128 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.142 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.159 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.175 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.191 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x3
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.203 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.218 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.236 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.252 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.266 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.280 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.296 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.311 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.327 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.340 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.357 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.373 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.388 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.404 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.417 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.432 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.443 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.466 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.480 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.494 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.510 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.526 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.541 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.557 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.570 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.585 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.601 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.614 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.630 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.651 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.672 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Dynamic input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.689 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.704 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.721 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.734 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T2 for Required input x2
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.750 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T2 for Required input x3
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.765 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.781 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_UINT8,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.796 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.810 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.822 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T2 for Required input x2
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.851 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T2 for Required input x3
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.865 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.881 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_UINT8,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.898 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.913 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.930 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.950 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.968 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.982 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.718.999 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.719.014 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.719.030 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.719.043 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.719.064 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.719.092 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.719.109 [ir_data_type_symbol_store.cc:173]618654 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.719.122 [ir_data_type_symbol_store.cc:219]618654 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.719.144 [ir_data_type_symbol_store.cc:182]618654 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:25.726.190 [awatchdog_core.c:99](tid:618654) watchdog get platform host side
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:25.726.355 [awatchdog_monitor.c:127](tid:618654) create monitor thread successfully, tid :281472440713120 
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:25.726.380 [awatchdog_monitor.c:226](tid:618654) AwdMonitorInit
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:25.726.573 [trace_attr.c:99](tid:618654) doesn't set env ASCEND_LOG_DEVICE_FLUSH_TIMEOUT, use default timeout=0ms.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:25.726.604 [trace_attr.c:189](tid:618654) attr init success, timeout=0ms.
[WARNING] ATRACE(618654,python3.9):2025-04-03-09:27:25.726.619 [trace_system_api.c:115](tid:618654) env ASCEND_WORK_PATH is null.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:25.726.676 [trace_recorder.c:40](tid:618654) home_directory=/home/jenkins.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:25.726.694 [trace_recorder.c:121](tid:618654) use root path: /home/jenkins/ascend
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:25.726.708 [trace_event.c:151](tid:618654) init trace event success
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:25.726.757 [atrace_client_core.c:185](tid:618654) atrace client init success.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:25.728.126 [stacktrace_dumper.c:218](tid:618654) path = /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/bin/asc_dumper
[WARNING] ATRACE(618654,python3.9):2025-04-03-09:27:25.728.150 [trace_system_api.c:115](tid:618654) env ASCEND_COREDUMP_SIGNAL is null.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:25.728.290 [stacktrace_signal.c:165](tid:618654) register signal handler for signo 2 succeed.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:25.728.311 [stacktrace_signal.c:165](tid:618654) register signal handler for signo 15 succeed.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:25.728.323 [stacktrace_signal.c:165](tid:618654) register signal handler for signo 3 succeed.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:25.728.336 [stacktrace_signal.c:165](tid:618654) register signal handler for signo 4 succeed.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:25.728.349 [stacktrace_signal.c:165](tid:618654) register signal handler for signo 5 succeed.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:25.728.364 [stacktrace_signal.c:165](tid:618654) register signal handler for signo 6 succeed.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:25.728.376 [stacktrace_signal.c:165](tid:618654) register signal handler for signo 7 succeed.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:25.728.388 [stacktrace_signal.c:165](tid:618654) register signal handler for signo 8 succeed.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:25.728.401 [stacktrace_signal.c:165](tid:618654) register signal handler for signo 11 succeed.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:25.728.417 [stacktrace_signal.c:165](tid:618654) register signal handler for signo 24 succeed.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:25.728.429 [stacktrace_signal.c:165](tid:618654) register signal handler for signo 25 succeed.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:25.728.440 [stacktrace_signal.c:165](tid:618654) register signal handler for signo 31 succeed.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:25.728.453 [stacktrace_signal.c:165](tid:618654) register signal handler for signo 35 succeed.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:25.728.467 [stacktrace_signal.c:168](tid:618654) trace signal init succeed.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:25.728.479 [trace_core.c:51](tid:618654) trace init success.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:25.729.201 [task_fail_callback_data_manager.cc:58] 618654 TaskFailCallBackManager: Constructor.
[INFO] OP(618650,python3.9):2025-04-03-09:27:25.735.889 [nnopbase_args_pool.cpp:123][NNOP][GetCacheSizeLimit][618650] cachelimit is 10000
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.330 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.438 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.485 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.506 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.529 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.549 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.570 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.587 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.605 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.623 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.641 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.659 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.676 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.692 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.708 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.727 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.742 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.758 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.778 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.794 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.810 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_UINT8,DT_INT16,DT_INT64,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.843 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.856 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.872 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.889 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T1 for Required input x
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.907 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.940 [ir_data_type_symbol_store.cc:240]618658 DeclareSymbol:Bind symbol T1 with ordered list-dtypes [DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_INT4,DT_UINT8,DT_INT8,DT_INT16,DT_INT16,DT_INT32,DT_INT32,DT_INT32,DT_INT32,DT_INT64,DT_INT64,DT_FLOAT,DT_BFLOAT16,DT_BFLOAT16,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.959 [ir_data_type_symbol_store.cc:240]618658 DeclareSymbol:Bind symbol T2 with ordered list-dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,DT_INT32,DT_INT16,DT_FLOAT,DT_INT32,DT_INT16,DT_INT8,DT_UINT8,DT_INT4,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT,DT_FLOAT,DT_INT64,DT_INT16,DT_FLOAT16,DT_INT32,DT_FLOAT,DT_BFLOAT16,DT_FLOAT,DT_INT32,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.977 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.738.991 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.008 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.024 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.039 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.053 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.071 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.086 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.099 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.114 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.129 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.141 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.160 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.175 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.188 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.216 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.232 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.246 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.264 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.278 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.291 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.307 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.739.276 [operator_factory_impl.cc:232]618654 RegisterInferShapeV2Func:operator infer shape v2 funcs init
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.739.311 [operator_factory_impl.cc:246]618654 RegisterInferShapeRangeFunc:operator infer shape range funcs init
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.739.329 [operator_factory_impl.cc:239]618654 RegisterInferDataTypeFunc:operator infer data type funcs init
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.322 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.338 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.354 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T1 for Required input x
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.370 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.384 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.399 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.413 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.429 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.444 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.460 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.474 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.492 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.508 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.523 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.539 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.555 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.570 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.584 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.607 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.624 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.636 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.650 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.665 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.678 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.698 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.713 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.725 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.741 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.757 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.769 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.783 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.798 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.811 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.825 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.840 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.852 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.868 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.885 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.899 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.914 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.927 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.946 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.962 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.974 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.739.999 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.017 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.031 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.044 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.060 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.076 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.090 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.106 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.119 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.134 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.149 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.207 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.224 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] OP(618650,python3.9):2025-04-03-09:27:25.740.149 [op_dfx.cpp:230][NNOP][RecordOpArgCallback][618650] RecordOpArgCallback, get record op arg flag = 0
[INFO] OP(618650,python3.9):2025-04-03-09:27:25.740.245 [op_dfx.cpp:54][NNOP][SystemConfig][618650] enable debug kernel flag 0.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.245 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.262 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x2
[INFO] PROFILING(618650,python3.9):2025-04-03-09:27:25.740.267 [prof_cann_plugin.cpp:256] (tid:618650) Register module[61] callback.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.278 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.294 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.310 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.324 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.339 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.353 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.369 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.383 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.400 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.413 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.430 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.444 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.458 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.474 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.485 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.501 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.517 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.531 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.547 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x3
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.558 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.578 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.596 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.612 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.624 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.638 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.654 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.667 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.683 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.694 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.711 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.726 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.740 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.755 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.767 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.785 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.799 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.829 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.847 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.861 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.879 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.895 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.909 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.924 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.936 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.951 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.966 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.980 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.740.996 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.015 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.037 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Dynamic input x
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.052 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.068 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.085 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.099 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T2 for Required input x2
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.114 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T2 for Required input x3
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.127 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.145 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_UINT8,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.162 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.178 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.191 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T2 for Required input x2
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.213 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T2 for Required input x3
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.225 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.238 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_UINT8,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.254 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.269 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.284 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.301 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.318 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.332 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.349 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.363 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.379 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.390 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.410 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.438 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.454 [ir_data_type_symbol_store.cc:173]618658 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.466 [ir_data_type_symbol_store.cc:219]618658 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.741.486 [ir_data_type_symbol_store.cc:182]618658 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:25.746.735 [adapter_rts.cc:2720] [618654][adapter_rts.cc][CallBackInitRts] g_deviceType [6] g_deviceLogicId [-1] g_devicePhyId [-1]
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:25.748.669 [awatchdog_core.c:99](tid:618658) watchdog get platform host side
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:25.748.798 [awatchdog_monitor.c:127](tid:618658) create monitor thread successfully, tid :281473079037856 
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:25.748.821 [awatchdog_monitor.c:226](tid:618658) AwdMonitorInit
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:25.749.018 [trace_attr.c:99](tid:618658) doesn't set env ASCEND_LOG_DEVICE_FLUSH_TIMEOUT, use default timeout=0ms.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:25.749.053 [trace_attr.c:189](tid:618658) attr init success, timeout=0ms.
[WARNING] ATRACE(618658,python3.9):2025-04-03-09:27:25.749.069 [trace_system_api.c:115](tid:618658) env ASCEND_WORK_PATH is null.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:25.749.125 [trace_recorder.c:40](tid:618658) home_directory=/home/jenkins.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:25.749.143 [trace_recorder.c:121](tid:618658) use root path: /home/jenkins/ascend
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:25.749.155 [trace_event.c:151](tid:618658) init trace event success
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:25.749.204 [atrace_client_core.c:185](tid:618658) atrace client init success.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:25.750.520 [stacktrace_dumper.c:218](tid:618658) path = /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/bin/asc_dumper
[WARNING] ATRACE(618658,python3.9):2025-04-03-09:27:25.750.543 [trace_system_api.c:115](tid:618658) env ASCEND_COREDUMP_SIGNAL is null.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:25.750.620 [stacktrace_signal.c:165](tid:618658) register signal handler for signo 2 succeed.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:25.750.639 [stacktrace_signal.c:165](tid:618658) register signal handler for signo 15 succeed.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:25.750.650 [stacktrace_signal.c:165](tid:618658) register signal handler for signo 3 succeed.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:25.750.663 [stacktrace_signal.c:165](tid:618658) register signal handler for signo 4 succeed.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:25.750.677 [stacktrace_signal.c:165](tid:618658) register signal handler for signo 5 succeed.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:25.750.688 [stacktrace_signal.c:165](tid:618658) register signal handler for signo 6 succeed.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:25.750.700 [stacktrace_signal.c:165](tid:618658) register signal handler for signo 7 succeed.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:25.750.712 [stacktrace_signal.c:165](tid:618658) register signal handler for signo 8 succeed.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:25.750.725 [stacktrace_signal.c:165](tid:618658) register signal handler for signo 11 succeed.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:25.750.737 [stacktrace_signal.c:165](tid:618658) register signal handler for signo 24 succeed.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:25.750.752 [stacktrace_signal.c:165](tid:618658) register signal handler for signo 25 succeed.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:25.750.763 [stacktrace_signal.c:165](tid:618658) register signal handler for signo 31 succeed.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:25.750.775 [stacktrace_signal.c:165](tid:618658) register signal handler for signo 35 succeed.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:25.750.789 [stacktrace_signal.c:168](tid:618658) trace signal init succeed.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:25.750.800 [trace_core.c:51](tid:618658) trace init success.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:25.751.540 [task_fail_callback_data_manager.cc:58] 618658 TaskFailCallBackManager: Constructor.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.752.322 [mem_manager.cc:138]618646 RegisterAllocatorManager:MemManager RegisterAllocatorManager.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.759.449 [cache_policy.cc:47]618646 Create:[CachePolicy] Create CachePolicy with match_policy: 0, aging_policy: 0 success;
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.761.968 [operator_factory_impl.cc:232]618658 RegisterInferShapeV2Func:operator infer shape v2 funcs init
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.762.000 [operator_factory_impl.cc:246]618658 RegisterInferShapeRangeFunc:operator infer shape range funcs init
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.762.013 [operator_factory_impl.cc:239]618658 RegisterInferDataTypeFunc:operator infer data type funcs init
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.762.956 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Allreduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.763.028 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Reduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.763.061 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:25.769.639 [adapter_rts.cc:2720] [618658][adapter_rts.cc][CallBackInitRts] g_deviceType [6] g_deviceLogicId [-1] g_devicePhyId [-1]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.771.420 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.771.537 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.771.582 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.771.605 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.771.626 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.771.647 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.771.668 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.771.689 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.771.708 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.771.726 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.771.742 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.771.759 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.771.777 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.771.793 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.771.810 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.771.829 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.771.845 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.771.859 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.771.875 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.771.893 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.771.908 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_UINT8,DT_INT16,DT_INT64,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.771.949 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.771.969 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.771.988 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.007 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T1 for Required input x
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.022 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.053 [ir_data_type_symbol_store.cc:240]618662 DeclareSymbol:Bind symbol T1 with ordered list-dtypes [DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_INT4,DT_UINT8,DT_INT8,DT_INT16,DT_INT16,DT_INT32,DT_INT32,DT_INT32,DT_INT32,DT_INT64,DT_INT64,DT_FLOAT,DT_BFLOAT16,DT_BFLOAT16,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.074 [ir_data_type_symbol_store.cc:240]618662 DeclareSymbol:Bind symbol T2 with ordered list-dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,DT_INT32,DT_INT16,DT_FLOAT,DT_INT32,DT_INT16,DT_INT8,DT_UINT8,DT_INT4,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT,DT_FLOAT,DT_INT64,DT_INT16,DT_FLOAT16,DT_INT32,DT_FLOAT,DT_BFLOAT16,DT_FLOAT,DT_INT32,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.092 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.110 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.129 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.148 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.176 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.198 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.213 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.229 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.243 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.258 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.271 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.290 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.309 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.325 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.338 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.381 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.399 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.414 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.432 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.446 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.465 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.482 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.499 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.513 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.530 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T1 for Required input x
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.547 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.563 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.579 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.595 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.612 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.630 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.649 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.666 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.679 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.697 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.713 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.728 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.744 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.760 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.776 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.799 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.812 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.827 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.844 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.861 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.877 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.896 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.913 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.926 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.941 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.957 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.970 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.772.985 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.001 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.016 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.033 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.048 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.063 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.076 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.094 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.108 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.123 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.137 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.153 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.171 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.187 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.210 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.224 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.241 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.255 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.272 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.288 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.304 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.318 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.332 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.351 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.367 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.379 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.395 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.412 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.428 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.443 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.456 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.471 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.487 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.500 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.517 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.532 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.549 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.565 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.577 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.609 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.627 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.644 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.666 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.681 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.696 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.714 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.729 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.744 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x3
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.756 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.770 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.787 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.803 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.817 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.834 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.852 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.870 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.888 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.902 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.920 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.934 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.949 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.962 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.978 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.773.992 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.010 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.034 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.049 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.063 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.078 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.093 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.110 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.127 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.140 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.155 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.171 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.189 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.205 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.224 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.246 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Dynamic input x
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.262 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.774.248 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for AddN.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.286 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.304 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.319 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T2 for Required input x2
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.334 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T2 for Required input x3
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.347 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.363 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_UINT8,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.378 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.774.385 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for BatchMatMulV2.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.396 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.413 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T2 for Required input x2
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.437 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T2 for Required input x3
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.449 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.465 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_UINT8,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.482 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] PROFILING(618654,python3.9):2025-04-03-09:27:25.774.447 [prof_cann_plugin.cpp:256] (tid:618654) Register module[6] callback.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.774.495 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Add.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.500 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.516 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.774.523 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Mul.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.533 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.551 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.774.549 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Less.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.566 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.774.573 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Sub.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.583 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.774.596 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for RealDiv.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.603 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.620 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.774.618 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Equal.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.634 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.774.643 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for NotEqual.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.653 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.774.672 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Greater.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.683 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.700 [ir_data_type_symbol_store.cc:173]618662 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.774.693 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Maximum.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.714 [ir_data_type_symbol_store.cc:219]618662 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.774.716 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Minimum.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.774.735 [ir_data_type_symbol_store.cc:182]618662 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.774.738 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for LogicalAnd.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.774.760 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for LogicalOr.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.774.781 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Div.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.774.802 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for LessEqual.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.774.825 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for SquaredDifference.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.774.845 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for GreaterEqual.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.774.871 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for DivNoNan.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.774.892 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for LeakyReluGrad.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.774.991 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for ClipByValue.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.775.110 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for ConcatV2.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.775.137 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for ConcatV2D.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.775.230 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Abs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.775.255 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Relu.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.775.279 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for IsNan.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.775.304 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Sign.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.775.326 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Exp.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.775.347 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Cast.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.775.368 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for LogicalNot.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.775.389 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Neg.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.775.411 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Sqrt.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.775.442 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Rsqrt.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.775.463 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Pow.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.775.485 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for ZerosLike.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.775.505 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Sigmoid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.775.526 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for BiasAdd.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.775.548 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Square.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.775.569 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Erf.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.775.595 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Reciprocal.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.775.620 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for LeakyRelu.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.775.641 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Tanh.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.775.734 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for ExpandDims.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.775.833 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Fill.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.775.928 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for GatherV2.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.776.038 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for LayerNorm.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.776.139 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for MatMul.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.776.176 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for MatMulV2.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.776.288 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Pack.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.776.386 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Pad.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.776.412 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for PadD.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.776.510 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Range.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.776.619 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for ReduceSum.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.776.647 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for ReduceMax.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.776.669 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for ReduceMin.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.776.691 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for ReduceProd.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.776.713 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for ReduceMean.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.776.734 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for ReduceAll.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.776.755 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for ReduceAny.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.776.773 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for ReduceSumD.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.776.796 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for ReduceMaxD.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.776.820 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for ReduceMinD.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.776.842 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for ReduceProdD.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.776.862 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for ReduceMeanD.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.776.887 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for ReduceAllD.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.776.907 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for ReduceAnyD.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.777.008 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Reshape.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.777.108 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Select.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.777.206 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Slice.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.777.303 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Split.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.777.331 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for SplitV.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.777.355 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for SplitD.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.777.377 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for SplitVD.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.777.474 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Squeeze.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.777.587 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for StridedSliceD.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.777.612 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for StridedSlice.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.777.705 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Tile.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.777.729 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for TileD.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.777.828 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Transpose.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.777.928 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for TransposeD.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.778.027 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Unpack.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.778.123 [addn.cc:29]618646 InferSymbolShape:Register infer symbol shape for Unsqueeze.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.778.473 [symbolic_kernel_factory.cc:27]618646 RegisterCreator:Register host symbolic kernel for node type ConcatV2D
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.778.574 [symbolic_kernel_factory.cc:27]618646 RegisterCreator:Register host symbolic kernel for node type ExpandDims
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.778.676 [symbolic_kernel_factory.cc:27]618646 RegisterCreator:Register host symbolic kernel for node type Fill
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.778.769 [symbolic_kernel_factory.cc:27]618646 RegisterCreator:Register host symbolic kernel for node type Pack
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.778.862 [symbolic_kernel_factory.cc:27]618646 RegisterCreator:Register host symbolic kernel for node type ReduceProd
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.778.957 [symbolic_kernel_factory.cc:27]618646 RegisterCreator:Register host symbolic kernel for node type Shape
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.779.048 [symbolic_kernel_factory.cc:27]618646 RegisterCreator:Register host symbolic kernel for node type Squeeze
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.779.145 [symbolic_kernel_factory.cc:27]618646 RegisterCreator:Register host symbolic kernel for node type StridedSlice
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.779.163 [symbolic_kernel_factory.cc:27]618646 RegisterCreator:Register host symbolic kernel for node type StridedSliceD
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.779.249 [symbolic_kernel_factory.cc:27]618646 RegisterCreator:Register host symbolic kernel for node type Tile
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.779.342 [symbolic_kernel_factory.cc:27]618646 RegisterCreator:Register host symbolic kernel for node type Unpack
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.779.432 [symbolic_kernel_factory.cc:27]618646 RegisterCreator:Register host symbolic kernel for node type Unsqueeze
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:25.781.617 [awatchdog_core.c:99](tid:618662) watchdog get platform host side
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:25.781.791 [awatchdog_monitor.c:127](tid:618662) create monitor thread successfully, tid :281473110867872 
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:25.781.816 [awatchdog_monitor.c:226](tid:618662) AwdMonitorInit
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:25.781.998 [trace_attr.c:99](tid:618662) doesn't set env ASCEND_LOG_DEVICE_FLUSH_TIMEOUT, use default timeout=0ms.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:25.782.031 [trace_attr.c:189](tid:618662) attr init success, timeout=0ms.
[WARNING] ATRACE(618662,python3.9):2025-04-03-09:27:25.782.046 [trace_system_api.c:115](tid:618662) env ASCEND_WORK_PATH is null.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:25.782.102 [trace_recorder.c:40](tid:618662) home_directory=/home/jenkins.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:25.782.120 [trace_recorder.c:121](tid:618662) use root path: /home/jenkins/ascend
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:25.782.133 [trace_event.c:151](tid:618662) init trace event success
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:25.782.182 [atrace_client_core.c:185](tid:618662) atrace client init success.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:25.783.519 [stacktrace_dumper.c:218](tid:618662) path = /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/bin/asc_dumper
[WARNING] ATRACE(618662,python3.9):2025-04-03-09:27:25.783.545 [trace_system_api.c:115](tid:618662) env ASCEND_COREDUMP_SIGNAL is null.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:25.783.635 [stacktrace_signal.c:165](tid:618662) register signal handler for signo 2 succeed.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:25.783.654 [stacktrace_signal.c:165](tid:618662) register signal handler for signo 15 succeed.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:25.783.667 [stacktrace_signal.c:165](tid:618662) register signal handler for signo 3 succeed.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:25.783.679 [stacktrace_signal.c:165](tid:618662) register signal handler for signo 4 succeed.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:25.783.692 [stacktrace_signal.c:165](tid:618662) register signal handler for signo 5 succeed.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:25.783.708 [stacktrace_signal.c:165](tid:618662) register signal handler for signo 6 succeed.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:25.783.719 [stacktrace_signal.c:165](tid:618662) register signal handler for signo 7 succeed.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:25.783.732 [stacktrace_signal.c:165](tid:618662) register signal handler for signo 8 succeed.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:25.783.747 [stacktrace_signal.c:165](tid:618662) register signal handler for signo 11 succeed.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:25.783.759 [stacktrace_signal.c:165](tid:618662) register signal handler for signo 24 succeed.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:25.783.771 [stacktrace_signal.c:165](tid:618662) register signal handler for signo 25 succeed.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:25.783.783 [stacktrace_signal.c:165](tid:618662) register signal handler for signo 31 succeed.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:25.783.796 [stacktrace_signal.c:165](tid:618662) register signal handler for signo 35 succeed.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:25.783.808 [stacktrace_signal.c:168](tid:618662) trace signal init succeed.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:25.783.823 [trace_core.c:51](tid:618662) trace init success.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:25.784.535 [task_fail_callback_data_manager.cc:58] 618662 TaskFailCallBackManager: Constructor.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.784.760 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Allreduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.784.826 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Reduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.784.855 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.786.172 [process_node_engine_manager.cc:140]618646 RegisterEngine:Register ProcessNodeEngine id:PS success.
[INFO] GE(618646,python3.9):2025-04-03-09:27:25.786.292 [process_node_engine_manager.cc:140]618646 RegisterEngine:Register ProcessNodeEngine id:NPU success.
[INFO] DVPP(618646,python3.9):2025-04-03-09:27:25.792.936 [PlatformInfo.cpp:85][DVPP] [InitPara:85] [T2] chip type is 5.
[INFO] DVPP(618646,python3.9):2025-04-03-09:27:25.792.971 [PlatformInfo.cpp:94][DVPP] [InitPara:94] [T2] run mode is 1.
[INFO] DVPP(618646,python3.9):2025-04-03-09:27:25.793.470 [dvpp_dev_hdc.cpp:750][WRAP] [StartHostPacketCountTimer:750] [tid:618646] start packet count timer
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.794.431 [operator_factory_impl.cc:232]618662 RegisterInferShapeV2Func:operator infer shape v2 funcs init
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.794.468 [operator_factory_impl.cc:246]618662 RegisterInferShapeRangeFunc:operator infer shape range funcs init
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.794.485 [operator_factory_impl.cc:239]618662 RegisterInferDataTypeFunc:operator infer data type funcs init
[INFO] PROFILING(618658,python3.9):2025-04-03-09:27:25.795.158 [prof_cann_plugin.cpp:256] (tid:618658) Register module[6] callback.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.797.455 [mem_manager.cc:138]618650 RegisterAllocatorManager:MemManager RegisterAllocatorManager.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:25.801.767 [adapter_rts.cc:2720] [618662][adapter_rts.cc][CallBackInitRts] g_deviceType [6] g_deviceLogicId [-1] g_devicePhyId [-1]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.804.942 [cache_policy.cc:47]618650 Create:[CachePolicy] Create CachePolicy with match_policy: 0, aging_policy: 0 success;
[INFO] PROFILING(618646,python3.9):2025-04-03-09:27:25.814.618 [prof_atls_plugin.cpp:117] (tid:618646) RegisterProfileCallback, callback type is 7
[INFO] PROFILING(618646,python3.9):2025-04-03-09:27:25.814.663 [prof_atls_plugin.cpp:117] (tid:618646) RegisterProfileCallback, callback type is 8
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.817.675 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Allreduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.817.747 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Reduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.817.779 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.820.386 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for AddN.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.820.523 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for BatchMatMulV2.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.820.638 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Add.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.820.669 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Mul.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.820.694 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Less.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.820.718 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Sub.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.820.742 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for RealDiv.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.820.765 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Equal.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.820.794 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for NotEqual.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.820.820 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Greater.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.820.844 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Maximum.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.820.872 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Minimum.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.820.896 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for LogicalAnd.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.820.920 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for LogicalOr.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.820.944 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Div.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.820.969 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for LessEqual.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.820.992 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for SquaredDifference.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.821.020 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for GreaterEqual.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.821.043 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for DivNoNan.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.821.075 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for LeakyReluGrad.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.821.184 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for ClipByValue.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.821.321 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for ConcatV2.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.821.347 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for ConcatV2D.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.821.444 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Abs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.821.473 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Relu.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.821.498 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for IsNan.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.821.523 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Sign.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.821.549 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Exp.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.821.573 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Cast.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.821.597 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for LogicalNot.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.821.626 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Neg.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.821.650 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Sqrt.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.821.675 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Rsqrt.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.821.700 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Pow.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.821.725 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for ZerosLike.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.821.748 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Sigmoid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.821.773 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for BiasAdd.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.821.799 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Square.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.821.823 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Erf.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.821.850 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Reciprocal.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.821.876 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for LeakyRelu.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.821.906 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Tanh.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.822.007 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for ExpandDims.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.822.110 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Fill.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.822.212 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for GatherV2.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.822.325 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for LayerNorm.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.822.427 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for MatMul.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.822.457 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for MatMulV2.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.822.563 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Pack.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.822.666 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Pad.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.822.694 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for PadD.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.822.798 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Range.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.822.922 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for ReduceSum.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.822.952 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for ReduceMax.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.822.976 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for ReduceMin.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.823.000 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for ReduceProd.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.823.023 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for ReduceMean.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.823.049 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for ReduceAll.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.823.074 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for ReduceAny.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.823.097 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for ReduceSumD.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.823.120 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for ReduceMaxD.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.823.147 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for ReduceMinD.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.823.172 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for ReduceProdD.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.823.197 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for ReduceMeanD.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.823.220 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for ReduceAllD.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.823.247 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for ReduceAnyD.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.823.356 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Reshape.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.823.458 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Select.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.823.559 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Slice.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.823.663 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Split.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.823.693 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for SplitV.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.823.718 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for SplitD.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.823.742 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for SplitVD.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.823.845 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Squeeze.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.823.968 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for StridedSliceD.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.823.995 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for StridedSlice.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.824.094 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Tile.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.824.123 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for TileD.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.824.278 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Transpose.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.824.387 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for TransposeD.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.824.492 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Unpack.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.824.590 [addn.cc:29]618650 InferSymbolShape:Register infer symbol shape for Unsqueeze.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.824.968 [symbolic_kernel_factory.cc:27]618650 RegisterCreator:Register host symbolic kernel for node type ConcatV2D
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.825.076 [symbolic_kernel_factory.cc:27]618650 RegisterCreator:Register host symbolic kernel for node type ExpandDims
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.825.188 [symbolic_kernel_factory.cc:27]618650 RegisterCreator:Register host symbolic kernel for node type Fill
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.825.283 [symbolic_kernel_factory.cc:27]618650 RegisterCreator:Register host symbolic kernel for node type Pack
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.825.377 [symbolic_kernel_factory.cc:27]618650 RegisterCreator:Register host symbolic kernel for node type ReduceProd
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.825.475 [symbolic_kernel_factory.cc:27]618650 RegisterCreator:Register host symbolic kernel for node type Shape
[INFO] OP(618654,python3.9):2025-04-03-09:27:25.825.499 [nnopbase_args_pool.cpp:123][NNOP][GetCacheSizeLimit][618654] cachelimit is 10000
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.825.570 [symbolic_kernel_factory.cc:27]618650 RegisterCreator:Register host symbolic kernel for node type Squeeze
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.825.673 [symbolic_kernel_factory.cc:27]618650 RegisterCreator:Register host symbolic kernel for node type StridedSlice
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.825.692 [symbolic_kernel_factory.cc:27]618650 RegisterCreator:Register host symbolic kernel for node type StridedSliceD
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.825.783 [symbolic_kernel_factory.cc:27]618650 RegisterCreator:Register host symbolic kernel for node type Tile
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.825.885 [symbolic_kernel_factory.cc:27]618650 RegisterCreator:Register host symbolic kernel for node type Unpack
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.825.978 [symbolic_kernel_factory.cc:27]618650 RegisterCreator:Register host symbolic kernel for node type Unsqueeze
[INFO] PROFILING(618662,python3.9):2025-04-03-09:27:25.828.537 [prof_cann_plugin.cpp:256] (tid:618662) Register module[6] callback.
[INFO] OP(618654,python3.9):2025-04-03-09:27:25.829.436 [op_dfx.cpp:230][NNOP][RecordOpArgCallback][618654] RecordOpArgCallback, get record op arg flag = 0
[INFO] OP(618654,python3.9):2025-04-03-09:27:25.829.480 [op_dfx.cpp:54][NNOP][SystemConfig][618654] enable debug kernel flag 0.
[INFO] PROFILING(618654,python3.9):2025-04-03-09:27:25.829.501 [prof_cann_plugin.cpp:256] (tid:618654) Register module[61] callback.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.833.020 [process_node_engine_manager.cc:140]618650 RegisterEngine:Register ProcessNodeEngine id:PS success.
[INFO] GE(618650,python3.9):2025-04-03-09:27:25.833.145 [process_node_engine_manager.cc:140]618650 RegisterEngine:Register ProcessNodeEngine id:NPU success.
[INFO] DVPP(618650,python3.9):2025-04-03-09:27:25.840.076 [PlatformInfo.cpp:85][DVPP] [InitPara:85] [T2] chip type is 5.
[INFO] DVPP(618650,python3.9):2025-04-03-09:27:25.840.114 [PlatformInfo.cpp:94][DVPP] [InitPara:94] [T2] run mode is 1.
[INFO] DVPP(618650,python3.9):2025-04-03-09:27:25.840.769 [dvpp_dev_hdc.cpp:750][WRAP] [StartHostPacketCountTimer:750] [tid:618650] start packet count timer
[INFO] OP(618658,python3.9):2025-04-03-09:27:25.845.676 [nnopbase_args_pool.cpp:123][NNOP][GetCacheSizeLimit][618658] cachelimit is 10000
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.238 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.240 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.330 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.330 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.371 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.370 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.392 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.395 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.416 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.417 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.436 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.435 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.457 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.472 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.456 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.470 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.486 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.487 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.504 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.508 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.525 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.522 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.540 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.540 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.558 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.558 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.572 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.571 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.587 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.590 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.608 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.605 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.620 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.622 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.635 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.652 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.641 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.658 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.666 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.671 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.683 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_UINT8,DT_INT16,DT_INT64,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.689 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_UINT8,DT_INT16,DT_INT64,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.712 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.720 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.727 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.737 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.745 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.753 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.763 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T1 for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.774 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T1 for Required input x
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.781 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.792 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.811 [ir_data_type_symbol_store.cc:240]618670 DeclareSymbol:Bind symbol T1 with ordered list-dtypes [DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_INT4,DT_UINT8,DT_INT8,DT_INT16,DT_INT16,DT_INT32,DT_INT32,DT_INT32,DT_INT32,DT_INT64,DT_INT64,DT_FLOAT,DT_BFLOAT16,DT_BFLOAT16,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.817 [ir_data_type_symbol_store.cc:240]618666 DeclareSymbol:Bind symbol T1 with ordered list-dtypes [DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_INT4,DT_UINT8,DT_INT8,DT_INT16,DT_INT16,DT_INT32,DT_INT32,DT_INT32,DT_INT32,DT_INT64,DT_INT64,DT_FLOAT,DT_BFLOAT16,DT_BFLOAT16,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.831 [ir_data_type_symbol_store.cc:240]618670 DeclareSymbol:Bind symbol T2 with ordered list-dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,DT_INT32,DT_INT16,DT_FLOAT,DT_INT32,DT_INT16,DT_INT8,DT_UINT8,DT_INT4,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT,DT_FLOAT,DT_INT64,DT_INT16,DT_FLOAT16,DT_INT32,DT_FLOAT,DT_BFLOAT16,DT_FLOAT,DT_INT32,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.836 [ir_data_type_symbol_store.cc:240]618666 DeclareSymbol:Bind symbol T2 with ordered list-dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,DT_INT32,DT_INT16,DT_FLOAT,DT_INT32,DT_INT16,DT_INT8,DT_UINT8,DT_INT4,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT,DT_FLOAT,DT_INT64,DT_INT16,DT_FLOAT16,DT_INT32,DT_FLOAT,DT_BFLOAT16,DT_FLOAT,DT_INT32,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.849 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.852 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.865 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.869 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.880 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.882 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.899 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.902 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.919 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.915 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.934 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.934 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.953 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.954 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.968 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.967 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.983 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.981 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.846.997 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.846.998 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.012 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.027 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.014 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.027 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.043 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.042 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.059 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.057 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.073 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.076 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.100 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.098 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.113 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.113 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.130 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.128 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.144 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.144 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.161 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.162 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.176 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.175 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.192 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.190 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.206 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.205 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.221 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.221 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.238 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T1 for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.238 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T1 for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.252 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.251 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.267 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.267 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.283 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.281 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.298 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.298 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.313 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.312 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.328 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.327 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.341 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.344 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.356 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.362 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.373 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.377 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.389 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.393 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.406 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.405 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.419 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.422 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.437 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.436 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.449 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.452 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.465 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.467 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.490 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.490 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.506 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.503 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.520 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.519 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.536 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.534 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.550 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.549 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.566 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.564 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.582 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.582 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.599 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.600 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.611 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.619 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.630 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.643 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.636 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.649 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.657 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.663 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.674 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.680 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.687 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.696 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.703 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.711 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.717 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.727 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.733 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.741 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.745 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.757 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.764 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.772 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.782 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.789 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.798 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.802 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.817 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.813 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.832 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.828 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.847 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.847 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.863 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.864 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.876 [ir_data_type_symbol_store.cc:21[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.877 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
9]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.899 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.907 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.914 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.924 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.932 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.938 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.948 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.955 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.962 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.973 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.979 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.847.990 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.847.995 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.008 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.006 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.023 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.022 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.037 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.039 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.052 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.064 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.054 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.070 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.080 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.083 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.100 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.097 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.114 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.127 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.116 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.132 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.144 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.141 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.168 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.168 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.189 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.191 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.204 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.204 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.217 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.220 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.234 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.235 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.248 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.262 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.263 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.277 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.283 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.291 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.300 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.314 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.327 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.331 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.343 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.346 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.361 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.361 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.377 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.374 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.391 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.390 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.404 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.406 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.424 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.422 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.437 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.437 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x3
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.450 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.452 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x3
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.465 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.467 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.482 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.481 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.497 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.510 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.498 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.513 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.525 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.527 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.541 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.543 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.557 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.555 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.571 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.571 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.587 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.586 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.600 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.604 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.620 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.621 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.637 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.635 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.651 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.653 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.664 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.670 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.678 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.683 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.696 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.693 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.713 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.726 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.711 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.739 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.735 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.748 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.754 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.764 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.769 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.779 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.794 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.784 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.808 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.800 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.813 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.822 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.828 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.837 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.843 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.851 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.865 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.857 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.870 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.879 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.890 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.892 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.911 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Dynamic input x
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.914 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.927 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.933 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Dynamic input x
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.943 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.946 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.960 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.964 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.976 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T2 for Required input x2
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.982 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.848.989 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T2 for Required input x3
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.848.996 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T2 for Required input x2
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.849.007 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.849.011 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T2 for Required input x3
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.849.022 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_UINT8,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.849.024 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.849.040 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_UINT8,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.849.053 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.849.038 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.849.053 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.849.065 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T2 for Required input x2
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.849.068 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.849.087 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T2 for Required input x3
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.849.100 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.849.083 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T2 for Required input x2
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.849.106 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T2 for Required input x3
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.849.114 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_UINT8,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.849.119 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.849.129 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.849.135 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_UINT8,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.849.145 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.849.150 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.849.163 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.849.167 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.849.184 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.849.181 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.849.199 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.849.201 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.849.212 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.849.219 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.849.233 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.849.231 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.849.247 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.849.248 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.849.261 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.849.276 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.849.264 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.849.280 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.849.294 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.849.296 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.849.316 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.849.323 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.849.338 [ir_data_type_symbol_store.cc:173]618666 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.849.342 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.849.354 [ir_data_type_symbol_store.cc:219]618666 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.849.358 [ir_data_type_symbol_store.cc:173]618670 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.849.371 [ir_data_type_symbol_store.cc:219]618670 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.849.374 [ir_data_type_symbol_store.cc:182]618666 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.849.390 [ir_data_type_symbol_store.cc:182]618670 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] OP(618658,python3.9):2025-04-03-09:27:25.849.793 [op_dfx.cpp:230][NNOP][RecordOpArgCallback][618658] RecordOpArgCallback, get record op arg flag = 0
[INFO] OP(618658,python3.9):2025-04-03-09:27:25.849.845 [op_dfx.cpp:54][NNOP][SystemConfig][618658] enable debug kernel flag 0.
[INFO] PROFILING(618658,python3.9):2025-04-03-09:27:25.849.866 [prof_cann_plugin.cpp:256] (tid:618658) Register module[61] callback.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:25.855.861 [awatchdog_core.c:99](tid:618666) watchdog get platform host side
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:25.855.861 [awatchdog_core.c:99](tid:618670) watchdog get platform host side
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:25.856.008 [awatchdog_monitor.c:127](tid:618670) create monitor thread successfully, tid :281472919457696 
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:25.856.030 [awatchdog_monitor.c:226](tid:618670) AwdMonitorInit
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:25.856.012 [awatchdog_monitor.c:127](tid:618666) create monitor thread successfully, tid :281472430727072 
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:25.856.034 [awatchdog_monitor.c:226](tid:618666) AwdMonitorInit
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:25.856.231 [trace_attr.c:99](tid:618666) doesn't set env ASCEND_LOG_DEVICE_FLUSH_TIMEOUT, use default timeout=0ms.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:25.856.266 [trace_attr.c:189](tid:618666) attr init success, timeout=0ms.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:25.856.238 [trace_attr.c:99](tid:618670) doesn't set env ASCEND_LOG_DEVICE_FLUSH_TIMEOUT, use default timeout=0ms.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:25.856.267 [trace_attr.c:189](tid:618670) attr init success, timeout=0ms.
[WARNING] ATRACE(618666,python3.9):2025-04-03-09:27:25.856.281 [trace_system_api.c:115](tid:618666) env ASCEND_WORK_PATH is null.
[WARNING] ATRACE(618670,python3.9):2025-04-03-09:27:25.856.282 [trace_system_api.c:115](tid:618670) env ASCEND_WORK_PATH is null.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:25.856.340 [trace_recorder.c:40](tid:618666) home_directory=/home/jenkins.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:25.856.341 [trace_recorder.c:40](tid:618670) home_directory=/home/jenkins.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:25.856.359 [trace_recorder.c:121](tid:618670) use root path: /home/jenkins/ascend
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:25.856.359 [trace_recorder.c:121](tid:618666) use root path: /home/jenkins/ascend
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:25.856.372 [trace_event.c:151](tid:618670) init trace event success
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:25.856.372 [trace_event.c:151](tid:618666) init trace event success
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:25.856.424 [atrace_client_core.c:185](tid:618670) atrace client init success.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:25.856.424 [atrace_client_core.c:185](tid:618666) atrace client init success.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:25.857.711 [stacktrace_dumper.c:218](tid:618666) path = /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/bin/asc_dumper
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:25.857.711 [stacktrace_dumper.c:218](tid:618670) path = /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/bin/asc_dumper
[WARNING] ATRACE(618670,python3.9):2025-04-03-09:27:25.857.735 [trace_system_api.c:115](tid:618670) env ASCEND_COREDUMP_SIGNAL is null.
[WARNING] ATRACE(618666,python3.9):2025-04-03-09:27:25.857.735 [trace_system_api.c:115](tid:618666) env ASCEND_COREDUMP_SIGNAL is null.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:25.857.829 [stacktrace_signal.c:165](tid:618666) register signal handler for signo 2 succeed.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:25.857.825 [stacktrace_signal.c:165](tid:618670) register signal handler for signo 2 succeed.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:25.857.844 [stacktrace_signal.c:165](tid:618670) register signal handler for signo 15 succeed.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:25.857.846 [stacktrace_signal.c:165](tid:618666) register signal handler for signo 15 succeed.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:25.857.860 [stacktrace_signal.c:165](tid:618666) register signal handler for signo 3 succeed.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:25.857.871 [stacktrace_signal.c:165](tid:618666) register signal handler for signo 4 succeed.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:25.857.856 [stacktrace_signal.c:165](tid:618670) register signal handler for signo 3 succeed.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:25.857.867 [stacktrace_signal.c:165](tid:618670) register signal handler for signo 4 succeed.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:25.857.879 [stacktrace_signal.c:165](tid:618670) register signal handler for signo 5 succeed.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:25.857.894 [stacktrace_signal.c:165](tid:618670) register signal handler for signo 6 succeed.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:25.857.883 [stacktrace_signal.c:165](tid:618666) register signal handler for signo 5 succeed.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:25.857.906 [stacktrace_signal.c:165](tid:618670) register signal handler for signo 7 succeed.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:25.857.897 [stacktrace_signal.c:165](tid:618666) register signal handler for signo 6 succeed.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:25.857.911 [stacktrace_signal.c:165](tid:618666) register signal handler for signo 7 succeed.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:25.857.918 [stacktrace_signal.c:165](tid:618670) register signal handler for signo 8 succeed.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:25.857.932 [stacktrace_signal.c:165](tid:618670) register signal handler for signo 11 succeed.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:25.857.923 [stacktrace_signal.c:165](tid:618666) register signal handler for signo 8 succeed.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:25.857.937 [stacktrace_signal.c:165](tid:618666) register signal handler for signo 11 succeed.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:25.857.944 [stacktrace_signal.c:165](tid:618670) register signal handler for signo 24 succeed.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:25.857.950 [stacktrace_signal.c:165](tid:618666) register signal handler for signo 24 succeed.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:25.857.964 [stacktrace_signal.c:165](tid:618666) register signal handler for signo 25 succeed.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:25.857.955 [stacktrace_signal.c:165](tid:618670) register signal handler for signo 25 succeed.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:25.857.970 [stacktrace_signal.c:165](tid:618670) register signal handler for signo 31 succeed.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:25.857.976 [stacktrace_signal.c:165](tid:618666) register signal handler for signo 31 succeed.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:25.857.982 [stacktrace_signal.c:165](tid:618670) register signal handler for signo 35 succeed.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:25.857.996 [stacktrace_signal.c:168](tid:618670) trace signal init succeed.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:25.857.988 [stacktrace_signal.c:165](tid:618666) register signal handler for signo 35 succeed.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:25.858.001 [stacktrace_signal.c:168](tid:618666) trace signal init succeed.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:25.858.006 [trace_core.c:51](tid:618670) trace init success.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:25.858.013 [trace_core.c:51](tid:618666) trace init success.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:25.858.662 [task_fail_callback_data_manager.cc:58] 618670 TaskFailCallBackManager: Constructor.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:25.858.662 [task_fail_callback_data_manager.cc:58] 618666 TaskFailCallBackManager: Constructor.
[INFO] PROFILING(618650,python3.9):2025-04-03-09:27:25.863.541 [prof_atls_plugin.cpp:117] (tid:618650) RegisterProfileCallback, callback type is 7
[INFO] PROFILING(618650,python3.9):2025-04-03-09:27:25.863.585 [prof_atls_plugin.cpp:117] (tid:618650) RegisterProfileCallback, callback type is 8
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.868.117 [operator_factory_impl.cc:232]618670 RegisterInferShapeV2Func:operator infer shape v2 funcs init
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.868.154 [operator_factory_impl.cc:246]618670 RegisterInferShapeRangeFunc:operator infer shape range funcs init
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.868.117 [operator_factory_impl.cc:232]618666 RegisterInferShapeV2Func:operator infer shape v2 funcs init
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.868.179 [operator_factory_impl.cc:239]618670 RegisterInferDataTypeFunc:operator infer data type funcs init
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.868.168 [operator_factory_impl.cc:246]618666 RegisterInferShapeRangeFunc:operator infer shape range funcs init
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.868.189 [operator_factory_impl.cc:239]618666 RegisterInferDataTypeFunc:operator infer data type funcs init
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:25.875.149 [adapter_rts.cc:2720] [618666][adapter_rts.cc][CallBackInitRts] g_deviceType [6] g_deviceLogicId [-1] g_devicePhyId [-1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:25.875.147 [adapter_rts.cc:2720] [618670][adapter_rts.cc][CallBackInitRts] g_deviceType [6] g_deviceLogicId [-1] g_devicePhyId [-1]
[INFO] OP(618662,python3.9):2025-04-03-09:27:25.879.275 [nnopbase_args_pool.cpp:123][NNOP][GetCacheSizeLimit][618662] cachelimit is 10000
[INFO] OP(618662,python3.9):2025-04-03-09:27:25.883.388 [op_dfx.cpp:230][NNOP][RecordOpArgCallback][618662] RecordOpArgCallback, get record op arg flag = 0
[INFO] OP(618662,python3.9):2025-04-03-09:27:25.883.446 [op_dfx.cpp:54][NNOP][SystemConfig][618662] enable debug kernel flag 0.
[INFO] PROFILING(618662,python3.9):2025-04-03-09:27:25.883.467 [prof_cann_plugin.cpp:256] (tid:618662) Register module[61] callback.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.885.525 [mem_manager.cc:138]618654 RegisterAllocatorManager:MemManager RegisterAllocatorManager.
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.890.034 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Allreduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.890.033 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Allreduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.890.107 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Reduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.890.106 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Reduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:25.890.132 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:25.890.133 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] ME(618646,ffff85d12de0,python3.9):2025-04-03-09:27:25.890.790 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:377] LoadPlugin] Load libmindspore_ascend plugin file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/libmindspore_ascend.so.2 success.
[INFO] ME(618646,ffff85d12de0,python3.9):2025-04-03-09:27:25.891.316 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:377] LoadPlugin] Load libmindspore_ops_ascend plugin file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/libmindspore_ops_ascend.so success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.893.032 [cache_policy.cc:47]618654 Create:[CachePolicy] Create CachePolicy with match_policy: 0, aging_policy: 0 success;
[INFO] PROFILING(618670,python3.9):2025-04-03-09:27:25.900.408 [prof_cann_plugin.cpp:256] (tid:618670) Register module[6] callback.
[INFO] PROFILING(618666,python3.9):2025-04-03-09:27:25.900.408 [prof_cann_plugin.cpp:256] (tid:618666) Register module[6] callback.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.905.054 [mem_manager.cc:138]618658 RegisterAllocatorManager:MemManager RegisterAllocatorManager.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.908.115 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for AddN.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.908.293 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for BatchMatMulV2.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.908.411 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Add.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.908.439 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Mul.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.908.462 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Less.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.908.484 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Sub.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.908.506 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for RealDiv.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.908.531 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Equal.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.908.556 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for NotEqual.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.908.577 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Greater.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.908.598 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Maximum.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.908.620 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Minimum.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.908.641 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for LogicalAnd.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.908.662 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for LogicalOr.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.908.684 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Div.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.908.707 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for LessEqual.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.908.728 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for SquaredDifference.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.908.750 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for GreaterEqual.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.908.772 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for DivNoNan.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.908.794 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for LeakyReluGrad.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.908.901 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for ClipByValue.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.909.021 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for ConcatV2.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.909.046 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for ConcatV2D.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.909.142 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Abs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.909.167 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Relu.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.909.189 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for IsNan.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.909.211 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Sign.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.909.230 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Exp.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.909.248 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Cast.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.909.275 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for LogicalNot.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.909.296 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Neg.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.909.317 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Sqrt.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.909.341 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Rsqrt.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.909.362 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Pow.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.909.383 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for ZerosLike.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.909.406 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Sigmoid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.909.429 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for BiasAdd.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.909.450 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Square.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.909.471 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Erf.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.909.495 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Reciprocal.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.909.517 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for LeakyRelu.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.909.539 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Tanh.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.909.643 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for ExpandDims.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.909.749 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Fill.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.909.849 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for GatherV2.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.909.961 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for LayerNorm.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.910.065 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for MatMul.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.910.093 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for MatMulV2.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.910.195 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Pack.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.910.297 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Pad.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.910.322 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for PadD.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.910.424 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Range.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.910.544 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for ReduceSum.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.910.576 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for ReduceMax.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.910.598 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for ReduceMin.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.910.620 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for ReduceProd.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.910.641 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for ReduceMean.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.910.664 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for ReduceAll.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.910.683 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for ReduceAny.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.910.705 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for ReduceSumD.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.910.726 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for ReduceMaxD.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.910.749 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for ReduceMinD.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.910.770 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for ReduceProdD.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.910.791 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for ReduceMeanD.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.910.815 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for ReduceAllD.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.910.837 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for ReduceAnyD.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.910.937 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Reshape.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.911.039 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Select.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.911.137 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Slice.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.911.239 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Split.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.911.264 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for SplitV.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.911.285 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for SplitD.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.911.311 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for SplitVD.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.911.428 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Squeeze.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.911.531 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for StridedSliceD.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.911.556 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for StridedSlice.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.911.656 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Tile.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.911.680 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for TileD.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.911.776 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Transpose.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.911.878 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for TransposeD.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.911.980 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Unpack.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.912.088 [addn.cc:29]618654 InferSymbolShape:Register infer symbol shape for Unsqueeze.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.912.485 [symbolic_kernel_factory.cc:27]618654 RegisterCreator:Register host symbolic kernel for node type ConcatV2D
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.912.477 [cache_policy.cc:47]618658 Create:[CachePolicy] Create CachePolicy with match_policy: 0, aging_policy: 0 success;
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.912.594 [symbolic_kernel_factory.cc:27]618654 RegisterCreator:Register host symbolic kernel for node type ExpandDims
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.912.691 [symbolic_kernel_factory.cc:27]618654 RegisterCreator:Register host symbolic kernel for node type Fill
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.912.788 [symbolic_kernel_factory.cc:27]618654 RegisterCreator:Register host symbolic kernel for node type Pack
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.912.884 [symbolic_kernel_factory.cc:27]618654 RegisterCreator:Register host symbolic kernel for node type ReduceProd
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.912.981 [symbolic_kernel_factory.cc:27]618654 RegisterCreator:Register host symbolic kernel for node type Shape
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.913.076 [symbolic_kernel_factory.cc:27]618654 RegisterCreator:Register host symbolic kernel for node type Squeeze
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.913.176 [symbolic_kernel_factory.cc:27]618654 RegisterCreator:Register host symbolic kernel for node type StridedSlice
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.913.193 [symbolic_kernel_factory.cc:27]618654 RegisterCreator:Register host symbolic kernel for node type StridedSliceD
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.913.283 [symbolic_kernel_factory.cc:27]618654 RegisterCreator:Register host symbolic kernel for node type Tile
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.913.375 [symbolic_kernel_factory.cc:27]618654 RegisterCreator:Register host symbolic kernel for node type Unpack
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.913.462 [symbolic_kernel_factory.cc:27]618654 RegisterCreator:Register host symbolic kernel for node type Unsqueeze
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.920.390 [process_node_engine_manager.cc:140]618654 RegisterEngine:Register ProcessNodeEngine id:PS success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:25.920.520 [process_node_engine_manager.cc:140]618654 RegisterEngine:Register ProcessNodeEngine id:NPU success.
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.303 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.391 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.422 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.442 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.461 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.479 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.499 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.514 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.531 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.547 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.562 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.578 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.594 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.609 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.624 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.639 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.653 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.669 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.685 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.699 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.715 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_UINT8,DT_INT16,DT_INT64,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.749 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.763 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.780 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.795 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T1 for Required input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.809 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.836 [ir_data_type_symbol_store.cc:240]618674 DeclareSymbol:Bind symbol T1 with ordered list-dtypes [DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_INT4,DT_UINT8,DT_INT8,DT_INT16,DT_INT16,DT_INT32,DT_INT32,DT_INT32,DT_INT32,DT_INT64,DT_INT64,DT_FLOAT,DT_BFLOAT16,DT_BFLOAT16,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.854 [ir_data_type_symbol_store.cc:240]618674 DeclareSymbol:Bind symbol T2 with ordered list-dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,DT_INT32,DT_INT16,DT_FLOAT,DT_INT32,DT_INT16,DT_INT8,DT_UINT8,DT_INT4,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT16,DT_FLOAT,DT_FLOAT,DT_INT64,DT_INT16,DT_FLOAT16,DT_INT32,DT_FLOAT,DT_BFLOAT16,DT_FLOAT,DT_INT32,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.872 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.887 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.901 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.926 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.940 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.954 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.970 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.982 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.924.995 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.012 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.026 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.040 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.056 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.070 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.084 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.105 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.119 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.134 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.149 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.163 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.177 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.192 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.205 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.221 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.237 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T1 for Required input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.251 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.270 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.284 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.301 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.316 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.331 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.346 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.360 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.375 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.389 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.403 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.418 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.434 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.449 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.463 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.484 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.498 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.513 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.532 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.546 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.561 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.578 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.593 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.607 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.622 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.636 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.649 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.665 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.680 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.694 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.709 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.722 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.736 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.751 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.765 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.779 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.792 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.809 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.826 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.841 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.854 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.874 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.889 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.903 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.915 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.930 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.945 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.958 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.974 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.925.989 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.004 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.018 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.031 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.046 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.062 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.077 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.089 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.104 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.122 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.136 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.150 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.165 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.180 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.194 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.208 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.221 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.242 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.254 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.270 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.285 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.298 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.313 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.328 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.341 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.355 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x3
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.368 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.383 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.400 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.414 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.428 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.445 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.459 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.475 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.489 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.502 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.515 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.530 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.545 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.559 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.571 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.590 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.604 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.625 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.639 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.654 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.668 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.682 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.697 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.711 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T1 for Required input x2
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.726 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.743 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT64,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.757 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_UINT8,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.772 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.786 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.806 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.824 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Dynamic input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.839 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.856 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.872 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.883 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T2 for Required input x2
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.894 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T2 for Required input x3
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.905 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.919 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_UINT8,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.935 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.950 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T1 for Required input x1
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.966 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T2 for Required input x2
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.985 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T2 for Required input x3
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.926.997 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T2 for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.927.011 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T1 with allowed dtypes [DT_UINT8,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.927.026 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T2 with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT32,DT_INT16,DT_INT64,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.927.041 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.927.055 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.927.071 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.927.086 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.927.100 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.927.118 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.927.134 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.927.148 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.927.162 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.927.181 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.927.207 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x1
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.927.221 [ir_data_type_symbol_store.cc:173]618674 SetInputSymbol:Create symbol T for Required input x2
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.927.234 [ir_data_type_symbol_store.cc:219]618674 SetOutputSymbol:Create symbol expression T for Required output y
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.927.253 [ir_data_type_symbol_store.cc:182]618674 DeclareSymbol:Bind symbol T with allowed dtypes [DT_FLOAT,DT_FLOAT16,DT_INT8,DT_INT32,DT_UINT8,DT_INT16,DT_UINT16,DT_UINT32,DT_INT64,DT_UINT64,DT_DOUBLE,DT_BOOL,DT_STRING,DT_COMPLEX64,DT_COMPLEX128,DT_QINT8,DT_QINT16,DT_QINT32,DT_QUINT8,DT_QUINT16,DT_RESOURCE,DT_BFLOAT16,DT_COMPLEX32,]
[INFO] DVPP(618654,python3.9):2025-04-03-09:27:25.927.270 [PlatformInfo.cpp:85][DVPP] [InitPara:85] [T2] chip type is 5.
[INFO] DVPP(618654,python3.9):2025-04-03-09:27:25.927.313 [PlatformInfo.cpp:94][DVPP] [InitPara:94] [T2] run mode is 1.
[INFO] DVPP(618654,python3.9):2025-04-03-09:27:25.927.835 [dvpp_dev_hdc.cpp:750][WRAP] [StartHostPacketCountTimer:750] [tid:618654] start packet count timer
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.927.994 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for AddN.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.928.138 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for BatchMatMulV2.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.928.278 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Add.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.928.310 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Mul.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.928.336 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Less.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.928.358 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Sub.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.928.380 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for RealDiv.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.928.402 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Equal.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.928.424 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for NotEqual.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.928.445 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Greater.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.928.468 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Maximum.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.928.489 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Minimum.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.928.514 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for LogicalAnd.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.928.534 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for LogicalOr.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.928.555 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Div.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.928.576 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for LessEqual.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.928.597 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for SquaredDifference.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.928.620 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for GreaterEqual.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.928.641 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for DivNoNan.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.928.661 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for LeakyReluGrad.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.928.774 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for ClipByValue.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.928.891 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for ConcatV2.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.928.919 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for ConcatV2D.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.929.014 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Abs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.929.041 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Relu.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.929.063 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for IsNan.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.929.084 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Sign.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.929.107 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Exp.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.929.128 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Cast.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.929.149 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for LogicalNot.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.929.172 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Neg.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.929.193 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Sqrt.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.929.215 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Rsqrt.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.929.235 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Pow.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.929.259 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for ZerosLike.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.929.279 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Sigmoid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.929.301 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for BiasAdd.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.929.323 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Square.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.929.344 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Erf.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.929.367 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Reciprocal.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.929.389 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for LeakyRelu.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.929.409 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Tanh.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.929.517 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for ExpandDims.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.929.622 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Fill.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.929.732 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for GatherV2.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.929.837 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for LayerNorm.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.929.941 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for MatMul.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.929.967 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for MatMulV2.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.930.069 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Pack.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.930.187 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Pad.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.930.212 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for PadD.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.930.310 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Range.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.930.437 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for ReduceSum.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.930.462 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for ReduceMax.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.930.482 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for ReduceMin.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.930.503 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for ReduceProd.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.930.525 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for ReduceMean.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.930.546 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for ReduceAll.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.930.572 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for ReduceAny.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.930.592 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for ReduceSumD.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.930.615 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for ReduceMaxD.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.930.638 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for ReduceMinD.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.930.659 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for ReduceProdD.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.930.680 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for ReduceMeanD.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.930.702 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for ReduceAllD.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.930.724 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for ReduceAnyD.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.930.822 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Reshape.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.930.925 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Select.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.931.027 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Slice.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.931.132 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Split.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.931.164 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for SplitV.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.931.186 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for SplitD.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.931.208 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for SplitVD.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.931.325 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Squeeze.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.931.437 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for StridedSliceD.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.931.461 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for StridedSlice.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.931.559 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Tile.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.931.586 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for TileD.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.931.682 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Transpose.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.931.784 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for TransposeD.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.931.900 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Unpack.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.932.000 [addn.cc:29]618658 InferSymbolShape:Register infer symbol shape for Unsqueeze.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.932.409 [symbolic_kernel_factory.cc:27]618658 RegisterCreator:Register host symbolic kernel for node type ConcatV2D
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.932.522 [symbolic_kernel_factory.cc:27]618658 RegisterCreator:Register host symbolic kernel for node type ExpandDims
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.932.624 [symbolic_kernel_factory.cc:27]618658 RegisterCreator:Register host symbolic kernel for node type Fill
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.932.720 [symbolic_kernel_factory.cc:27]618658 RegisterCreator:Register host symbolic kernel for node type Pack
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.932.813 [symbolic_kernel_factory.cc:27]618658 RegisterCreator:Register host symbolic kernel for node type ReduceProd
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.932.910 [symbolic_kernel_factory.cc:27]618658 RegisterCreator:Register host symbolic kernel for node type Shape
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.933.017 [symbolic_kernel_factory.cc:27]618658 RegisterCreator:Register host symbolic kernel for node type Squeeze
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.933.113 [symbolic_kernel_factory.cc:27]618658 RegisterCreator:Register host symbolic kernel for node type StridedSlice
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.933.130 [symbolic_kernel_factory.cc:27]618658 RegisterCreator:Register host symbolic kernel for node type StridedSliceD
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.933.221 [symbolic_kernel_factory.cc:27]618658 RegisterCreator:Register host symbolic kernel for node type Tile
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:25.933.203 [awatchdog_core.c:99](tid:618674) watchdog get platform host side
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.933.316 [symbolic_kernel_factory.cc:27]618658 RegisterCreator:Register host symbolic kernel for node type Unpack
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:25.933.372 [awatchdog_monitor.c:127](tid:618674) create monitor thread successfully, tid :281472386613152 
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:25.933.393 [awatchdog_monitor.c:226](tid:618674) AwdMonitorInit
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.933.410 [symbolic_kernel_factory.cc:27]618658 RegisterCreator:Register host symbolic kernel for node type Unsqueeze
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:25.933.550 [trace_attr.c:99](tid:618674) doesn't set env ASCEND_LOG_DEVICE_FLUSH_TIMEOUT, use default timeout=0ms.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:25.933.583 [trace_attr.c:189](tid:618674) attr init success, timeout=0ms.
[WARNING] ATRACE(618674,python3.9):2025-04-03-09:27:25.933.596 [trace_system_api.c:115](tid:618674) env ASCEND_WORK_PATH is null.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:25.933.652 [trace_recorder.c:40](tid:618674) home_directory=/home/jenkins.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:25.933.669 [trace_recorder.c:121](tid:618674) use root path: /home/jenkins/ascend
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:25.933.680 [trace_event.c:151](tid:618674) init trace event success
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:25.933.732 [atrace_client_core.c:185](tid:618674) atrace client init success.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:25.934.951 [stacktrace_dumper.c:218](tid:618674) path = /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/bin/asc_dumper
[WARNING] ATRACE(618674,python3.9):2025-04-03-09:27:25.934.972 [trace_system_api.c:115](tid:618674) env ASCEND_COREDUMP_SIGNAL is null.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:25.935.054 [stacktrace_signal.c:165](tid:618674) register signal handler for signo 2 succeed.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:25.935.071 [stacktrace_signal.c:165](tid:618674) register signal handler for signo 15 succeed.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:25.935.082 [stacktrace_signal.c:165](tid:618674) register signal handler for signo 3 succeed.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:25.935.094 [stacktrace_signal.c:165](tid:618674) register signal handler for signo 4 succeed.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:25.935.107 [stacktrace_signal.c:165](tid:618674) register signal handler for signo 5 succeed.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:25.935.118 [stacktrace_signal.c:165](tid:618674) register signal handler for signo 6 succeed.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:25.935.130 [stacktrace_signal.c:165](tid:618674) register signal handler for signo 7 succeed.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:25.935.142 [stacktrace_signal.c:165](tid:618674) register signal handler for signo 8 succeed.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:25.935.154 [stacktrace_signal.c:165](tid:618674) register signal handler for signo 11 succeed.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:25.935.168 [stacktrace_signal.c:165](tid:618674) register signal handler for signo 24 succeed.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:25.935.180 [stacktrace_signal.c:165](tid:618674) register signal handler for signo 25 succeed.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:25.935.194 [stacktrace_signal.c:165](tid:618674) register signal handler for signo 31 succeed.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:25.935.207 [stacktrace_signal.c:165](tid:618674) register signal handler for signo 35 succeed.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:25.935.220 [stacktrace_signal.c:168](tid:618674) trace signal init succeed.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:25.935.229 [trace_core.c:51](tid:618674) trace init success.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:25.935.818 [task_fail_callback_data_manager.cc:58] 618674 TaskFailCallBackManager: Constructor.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.938.186 [mem_manager.cc:138]618662 RegisterAllocatorManager:MemManager RegisterAllocatorManager.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.940.446 [process_node_engine_manager.cc:140]618658 RegisterEngine:Register ProcessNodeEngine id:PS success.
[INFO] GE(618658,python3.9):2025-04-03-09:27:25.940.567 [process_node_engine_manager.cc:140]618658 RegisterEngine:Register ProcessNodeEngine id:NPU success.
[INFO] ME(618646,ffff85d12de0,python3.9):2025-04-03-09:27:25.942.059 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:377] LoadPlugin] Load libmindspore_ops_host plugin file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/libmindspore_ops_host.so success.
[INFO] CORE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:25.942.217 [mindspore/core/utils/ms_context.cc:105] SetDeviceId] Set MS_CTX_DEVICE_ID by env DEVICE_ID to: 0
[INFO] CORE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:25.942.262 [mindspore/core/utils/ms_context.cc:165] set_backend_policy] ms set context backend policy:ge
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:25.943.167 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_base_symbol.cc:63] LoadAclBaseApiSymbol] Load acl base api success!
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.944.451 [operator_factory_impl.cc:232]618674 RegisterInferShapeV2Func:operator infer shape v2 funcs init
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.944.487 [operator_factory_impl.cc:246]618674 RegisterInferShapeRangeFunc:operator infer shape range funcs init
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.944.500 [operator_factory_impl.cc:239]618674 RegisterInferDataTypeFunc:operator infer data type funcs init
[INFO] ME(618650,ffffbf562de0,python3.9):2025-04-03-09:27:25.944.585 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:377] LoadPlugin] Load libmindspore_ascend plugin file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/libmindspore_ascend.so.2 success.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:25.944.939 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_compiler_symbol.cc:39] LoadAclOpCompilerApiSymbol] Load acl op compiler api success!
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:25.945.026 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_mdl_symbol.cc:115] LoadAclMdlApiSymbol] Load acl mdl api success!
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:25.945.068 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_op_symbol.cc:55] LoadAclOpApiSymbol] Load ascend op api success!
[INFO] ME(618650,ffffbf562de0,python3.9):2025-04-03-09:27:25.945.069 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:377] LoadPlugin] Load libmindspore_ops_ascend plugin file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/libmindspore_ops_ascend.so success.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:25.945.169 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_prof_symbol.cc:49] LoadProfApiSymbol] Load acl prof api success!
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:25.945.205 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_rt_allocator_symbol.cc:48] LoadAclAllocatorApiSymbol] Load acl allocator api success!
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:25.945.267 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_rt_symbol.cc:149] LoadAclRtApiSymbol] Load acl rt api success!
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:25.945.296 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_symbol.cc:34] LoadAclApiSymbol] Load acl base api success!
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.945.463 [cache_policy.cc:47]618662 Create:[CachePolicy] Create CachePolicy with match_policy: 0, aging_policy: 0 success;
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:25.947.106 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_tdt_symbol.cc:82] LoadAcltdtApiSymbol] Load acl tdt api success!
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:25.947.142 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/symbol_utils.cc:79] LoadAscendApiSymbols] Load ascend api success!
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:25.947.184 [acl.cpp:753]618646 aclrtGetSocName: start to execute aclrtGetSocName.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.947.258 [runtime_keeper.cc:78] 618646 GetDeviceType: hardwareVersion=0x503
[INFO] DVPP(618658,python3.9):2025-04-03-09:27:25.947.444 [PlatformInfo.cpp:85][DVPP] [InitPara:85] [T2] chip type is 5.
[INFO] DVPP(618658,python3.9):2025-04-03-09:27:25.947.479 [PlatformInfo.cpp:94][DVPP] [InitPara:94] [T2] run mode is 1.
[INFO] DVPP(618658,python3.9):2025-04-03-09:27:25.947.994 [dvpp_dev_hdc.cpp:750][WRAP] [StartHostPacketCountTimer:750] [tid:618658] start packet count timer
[INFO] PROFILING(618654,python3.9):2025-04-03-09:27:25.949.678 [prof_atls_plugin.cpp:117] (tid:618654) RegisterProfileCallback, callback type is 7
[INFO] PROFILING(618654,python3.9):2025-04-03-09:27:25.949.731 [prof_atls_plugin.cpp:117] (tid:618654) RegisterProfileCallback, callback type is 8
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:25.950.986 [adapter_rts.cc:2720] [618674][adapter_rts.cc][CallBackInitRts] g_deviceType [6] g_deviceLogicId [-1] g_devicePhyId [-1]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.214 [plugin_old_arch.cc:16] 618646 ConstructRuntimeImpl: RuntimeImpl construct success, rt = 0xaaaafa7f0ec0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.252 [runtime_keeper.cc:149] 618646 CreateRuntimeImpl: Open libruntime_v100.so success
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.265 [runtime_keeper.cc:221] 618646 BootRuntime: new Runtime ok, Runtime_alloc_size 12600.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.308 [runtime.cc:1387] 618646 CheckHaveDevice: hardwareVersion=0x503
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.340 [runtime.cc:1163] 618646 InitChipAndSocType: Runtime init: device type=5, soc type=18, arch type=0, havedevice=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.367 [npu_driver.cc:4062] 618646 CheckSqcqIsSupportDevMem: sqcq support dev mem
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.389 [runtime.cc:5096] 618646 GetVisibleDevices: ASCEND_RT_VISIBLE_DEVICES param was not set
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.406 [runtime.cc:1173] 618646 InitApiImpile: ApiImpl:Runtime_alloc_size 8
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.419 [runtime.cc:1183] 618646 InitLogger: Logger:Runtime_alloc_size 32
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.436 [runtime.cc:1193] 618646 InitApiProfiler: RProfiler:Runtime_alloc_size 176
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.455 [profiler.cc:84] 618646 Init: Init ok, Runtime_alloc_size 48
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.481 [runtime.cc:1209] 618646 InitApiErrorDecorator: ApiErrorDecorator:Runtime_alloc_size 16.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.512 [runtime.cc:1219] 618646 InitThreadGuard: Runtime init:new ThreadGuard ok, Runtime_alloc_size 104.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.525 [runtime.cc:1230] 618646 InitStreamObserver: EngineStreamObserver:Runtime_alloc_size 8.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.539 [runtime.cc:1242] 618646 InitAicpuStreamIdBitmap: Bitmap(1024):Runtime_alloc_size 72.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.554 [runtime.cc:1264] 618646 InitCbSubscribe: The thread group num is 1024
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.570 [runtime.cc:1270] 618646 InitCbSubscribe: Runtime init:new CbSubscribe ok, Runtime_alloc_size 304.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.690 [runtime.cc:109] 618646 Init: ObjAllocator alloc success, Runtime_alloc_size 160000(bytes)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.952.120 [runtime.cc:121] 618646 Init: ObjAllocator alloc success, Runtime_alloc_size 960000(bytes)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.952.221 [runtime.cc:1314] 618646 InitLabelAllocator: Runtime init:new LabelAllocator ok, Runtime_alloc_size 131152.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.952.242 [runtime.cc:1322] 618646 InitSetRuntimeVersion: set runtime api ver success
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.952.371 [runtime.cc:1338] 618646 InitNpuCollectPath: NPU_COLLECT_PATH is not set!
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.952.434 [utils.cc:105] 618646 GetDriverPath: driver path is [Driver_Install_Path_Param=/usr/local/Ascend].
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.952.489 [runtime.cc:1664] 618646 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.952.534 [runtime.cc:1688] 618646 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.952.558 [runtime.cc:1953] 618646 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=preload_stack_16KB.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.952.588 [runtime.cc:1477] 618646 FindAndRegisterDcacheLockOp: register lock op success
[INFO] PROFILING(618646,python3.9):2025-04-03-09:27:25.952.612 [prof_atls_plugin.cpp:210] (tid:618646) Module[7] register callback of ctrl handle.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:25.952.634 [heterogenous.cc:19] 618646 ReadHeterogenousModeFromConfigIni: can not read ASCEND_LATEST_INSTALL_PATH! isHeterogenous=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.952.667 [api_c_soc.cc:70] 618646 rtGetSocVersion: soc version is Ascend910B3
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:25.952.685 [acl.cpp:115]618646 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:25.952.702 [acl.cpp:760]618646 aclrtGetSocName: execute aclrtGetSocName successfully
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:25.952.736 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:408] SetContextSocVersion] The soc version :Ascend910B3
[INFO] OP(618670,python3.9):2025-04-03-09:27:25.955.036 [nnopbase_args_pool.cpp:123][NNOP][GetCacheSizeLimit][618670] cachelimit is 10000
[INFO] OP(618666,python3.9):2025-04-03-09:27:25.955.132 [nnopbase_args_pool.cpp:123][NNOP][GetCacheSizeLimit][618666] cachelimit is 10000
[INFO] OP(618670,python3.9):2025-04-03-09:27:25.959.079 [op_dfx.cpp:230][NNOP][RecordOpArgCallback][618670] RecordOpArgCallback, get record op arg flag = 0
[INFO] OP(618666,python3.9):2025-04-03-09:27:25.959.078 [op_dfx.cpp:230][NNOP][RecordOpArgCallback][618666] RecordOpArgCallback, get record op arg flag = 0
[INFO] OP(618670,python3.9):2025-04-03-09:27:25.959.133 [op_dfx.cpp:54][NNOP][SystemConfig][618670] enable debug kernel flag 0.
[INFO] OP(618666,python3.9):2025-04-03-09:27:25.959.132 [op_dfx.cpp:54][NNOP][SystemConfig][618666] enable debug kernel flag 0.
[INFO] PROFILING(618666,python3.9):2025-04-03-09:27:25.959.146 [prof_cann_plugin.cpp:256] (tid:618666) Register module[61] callback.
[INFO] PROFILING(618670,python3.9):2025-04-03-09:27:25.959.147 [prof_cann_plugin.cpp:256] (tid:618670) Register module[61] callback.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.960.540 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for AddN.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.960.673 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for BatchMatMulV2.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.960.782 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Add.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.960.808 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Mul.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.960.832 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Less.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.960.854 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Sub.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.960.878 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for RealDiv.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.960.900 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Equal.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.960.931 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for NotEqual.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.960.952 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Greater.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.960.973 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Maximum.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.960.994 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Minimum.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.015 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for LogicalAnd.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.041 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for LogicalOr.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.063 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Div.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.085 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for LessEqual.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.107 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for SquaredDifference.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.128 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for GreaterEqual.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.150 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for DivNoNan.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.171 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for LeakyReluGrad.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.270 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for ClipByValue.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.392 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for ConcatV2.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.420 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for ConcatV2D.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.538 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Abs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.563 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Relu.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.583 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for IsNan.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.608 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Sign.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.630 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Exp.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.651 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Cast.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.672 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for LogicalNot.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.694 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Neg.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.721 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Sqrt.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.744 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Rsqrt.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.768 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Pow.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.789 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for ZerosLike.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.814 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Sigmoid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.835 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for BiasAdd.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.857 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Square.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.878 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Erf.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.902 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Reciprocal.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.925 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for LeakyRelu.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.961.947 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Tanh.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.962.043 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for ExpandDims.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.962.143 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Fill.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.962.243 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for GatherV2.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.962.342 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for LayerNorm.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.962.456 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for MatMul.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.962.481 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for MatMulV2.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.962.582 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Pack.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.962.684 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Pad.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.962.709 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for PadD.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.962.802 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Range.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.962.909 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for ReduceSum.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.962.934 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for ReduceMax.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.962.959 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for ReduceMin.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.962.981 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for ReduceProd.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.963.002 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for ReduceMean.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.963.023 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for ReduceAll.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.963.044 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for ReduceAny.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.963.068 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for ReduceSumD.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.963.090 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for ReduceMaxD.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.963.117 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for ReduceMinD.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.963.139 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for ReduceProdD.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.963.160 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for ReduceMeanD.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.963.183 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for ReduceAllD.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.963.204 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for ReduceAnyD.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.963.323 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Reshape.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.963.557 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Select.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.963.662 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Slice.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.963.758 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Split.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.963.783 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for SplitV.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.963.805 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for SplitD.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.963.830 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for SplitVD.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.963.925 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Squeeze.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.964.023 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for StridedSliceD.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.964.054 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for StridedSlice.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.964.176 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Tile.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.964.203 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for TileD.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.964.299 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Transpose.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.964.404 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for TransposeD.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.964.503 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Unpack.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.964.602 [addn.cc:29]618662 InferSymbolShape:Register infer symbol shape for Unsqueeze.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.964.952 [symbolic_kernel_factory.cc:27]618662 RegisterCreator:Register host symbolic kernel for node type ConcatV2D
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.965.062 [symbolic_kernel_factory.cc:27]618662 RegisterCreator:Register host symbolic kernel for node type ExpandDims
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.965.158 [symbolic_kernel_factory.cc:27]618662 RegisterCreator:Register host symbolic kernel for node type Fill
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.965.259 [symbolic_kernel_factory.cc:27]618662 RegisterCreator:Register host symbolic kernel for node type Pack
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.965.352 [symbolic_kernel_factory.cc:27]618662 RegisterCreator:Register host symbolic kernel for node type ReduceProd
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.965.450 [symbolic_kernel_factory.cc:27]618662 RegisterCreator:Register host symbolic kernel for node type Shape
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.965.543 [symbolic_kernel_factory.cc:27]618662 RegisterCreator:Register host symbolic kernel for node type Squeeze
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.965.637 [symbolic_kernel_factory.cc:27]618662 RegisterCreator:Register host symbolic kernel for node type StridedSlice
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.965.655 [symbolic_kernel_factory.cc:27]618662 RegisterCreator:Register host symbolic kernel for node type StridedSliceD
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.965.755 [symbolic_kernel_factory.cc:27]618662 RegisterCreator:Register host symbolic kernel for node type Tile
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.965.850 [symbolic_kernel_factory.cc:27]618662 RegisterCreator:Register host symbolic kernel for node type Unpack
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.965.943 [symbolic_kernel_factory.cc:27]618662 RegisterCreator:Register host symbolic kernel for node type Unsqueeze
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.967.004 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Allreduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.967.077 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Reduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:25.967.106 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] PROFILING(618658,python3.9):2025-04-03-09:27:25.970.384 [prof_atls_plugin.cpp:117] (tid:618658) RegisterProfileCallback, callback type is 7
[INFO] PROFILING(618658,python3.9):2025-04-03-09:27:25.970.424 [prof_atls_plugin.cpp:117] (tid:618658) RegisterProfileCallback, callback type is 8
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.972.716 [process_node_engine_manager.cc:140]618662 RegisterEngine:Register ProcessNodeEngine id:PS success.
[INFO] GE(618662,python3.9):2025-04-03-09:27:25.972.847 [process_node_engine_manager.cc:140]618662 RegisterEngine:Register ProcessNodeEngine id:NPU success.
[INFO] PROFILING(618674,python3.9):2025-04-03-09:27:25.977.655 [prof_cann_plugin.cpp:256] (tid:618674) Register module[6] callback.
[INFO] DVPP(618662,python3.9):2025-04-03-09:27:25.979.499 [PlatformInfo.cpp:85][DVPP] [InitPara:85] [T2] chip type is 5.
[INFO] DVPP(618662,python3.9):2025-04-03-09:27:25.979.538 [PlatformInfo.cpp:94][DVPP] [InitPara:94] [T2] run mode is 1.
[INFO] DVPP(618662,python3.9):2025-04-03-09:27:25.979.655 [dvpp_dev_hdc.cpp:750][WRAP] [StartHostPacketCountTimer:750] [tid:618662] start packet count timer
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:25.990.333 [mindspore/ccsrc/pybind_api/utils/log_adapter_py.cc:27] PyExceptionInitializer] Set exception handler
[INFO] ME(618650,ffffbf562de0,python3.9):2025-04-03-09:27:25.994.717 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:377] LoadPlugin] Load libmindspore_ops_host plugin file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/libmindspore_ops_host.so success.
[INFO] CORE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:25.994.846 [mindspore/core/utils/ms_context.cc:105] SetDeviceId] Set MS_CTX_DEVICE_ID by env DEVICE_ID to: 1
[INFO] CORE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:25.994.890 [mindspore/core/utils/ms_context.cc:165] set_backend_policy] ms set context backend policy:ge
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:25.995.713 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_base_symbol.cc:63] LoadAclBaseApiSymbol] Load acl base api success!
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:25.997.412 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_compiler_symbol.cc:39] LoadAclOpCompilerApiSymbol] Load acl op compiler api success!
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:25.997.494 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_mdl_symbol.cc:115] LoadAclMdlApiSymbol] Load acl mdl api success!
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:25.997.534 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_op_symbol.cc:55] LoadAclOpApiSymbol] Load ascend op api success!
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:25.997.629 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_prof_symbol.cc:49] LoadProfApiSymbol] Load acl prof api success!
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:25.997.665 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_rt_allocator_symbol.cc:48] LoadAclAllocatorApiSymbol] Load acl allocator api success!
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:25.997.723 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_rt_symbol.cc:149] LoadAclRtApiSymbol] Load acl rt api success!
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:25.997.752 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_symbol.cc:34] LoadAclApiSymbol] Load acl base api success!
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:25.999.467 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_tdt_symbol.cc:82] LoadAcltdtApiSymbol] Load acl tdt api success!
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:25.999.501 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/symbol_utils.cc:79] LoadAscendApiSymbols] Load ascend api success!
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:25.999.540 [acl.cpp:753]618650 aclrtGetSocName: start to execute aclrtGetSocName.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:25.999.613 [runtime_keeper.cc:78] 618650 GetDeviceType: hardwareVersion=0x503
[INFO] PROFILING(618662,python3.9):2025-04-03-09:27:26.001.536 [prof_atls_plugin.cpp:117] (tid:618662) RegisterProfileCallback, callback type is 7
[INFO] PROFILING(618662,python3.9):2025-04-03-09:27:26.001.594 [prof_atls_plugin.cpp:117] (tid:618662) RegisterProfileCallback, callback type is 8
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.424 [plugin_old_arch.cc:16] 618650 ConstructRuntimeImpl: RuntimeImpl construct success, rt = 0xaaab24e12730
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.462 [runtime_keeper.cc:149] 618650 CreateRuntimeImpl: Open libruntime_v100.so success
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.477 [runtime_keeper.cc:221] 618650 BootRuntime: new Runtime ok, Runtime_alloc_size 12600.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.513 [runtime.cc:1387] 618650 CheckHaveDevice: hardwareVersion=0x503
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.545 [runtime.cc:1163] 618650 InitChipAndSocType: Runtime init: device type=5, soc type=18, arch type=0, havedevice=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.573 [npu_driver.cc:4062] 618650 CheckSqcqIsSupportDevMem: sqcq support dev mem
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.595 [runtime.cc:5096] 618650 GetVisibleDevices: ASCEND_RT_VISIBLE_DEVICES param was not set
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.612 [runtime.cc:1173] 618650 InitApiImpile: ApiImpl:Runtime_alloc_size 8
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.625 [runtime.cc:1183] 618650 InitLogger: Logger:Runtime_alloc_size 32
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.643 [runtime.cc:1193] 618650 InitApiProfiler: RProfiler:Runtime_alloc_size 176
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.660 [profiler.cc:84] 618650 Init: Init ok, Runtime_alloc_size 48
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.680 [runtime.cc:1209] 618650 InitApiErrorDecorator: ApiErrorDecorator:Runtime_alloc_size 16.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.712 [runtime.cc:1219] 618650 InitThreadGuard: Runtime init:new ThreadGuard ok, Runtime_alloc_size 104.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.727 [runtime.cc:1230] 618650 InitStreamObserver: EngineStreamObserver:Runtime_alloc_size 8.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.740 [runtime.cc:1242] 618650 InitAicpuStreamIdBitmap: Bitmap(1024):Runtime_alloc_size 72.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.756 [runtime.cc:1264] 618650 InitCbSubscribe: The thread group num is 1024
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.772 [runtime.cc:1270] 618650 InitCbSubscribe: Runtime init:new CbSubscribe ok, Runtime_alloc_size 304.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.894 [runtime.cc:109] 618650 Init: ObjAllocator alloc success, Runtime_alloc_size 160000(bytes)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.004.366 [runtime.cc:121] 618650 Init: ObjAllocator alloc success, Runtime_alloc_size 960000(bytes)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.004.451 [runtime.cc:1314] 618650 InitLabelAllocator: Runtime init:new LabelAllocator ok, Runtime_alloc_size 131152.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.004.472 [runtime.cc:1322] 618650 InitSetRuntimeVersion: set runtime api ver success
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.004.597 [runtime.cc:1338] 618650 InitNpuCollectPath: NPU_COLLECT_PATH is not set!
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.004.664 [utils.cc:105] 618650 GetDriverPath: driver path is [Driver_Install_Path_Param=/usr/local/Ascend].
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.004.718 [runtime.cc:1664] 618650 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.004.758 [runtime.cc:1688] 618650 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.004.782 [runtime.cc:1953] 618650 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=preload_stack_16KB.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.004.813 [runtime.cc:1477] 618650 FindAndRegisterDcacheLockOp: register lock op success
[INFO] PROFILING(618650,python3.9):2025-04-03-09:27:26.004.836 [prof_atls_plugin.cpp:210] (tid:618650) Module[7] register callback of ctrl handle.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:26.004.859 [heterogenous.cc:19] 618650 ReadHeterogenousModeFromConfigIni: can not read ASCEND_LATEST_INSTALL_PATH! isHeterogenous=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.004.894 [api_c_soc.cc:70] 618650 rtGetSocVersion: soc version is Ascend910B3
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:26.004.912 [acl.cpp:115]618650 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:26.004.929 [acl.cpp:760]618650 aclrtGetSocName: execute aclrtGetSocName successfully
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:26.004.961 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:408] SetContextSocVersion] The soc version :Ascend910B3
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.008.302 [mem_manager.cc:138]618670 RegisterAllocatorManager:MemManager RegisterAllocatorManager.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.008.400 [mem_manager.cc:138]618666 RegisterAllocatorManager:MemManager RegisterAllocatorManager.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.014.803 [cache_policy.cc:47]618666 Create:[CachePolicy] Create CachePolicy with match_policy: 0, aging_policy: 0 success;
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.014.802 [cache_policy.cc:47]618670 Create:[CachePolicy] Create CachePolicy with match_policy: 0, aging_policy: 0 success;
[INFO] ME(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:26.019.221 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:377] LoadPlugin] Load libmindspore_ascend plugin file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/libmindspore_ascend.so.2 success.
[INFO] ME(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:26.019.670 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:377] LoadPlugin] Load libmindspore_ops_ascend plugin file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/libmindspore_ops_ascend.so success.
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:26.024.673 [mindspore/ccsrc/pybind_api/init.cc:250] pybind11_init__c_expression] Start GraphExecutorPy...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:26.025.125 [mindspore/ccsrc/pybind_api/init.cc:316] pybind11_init__c_expression] Start JitExecutorPy...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:26.025.569 [mindspore/ccsrc/pybind_api/init.cc:381] pybind11_init__c_expression] Start ParallelContext...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:26.026.382 [mindspore/ccsrc/pybind_api/init.cc:515] pybind11_init__c_expression] Start CostModelContext...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:26.026.839 [mindspore/ccsrc/pybind_api/init.cc:617] pybind11_init__c_expression] Start OffloadContext...
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.027.956 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for AddN.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.027.956 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for AddN.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.086 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for BatchMatMulV2.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.086 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for BatchMatMulV2.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.189 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Add.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.193 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Add.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.220 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Mul.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.240 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Less.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.258 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Sub.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.275 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for RealDiv.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.293 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Equal.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.217 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Mul.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.240 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Less.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.258 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Sub.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.273 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for RealDiv.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.289 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Equal.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.306 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for NotEqual.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.311 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for NotEqual.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.321 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Greater.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.328 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Greater.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.341 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Maximum.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.348 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Maximum.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.359 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Minimum.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.368 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Minimum.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.377 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for LogicalAnd.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.384 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for LogicalAnd.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.393 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for LogicalOr.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.400 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for LogicalOr.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.411 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Div.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.418 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Div.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.428 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for LessEqual.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.435 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for LessEqual.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.446 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for SquaredDifference.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.453 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for SquaredDifference.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.466 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for GreaterEqual.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.472 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for GreaterEqual.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.485 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for DivNoNan.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.490 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for DivNoNan.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.509 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for LeakyReluGrad.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.510 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for LeakyReluGrad.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.603 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for ClipByValue.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.606 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for ClipByValue.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:26.028.656 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/symbol_utils.cc:65] LoadAscendApiSymbols] Ascend api is already loaded.
[INFO] OP(618674,python3.9):2025-04-03-09:27:26.028.628 [nnopbase_args_pool.cpp:123][NNOP][GetCacheSizeLimit][618674] cachelimit is 10000
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.705 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for ConcatV2.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.705 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for ConcatV2.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.728 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for ConcatV2D.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.727 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for ConcatV2D.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:26.028.708 [acl.cpp:753]618646 aclrtGetSocName: start to execute aclrtGetSocName.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:26.028.741 [acl.cpp:115]618646 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:26.028.757 [acl.cpp:760]618646 aclrtGetSocName: execute aclrtGetSocName successfully
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:26.028.789 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:408] SetContextSocVersion] The soc version :Ascend910B3
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.817 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Abs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.822 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Abs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.842 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Relu.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.846 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Relu.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.861 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for IsNan.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.864 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for IsNan.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.883 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Sign.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.883 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Sign.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.900 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Exp.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.901 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Exp.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.918 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Cast.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.919 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Cast.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.936 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for LogicalNot.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.939 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for LogicalNot.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.956 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Neg.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.959 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Neg.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.973 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Sqrt.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.977 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Sqrt.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.028.992 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Rsqrt.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.028.995 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Rsqrt.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.029.010 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Pow.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.029.013 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Pow.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.029.027 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for ZerosLike.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.029.030 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for ZerosLike.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.029.044 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Sigmoid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.029.047 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Sigmoid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.029.062 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for BiasAdd.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.029.066 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for BiasAdd.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.029.081 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Square.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.029.085 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Square.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.029.098 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Erf.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.029.103 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Erf.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.029.119 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Reciprocal.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.029.123 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Reciprocal.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.029.137 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for LeakyRelu.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.029.141 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for LeakyRelu.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.029.158 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Tanh.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.029.162 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Tanh.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.029.249 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for ExpandDims.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.029.250 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for ExpandDims.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.029.337 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Fill.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.029.343 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Fill.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.029.426 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for GatherV2.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.029.427 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for GatherV2.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.029.516 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for LayerNorm.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.029.521 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for LayerNorm.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.029.608 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for MatMul.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.029.608 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for MatMul.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.029.633 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for MatMulV2.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.029.636 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for MatMulV2.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.029.718 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Pack.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.029.729 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Pack.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.029.817 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Pad.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.029.815 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Pad.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.029.837 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for PadD.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.029.838 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for PadD.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.029.921 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Range.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.029.921 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Range.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.030.018 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for ReduceSum.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.030.029 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for ReduceSum.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.030.042 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for ReduceMax.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.030.052 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for ReduceMax.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.030.061 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for ReduceMin.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.030.072 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for ReduceMin.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.030.079 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for ReduceProd.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.030.090 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for ReduceProd.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.030.096 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for ReduceMean.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.030.108 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for ReduceMean.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.030.115 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for ReduceAll.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.030.126 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for ReduceAll.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.030.134 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for ReduceAny.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.030.145 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for ReduceAny.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.030.159 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for ReduceSumD.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.030.162 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for ReduceSumD.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.030.177 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for ReduceMaxD.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.030.180 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for ReduceMaxD.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.030.197 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for ReduceMinD.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.030.200 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for ReduceMinD.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.030.214 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for ReduceProdD.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.030.218 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for ReduceProdD.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.030.232 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for ReduceMeanD.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.030.235 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for ReduceMeanD.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.030.250 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for ReduceAllD.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.030.257 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for ReduceAllD.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.030.269 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for ReduceAnyD.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.030.276 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for ReduceAnyD.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.030.362 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Reshape.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.030.362 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Reshape.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.030.451 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Select.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.030.454 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Select.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.030.538 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Slice.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.030.538 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Slice.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.030.626 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Split.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.030.629 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Split.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.030.650 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for SplitV.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.030.657 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for SplitV.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.030.671 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for SplitD.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.030.676 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for SplitD.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.030.691 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for SplitVD.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.030.695 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for SplitVD.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.030.782 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Squeeze.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.030.790 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Squeeze.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.030.873 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for StridedSliceD.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.030.880 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for StridedSliceD.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.030.899 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for StridedSlice.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.030.901 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for StridedSlice.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.030.986 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Tile.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.030.995 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Tile.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.031.010 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for TileD.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.031.019 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for TileD.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.031.097 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Transpose.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.031.101 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Transpose.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.031.185 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for TransposeD.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.031.192 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for TransposeD.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.031.280 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Unpack.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.031.280 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Unpack.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.031.365 [addn.cc:29]618670 InferSymbolShape:Register infer symbol shape for Unsqueeze.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.031.365 [addn.cc:29]618666 InferSymbolShape:Register infer symbol shape for Unsqueeze.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.031.676 [symbolic_kernel_factory.cc:27]618666 RegisterCreator:Register host symbolic kernel for node type ConcatV2D
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.031.677 [symbolic_kernel_factory.cc:27]618670 RegisterCreator:Register host symbolic kernel for node type ConcatV2D
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.031.765 [symbolic_kernel_factory.cc:27]618670 RegisterCreator:Register host symbolic kernel for node type ExpandDims
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.031.768 [symbolic_kernel_factory.cc:27]618666 RegisterCreator:Register host symbolic kernel for node type ExpandDims
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.031.850 [symbolic_kernel_factory.cc:27]618670 RegisterCreator:Register host symbolic kernel for node type Fill
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.031.853 [symbolic_kernel_factory.cc:27]618666 RegisterCreator:Register host symbolic kernel for node type Fill
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.031.931 [symbolic_kernel_factory.cc:27]618670 RegisterCreator:Register host symbolic kernel for node type Pack
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.031.939 [symbolic_kernel_factory.cc:27]618666 RegisterCreator:Register host symbolic kernel for node type Pack
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.032.014 [symbolic_kernel_factory.cc:27]618670 RegisterCreator:Register host symbolic kernel for node type ReduceProd
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.032.019 [symbolic_kernel_factory.cc:27]618666 RegisterCreator:Register host symbolic kernel for node type ReduceProd
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.032.095 [symbolic_kernel_factory.cc:27]618670 RegisterCreator:Register host symbolic kernel for node type Shape
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.032.101 [symbolic_kernel_factory.cc:27]618666 RegisterCreator:Register host symbolic kernel for node type Shape
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.032.194 [symbolic_kernel_factory.cc:27]618666 RegisterCreator:Register host symbolic kernel for node type Squeeze
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.032.194 [symbolic_kernel_factory.cc:27]618670 RegisterCreator:Register host symbolic kernel for node type Squeeze
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.032.277 [symbolic_kernel_factory.cc:27]618670 RegisterCreator:Register host symbolic kernel for node type StridedSlice
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.032.277 [symbolic_kernel_factory.cc:27]618666 RegisterCreator:Register host symbolic kernel for node type StridedSlice
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.032.292 [symbolic_kernel_factory.cc:27]618666 RegisterCreator:Register host symbolic kernel for node type StridedSliceD
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.032.292 [symbolic_kernel_factory.cc:27]618670 RegisterCreator:Register host symbolic kernel for node type StridedSliceD
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.032.375 [symbolic_kernel_factory.cc:27]618670 RegisterCreator:Register host symbolic kernel for node type Tile
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.032.374 [symbolic_kernel_factory.cc:27]618666 RegisterCreator:Register host symbolic kernel for node type Tile
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.032.463 [symbolic_kernel_factory.cc:27]618670 RegisterCreator:Register host symbolic kernel for node type Unpack
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.032.463 [symbolic_kernel_factory.cc:27]618666 RegisterCreator:Register host symbolic kernel for node type Unpack
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.032.543 [symbolic_kernel_factory.cc:27]618666 RegisterCreator:Register host symbolic kernel for node type Unsqueeze
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.032.546 [symbolic_kernel_factory.cc:27]618670 RegisterCreator:Register host symbolic kernel for node type Unsqueeze
[INFO] OP(618674,python3.9):2025-04-03-09:27:26.032.718 [op_dfx.cpp:230][NNOP][RecordOpArgCallback][618674] RecordOpArgCallback, get record op arg flag = 0
[INFO] OP(618674,python3.9):2025-04-03-09:27:26.032.774 [op_dfx.cpp:54][NNOP][SystemConfig][618674] enable debug kernel flag 0.
[INFO] PROFILING(618674,python3.9):2025-04-03-09:27:26.032.795 [prof_cann_plugin.cpp:256] (tid:618674) Register module[61] callback.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.038.528 [process_node_engine_manager.cc:140]618670 RegisterEngine:Register ProcessNodeEngine id:PS success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.038.521 [process_node_engine_manager.cc:140]618666 RegisterEngine:Register ProcessNodeEngine id:PS success.
[INFO] GE(618670,python3.9):2025-04-03-09:27:26.038.637 [process_node_engine_manager.cc:140]618670 RegisterEngine:Register ProcessNodeEngine id:NPU success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:26.038.648 [process_node_engine_manager.cc:140]618666 RegisterEngine:Register ProcessNodeEngine id:NPU success.
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:26.040.248 [mindspore/ccsrc/pybind_api/utils/log_adapter_py.cc:27] PyExceptionInitializer] Set exception handler
[INFO] DVPP(618666,python3.9):2025-04-03-09:27:26.044.637 [PlatformInfo.cpp:85][DVPP] [InitPara:85] [T2] chip type is 5.
[INFO] DVPP(618670,python3.9):2025-04-03-09:27:26.044.637 [PlatformInfo.cpp:85][DVPP] [InitPara:85] [T2] chip type is 5.
[INFO] DVPP(618670,python3.9):2025-04-03-09:27:26.044.670 [PlatformInfo.cpp:94][DVPP] [InitPara:94] [T2] run mode is 1.
[INFO] DVPP(618666,python3.9):2025-04-03-09:27:26.044.673 [PlatformInfo.cpp:94][DVPP] [InitPara:94] [T2] run mode is 1.
[INFO] DVPP(618666,python3.9):2025-04-03-09:27:26.045.186 [dvpp_dev_hdc.cpp:750][WRAP] [StartHostPacketCountTimer:750] [tid:618666] start packet count timer
[INFO] DVPP(618670,python3.9):2025-04-03-09:27:26.045.188 [dvpp_dev_hdc.cpp:750][WRAP] [StartHostPacketCountTimer:750] [tid:618670] start packet count timer
[INFO] ME(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:26.048.708 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:377] LoadPlugin] Load libmindspore_ascend plugin file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/libmindspore_ascend.so.2 success.
[INFO] ME(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:26.049.224 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:377] LoadPlugin] Load libmindspore_ops_ascend plugin file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/libmindspore_ops_ascend.so success.
[INFO] ME(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:26.056.509 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:377] LoadPlugin] Load libmindspore_ops_host plugin file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/libmindspore_ops_host.so success.
[INFO] CORE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:26.056.652 [mindspore/core/utils/ms_context.cc:105] SetDeviceId] Set MS_CTX_DEVICE_ID by env DEVICE_ID to: 2
[INFO] CORE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:26.056.685 [mindspore/core/utils/ms_context.cc:165] set_backend_policy] ms set context backend policy:ge
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:26.057.436 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_base_symbol.cc:63] LoadAclBaseApiSymbol] Load acl base api success!
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:26.059.066 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_compiler_symbol.cc:39] LoadAclOpCompilerApiSymbol] Load acl op compiler api success!
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:26.059.134 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_mdl_symbol.cc:115] LoadAclMdlApiSymbol] Load acl mdl api success!
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:26.059.167 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_op_symbol.cc:55] LoadAclOpApiSymbol] Load ascend op api success!
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:26.059.251 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_prof_symbol.cc:49] LoadProfApiSymbol] Load acl prof api success!
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:26.059.277 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_rt_allocator_symbol.cc:48] LoadAclAllocatorApiSymbol] Load acl allocator api success!
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:26.059.321 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_rt_symbol.cc:149] LoadAclRtApiSymbol] Load acl rt api success!
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:26.059.343 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_symbol.cc:34] LoadAclApiSymbol] Load acl base api success!
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:26.061.022 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_tdt_symbol.cc:82] LoadAcltdtApiSymbol] Load acl tdt api success!
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:26.061.055 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/symbol_utils.cc:79] LoadAscendApiSymbols] Load ascend api success!
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:26.061.086 [acl.cpp:753]618654 aclrtGetSocName: start to execute aclrtGetSocName.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.061.139 [runtime_keeper.cc:78] 618654 GetDeviceType: hardwareVersion=0x503
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.588 [plugin_old_arch.cc:16] 618654 ConstructRuntimeImpl: RuntimeImpl construct success, rt = 0xaaaae8bea360
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.624 [runtime_keeper.cc:149] 618654 CreateRuntimeImpl: Open libruntime_v100.so success
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.635 [runtime_keeper.cc:221] 618654 BootRuntime: new Runtime ok, Runtime_alloc_size 12600.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.666 [runtime.cc:1387] 618654 CheckHaveDevice: hardwareVersion=0x503
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.691 [runtime.cc:1163] 618654 InitChipAndSocType: Runtime init: device type=5, soc type=18, arch type=0, havedevice=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.713 [npu_driver.cc:4062] 618654 CheckSqcqIsSupportDevMem: sqcq support dev mem
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.728 [runtime.cc:5096] 618654 GetVisibleDevices: ASCEND_RT_VISIBLE_DEVICES param was not set
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.739 [runtime.cc:1173] 618654 InitApiImpile: ApiImpl:Runtime_alloc_size 8
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.750 [runtime.cc:1183] 618654 InitLogger: Logger:Runtime_alloc_size 32
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.763 [runtime.cc:1193] 618654 InitApiProfiler: RProfiler:Runtime_alloc_size 176
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.774 [profiler.cc:84] 618654 Init: Init ok, Runtime_alloc_size 48
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.789 [runtime.cc:1209] 618654 InitApiErrorDecorator: ApiErrorDecorator:Runtime_alloc_size 16.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.808 [runtime.cc:1219] 618654 InitThreadGuard: Runtime init:new ThreadGuard ok, Runtime_alloc_size 104.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.818 [runtime.cc:1230] 618654 InitStreamObserver: EngineStreamObserver:Runtime_alloc_size 8.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.828 [runtime.cc:1242] 618654 InitAicpuStreamIdBitmap: Bitmap(1024):Runtime_alloc_size 72.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.838 [runtime.cc:1264] 618654 InitCbSubscribe: The thread group num is 1024
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.849 [runtime.cc:1270] 618654 InitCbSubscribe: Runtime init:new CbSubscribe ok, Runtime_alloc_size 304.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.956 [runtime.cc:109] 618654 Init: ObjAllocator alloc success, Runtime_alloc_size 160000(bytes)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.065.349 [runtime.cc:121] 618654 Init: ObjAllocator alloc success, Runtime_alloc_size 960000(bytes)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.065.423 [runtime.cc:1314] 618654 InitLabelAllocator: Runtime init:new LabelAllocator ok, Runtime_alloc_size 131152.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.065.436 [runtime.cc:1322] 618654 InitSetRuntimeVersion: set runtime api ver success
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.065.549 [runtime.cc:1338] 618654 InitNpuCollectPath: NPU_COLLECT_PATH is not set!
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.065.607 [utils.cc:105] 618654 GetDriverPath: driver path is [Driver_Install_Path_Param=/usr/local/Ascend].
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.065.661 [runtime.cc:1664] 618654 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.065.693 [runtime.cc:1688] 618654 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.065.710 [runtime.cc:1953] 618654 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=preload_stack_16KB.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.065.734 [runtime.cc:1477] 618654 FindAndRegisterDcacheLockOp: register lock op success
[INFO] PROFILING(618654,python3.9):2025-04-03-09:27:26.065.751 [prof_atls_plugin.cpp:210] (tid:618654) Module[7] register callback of ctrl handle.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:26.065.767 [heterogenous.cc:19] 618654 ReadHeterogenousModeFromConfigIni: can not read ASCEND_LATEST_INSTALL_PATH! isHeterogenous=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.065.794 [api_c_soc.cc:70] 618654 rtGetSocVersion: soc version is Ascend910B3
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:26.065.807 [acl.cpp:115]618654 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:26.065.819 [acl.cpp:760]618654 aclrtGetSocName: execute aclrtGetSocName successfully
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:26.065.852 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:408] SetContextSocVersion] The soc version :Ascend910B3
[INFO] PROFILING(618670,python3.9):2025-04-03-09:27:26.066.292 [prof_atls_plugin.cpp:117] (tid:618670) RegisterProfileCallback, callback type is 7
[INFO] PROFILING(618670,python3.9):2025-04-03-09:27:26.066.335 [prof_atls_plugin.cpp:117] (tid:618670) RegisterProfileCallback, callback type is 8
[INFO] PROFILING(618666,python3.9):2025-04-03-09:27:26.066.292 [prof_atls_plugin.cpp:117] (tid:618666) RegisterProfileCallback, callback type is 7
[INFO] PROFILING(618666,python3.9):2025-04-03-09:27:26.066.335 [prof_atls_plugin.cpp:117] (tid:618666) RegisterProfileCallback, callback type is 8
[INFO] ME(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:26.069.038 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:377] LoadPlugin] Load libmindspore_ascend plugin file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/libmindspore_ascend.so.2 success.
[INFO] ME(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:26.069.501 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:377] LoadPlugin] Load libmindspore_ops_ascend plugin file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/libmindspore_ops_ascend.so success.
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:26.074.310 [mindspore/ccsrc/pybind_api/init.cc:250] pybind11_init__c_expression] Start GraphExecutorPy...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:26.074.774 [mindspore/ccsrc/pybind_api/init.cc:316] pybind11_init__c_expression] Start JitExecutorPy...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:26.075.218 [mindspore/ccsrc/pybind_api/init.cc:381] pybind11_init__c_expression] Start ParallelContext...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:26.076.021 [mindspore/ccsrc/pybind_api/init.cc:515] pybind11_init__c_expression] Start CostModelContext...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:26.076.510 [mindspore/ccsrc/pybind_api/init.cc:617] pybind11_init__c_expression] Start OffloadContext...
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:26.078.253 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/symbol_utils.cc:65] LoadAscendApiSymbols] Ascend api is already loaded.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:26.078.306 [acl.cpp:753]618650 aclrtGetSocName: start to execute aclrtGetSocName.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:26.078.342 [acl.cpp:115]618650 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:26.078.361 [acl.cpp:760]618650 aclrtGetSocName: execute aclrtGetSocName successfully
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:26.078.385 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:408] SetContextSocVersion] The soc version :Ascend910B3
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.085.781 [mem_manager.cc:138]618674 RegisterAllocatorManager:MemManager RegisterAllocatorManager.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.092.823 [cache_policy.cc:47]618674 Create:[CachePolicy] Create CachePolicy with match_policy: 0, aging_policy: 0 success;
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:26.095.670 [mindspore/ccsrc/pybind_api/utils/log_adapter_py.cc:27] PyExceptionInitializer] Set exception handler
[INFO] ME(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:26.097.677 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:377] LoadPlugin] Load libmindspore_ops_host plugin file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/libmindspore_ops_host.so success.
[INFO] CORE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:26.097.811 [mindspore/core/utils/ms_context.cc:105] SetDeviceId] Set MS_CTX_DEVICE_ID by env DEVICE_ID to: 3
[INFO] CORE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:26.097.854 [mindspore/core/utils/ms_context.cc:165] set_backend_policy] ms set context backend policy:ge
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:26.098.660 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_base_symbol.cc:63] LoadAclBaseApiSymbol] Load acl base api success!
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:26.100.359 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_compiler_symbol.cc:39] LoadAclOpCompilerApiSymbol] Load acl op compiler api success!
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:26.100.440 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_mdl_symbol.cc:115] LoadAclMdlApiSymbol] Load acl mdl api success!
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:26.100.478 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_op_symbol.cc:55] LoadAclOpApiSymbol] Load ascend op api success!
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:26.100.577 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_prof_symbol.cc:49] LoadProfApiSymbol] Load acl prof api success!
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:26.100.610 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_rt_allocator_symbol.cc:48] LoadAclAllocatorApiSymbol] Load acl allocator api success!
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:26.100.667 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_rt_symbol.cc:149] LoadAclRtApiSymbol] Load acl rt api success!
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:26.100.695 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_symbol.cc:34] LoadAclApiSymbol] Load acl base api success!
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:26.102.422 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_tdt_symbol.cc:82] LoadAcltdtApiSymbol] Load acl tdt api success!
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:26.102.454 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/symbol_utils.cc:79] LoadAscendApiSymbols] Load ascend api success!
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:26.102.491 [acl.cpp:753]618658 aclrtGetSocName: start to execute aclrtGetSocName.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.102.571 [runtime_keeper.cc:78] 618658 GetDeviceType: hardwareVersion=0x503
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.443 [plugin_old_arch.cc:16] 618658 ConstructRuntimeImpl: RuntimeImpl construct success, rt = 0xaaaafe6231e0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.475 [runtime_keeper.cc:149] 618658 CreateRuntimeImpl: Open libruntime_v100.so success
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.489 [runtime_keeper.cc:221] 618658 BootRuntime: new Runtime ok, Runtime_alloc_size 12600.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.526 [runtime.cc:1387] 618658 CheckHaveDevice: hardwareVersion=0x503
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.556 [runtime.cc:1163] 618658 InitChipAndSocType: Runtime init: device type=5, soc type=18, arch type=0, havedevice=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.581 [npu_driver.cc:4062] 618658 CheckSqcqIsSupportDevMem: sqcq support dev mem
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.602 [runtime.cc:5096] 618658 GetVisibleDevices: ASCEND_RT_VISIBLE_DEVICES param was not set
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.617 [runtime.cc:1173] 618658 InitApiImpile: ApiImpl:Runtime_alloc_size 8
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.629 [runtime.cc:1183] 618658 InitLogger: Logger:Runtime_alloc_size 32
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.651 [runtime.cc:1193] 618658 InitApiProfiler: RProfiler:Runtime_alloc_size 176
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.667 [profiler.cc:84] 618658 Init: Init ok, Runtime_alloc_size 48
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.688 [runtime.cc:1209] 618658 InitApiErrorDecorator: ApiErrorDecorator:Runtime_alloc_size 16.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.714 [runtime.cc:1219] 618658 InitThreadGuard: Runtime init:new ThreadGuard ok, Runtime_alloc_size 104.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.726 [runtime.cc:1230] 618658 InitStreamObserver: EngineStreamObserver:Runtime_alloc_size 8.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.739 [runtime.cc:1242] 618658 InitAicpuStreamIdBitmap: Bitmap(1024):Runtime_alloc_size 72.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.754 [runtime.cc:1264] 618658 InitCbSubscribe: The thread group num is 1024
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.768 [runtime.cc:1270] 618658 InitCbSubscribe: Runtime init:new CbSubscribe ok, Runtime_alloc_size 304.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.880 [runtime.cc:109] 618658 Init: ObjAllocator alloc success, Runtime_alloc_size 160000(bytes)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.107.288 [runtime.cc:121] 618658 Init: ObjAllocator alloc success, Runtime_alloc_size 960000(bytes)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.107.362 [runtime.cc:1314] 618658 InitLabelAllocator: Runtime init:new LabelAllocator ok, Runtime_alloc_size 131152.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.107.380 [runtime.cc:1322] 618658 InitSetRuntimeVersion: set runtime api ver success
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.107.498 [runtime.cc:1338] 618658 InitNpuCollectPath: NPU_COLLECT_PATH is not set!
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.107.462 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for AddN.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.107.559 [utils.cc:105] 618658 GetDriverPath: driver path is [Driver_Install_Path_Param=/usr/local/Ascend].
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.107.608 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for BatchMatMulV2.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.107.617 [runtime.cc:1664] 618658 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.107.656 [runtime.cc:1688] 618658 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.107.680 [runtime.cc:1953] 618658 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=preload_stack_16KB.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.107.709 [runtime.cc:1477] 618658 FindAndRegisterDcacheLockOp: register lock op success
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.107.710 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Add.
[INFO] PROFILING(618658,python3.9):2025-04-03-09:27:26.107.730 [prof_atls_plugin.cpp:210] (tid:618658) Module[7] register callback of ctrl handle.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.107.738 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Mul.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:26.107.752 [heterogenous.cc:19] 618658 ReadHeterogenousModeFromConfigIni: can not read ASCEND_LATEST_INSTALL_PATH! isHeterogenous=0.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.107.759 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Less.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.107.781 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Sub.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.107.786 [api_c_soc.cc:70] 618658 rtGetSocVersion: soc version is Ascend910B3
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:26.107.803 [acl.cpp:115]618658 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.107.806 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for RealDiv.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:26.107.816 [acl.cpp:760]618658 aclrtGetSocName: execute aclrtGetSocName successfully
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.107.827 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Equal.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.107.851 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for NotEqual.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:26.107.851 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:408] SetContextSocVersion] The soc version :Ascend910B3
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.107.872 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Greater.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.107.895 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Maximum.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.107.916 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Minimum.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.107.939 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for LogicalAnd.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.107.960 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for LogicalOr.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.107.981 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Div.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.108.002 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for LessEqual.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.108.023 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for SquaredDifference.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.108.045 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for GreaterEqual.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.108.067 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for DivNoNan.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.108.088 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for LeakyReluGrad.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.108.196 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for ClipByValue.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.108.315 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for ConcatV2.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.108.345 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for ConcatV2D.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.108.437 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Abs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.108.464 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Relu.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.108.486 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for IsNan.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.108.508 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Sign.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.108.529 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Exp.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.108.555 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Cast.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.108.576 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for LogicalNot.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.108.597 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Neg.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.108.619 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Sqrt.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.108.642 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Rsqrt.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.108.662 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Pow.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.108.685 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for ZerosLike.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.108.706 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Sigmoid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.108.726 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for BiasAdd.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.108.747 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Square.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.108.768 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Erf.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.108.793 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Reciprocal.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.108.815 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for LeakyRelu.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.108.835 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Tanh.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.108.936 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for ExpandDims.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.109.035 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Fill.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.109.144 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for GatherV2.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.109.244 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for LayerNorm.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.109.345 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for MatMul.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.109.372 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for MatMulV2.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.109.474 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Pack.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.109.576 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Pad.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.109.600 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for PadD.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.109.693 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Range.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.109.799 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for ReduceSum.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.109.823 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for ReduceMax.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.109.844 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for ReduceMin.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.109.866 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for ReduceProd.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.109.888 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for ReduceMean.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.109.908 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for ReduceAll.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.109.933 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for ReduceAny.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.109.953 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for ReduceSumD.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.109.974 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for ReduceMaxD.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.109.999 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for ReduceMinD.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.110.019 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for ReduceProdD.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.110.040 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for ReduceMeanD.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.110.062 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for ReduceAllD.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.110.089 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for ReduceAnyD.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.110.183 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Reshape.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.110.281 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Select.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.110.393 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Slice.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.110.489 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Split.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.110.517 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for SplitV.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.110.539 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for SplitD.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.110.560 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for SplitVD.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.110.655 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Squeeze.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.110.756 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for StridedSliceD.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.110.781 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for StridedSlice.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.110.880 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Tile.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.110.905 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for TileD.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.111.010 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Transpose.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.111.108 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for TransposeD.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.111.208 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Unpack.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.111.303 [addn.cc:29]618674 InferSymbolShape:Register infer symbol shape for Unsqueeze.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.111.647 [symbolic_kernel_factory.cc:27]618674 RegisterCreator:Register host symbolic kernel for node type ConcatV2D
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.111.744 [symbolic_kernel_factory.cc:27]618674 RegisterCreator:Register host symbolic kernel for node type ExpandDims
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.111.846 [symbolic_kernel_factory.cc:27]618674 RegisterCreator:Register host symbolic kernel for node type Fill
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.111.937 [symbolic_kernel_factory.cc:27]618674 RegisterCreator:Register host symbolic kernel for node type Pack
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.112.038 [symbolic_kernel_factory.cc:27]618674 RegisterCreator:Register host symbolic kernel for node type ReduceProd
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.112.131 [symbolic_kernel_factory.cc:27]618674 RegisterCreator:Register host symbolic kernel for node type Shape
[INFO] ME(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:26.112.110 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:377] LoadPlugin] Load libmindspore_ops_host plugin file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/libmindspore_ops_host.so success.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.112.230 [symbolic_kernel_factory.cc:27]618674 RegisterCreator:Register host symbolic kernel for node type Squeeze
[INFO] CORE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:26.112.241 [mindspore/core/utils/ms_context.cc:105] SetDeviceId] Set MS_CTX_DEVICE_ID by env DEVICE_ID to: 4
[INFO] CORE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:26.112.278 [mindspore/core/utils/ms_context.cc:165] set_backend_policy] ms set context backend policy:ge
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.112.326 [symbolic_kernel_factory.cc:27]618674 RegisterCreator:Register host symbolic kernel for node type StridedSlice
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.112.345 [symbolic_kernel_factory.cc:27]618674 RegisterCreator:Register host symbolic kernel for node type StridedSliceD
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.112.433 [symbolic_kernel_factory.cc:27]618674 RegisterCreator:Register host symbolic kernel for node type Tile
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.112.529 [symbolic_kernel_factory.cc:27]618674 RegisterCreator:Register host symbolic kernel for node type Unpack
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.112.619 [symbolic_kernel_factory.cc:27]618674 RegisterCreator:Register host symbolic kernel for node type Unsqueeze
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:26.113.045 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_base_symbol.cc:63] LoadAclBaseApiSymbol] Load acl base api success!
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:26.114.577 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_compiler_symbol.cc:39] LoadAclOpCompilerApiSymbol] Load acl op compiler api success!
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:26.114.642 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_mdl_symbol.cc:115] LoadAclMdlApiSymbol] Load acl mdl api success!
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:26.114.676 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_op_symbol.cc:55] LoadAclOpApiSymbol] Load ascend op api success!
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:26.114.763 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_prof_symbol.cc:49] LoadProfApiSymbol] Load acl prof api success!
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:26.114.793 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_rt_allocator_symbol.cc:48] LoadAclAllocatorApiSymbol] Load acl allocator api success!
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:26.114.840 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_rt_symbol.cc:149] LoadAclRtApiSymbol] Load acl rt api success!
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:26.114.865 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_symbol.cc:34] LoadAclApiSymbol] Load acl base api success!
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:26.116.592 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_tdt_symbol.cc:82] LoadAcltdtApiSymbol] Load acl tdt api success!
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:26.116.623 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/symbol_utils.cc:79] LoadAscendApiSymbols] Load ascend api success!
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:26.116.660 [acl.cpp:753]618662 aclrtGetSocName: start to execute aclrtGetSocName.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.116.721 [runtime_keeper.cc:78] 618662 GetDeviceType: hardwareVersion=0x503
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.119.290 [process_node_engine_manager.cc:140]618674 RegisterEngine:Register ProcessNodeEngine id:PS success.
[INFO] GE(618674,python3.9):2025-04-03-09:27:26.119.420 [process_node_engine_manager.cc:140]618674 RegisterEngine:Register ProcessNodeEngine id:NPU success.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.241 [plugin_old_arch.cc:16] 618662 ConstructRuntimeImpl: RuntimeImpl construct success, rt = 0xaaaafc177e10
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.275 [runtime_keeper.cc:149] 618662 CreateRuntimeImpl: Open libruntime_v100.so success
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.287 [runtime_keeper.cc:221] 618662 BootRuntime: new Runtime ok, Runtime_alloc_size 12600.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.328 [runtime.cc:1387] 618662 CheckHaveDevice: hardwareVersion=0x503
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.355 [runtime.cc:1163] 618662 InitChipAndSocType: Runtime init: device type=5, soc type=18, arch type=0, havedevice=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.379 [npu_driver.cc:4062] 618662 CheckSqcqIsSupportDevMem: sqcq support dev mem
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.398 [runtime.cc:5096] 618662 GetVisibleDevices: ASCEND_RT_VISIBLE_DEVICES param was not set
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.412 [runtime.cc:1173] 618662 InitApiImpile: ApiImpl:Runtime_alloc_size 8
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.426 [runtime.cc:1183] 618662 InitLogger: Logger:Runtime_alloc_size 32
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.445 [runtime.cc:1193] 618662 InitApiProfiler: RProfiler:Runtime_alloc_size 176
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.460 [profiler.cc:84] 618662 Init: Init ok, Runtime_alloc_size 48
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.480 [runtime.cc:1209] 618662 InitApiErrorDecorator: ApiErrorDecorator:Runtime_alloc_size 16.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.505 [runtime.cc:1219] 618662 InitThreadGuard: Runtime init:new ThreadGuard ok, Runtime_alloc_size 104.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.517 [runtime.cc:1230] 618662 InitStreamObserver: EngineStreamObserver:Runtime_alloc_size 8.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.530 [runtime.cc:1242] 618662 InitAicpuStreamIdBitmap: Bitmap(1024):Runtime_alloc_size 72.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.544 [runtime.cc:1264] 618662 InitCbSubscribe: The thread group num is 1024
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.558 [runtime.cc:1270] 618662 InitCbSubscribe: Runtime init:new CbSubscribe ok, Runtime_alloc_size 304.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.669 [runtime.cc:109] 618662 Init: ObjAllocator alloc success, Runtime_alloc_size 160000(bytes)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.121.075 [runtime.cc:121] 618662 Init: ObjAllocator alloc success, Runtime_alloc_size 960000(bytes)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.121.150 [runtime.cc:1314] 618662 InitLabelAllocator: Runtime init:new LabelAllocator ok, Runtime_alloc_size 131152.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.121.166 [runtime.cc:1322] 618662 InitSetRuntimeVersion: set runtime api ver success
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.121.286 [runtime.cc:1338] 618662 InitNpuCollectPath: NPU_COLLECT_PATH is not set!
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.121.347 [utils.cc:105] 618662 GetDriverPath: driver path is [Driver_Install_Path_Param=/usr/local/Ascend].
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.121.398 [runtime.cc:1664] 618662 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.121.433 [runtime.cc:1688] 618662 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.121.452 [runtime.cc:1953] 618662 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=preload_stack_16KB.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.121.479 [runtime.cc:1477] 618662 FindAndRegisterDcacheLockOp: register lock op success
[INFO] PROFILING(618662,python3.9):2025-04-03-09:27:26.121.499 [prof_atls_plugin.cpp:210] (tid:618662) Module[7] register callback of ctrl handle.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:26.121.517 [heterogenous.cc:19] 618662 ReadHeterogenousModeFromConfigIni: can not read ASCEND_LATEST_INSTALL_PATH! isHeterogenous=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.121.546 [api_c_soc.cc:70] 618662 rtGetSocVersion: soc version is Ascend910B3
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:26.121.564 [acl.cpp:115]618662 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:26.121.578 [acl.cpp:760]618662 aclrtGetSocName: execute aclrtGetSocName successfully
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:26.121.611 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:408] SetContextSocVersion] The soc version :Ascend910B3
[INFO] DVPP(618674,python3.9):2025-04-03-09:27:26.125.994 [PlatformInfo.cpp:85][DVPP] [InitPara:85] [T2] chip type is 5.
[INFO] DVPP(618674,python3.9):2025-04-03-09:27:26.126.052 [PlatformInfo.cpp:94][DVPP] [InitPara:94] [T2] run mode is 1.
[INFO] DVPP(618674,python3.9):2025-04-03-09:27:26.126.588 [dvpp_dev_hdc.cpp:750][WRAP] [StartHostPacketCountTimer:750] [tid:618674] start packet count timer
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:26.126.595 [mindspore/ccsrc/pybind_api/init.cc:250] pybind11_init__c_expression] Start GraphExecutorPy...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:26.127.027 [mindspore/ccsrc/pybind_api/init.cc:316] pybind11_init__c_expression] Start JitExecutorPy...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:26.127.435 [mindspore/ccsrc/pybind_api/init.cc:381] pybind11_init__c_expression] Start ParallelContext...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:26.128.221 [mindspore/ccsrc/pybind_api/init.cc:515] pybind11_init__c_expression] Start CostModelContext...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:26.128.636 [mindspore/ccsrc/pybind_api/init.cc:617] pybind11_init__c_expression] Start OffloadContext...
[INFO] ME(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:26.129.370 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:377] LoadPlugin] Load libmindspore_ascend plugin file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/libmindspore_ascend.so.2 success.
[INFO] ME(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:26.129.611 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:377] LoadPlugin] Load libmindspore_ascend plugin file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/libmindspore_ascend.so.2 success.
[INFO] ME(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:26.129.810 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:377] LoadPlugin] Load libmindspore_ops_ascend plugin file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/libmindspore_ops_ascend.so success.
[INFO] ME(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:26.130.035 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:377] LoadPlugin] Load libmindspore_ops_ascend plugin file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/libmindspore_ops_ascend.so success.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:26.130.232 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/symbol_utils.cc:65] LoadAscendApiSymbols] Ascend api is already loaded.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:26.130.274 [acl.cpp:753]618654 aclrtGetSocName: start to execute aclrtGetSocName.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:26.130.299 [acl.cpp:115]618654 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:26.130.310 [acl.cpp:760]618654 aclrtGetSocName: execute aclrtGetSocName successfully
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:26.130.332 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:408] SetContextSocVersion] The soc version :Ascend910B3
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:26.145.053 [mindspore/ccsrc/pybind_api/utils/log_adapter_py.cc:27] PyExceptionInitializer] Set exception handler
[INFO] PROFILING(618674,python3.9):2025-04-03-09:27:26.147.746 [prof_atls_plugin.cpp:117] (tid:618674) RegisterProfileCallback, callback type is 7
[INFO] PROFILING(618674,python3.9):2025-04-03-09:27:26.147.795 [prof_atls_plugin.cpp:117] (tid:618674) RegisterProfileCallback, callback type is 8
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:26.153.413 [mindspore/ccsrc/pybind_api/utils/log_adapter_py.cc:27] PyExceptionInitializer] Set exception handler
[INFO] ME(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:26.165.113 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:377] LoadPlugin] Load libmindspore_ops_host plugin file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/libmindspore_ops_host.so success.
[INFO] CORE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:26.165.232 [mindspore/core/utils/ms_context.cc:105] SetDeviceId] Set MS_CTX_DEVICE_ID by env DEVICE_ID to: 5
[INFO] CORE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:26.165.265 [mindspore/core/utils/ms_context.cc:165] set_backend_policy] ms set context backend policy:ge
[INFO] ME(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:26.165.533 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:377] LoadPlugin] Load libmindspore_ops_host plugin file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/libmindspore_ops_host.so success.
[INFO] CORE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:26.165.628 [mindspore/core/utils/ms_context.cc:105] SetDeviceId] Set MS_CTX_DEVICE_ID by env DEVICE_ID to: 6
[INFO] CORE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:26.165.661 [mindspore/core/utils/ms_context.cc:165] set_backend_policy] ms set context backend policy:ge
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:26.166.001 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_base_symbol.cc:63] LoadAclBaseApiSymbol] Load acl base api success!
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:26.166.381 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_base_symbol.cc:63] LoadAclBaseApiSymbol] Load acl base api success!
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:26.167.556 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_compiler_symbol.cc:39] LoadAclOpCompilerApiSymbol] Load acl op compiler api success!
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:26.167.628 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_mdl_symbol.cc:115] LoadAclMdlApiSymbol] Load acl mdl api success!
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:26.167.662 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_op_symbol.cc:55] LoadAclOpApiSymbol] Load ascend op api success!
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:26.167.749 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_prof_symbol.cc:49] LoadProfApiSymbol] Load acl prof api success!
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:26.167.776 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_rt_allocator_symbol.cc:48] LoadAclAllocatorApiSymbol] Load acl allocator api success!
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:26.167.821 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_rt_symbol.cc:149] LoadAclRtApiSymbol] Load acl rt api success!
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:26.167.844 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_symbol.cc:34] LoadAclApiSymbol] Load acl base api success!
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:26.167.866 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_compiler_symbol.cc:39] LoadAclOpCompilerApiSymbol] Load acl op compiler api success!
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:26.167.935 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_mdl_symbol.cc:115] LoadAclMdlApiSymbol] Load acl mdl api success!
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:26.167.969 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_op_symbol.cc:55] LoadAclOpApiSymbol] Load ascend op api success!
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:26.168.058 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_prof_symbol.cc:49] LoadProfApiSymbol] Load acl prof api success!
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:26.168.086 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_rt_allocator_symbol.cc:48] LoadAclAllocatorApiSymbol] Load acl allocator api success!
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:26.168.131 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_rt_symbol.cc:149] LoadAclRtApiSymbol] Load acl rt api success!
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:26.168.154 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_symbol.cc:34] LoadAclApiSymbol] Load acl base api success!
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:26.169.555 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_tdt_symbol.cc:82] LoadAcltdtApiSymbol] Load acl tdt api success!
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:26.169.590 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/symbol_utils.cc:79] LoadAscendApiSymbols] Load ascend api success!
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:26.169.619 [acl.cpp:753]618666 aclrtGetSocName: start to execute aclrtGetSocName.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.169.675 [runtime_keeper.cc:78] 618666 GetDeviceType: hardwareVersion=0x503
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:26.169.818 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_tdt_symbol.cc:82] LoadAcltdtApiSymbol] Load acl tdt api success!
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:26.169.848 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/symbol_utils.cc:79] LoadAscendApiSymbols] Load ascend api success!
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:26.169.876 [acl.cpp:753]618670 aclrtGetSocName: start to execute aclrtGetSocName.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.169.922 [runtime_keeper.cc:78] 618670 GetDeviceType: hardwareVersion=0x503
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.063 [plugin_old_arch.cc:16] 618666 ConstructRuntimeImpl: RuntimeImpl construct success, rt = 0xaaaaea994360
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.099 [runtime_keeper.cc:149] 618666 CreateRuntimeImpl: Open libruntime_v100.so success
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.111 [runtime_keeper.cc:221] 618666 BootRuntime: new Runtime ok, Runtime_alloc_size 12600.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.101 [plugin_old_arch.cc:16] 618670 ConstructRuntimeImpl: RuntimeImpl construct success, rt = 0xaaaacd4e41e0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.132 [runtime_keeper.cc:149] 618670 CreateRuntimeImpl: Open libruntime_v100.so success
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.141 [runtime.cc:1387] 618666 CheckHaveDevice: hardwareVersion=0x503
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.146 [runtime_keeper.cc:221] 618670 BootRuntime: new Runtime ok, Runtime_alloc_size 12600.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.167 [runtime.cc:1163] 618666 InitChipAndSocType: Runtime init: device type=5, soc type=18, arch type=0, havedevice=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.175 [runtime.cc:1387] 618670 CheckHaveDevice: hardwareVersion=0x503
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.188 [npu_driver.cc:4062] 618666 CheckSqcqIsSupportDevMem: sqcq support dev mem
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.198 [runtime.cc:1163] 618670 InitChipAndSocType: Runtime init: device type=5, soc type=18, arch type=0, havedevice=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.205 [runtime.cc:5096] 618666 GetVisibleDevices: ASCEND_RT_VISIBLE_DEVICES param was not set
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.217 [runtime.cc:1173] 618666 InitApiImpile: ApiImpl:Runtime_alloc_size 8
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.218 [npu_driver.cc:4062] 618670 CheckSqcqIsSupportDevMem: sqcq support dev mem
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.229 [runtime.cc:1183] 618666 InitLogger: Logger:Runtime_alloc_size 32
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.233 [runtime.cc:5096] 618670 GetVisibleDevices: ASCEND_RT_VISIBLE_DEVICES param was not set
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.244 [runtime.cc:1193] 618666 InitApiProfiler: RProfiler:Runtime_alloc_size 176
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.244 [runtime.cc:1173] 618670 InitApiImpile: ApiImpl:Runtime_alloc_size 8
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.256 [runtime.cc:1183] 618670 InitLogger: Logger:Runtime_alloc_size 32
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.256 [profiler.cc:84] 618666 Init: Init ok, Runtime_alloc_size 48
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.268 [runtime.cc:1193] 618670 InitApiProfiler: RProfiler:Runtime_alloc_size 176
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.279 [profiler.cc:84] 618670 Init: Init ok, Runtime_alloc_size 48
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.272 [runtime.cc:1209] 618666 InitApiErrorDecorator: ApiErrorDecorator:Runtime_alloc_size 16.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.297 [runtime.cc:1219] 618666 InitThreadGuard: Runtime init:new ThreadGuard ok, Runtime_alloc_size 104.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.296 [runtime.cc:1209] 618670 InitApiErrorDecorator: ApiErrorDecorator:Runtime_alloc_size 16.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.309 [runtime.cc:1230] 618666 InitStreamObserver: EngineStreamObserver:Runtime_alloc_size 8.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.317 [runtime.cc:1219] 618670 InitThreadGuard: Runtime init:new ThreadGuard ok, Runtime_alloc_size 104.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.319 [runtime.cc:1242] 618666 InitAicpuStreamIdBitmap: Bitmap(1024):Runtime_alloc_size 72.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.331 [runtime.cc:1264] 618666 InitCbSubscribe: The thread group num is 1024
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.329 [runtime.cc:1230] 618670 InitStreamObserver: EngineStreamObserver:Runtime_alloc_size 8.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.340 [runtime.cc:1242] 618670 InitAicpuStreamIdBitmap: Bitmap(1024):Runtime_alloc_size 72.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.340 [runtime.cc:1270] 618666 InitCbSubscribe: Runtime init:new CbSubscribe ok, Runtime_alloc_size 304.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.352 [runtime.cc:1264] 618670 InitCbSubscribe: The thread group num is 1024
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.363 [runtime.cc:1270] 618670 InitCbSubscribe: Runtime init:new CbSubscribe ok, Runtime_alloc_size 304.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.443 [runtime.cc:109] 618666 Init: ObjAllocator alloc success, Runtime_alloc_size 160000(bytes)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.472 [runtime.cc:109] 618670 Init: ObjAllocator alloc success, Runtime_alloc_size 160000(bytes)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.845 [runtime.cc:121] 618666 Init: ObjAllocator alloc success, Runtime_alloc_size 960000(bytes)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.875 [runtime.cc:121] 618670 Init: ObjAllocator alloc success, Runtime_alloc_size 960000(bytes)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.919 [runtime.cc:1314] 618666 InitLabelAllocator: Runtime init:new LabelAllocator ok, Runtime_alloc_size 131152.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.933 [runtime.cc:1322] 618666 InitSetRuntimeVersion: set runtime api ver success
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.943 [runtime.cc:1314] 618670 InitLabelAllocator: Runtime init:new LabelAllocator ok, Runtime_alloc_size 131152.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.957 [runtime.cc:1322] 618670 InitSetRuntimeVersion: set runtime api ver success
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.174.055 [runtime.cc:1338] 618666 InitNpuCollectPath: NPU_COLLECT_PATH is not set!
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.174.069 [runtime.cc:1338] 618670 InitNpuCollectPath: NPU_COLLECT_PATH is not set!
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.174.113 [utils.cc:105] 618666 GetDriverPath: driver path is [Driver_Install_Path_Param=/usr/local/Ascend].
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.174.113 [utils.cc:105] 618670 GetDriverPath: driver path is [Driver_Install_Path_Param=/usr/local/Ascend].
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.174.164 [runtime.cc:1664] 618666 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.174.164 [runtime.cc:1664] 618670 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.174.196 [runtime.cc:1688] 618670 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.174.196 [runtime.cc:1688] 618666 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.174.213 [runtime.cc:1953] 618666 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=preload_stack_16KB.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.174.213 [runtime.cc:1953] 618670 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=preload_stack_16KB.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.174.238 [runtime.cc:1477] 618666 FindAndRegisterDcacheLockOp: register lock op success
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.174.238 [runtime.cc:1477] 618670 FindAndRegisterDcacheLockOp: register lock op success
[INFO] PROFILING(618666,python3.9):2025-04-03-09:27:26.174.255 [prof_atls_plugin.cpp:210] (tid:618666) Module[7] register callback of ctrl handle.
[INFO] PROFILING(618670,python3.9):2025-04-03-09:27:26.174.255 [prof_atls_plugin.cpp:210] (tid:618670) Module[7] register callback of ctrl handle.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:26.174.271 [heterogenous.cc:19] 618670 ReadHeterogenousModeFromConfigIni: can not read ASCEND_LATEST_INSTALL_PATH! isHeterogenous=0.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:26.174.271 [heterogenous.cc:19] 618666 ReadHeterogenousModeFromConfigIni: can not read ASCEND_LATEST_INSTALL_PATH! isHeterogenous=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.174.299 [api_c_soc.cc:70] 618670 rtGetSocVersion: soc version is Ascend910B3
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.174.300 [api_c_soc.cc:70] 618666 rtGetSocVersion: soc version is Ascend910B3
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:26.174.313 [acl.cpp:115]618670 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:26.174.313 [acl.cpp:115]618666 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:26.174.325 [acl.cpp:760]618666 aclrtGetSocName: execute aclrtGetSocName successfully
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:26.174.325 [acl.cpp:760]618670 aclrtGetSocName: execute aclrtGetSocName successfully
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:26.174.356 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:408] SetContextSocVersion] The soc version :Ascend910B3
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:26.174.356 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:408] SetContextSocVersion] The soc version :Ascend910B3
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:26.178.946 [mindspore/ccsrc/pybind_api/init.cc:250] pybind11_init__c_expression] Start GraphExecutorPy...
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:26.179.384 [mindspore/ccsrc/pybind_api/init.cc:316] pybind11_init__c_expression] Start JitExecutorPy...
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:26.179.815 [mindspore/ccsrc/pybind_api/init.cc:381] pybind11_init__c_expression] Start ParallelContext...
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:26.180.666 [mindspore/ccsrc/pybind_api/init.cc:515] pybind11_init__c_expression] Start CostModelContext...
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:26.181.108 [mindspore/ccsrc/pybind_api/init.cc:617] pybind11_init__c_expression] Start OffloadContext...
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:26.182.830 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/symbol_utils.cc:65] LoadAscendApiSymbols] Ascend api is already loaded.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:26.182.875 [acl.cpp:753]618658 aclrtGetSocName: start to execute aclrtGetSocName.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:26.182.903 [acl.cpp:115]618658 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:26.182.917 [acl.cpp:760]618658 aclrtGetSocName: execute aclrtGetSocName successfully
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:26.182.942 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:408] SetContextSocVersion] The soc version :Ascend910B3
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:26.185.426 [mindspore/ccsrc/pybind_api/init.cc:250] pybind11_init__c_expression] Start GraphExecutorPy...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:26.185.864 [mindspore/ccsrc/pybind_api/init.cc:316] pybind11_init__c_expression] Start JitExecutorPy...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:26.186.287 [mindspore/ccsrc/pybind_api/init.cc:381] pybind11_init__c_expression] Start ParallelContext...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:26.187.079 [mindspore/ccsrc/pybind_api/init.cc:515] pybind11_init__c_expression] Start CostModelContext...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:26.187.502 [mindspore/ccsrc/pybind_api/init.cc:617] pybind11_init__c_expression] Start OffloadContext...
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:26.189.151 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/symbol_utils.cc:65] LoadAscendApiSymbols] Ascend api is already loaded.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:26.189.197 [acl.cpp:753]618662 aclrtGetSocName: start to execute aclrtGetSocName.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:26.189.225 [acl.cpp:115]618662 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:26.189.236 [acl.cpp:760]618662 aclrtGetSocName: execute aclrtGetSocName successfully
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:26.189.254 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:408] SetContextSocVersion] The soc version :Ascend910B3
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:26.203.201 [mindspore/ccsrc/pybind_api/utils/log_adapter_py.cc:27] PyExceptionInitializer] Set exception handler
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:26.203.400 [mindspore/ccsrc/pybind_api/utils/log_adapter_py.cc:27] PyExceptionInitializer] Set exception handler
[INFO] ME(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:26.222.700 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:377] LoadPlugin] Load libmindspore_ascend plugin file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/libmindspore_ascend.so.2 success.
[INFO] ME(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:26.223.190 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:377] LoadPlugin] Load libmindspore_ops_ascend plugin file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/libmindspore_ops_ascend.so success.
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:26.233.920 [mindspore/ccsrc/pybind_api/init.cc:250] pybind11_init__c_expression] Start GraphExecutorPy...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:26.234.338 [mindspore/ccsrc/pybind_api/init.cc:316] pybind11_init__c_expression] Start JitExecutorPy...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:26.234.557 [mindspore/ccsrc/pybind_api/init.cc:250] pybind11_init__c_expression] Start GraphExecutorPy...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:26.234.756 [mindspore/ccsrc/pybind_api/init.cc:381] pybind11_init__c_expression] Start ParallelContext...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:26.234.991 [mindspore/ccsrc/pybind_api/init.cc:316] pybind11_init__c_expression] Start JitExecutorPy...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:26.235.412 [mindspore/ccsrc/pybind_api/init.cc:381] pybind11_init__c_expression] Start ParallelContext...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:26.235.515 [mindspore/ccsrc/pybind_api/init.cc:515] pybind11_init__c_expression] Start CostModelContext...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:26.235.929 [mindspore/ccsrc/pybind_api/init.cc:617] pybind11_init__c_expression] Start OffloadContext...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:26.236.215 [mindspore/ccsrc/pybind_api/init.cc:515] pybind11_init__c_expression] Start CostModelContext...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:26.236.647 [mindspore/ccsrc/pybind_api/init.cc:617] pybind11_init__c_expression] Start OffloadContext...
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:26.237.515 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/symbol_utils.cc:65] LoadAscendApiSymbols] Ascend api is already loaded.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:26.237.561 [acl.cpp:753]618670 aclrtGetSocName: start to execute aclrtGetSocName.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:26.237.586 [acl.cpp:115]618670 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:26.237.598 [acl.cpp:760]618670 aclrtGetSocName: execute aclrtGetSocName successfully
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:26.237.622 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:408] SetContextSocVersion] The soc version :Ascend910B3
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:26.238.256 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/symbol_utils.cc:65] LoadAscendApiSymbols] Ascend api is already loaded.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:26.238.306 [acl.cpp:753]618666 aclrtGetSocName: start to execute aclrtGetSocName.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:26.238.331 [acl.cpp:115]618666 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:26.238.344 [acl.cpp:760]618666 aclrtGetSocName: execute aclrtGetSocName successfully
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:26.238.367 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:408] SetContextSocVersion] The soc version :Ascend910B3
[INFO] ME(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:26.269.376 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:377] LoadPlugin] Load libmindspore_ops_host plugin file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/libmindspore_ops_host.so success.
[INFO] CORE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:26.269.509 [mindspore/core/utils/ms_context.cc:105] SetDeviceId] Set MS_CTX_DEVICE_ID by env DEVICE_ID to: 7
[INFO] CORE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:26.269.553 [mindspore/core/utils/ms_context.cc:165] set_backend_policy] ms set context backend policy:ge
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:26.270.326 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_base_symbol.cc:63] LoadAclBaseApiSymbol] Load acl base api success!
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:26.271.934 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_compiler_symbol.cc:39] LoadAclOpCompilerApiSymbol] Load acl op compiler api success!
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:26.272.012 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_mdl_symbol.cc:115] LoadAclMdlApiSymbol] Load acl mdl api success!
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:26.272.051 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_op_symbol.cc:55] LoadAclOpApiSymbol] Load ascend op api success!
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:26.272.144 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_prof_symbol.cc:49] LoadProfApiSymbol] Load acl prof api success!
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:26.272.225 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_rt_allocator_symbol.cc:48] LoadAclAllocatorApiSymbol] Load acl allocator api success!
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:26.272.288 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_rt_symbol.cc:149] LoadAclRtApiSymbol] Load acl rt api success!
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:26.272.317 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_symbol.cc:34] LoadAclApiSymbol] Load acl base api success!
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:26.274.024 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_tdt_symbol.cc:82] LoadAcltdtApiSymbol] Load acl tdt api success!
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:26.274.058 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/symbol_utils.cc:79] LoadAscendApiSymbols] Load ascend api success!
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:26.274.096 [acl.cpp:753]618674 aclrtGetSocName: start to execute aclrtGetSocName.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.274.170 [runtime_keeper.cc:78] 618674 GetDeviceType: hardwareVersion=0x503
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.277.919 [plugin_old_arch.cc:16] 618674 ConstructRuntimeImpl: RuntimeImpl construct success, rt = 0xaaaaf4ba3ed0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.277.958 [runtime_keeper.cc:149] 618674 CreateRuntimeImpl: Open libruntime_v100.so success
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.277.971 [runtime_keeper.cc:221] 618674 BootRuntime: new Runtime ok, Runtime_alloc_size 12600.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.002 [runtime.cc:1387] 618674 CheckHaveDevice: hardwareVersion=0x503
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.032 [runtime.cc:1163] 618674 InitChipAndSocType: Runtime init: device type=5, soc type=18, arch type=0, havedevice=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.059 [npu_driver.cc:4062] 618674 CheckSqcqIsSupportDevMem: sqcq support dev mem
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.086 [runtime.cc:5096] 618674 GetVisibleDevices: ASCEND_RT_VISIBLE_DEVICES param was not set
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.102 [runtime.cc:1173] 618674 InitApiImpile: ApiImpl:Runtime_alloc_size 8
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.116 [runtime.cc:1183] 618674 InitLogger: Logger:Runtime_alloc_size 32
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.135 [runtime.cc:1193] 618674 InitApiProfiler: RProfiler:Runtime_alloc_size 176
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.150 [profiler.cc:84] 618674 Init: Init ok, Runtime_alloc_size 48
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.170 [runtime.cc:1209] 618674 InitApiErrorDecorator: ApiErrorDecorator:Runtime_alloc_size 16.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.205 [runtime.cc:1219] 618674 InitThreadGuard: Runtime init:new ThreadGuard ok, Runtime_alloc_size 104.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.219 [runtime.cc:1230] 618674 InitStreamObserver: EngineStreamObserver:Runtime_alloc_size 8.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.234 [runtime.cc:1242] 618674 InitAicpuStreamIdBitmap: Bitmap(1024):Runtime_alloc_size 72.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.246 [runtime.cc:1264] 618674 InitCbSubscribe: The thread group num is 1024
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.259 [runtime.cc:1270] 618674 InitCbSubscribe: Runtime init:new CbSubscribe ok, Runtime_alloc_size 304.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.373 [runtime.cc:109] 618674 Init: ObjAllocator alloc success, Runtime_alloc_size 160000(bytes)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.778 [runtime.cc:121] 618674 Init: ObjAllocator alloc success, Runtime_alloc_size 960000(bytes)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.857 [runtime.cc:1314] 618674 InitLabelAllocator: Runtime init:new LabelAllocator ok, Runtime_alloc_size 131152.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.875 [runtime.cc:1322] 618674 InitSetRuntimeVersion: set runtime api ver success
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.995 [runtime.cc:1338] 618674 InitNpuCollectPath: NPU_COLLECT_PATH is not set!
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.279.057 [utils.cc:105] 618674 GetDriverPath: driver path is [Driver_Install_Path_Param=/usr/local/Ascend].
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.279.113 [runtime.cc:1664] 618674 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.279.154 [runtime.cc:1688] 618674 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.279.177 [runtime.cc:1953] 618674 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=preload_stack_16KB.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.279.206 [runtime.cc:1477] 618674 FindAndRegisterDcacheLockOp: register lock op success
[INFO] PROFILING(618674,python3.9):2025-04-03-09:27:26.279.228 [prof_atls_plugin.cpp:210] (tid:618674) Module[7] register callback of ctrl handle.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:26.279.249 [heterogenous.cc:19] 618674 ReadHeterogenousModeFromConfigIni: can not read ASCEND_LATEST_INSTALL_PATH! isHeterogenous=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.279.280 [api_c_soc.cc:70] 618674 rtGetSocVersion: soc version is Ascend910B3
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:26.279.297 [acl.cpp:115]618674 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:26.279.312 [acl.cpp:760]618674 aclrtGetSocName: execute aclrtGetSocName successfully
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:26.279.343 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:408] SetContextSocVersion] The soc version :Ascend910B3
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:26.315.056 [mindspore/ccsrc/pybind_api/utils/log_adapter_py.cc:27] PyExceptionInitializer] Set exception handler
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:26.348.785 [mindspore/ccsrc/pybind_api/init.cc:250] pybind11_init__c_expression] Start GraphExecutorPy...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:26.349.215 [mindspore/ccsrc/pybind_api/init.cc:316] pybind11_init__c_expression] Start JitExecutorPy...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:26.349.638 [mindspore/ccsrc/pybind_api/init.cc:381] pybind11_init__c_expression] Start ParallelContext...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:26.350.434 [mindspore/ccsrc/pybind_api/init.cc:515] pybind11_init__c_expression] Start CostModelContext...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:26.350.874 [mindspore/ccsrc/pybind_api/init.cc:617] pybind11_init__c_expression] Start OffloadContext...
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:26.352.638 [mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/symbol_utils.cc:65] LoadAscendApiSymbols] Ascend api is already loaded.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:26.352.687 [acl.cpp:753]618674 aclrtGetSocName: start to execute aclrtGetSocName.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:26.352.717 [acl.cpp:115]618674 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:26.352.732 [acl.cpp:760]618674 aclrtGetSocName: execute aclrtGetSocName successfully
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:26.352.764 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:408] SetContextSocVersion] The soc version :Ascend910B3
[WARNING] FE(618646,python3.9):2025-04-03-09:27:26.964.104 [platform_info.cpp:853]618646 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend310P5."
[WARNING] FE(618646,python3.9):2025-04-03-09:27:26.965.957 [platform_info.cpp:853]618646 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9362."
[WARNING] FE(618646,python3.9):2025-04-03-09:27:26.986.149 [platform_info.cpp:853]618646 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_95."
[WARNING] FE(618646,python3.9):2025-04-03-09:27:26.994.971 [platform_info.cpp:853]618646 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9382."
[WARNING] FE(618646,python3.9):2025-04-03-09:27:26.998.182 [platform_info.cpp:853]618646 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9361."
[WARNING] FE(618646,python3.9):2025-04-03-09:27:27.001.221 [platform_info.cpp:853]618646 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_5591."
[WARNING] FE(618646,python3.9):2025-04-03-09:27:27.029.463 [platform_info.cpp:853]618646 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9392."
[WARNING] FE(618646,python3.9):2025-04-03-09:27:27.044.285 [platform_info.cpp:853]618646 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend310P7."
[WARNING] FE(618650,python3.9):2025-04-03-09:27:27.079.959 [platform_info.cpp:853]618650 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend310P5."
[WARNING] FE(618650,python3.9):2025-04-03-09:27:27.082.001 [platform_info.cpp:853]618650 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9362."
[WARNING] FE(618650,python3.9):2025-04-03-09:27:27.103.490 [platform_info.cpp:853]618650 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_95."
[WARNING] FE(618650,python3.9):2025-04-03-09:27:27.112.390 [platform_info.cpp:853]618650 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9382."
[WARNING] FE(618658,python3.9):2025-04-03-09:27:27.115.728 [platform_info.cpp:853]618658 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend310P5."
[WARNING] FE(618650,python3.9):2025-04-03-09:27:27.116.479 [platform_info.cpp:853]618650 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9361."
[WARNING] FE(618658,python3.9):2025-04-03-09:27:27.117.666 [platform_info.cpp:853]618658 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9362."
[WARNING] FE(618650,python3.9):2025-04-03-09:27:27.119.574 [platform_info.cpp:853]618650 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_5591."
[WARNING] FE(618662,python3.9):2025-04-03-09:27:27.126.665 [platform_info.cpp:853]618662 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend310P5."
[WARNING] FE(618662,python3.9):2025-04-03-09:27:27.128.845 [platform_info.cpp:853]618662 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9362."
[WARNING] FE(618658,python3.9):2025-04-03-09:27:27.139.007 [platform_info.cpp:853]618658 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_95."
[WARNING] FE(618658,python3.9):2025-04-03-09:27:27.147.845 [platform_info.cpp:853]618658 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9382."
[WARNING] FE(618654,python3.9):2025-04-03-09:27:27.148.545 [platform_info.cpp:853]618654 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend310P5."
[WARNING] FE(618650,python3.9):2025-04-03-09:27:27.149.428 [platform_info.cpp:853]618650 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9392."
[WARNING] FE(618654,python3.9):2025-04-03-09:27:27.150.362 [platform_info.cpp:853]618654 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9362."
[WARNING] FE(618658,python3.9):2025-04-03-09:27:27.150.802 [platform_info.cpp:853]618658 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9361."
[WARNING] FE(618662,python3.9):2025-04-03-09:27:27.153.160 [platform_info.cpp:853]618662 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_95."
[WARNING] FE(618658,python3.9):2025-04-03-09:27:27.153.829 [platform_info.cpp:853]618658 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_5591."
[WARNING] FE(618662,python3.9):2025-04-03-09:27:27.162.037 [platform_info.cpp:853]618662 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9382."
[WARNING] FE(618650,python3.9):2025-04-03-09:27:27.164.598 [platform_info.cpp:853]618650 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend310P7."
[WARNING] FE(618662,python3.9):2025-04-03-09:27:27.164.986 [platform_info.cpp:853]618662 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9361."
[WARNING] FE(618662,python3.9):2025-04-03-09:27:27.167.980 [platform_info.cpp:853]618662 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_5591."
[WARNING] FE(618654,python3.9):2025-04-03-09:27:27.170.619 [platform_info.cpp:853]618654 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_95."
[WARNING] FE(618670,python3.9):2025-04-03-09:27:27.177.086 [platform_info.cpp:853]618670 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend310P5."
[WARNING] FE(618670,python3.9):2025-04-03-09:27:27.179.158 [platform_info.cpp:853]618670 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9362."
[WARNING] FE(618654,python3.9):2025-04-03-09:27:27.179.424 [platform_info.cpp:853]618654 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9382."
[WARNING] FE(618654,python3.9):2025-04-03-09:27:27.182.368 [platform_info.cpp:853]618654 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9361."
[WARNING] FE(618658,python3.9):2025-04-03-09:27:27.182.471 [platform_info.cpp:853]618658 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9392."
[WARNING] FE(618654,python3.9):2025-04-03-09:27:27.185.392 [platform_info.cpp:853]618654 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_5591."
[WARNING] FE(618666,python3.9):2025-04-03-09:27:27.191.229 [platform_info.cpp:853]618666 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend310P5."
[WARNING] FE(618666,python3.9):2025-04-03-09:27:27.193.086 [platform_info.cpp:853]618666 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9362."
[WARNING] FE(618658,python3.9):2025-04-03-09:27:27.198.345 [platform_info.cpp:853]618658 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend310P7."
[WARNING] FE(618662,python3.9):2025-04-03-09:27:27.198.515 [platform_info.cpp:853]618662 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9392."
[WARNING] FE(618670,python3.9):2025-04-03-09:27:27.200.578 [platform_info.cpp:853]618670 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_95."
[WARNING] FE(618670,python3.9):2025-04-03-09:27:27.209.375 [platform_info.cpp:853]618670 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9382."
[WARNING] FE(618670,python3.9):2025-04-03-09:27:27.212.378 [platform_info.cpp:853]618670 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9361."
[WARNING] FE(618654,python3.9):2025-04-03-09:27:27.213.206 [platform_info.cpp:853]618654 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9392."
[WARNING] FE(618666,python3.9):2025-04-03-09:27:27.213.280 [platform_info.cpp:853]618666 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_95."
[WARNING] FE(618662,python3.9):2025-04-03-09:27:27.213.623 [platform_info.cpp:853]618662 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend310P7."
[WARNING] FE(618670,python3.9):2025-04-03-09:27:27.215.375 [platform_info.cpp:853]618670 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_5591."
[WARNING] FE(618666,python3.9):2025-04-03-09:27:27.222.008 [platform_info.cpp:853]618666 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9382."
[WARNING] FE(618666,python3.9):2025-04-03-09:27:27.225.124 [platform_info.cpp:853]618666 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9361."
[WARNING] FE(618654,python3.9):2025-04-03-09:27:27.227.704 [platform_info.cpp:853]618654 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend310P7."
[WARNING] FE(618666,python3.9):2025-04-03-09:27:27.228.117 [platform_info.cpp:853]618666 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_5591."
[WARNING] FE(618670,python3.9):2025-04-03-09:27:27.244.192 [platform_info.cpp:853]618670 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9392."
[WARNING] FE(618666,python3.9):2025-04-03-09:27:27.255.871 [platform_info.cpp:853]618666 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9392."
[WARNING] FE(618670,python3.9):2025-04-03-09:27:27.259.326 [platform_info.cpp:853]618670 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend310P7."
[WARNING] FE(618666,python3.9):2025-04-03-09:27:27.270.448 [platform_info.cpp:853]618666 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend310P7."
[WARNING] FE(618674,python3.9):2025-04-03-09:27:27.308.350 [platform_info.cpp:853]618674 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend310P5."
[WARNING] FE(618674,python3.9):2025-04-03-09:27:27.310.149 [platform_info.cpp:853]618674 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9362."
[WARNING] FE(618674,python3.9):2025-04-03-09:27:27.331.264 [platform_info.cpp:853]618674 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_95."
[WARNING] FE(618674,python3.9):2025-04-03-09:27:27.340.089 [platform_info.cpp:853]618674 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9382."
[WARNING] FE(618674,python3.9):2025-04-03-09:27:27.343.506 [platform_info.cpp:853]618674 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9361."
[WARNING] FE(618674,python3.9):2025-04-03-09:27:27.346.574 [platform_info.cpp:853]618674 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_5591."
[WARNING] FE(618674,python3.9):2025-04-03-09:27:27.375.537 [platform_info.cpp:853]618674 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend910_9392."
[WARNING] FE(618674,python3.9):2025-04-03-09:27:27.390.178 [platform_info.cpp:853]618674 AssemblePlatformInfoVector:"Can not find soc info enum by Ascend310P7."
[INFO] TBE(618646,python3.9):2025-04-03-09:27:27.945.424 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:59][decorator] Fusion pass[conv2d_data_rm_build_pass] of stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618646,python3.9):2025-04-03-09:27:27.947.208 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_conv3d] of op type[Conv3D] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618646,python3.9):2025-04-03-09:27:27.947.341 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:59][decorator] Fusion pass[trans_shape_depthwise_conv2d] of stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618646,python3.9):2025-04-03-09:27:27.949.610 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_for_elemwise] of op type[None] op pattern[ElemWise] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618646,python3.9):2025-04-03-09:27:27.949.745 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_for_broadcast] of op type[None] op pattern[Broadcast] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618646,python3.9):2025-04-03-09:27:27.949.859 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_biasadd] of op type[BiasAdd] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618646,python3.9):2025-04-03-09:27:27.949.982 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_requant_s16] of op type[AscendRequantS16] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618646,python3.9):2025-04-03-09:27:27.950.086 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_bninference] of op type[BNInferenceD] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618646,python3.9):2025-04-03-09:27:27.951.192 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_fully_connection] of op type[FullyConnection] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618646,python3.9):2025-04-03-09:27:27.951.325 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_fully_connection_compress] of op type[FullyConnectionCompress] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618646,python3.9):2025-04-03-09:27:27.953.256 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmul_bias_shape] of op type[MatMulV2] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618646,python3.9):2025-04-03-09:27:27.953.386 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmul_bias_shape] of op type[MatMul] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618646,python3.9):2025-04-03-09:27:27.953.498 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmulcompress_bias_shape] of op type[MatMulV2Compress] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618646,python3.9):2025-04-03-09:27:27.953.607 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_batch_matmul_shape] of op type[BatchMatMulV2] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618646,python3.9):2025-04-03-09:27:27.953.709 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_batch_matmul_shape] of op type[BatchMatMul] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618646,python3.9):2025-04-03-09:27:27.953.814 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_transdata_fixpipe] of op type[None] op pattern[BatchMatmul] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618650,python3.9):2025-04-03-09:27:28.119.631 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:59][decorator] Fusion pass[conv2d_data_rm_build_pass] of stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618650,python3.9):2025-04-03-09:27:28.121.459 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_conv3d] of op type[Conv3D] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618650,python3.9):2025-04-03-09:27:28.121.597 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:59][decorator] Fusion pass[trans_shape_depthwise_conv2d] of stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618650,python3.9):2025-04-03-09:27:28.123.840 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_for_elemwise] of op type[None] op pattern[ElemWise] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618650,python3.9):2025-04-03-09:27:28.123.979 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_for_broadcast] of op type[None] op pattern[Broadcast] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618650,python3.9):2025-04-03-09:27:28.124.096 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_biasadd] of op type[BiasAdd] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618650,python3.9):2025-04-03-09:27:28.124.251 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_requant_s16] of op type[AscendRequantS16] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618650,python3.9):2025-04-03-09:27:28.124.362 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_bninference] of op type[BNInferenceD] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618650,python3.9):2025-04-03-09:27:28.125.488 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_fully_connection] of op type[FullyConnection] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618650,python3.9):2025-04-03-09:27:28.125.625 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_fully_connection_compress] of op type[FullyConnectionCompress] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618650,python3.9):2025-04-03-09:27:28.127.713 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmul_bias_shape] of op type[MatMulV2] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618650,python3.9):2025-04-03-09:27:28.127.849 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmul_bias_shape] of op type[MatMul] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618650,python3.9):2025-04-03-09:27:28.127.964 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmulcompress_bias_shape] of op type[MatMulV2Compress] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618650,python3.9):2025-04-03-09:27:28.128.076 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_batch_matmul_shape] of op type[BatchMatMulV2] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618650,python3.9):2025-04-03-09:27:28.128.219 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_batch_matmul_shape] of op type[BatchMatMul] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618650,python3.9):2025-04-03-09:27:28.128.332 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_transdata_fixpipe] of op type[None] op pattern[BatchMatmul] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618658,python3.9):2025-04-03-09:27:28.180.387 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:59][decorator] Fusion pass[conv2d_data_rm_build_pass] of stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618658,python3.9):2025-04-03-09:27:28.182.215 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_conv3d] of op type[Conv3D] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618658,python3.9):2025-04-03-09:27:28.182.352 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:59][decorator] Fusion pass[trans_shape_depthwise_conv2d] of stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618658,python3.9):2025-04-03-09:27:28.184.618 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_for_elemwise] of op type[None] op pattern[ElemWise] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618658,python3.9):2025-04-03-09:27:28.184.762 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_for_broadcast] of op type[None] op pattern[Broadcast] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618658,python3.9):2025-04-03-09:27:28.184.884 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_biasadd] of op type[BiasAdd] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618658,python3.9):2025-04-03-09:27:28.185.027 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_requant_s16] of op type[AscendRequantS16] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618658,python3.9):2025-04-03-09:27:28.185.141 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_bninference] of op type[BNInferenceD] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618658,python3.9):2025-04-03-09:27:28.186.291 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_fully_connection] of op type[FullyConnection] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618658,python3.9):2025-04-03-09:27:28.186.431 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_fully_connection_compress] of op type[FullyConnectionCompress] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618658,python3.9):2025-04-03-09:27:28.188.375 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmul_bias_shape] of op type[MatMulV2] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618658,python3.9):2025-04-03-09:27:28.188.510 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmul_bias_shape] of op type[MatMul] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618658,python3.9):2025-04-03-09:27:28.188.631 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmulcompress_bias_shape] of op type[MatMulV2Compress] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618658,python3.9):2025-04-03-09:27:28.188.746 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_batch_matmul_shape] of op type[BatchMatMulV2] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618658,python3.9):2025-04-03-09:27:28.188.854 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_batch_matmul_shape] of op type[BatchMatMul] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618658,python3.9):2025-04-03-09:27:28.188.964 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_transdata_fixpipe] of op type[None] op pattern[BatchMatmul] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618670,python3.9):2025-04-03-09:27:28.189.083 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:59][decorator] Fusion pass[conv2d_data_rm_build_pass] of stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618670,python3.9):2025-04-03-09:27:28.191.460 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_conv3d] of op type[Conv3D] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618670,python3.9):2025-04-03-09:27:28.191.602 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:59][decorator] Fusion pass[trans_shape_depthwise_conv2d] of stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618670,python3.9):2025-04-03-09:27:28.194.102 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_for_elemwise] of op type[None] op pattern[ElemWise] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618670,python3.9):2025-04-03-09:27:28.194.245 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_for_broadcast] of op type[None] op pattern[Broadcast] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618670,python3.9):2025-04-03-09:27:28.194.366 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_biasadd] of op type[BiasAdd] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618670,python3.9):2025-04-03-09:27:28.194.503 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_requant_s16] of op type[AscendRequantS16] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618670,python3.9):2025-04-03-09:27:28.194.615 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_bninference] of op type[BNInferenceD] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618670,python3.9):2025-04-03-09:27:28.195.771 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_fully_connection] of op type[FullyConnection] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618670,python3.9):2025-04-03-09:27:28.195.910 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_fully_connection_compress] of op type[FullyConnectionCompress] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618670,python3.9):2025-04-03-09:27:28.197.923 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmul_bias_shape] of op type[MatMulV2] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618670,python3.9):2025-04-03-09:27:28.198.060 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmul_bias_shape] of op type[MatMul] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618670,python3.9):2025-04-03-09:27:28.198.180 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmulcompress_bias_shape] of op type[MatMulV2Compress] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618670,python3.9):2025-04-03-09:27:28.198.294 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_batch_matmul_shape] of op type[BatchMatMulV2] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618670,python3.9):2025-04-03-09:27:28.198.403 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_batch_matmul_shape] of op type[BatchMatMul] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618670,python3.9):2025-04-03-09:27:28.198.514 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_transdata_fixpipe] of op type[None] op pattern[BatchMatmul] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618662,python3.9):2025-04-03-09:27:28.202.358 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:59][decorator] Fusion pass[conv2d_data_rm_build_pass] of stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618662,python3.9):2025-04-03-09:27:28.204.128 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_conv3d] of op type[Conv3D] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618662,python3.9):2025-04-03-09:27:28.204.286 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:59][decorator] Fusion pass[trans_shape_depthwise_conv2d] of stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618662,python3.9):2025-04-03-09:27:28.206.537 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_for_elemwise] of op type[None] op pattern[ElemWise] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618662,python3.9):2025-04-03-09:27:28.206.680 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_for_broadcast] of op type[None] op pattern[Broadcast] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618662,python3.9):2025-04-03-09:27:28.206.800 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_biasadd] of op type[BiasAdd] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618662,python3.9):2025-04-03-09:27:28.206.932 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_requant_s16] of op type[AscendRequantS16] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618662,python3.9):2025-04-03-09:27:28.207.044 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_bninference] of op type[BNInferenceD] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618662,python3.9):2025-04-03-09:27:28.208.193 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_fully_connection] of op type[FullyConnection] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618662,python3.9):2025-04-03-09:27:28.208.335 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_fully_connection_compress] of op type[FullyConnectionCompress] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618662,python3.9):2025-04-03-09:27:28.210.250 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmul_bias_shape] of op type[MatMulV2] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618662,python3.9):2025-04-03-09:27:28.210.388 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmul_bias_shape] of op type[MatMul] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618662,python3.9):2025-04-03-09:27:28.210.507 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmulcompress_bias_shape] of op type[MatMulV2Compress] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618662,python3.9):2025-04-03-09:27:28.210.623 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_batch_matmul_shape] of op type[BatchMatMulV2] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618662,python3.9):2025-04-03-09:27:28.210.731 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_batch_matmul_shape] of op type[BatchMatMul] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618662,python3.9):2025-04-03-09:27:28.210.842 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_transdata_fixpipe] of op type[None] op pattern[BatchMatmul] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618666,python3.9):2025-04-03-09:27:28.238.610 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:59][decorator] Fusion pass[conv2d_data_rm_build_pass] of stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618654,python3.9):2025-04-03-09:27:28.239.428 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:59][decorator] Fusion pass[conv2d_data_rm_build_pass] of stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618666,python3.9):2025-04-03-09:27:28.240.412 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_conv3d] of op type[Conv3D] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618666,python3.9):2025-04-03-09:27:28.240.539 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:59][decorator] Fusion pass[trans_shape_depthwise_conv2d] of stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618654,python3.9):2025-04-03-09:27:28.241.315 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_conv3d] of op type[Conv3D] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618654,python3.9):2025-04-03-09:27:28.241.452 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:59][decorator] Fusion pass[trans_shape_depthwise_conv2d] of stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618666,python3.9):2025-04-03-09:27:28.242.744 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_for_elemwise] of op type[None] op pattern[ElemWise] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618666,python3.9):2025-04-03-09:27:28.242.874 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_for_broadcast] of op type[None] op pattern[Broadcast] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618666,python3.9):2025-04-03-09:27:28.242.985 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_biasadd] of op type[BiasAdd] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618666,python3.9):2025-04-03-09:27:28.243.105 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_requant_s16] of op type[AscendRequantS16] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618666,python3.9):2025-04-03-09:27:28.243.209 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_bninference] of op type[BNInferenceD] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618654,python3.9):2025-04-03-09:27:28.243.722 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_for_elemwise] of op type[None] op pattern[ElemWise] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618654,python3.9):2025-04-03-09:27:28.243.862 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_for_broadcast] of op type[None] op pattern[Broadcast] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618654,python3.9):2025-04-03-09:27:28.243.978 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_biasadd] of op type[BiasAdd] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618654,python3.9):2025-04-03-09:27:28.244.101 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_requant_s16] of op type[AscendRequantS16] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618654,python3.9):2025-04-03-09:27:28.244.252 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_bninference] of op type[BNInferenceD] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618666,python3.9):2025-04-03-09:27:28.244.324 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_fully_connection] of op type[FullyConnection] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618666,python3.9):2025-04-03-09:27:28.244.452 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_fully_connection_compress] of op type[FullyConnectionCompress] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618654,python3.9):2025-04-03-09:27:28.245.415 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_fully_connection] of op type[FullyConnection] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618654,python3.9):2025-04-03-09:27:28.245.553 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_fully_connection_compress] of op type[FullyConnectionCompress] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618666,python3.9):2025-04-03-09:27:28.246.333 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmul_bias_shape] of op type[MatMulV2] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618666,python3.9):2025-04-03-09:27:28.246.458 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmul_bias_shape] of op type[MatMul] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618666,python3.9):2025-04-03-09:27:28.246.567 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmulcompress_bias_shape] of op type[MatMulV2Compress] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618666,python3.9):2025-04-03-09:27:28.246.673 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_batch_matmul_shape] of op type[BatchMatMulV2] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618666,python3.9):2025-04-03-09:27:28.246.773 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_batch_matmul_shape] of op type[BatchMatMul] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618666,python3.9):2025-04-03-09:27:28.246.873 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_transdata_fixpipe] of op type[None] op pattern[BatchMatmul] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618654,python3.9):2025-04-03-09:27:28.247.500 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmul_bias_shape] of op type[MatMulV2] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618654,python3.9):2025-04-03-09:27:28.247.634 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmul_bias_shape] of op type[MatMul] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618654,python3.9):2025-04-03-09:27:28.247.749 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmulcompress_bias_shape] of op type[MatMulV2Compress] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618654,python3.9):2025-04-03-09:27:28.247.860 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_batch_matmul_shape] of op type[BatchMatMulV2] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618654,python3.9):2025-04-03-09:27:28.247.964 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_batch_matmul_shape] of op type[BatchMatMul] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618654,python3.9):2025-04-03-09:27:28.248.070 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_transdata_fixpipe] of op type[None] op pattern[BatchMatmul] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618674,python3.9):2025-04-03-09:27:28.363.916 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:59][decorator] Fusion pass[conv2d_data_rm_build_pass] of stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618674,python3.9):2025-04-03-09:27:28.365.759 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_conv3d] of op type[Conv3D] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618674,python3.9):2025-04-03-09:27:28.365.895 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:59][decorator] Fusion pass[trans_shape_depthwise_conv2d] of stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618674,python3.9):2025-04-03-09:27:28.368.124 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_for_elemwise] of op type[None] op pattern[ElemWise] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618674,python3.9):2025-04-03-09:27:28.368.281 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_for_broadcast] of op type[None] op pattern[Broadcast] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618674,python3.9):2025-04-03-09:27:28.368.402 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_biasadd] of op type[BiasAdd] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618674,python3.9):2025-04-03-09:27:28.368.540 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_requant_s16] of op type[AscendRequantS16] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618674,python3.9):2025-04-03-09:27:28.368.648 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_of_bninference] of op type[BNInferenceD] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618674,python3.9):2025-04-03-09:27:28.369.770 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_fully_connection] of op type[FullyConnection] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618674,python3.9):2025-04-03-09:27:28.369.905 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_fully_connection_compress] of op type[FullyConnectionCompress] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618674,python3.9):2025-04-03-09:27:28.371.828 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmul_bias_shape] of op type[MatMulV2] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618674,python3.9):2025-04-03-09:27:28.371.960 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmul_bias_shape] of op type[MatMul] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618674,python3.9):2025-04-03-09:27:28.372.075 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_matmulcompress_bias_shape] of op type[MatMulV2Compress] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618674,python3.9):2025-04-03-09:27:28.372.203 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_batch_matmul_shape] of op type[BatchMatMulV2] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618674,python3.9):2025-04-03-09:27:28.372.311 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_batch_matmul_shape] of op type[BatchMatMul] op pattern[None] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[INFO] TBE(618674,python3.9):2025-04-03-09:27:28.372.418 [../../../../../../latest/python/site-packages/tbe/common/register/fusion_pass_mgr.py:114][decorator] Fusion pass[trans_shape_transdata_fixpipe] of op type[None] op pattern[BatchMatmul] stage[InvokeStage.STAGE_BUILD] priority[Priority.NORMAL] has been registered.
[WARNING] TBE(618646,python3.9):2025-04-03-09:27:28.571.966 [../../../../../../latest/python/site-packages/te/platform/cce_policy.py:50][OpImplPolicy] te.platform.cce_policy.OpImplPolicy is deprecated, use te_fusion.fusion_util.OpImplPolicy instead.
[WARNING] TBE(618650,python3.9):2025-04-03-09:27:28.768.874 [../../../../../../latest/python/site-packages/te/platform/cce_policy.py:50][OpImplPolicy] te.platform.cce_policy.OpImplPolicy is deprecated, use te_fusion.fusion_util.OpImplPolicy instead.
[WARNING] TBE(618658,python3.9):2025-04-03-09:27:28.813.907 [../../../../../../latest/python/site-packages/te/platform/cce_policy.py:50][OpImplPolicy] te.platform.cce_policy.OpImplPolicy is deprecated, use te_fusion.fusion_util.OpImplPolicy instead.
[WARNING] TBE(618662,python3.9):2025-04-03-09:27:28.841.864 [../../../../../../latest/python/site-packages/te/platform/cce_policy.py:50][OpImplPolicy] te.platform.cce_policy.OpImplPolicy is deprecated, use te_fusion.fusion_util.OpImplPolicy instead.
[WARNING] TBE(618666,python3.9):2025-04-03-09:27:28.852.091 [../../../../../../latest/python/site-packages/te/platform/cce_policy.py:50][OpImplPolicy] te.platform.cce_policy.OpImplPolicy is deprecated, use te_fusion.fusion_util.OpImplPolicy instead.
[WARNING] TBE(618654,python3.9):2025-04-03-09:27:28.881.679 [../../../../../../latest/python/site-packages/te/platform/cce_policy.py:50][OpImplPolicy] te.platform.cce_policy.OpImplPolicy is deprecated, use te_fusion.fusion_util.OpImplPolicy instead.
[WARNING] TBE(618670,python3.9):2025-04-03-09:27:28.882.154 [../../../../../../latest/python/site-packages/te/platform/cce_policy.py:50][OpImplPolicy] te.platform.cce_policy.OpImplPolicy is deprecated, use te_fusion.fusion_util.OpImplPolicy instead.
[WARNING] TBE(618674,python3.9):2025-04-03-09:27:28.991.042 [../../../../../../latest/python/site-packages/te/platform/cce_policy.py:50][OpImplPolicy] te.platform.cce_policy.OpImplPolicy is deprecated, use te_fusion.fusion_util.OpImplPolicy instead.
[INFO] TBE(618646,python3.9):2025-04-03-09:27:32.720.769 [../../../../../../latest/python/site-packages/tbe/common/rl_bank/dynamic_op_filter.py:373][_need_to_tune_all_op] Auto search dynamic filter info: tune_all_op is False.
[INFO] TBE(618650,python3.9):2025-04-03-09:27:32.957.342 [../../../../../../latest/python/site-packages/tbe/common/rl_bank/dynamic_op_filter.py:373][_need_to_tune_all_op] Auto search dynamic filter info: tune_all_op is False.
[INFO] CORE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:32.978.121 [mindspore/core/utils/ms_context.cc:306] SetDeviceTargetFromInner] ms set context device target:Ascend
[INFO] PARALLEL(618646,ffff85d12de0,python3.9):2025-04-03-09:27:32.978.196 [mindspore/ccsrc/frontend/parallel/costmodel_context.cc:30] GetInstance] Create costmodel_context
[INFO] CORE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:32.978.228 [mindspore/core/utils/ms_context.cc:310] SetDeviceTargetFromInner] Set memory_optimize_level to O0 as default on other device
[INFO] GE(618646,python3.9):2025-04-03-09:27:33.021.981 [ops_kernel_builder_registry.cc:55]618646 OpsKernelBuilderRegistrar:Register kernel lib name = ops_kernel_info_hccl
[INFO] GE(618646,python3.9):2025-04-03-09:27:33.022.080 [ops_kernel_builder_registry.cc:28]618646 Register:Register OpsKernelBuilder successfully, kernel lib name = ops_kernel_info_hccl
[INFO] CORE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:33.059.652 [mindspore/core/utils/ms_context.cc:839] UseNewBackend] Use the new backend.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:33.059.751 [mindspore/ccsrc/runtime/pynative/lazy_fusion.cc:27] Init] Start init lazy fusion.
[INFO] KERNEL(618646,ffff85d12de0,python3.9):2025-04-03-09:27:33.059.821 [mindspore/ccsrc/plugin/device/ascend/kernel/dvm/lazy_fusion_flags.cc:174] LazyFusionFlags] lazy_fusion_flags :{"disable_ops":[],"dump_as_text":false,"enable_ops_only":[],"flush_threshold":100,"online_tuning":false,"opt_level":0,"synchronize":false}
[INFO] KERNEL(618646,ffff85d12de0,python3.9):2025-04-03-09:27:33.059.839 [mindspore/ccsrc/plugin/device/ascend/kernel/dvm/lazy_fusion_op.cc:1636] LazyFusionAscendInit] Skip init lazy fusion.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:33.059.854 [mindspore/ccsrc/runtime/pynative/lazy_fusion.cc:31] Init] End init lazy fusion.
[INFO] TBE(618658,python3.9):2025-04-03-09:27:33.104.830 [../../../../../../latest/python/site-packages/tbe/common/rl_bank/dynamic_op_filter.py:373][_need_to_tune_all_op] Auto search dynamic filter info: tune_all_op is False.
[INFO] CORE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:33.217.255 [mindspore/core/utils/ms_context.cc:306] SetDeviceTargetFromInner] ms set context device target:Ascend
[INFO] PARALLEL(618650,ffffbf562de0,python3.9):2025-04-03-09:27:33.217.359 [mindspore/ccsrc/frontend/parallel/costmodel_context.cc:30] GetInstance] Create costmodel_context
[INFO] CORE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:33.217.401 [mindspore/core/utils/ms_context.cc:310] SetDeviceTargetFromInner] Set memory_optimize_level to O0 as default on other device
[INFO] TBE(618662,python3.9):2025-04-03-09:27:33.241.285 [../../../../../../latest/python/site-packages/tbe/common/rl_bank/dynamic_op_filter.py:373][_need_to_tune_all_op] Auto search dynamic filter info: tune_all_op is False.
[INFO] GE(618650,python3.9):2025-04-03-09:27:33.262.344 [ops_kernel_builder_registry.cc:55]618650 OpsKernelBuilderRegistrar:Register kernel lib name = ops_kernel_info_hccl
[INFO] GE(618650,python3.9):2025-04-03-09:27:33.262.464 [ops_kernel_builder_registry.cc:28]618650 Register:Register OpsKernelBuilder successfully, kernel lib name = ops_kernel_info_hccl
[INFO] TBE(618674,python3.9):2025-04-03-09:27:33.279.929 [../../../../../../latest/python/site-packages/tbe/common/rl_bank/dynamic_op_filter.py:373][_need_to_tune_all_op] Auto search dynamic filter info: tune_all_op is False.
[INFO] CORE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:33.301.435 [mindspore/core/utils/ms_context.cc:839] UseNewBackend] Use the new backend.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:33.301.553 [mindspore/ccsrc/runtime/pynative/lazy_fusion.cc:27] Init] Start init lazy fusion.
[INFO] KERNEL(618650,ffffbf562de0,python3.9):2025-04-03-09:27:33.301.640 [mindspore/ccsrc/plugin/device/ascend/kernel/dvm/lazy_fusion_flags.cc:174] LazyFusionFlags] lazy_fusion_flags :{"disable_ops":[],"dump_as_text":false,"enable_ops_only":[],"flush_threshold":100,"online_tuning":false,"opt_level":0,"synchronize":false}
[INFO] KERNEL(618650,ffffbf562de0,python3.9):2025-04-03-09:27:33.301.665 [mindspore/ccsrc/plugin/device/ascend/kernel/dvm/lazy_fusion_op.cc:1636] LazyFusionAscendInit] Skip init lazy fusion.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:33.301.685 [mindspore/ccsrc/runtime/pynative/lazy_fusion.cc:31] Init] End init lazy fusion.
[INFO] CORE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:33.380.238 [mindspore/core/utils/ms_context.cc:306] SetDeviceTargetFromInner] ms set context device target:Ascend
[INFO] PARALLEL(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:33.380.356 [mindspore/ccsrc/frontend/parallel/costmodel_context.cc:30] GetInstance] Create costmodel_context
[INFO] CORE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:33.380.399 [mindspore/core/utils/ms_context.cc:310] SetDeviceTargetFromInner] Set memory_optimize_level to O0 as default on other device
[INFO] TBE(618670,python3.9):2025-04-03-09:27:33.410.706 [../../../../../../latest/python/site-packages/tbe/common/rl_bank/dynamic_op_filter.py:373][_need_to_tune_all_op] Auto search dynamic filter info: tune_all_op is False.
[INFO] GE(618658,python3.9):2025-04-03-09:27:33.428.570 [ops_kernel_builder_registry.cc:55]618658 OpsKernelBuilderRegistrar:Register kernel lib name = ops_kernel_info_hccl
[INFO] GE(618658,python3.9):2025-04-03-09:27:33.428.702 [ops_kernel_builder_registry.cc:28]618658 Register:Register OpsKernelBuilder successfully, kernel lib name = ops_kernel_info_hccl
[INFO] TBE(618654,python3.9):2025-04-03-09:27:33.429.577 [../../../../../../latest/python/site-packages/tbe/common/rl_bank/dynamic_op_filter.py:373][_need_to_tune_all_op] Auto search dynamic filter info: tune_all_op is False.
[INFO] CORE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:33.468.787 [mindspore/core/utils/ms_context.cc:839] UseNewBackend] Use the new backend.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:33.468.916 [mindspore/ccsrc/runtime/pynative/lazy_fusion.cc:27] Init] Start init lazy fusion.
[INFO] KERNEL(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:33.469.015 [mindspore/ccsrc/plugin/device/ascend/kernel/dvm/lazy_fusion_flags.cc:174] LazyFusionFlags] lazy_fusion_flags :{"disable_ops":[],"dump_as_text":false,"enable_ops_only":[],"flush_threshold":100,"online_tuning":false,"opt_level":0,"synchronize":false}
[INFO] KERNEL(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:33.469.040 [mindspore/ccsrc/plugin/device/ascend/kernel/dvm/lazy_fusion_op.cc:1636] LazyFusionAscendInit] Skip init lazy fusion.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:33.469.060 [mindspore/ccsrc/runtime/pynative/lazy_fusion.cc:31] Init] End init lazy fusion.
[INFO] CORE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:33.511.989 [mindspore/core/utils/ms_context.cc:306] SetDeviceTargetFromInner] ms set context device target:Ascend
[INFO] PARALLEL(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:33.512.083 [mindspore/ccsrc/frontend/parallel/costmodel_context.cc:30] GetInstance] Create costmodel_context
[INFO] CORE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:33.512.179 [mindspore/core/utils/ms_context.cc:310] SetDeviceTargetFromInner] Set memory_optimize_level to O0 as default on other device
[INFO] TBE(618666,python3.9):2025-04-03-09:27:33.521.168 [../../../../../../latest/python/site-packages/tbe/common/rl_bank/dynamic_op_filter.py:373][_need_to_tune_all_op] Auto search dynamic filter info: tune_all_op is False.
[INFO] CORE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:33.552.067 [mindspore/core/utils/ms_context.cc:306] SetDeviceTargetFromInner] ms set context device target:Ascend
[INFO] PARALLEL(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:33.552.175 [mindspore/ccsrc/frontend/parallel/costmodel_context.cc:30] GetInstance] Create costmodel_context
[INFO] CORE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:33.552.214 [mindspore/core/utils/ms_context.cc:310] SetDeviceTargetFromInner] Set memory_optimize_level to O0 as default on other device
[INFO] GE(618662,python3.9):2025-04-03-09:27:33.559.237 [ops_kernel_builder_registry.cc:55]618662 OpsKernelBuilderRegistrar:Register kernel lib name = ops_kernel_info_hccl
[INFO] GE(618662,python3.9):2025-04-03-09:27:33.559.366 [ops_kernel_builder_registry.cc:28]618662 Register:Register OpsKernelBuilder successfully, kernel lib name = ops_kernel_info_hccl
[INFO] GE(618674,python3.9):2025-04-03-09:27:33.594.761 [ops_kernel_builder_registry.cc:55]618674 OpsKernelBuilderRegistrar:Register kernel lib name = ops_kernel_info_hccl
[INFO] GE(618674,python3.9):2025-04-03-09:27:33.594.872 [ops_kernel_builder_registry.cc:28]618674 Register:Register OpsKernelBuilder successfully, kernel lib name = ops_kernel_info_hccl
[INFO] CORE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:33.603.018 [mindspore/core/utils/ms_context.cc:839] UseNewBackend] Use the new backend.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:33.603.183 [mindspore/ccsrc/runtime/pynative/lazy_fusion.cc:27] Init] Start init lazy fusion.
[INFO] KERNEL(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:33.603.278 [mindspore/ccsrc/plugin/device/ascend/kernel/dvm/lazy_fusion_flags.cc:174] LazyFusionFlags] lazy_fusion_flags :{"disable_ops":[],"dump_as_text":false,"enable_ops_only":[],"flush_threshold":100,"online_tuning":false,"opt_level":0,"synchronize":false}
[INFO] KERNEL(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:33.603.302 [mindspore/ccsrc/plugin/device/ascend/kernel/dvm/lazy_fusion_op.cc:1636] LazyFusionAscendInit] Skip init lazy fusion.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:33.603.322 [mindspore/ccsrc/runtime/pynative/lazy_fusion.cc:31] Init] End init lazy fusion.
[INFO] CORE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:33.632.282 [mindspore/core/utils/ms_context.cc:839] UseNewBackend] Use the new backend.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:33.632.393 [mindspore/ccsrc/runtime/pynative/lazy_fusion.cc:27] Init] Start init lazy fusion.
[INFO] KERNEL(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:33.632.475 [mindspore/ccsrc/plugin/device/ascend/kernel/dvm/lazy_fusion_flags.cc:174] LazyFusionFlags] lazy_fusion_flags :{"disable_ops":[],"dump_as_text":false,"enable_ops_only":[],"flush_threshold":100,"online_tuning":false,"opt_level":0,"synchronize":false}
[INFO] KERNEL(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:33.632.498 [mindspore/ccsrc/plugin/device/ascend/kernel/dvm/lazy_fusion_op.cc:1636] LazyFusionAscendInit] Skip init lazy fusion.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:33.632.517 [mindspore/ccsrc/runtime/pynative/lazy_fusion.cc:31] Init] End init lazy fusion.
[INFO] CORE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:33.672.228 [mindspore/core/utils/ms_context.cc:306] SetDeviceTargetFromInner] ms set context device target:Ascend
[INFO] PARALLEL(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:33.672.324 [mindspore/ccsrc/frontend/parallel/costmodel_context.cc:30] GetInstance] Create costmodel_context
[INFO] CORE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:33.672.360 [mindspore/core/utils/ms_context.cc:310] SetDeviceTargetFromInner] Set memory_optimize_level to O0 as default on other device
[INFO] CORE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:33.702.120 [mindspore/core/utils/ms_context.cc:306] SetDeviceTargetFromInner] ms set context device target:Ascend
[INFO] PARALLEL(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:33.702.226 [mindspore/ccsrc/frontend/parallel/costmodel_context.cc:30] GetInstance] Create costmodel_context
[INFO] CORE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:33.702.267 [mindspore/core/utils/ms_context.cc:310] SetDeviceTargetFromInner] Set memory_optimize_level to O0 as default on other device
[INFO] GE(618670,python3.9):2025-04-03-09:27:33.716.465 [ops_kernel_builder_registry.cc:55]618670 OpsKernelBuilderRegistrar:Register kernel lib name = ops_kernel_info_hccl
[INFO] GE(618670,python3.9):2025-04-03-09:27:33.716.569 [ops_kernel_builder_registry.cc:28]618670 Register:Register OpsKernelBuilder successfully, kernel lib name = ops_kernel_info_hccl
[INFO] GE(618654,python3.9):2025-04-03-09:27:33.749.580 [ops_kernel_builder_registry.cc:55]618654 OpsKernelBuilderRegistrar:Register kernel lib name = ops_kernel_info_hccl
[INFO] GE(618654,python3.9):2025-04-03-09:27:33.749.709 [ops_kernel_builder_registry.cc:28]618654 Register:Register OpsKernelBuilder successfully, kernel lib name = ops_kernel_info_hccl
[INFO] CORE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:33.754.245 [mindspore/core/utils/ms_context.cc:839] UseNewBackend] Use the new backend.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:33.754.369 [mindspore/ccsrc/runtime/pynative/lazy_fusion.cc:27] Init] Start init lazy fusion.
[INFO] KERNEL(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:33.754.461 [mindspore/ccsrc/plugin/device/ascend/kernel/dvm/lazy_fusion_flags.cc:174] LazyFusionFlags] lazy_fusion_flags :{"disable_ops":[],"dump_as_text":false,"enable_ops_only":[],"flush_threshold":100,"online_tuning":false,"opt_level":0,"synchronize":false}
[INFO] KERNEL(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:33.754.484 [mindspore/ccsrc/plugin/device/ascend/kernel/dvm/lazy_fusion_op.cc:1636] LazyFusionAscendInit] Skip init lazy fusion.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:33.754.503 [mindspore/ccsrc/runtime/pynative/lazy_fusion.cc:31] Init] End init lazy fusion.
[INFO] CORE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:33.791.447 [mindspore/core/utils/ms_context.cc:839] UseNewBackend] Use the new backend.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:33.791.567 [mindspore/ccsrc/runtime/pynative/lazy_fusion.cc:27] Init] Start init lazy fusion.
[INFO] KERNEL(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:33.791.668 [mindspore/ccsrc/plugin/device/ascend/kernel/dvm/lazy_fusion_flags.cc:174] LazyFusionFlags] lazy_fusion_flags :{"disable_ops":[],"dump_as_text":false,"enable_ops_only":[],"flush_threshold":100,"online_tuning":false,"opt_level":0,"synchronize":false}
[INFO] KERNEL(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:33.791.695 [mindspore/ccsrc/plugin/device/ascend/kernel/dvm/lazy_fusion_op.cc:1636] LazyFusionAscendInit] Skip init lazy fusion.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:33.791.714 [mindspore/ccsrc/runtime/pynative/lazy_fusion.cc:31] Init] End init lazy fusion.
[INFO] CORE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:33.855.633 [mindspore/core/utils/ms_context.cc:306] SetDeviceTargetFromInner] ms set context device target:Ascend
[INFO] PARALLEL(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:33.855.783 [mindspore/ccsrc/frontend/parallel/costmodel_context.cc:30] GetInstance] Create costmodel_context
[INFO] CORE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:33.855.823 [mindspore/core/utils/ms_context.cc:310] SetDeviceTargetFromInner] Set memory_optimize_level to O0 as default on other device
[WARNING] TBE(618646,python3.9):2025-04-03-09:27:33.879.265 [../../../../../../latest/python/site-packages/te/tik/__init__.py:51][<module>] 'from te import tik' is deprecated, please replace it with 'from tbe import tik'.
[INFO] GE(618666,python3.9):2025-04-03-09:27:33.905.331 [ops_kernel_builder_registry.cc:55]618666 OpsKernelBuilderRegistrar:Register kernel lib name = ops_kernel_info_hccl
[INFO] GE(618666,python3.9):2025-04-03-09:27:33.905.474 [ops_kernel_builder_registry.cc:28]618666 Register:Register OpsKernelBuilder successfully, kernel lib name = ops_kernel_info_hccl
[INFO] CORE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:33.947.946 [mindspore/core/utils/ms_context.cc:839] UseNewBackend] Use the new backend.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:33.948.070 [mindspore/ccsrc/runtime/pynative/lazy_fusion.cc:27] Init] Start init lazy fusion.
[INFO] KERNEL(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:33.948.200 [mindspore/ccsrc/plugin/device/ascend/kernel/dvm/lazy_fusion_flags.cc:174] LazyFusionFlags] lazy_fusion_flags :{"disable_ops":[],"dump_as_text":false,"enable_ops_only":[],"flush_threshold":100,"online_tuning":false,"opt_level":0,"synchronize":false}
[INFO] KERNEL(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:33.948.229 [mindspore/ccsrc/plugin/device/ascend/kernel/dvm/lazy_fusion_op.cc:1636] LazyFusionAscendInit] Skip init lazy fusion.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:33.948.249 [mindspore/ccsrc/runtime/pynative/lazy_fusion.cc:31] Init] End init lazy fusion.
[WARNING] TBE(618650,python3.9):2025-04-03-09:27:34.140.111 [../../../../../../latest/python/site-packages/te/tik/__init__.py:51][<module>] 'from te import tik' is deprecated, please replace it with 'from tbe import tik'.
[WARNING] TBE(618658,python3.9):2025-04-03-09:27:34.318.600 [../../../../../../latest/python/site-packages/te/tik/__init__.py:51][<module>] 'from te import tik' is deprecated, please replace it with 'from tbe import tik'.
[WARNING] TBE(618662,python3.9):2025-04-03-09:27:34.457.777 [../../../../../../latest/python/site-packages/te/tik/__init__.py:51][<module>] 'from te import tik' is deprecated, please replace it with 'from tbe import tik'.
[WARNING] TBE(618674,python3.9):2025-04-03-09:27:34.473.784 [../../../../../../latest/python/site-packages/te/tik/__init__.py:51][<module>] 'from te import tik' is deprecated, please replace it with 'from tbe import tik'.
[WARNING] TBE(618670,python3.9):2025-04-03-09:27:34.571.969 [../../../../../../latest/python/site-packages/te/tik/__init__.py:51][<module>] 'from te import tik' is deprecated, please replace it with 'from tbe import tik'.
[WARNING] TBE(618654,python3.9):2025-04-03-09:27:34.659.954 [../../../../../../latest/python/site-packages/te/tik/__init__.py:51][<module>] 'from te import tik' is deprecated, please replace it with 'from tbe import tik'.
[WARNING] TBE(618666,python3.9):2025-04-03-09:27:34.916.011 [../../../../../../latest/python/site-packages/te/tik/__init__.py:51][<module>] 'from te import tik' is deprecated, please replace it with 'from tbe import tik'.
[INFO] ME(618646:281472926821856,MainProcess):2025-04-03-09:27:35.594.503 [mindspore/profiler/common/registry.py:36] registered module: CpuProfiler with name: CPU
[INFO] ME(618646:281472926821856,MainProcess):2025-04-03-09:27:35.595.150 [mindspore/profiler/common/registry.py:36] registered module: GpuProfiler with name: GPU
[INFO] ME(618646:281472926821856,MainProcess):2025-04-03-09:27:35.606.129 [mindspore/profiler/common/registry.py:36] registered module: NpuProfiler with name: Ascend
[INFO] ME(618646,ffff85d12de0,python3.9):2025-04-03-09:27:35.695.353 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:466] GetDeviceContext] Device context of device Ascend is not created yet.
[INFO] ME(618646:281472926821856,MainProcess):2025-04-03-09:27:35.695.433 [mindspore/hal/device.py:158] Backend Ascend is not created yet.
[INFO] PS(618646,ffff85d12de0,python3.9):2025-04-03-09:27:35.696.698 [mindspore/ccsrc/ps/ps_context.cc:256] set_ms_role] MS_ROLE of this node is MS_WORKER
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:35.696.748 [mindspore/ccsrc/include/backend/distributed/cluster/topology/node_base.h:46] NodeBase] Cluster topo timeout is 600 seconds.
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:35.696.768 [mindspore/ccsrc/include/backend/distributed/cluster/topology/node_base.h:51] NodeBase] Node timeout after exception is 30 seconds.
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:35.696.791 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:29] TCPClient] Tcp client receiving message timeout is 15 seconds.
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:35.697.072 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:RECV_EVENT_LOOP,loop_thread_:281471314861984
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:35.697.199 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:SEND_EVENT_LOOP,loop_thread_:281471306407840
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:35.697.222 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:29] TCPClient] Tcp client receiving message timeout is 15 seconds.
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:35.697.344 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:RECV_EVENT_LOOP,loop_thread_:281471297953696
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:35.697.560 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:SEND_EVENT_LOOP,loop_thread_:281471084392352
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:35.697.585 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:170] Register] Start connecting heartbeat client.
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:35.697.601 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:441] Connect] Can not found link destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:35.697.812 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:485] Connect] Connection 20 source: 127.0.0.1:35264, destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:35.697.853 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:494] Connect] Waiting for the state of the connection to 127.0.0.1:8118 to be connected...Retry number: 1
[WARNING] DISTRIBUTED(618646,ffff24ba9fa0,python3.9):2025-04-03-09:27:35.697.869 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:79] ConnectedEventHandler] Connection from 127.0.0.1:35264 to 127.0.0.1:8118 is successfully created. System errno: Success
[INFO] ME(618650:281473891839456,MainProcess):2025-04-03-09:27:35.893.864 [mindspore/profiler/common/registry.py:36] registered module: CpuProfiler with name: CPU
[INFO] ME(618650:281473891839456,MainProcess):2025-04-03-09:27:35.894.543 [mindspore/profiler/common/registry.py:36] registered module: GpuProfiler with name: GPU
[INFO] ME(618650:281473891839456,MainProcess):2025-04-03-09:27:35.905.810 [mindspore/profiler/common/registry.py:36] registered module: NpuProfiler with name: Ascend
[INFO] ME(618650,ffffbf562de0,python3.9):2025-04-03-09:27:35.996.836 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:466] GetDeviceContext] Device context of device Ascend is not created yet.
[INFO] ME(618650:281473891839456,MainProcess):2025-04-03-09:27:35.996.915 [mindspore/hal/device.py:158] Backend Ascend is not created yet.
[INFO] PS(618650,ffffbf562de0,python3.9):2025-04-03-09:27:35.998.184 [mindspore/ccsrc/ps/ps_context.cc:256] set_ms_role] MS_ROLE of this node is MS_WORKER
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:35.998.235 [mindspore/ccsrc/include/backend/distributed/cluster/topology/node_base.h:46] NodeBase] Cluster topo timeout is 600 seconds.
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:35.998.259 [mindspore/ccsrc/include/backend/distributed/cluster/topology/node_base.h:51] NodeBase] Node timeout after exception is 30 seconds.
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:35.998.292 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:29] TCPClient] Tcp client receiving message timeout is 15 seconds.
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:35.998.542 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:RECV_EVENT_LOOP,loop_thread_:281472279879584
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:35.998.684 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:SEND_EVENT_LOOP,loop_thread_:281472271425440
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:35.998.712 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:29] TCPClient] Tcp client receiving message timeout is 15 seconds.
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:35.998.858 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:RECV_EVENT_LOOP,loop_thread_:281472262971296
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:35.999.013 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:SEND_EVENT_LOOP,loop_thread_:281472254517152
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:35.999.044 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:170] Register] Start connecting heartbeat client.
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:35.999.068 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:441] Connect] Can not found link destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:35.999.305 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:485] Connect] Connection 20 source: 127.0.0.1:35266, destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:35.999.347 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:494] Connect] Waiting for the state of the connection to 127.0.0.1:8118 to be connected...Retry number: 1
[WARNING] DISTRIBUTED(618650,ffff5e3f9fa0,python3.9):2025-04-03-09:27:35.999.360 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:79] ConnectedEventHandler] Connection from 127.0.0.1:35266 to 127.0.0.1:8118 is successfully created. System errno: Success
[INFO] ME(618658:281473716280800,MainProcess):2025-04-03-09:27:36.154.470 [mindspore/profiler/common/registry.py:36] registered module: CpuProfiler with name: CPU
[INFO] ME(618658:281473716280800,MainProcess):2025-04-03-09:27:36.155.229 [mindspore/profiler/common/registry.py:36] registered module: GpuProfiler with name: GPU
[INFO] ME(618658:281473716280800,MainProcess):2025-04-03-09:27:36.167.407 [mindspore/profiler/common/registry.py:36] registered module: NpuProfiler with name: Ascend
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:36.197.967 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:505] Connect] Connected to destination: 127.0.0.1:8118
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:36.198.014 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:73] Connect] Connected to the tcp server 127.0.0.1:8118 successfully.
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:36.198.029 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:178] Register] Start connecting business client.
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:36.198.044 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:441] Connect] Can not found link destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:36.198.253 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:485] Connect] Connection 21 source: 127.0.0.1:35274, destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:36.198.272 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:494] Connect] Waiting for the state of the connection to 127.0.0.1:8118 to be connected...Retry number: 2
[WARNING] DISTRIBUTED(618646,ffff25bc9fa0,python3.9):2025-04-03-09:27:36.198.309 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:79] ConnectedEventHandler] Connection from 127.0.0.1:35274 to 127.0.0.1:8118 is successfully created. System errno: Success
[INFO] ME(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:36.264.543 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:466] GetDeviceContext] Device context of device Ascend is not created yet.
[INFO] ME(618658:281473716280800,MainProcess):2025-04-03-09:27:36.264.645 [mindspore/hal/device.py:158] Backend Ascend is not created yet.
[INFO] PS(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:36.265.998 [mindspore/ccsrc/ps/ps_context.cc:256] set_ms_role] MS_ROLE of this node is MS_WORKER
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:36.266.053 [mindspore/ccsrc/include/backend/distributed/cluster/topology/node_base.h:46] NodeBase] Cluster topo timeout is 600 seconds.
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:36.266.076 [mindspore/ccsrc/include/backend/distributed/cluster/topology/node_base.h:51] NodeBase] Node timeout after exception is 30 seconds.
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:36.266.110 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:29] TCPClient] Tcp client receiving message timeout is 15 seconds.
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:36.266.394 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:RECV_EVENT_LOOP,loop_thread_:281472104320928
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:36.266.608 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:SEND_EVENT_LOOP,loop_thread_:281472023916448
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:36.266.636 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:29] TCPClient] Tcp client receiving message timeout is 15 seconds.
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:36.266.773 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:RECV_EVENT_LOOP,loop_thread_:281472015462304
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:36.266.918 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:SEND_EVENT_LOOP,loop_thread_:281472007008160
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:36.266.951 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:170] Register] Start connecting heartbeat client.
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:36.266.973 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:441] Connect] Can not found link destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:36.267.235 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:485] Connect] Connection 20 source: 127.0.0.1:35282, destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:36.267.285 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:494] Connect] Waiting for the state of the connection to 127.0.0.1:8118 to be connected...Retry number: 1
[WARNING] DISTRIBUTED(618658,ffff4f7eefa0,python3.9):2025-04-03-09:27:36.267.289 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:79] ConnectedEventHandler] Connection from 127.0.0.1:35282 to 127.0.0.1:8118 is successfully created. System errno: Success
[INFO] ME(618674:281473023856096,MainProcess):2025-04-03-09:27:36.271.940 [mindspore/profiler/common/registry.py:36] registered module: CpuProfiler with name: CPU
[INFO] ME(618662:281473748110816,MainProcess):2025-04-03-09:27:36.271.940 [mindspore/profiler/common/registry.py:36] registered module: CpuProfiler with name: CPU
[INFO] ME(618674:281473023856096,MainProcess):2025-04-03-09:27:36.272.623 [mindspore/profiler/common/registry.py:36] registered module: GpuProfiler with name: GPU
[INFO] ME(618662:281473748110816,MainProcess):2025-04-03-09:27:36.272.623 [mindspore/profiler/common/registry.py:36] registered module: GpuProfiler with name: GPU
[INFO] ME(618662:281473748110816,MainProcess):2025-04-03-09:27:36.284.322 [mindspore/profiler/common/registry.py:36] registered module: NpuProfiler with name: Ascend
[INFO] ME(618674:281473023856096,MainProcess):2025-04-03-09:27:36.284.326 [mindspore/profiler/common/registry.py:36] registered module: NpuProfiler with name: Ascend
[INFO] ME(618670:281473556700640,MainProcess):2025-04-03-09:27:36.302.032 [mindspore/profiler/common/registry.py:36] registered module: CpuProfiler with name: CPU
[INFO] ME(618670:281473556700640,MainProcess):2025-04-03-09:27:36.302.707 [mindspore/profiler/common/registry.py:36] registered module: GpuProfiler with name: GPU
[INFO] ME(618670:281473556700640,MainProcess):2025-04-03-09:27:36.314.023 [mindspore/profiler/common/registry.py:36] registered module: NpuProfiler with name: Ascend
[INFO] ME(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:36.377.656 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:466] GetDeviceContext] Device context of device Ascend is not created yet.
[INFO] ME(618674:281473023856096,MainProcess):2025-04-03-09:27:36.377.750 [mindspore/hal/device.py:158] Backend Ascend is not created yet.
[INFO] PS(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:36.379.061 [mindspore/ccsrc/ps/ps_context.cc:256] set_ms_role] MS_ROLE of this node is MS_WORKER
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:36.379.116 [mindspore/ccsrc/include/backend/distributed/cluster/topology/node_base.h:46] NodeBase] Cluster topo timeout is 600 seconds.
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:36.379.139 [mindspore/ccsrc/include/backend/distributed/cluster/topology/node_base.h:51] NodeBase] Node timeout after exception is 30 seconds.
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:36.379.172 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:29] TCPClient] Tcp client receiving message timeout is 15 seconds.
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:36.379.422 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:RECV_EVENT_LOOP,loop_thread_:281471411896224
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:36.379.545 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:SEND_EVENT_LOOP,loop_thread_:281471403442080
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:36.379.570 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:29] TCPClient] Tcp client receiving message timeout is 15 seconds.
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:36.379.696 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:RECV_EVENT_LOOP,loop_thread_:281471394987936
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:36.379.835 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:SEND_EVENT_LOOP,loop_thread_:281471386533792
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:36.379.867 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:170] Register] Start connecting heartbeat client.
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:36.379.889 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:441] Connect] Can not found link destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:36.380.138 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:485] Connect] Connection 20 source: 127.0.0.1:35292, destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:36.380.211 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:494] Connect] Waiting for the state of the connection to 127.0.0.1:8118 to be connected...Retry number: 1
[WARNING] DISTRIBUTED(618674,ffff2a833fa0,python3.9):2025-04-03-09:27:36.380.214 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:79] ConnectedEventHandler] Connection from 127.0.0.1:35292 to 127.0.0.1:8118 is successfully created. System errno: Success
[INFO] ME(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:36.385.032 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:466] GetDeviceContext] Device context of device Ascend is not created yet.
[INFO] ME(618662:281473748110816,MainProcess):2025-04-03-09:27:36.385.105 [mindspore/hal/device.py:158] Backend Ascend is not created yet.
[INFO] PS(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:36.386.521 [mindspore/ccsrc/ps/ps_context.cc:256] set_ms_role] MS_ROLE of this node is MS_WORKER
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:36.386.564 [mindspore/ccsrc/include/backend/distributed/cluster/topology/node_base.h:46] NodeBase] Cluster topo timeout is 600 seconds.
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:36.386.586 [mindspore/ccsrc/include/backend/distributed/cluster/topology/node_base.h:51] NodeBase] Node timeout after exception is 30 seconds.
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:36.386.614 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:29] TCPClient] Tcp client receiving message timeout is 15 seconds.
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:36.386.808 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:RECV_EVENT_LOOP,loop_thread_:281472136150944
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:36.386.931 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:SEND_EVENT_LOOP,loop_thread_:281472127696800
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:36.386.956 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:29] TCPClient] Tcp client receiving message timeout is 15 seconds.
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:36.387.071 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:RECV_EVENT_LOOP,loop_thread_:281472119242656
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:36.387.195 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:SEND_EVENT_LOOP,loop_thread_:281472110788512
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:36.387.222 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:170] Register] Start connecting heartbeat client.
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:36.387.243 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:441] Connect] Can not found link destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:36.387.367 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:485] Connect] Connection 20 source: 127.0.0.1:35296, destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:36.387.422 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:494] Connect] Waiting for the state of the connection to 127.0.0.1:8118 to be connected...Retry number: 1
[WARNING] DISTRIBUTED(618662,ffff55ae7fa0,python3.9):2025-04-03-09:27:36.387.424 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:79] ConnectedEventHandler] Connection from 127.0.0.1:35296 to 127.0.0.1:8118 is successfully created. System errno: Success
[INFO] ME(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:36.403.859 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:466] GetDeviceContext] Device context of device Ascend is not created yet.
[INFO] ME(618670:281473556700640,MainProcess):2025-04-03-09:27:36.403.943 [mindspore/hal/device.py:158] Backend Ascend is not created yet.
[INFO] PS(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:36.405.201 [mindspore/ccsrc/ps/ps_context.cc:256] set_ms_role] MS_ROLE of this node is MS_WORKER
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:36.405.256 [mindspore/ccsrc/include/backend/distributed/cluster/topology/node_base.h:46] NodeBase] Cluster topo timeout is 600 seconds.
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:36.405.279 [mindspore/ccsrc/include/backend/distributed/cluster/topology/node_base.h:51] NodeBase] Node timeout after exception is 30 seconds.
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:36.405.313 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:29] TCPClient] Tcp client receiving message timeout is 15 seconds.
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:36.405.537 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:RECV_EVENT_LOOP,loop_thread_:281471944740768
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:36.405.651 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:SEND_EVENT_LOOP,loop_thread_:281471936286624
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:36.405.677 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:29] TCPClient] Tcp client receiving message timeout is 15 seconds.
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:36.405.796 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:RECV_EVENT_LOOP,loop_thread_:281471927832480
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:36.405.922 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:SEND_EVENT_LOOP,loop_thread_:281471919378336
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:36.405.952 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:170] Register] Start connecting heartbeat client.
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:36.405.974 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:441] Connect] Can not found link destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:36.406.166 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:485] Connect] Connection 20 source: 127.0.0.1:35306, destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:36.406.207 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:494] Connect] Waiting for the state of the connection to 127.0.0.1:8118 to be connected...Retry number: 1
[WARNING] DISTRIBUTED(618670,ffff4a45cfa0,python3.9):2025-04-03-09:27:36.406.224 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:79] ConnectedEventHandler] Connection from 127.0.0.1:35306 to 127.0.0.1:8118 is successfully created. System errno: Success
[INFO] ME(618654:281473077956064,MainProcess):2025-04-03-09:27:36.496.100 [mindspore/profiler/common/registry.py:36] registered module: CpuProfiler with name: CPU
[INFO] ME(618654:281473077956064,MainProcess):2025-04-03-09:27:36.496.762 [mindspore/profiler/common/registry.py:36] registered module: GpuProfiler with name: GPU
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:36.499.436 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:505] Connect] Connected to destination: 127.0.0.1:8118
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:36.499.464 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:73] Connect] Connected to the tcp server 127.0.0.1:8118 successfully.
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:36.499.477 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:178] Register] Start connecting business client.
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:36.499.498 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:441] Connect] Can not found link destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:36.499.620 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:485] Connect] Connection 21 source: 127.0.0.1:35310, destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:36.499.644 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:494] Connect] Waiting for the state of the connection to 127.0.0.1:8118 to be connected...Retry number: 2
[WARNING] DISTRIBUTED(618650,ffff5f419fa0,python3.9):2025-04-03-09:27:36.499.654 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:79] ConnectedEventHandler] Connection from 127.0.0.1:35310 to 127.0.0.1:8118 is successfully created. System errno: Success
[INFO] ME(618654:281473077956064,MainProcess):2025-04-03-09:27:36.508.123 [mindspore/profiler/common/registry.py:36] registered module: NpuProfiler with name: Ascend
[INFO] ME(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:36.598.802 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:466] GetDeviceContext] Device context of device Ascend is not created yet.
[INFO] ME(618654:281473077956064,MainProcess):2025-04-03-09:27:36.598.871 [mindspore/hal/device.py:158] Backend Ascend is not created yet.
[INFO] PS(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:36.600.137 [mindspore/ccsrc/ps/ps_context.cc:256] set_ms_role] MS_ROLE of this node is MS_WORKER
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:36.600.197 [mindspore/ccsrc/include/backend/distributed/cluster/topology/node_base.h:46] NodeBase] Cluster topo timeout is 600 seconds.
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:36.600.225 [mindspore/ccsrc/include/backend/distributed/cluster/topology/node_base.h:51] NodeBase] Node timeout after exception is 30 seconds.
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:36.600.254 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:29] TCPClient] Tcp client receiving message timeout is 15 seconds.
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:36.600.462 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:RECV_EVENT_LOOP,loop_thread_:281471465996192
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:36.600.582 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:SEND_EVENT_LOOP,loop_thread_:281471457542048
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:36.600.608 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:29] TCPClient] Tcp client receiving message timeout is 15 seconds.
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:36.600.733 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:RECV_EVENT_LOOP,loop_thread_:281471449087904
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:36.600.864 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:SEND_EVENT_LOOP,loop_thread_:281471440633760
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:36.600.893 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:170] Register] Start connecting heartbeat client.
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:36.600.915 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:441] Connect] Can not found link destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:36.601.080 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:485] Connect] Connection 20 source: 127.0.0.1:35324, destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:36.601.125 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:494] Connect] Waiting for the state of the connection to 127.0.0.1:8118 to be connected...Retry number: 1
[WARNING] DISTRIBUTED(618654,ffff2dbcbfa0,python3.9):2025-04-03-09:27:36.601.128 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:79] ConnectedEventHandler] Connection from 127.0.0.1:35324 to 127.0.0.1:8118 is successfully created. System errno: Success
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:36.698.374 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:505] Connect] Connected to destination: 127.0.0.1:8118
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:36.698.417 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:73] Connect] Connected to the tcp server 127.0.0.1:8118 successfully.
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:36.698.762 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:222] Register] The compute graph node: 0 has been registered successfully.
[WARNING] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:36.698.932 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:246] BuildCluster] Topology build timed out., retry(1/1200).
[INFO] DISTRIBUTED(618646,ffff177eefa0,python3.9):2025-04-03-09:27:36.698.998 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:270] Heartbeat] Interval of heartbeat lower and upper are 3 and 5
[INFO] DISTRIBUTED(618646,ffff177eefa0,python3.9):2025-04-03-09:27:36.699.025 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:274] Heartbeat] The heartbeat thread is started.
[INFO] ME(618666:281473067970016,MainProcess):2025-04-03-09:27:36.708.089 [mindspore/profiler/common/registry.py:36] registered module: CpuProfiler with name: CPU
[INFO] ME(618666:281473067970016,MainProcess):2025-04-03-09:27:36.708.732 [mindspore/profiler/common/registry.py:36] registered module: GpuProfiler with name: GPU
[INFO] ME(618666:281473067970016,MainProcess):2025-04-03-09:27:36.719.719 [mindspore/profiler/common/registry.py:36] registered module: NpuProfiler with name: Ascend
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:36.767.397 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:505] Connect] Connected to destination: 127.0.0.1:8118
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:36.767.431 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:73] Connect] Connected to the tcp server 127.0.0.1:8118 successfully.
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:36.767.445 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:178] Register] Start connecting business client.
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:36.767.466 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:441] Connect] Can not found link destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:36.767.581 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:485] Connect] Connection 21 source: 127.0.0.1:35326, destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:36.767.605 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:494] Connect] Waiting for the state of the connection to 127.0.0.1:8118 to be connected...Retry number: 2
[WARNING] DISTRIBUTED(618658,ffff54cacfa0,python3.9):2025-04-03-09:27:36.767.628 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:79] ConnectedEventHandler] Connection from 127.0.0.1:35326 to 127.0.0.1:8118 is successfully created. System errno: Success
[INFO] ME(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:36.810.610 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:466] GetDeviceContext] Device context of device Ascend is not created yet.
[INFO] ME(618666:281473067970016,MainProcess):2025-04-03-09:27:36.810.678 [mindspore/hal/device.py:158] Backend Ascend is not created yet.
[INFO] PS(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:36.811.919 [mindspore/ccsrc/ps/ps_context.cc:256] set_ms_role] MS_ROLE of this node is MS_WORKER
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:36.811.960 [mindspore/ccsrc/include/backend/distributed/cluster/topology/node_base.h:46] NodeBase] Cluster topo timeout is 600 seconds.
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:36.811.978 [mindspore/ccsrc/include/backend/distributed/cluster/topology/node_base.h:51] NodeBase] Node timeout after exception is 30 seconds.
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:36.812.001 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:29] TCPClient] Tcp client receiving message timeout is 15 seconds.
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:36.812.224 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:RECV_EVENT_LOOP,loop_thread_:281471456010144
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:36.812.366 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:SEND_EVENT_LOOP,loop_thread_:281471447556000
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:36.812.388 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:29] TCPClient] Tcp client receiving message timeout is 15 seconds.
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:36.812.494 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:RECV_EVENT_LOOP,loop_thread_:281471439101856
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:36.812.620 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:189] Initialize] Set pthread name success name:SEND_EVENT_LOOP,loop_thread_:281471430647712
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:36.812.643 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:170] Register] Start connecting heartbeat client.
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:36.812.659 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:441] Connect] Can not found link destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:36.812.843 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:485] Connect] Connection 20 source: 127.0.0.1:35328, destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:36.812.865 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:494] Connect] Waiting for the state of the connection to 127.0.0.1:8118 to be connected...Retry number: 1
[WARNING] DISTRIBUTED(618666,ffff2d245fa0,python3.9):2025-04-03-09:27:36.812.897 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:79] ConnectedEventHandler] Connection from 127.0.0.1:35328 to 127.0.0.1:8118 is successfully created. System errno: Success
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:36.880.313 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:505] Connect] Connected to destination: 127.0.0.1:8118
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:36.880.341 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:73] Connect] Connected to the tcp server 127.0.0.1:8118 successfully.
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:36.880.355 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:178] Register] Start connecting business client.
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:36.880.374 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:441] Connect] Can not found link destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:36.880.482 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:485] Connect] Connection 21 source: 127.0.0.1:35342, destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:36.880.504 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:494] Connect] Waiting for the state of the connection to 127.0.0.1:8118 to be connected...Retry number: 2
[WARNING] DISTRIBUTED(618674,ffff2b853fa0,python3.9):2025-04-03-09:27:36.880.529 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:79] ConnectedEventHandler] Connection from 127.0.0.1:35342 to 127.0.0.1:8118 is successfully created. System errno: Success
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:36.887.515 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:505] Connect] Connected to destination: 127.0.0.1:8118
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:36.887.542 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:73] Connect] Connected to the tcp server 127.0.0.1:8118 successfully.
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:36.887.557 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:178] Register] Start connecting business client.
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:36.887.576 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:441] Connect] Can not found link destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:36.887.677 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:485] Connect] Connection 21 source: 127.0.0.1:35354, destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:36.887.698 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:494] Connect] Waiting for the state of the connection to 127.0.0.1:8118 to be connected...Retry number: 2
[WARNING] DISTRIBUTED(618662,ffff56b07fa0,python3.9):2025-04-03-09:27:36.887.722 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:79] ConnectedEventHandler] Connection from 127.0.0.1:35354 to 127.0.0.1:8118 is successfully created. System errno: Success
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:36.906.297 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:505] Connect] Connected to destination: 127.0.0.1:8118
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:36.906.322 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:73] Connect] Connected to the tcp server 127.0.0.1:8118 successfully.
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:36.906.337 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:178] Register] Start connecting business client.
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:36.906.354 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:441] Connect] Can not found link destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:36.906.454 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:485] Connect] Connection 21 source: 127.0.0.1:35364, destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:36.906.475 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:494] Connect] Waiting for the state of the connection to 127.0.0.1:8118 to be connected...Retry number: 2
[WARNING] DISTRIBUTED(618670,ffff4b47cfa0,python3.9):2025-04-03-09:27:36.906.492 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:79] ConnectedEventHandler] Connection from 127.0.0.1:35364 to 127.0.0.1:8118 is successfully created. System errno: Success
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:36.999.723 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:505] Connect] Connected to destination: 127.0.0.1:8118
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:36.999.748 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:73] Connect] Connected to the tcp server 127.0.0.1:8118 successfully.
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:37.000.006 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:222] Register] The compute graph node: 1 has been registered successfully.
[WARNING] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:37.000.182 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:246] BuildCluster] Topology build timed out., retry(1/1200).
[INFO] DISTRIBUTED(618650,ffff5d3d9fa0,python3.9):2025-04-03-09:27:37.000.233 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:270] Heartbeat] Interval of heartbeat lower and upper are 3 and 5
[INFO] DISTRIBUTED(618650,ffff5d3d9fa0,python3.9):2025-04-03-09:27:37.000.261 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:274] Heartbeat] The heartbeat thread is started.
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:37.101.211 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:505] Connect] Connected to destination: 127.0.0.1:8118
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:37.101.234 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:73] Connect] Connected to the tcp server 127.0.0.1:8118 successfully.
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:37.101.248 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:178] Register] Start connecting business client.
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:37.101.267 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:441] Connect] Can not found link destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:37.101.361 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:485] Connect] Connection 21 source: 127.0.0.1:35368, destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:37.101.383 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:494] Connect] Waiting for the state of the connection to 127.0.0.1:8118 to be connected...Retry number: 2
[WARNING] DISTRIBUTED(618654,ffff2ebebfa0,python3.9):2025-04-03-09:27:37.101.398 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:79] ConnectedEventHandler] Connection from 127.0.0.1:35368 to 127.0.0.1:8118 is successfully created. System errno: Success
[WARNING] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:37.199.011 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:246] BuildCluster] Topology build timed out., retry(2/1200).
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:37.267.684 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:505] Connect] Connected to destination: 127.0.0.1:8118
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:37.267.707 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:73] Connect] Connected to the tcp server 127.0.0.1:8118 successfully.
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:37.267.968 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:222] Register] The compute graph node: 3 has been registered successfully.
[WARNING] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:37.268.108 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:246] BuildCluster] Topology build timed out., retry(1/1200).
[INFO] DISTRIBUTED(618658,ffff4e7cefa0,python3.9):2025-04-03-09:27:37.268.181 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:270] Heartbeat] Interval of heartbeat lower and upper are 3 and 5
[INFO] DISTRIBUTED(618658,ffff4e7cefa0,python3.9):2025-04-03-09:27:37.268.212 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:274] Heartbeat] The heartbeat thread is started.
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:37.312.945 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:505] Connect] Connected to destination: 127.0.0.1:8118
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:37.312.965 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:73] Connect] Connected to the tcp server 127.0.0.1:8118 successfully.
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:37.312.978 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:178] Register] Start connecting business client.
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:37.312.992 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:441] Connect] Can not found link destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:37.313.092 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:485] Connect] Connection 21 source: 127.0.0.1:35370, destination: 127.0.0.1:8118
[WARNING] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:37.313.110 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:494] Connect] Waiting for the state of the connection to 127.0.0.1:8118 to be connected...Retry number: 2
[WARNING] DISTRIBUTED(618666,ffff2e265fa0,python3.9):2025-04-03-09:27:37.313.129 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:79] ConnectedEventHandler] Connection from 127.0.0.1:35370 to 127.0.0.1:8118 is successfully created. System errno: Success
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:37.380.581 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:505] Connect] Connected to destination: 127.0.0.1:8118
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:37.380.604 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:73] Connect] Connected to the tcp server 127.0.0.1:8118 successfully.
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:37.380.807 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:222] Register] The compute graph node: 7 has been registered successfully.
[WARNING] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:37.380.920 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:246] BuildCluster] Topology build timed out., retry(1/1200).
[INFO] DISTRIBUTED(618674,ffff29813fa0,python3.9):2025-04-03-09:27:37.380.977 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:270] Heartbeat] Interval of heartbeat lower and upper are 3 and 5
[INFO] DISTRIBUTED(618674,ffff29813fa0,python3.9):2025-04-03-09:27:37.381.002 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:274] Heartbeat] The heartbeat thread is started.
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:37.387.777 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:505] Connect] Connected to destination: 127.0.0.1:8118
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:37.387.800 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:73] Connect] Connected to the tcp server 127.0.0.1:8118 successfully.
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:37.388.012 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:222] Register] The compute graph node: 4 has been registered successfully.
[WARNING] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:37.388.133 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:246] BuildCluster] Topology build timed out., retry(1/1200).
[INFO] DISTRIBUTED(618662,ffff54ac7fa0,python3.9):2025-04-03-09:27:37.388.198 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:270] Heartbeat] Interval of heartbeat lower and upper are 3 and 5
[INFO] DISTRIBUTED(618662,ffff54ac7fa0,python3.9):2025-04-03-09:27:37.388.226 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:274] Heartbeat] The heartbeat thread is started.
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:37.406.552 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:505] Connect] Connected to destination: 127.0.0.1:8118
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:37.406.574 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:73] Connect] Connected to the tcp server 127.0.0.1:8118 successfully.
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:37.406.842 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:222] Register] The compute graph node: 6 has been registered successfully.
[WARNING] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:37.406.964 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:246] BuildCluster] Topology build timed out., retry(1/1200).
[INFO] DISTRIBUTED(618670,ffff4943cfa0,python3.9):2025-04-03-09:27:37.407.027 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:270] Heartbeat] Interval of heartbeat lower and upper are 3 and 5
[INFO] DISTRIBUTED(618670,ffff4943cfa0,python3.9):2025-04-03-09:27:37.407.056 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:274] Heartbeat] The heartbeat thread is started.
[WARNING] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:37.500.267 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:246] BuildCluster] Topology build timed out., retry(2/1200).
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:37.601.471 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:505] Connect] Connected to destination: 127.0.0.1:8118
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:37.601.499 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:73] Connect] Connected to the tcp server 127.0.0.1:8118 successfully.
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:37.601.690 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:222] Register] The compute graph node: 2 has been registered successfully.
[WARNING] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:37.601.816 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:246] BuildCluster] Topology build timed out., retry(1/1200).
[INFO] DISTRIBUTED(618654,ffff2cbabfa0,python3.9):2025-04-03-09:27:37.601.867 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:270] Heartbeat] Interval of heartbeat lower and upper are 3 and 5
[INFO] DISTRIBUTED(618654,ffff2cbabfa0,python3.9):2025-04-03-09:27:37.601.893 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:274] Heartbeat] The heartbeat thread is started.
[WARNING] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:37.699.101 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:246] BuildCluster] Topology build timed out., retry(3/1200).
[WARNING] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:37.768.197 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:246] BuildCluster] Topology build timed out., retry(2/1200).
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:37.813.183 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:505] Connect] Connected to destination: 127.0.0.1:8118
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:37.813.201 [mindspore/ccsrc/distributed/rpc/tcp/tcp_client.cc:73] Connect] Connected to the tcp server 127.0.0.1:8118 successfully.
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:37.813.400 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:222] Register] The compute graph node: 5 has been registered successfully.
[WARNING] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:37.813.599 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:246] BuildCluster] Topology build timed out., retry(1/1200).
[INFO] DISTRIBUTED(618666,ffff1fffefa0,python3.9):2025-04-03-09:27:37.813.656 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:270] Heartbeat] Interval of heartbeat lower and upper are 3 and 5
[INFO] DISTRIBUTED(618666,ffff1fffefa0,python3.9):2025-04-03-09:27:37.813.681 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:274] Heartbeat] The heartbeat thread is started.
[WARNING] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:37.881.008 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:246] BuildCluster] Topology build timed out., retry(2/1200).
[WARNING] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:37.888.172 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:246] BuildCluster] Topology build timed out., retry(2/1200).
[WARNING] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:37.907.045 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:246] BuildCluster] Topology build timed out., retry(2/1200).
[WARNING] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:38.000.379 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:246] BuildCluster] Topology build timed out., retry(3/1200).
[WARNING] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:38.101.904 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:246] BuildCluster] Topology build timed out., retry(2/1200).
[WARNING] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:38.199.181 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:246] BuildCluster] Topology build timed out., retry(4/1200).
[WARNING] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.268.300 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:246] BuildCluster] Topology build timed out., retry(3/1200).
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:38.313.690 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:247] BuildCluster] [PROF]BuildCluster costs 1501.72 msec.
[WARNING] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:38.313.723 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:249] BuildCluster] Cluster is successfully initialized.
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:38.313.738 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:342] PostProcess] Start post processing for computing graph nodes.
[WARNING] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:38.313.755 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:356] PostProcess] This node 5 rank id: 5
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:38.313.770 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:360] PostProcess] Client ip address in this cluster of this compute graph node is 127.0.0.1
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:38.313.794 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:371] PostProcess] Assigned for this worker port range is 9398 to 9653
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:38.313.815 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:253] BuildCluster] [PROF]PostBuildCluster costs 0.073 msec.
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:38.313.836 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:184] node_num] Number of role MS_WORKER is 8
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:38.313.855 [mindspore/ccsrc/distributed/init.cc:52] Initialize] [PROF]distributed_cluster_init costs 1501.98 msec.
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:38.313.875 [mindspore/ccsrc/distributed/collective/collective_manager.cc:175] Initialize] Start initializing collective communication for backend: Ascend...
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:38.313.967 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:48] MsCollectiveCommLib] Global group name of MindSpore collective communication library is mccl_world_group
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:38.313.985 [mindspore/ccsrc/distributed/collective/collective_manager.cc:577] InitHostCommlib] Start initializing communication library on host side...
[INFO] PS(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:38.314.007 [mindspore/ccsrc/ps/core/abstract_node.cc:1368] InitNodeNum] The worker num:8, the server num:0, the scheduler ip:127.0.0.1, the scheduler port:8118
[WARNING] PS(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:38.314.031 [mindspore/ccsrc/ps/core/file_configuration.cc:24] Initialize] The file: is not exist.
[INFO] PS(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:38.314.046 [mindspore/ccsrc/ps/core/file_configuration.cc:27] Initialize] Create directory for file: success.
[WARNING] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:38.314.060 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:33] Start] Failed to initialize the configuration for this mccl collective node.
[INFO] PS(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:38.315.738 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:170] Init] The max connection is:10000
[INFO] PS(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:38.315.757 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:179] Init] Initialize TcpServer with port range 9398 to 9653
[INFO] PS(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:38.315.891 [mindspore/ccsrc/ps/core/abstract_node.cc:1358] InitNodeInfo] The node role:WORKER is generate uuid is:fe30498e-6e69-4420-a4b2-acdb83854f66, the ip:127.0.0.1, the port:9398
[INFO] PS(618666,ffff1f7eefa0,python3.9):2025-04-03-09:27:38.315.919 [mindspore/ccsrc/ps/core/abstract_node.cc:1447] operator()] The worker node or server node start a tcp server!
[INFO] PS(618666,ffff1f7eefa0,python3.9):2025-04-03-09:27:38.315.942 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:217] Start] Start tcp server!
[INFO] PS(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:38.317.506 [mindspore/ccsrc/ps/core/communicator/tcp_client.cc:116] Init] SSL is disable.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:38.317.658 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:89] SynchronizeAddresses] The address of rank MCCL_COLLECTIVE_RANK_MS_WORKER_5 has been registered successfully.
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:38.317.679 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:184] node_num] Number of role MS_WORKER is 8
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:38.317.771 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:115] SynchronizeAddresses] Waiting for the address of rank MCCL_COLLECTIVE_RANK_MS_WORKER_0 to be registered, retry 19 times.
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:38.381.127 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:247] BuildCluster] [PROF]BuildCluster costs 2001.99 msec.
[WARNING] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:38.381.157 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:249] BuildCluster] Cluster is successfully initialized.
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:38.381.179 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:342] PostProcess] Start post processing for computing graph nodes.
[WARNING] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:38.381.197 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:356] PostProcess] This node 7 rank id: 7
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:38.381.214 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:360] PostProcess] Client ip address in this cluster of this compute graph node is 127.0.0.1
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:38.381.240 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:371] PostProcess] Assigned for this worker port range is 9910 to 10165
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:38.381.264 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:253] BuildCluster] [PROF]PostBuildCluster costs 0.082 msec.
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:38.381.304 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:184] node_num] Number of role MS_WORKER is 8
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:38.381.329 [mindspore/ccsrc/distributed/init.cc:52] Initialize] [PROF]distributed_cluster_init costs 2002.32 msec.
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:38.381.356 [mindspore/ccsrc/distributed/collective/collective_manager.cc:175] Initialize] Start initializing collective communication for backend: Ascend...
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:38.381.527 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:48] MsCollectiveCommLib] Global group name of MindSpore collective communication library is mccl_world_group
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:38.381.547 [mindspore/ccsrc/distributed/collective/collective_manager.cc:577] InitHostCommlib] Start initializing communication library on host side...
[INFO] PS(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:38.381.579 [mindspore/ccsrc/ps/core/abstract_node.cc:1368] InitNodeNum] The worker num:8, the server num:0, the scheduler ip:127.0.0.1, the scheduler port:8118
[WARNING] PS(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:38.381.625 [mindspore/ccsrc/ps/core/file_configuration.cc:24] Initialize] The file: is not exist.
[INFO] PS(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:38.381.644 [mindspore/ccsrc/ps/core/file_configuration.cc:27] Initialize] Create directory for file: success.
[WARNING] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:38.381.662 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:33] Start] Failed to initialize the configuration for this mccl collective node.
[INFO] PS(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:38.383.383 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:170] Init] The max connection is:10000
[INFO] PS(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:38.383.406 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:179] Init] Initialize TcpServer with port range 9910 to 10165
[INFO] PS(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:38.383.587 [mindspore/ccsrc/ps/core/abstract_node.cc:1358] InitNodeInfo] The node role:WORKER is generate uuid is:d2760fea-2d5e-46a0-89ae-836705dd6ea8, the ip:127.0.0.1, the port:9910
[INFO] PS(618674,ffff29003fa0,python3.9):2025-04-03-09:27:38.383.607 [mindspore/ccsrc/ps/core/abstract_node.cc:1447] operator()] The worker node or server node start a tcp server!
[INFO] PS(618674,ffff29003fa0,python3.9):2025-04-03-09:27:38.383.642 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:217] Start] Start tcp server!
[INFO] PS(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:38.385.236 [mindspore/ccsrc/ps/core/communicator/tcp_client.cc:116] Init] SSL is disable.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:38.385.483 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:89] SynchronizeAddresses] The address of rank MCCL_COLLECTIVE_RANK_MS_WORKER_7 has been registered successfully.
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:38.385.511 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:184] node_num] Number of role MS_WORKER is 8
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:38.385.637 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:115] SynchronizeAddresses] Waiting for the address of rank MCCL_COLLECTIVE_RANK_MS_WORKER_0 to be registered, retry 19 times.
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:38.388.278 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:247] BuildCluster] [PROF]BuildCluster costs 2001.7 msec.
[WARNING] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:38.388.306 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:249] BuildCluster] Cluster is successfully initialized.
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:38.388.329 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:342] PostProcess] Start post processing for computing graph nodes.
[WARNING] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:38.388.350 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:356] PostProcess] This node 4 rank id: 4
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:38.388.369 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:360] PostProcess] Client ip address in this cluster of this compute graph node is 127.0.0.1
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:38.388.397 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:371] PostProcess] Assigned for this worker port range is 9142 to 9397
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:38.388.420 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:253] BuildCluster] [PROF]PostBuildCluster costs 0.088 msec.
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:38.388.446 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:184] node_num] Number of role MS_WORKER is 8
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:38.388.470 [mindspore/ccsrc/distributed/init.cc:52] Initialize] [PROF]distributed_cluster_init costs 2002 msec.
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:38.388.495 [mindspore/ccsrc/distributed/collective/collective_manager.cc:175] Initialize] Start initializing collective communication for backend: Ascend...
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:38.388.658 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:48] MsCollectiveCommLib] Global group name of MindSpore collective communication library is mccl_world_group
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:38.388.679 [mindspore/ccsrc/distributed/collective/collective_manager.cc:577] InitHostCommlib] Start initializing communication library on host side...
[INFO] PS(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:38.388.709 [mindspore/ccsrc/ps/core/abstract_node.cc:1368] InitNodeNum] The worker num:8, the server num:0, the scheduler ip:127.0.0.1, the scheduler port:8118
[WARNING] PS(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:38.388.737 [mindspore/ccsrc/ps/core/file_configuration.cc:24] Initialize] The file: is not exist.
[INFO] PS(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:38.388.755 [mindspore/ccsrc/ps/core/file_configuration.cc:27] Initialize] Create directory for file: success.
[WARNING] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:38.388.774 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:33] Start] Failed to initialize the configuration for this mccl collective node.
[INFO] PS(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:38.390.442 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:170] Init] The max connection is:10000
[INFO] PS(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:38.390.464 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:179] Init] Initialize TcpServer with port range 9142 to 9397
[INFO] PS(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:38.390.696 [mindspore/ccsrc/ps/core/abstract_node.cc:1358] InitNodeInfo] The node role:WORKER is generate uuid is:962457c7-88ff-444c-ab91-2c2437c2dac7, the ip:127.0.0.1, the port:9142
[INFO] PS(618662,ffff3fffefa0,python3.9):2025-04-03-09:27:38.390.718 [mindspore/ccsrc/ps/core/abstract_node.cc:1447] operator()] The worker node or server node start a tcp server!
[INFO] PS(618662,ffff3fffefa0,python3.9):2025-04-03-09:27:38.390.753 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:217] Start] Start tcp server!
[INFO] PS(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:38.392.345 [mindspore/ccsrc/ps/core/communicator/tcp_client.cc:116] Init] SSL is disable.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:38.392.495 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:89] SynchronizeAddresses] The address of rank MCCL_COLLECTIVE_RANK_MS_WORKER_4 has been registered successfully.
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:38.392.523 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:184] node_num] Number of role MS_WORKER is 8
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:38.392.646 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:115] SynchronizeAddresses] Waiting for the address of rank MCCL_COLLECTIVE_RANK_MS_WORKER_0 to be registered, retry 19 times.
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:38.407.163 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:247] BuildCluster] [PROF]BuildCluster costs 2001.89 msec.
[WARNING] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:38.407.191 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:249] BuildCluster] Cluster is successfully initialized.
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:38.407.212 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:342] PostProcess] Start post processing for computing graph nodes.
[WARNING] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:38.407.231 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:356] PostProcess] This node 6 rank id: 6
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:38.407.249 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:360] PostProcess] Client ip address in this cluster of this compute graph node is 127.0.0.1
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:38.407.278 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:371] PostProcess] Assigned for this worker port range is 9654 to 9909
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:38.407.303 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:253] BuildCluster] [PROF]PostBuildCluster costs 0.087 msec.
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:38.407.331 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:184] node_num] Number of role MS_WORKER is 8
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:38.407.356 [mindspore/ccsrc/distributed/init.cc:52] Initialize] [PROF]distributed_cluster_init costs 2002.22 msec.
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:38.407.381 [mindspore/ccsrc/distributed/collective/collective_manager.cc:175] Initialize] Start initializing collective communication for backend: Ascend...
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:38.407.542 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:48] MsCollectiveCommLib] Global group name of MindSpore collective communication library is mccl_world_group
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:38.407.563 [mindspore/ccsrc/distributed/collective/collective_manager.cc:577] InitHostCommlib] Start initializing communication library on host side...
[INFO] PS(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:38.407.592 [mindspore/ccsrc/ps/core/abstract_node.cc:1368] InitNodeNum] The worker num:8, the server num:0, the scheduler ip:127.0.0.1, the scheduler port:8118
[WARNING] PS(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:38.407.631 [mindspore/ccsrc/ps/core/file_configuration.cc:24] Initialize] The file: is not exist.
[INFO] PS(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:38.407.651 [mindspore/ccsrc/ps/core/file_configuration.cc:27] Initialize] Create directory for file: success.
[WARNING] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:38.407.669 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:33] Start] Failed to initialize the configuration for this mccl collective node.
[INFO] PS(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:38.409.424 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:170] Init] The max connection is:10000
[INFO] PS(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:38.409.448 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:179] Init] Initialize TcpServer with port range 9654 to 9909
[INFO] PS(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:38.409.613 [mindspore/ccsrc/ps/core/abstract_node.cc:1358] InitNodeInfo] The node role:WORKER is generate uuid is:f0d36792-1854-49bf-8038-584ab55122c2, the ip:127.0.0.1, the port:9654
[INFO] PS(618670,ffff48c2cfa0,python3.9):2025-04-03-09:27:38.409.639 [mindspore/ccsrc/ps/core/abstract_node.cc:1447] operator()] The worker node or server node start a tcp server!
[INFO] PS(618670,ffff48c2cfa0,python3.9):2025-04-03-09:27:38.409.677 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:217] Start] Start tcp server!
[INFO] PS(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:38.411.261 [mindspore/ccsrc/ps/core/communicator/tcp_client.cc:116] Init] SSL is disable.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:38.411.481 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:89] SynchronizeAddresses] The address of rank MCCL_COLLECTIVE_RANK_MS_WORKER_6 has been registered successfully.
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:38.411.507 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:184] node_num] Number of role MS_WORKER is 8
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:38.411.631 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:115] SynchronizeAddresses] Waiting for the address of rank MCCL_COLLECTIVE_RANK_MS_WORKER_0 to be registered, retry 19 times.
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:38.500.483 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:247] BuildCluster] [PROF]BuildCluster costs 2502.24 msec.
[WARNING] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:38.500.510 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:249] BuildCluster] Cluster is successfully initialized.
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:38.500.529 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:342] PostProcess] Start post processing for computing graph nodes.
[WARNING] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:38.500.550 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:356] PostProcess] This node 1 rank id: 1
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:38.500.569 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:360] PostProcess] Client ip address in this cluster of this compute graph node is 127.0.0.1
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:38.500.614 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:371] PostProcess] Assigned for this worker port range is 8374 to 8629
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:38.500.640 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:253] BuildCluster] [PROF]PostBuildCluster costs 0.108 msec.
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:38.500.670 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:184] node_num] Number of role MS_WORKER is 8
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:38.500.696 [mindspore/ccsrc/distributed/init.cc:52] Initialize] [PROF]distributed_cluster_init costs 2502.56 msec.
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:38.500.721 [mindspore/ccsrc/distributed/collective/collective_manager.cc:175] Initialize] Start initializing collective communication for backend: Ascend...
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:38.500.862 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:48] MsCollectiveCommLib] Global group name of MindSpore collective communication library is mccl_world_group
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:38.500.884 [mindspore/ccsrc/distributed/collective/collective_manager.cc:577] InitHostCommlib] Start initializing communication library on host side...
[INFO] PS(618650,ffffbf562de0,python3.9):2025-04-03-09:27:38.500.929 [mindspore/ccsrc/ps/core/abstract_node.cc:1368] InitNodeNum] The worker num:8, the server num:0, the scheduler ip:127.0.0.1, the scheduler port:8118
[WARNING] PS(618650,ffffbf562de0,python3.9):2025-04-03-09:27:38.500.961 [mindspore/ccsrc/ps/core/file_configuration.cc:24] Initialize] The file: is not exist.
[INFO] PS(618650,ffffbf562de0,python3.9):2025-04-03-09:27:38.500.981 [mindspore/ccsrc/ps/core/file_configuration.cc:27] Initialize] Create directory for file: success.
[WARNING] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:38.501.000 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:33] Start] Failed to initialize the configuration for this mccl collective node.
[INFO] PS(618650,ffffbf562de0,python3.9):2025-04-03-09:27:38.502.733 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:170] Init] The max connection is:10000
[INFO] PS(618650,ffffbf562de0,python3.9):2025-04-03-09:27:38.502.757 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:179] Init] Initialize TcpServer with port range 8374 to 8629
[INFO] PS(618650,ffffbf562de0,python3.9):2025-04-03-09:27:38.502.962 [mindspore/ccsrc/ps/core/abstract_node.cc:1358] InitNodeInfo] The node role:WORKER is generate uuid is:e226cf52-fbba-4bb3-99cb-95b82c78a8f1, the ip:127.0.0.1, the port:8374
[INFO] PS(618650,ffff5cbc9fa0,python3.9):2025-04-03-09:27:38.502.982 [mindspore/ccsrc/ps/core/abstract_node.cc:1447] operator()] The worker node or server node start a tcp server!
[INFO] PS(618650,ffff5cbc9fa0,python3.9):2025-04-03-09:27:38.503.016 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:217] Start] Start tcp server!
[INFO] PS(618650,ffffbf562de0,python3.9):2025-04-03-09:27:38.504.656 [mindspore/ccsrc/ps/core/communicator/tcp_client.cc:116] Init] SSL is disable.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:38.504.917 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:89] SynchronizeAddresses] The address of rank MCCL_COLLECTIVE_RANK_MS_WORKER_1 has been registered successfully.
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:38.504.946 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:184] node_num] Number of role MS_WORKER is 8
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:38.505.066 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:115] SynchronizeAddresses] Waiting for the address of rank MCCL_COLLECTIVE_RANK_MS_WORKER_0 to be registered, retry 19 times.
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:38.602.017 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:247] BuildCluster] [PROF]BuildCluster costs 2001.81 msec.
[WARNING] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:38.602.046 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:249] BuildCluster] Cluster is successfully initialized.
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:38.602.062 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:342] PostProcess] Start post processing for computing graph nodes.
[WARNING] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:38.602.081 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:356] PostProcess] This node 2 rank id: 2
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:38.602.097 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:360] PostProcess] Client ip address in this cluster of this compute graph node is 127.0.0.1
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:38.602.121 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:371] PostProcess] Assigned for this worker port range is 8630 to 8885
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:38.602.145 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:253] BuildCluster] [PROF]PostBuildCluster costs 0.079 msec.
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:38.602.174 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:184] node_num] Number of role MS_WORKER is 8
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:38.602.199 [mindspore/ccsrc/distributed/init.cc:52] Initialize] [PROF]distributed_cluster_init costs 2002.12 msec.
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:38.602.222 [mindspore/ccsrc/distributed/collective/collective_manager.cc:175] Initialize] Start initializing collective communication for backend: Ascend...
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:38.602.367 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:48] MsCollectiveCommLib] Global group name of MindSpore collective communication library is mccl_world_group
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:38.602.388 [mindspore/ccsrc/distributed/collective/collective_manager.cc:577] InitHostCommlib] Start initializing communication library on host side...
[INFO] PS(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:38.602.425 [mindspore/ccsrc/ps/core/abstract_node.cc:1368] InitNodeNum] The worker num:8, the server num:0, the scheduler ip:127.0.0.1, the scheduler port:8118
[WARNING] PS(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:38.602.464 [mindspore/ccsrc/ps/core/file_configuration.cc:24] Initialize] The file: is not exist.
[INFO] PS(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:38.602.483 [mindspore/ccsrc/ps/core/file_configuration.cc:27] Initialize] Create directory for file: success.
[WARNING] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:38.602.503 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:33] Start] Failed to initialize the configuration for this mccl collective node.
[INFO] PS(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:38.604.191 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:170] Init] The max connection is:10000
[INFO] PS(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:38.604.216 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:179] Init] Initialize TcpServer with port range 8630 to 8885
[INFO] PS(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:38.604.499 [mindspore/ccsrc/ps/core/abstract_node.cc:1358] InitNodeInfo] The node role:WORKER is generate uuid is:fdb84a42-c87b-44a5-86f5-2b780e902f72, the ip:127.0.0.1, the port:8630
[INFO] PS(618654,ffff17ffefa0,python3.9):2025-04-03-09:27:38.604.533 [mindspore/ccsrc/ps/core/abstract_node.cc:1447] operator()] The worker node or server node start a tcp server!
[INFO] PS(618654,ffff17ffefa0,python3.9):2025-04-03-09:27:38.604.580 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:217] Start] Start tcp server!
[INFO] PS(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:38.606.141 [mindspore/ccsrc/ps/core/communicator/tcp_client.cc:116] Init] SSL is disable.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:38.606.288 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:89] SynchronizeAddresses] The address of rank MCCL_COLLECTIVE_RANK_MS_WORKER_2 has been registered successfully.
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:38.606.314 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:184] node_num] Number of role MS_WORKER is 8
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:38.606.465 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:115] SynchronizeAddresses] Waiting for the address of rank MCCL_COLLECTIVE_RANK_MS_WORKER_0 to be registered, retry 19 times.
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:38.699.273 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:247] BuildCluster] [PROF]BuildCluster costs 3002.52 msec.
[WARNING] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:38.699.299 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:249] BuildCluster] Cluster is successfully initialized.
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:38.699.313 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:342] PostProcess] Start post processing for computing graph nodes.
[WARNING] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:38.699.330 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:356] PostProcess] This node 0 rank id: 0
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:38.699.345 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:360] PostProcess] Client ip address in this cluster of this compute graph node is 127.0.0.1
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:38.699.370 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:371] PostProcess] Assigned for this worker port range is 8118 to 8373
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:38.699.390 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:253] BuildCluster] [PROF]PostBuildCluster costs 0.073 msec.
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:38.699.412 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:184] node_num] Number of role MS_WORKER is 8
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:38.699.432 [mindspore/ccsrc/distributed/init.cc:52] Initialize] [PROF]distributed_cluster_init costs 3002.78 msec.
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:38.699.452 [mindspore/ccsrc/distributed/collective/collective_manager.cc:175] Initialize] Start initializing collective communication for backend: Ascend...
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:38.699.574 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:48] MsCollectiveCommLib] Global group name of MindSpore collective communication library is mccl_world_group
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:38.699.591 [mindspore/ccsrc/distributed/collective/collective_manager.cc:577] InitHostCommlib] Start initializing communication library on host side...
[INFO] PS(618646,ffff85d12de0,python3.9):2025-04-03-09:27:38.699.625 [mindspore/ccsrc/ps/core/abstract_node.cc:1368] InitNodeNum] The worker num:8, the server num:0, the scheduler ip:127.0.0.1, the scheduler port:8118
[WARNING] PS(618646,ffff85d12de0,python3.9):2025-04-03-09:27:38.699.648 [mindspore/ccsrc/ps/core/file_configuration.cc:24] Initialize] The file: is not exist.
[INFO] PS(618646,ffff85d12de0,python3.9):2025-04-03-09:27:38.699.662 [mindspore/ccsrc/ps/core/file_configuration.cc:27] Initialize] Create directory for file: success.
[WARNING] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:38.699.676 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:33] Start] Failed to initialize the configuration for this mccl collective node.
[INFO] PS(618646,ffff85d12de0,python3.9):2025-04-03-09:27:38.701.371 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:170] Init] The max connection is:10000
[INFO] PS(618646,ffff85d12de0,python3.9):2025-04-03-09:27:38.701.393 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:179] Init] Initialize TcpServer with port range 8118 to 8373
[WARNING] PS(618646,ffff85d12de0,python3.9):2025-04-03-09:27:38.701.453 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:188] Init] The port 8119 is already in use. So increase port to: 8119
[INFO] PS(618646,ffff85d12de0,python3.9):2025-04-03-09:27:38.701.605 [mindspore/ccsrc/ps/core/abstract_node.cc:1358] InitNodeInfo] The node role:WORKER is generate uuid is:a3f70c89-be54-4cc0-9f62-e64b88cb562d, the ip:127.0.0.1, the port:8119
[INFO] PS(618646,ffff16fdefa0,python3.9):2025-04-03-09:27:38.701.638 [mindspore/ccsrc/ps/core/abstract_node.cc:1447] operator()] The worker node or server node start a tcp server!
[INFO] PS(618646,ffff16fdefa0,python3.9):2025-04-03-09:27:38.701.666 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:217] Start] Start tcp server!
[INFO] PS(618646,ffff85d12de0,python3.9):2025-04-03-09:27:38.703.231 [mindspore/ccsrc/ps/core/communicator/tcp_client.cc:116] Init] SSL is disable.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:38.703.371 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:89] SynchronizeAddresses] The address of rank MCCL_COLLECTIVE_RANK_MS_WORKER_0 has been registered successfully.
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:38.703.394 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:184] node_num] Number of role MS_WORKER is 8
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:38.703.753 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:115] SynchronizeAddresses] Waiting for the address of rank MCCL_COLLECTIVE_RANK_MS_WORKER_3 to be registered, retry 19 times.
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.768.406 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:247] BuildCluster] [PROF]BuildCluster costs 2502.34 msec.
[WARNING] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.768.441 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:249] BuildCluster] Cluster is successfully initialized.
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.768.460 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:342] PostProcess] Start post processing for computing graph nodes.
[WARNING] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.768.480 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:356] PostProcess] This node 3 rank id: 3
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.768.499 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:360] PostProcess] Client ip address in this cluster of this compute graph node is 127.0.0.1
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.768.518 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:371] PostProcess] Assigned for this worker port range is 8886 to 9141
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.768.543 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:253] BuildCluster] [PROF]PostBuildCluster costs 0.08 msec.
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.768.570 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:184] node_num] Number of role MS_WORKER is 8
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.768.594 [mindspore/ccsrc/distributed/init.cc:52] Initialize] [PROF]distributed_cluster_init costs 2502.66 msec.
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.768.619 [mindspore/ccsrc/distributed/collective/collective_manager.cc:175] Initialize] Start initializing collective communication for backend: Ascend...
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.768.783 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:48] MsCollectiveCommLib] Global group name of MindSpore collective communication library is mccl_world_group
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.768.805 [mindspore/ccsrc/distributed/collective/collective_manager.cc:577] InitHostCommlib] Start initializing communication library on host side...
[INFO] PS(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.768.834 [mindspore/ccsrc/ps/core/abstract_node.cc:1368] InitNodeNum] The worker num:8, the server num:0, the scheduler ip:127.0.0.1, the scheduler port:8118
[WARNING] PS(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.768.865 [mindspore/ccsrc/ps/core/file_configuration.cc:24] Initialize] The file: is not exist.
[INFO] PS(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.768.885 [mindspore/ccsrc/ps/core/file_configuration.cc:27] Initialize] Create directory for file: success.
[WARNING] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.768.901 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:33] Start] Failed to initialize the configuration for this mccl collective node.
[INFO] PS(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.770.588 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:170] Init] The max connection is:10000
[INFO] PS(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.770.610 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:179] Init] Initialize TcpServer with port range 8886 to 9141
[INFO] PS(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.770.781 [mindspore/ccsrc/ps/core/abstract_node.cc:1358] InitNodeInfo] The node role:WORKER is generate uuid is:36cff3a8-31cf-48aa-87ea-9588efd3b541, the ip:127.0.0.1, the port:8886
[INFO] PS(618658,ffff4dfbefa0,python3.9):2025-04-03-09:27:38.770.814 [mindspore/ccsrc/ps/core/abstract_node.cc:1447] operator()] The worker node or server node start a tcp server!
[INFO] PS(618658,ffff4dfbefa0,python3.9):2025-04-03-09:27:38.770.844 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:217] Start] Start tcp server!
[INFO] PS(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.772.447 [mindspore/ccsrc/ps/core/communicator/tcp_client.cc:116] Init] SSL is disable.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.772.601 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:89] SynchronizeAddresses] The address of rank MCCL_COLLECTIVE_RANK_MS_WORKER_3 has been registered successfully.
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.772.629 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:184] node_num] Number of role MS_WORKER is 8
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.773.155 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:49] Start] The cpu collective rank 3 has been started successfully.
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.773.182 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:184] node_num] Number of role MS_WORKER is 8
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.773.226 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:81] Initialize] Query retry count is 400
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.773.248 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:89] Initialize] Interval of retry allgather hostname lower and upper are 1 and 2
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.773.283 [mindspore/ccsrc/distributed/collective/collective_manager.cc:597] InitHostCommlib] Communication library on host side is successfully initialized. Global rank id: 3, global rank size: 8
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.773.309 [mindspore/ccsrc/distributed/collective/collective_manager.cc:198] Initialize] [PROF]InitHostCommlib costs 4.662 msec.
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.773.331 [mindspore/ccsrc/distributed/collective/collective_manager.cc:640] AssignLocalRank] Host name for rank 3 is devserver-c233-2
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.773.498 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:564] GetHostNames] Worker gets host names {"hostnames":["devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2"]}
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.773.572 [mindspore/ccsrc/distributed/collective/collective_manager.cc:661] AssignLocalRank] Successfully get all nodes' hostname.
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.773.597 [mindspore/ccsrc/distributed/collective/collective_manager.cc:678] AssignLocalRank] The local rank id assigned for this process is 3
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.773.616 [mindspore/ccsrc/distributed/collective/collective_manager.cc:679] AssignLocalRank] The env 'DEVICE_ID' assigned for this process is: 3
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.773.640 [mindspore/ccsrc/distributed/collective/collective_manager.cc:697] AssignLocalRank] The device_id of ms_context is set to local rank id [3].
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.773.667 [mindspore/ccsrc/distributed/collective/collective_manager.cc:206] Initialize] [PROF]AssignLocalRank costs 0.333 msec.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.773.751 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:236] Initialize] Start initializing device context.
[INFO] CORE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.773.789 [mindspore/core/utils/ms_context.cc:463] PrintJitLevelAndExecMode] The jit_level is: O0, and enable kernelbykernel executor in the PYNATIVE mode.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.773.828 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:250] Initialize] The current overflow detection mode is INFNAN.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:38.773.880 [device.cpp:365]618658 aclrtSetDeviceSatMode: start to execute aclrtSetDeviceSatMode, mode is 1
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:38.774.028 [api_impl.cc:249] 618658 CurrentContext: current ctx is nullptr!
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.774.051 [api_impl.cc:6795] 618658 SetDeviceSatMode: Set saturation mode to 1 for runtime process.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:38.774.068 [device.cpp:371]618658 aclrtSetDeviceSatMode: successfully execute aclrtSetDeviceSatMode, mode is 1
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:38.774.144 [callback.cpp:37]618658 aclrtSetExceptionInfoCallback: start to execute aclrtSetExceptionInfoCallback.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:38.774.190 [callback.cpp:44]618658 aclrtSetExceptionInfoCallback: successfully execute aclrtSetExceptionInfoCallback
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.774.219 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:235] Init] Start inititializing kernel runtime(SetDevice & CreateDefaultStream & MemoryManagerInitialization etc).
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:38.774.248 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:48] InitDevice] Enter SetRtDevice, current initialize device number:0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:38.774.290 [device.cpp:143]618658 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.774.401 [npu_driver.cc:124] 618658 NpuDriver: Run mode=1 [0:offline, 1:online], env type=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.774.432 [api_impl.cc:2999] 618658 SetDevice: device_id=3, deviceMode=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.774.475 [runtime.cc:3602] 618658 DeviceRetain: [dlog api] DlogReportStart exist.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.774.722 [hdc_core.c:1982][ascend][curpid:618658,618658][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4139; pid=618658)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.774.856 [runtime.cc:3609] 618658 DeviceRetain: [dlog api] AtraceReportStart exist.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:38.774.909 [atrace_client_communication.c:103](tid:618658) send [hello] msg.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:38.774.930 [atrace_client_communication.c:63](tid:618658) send msg by adx[begin], resultLen=1024 bytes.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.775.047 [hdc_core.c:1982][ascend][curpid:618658,618658][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4140; pid=618658)
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:38.775.067 [hdc_api.cpp:671][tid:618658] connect succ, peer_node: 0, peer_devid: 3
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.778.493 [hdc_client.c:417][ascend][curpid:618658,618658][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4140)
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:38.778.534 [atrace_client_communication.c:65](tid:618658) send msg by adx[finish], ret=0.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:38.778.554 [atrace_client_communication.c:97](tid:618658) msgType=1, magic=49959, version=1.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:38.778.569 [atrace_client_communication.c:135](tid:618658) send [hello] msg success.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:38.778.658 [atrace_client_core.c:160](tid:618658) start to receive device[3] trace log.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.778.700 [runtime.cc:5239] 618658 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.778.732 [runtime.cc:2855] 618658 startAicpuExecutor: TsdOpen devId=3, device mode=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.778.748 [runtime.cc:5239] 618658 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.778.801 [client_manager.cpp:160][GetPlatformInfo][tid:618658] [TsdClient] mode[1] chipType[5]
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.778.799 [hdc_core.c:1982][ascend][curpid:618658,618771][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4141; pid=618658)
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:38.778.836 [hdc_api.cpp:671][tid:618771] connect succ, peer_node: 0, peer_devid: 3
[WARNING] TDT(618658,python3.9):2025-04-03-09:27:38.778.843 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618658] Get env[ASCEND_RT_VISIBLE_DEVICES] failed
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.778.862 [client_manager.cpp:582][GetVisibleDevices][tid:618658] [TsdClient] Get env ASCEND_RT_VISIBLE_DEVICES [].
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.778.879 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618658] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.778.896 [client_manager.cpp:125][GetInstance][tid:618658] [ClientManager] GetInstance, deviceId[3], g_runningMode[0], begin saving instance
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.778.936 [client_manager.cpp:435][IsHostEnvironment][tid:618658] [TsdClient] logicDeviceId is [3], hostaicpunum[0]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.778.955 [client_manager.cpp:464][GetClientRunMode][tid:618658] runningMode:0
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.778.967 [client_manager.cpp:127][GetInstance][tid:618658] [ClientManager] Current mode:1
[WARNING] TDT(618658,python3.9):2025-04-03-09:27:38.778.991 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618658] Get env[AICPU_PROFILING_MODE] failed
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.779.007 [client_manager.cpp:347][GetProfilingMode][tid:618658] Get AICPU_PROFILING_MODE[]
[WARNING] TDT(618658,python3.9):2025-04-03-09:27:38.779.040 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618658] Get env[ASCEND_MODULE_LOG_LEVEL] failed
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.779.057 [process_mode_base.cpp:149][GetLogLevel][tid:618658] [TsdClient] get ASCEND_GLOBAL_LOG_LEVEL [1] ASCEND_GLOBAL_EVENT_ENABLE [0] ASCEND_MODULE_LOG_LEVEL []
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:38.779.073 [atrace_client_communication.c:177](tid:618771) send [start] msg.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:38.779.122 [atrace_client_communication.c:189](tid:618771) send [start] msg success.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.779.156 [process_mode_base.cpp:161][GetLogLevel][tid:618658] [TsdClient] Get Log Level[001]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.779.176 [process_mode_manager.cpp:71][OpenProcess][tid:618658] [ProcessModeManager] enter into open process deviceId[3] rankSize[0]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.779.194 [process_mode_manager.cpp:615][CheckNeedToOpen][tid:618658] [TsdClient] get open para startCp[1] startHccp[0] (0:false 1:true)
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.779.262 [client_manager.cpp:261][CheckPackageExists][tid:618658] [TsdClient] check file[.], deviceId[3]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.779.338 [client_manager.cpp:261][CheckPackageExists][tid:618658] [TsdClient] check file[scene.info], deviceId[3]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.779.404 [client_manager.cpp:261][CheckPackageExists][tid:618658] [TsdClient] check file[Ascend-aicpu_syskernels.tar.gz], deviceId[3]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.779.490 [client_manager.cpp:264][CheckPackageExists][tid:618658] [TsdClient] find aicpu package[Ascend-aicpu_syskernels.tar.gz] in path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], deviceId[3]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.779.519 [client_manager.cpp:261][CheckPackageExists][tid:618658] [TsdClient] check file[ascend_install.info], deviceId[3]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.779.581 [client_manager.cpp:261][CheckPackageExists][tid:618658] [TsdClient] check file[version.info], deviceId[3]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.779.643 [client_manager.cpp:261][CheckPackageExists][tid:618658] [TsdClient] check file[..], deviceId[3]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.779.706 [client_manager.cpp:261][CheckPackageExists][tid:618658] [TsdClient] check file[Ascend-aicpu_extend_syskernels.tar.gz], deviceId[3]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.779.838 [client_manager.cpp:268][CheckPackageExists][tid:618658] [TsdClient] find extend package[Ascend-aicpu_extend_syskernels.tar.gz] in path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], deviceId[3]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.779.856 [client_manager.cpp:283][CheckPackageExists][tid:618658] [TsdClient][deviceId=3] set extend package path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], name[Ascend-aicpu_extend_syskernels.tar.gz]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.779.871 [client_manager.cpp:286][CheckPackageExists][tid:618658] [TsdClient][deviceId=3] set aicpu package path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], name[Ascend-aicpu_syskernels.tar.gz]
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.779.940 [devdrv_hccl.c:103][ascend][curpid:618658,618658][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618658)
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.779.959 [process_mode_manager.cpp:396][InitTsdClient][tid:618658] [TsdClient][deviceId=3] get process sign success, procPid[618658]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.779.974 [process_mode_manager.cpp:403][InitTsdClient][tid:618658] [TsdClient] deviceId[3] begin to init hdc client
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.780.014 [hdc_common.cpp:67][InitMsgSize][tid:618658] HdcCommon::InitMsgSize Start
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.780.032 [hdc_common.cpp:80][InitMsgSize][tid:618658] msgMaxSize_ = 524224 bytes, msgShortHeadDataMaxSize_ = 524212 bytes, msgLongHeadDataMaxSize_ = 524200 bytes
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.780.047 [hdc_client.cpp:184][CreateHdcSession][tid:618658] HdcClient::CreateHdcSession Start
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.780.137 [hdc_client.cpp:208][CreateHdcSession][tid:618658] [HdcClient] deviceId: 3 connect session
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.780.179 [hdc_core.c:1982][ascend][curpid:618658,618658][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4142; pid=618658)
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.780.202 [hdc_client.cpp:219][CreateHdcSession][tid:618658] [HdcClient] drvHdcSetSessionReference success
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.780.217 [hdc_client.cpp:230][CreateHdcSession][tid:618658] [HdcClient] deviceId: 3 connect session and drvHdcSetSessionReference success, sessionId=1
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.780.239 [version_verify.cpp:36][SetVersionInfo][tid:618658] VersionVerify: send client version to server
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.780.292 [version_verify.cpp:52][SetVersionInfo][tid:618658] send feature_info:{msg_type:35, features:{check before send aicpu package}}
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.780.310 [version_verify.cpp:52][SetVersionInfo][tid:618658] send feature_info:{msg_type:37, features:{check before send open qs message}}
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.780.324 [version_verify.cpp:52][SetVersionInfo][tid:618658] send feature_info:{msg_type:64, features:{get check code retry}}
[WARNING] TDT(618658,python3.9):2025-04-03-09:27:38.780.369 [internal_api.cpp:101][GetScheduleEnv][tid:618658] Get env[DATAMASTER_RUN_MODE] failed
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.780.728 [version_verify.cpp:68][PeerVersionCheck][tid:618658] VersionVerify: Check client version info, server[1230], client[1230]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.780.762 [version_verify.cpp:89][ParseVersionInfo][tid:618658] VersionVerify: pass client version info success
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.780.776 [hdc_client.cpp:275][CheckHdcConnection][tid:618658] Service[2] create hdc success
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.780.798 [version_verify.cpp:122][SpecialFeatureCheck][tid:618658] VersionVerify: new type[35], supported
[WARNING] TDT(618658,python3.9):2025-04-03-09:27:38.780.817 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618658] Get env[ASAN_RUN_MODE] failed
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.780.852 [process_mode_manager.cpp:627][GetDeviceCheckCodeOnce][tid:618658] [TsdClient][deviceId=3] [sessionId=1] wait package info respond
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.780.870 [hdc_client.cpp:154][TsdRecvData][tid:618658] recv timeout is:150000 ms
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.781.877 [process_mode_msg_parse.cpp:148][PackageInfoMsgProc][tid:618658] [PackageInfoMsgProc] [sessionID=1]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.781.896 [process_mode_msg_parse.cpp:151][PackageInfoMsgProc][tid:618658] [PackageInfoMsgProc] [sessionID=1] deviceId[3], checkCode[56684994]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.781.910 [hdc_client.cpp:172][TsdRecvData][tid:618658] [deviceId=3] the Tsd recv data already
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.781.926 [version_verify.cpp:122][SpecialFeatureCheck][tid:618658] VersionVerify: new type[64], supported
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.781.942 [hdc_client.cpp:411][Destroy][tid:618658] enter HdcClient::Destroy() function
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.781.957 [hdc_client.c:417][ascend][curpid:618658,618658][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4142)
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.781.987 [hdc_client.cpp:394][DestroyClient][tid:618658] begin drvHdcClientDestroy
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.782.005 [hdc_client.cpp:399][DestroyClient][tid:618658] end drvHdcClientDestroy
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.782.019 [hdc_client.cpp:377][ClearClientPtr][tid:618658] begin HdcClient::ClearClientPtr
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.782.035 [hdc_client.cpp:385][ClearClientPtr][tid:618658] end HdcClient::ClearClientPtr
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.782.046 [hdc_client.cpp:418][Destroy][tid:618658] end HdcClient::Destroy() function
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.782.082 [process_mode_manager.cpp:371][SendAICPUPackage][tid:618658] [TsdClient]the checksum of host package[56684994] is same to device[56684994], skip send package.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.782.103 [process_mode_manager.cpp:1870][SendExtendPackage][tid:618658] [TsdClient]the checksum of host extend package[9658754] is same to device[9658754], skip send package.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.782.124 [devdrv_hccl.c:103][ascend][curpid:618658,618658][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618658)
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.782.138 [process_mode_manager.cpp:396][InitTsdClient][tid:618658] [TsdClient][deviceId=3] get process sign success, procPid[618658]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.782.153 [process_mode_manager.cpp:403][InitTsdClient][tid:618658] [TsdClient] deviceId[3] begin to init hdc client
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.782.171 [hdc_common.cpp:67][InitMsgSize][tid:618658] HdcCommon::InitMsgSize Start
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.782.188 [hdc_common.cpp:80][InitMsgSize][tid:618658] msgMaxSize_ = 524224 bytes, msgShortHeadDataMaxSize_ = 524212 bytes, msgLongHeadDataMaxSize_ = 524200 bytes
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.782.204 [hdc_client.cpp:184][CreateHdcSession][tid:618658] HdcClient::CreateHdcSession Start
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.782.292 [hdc_client.cpp:208][CreateHdcSession][tid:618658] [HdcClient] deviceId: 3 connect session
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.782.324 [hdc_core.c:1982][ascend][curpid:618658,618658][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4143; pid=618658)
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.782.342 [hdc_client.cpp:219][CreateHdcSession][tid:618658] [HdcClient] drvHdcSetSessionReference success
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.782.356 [hdc_client.cpp:230][CreateHdcSession][tid:618658] [HdcClient] deviceId: 3 connect session and drvHdcSetSessionReference success, sessionId=1
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.782.373 [version_verify.cpp:36][SetVersionInfo][tid:618658] VersionVerify: send client version to server
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.782.386 [version_verify.cpp:52][SetVersionInfo][tid:618658] send feature_info:{msg_type:35, features:{check before send aicpu package}}
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.782.400 [version_verify.cpp:52][SetVersionInfo][tid:618658] send feature_info:{msg_type:37, features:{check before send open qs message}}
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.782.416 [version_verify.cpp:52][SetVersionInfo][tid:618658] send feature_info:{msg_type:64, features:{get check code retry}}
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.782.652 [version_verify.cpp:68][PeerVersionCheck][tid:618658] VersionVerify: Check client version info, server[1230], client[1230]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.782.673 [version_verify.cpp:89][ParseVersionInfo][tid:618658] VersionVerify: pass client version info success
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.782.687 [hdc_client.cpp:275][CheckHdcConnection][tid:618658] Service[2] create hdc success
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.782.707 [process_mode_manager.cpp:458][ConstructOpenMsg][tid:618658] [TsdClient] tsd get process sign successfully, procpid[618658] signSize[48]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.782.728 [version_verify.cpp:114][SpecialFeatureCheck][tid:618658] VersionVerify: previous type[6], supported
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.782.758 [process_mode_manager.cpp:88][OpenProcess][tid:618658] [ProcessModeManager] deviceId[3] sessionId[1] rankSize[0], wait sub process start respond
[WARNING] TDT(618658,python3.9):2025-04-03-09:27:38.782.777 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618658] Get env[ASAN_RUN_MODE] failed
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.782.789 [hdc_client.cpp:154][TsdRecvData][tid:618658] recv timeout is:150000 ms
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.981.588 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618658] [ServerToClientMsgProc] [sessionID=1]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.981.615 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618658] [TsdClient] DeviceMsgProc recvMsg realDeviceId[3] msgType[8] localDevId[3] rspCode[0]heterogeneousSubPid[0], tsdSupportLevel_[63]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.981.638 [hdc_client.cpp:172][TsdRecvData][tid:618658] [deviceId=3] the Tsd recv data already
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.981.670 [devmm_svm.c:132][ascend][curpid:618658,618658][drv][devmm][devmm_setup_device]DrvMemDeviceOpen. (devid=3)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.983.792 [devmm_virt_interface.c:450][ascend][curpid:618658,618658][drv][devmm][devmm_ioctl_init_process]Init_process details. (hostpid=618658)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.984.104 [drv_log_user.c:623][ascend][curpid:618658,618658][drv][devmm][share_log_read_in_single_module]Setup device succeeded. (logical_devid=3; devid=3; vfid=0; hostpid=618658; devpid=30107)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.984.130 [devmm_svm.c:122][ascend][curpid:618658,618658][drv][devmm][devmm_set_device_info]Device info. (devid=3; dvpp_size=17179869184; support_bar_mem=1; support_dev_read_only=1; support_dev_mem_map_host=1; support_bar_huge_mem=1; is_alloced_by_malloc=0; host_rw_dev_ro=1; double_pgtable_offset=17592186044416; is_support_host_pin_pre_register=0; is_support_host_mem_pool=0)
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.984.421 [stub_process_mode_nowin.cpp:60][ProcessQueueForMdc][tid:618658] [TsdClient] it is unnecessary of current mode[0] to grant queue auth to aicpusd
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.984.447 [stub_process_mode_nowin.cpp:99][OpenInHost][tid:618658] enter into OpenInHost deviceid[3]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.984.473 [client_manager.cpp:435][IsHostEnvironment][tid:618658] [TsdClient] logicDeviceId is [3], hostaicpunum[0]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.984.490 [stub_process_mode_nowin.cpp:103][OpenInHost][tid:618658] host cpu not support
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.984.502 [process_mode_manager.cpp:121][OpenProcess][tid:618658] [TsdClient][deviceId=3] [sessionId=1] start hccp and computer process success
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.984.518 [runtime.cc:2879] 618658 startAicpuExecutor: userDeviceId=3, devId=3, tsdOpen ret=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.984.534 [runtime.cc:2891] 618658 startAicpuExecutor: TsdOpen success, devId=3, ret=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.984.549 [runtime.cc:3627] 618658 DeviceRetain: new dev ok id=3, rawDevSize=1328 (bytes), ts_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.984.567 [raw_device.cc:936] 618658 DevSetTsId: DevSetTsId, tsId=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.984.590 [npu_driver.cc:2968] 618658 DeviceOpen: Open device start, device_id=3, tsId=0.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.984.675 [trs_sqcq.c:458][ascend][curpid:618658,618658][drv][tsdrv][trsDevSqCqInit]Sqcq init. (devid=3)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.985.147 [trs_sqcq.c:394][ascend][curpid:618658,618658][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=3; tsId=0; id_type=6; num=2044)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.985.606 [trs_sqcq.c:394][ascend][curpid:618658,618658][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=3; tsId=0; id_type=7; num=2044)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.985.847 [trs_sqcq.c:394][ascend][curpid:618658,618658][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=3; tsId=0; id_type=10; num=1024)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.986.090 [trs_sqcq.c:394][ascend][curpid:618658,618658][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=3; tsId=0; id_type=11; num=1024)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.986.545 [trs_sqcq.c:394][ascend][curpid:618658,618658][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=3; tsId=0; id_type=12; num=2048)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.986.572 [trs_sqcq.c:394][ascend][curpid:618658,618658][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=3; tsId=0; id_type=8; num=16)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.986.596 [trs_sqcq.c:394][ascend][curpid:618658,618658][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=3; tsId=0; id_type=9; num=16)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.986.616 [trs_sqcq.c:394][ascend][curpid:618658,618658][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=3; tsId=0; id_type=13; num=4)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.986.635 [trs_sqcq.c:394][ascend][curpid:618658,618658][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=3; tsId=0; id_type=14; num=10)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.988.636 [trs_dev_drv.c:302][ascend][curpid:618658,618658][drv][tsdrv][drvDeviceOpenComm]Open success. (devid=3; fd=36; mmapFd=37)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.988.662 [devmm_svm.c:132][ascend][curpid:618658,618658][drv][devmm][devmm_setup_device]DrvMemDeviceOpen. (devid=3)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.988.688 [devmm_svm.c:122][ascend][curpid:618658,618658][drv][devmm][devmm_set_device_info]Device info. (devid=3; dvpp_size=17179869184; support_bar_mem=1; support_dev_read_only=1; support_dev_mem_map_host=1; support_bar_huge_mem=1; is_alloced_by_malloc=0; host_rw_dev_ro=1; double_pgtable_offset=17592186044416; is_support_host_pin_pre_register=0; is_support_host_mem_pool=0)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.988.769 [npu_driver.cc:3011] 618658 DeviceOpen: Open device success, device_id=3, tsId=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.988.790 [raw_device.cc:292] 618658 Init: chipType:0x5
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.988.830 [raw_device.cc:304] 618658 Init: isAddrFlat:0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.988.851 [raw_device.cc:320] 618658 Init: GetDevInfo, device_id=3, hardwareVersion=0x503
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.988.870 [devmm_svm.c:1972][ascend][curpid:618658,618658][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0x1; out_feature=0x1)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.988.888 [npu_driver.cc:1578] 618658 SupportNumaTsMemCtrl: chip type=5, support flag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.989.829 [raw_device.cc:352] 618658 Init: Get phy info, phy chip id 3, phy die id 0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.989.852 [runtime.cc:2771] 618658 GetTsdQos: [TSD] start get qos, devId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.989.864 [runtime.cc:5239] 618658 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.989.878 [tsd_client.cpp:189][TsdCapabilityGet][tid:618658] TsdCapabilityGet Begin.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.989.893 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618658] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.989.910 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618658] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.989.923 [process_mode_manager.cpp:1042][CapabilityGet][tid:618658] [ProcessModeManager] enter into CapabilityGet process deviceId[3] type[0]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.989.941 [process_mode_manager.cpp:386][InitTsdClient][tid:618658] [TsdClient] tsd client has been inited before
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.989.957 [version_verify.cpp:114][SpecialFeatureCheck][tid:618658] VersionVerify: previous type[38], supported
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.989.995 [process_mode_manager.cpp:1065][CapabilityGet][tid:618658] [TsdClient][deviceId=3] [sessionId=1] [type=0]send capability success 
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.990.014 [hdc_client.cpp:154][TsdRecvData][tid:618658] recv timeout is:150000 ms
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.990.522 [process_mode_msg_parse.cpp:175][CapabilityResMsgProc][tid:618658] [CapabilityResMsgProc] [sessionID=1]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.990.578 [process_mode_msg_parse.cpp:170][PidQosMsgProc][tid:618658] [TsdClient] PidQosMsgProc recvMsg realDeviceId[3] msgType[39] localDevId[3] rspCode[0],pidqos[1]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.990.599 [hdc_client.cpp:172][TsdRecvData][tid:618658] [deviceId=3] the Tsd recv data already
[INFO] TDT(618658,python3.9):2025-04-03-09:27:38.990.617 [process_mode_manager.cpp:1070][CapabilityGet][tid:618658] [TsdClient][logicDeviceId_=3][type=0][pidQos=1][ret=0]recv capability respond finish
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.990.636 [runtime.cc:2782] 618658 GetTsdQos: [TSD] get qos success, userDeviceId=3, devId=3, qos=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.990.661 [engine.cc:78] 618658 Engine: Constructor.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.990.676 [stars_engine.cc:51] 618658 StarsEngine: Constructor.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.990.688 [engine_factory.cc:26] 618658 CreateEngine: new StarsEngine, Runtime_alloc_size 320
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.990.706 [engine_factory.cc:38] 618658 CreateEngine: Engine init success.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.990.739 [raw_device.cc:364] 618658 Init: new SpmPool ok, Runtime_alloc_size 56(bytes)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.990.753 [spm_pool.cc:42] 618658 Init: new buffer ok, Runtime_alloc_size 128
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.990.978 [buffer_allocator.cc:61] 618658 BufferAllocator: alloc success, Runtime_alloc_size 128(bytes)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.990.995 [spm_pool.cc:55] 618658 Init: new BufferAllocator ok, Runtime_alloc_size 152
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.991.008 [raw_device.cc:380] 618658 Init: new UmaArgLoader ok, Runtime_alloc_size 296(bytes)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.991.028 [devmm_svm.c:1972][ascend][curpid:618658,618658][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.991.046 [npu_driver.cc:6080] 618658 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] DRV(618658,python3.9):2025-04-03-09:27:38.991.060 [devmm_svm.c:1972][ascend][curpid:618658,618658][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:38.991.076 [npu_driver.cc:6080] 618658 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.004.640 [buffer_allocator.cc:61] 618658 BufferAllocator: alloc success, Runtime_alloc_size 32768(bytes)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.004.700 [task_allocator.cc:46] 618658 DefaultAlloc: Runtime_alloc_size 32768(bytes)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.004.736 [buffer_allocator.cc:61] 618658 BufferAllocator: alloc success, Runtime_alloc_size 104(bytes)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.004.752 [h2d_copy_mgr.cc:45] 618658 H2DCopyMgr: alloc h2d copy buff success, policy 2
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.004.788 [devmm_svm.c:1972][ascend][curpid:618658,618658][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.004.805 [npu_driver.cc:6080] 618658 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.005.905 [buffer_allocator.cc:61] 618658 BufferAllocator: alloc success, Runtime_alloc_size 262144(bytes)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.005.940 [task_allocator.cc:46] 618658 DefaultAlloc: Runtime_alloc_size 4096(bytes)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.005.958 [buffer_allocator.cc:61] 618658 BufferAllocator: alloc success, Runtime_alloc_size 128(bytes)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.005.970 [h2d_copy_mgr.cc:45] 618658 H2DCopyMgr: alloc h2d copy buff success, policy 2
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.005.985 [devmm_svm.c:1972][ascend][curpid:618658,618658][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.006.001 [npu_driver.cc:6080] 618658 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.006.776 [buffer_allocator.cc:61] 618658 BufferAllocator: alloc success, Runtime_alloc_size 524288(bytes)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.006.811 [task_allocator.cc:46] 618658 DefaultAlloc: Runtime_alloc_size 2048(bytes)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.006.827 [buffer_allocator.cc:61] 618658 BufferAllocator: alloc success, Runtime_alloc_size 136(bytes)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.006.838 [h2d_copy_mgr.cc:45] 618658 H2DCopyMgr: alloc h2d copy buff success, policy 2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.006.849 [uma_arg_loader.cc:86] 618658 Init: new BufferAllocator superArgAllocator_ ok, Runtime_alloc_size 152
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.006.880 [task_allocator.cc:46] 618658 DefaultAlloc: Runtime_alloc_size 32768(bytes)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.006.906 [buffer_allocator.cc:61] 618658 BufferAllocator: alloc success, Runtime_alloc_size 104(bytes)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.006.920 [uma_arg_loader.cc:93] 618658 Init: new BufferAllocator handleAllocator_ ok, Runtime_alloc_size 152
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.007.779 [buffer_allocator.cc:61] 618658 BufferAllocator: alloc success, Runtime_alloc_size 131072(bytes)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.007.799 [uma_arg_loader.cc:102] 618658 Init: new BufferAllocator kernelInfoAllocator_ ok, Runtime_alloc_size 152
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.007.811 [uma_arg_loader.cc:104] 618658 Init: ALLOC PCIE is support[1]
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.007.825 [devmm_svm.c:1972][ascend][curpid:618658,618658][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.007.842 [npu_driver.cc:6080] 618658 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.008.008 [buffer_allocator.cc:61] 618658 BufferAllocator: alloc success, Runtime_alloc_size 32768(bytes)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.008.026 [h2d_copy_mgr.cc:45] 618658 H2DCopyMgr: alloc h2d copy buff success, policy 1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.008.050 [raw_device.cc:393] 618658 Init: new StreamSqCqManage ok, Runtime_alloc_size 416(bytes)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.008.066 [raw_device.cc:398] 618658 Init: New taskFactory ok, Runtime_alloc_size 136(bytes)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.008.080 [task_allocator.cc:46] 618658 DefaultAlloc: Runtime_alloc_size 393216(bytes)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.008.270 [buffer_allocator.cc:61] 618658 BufferAllocator: alloc success, Runtime_alloc_size 104(bytes)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.008.482 [raw_device.cc:109] 618658 Init: ObjAllocator alloc success, Runtime_alloc_size 160000(bytes)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.008.868 [raw_device.cc:121] 618658 Init: ObjAllocator alloc success, Runtime_alloc_size 960000(bytes)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.008.887 [raw_device.cc:425] 618658 Init: Runtime_alloc_size=64000(bytes)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.008.939 [npu_driver.cc:404] 618658 StreamIdAlloc: stream id alloc begin, device_id=3, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.009.024 [stream.cc:2246] 618658 AllocExecutedTimesSvm: stream_id=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.009.062 [stream_sqcq_manage.cc:147] 618658 Alloc: deviceId=3, tsId=0, drvFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.009.079 [npu_driver.cc:882] 618658 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.009.464 [npu_driver.cc:6125] 618658 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.009.531 [npu_driver.cc:6137] 618658 LogicCqAllocateV2: success: deviceId=3, tsId=0, cqId=1039, streamId=0, logicCq=1039, cqeDepth=4096
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.009.558 [npu_driver.cc:6189] 618658 StreamBindLogicCq: success: deviceId=3, tsId=0, streamId=0, logicCq=1039.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.009.578 [npu_driver.cc:5916] 618658 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=f6446000, addr=dffff6446000size=4096
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.009.595 [stream.cc:653] 618658 Setup: Success to get sq=0 sq reg virtual addr length=4096.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.009.644 [stream.cc:276] 618658 CreateStreamTaskRes: Normal STREAM Setup stream_id=0 flags_=0xc0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.009.672 [stream.cc:688] 618658 Setup: stream setup end, stream_id=0, IsTaskSink=0, sqId=0, cqId=0, deviceId=3, streamResId=0
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:39.009.699 [stream_state_callback_manager.cc:45] 618658 Notify: not reg stream state callback func!
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.009.715 [raw_device.cc:593] 618658 Start: new primary Stream ok, Runtime_alloc_size 3872, stream_id=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.009.735 [npu_driver.cc:404] 618658 StreamIdAlloc: stream id alloc begin, device_id=3, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.009.755 [stream_sqcq_manage.cc:147] 618658 Alloc: deviceId=3, tsId=0, drvFlag=16
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.009.770 [npu_driver.cc:882] 618658 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.009.867 [tsch_stream.cc:45] 618658 Setup: stream setup end, stream_id=1, type=1, IsTaskSink=0, sqId=1, cqId=1, deviceId=3 streamResId=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.009.886 [raw_device.cc:1219] 618658 TschStreamSetup: Tsch setup ffts dsa stream ok, stream_id=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.009.952 [osal.cc:309] 618658 CreateThread: Runtime_alloc_size 56
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.010.149 [osal.cc:182] 618658 Start: mmCreateTaskWithThreadAttr, retCode=0, name_=MONITOR_0, i=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.010.172 [osal.cc:309] 618658 CreateThread: Runtime_alloc_size 56
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.010.251 [osal.cc:182] 618658 Start: mmCreateTaskWithThreadAttr, retCode=0, name_=RT_RECYCLE, i=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.010.253 [stars_engine.cc:1785] 618772 MonitoringRun: Starts Monitor thread has entered, ts_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.010.280 [stars_engine.cc:201] 618773 RecycleThreadRun: RecycleThreadRun thread enter.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.010.299 [runtime.cc:5239] 618772 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:39.010.329 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618772] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:39.010.361 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618772] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:39.010.378 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618772] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.010.406 [runtime.cc:3077] 618772 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=3, devId=3, tdt status=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.010.471 [npu_driver.cc:6306] 618772 GetDeviceStatus: GetDeviceStatus status=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.010.493 [stars_engine.cc:1855] 618772 ReportHBMRasProc: g_hbmRasCheckDeviceId init, dev_id=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.010.509 [npu_driver.cc:551] 618772 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.010.596 [engine.cc:188] 618658 SubmitTaskNormal: stream_id=0,task_id=0,task_type=97 (STARS_VERSION).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.010.629 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=0, head=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.010.661 [task_info.cc:1596] 618658 ConstructSqeForStarsVersionTask: Send GetStarsVersionTask succ,sqe_type=3,pre_p=1,sqe->rt_streamID=32768,stream_id=0,task_id=0,task_type=97.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.010.680 [stream.cc:1400] 618658 AddTaskToList: public task, stream_id=0, task_id=0, task_type=97 (STARS_VERSION), head=0, tail=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.010.705 [stream.cc:2595] 618658 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=0, type=97(STARS_VERSION), head=0, tail=1, sqe_num=1, lastTail=0, device_id=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.010.736 [npu_driver.cc:751] 618658 SqTaskSend: device_id=3, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.010.752 [stars_engine.cc:893] 618658 SendTask: Sq task send finished, device_id=3, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=0, task_type=97(STARS_VERSION).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.010.771 [stars_engine.cc:1122] 618658 SyncTask: Task Wait: device_id=3, stream_id=0, task_id=0, logicCqId=1039.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.010.821 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=0, head=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.010.838 [stars_engine.cc:1071] 618658 IsSyncTaskFinish: Sync task finished, sqHead=0 finishedTaskId=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.010.865 [stars_engine.cc:1017] 618658 ProcReport: Get logic report: cnt=1, idx=0, stream_id=0, report task_id=0, sync task_id=0, sqeType=3, sqeHead=0, retCode=0x23, errType=0x20.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.010.884 [task.cc:185] 618658 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.010.897 [stars_engine.cc:1027] 618658 ProcReport: taskType=97.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.010.917 [task.cc:185] 618658 GetTask: this stream no taskRes, stream_id=0
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:39.010.932 [stars_engine.cc:1570] 618658 ProcLogicCqReport: CQE warning, device_id=3, stream_id=0, task_id=0, sqe_type=3(place holder), errType=0x20(sq sw status error), sqSwStatus=0x23
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.010.961 [task.cc:185] 618658 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.010.978 [logger.cc:152] 618658 TaskFinished: device_id=3, stream_id=0, task_id=0, task_type=97 (STARS_VERSION), task_finish_num=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.010.995 [task_info.cc:1614] 618658 DoCompleteSuccessForStarsVersionTask: Complete StarsVersionTask succ, retCode=35,tschVersion=35.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.011.007 [raw_device.cc:1305] 618658 SetTschVersion: Set tsch version=35.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:39.011.035 [stars_engine.cc:1351] 618658 StarsResumeRtsq: Begin to query sq status, stream_id=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.011.057 [npu_driver.cc:5618] 618658 GetSqEnable: deviceId=3, tsId=0, sqId=0, enable=0.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:39.011.073 [stars_engine.cc:1365] 618658 StarsResumeRtsq: sq already disable, stream_id=0, queryCnt=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.011.085 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=0, head=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.011.099 [npu_driver.cc:5595] 618658 GetSqTail: deviceId=3, tsId=0, sqId=0, tail=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.011.112 [npu_driver.cc:5406] 618658 SetSqHead: deviceId=3, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.011.135 [npu_driver.cc:5357] 618658 EnableSq: deviceId=3, tsId=0, sqId=0.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:39.011.153 [stars_engine.cc:1430] 618658 StarsResumeRtsq: Resume stream_id=0, sq_id=0, sq_head=0, task_id=0, taskType=97, head=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.011.172 [npu_driver.cc:5618] 618658 GetSqEnable: deviceId=3, tsId=0, sqId=0, enable=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.011.185 [stream.cc:1494] 618658 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.011.200 [raw_device.cc:1331] 618658 GetStarsVersion: send alloc get stars version task, stream_id=0, retCode:0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.011.224 [raw_device.cc:610] 618658 Start: Get TschVersion, tschVersion=35.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.012.507 [engine.cc:188] 618658 SubmitTaskNormal: stream_id=0,task_id=1,task_type=83 (DEVICE_RINGBUFFER_CONTROL).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.012.552 [ringbuffer_maintain_task.cc:98] 618658 ConstructSqeForRingBufferMaintainTask: RingBufferMaintainTask stream_id=0, task_id=1, offset=0x1580
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.012.572 [stream.cc:1400] 618658 AddTaskToList: public task, stream_id=0, task_id=1, task_type=83 (DEVICE_RINGBUFFER_CONTROL), head=1, tail=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.012.587 [stream.cc:2595] 618658 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=1, type=83(DEVICE_RINGBUFFER_CONTROL), head=1, tail=2, sqe_num=1, lastTail=1, device_id=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.012.607 [npu_driver.cc:751] 618658 SqTaskSend: device_id=3, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.012.622 [stars_engine.cc:893] 618658 SendTask: Sq task send finished, device_id=3, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=1, task_type=83(DEVICE_RINGBUFFER_CONTROL).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.012.636 [stream.cc:1494] 618658 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.012.653 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.012.686 [stars_engine.cc:622] 618658 ProcLogicCqUntilEmpty: Task Wait: stream_id=0, logicCqId=1039, retCode=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.012.704 [stream.cc:2886] 618658 StarsWaitForTask: No.0 stream_id=0, taskId=1, currentId=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.012.718 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.012.734 [stream.cc:2886] 618658 StarsWaitForTask: No.1 stream_id=0, taskId=1, currentId=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.012.746 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.012.762 [stream.cc:2886] 618658 StarsWaitForTask: No.2 stream_id=0, taskId=1, currentId=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.012.774 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.012.790 [stream.cc:2886] 618658 StarsWaitForTask: No.3 stream_id=0, taskId=1, currentId=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.012.802 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=0, head=2.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.012.818 [task.cc:185] 618658 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.012.831 [task.cc:185] 618658 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.012.844 [logger.cc:152] 618658 TaskFinished: device_id=3, stream_id=0, task_id=1, task_type=83 (DEVICE_RINGBUFFER_CONTROL), task_finish_num=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.012.858 [stars_engine.cc:437] 618658 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=1, sqHead=2, endTaskId=1, recycleTaskId=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.012.875 [stream.cc:2886] 618658 StarsWaitForTask: No.4 stream_id=0, taskId=1, currentId=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.012.928 [engine.cc:188] 618658 SubmitTaskNormal: stream_id=0,task_id=2,task_type=29 (ALLOC_DSA_ADDR).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.012.947 [task_info.cc:111] 618658 ConstructSqeForAllocDsaAddrTask: Send AllocDsaAddrTask succ, sqe_type=3, pre_p=1, stream_id=0, task_id=2, task_type=29, dsa_sq_id=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.012.974 [stream.cc:1400] 618658 AddTaskToList: public task, stream_id=0, task_id=2, task_type=29 (ALLOC_DSA_ADDR), head=2, tail=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.012.987 [stream.cc:2595] 618658 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=2, type=29(ALLOC_DSA_ADDR), head=2, tail=3, sqe_num=1, lastTail=2, device_id=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.013.005 [npu_driver.cc:751] 618658 SqTaskSend: device_id=3, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.013.018 [stars_engine.cc:893] 618658 SendTask: Sq task send finished, device_id=3, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=2, task_type=29(ALLOC_DSA_ADDR).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.013.036 [stars_engine.cc:1122] 618658 SyncTask: Task Wait: device_id=3, stream_id=0, task_id=2, logicCqId=1039.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.013.163 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=0, head=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.013.180 [stars_engine.cc:1071] 618658 IsSyncTaskFinish: Sync task finished, sqHead=3 finishedTaskId=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.013.191 [stars_engine.cc:1017] 618658 ProcReport: Get logic report: cnt=1, idx=0, stream_id=0, report task_id=2, sync task_id=2, sqeType=3, sqeHead=2, retCode=0, errType=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.013.208 [task.cc:185] 618658 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.013.219 [stars_engine.cc:1027] 618658 ProcReport: taskType=29.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.013.230 [task.cc:185] 618658 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.013.245 [task.cc:185] 618658 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.013.256 [logger.cc:152] 618658 TaskFinished: device_id=3, stream_id=0, task_id=2, task_type=29 (ALLOC_DSA_ADDR), task_finish_num=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.013.278 [npu_driver.cc:5618] 618658 GetSqEnable: deviceId=3, tsId=0, sqId=0, enable=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.013.293 [stream.cc:1494] 618658 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=2.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.013.305 [raw_device.cc:1232] 618658 TschStreamAllocDsaAddr: send alloc dsa sq task, stream_id=1, retCode:0
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:39.013.328 [atrace_api.c:40](tid:618658) AtraceCreate start.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:39.014.454 [trace_rb_log.c:45](tid:618658) init ring buffer time finished, realTime 1743643659013388995, monotonicTime 4162822404153, freq 99993 kHz, minutesWest 480 minutes
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:39.014.472 [trace_rb_log.c:137](tid:618658) [RUNTIME_ATRACE_DEV3_TS0] create ring buffer success, msgSize 128 bytes, msgTxtSize 112 bytes, bufferSize 1024 bytes, msg space 128 bytes, total space 131568 bytes
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:39.014.489 [tracer_mgr_operate.c:66](tid:618658) create object RUNTIME_ATRACE_DEV3_TS0 success, exitSave(false), noLock(false).
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:39.014.501 [atrace_api.c:44](tid:618658) AtraceCreate end.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:39.014.538 [trace_event.c:70](tid:618658) limitedNum 1, processType 0 
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:39.014.553 [trace_event.c:372](tid:618658) set trace event attr limitedNum: 1, processType: 0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.014.569 [runtime.cc:3159] 618658 SetTsdProfCallback: set tsd prof callback
[INFO] TDT(618658,python3.9):2025-04-03-09:27:39.014.584 [client_manager.cpp:196][SetProfilingCallback][tid:618658] [TsdClient] set profiling callback success
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.014.615 [runtime.cc:3364] 618658 PrimaryContextRetain: new Context ok, Runtime_alloc_size 424
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.014.655 [context.cc:109] 618658 Init: ObjAllocator alloc success, Runtime_alloc_size 160000(bytes)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.014.720 [context.cc:121] 618658 Init: ObjAllocator alloc success, Runtime_alloc_size 960000(bytes)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.014.735 [context.cc:276] 618658 Init: Runtime_alloc_size is 16000.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.014.778 [raw_device.cc:803] 618658 UpdateTimeoutConfig: No need to update timeout config.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:39.014.795 [npu_driver_dcache_lock.cpp:39] 618658 AllocAddrForDcache: halMemCtl failed, drvRet=65534, outSize=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.014.904 [raw_device.cc:528] 618658 AllocStackPhyBase: AllocStackPhyBase device_id=3, stackPhyBase32k_=0x12c140000000, stackPhySize=2457600.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.014.952 [raw_device.cc:232] 618658 LaunchDcacheLockOp: dcache lock has been set or stack addr is not for dcache, dCacheLockFlag_=0, stackAddrIsDcache_=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.014.975 [runtime.cc:3393] 618658 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.014.991 [runtime.cc:3560] 618658 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.015.007 [api_impl.cc:2987] 618658 NewDevice: SetCurRef = 0xaaab0b9e09a0,userDeviceId=3,deviceId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.015.023 [runtime.cc:5239] 618658 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.015.038 [api_impl.cc:2992] 618658 NewDevice: New device success, user_device_id=3, die_num=1.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:39.015.060 [awatchdog_core.c:175](tid:618658) create watchdog for id : 65543, tid : 618658, timeout : 300s
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.015.076 [api_impl.cc:3025] 618658 SetDevice: SetDevice success, curCtx=0xaaab0b9e09a0, user_device_id=3.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.015.110 [acl.cpp:115]618658 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.015.127 [acl.cpp:121]618658 GetSocVersion: socVersion is Ascend910B3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.017.927 [api_impl.cc:3476] 618658 GetDeviceInfo: get device info, deviceId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.017.960 [api_impl.cc:3476] 618658 GetDeviceInfo: get device info, deviceId=3
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.018.007 [device.cpp:133]618658 UpdatePlatformInfoWithDevice: Successfully to UpdatePlatformInfoWithDevice, deviceId = 3, aicCnt = 20, vecCoreCnt = 40, cubeCoreCnt = 20
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.018.031 [device.cpp:154]618658 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 3
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.018.050 [context.cpp:87]618658 aclrtGetCurrentContext: start to execute aclrtGetCurrentContext
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.018.068 [context.cpp:98]618658 aclrtGetCurrentContext: successfully execute aclrtGetCurrentContext
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.018.092 [stream.cpp:48]618658 aclrtCreateStreamWithConfig: start to execute aclrtCreateStreamWithConfig with priority:0, flag:3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.018.121 [api_impl.cc:1120] 618658 StreamCreate: priority=0, flags=1536.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.018.180 [npu_driver.cc:404] 618658 StreamIdAlloc: stream id alloc begin, device_id=3, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.018.214 [stream.cc:2246] 618658 AllocExecutedTimesSvm: stream_id=2.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.018.266 [stream_sqcq_manage.cc:147] 618658 Alloc: deviceId=3, tsId=0, drvFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.018.283 [npu_driver.cc:882] 618658 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.018.481 [npu_driver.cc:6125] 618658 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.018.551 [npu_driver.cc:6137] 618658 LogicCqAllocateV2: success: deviceId=3, tsId=0, cqId=1040, streamId=2, logicCq=1040, cqeDepth=4096
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.018.575 [npu_driver.cc:6189] 618658 StreamBindLogicCq: success: deviceId=3, tsId=0, streamId=2, logicCq=1040.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.018.593 [npu_driver.cc:5916] 618658 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=ec06b000, addr=dfffec06b000size=4096
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.018.609 [stream.cc:653] 618658 Setup: Success to get sq=2 sq reg virtual addr length=4096.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.018.656 [devmm_svm.c:1972][ascend][curpid:618658,618658][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.018.674 [npu_driver.cc:6080] 618658 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.018.840 [stream.cc:291] 618658 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=2, flags_=0x600.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.022.302 [stream.cc:688] 618658 Setup: stream setup end, stream_id=2, IsTaskSink=0, sqId=2, cqId=2, deviceId=3, streamResId=65535
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:39.022.329 [stream_state_callback_manager.cc:45] 618658 Notify: not reg stream state callback func!
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.022.347 [api_impl.cc:1162] 618658 StreamCreate: Succ, flags=1536, stream_id=2, context=aaab0b9e09a0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.022.366 [stream.cpp:189]618658 aclrtSetStreamFailureMode: start to execute aclrtSetStreamFailureMode, mode is 1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.022.386 [stream.cc:3161] 618658 SetFailMode: stream_id=2 is updated from CONTINUE to STOP.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.022.401 [stream.cpp:195]618658 aclrtSetStreamFailureMode: successfully execute aclrtSetStreamFailureMode, mode is 1
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.022.457 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:105] RegCallback] Register callback thread, stream : 0xaaab0bb0bf40.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.022.512 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:377] CreateDefaultStream] Create ascend default stream, stream id: 0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.022.527 [stream.cpp:48]618658 aclrtCreateStreamWithConfig: start to execute aclrtCreateStreamWithConfig with priority:0, flag:3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.022.544 [api_impl.cc:1120] 618658 StreamCreate: priority=0, flags=1536.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.022.577 [npu_driver.cc:404] 618658 StreamIdAlloc: stream id alloc begin, device_id=3, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.022.611 [stream.cc:2246] 618658 AllocExecutedTimesSvm: stream_id=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.022.648 [stream_sqcq_manage.cc:147] 618658 Alloc: deviceId=3, tsId=0, drvFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.022.665 [npu_driver.cc:882] 618658 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.022.836 [npu_driver.cc:6125] 618658 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.022.894 [npu_driver.cc:6137] 618658 LogicCqAllocateV2: success: deviceId=3, tsId=0, cqId=1041, streamId=3, logicCq=1041, cqeDepth=4096
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.022.916 [npu_driver.cc:6189] 618658 StreamBindLogicCq: success: deviceId=3, tsId=0, streamId=3, logicCq=1041.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.022.934 [npu_driver.cc:5916] 618658 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=ec04a000, addr=dfffec04a000size=4096
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.022.949 [stream.cc:653] 618658 Setup: Success to get sq=3 sq reg virtual addr length=4096.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.022.992 [devmm_svm.c:1972][ascend][curpid:618658,618658][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.023.011 [npu_driver.cc:6080] 618658 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.023.316 [stream.cc:291] 618658 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=3, flags_=0x600.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.023.998 [stream.cc:688] 618658 Setup: stream setup end, stream_id=3, IsTaskSink=0, sqId=3, cqId=3, deviceId=3, streamResId=0
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:39.024.018 [stream_state_callback_manager.cc:45] 618658 Notify: not reg stream state callback func!
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.024.030 [api_impl.cc:1162] 618658 StreamCreate: Succ, flags=1536, stream_id=3, context=aaab0b9e09a0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.024.044 [stream.cpp:189]618658 aclrtSetStreamFailureMode: start to execute aclrtSetStreamFailureMode, mode is 1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.024.062 [stream.cc:3161] 618658 SetFailMode: stream_id=3 is updated from CONTINUE to STOP.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.024.076 [stream.cpp:195]618658 aclrtSetStreamFailureMode: successfully execute aclrtSetStreamFailureMode, mode is 1
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.024.109 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:105] RegCallback] Register callback thread, stream : 0xaaab0bc3ae30.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.024.255 [callback.cpp:25]618658 aclrtSubscribeReport: start to execute aclrtSubscribeReport, threadId is 281471973191584.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.024.299 [npu_driver.cc:462] 618658 EventIdAlloc: event id alloc begin, device_id=3, ts_id=0, remote_event_id=0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.024.315 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:39.024.365 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.024.367 [npu_driver.cc:483] 618658 EventIdAlloc: Event id alloc success, device_id=3, ts_id=0, event_id=0, eventFlag=0
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:39.024.382 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.024.388 [event.cc:347] 618658 GenEventId: Event id alloc success, device_id=3, tsId=0, eventFlag=1, event_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.024.408 [subscribe.cc:54] 618658 AssignGroupId: give groupId=64
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.024.423 [npu_driver.cc:3775] 618658 SqCqAllocate: deviceId=3, tsId=0, groupId=64.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.024.439 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.024.468 [npu_driver.cc:3785] 618658 SqCqAllocate: alloc success, deviceId=3 sqId=787, cqId=787.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.024.479 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.024.498 [subscribe.cc:131] 618658 Insert: callback subscribe: groupId=64, threadId=281471973191584, devId=3, tsId=0, streamId=2, sqId=787, cqId=787
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.024.519 [callback.cpp:31]618658 aclrtSubscribeReport: successfully execute aclrtSubscribeReport, threadId is 281471973191584.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.024.527 [npu_driver.cc:3828] 618774 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=64.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.024.551 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:125] RegCallback] Register callback thread success, stream : 0xaaab0bb0bf40.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.024.713 [callback.cpp:25]618658 aclrtSubscribeReport: start to execute aclrtSubscribeReport, threadId is 281471352827808.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.024.735 [npu_driver.cc:462] 618658 EventIdAlloc: event id alloc begin, device_id=3, ts_id=0, remote_event_id=0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.024.742 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.024.755 [npu_driver.cc:483] 618658 EventIdAlloc: Event id alloc success, device_id=3, ts_id=0, event_id=1, eventFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.024.771 [event.cc:347] 618658 GenEventId: Event id alloc success, device_id=3, tsId=0, eventFlag=1, event_id=1
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:39.024.772 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.024.788 [subscribe.cc:54] 618658 AssignGroupId: give groupId=65
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:39.024.792 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.024.800 [npu_driver.cc:3775] 618658 SqCqAllocate: deviceId=3, tsId=0, groupId=65.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.024.806 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.024.818 [npu_driver.cc:3785] 618658 SqCqAllocate: alloc success, deviceId=3 sqId=788, cqId=788.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.024.819 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.024.832 [subscribe.cc:131] 618658 Insert: callback subscribe: groupId=65, threadId=281471352827808, devId=3, tsId=0, streamId=3, sqId=788, cqId=788
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.024.852 [callback.cpp:31]618658 aclrtSubscribeReport: successfully execute aclrtSubscribeReport, threadId is 281471352827808.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.024.857 [npu_driver.cc:3828] 618775 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=65.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.024.877 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:125] RegCallback] Register callback thread success, stream : 0xaaab0bc3ae30.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.024.900 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:386] CreateDefaultStream] Create ascend communication stream, stream id: 1
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.024.986 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:110] Initialize] Config huge_page_reserve_size : 0, device_hbm_huge_page_reserved_size_ : 0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.025.325 [npu_driver.cc:2616] 618658 MemGetInfoEx: memory info type=1, type=2, free=8864677888, hug_free=56245616640
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.025.377 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:60] AscendVmmAdapter] VMM align size is 2097152
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.025.454 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:158] CheckVmmDriverVersion] Driver path is /usr/local/Ascend
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.025.496 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:187] CheckVmmDriverVersion] Driver version is 25.0.rc1.b070, major version is 25
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.025.523 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:113] IsVmmEnabled] VMM is enabled.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.025.545 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:180] Initialize] Device MOC Size:62420M, Device free MOC Size:62094M, Reserved MOC size for Other Components(HCCL/rts/etc.):3892M, Recommend Reserved MOC size for Other Components:3880M, User define MindSpore MOC Size:0G, MindSpore Used MOC Size:58202M.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.025.568 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_dynamic_mem_adapter.cc:57] Initialize] Ascend Memory Adapter initialize success, Memory Statistics:
Device MOC memory size: 62420M
MindSpore Used memory size: 58202M
Used peak memory usage (without fragments): 0M
Actual peak memory usage (with fragments): 0M

[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.025.595 [event.cpp:260]618658 aclrtSetOpWaitTimeout: start to execute aclrtSetOpWaitTimeout, timeout = 1980s
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.025.617 [api_impl.cc:5713] 618658 SetOpWaitTimeOut: set OP wait timeout:1980.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.026.694 [engine.cc:188] 618658 SubmitTaskNormal: stream_id=0,task_id=3,task_type=86 (TASK_TIMEOUT_SET).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.026.715 [timeout_set_task.cc:115] 618658 ConstructSqeForTimeoutSetTask: TaskTimeoutSetTask ConstructSqe finish,topic_type=0,cmd_type=13
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.026.731 [stream.cc:1400] 618658 AddTaskToList: public task, stream_id=0, task_id=3, task_type=86 (TASK_TIMEOUT_SET), head=3, tail=4
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.026.745 [stream.cc:2595] 618658 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=3, type=86(TASK_TIMEOUT_SET), head=3, tail=4, sqe_num=1, lastTail=3, device_id=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.026.765 [npu_driver.cc:751] 618658 SqTaskSend: device_id=3, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.026.781 [stars_engine.cc:893] 618658 SendTask: Sq task send finished, device_id=3, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=3, task_type=86(TASK_TIMEOUT_SET).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.026.799 [stream.cc:1494] 618658 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.026.813 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=0, head=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.026.844 [stars_engine.cc:622] 618658 ProcLogicCqUntilEmpty: Task Wait: stream_id=0, logicCqId=1039, retCode=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.026.860 [stream.cc:2886] 618658 StarsWaitForTask: No.0 stream_id=0, taskId=3, currentId=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.026.873 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=0, head=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.026.887 [stream.cc:2886] 618658 StarsWaitForTask: No.1 stream_id=0, taskId=3, currentId=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.026.913 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=0, head=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.026.926 [stream.cc:2886] 618658 StarsWaitForTask: No.2 stream_id=0, taskId=3, currentId=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.026.938 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=0, head=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.026.952 [stream.cc:2886] 618658 StarsWaitForTask: No.3 stream_id=0, taskId=3, currentId=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.026.965 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.026.978 [task.cc:185] 618658 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.026.994 [task.cc:185] 618658 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.027.006 [logger.cc:152] 618658 TaskFinished: device_id=3, stream_id=0, task_id=3, task_type=86 (TASK_TIMEOUT_SET), task_finish_num=4
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.027.024 [stars_engine.cc:437] 618658 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=3, sqHead=4, endTaskId=3, recycleTaskId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.027.040 [stream.cc:2886] 618658 StarsWaitForTask: No.4 stream_id=0, taskId=3, currentId=3
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.027.054 [event.cpp:262]618658 aclrtSetOpWaitTimeout: successfully execute aclrtSetOpWaitTimeout, timeout = 1980s
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.027.070 [event.cpp:269]618658 aclrtSetOpExecuteTimeOut: start to execute aclrtSetOpExecuteTimeOut, timeout = 900s
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.027.089 [engine.cc:188] 618658 SubmitTaskNormal: stream_id=0,task_id=4,task_type=86 (TASK_TIMEOUT_SET).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.027.105 [timeout_set_task.cc:115] 618658 ConstructSqeForTimeoutSetTask: TaskTimeoutSetTask ConstructSqe finish,topic_type=0,cmd_type=13
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.027.118 [stream.cc:1400] 618658 AddTaskToList: public task, stream_id=0, task_id=4, task_type=86 (TASK_TIMEOUT_SET), head=4, tail=5
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.027.134 [stream.cc:2595] 618658 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=4, type=86(TASK_TIMEOUT_SET), head=4, tail=5, sqe_num=1, lastTail=4, device_id=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.027.150 [npu_driver.cc:751] 618658 SqTaskSend: device_id=3, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.027.165 [stars_engine.cc:893] 618658 SendTask: Sq task send finished, device_id=3, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=4, task_type=86(TASK_TIMEOUT_SET).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.027.182 [stream.cc:1494] 618658 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=4.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.027.194 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.027.206 [stream.cc:2886] 618658 StarsWaitForTask: No.0 stream_id=0, taskId=4, currentId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.027.220 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.027.235 [stream.cc:2886] 618658 StarsWaitForTask: No.1 stream_id=0, taskId=4, currentId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.027.247 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.027.263 [stream.cc:2886] 618658 StarsWaitForTask: No.2 stream_id=0, taskId=4, currentId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.027.275 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=0, head=5.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.027.288 [task.cc:185] 618658 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.027.309 [task.cc:185] 618658 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.027.320 [logger.cc:152] 618658 TaskFinished: device_id=3, stream_id=0, task_id=4, task_type=86 (TASK_TIMEOUT_SET), task_finish_num=5
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.027.335 [stars_engine.cc:437] 618658 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=4, sqHead=5, endTaskId=4, recycleTaskId=4.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.027.351 [stream.cc:2886] 618658 StarsWaitForTask: No.3 stream_id=0, taskId=4, currentId=4
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.027.363 [event.cpp:277]618658 aclrtSetOpExecuteTimeOut: successfully execute aclrtSetOpExecuteTimeOut, timeout = 900s
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.027.392 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:285] Init] End inititializing kernel runtime.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.027.426 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:48] InitDevice] Enter SetRtDevice, current initialize device number:1
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.027.445 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:50] InitDevice] Device 3 has been set
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.027.461 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:381] CreateDefaultStream] The default compute stream is already created, skip.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.027.478 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:390] CreateDefaultStream] The default communication stream is already created, skip.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.027.521 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_pool.cc:165] DefaultEnhancedAscendMemoryPool] DefaultEnhancedAscendMemoryPool constructed.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.027.547 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:397] Initialize] Skip initialization of memory pool since init size is not configured.
[INFO] UTILS(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.027.599 [mindspore/ccsrc/utils/offload_context.cc:86] enable_aio] On ascend devices, enable aio and enable pinned mem cannot be turned on at the same time.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.027.712 [context.cpp:72]618658 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.027.738 [api_impl.cc:3717] 618658 ContextSetCurrent: set context=aaab0b9e09a0, flag=0.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.027.767 [context.cpp:80]618658 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.027.790 [context.cpp:72]618658 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.027.809 [api_impl.cc:3717] 618658 ContextSetCurrent: set context=aaab0b9e09a0, flag=0.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.027.823 [context.cpp:80]618658 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.027.978 [acl.cpp:288]618658 aclInit: start to execute aclInit
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.028.015 [acl.cpp:298]618658 aclInit: call ErrorManager.Initialize
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.028.107 [acl.cpp:242]618658 HandleErrorManagerConfig: err_msg mode is set ["1"].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.036.979 [error_manager.cc:673]618658 ParseJsonFile:Parse json file:/usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/../conf/error_manager/error_code.json success
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.037.585 [acl.cpp:315]618658 aclInit: call ge interface executor.Initialize
[INFO] PROFILING(618658,python3.9):2025-04-03-09:27:39.037.649 [prof_atls_plugin.cpp:210] (tid:618658) Module[45] register callback of ctrl handle.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.037.688 [ge_executor.cc:273]618658 Initialize:Init GeExecutor begin.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.037.929 [op_lib_register.cc:117]618658 GetAllCustomOpApiSoPaths:value of env ASCEND_CUSTOM_OPP_PATH is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/ho
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.038.010 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.038.051 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.038.084 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.038.117 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.038.148 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.038.178 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.038.209 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.038.239 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.038.269 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.038.310 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.038.341 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.038.370 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.038.400 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.038.430 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.038.459 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.038.489 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.038.519 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.038.549 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.038.578 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.038.608 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.038.642 [op_lib_register.cc:165]618658 CallInitFunc:CallInitFunc 0 successfully, op_lib_paths_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/je
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.038.689 [plugin_manager.cc:616]618658 GetOpTilingForwardOrderPath:Enter GetOpTilingPath schedule
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.038.705 [plugin_manager.cc:108]618658 GetOppPath:Enter get opp path schedule
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.038.735 [plugin_manager.cc:117]618658 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.038.758 [plugin_manager.cc:624]618658 GetOpTilingForwardOrderPath:Opp plugin path structure is new version!
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.038.774 [plugin_manager.cc:206]618658 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.039.259 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.039.302 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.039.319 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.039.333 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.039.380 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.039.674 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.039.710 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.039.727 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.039.740 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.039.778 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.039.817 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.039.844 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.039.857 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.039.873 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.039.889 [plugin_manager.cc:215]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.040.187 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.040.225 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.040.244 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.040.256 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.040.294 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.040.583 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.040.616 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.040.634 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.040.646 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.040.683 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.040.720 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.040.736 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.040.749 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.040.765 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.040.799 [plugin_manager.cc:215]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.041.084 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.041.117 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.041.134 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.041.147 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.041.183 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.041.472 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.041.504 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.041.521 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.041.534 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.041.568 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.041.604 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.041.620 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.041.633 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.041.648 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.041.661 [plugin_manager.cc:215]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.041.946 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.041.978 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.042.006 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.042.018 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.042.056 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.042.343 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.042.375 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.042.392 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.042.405 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.042.441 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.042.476 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.042.493 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.042.505 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.042.521 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.042.535 [plugin_manager.cc:215]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.042.819 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.042.852 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.042.867 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.042.880 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.042.916 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.043.213 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.043.245 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.043.262 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.043.275 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.043.311 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.043.347 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.043.364 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.043.377 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.043.393 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.043.407 [plugin_manager.cc:215]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.043.421 [plugin_manager.cc:218]618658 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-pack
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.043.442 [plugin_manager.cc:422]618658 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.043.456 [plugin_manager.cc:155]618658 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.043.477 [plugin_manager.cc:158]618658 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.043.492 [plugin_manager.cc:426]618658 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.043.794 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.043.828 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.043.845 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.043.858 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.043.895 [plugin_manager.cc:439]618658 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.043.916 [plugin_manager.cc:175]618658 ReversePathString:Enter ReversePathString schedule
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.043.937 [plugin_manager.cc:187]618658 ReversePathString:path_str is '/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/:/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.044.219 [plugin_manager.cc:996]618658 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.044.251 [plugin_manager.cc:1011]618658 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.044.274 [plugin_manager.cc:1015]618658 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.044.320 [op_tiling_manager.cc:58]618658 LoadSo:[FindSo][Check] Get path with op_master [/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.059.985 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DefaultImpl] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.060.818 [op_tiling_registry.cc:162]618658 OpTilingFuncRegistry:Register op tiling and parse function V4 for op_type:Aipp
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.060.968 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:AvgPool1DD
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.061.110 [op_tiling_registry.cc:162]618658 OpTilingFuncRegistry:Register op tiling and parse function V4 for op_type:AutoTiling
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.061.242 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Bias
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.061.370 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:INTrainingUpdateV2
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.061.495 [op_tiling_registry.cc:134]618658 OpTilingFuncRegistry:Register op tiling function V2 for op_type:CheckValid
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.061.633 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ConcatD
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.061.653 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ConcatV2D
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.061.677 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Pack
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.061.799 [op_tiling_registry.cc:134]618658 OpTilingFuncRegistry:Register op tiling function V2 for op_type:ConcatOffset
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.061.913 [op_tiling_registry.cc:134]618658 OpTilingFuncRegistry:Register op tiling function V2 for op_type:Diag
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.062.028 [op_tiling_registry.cc:134]618658 OpTilingFuncRegistry:Register op tiling function V2 for op_type:DiagPart
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.062.148 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:DynSeqOuter
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.062.272 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Expand
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.062.696 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Ger
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.062.806 [op_tiling_registry.cc:122]618658 OpTilingFuncRegistry:Register op tiling function V1 for op_type:IFMR
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.062.936 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:InTopKD
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.063.058 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:KlDivLossGrad
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.063.174 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:L1LossGrad
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.063.275 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNorm
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.063.379 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNormBetaGammaBackpropV2
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.063.558 [op_tiling_registry.cc:122]618658 OpTilingFuncRegistry:Register op tiling function V1 for op_type:LayerNormXBackprop
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.063.659 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNormXBackpropV2
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.063.764 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNormXBackpropV3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.063.869 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LpNormReduce
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.063.899 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LpNormReduceV2
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.063.997 [op_tiling_registry.cc:134]618658 OpTilingFuncRegistry:Register op tiling function V2 for op_type:LRUCacheV2
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.064.107 [op_tiling_registry.cc:134]618658 OpTilingFuncRegistry:Register op tiling function V2 for op_type:MaxPoolGradWithArgmaxV2
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.064.126 [op_tiling_registry.cc:134]618658 OpTilingFuncRegistry:Register op tiling function V2 for op_type:MaxPoolGradWithArgmaxV1
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.064.232 [op_tiling_registry.cc:122]618658 OpTilingFuncRegistry:Register op tiling function V1 for op_type:MaxPoolWithArgmaxV2
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.064.335 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:MovingSumWithSigmoid
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.064.440 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:MseLossGrad
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.064.631 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:NMSWithMask
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.064.801 [op_tiling_registry.cc:122]618658 OpTilingFuncRegistry:Register op tiling function V1 for op_type:PadD
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.064.895 [op_tiling_registry.cc:122]618658 OpTilingFuncRegistry:Register op tiling function V1 for op_type:PadV3Grad
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.064.996 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ReduceStdWithMean
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.065.104 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Resize
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.065.520 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ResizeBilinearV2
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.065.625 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ReverseV2
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.065.734 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Scale
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.065.911 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SigmoidFocalLoss
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.066.016 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SigmoidFocalLossGrad
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.066.135 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SignBitsPack
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.066.237 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SignBitsUnpack
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.066.338 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SmoothL1LossGradV2
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.066.436 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SmoothL1LossV2
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.066.536 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SoftMarginLossGrad
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.066.648 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SoftmaxFocalLossGrad
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.066.758 [op_tiling_registry.cc:134]618658 OpTilingFuncRegistry:Register op tiling function V2 for op_type:Sort
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.066.777 [op_tiling_registry.cc:134]618658 OpTilingFuncRegistry:Register op tiling function V2 for op_type:SortV2
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.066.875 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SparseApplyFtrlD
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.066.979 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SparseReshape
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.067.078 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SplitV
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.067.098 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Split
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.067.193 [op_tiling_registry.cc:122]618658 OpTilingFuncRegistry:Register op tiling function V1 for op_type:SquareSumAll
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.067.295 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SyncBatchNormGatherStats
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.067.399 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Tile
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.067.497 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:TileD
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.067.604 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:TileWithAxis
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.067.791 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Unpack
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.067.886 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.067.974 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.068.053 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.068.129 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AscendAntiQuantV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.068.216 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.068.300 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.068.327 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.068.417 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Concat] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.068.447 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ConcatV2] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.068.474 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.068.500 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.068.621 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.068.707 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.068.786 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.068.860 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.068.936 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.069.019 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.069.047 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.069.122 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.069.151 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.069.177 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.069.256 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.069.341 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.069.421 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.069.497 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.069.571 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.069.648 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.069.725 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.069.802 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.069.880 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.069.956 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.070.051 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.070.133 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.070.213 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.070.289 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.070.376 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.070.455 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.070.532 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.074.576 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:DepthToSpace
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.074.609 [op_tiling_registry.cc:148]618658 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SpaceToDepth
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.075.984 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.076.111 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.076.251 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.076.520 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.076.650 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.076.766 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DeformableOffsetsGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.076.878 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.077.031 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.077.141 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.077.295 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.077.443 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.077.559 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.077.670 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.077.795 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachNonFiniteCheckAndUnscale] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.077.918 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.078.034 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.078.065 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.078.222 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GatherV3] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.078.347 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.078.486 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.078.609 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.078.724 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.078.757 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.078.869 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.078.983 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.079.134 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LinSpace] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.079.254 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MemSet] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.079.365 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.079.486 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.079.611 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.079.722 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.079.840 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.079.954 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NPUClearFloatStatus] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.080.066 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NPUGetFloatStatus] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.080.200 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.080.234 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.080.454 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.080.572 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.080.720 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.080.921 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.081.039 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.081.250 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.081.405 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.081.517 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.081.546 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.081.666 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.081.696 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.081.808 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.081.916 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.081.945 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.082.063 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.082.173 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.082.285 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.082.398 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.082.600 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.082.631 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.082.737 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.082.850 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.083.047 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.083.159 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.083.277 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.083.386 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.083.504 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.083.704 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.083.869 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.084.022 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.084.199 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.084.328 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.084.441 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.084.554 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BlendFaceBgPartOne] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.084.665 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.084.779 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.085.038 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.085.202 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.085.252 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNN, funcPointer:0xffff19345d70, registered count:1
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.085.423 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.085.447 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNNV2, funcPointer:0xffff1934e248, registered count:2
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.085.572 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.085.687 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.085.833 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.085.948 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GridSampler2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.086.068 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GridSampler3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.086.184 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandle] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.086.297 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandleV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.086.406 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.086.532 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PasteSubImg] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.086.653 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.086.681 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.086.796 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.086.904 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.087.025 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.087.136 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.087.247 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.087.365 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.087.473 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TabulateFusionGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.087.588 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[YUV4442YUV422] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.087.740 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.087.769 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.087.797 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.087.823 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.087.974 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.088.091 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.088.218 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.088.331 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.088.444 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.088.549 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.088.577 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.088.604 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.088.724 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.088.836 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.088.966 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.089.155 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicAtomicAddrClean] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.089.270 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.089.378 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.089.497 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.089.617 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.089.726 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.089.839 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.089.869 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceMeanD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.089.979 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.090.086 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.090.125 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.090.398 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.090.507 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.090.616 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.090.736 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.090.846 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.090.962 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.091.077 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.091.185 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.091.386 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.091.504 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.091.626 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.094.135 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DepthToSpace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.094.182 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.094.211 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SpaceToDepth] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.094.344 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.094.465 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.094.581 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.094.699 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.094.815 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.094.925 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.095.041 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.095.155 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.095.278 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.095.307 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.095.432 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.095.461 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.095.581 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.095.610 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.095.719 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.095.828 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.095.944 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.096.058 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.096.298 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.096.581 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.096.748 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.096.862 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.096.985 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.097.102 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.097.756 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNormGradV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.098.546 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.098.862 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.099.312 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.099.895 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.100.018 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.100.133 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.100.307 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.100.429 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.100.713 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPool3DWithArgmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.102.888 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPool3DGradWithArgmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.103.707 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.103.869 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.104.029 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CTCLossV3Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.105.024 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CTCLossV3] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.105.178 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.105.342 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3DGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.105.801 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.105.921 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.106.049 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.106.164 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.106.279 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.106.399 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.106.515 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.106.627 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.106.739 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.106.853 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.106.980 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.107.135 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PadV3GradReplication] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.107.253 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.107.373 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.107.560 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.107.682 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.107.791 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.107.905 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.108.056 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.108.243 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.108.362 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.108.484 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.108.513 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.108.695 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.108.812 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.108.950 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.109.124 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.109.241 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.109.406 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.109.520 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.109.639 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.109.757 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.109.786 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.109.900 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.109.930 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.110.043 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.110.154 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.110.182 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.110.302 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.110.415 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.110.539 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.110.717 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.110.836 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.111.030 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GridSampler2DGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.111.182 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GridSampler3DGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.111.357 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.111.541 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.111.720 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PadV4Grad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.111.918 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PadV3GradReplicate] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.112.032 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.112.168 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.112.282 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.112.394 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.112.429 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.112.615 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.112.730 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.112.848 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.112.965 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.113.082 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.113.193 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.113.305 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.113.333 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.113.456 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.113.684 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.114.914 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.117.314 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.117.515 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.117.718 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.118.026 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.118.194 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.118.373 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.119.176 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.119.335 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.119.462 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.119.614 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyAdamWV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.119.773 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.119.915 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.120.073 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.120.255 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.120.408 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.120.552 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.120.671 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.120.771 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.079 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.114 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.141 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.167 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.197 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.223 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.250 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.277 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.302 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.328 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.366 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.395 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.422 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.447 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.472 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.497 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.523 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.548 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.574 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.599 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.624 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.649 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.675 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.700 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.725 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.752 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.777 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.803 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.828 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.853 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.878 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.905 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.930 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.965 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.121.991 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.122.016 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.122.041 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.122.067 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.122.097 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.122.126 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.122.151 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.122.176 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.122.201 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.122.226 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.122.251 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.122.276 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.122.301 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.122.326 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.122.352 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.122.377 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.122.402 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.122.428 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.122.453 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.122.478 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.122.504 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.122.529 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.122.704 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachACosInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.122.860 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.123.030 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMulScalarInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.123.061 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachLogInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.123.089 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSubListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.123.116 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMulListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.123.142 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachDivListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.123.290 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSubScalarInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.123.404 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.123.519 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.123.636 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.123.758 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.123.874 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.124.038 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.124.171 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.124.339 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.124.469 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.124.590 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.124.620 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.124.647 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.124.772 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.124.802 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.124.829 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.124.960 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.125.121 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.125.299 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.125.451 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.125.571 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.125.763 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IndexPutWithSort] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.125.892 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.126.088 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InplaceIndexAddWithSorted] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.126.210 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.126.332 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.126.361 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.126.388 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.126.562 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.126.735 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.126.892 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.127.045 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.127.240 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.127.397 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.127.521 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.127.690 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.127.861 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.128.048 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.128.201 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.128.335 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.128.457 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.128.584 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.128.705 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.128.869 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.129.033 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.129.152 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Resize] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.129.270 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.129.392 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.129.524 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.129.640 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.130.097 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.130.568 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.130.688 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.130.809 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.130.839 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.130.968 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.131.089 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.131.208 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.131.330 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.131.452 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.131.576 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.131.704 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.131.832 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.131.996 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.132.115 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.132.248 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.132.442 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.132.563 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.132.700 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.132.817 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.133.016 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.133.202 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.133.326 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RoiPoolingGradWithArgMax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.133.442 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.133.569 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.133.703 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.133.822 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.133.946 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.134.065 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.134.225 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StackBallQuery] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.134.348 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.134.515 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.134.783 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScoreGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.134.983 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.135.185 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.135.372 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.135.599 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.135.821 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.136.062 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.136.090 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.136.115 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.136.137 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.136.187 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.136.217 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.136.244 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.136.269 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.137.037 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.137.465 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.137.887 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.138.083 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.138.298 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.138.714 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.138.846 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.139.024 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.141.768 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.143.574 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.143.738 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.143.862 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.143.982 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.144.296 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CircularPad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.144.466 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CircularPadGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.144.657 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.145.000 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.145.035 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.145.063 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.145.090 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.145.116 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.145.314 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleLinear1d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.145.345 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleBilinear2d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.145.519 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleBicubic2d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.145.695 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.145.869 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAAGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.146.042 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.146.243 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.146.277 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.146.447 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.146.620 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAABackward] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.146.794 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.146.996 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ResizeUpsampleTrilinear] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.147.166 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dBackward] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.147.334 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.147.365 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.147.519 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleNearest] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.147.723 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleNearestExact2dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.147.754 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleNearest2dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.147.867 [op_tiling_registry.cc:134]618658 OpTilingFuncRegistry:Register op tiling function V2 for op_type:AvgPoolGrad
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.147.900 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.148.028 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.148.058 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.148.207 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.148.242 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.148.371 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.148.492 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.148.625 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.148.756 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.148.877 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.148.990 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.149.194 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.149.414 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.149.804 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.150.209 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.150.433 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.150.767 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.150.969 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.151.157 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReflectionPad3dGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.151.262 [op_tiling_registry.cc:134]618658 OpTilingFuncRegistry:Register op tiling function V2 for op_type:AvgPool
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.151.297 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.151.408 [op_tiling_registry.cc:134]618658 OpTilingFuncRegistry:Register op tiling function V2 for op_type:AvgPoolV2
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.151.441 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.151.596 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.151.626 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.151.657 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.151.686 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantConv2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.152.823 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.153.281 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.153.439 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.153.593 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.153.747 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.153.782 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.153.926 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.154.077 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.154.226 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.154.258 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.154.419 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.154.592 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.154.750 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.154.921 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.155.076 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AGLU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.155.487 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.155.850 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.156.088 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.156.303 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.157.383 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.157.835 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.158.403 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NLLLossGrad310p] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.158.570 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.158.733 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.158.854 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DropoutWithMulsAndSoftmaxGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.159.028 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.159.182 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.159.216 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.159.334 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.159.365 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.159.712 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.159.829 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.159.992 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachBinaryOp] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.160.186 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.160.322 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.160.636 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.160.839 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.160.997 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.161.121 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.161.241 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.161.415 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InstanceNormV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.161.598 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IouV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.161.781 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BidirectionLSTM] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.161.813 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BidirectionLSTMV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.161.981 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.162.013 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.162.186 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaskedSelectV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.162.380 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.163.899 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.169.635 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.169.684 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.172.484 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.172.754 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.173.055 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MedianDim] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.173.392 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.173.603 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.173.819 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.173.987 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.174.149 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeTutelCombineGates] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.174.333 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeTutelCombineX] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.174.473 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeTutelDispatch] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.174.569 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.174.822 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScore] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.174.951 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.175.104 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.175.573 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Rfft1D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.175.740 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.175.903 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.175.940 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GemmaRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.176.054 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.176.195 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.176.380 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LinearIndex] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.176.585 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LinearIndexV2] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.176.780 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterAddWithSorted] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.176.947 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Sinkhorn] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.177.075 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.177.197 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.177.232 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.177.883 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.178.117 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StackGroupPoints] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.178.278 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.178.400 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.178.556 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.178.587 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.178.721 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.178.839 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.178.869 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.178.896 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.179.049 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.179.252 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.179.346 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.179.589 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.179.786 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.179.819 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.179.847 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.180.045 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.180.078 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.182.870 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: Conv2DBackpropFilter, registered count: 1
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.182.967 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: Conv2DBackpropInput, registered count: 2
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.182.995 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: Conv2DTranspose, registered count: 3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.183.067 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: Conv2D, registered count: 4
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.183.148 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: Conv3DBackpropInput, registered count: 5
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.183.183 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: Conv3DTranspose, registered count: 6
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.183.257 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: Conv3D, registered count: 7
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.183.415 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: FFN, registered count: 8
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.183.436 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: MatmulTunnerTiling, registered count: 9
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.183.552 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: MatMulV2, registered count: 10
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.183.576 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: BatchMatmulFixpipe, registered count: 11
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.183.601 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: MatMulV3, registered count: 12
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.183.623 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: QuantBatchMatmulV3, registered count: 13
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.183.797 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: DynamicRNN, registered count: 14
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.183.818 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: MatMulTunnerTiling, registered count: 15
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.185.008 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:MatMulV2, funcPointer:0xffff19c98a10, registered count:3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.185.047 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:MatMulV2, funcPointer:0xffff19c98c70, registered count:1
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.185.465 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.185.947 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.187.643 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.187.810 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.187.897 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.188.321 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.188.780 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.219.206 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.219.347 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.219.537 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.219.623 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.219.779 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.219.921 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.220.558 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.220.653 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.220.920 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.221.008 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MlaAttentionScore] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.221.169 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.221.409 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.221.576 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.221.990 [op_tiling_manager.cc:79]618658 LoadSo:dlopen file /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so successfully!
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.222.070 [op_tiling_manager.cc:58]618658 LoadSo:[FindSo][Check] Get path with op_master [/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_master/] failed
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.222.299 [op_tiling_manager.cc:67]618658 LoadSo:Failed to dlopen /usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.222.347 [op_tiling_manager.cc:73]618658 LoadSo:Failed to dlopen /usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.222.415 [op_tiling_manager.cc:58]618658 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.222.472 [op_tiling_manager.cc:67]618658 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.222.513 [op_tiling_manager.cc:73]618658 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.222.572 [op_tiling_manager.cc:58]618658 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.222.620 [op_tiling_manager.cc:67]618658 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.223.620 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:AllFinite, funcPointer:(nil), registered count:2
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.223.658 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:AllFinite, funcPointer:(nil), registered count:4
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.223.683 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:AllFinite, funcPointer:(nil), registered count:1
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.223.706 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:AllFinite, funcPointer:(nil), registered count:1
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.223.731 [op_check.cc:71]618658 RegisterParamGeneralize:RegisterParamGeneralize: op_type:AllFinite, funcPointer:(nil), registered count:1
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.224.071 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff543349b0, registered count:3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.224.098 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:5
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.224.121 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:2
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.224.141 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:2
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.224.183 [op_check.cc:71]618658 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:2
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.224.514 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff54337da0, registered count:4
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.224.542 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.224.563 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.224.584 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.224.603 [op_check.cc:71]618658 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.224.921 [op_tiling_manager.cc:75]618658 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.224.980 [op_tiling_manager.cc:58]618658 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.225.067 [op_tiling_manager.cc:67]618658 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.225.825 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff542ee2c0, registered count:4
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.225.860 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.225.881 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.225.901 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.225.920 [op_check.cc:71]618658 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.226.254 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff542f2978, registered count:4
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.226.281 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.226.302 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.226.323 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.226.342 [op_check.cc:71]618658 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.226.640 [op_tiling_manager.cc:75]618658 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.226.693 [op_tiling_manager.cc:58]618658 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.226.776 [op_tiling_manager.cc:67]618658 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.226.843 [op_tiling_manager.cc:73]618658 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.226.886 [op_tiling_manager.cc:58]618658 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.226.932 [op_tiling_manager.cc:67]618658 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.226.967 [op_tiling_manager.cc:75]618658 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.227.008 [op_tiling_manager.cc:58]618658 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.227.049 [op_tiling_manager.cc:67]618658 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.227.083 [op_tiling_manager.cc:75]618658 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.227.122 [op_tiling_manager.cc:58]618658 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.227.161 [op_tiling_manager.cc:67]618658 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.227.199 [op_tiling_manager.cc:73]618658 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.227.247 [op_tiling_manager.cc:58]618658 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.227.291 [op_tiling_manager.cc:67]618658 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.227.324 [op_tiling_manager.cc:75]618658 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.227.363 [op_tiling_manager.cc:58]618658 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.227.402 [op_tiling_manager.cc:67]618658 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.227.434 [op_tiling_manager.cc:75]618658 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.227.472 [op_tiling_manager.cc:58]618658 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.227.511 [op_tiling_manager.cc:67]618658 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.227.548 [op_tiling_manager.cc:73]618658 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.227.586 [op_tiling_manager.cc:58]618658 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.227.625 [op_tiling_manager.cc:67]618658 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.227.666 [op_tiling_manager.cc:75]618658 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.227.705 [op_tiling_manager.cc:58]618658 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.227.748 [op_tiling_manager.cc:67]618658 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.227.782 [op_tiling_manager.cc:75]618658 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.227.820 [op_tiling_manager.cc:58]618658 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.227.859 [op_tiling_manager.cc:67]618658 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.227.897 [op_tiling_manager.cc:73]618658 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.227.936 [op_tiling_manager.cc:58]618658 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.227.975 [op_tiling_manager.cc:67]618658 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.228.008 [op_tiling_manager.cc:75]618658 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.228.053 [op_tiling_manager.cc:58]618658 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.228.094 [op_tiling_manager.cc:67]618658 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.228.126 [op_tiling_manager.cc:75]618658 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.228.149 [op_tiling_manager.cc:109]618658 ~FuncPerfScope:[GEPERFTRACE] The time cost of OpTilingManager::LoadSo is [189461] micro seconds.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.228.303 [plugin_manager.cc:639]618658 GetConstantFoldingOpsPath:Enter GetConstantFoldingOpsPath schedule
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.228.327 [plugin_manager.cc:108]618658 GetOppPath:Enter get opp path schedule
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.228.356 [plugin_manager.cc:117]618658 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.228.423 [host_cpu_engine.cc:254]618658 LoadLib:To invoke dlopen on lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libconstant_folding_ops.so
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.233.851 [host_cpu_engine.cc:273]618658 LoadLib:Lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libconstant_folding_ops.so has been opened
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.233.920 [host_cpu_engine.cc:254]618658 LoadLib:To invoke dlopen on lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libops_host_cpu.so
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.240.050 [host_cpu_engine.cc:267]618658 LoadLib:Invoke function Initialize in lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libops_host_cpu.so
[INFO] OP(618658,python3.9):2025-04-03-09:27:39.242.892 [host_cpu_kernel_wrapper.cpp:88][OP_PROTO][Initialize][618658] OpName:[HostCpuKernelWrapperOp] "Host cpu dlopen so[/usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libaicpu_const_folding.so] success"
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.242.932 [folding.cc:404][InitCpuConstantFoldingNew][tid:618658]:"Init cpu constant folding begin."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.242.984 [folding.cc:408][InitCpuConstantFoldingNew][tid:618658]:"Number of registered ops: 234"
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.003 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Acos]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.024 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Acosh]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.042 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[ActiveRotatedFilter]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.058 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[ActiveRotatedFilterGrad]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.075 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[AdaptiveAvgPool2dAssistMatrix]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.089 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[AdaptiveAvgPoolAssistMatrix]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.119 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[AdaptiveMaxPool2d]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.133 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Add]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.148 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Addcdiv]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.164 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Addcmul]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.177 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[AffineGrid]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.192 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[ApplyAdamV2]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.209 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Asin]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.221 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Asinh]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.239 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Assert]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.252 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Atan]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.267 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Atan2]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.284 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Atanh]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.297 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[AvgPoolV2]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.314 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Betainc]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.328 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Bucketize]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.342 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[CTCLossV2]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.359 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[CTCLossV2Grad]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.372 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[CacheSwapTable]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.385 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[CalcBucketsLimitAndOffset]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.402 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[CaseCondition]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.414 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Cast]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.429 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Ceil]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.445 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[CheckNumerics]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.458 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[ClipByValue]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.471 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[ClipByValueV2]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.485 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Combinations]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.501 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[CompareAndBitpack]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.514 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[ComputeAccidentalHits]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.528 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[ConcatV2]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.549 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Conj]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.563 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[ConjugateTranspose]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.577 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Coordinates1DTo2D]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.593 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Cosh]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.606 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[CropAndResize]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.620 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Cross]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.636 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Cummax]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.649 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Cummin]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.662 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Cumsum]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.678 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Div]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.692 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[DynamicStitch]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.706 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[EditDistance]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.723 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Elu]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.736 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[EluGrad]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.751 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[EmbeddingApplyAdaGrad]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.767 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[EmbeddingApplyAdam]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.780 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[EmbeddingApplyAdamW]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.794 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[EmbeddingApplyFtrl]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.810 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[EmbeddingApplyRmsprop]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.823 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[EmbeddingApplySgd]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.837 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[EmbeddingComputeVarExport]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.853 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[EmbeddingComputeVarImport]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.866 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[EmbeddingFeatureMappingExport]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.880 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[EmbeddingFeatureMappingFileSize]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.893 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[EmbeddingFeatureMappingImport]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.909 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[EmbeddingHashmapExport]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.922 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[EmbeddingHashmapFileSize]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.936 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[EmbeddingHashmapImport]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.957 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[EmbeddingLookup]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.970 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[EmbeddingTableEvict]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.243.984 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[EmbeddingTableExport]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.000 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[EmbeddingTableFind]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.013 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[EmbeddingTableFindAndInit]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.031 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[EmbeddingTableImport]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.044 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Equal]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.058 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Expand]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.074 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[ExpandDims]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.087 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Exponential]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.101 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[ExponentialDecayLR]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.118 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Fill]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.131 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[FillDiagonal]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.145 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Fills]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.178 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Floor]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.201 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[FloorDiv]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.218 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[FloorMod]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.231 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[GEMM]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.245 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[GatherElements]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.261 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[GatherV2]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.274 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Geometric]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.287 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[GetDynamicDims]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.300 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Greater]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.316 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[GreaterEqual]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.329 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[GridSampler2D]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.343 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[GridSampler2DGrad]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.359 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[GridSampler3D]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.372 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[GridSampler3DGrad]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.385 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Histogram]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.406 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[IMGWarpOffsets]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.420 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Identity]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.438 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[IndexToAddr]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.451 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[InitEmbeddingHashmap]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.466 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[InitPartitionMap]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.482 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[InplaceIndexAdd]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.495 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[InplaceTopKDistance]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.508 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[InvGrad]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.524 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[InvertPermutation]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.539 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[IsClose]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.557 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[IsInf]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.570 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[IsNan]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.586 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Less]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.602 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[LinSpace]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.615 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[LinearSumAssignment]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.630 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Log]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.646 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Log1p]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.659 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[LogMatrixDeterminant]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.677 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[LogSoftmaxV2]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.690 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[LogUniformCandidateSampler]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.705 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[MaskedFill]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.721 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[MaskedScatter]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.734 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[MaskedSelect]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.747 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[MaskedSelectGrad]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.762 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[MatMul]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.778 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[MatrixDiagPartV3]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.791 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[MatrixDiagV3]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.809 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[MinAreaPolygons]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.838 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Mul]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.852 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[MultinomialAliasDraw]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.870 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[MultinomialAliasSetup]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.883 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[MultinomialWithReplacement]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.897 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[NLLLoss]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.913 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[NLLLossGrad]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.926 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[NMSWithMask]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.941 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Neg]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.959 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[NonMaxSuppressionV3]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.973 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[NonZero]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.244.989 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[NonZeroWithValueShape]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.003 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[NonZeroWithValueShapeV2]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.020 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[NotEqual]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.034 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[OnesLike]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.051 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[PSAMask]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.063 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[PSAMaskGrad]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.078 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Pad]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.095 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[PadD]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.108 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[PadV3]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.126 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[PadV3Grad]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.138 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Pinverse]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.153 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Poisson]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.167 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Pow]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.183 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[ProdEnvMatACalcRij]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.196 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[RNNTLoss]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.214 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[RandomStandardNormal]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.228 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[RandomUniform]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.246 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[RealDiv]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.259 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[ReduceAll]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.283 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[ReduceMean]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.296 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[ReduceSum]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.310 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Reshape]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.326 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Resize]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.339 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[ResizeBilinear]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.354 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[ResizeBilinearGrad]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.371 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[ResizeBilinearV2Grad]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.387 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[ResizeGrad]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.404 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[ResizeTrilinear]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.418 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[ReverseSequence]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.432 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[RightShift]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.449 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[RoiPoolingWithArgMax]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.462 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[RotatedNMS]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.475 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Round]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.492 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Rsqrt]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.504 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[STFT]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.518 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[ScatterAddWithAxis]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.534 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[ScatterElements]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.547 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[ScatterNdAdd]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.561 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[ScatterNdMax]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.577 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[ScatterNdMin]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.590 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[SearchSorted]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.603 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[SelectV2]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.617 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Sigmoid]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.633 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[SigmoidGrad]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.646 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Sign]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.663 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[SilentCheck]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.676 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[SilentCheckV2]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.701 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[SilentCheckV3]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.715 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[SliceWrite]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.732 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[SoftmaxV2]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.745 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Sort]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.763 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[SparseFillEmptyRows]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.776 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[SparseSegmentMean]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.791 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[SparseSegmentMeanGrad]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.808 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[SparseSegmentSum]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.821 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[SparseToDense]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.838 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[SpatialTransformer]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.852 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[SplitD]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.869 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[SplitV]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.882 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Sqrt]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.898 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[SqrtGrad]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.911 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Square]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.925 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[SquaredDifference]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.941 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[StatelessBernoulli]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.956 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[StatelessRandomUniformV2]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.973 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[StatelessRandperm]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.245.985 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[StridedSlice]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.000 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[StridedSliceV2]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.017 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Sub]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.030 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[TableToResource]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.043 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Tan]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.059 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[TanhGrad]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.073 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[TensorEqual]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.090 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[TensorScatterUpdate]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.104 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[ThreeNN]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.121 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Tile]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.142 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[TileWithAxis]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.155 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[TopK]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.169 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[TopKPQDistance]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.186 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[TopKPQDistanceV2]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.199 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[TopKV2D]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.213 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Trace]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.230 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[TransData]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.242 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[TransDataRNN]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.257 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Tril]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.274 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Triu]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.287 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[UniformCandidateSampler]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.302 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[UninitEmbeddingHashmap]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.318 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[UninitPartitionMap]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.331 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[UniqueConsecutive]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.346 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[UniqueWithCountsAndSorting]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.362 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[UniqueWithCountsExt2]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.375 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[UpsampleNearest3d]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.389 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[UpsampleNearest3dGrad]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.405 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[UpsampleTrilinear3d]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.418 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[UpsampleTrilinear3dGrad]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.431 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[ViewCopy]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.448 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Voxelization]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.460 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[WarpAffine]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.475 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[ZerosLike]."
[INFO] AICPU(618658,python3.9):2025-04-03-09:27:39.246.492 [folding.cc:413][InitCpuConstantFoldingNew][tid:618658]:"Register op[Zeta]."
[INFO] OP(618658,python3.9):2025-04-03-09:27:39.246.509 [host_cpu_kernel_wrapper.cpp:118][OP_PROTO][Initialize][618658] OpName:[HostCpuKernelWrapperOp] "Host cpu init success"
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.246.527 [host_cpu_engine.cc:273]618658 LoadLib:Lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libops_host_cpu.so has been opened
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.246.669 [plugin_manager.cc:872]618658 LoadWithFlags:Dlopen path: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/plugin/engines/runtime/libdvpp_rtkernel.so. flags is 4354
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.250.085 [plugin_manager.cc:883]618658 LoadWithFlags:The shared library will not be checked. Please ensure that the source of the shared library is trusted.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.250.156 [ops_kernel_executor_manager.cc:37]618658 Initialize:No library to load
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.250.178 [plugin_manager.cc:540]618658 GetOpsProtoPath:Enter GetOpsProtoPath schedule
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.250.190 [plugin_manager.cc:108]618658 GetOppPath:Enter get opp path schedule
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.250.224 [plugin_manager.cc:117]618658 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.250.247 [plugin_manager.cc:547]618658 GetOpsProtoPath:Opp plugin path structure is new version!
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.250.266 [plugin_manager.cc:206]618658 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.251.084 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.251.138 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.251.157 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.251.171 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.251.222 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.251.571 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.251.609 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.251.628 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.251.641 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.251.678 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.251.733 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.251.751 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.251.764 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.251.780 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.251.816 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.251.833 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.251.846 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.251.860 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.252.216 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.252.257 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.252.278 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.252.291 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.252.328 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.252.668 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.252.705 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.252.724 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.252.737 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.252.777 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.252.826 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.252.844 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.252.857 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.252.872 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.252.904 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.252.921 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.252.934 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.252.947 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.253.287 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.253.324 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.253.341 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.253.354 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.253.390 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.253.742 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.253.778 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.253.794 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.253.808 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.253.860 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.253.897 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.253.914 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.253.929 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.253.943 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.253.976 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.253.992 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.254.005 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.254.020 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.254.359 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.254.394 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.254.412 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.254.425 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.254.465 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.254.807 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.254.840 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.254.858 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.254.871 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.254.921 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.254.958 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.254.976 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.254.989 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.255.003 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.255.036 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.255.052 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.255.065 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.255.080 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.255.421 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.255.456 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.255.474 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.255.488 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.255.523 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.255.869 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.255.905 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.255.923 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.255.952 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.255.987 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.256.023 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.256.041 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.256.054 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.256.068 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.256.101 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.256.117 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.256.130 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.256.144 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.256.178 [plugin_manager.cc:218]618658 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.256.205 [plugin_manager.cc:422]618658 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.256.220 [plugin_manager.cc:155]618658 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.256.242 [plugin_manager.cc:158]618658 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.256.266 [plugin_manager.cc:426]618658 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.256.605 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.256.643 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.256.661 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.256.674 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.256.711 [plugin_manager.cc:439]618658 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspo
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.256.733 [ge_executor.cc:259]618658 InitOpsProtoManager:Get opsproto path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/minds
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.257.109 [plugin_manager.cc:996]618658 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.257.143 [plugin_manager.cc:1011]618658 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.257.166 [plugin_manager.cc:1015]618658 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.257.269 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.257.289 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.257.365 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.257.394 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.257.425 [opsproto_manager.cc:123]618658 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.257.474 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.257.491 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.257.520 [opsproto_manager.cc:123]618658 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.257.566 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.257.583 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 2 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.257.646 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.257.663 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.257.725 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.257.742 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.257.768 [opsproto_manager.cc:123]618658 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.257.812 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.257.829 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 3 libs.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.257.855 [opsproto_manager.cc:123]618658 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.257.899 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.257.915 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 4 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.257.978 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.258.000 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.258.063 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.258.080 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.258.107 [opsproto_manager.cc:123]618658 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.258.151 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.258.167 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 5 libs.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.258.195 [opsproto_manager.cc:123]618658 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.258.240 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.258.256 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 6 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.258.319 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.258.335 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.258.397 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.258.413 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.258.441 [opsproto_manager.cc:123]618658 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.258.484 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.258.501 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 7 libs.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.258.527 [opsproto_manager.cc:123]618658 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.258.577 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.258.594 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 8 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.258.656 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.258.672 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.258.734 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.258.750 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.258.777 [opsproto_manager.cc:123]618658 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.258.822 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.258.838 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 9 libs.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.258.865 [opsproto_manager.cc:123]618658 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.258.908 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.258.924 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 10 libs.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.258.950 [opsproto_manager.cc:123]618658 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/usr/local/Ascend/ascend-toolkit/latest/opp/op_proto/custom/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.258.991 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 10 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.259.054 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.259.071 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.259.084 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.259.097 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 3 libs.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.259.120 [opsproto_manager.cc:147]618658 LoadOpsProtoPluginSo:[LoadSo][Check] Shared library will not be checked. Please make sure that the source of shared library is trusted.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.259.448 [operator_factory_impl.cc:215]618658 RegisterInferShapeFunc:operator_infershape_funcs_ init
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.259.474 [operator_factory_impl.cc:269]618658 RegisterVerifyFunc:operator_verify_funcs_ init
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.259.511 [opsproto_manager.cc:162]618658 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.265.544 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Igammac] has registered infer func
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.266.362 [opsproto_manager.cc:162]618658 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.266.448 [opsproto_manager.cc:162]618658 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.266.495 [opsproto_manager.cc:162]618658 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.266.530 [opsproto_manager.cc:162]618658 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.266.562 [opsproto_manager.cc:162]618658 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.266.593 [opsproto_manager.cc:162]618658 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.266.623 [opsproto_manager.cc:162]618658 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.266.653 [opsproto_manager.cc:162]618658 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.266.684 [opsproto_manager.cc:162]618658 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.286.087 [operator_factory_impl.cc:368]618658 RegisterInferAxisTypeInfoFunc:axis type info derivation funcs init
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.286.340 [operator_factory_impl.cc:284]618658 RegisterInferDataSliceFunc:operator_infer_data_slice_funcs_ init
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.286.539 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [MatrixBandPart] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.286.566 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [CheckNumerics] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.286.595 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [UnravelIndex] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.286.609 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [UpperBound] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.286.625 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [ListDiff] has registered infer func
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.286.649 [operator_factory_impl.cc:254]618658 RegisterInferFormatFunc:operator_inferformat_funcs_ init
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.286.674 [operator_factory_impl.cc:340]618658 RegisterInferAxisSliceFunc:axis slice derivation funcs init
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.286.702 [operator_factory_impl.cc:307]618658 RegisterInferValueRangeFunc:operator_infervalue_paras_ init
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.286.732 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [IdentityN] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.286.753 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [LowerBound] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.286.778 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Expand] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.286.895 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [LeftShift] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.287.760 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Reciprocal] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.287.794 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Sign] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.287.814 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Div] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.287.835 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Exp] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.287.856 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [LessEqual] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.287.874 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Log1p] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.287.898 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [DivNoNan] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.287.938 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Mul] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.287.957 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [SqrtGrad] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.287.975 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Log] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.287.990 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [AddN] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.288.013 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [AcosGrad] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.288.030 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [AcoshGrad] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.288.062 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [BiasAdd] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.288.095 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [FloorDiv] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.288.118 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [ArgMin] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.288.206 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [MulNoNan] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.288.254 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [AsinGrad] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.288.277 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Cos] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.288.295 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Sin] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.288.324 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [AsinhGrad] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.288.349 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Expm1] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.289.563 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [AdjustHue] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.289.594 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [AdjustSaturation] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.289.621 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [ExtractGlimpse] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.289.643 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [ResizeArea] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.289.661 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [ResizeBicubic] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.289.678 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [RGBToHSV] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.289.700 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [NonMaxSuppressionWithOverlaps] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.289.740 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [ScaleAndTranslate] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.289.757 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [ScaleAndTranslateGrad] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.289.771 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [CombinedNonMaxSuppression] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.289.879 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [CholeskyGrad] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.289.899 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Cholesky] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.289.916 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [MatrixDeterminant] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.289.933 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [MatrixSolve] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.289.946 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [MatrixTriangularSolve] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.289.957 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Qr] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.290.295 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Digamma] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.290.317 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Igamma] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.290.332 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Igammac] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.290.366 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Bincount] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.290.384 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Betainc] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.290.398 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Bucketize] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.290.417 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [IgammaGradA] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.290.444 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [NextAfter] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.290.464 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [IsInf] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.290.482 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [IsNan] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.290.496 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Conj] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.290.526 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Complex] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.290.544 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Angle] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.290.788 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [ScatterNdUpdate] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.290.811 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [TensorScatterUpdate] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.290.873 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Tril] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.290.892 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [IndexPut] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.290.906 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Eye] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.290.923 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [FillDiagonal] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.290.936 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Trace] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.291.883 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [DecodeBbox] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.291.914 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [ClipBoxes] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.291.934 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [ClipBoxesD] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.291.955 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [DecodeBoundariesTarget] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.291.973 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [DecodeCornerpointsTargetBG] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.291.989 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [DecodeCornerpointsTargetWrtCenterV1] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.292.006 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [DecodeWheelsTarget] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.292.135 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [SparseSoftmaxCrossEntropyWithLogits] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.292.254 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [KlDivLossGrad] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.292.628 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [FractionalMaxPoolGrad] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.292.650 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [FractionalAvgPool] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.292.665 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [FractionalMaxPool] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.292.685 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [DataFormatVecPermute] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.292.697 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [FractionalAvgPoolGrad] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.292.711 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [NthElement] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.293.186 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Tanh] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.293.513 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Pad] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.293.539 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [PadV3] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.293.557 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [PadV3Grad] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.293.575 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [BroadcastTo] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.293.746 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [RaggedRange] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.293.903 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [ShuffleChannel] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.294.203 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [ReduceSum] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.294.229 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [ReduceProd] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.294.266 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [INInferV2] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.294.282 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [INInferV2] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.294.882 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [UnsortedSegmentSum] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.294.926 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [ReverseV2] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.294.946 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Select] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.294.974 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [SegmentSum] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.294.995 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Slice] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.295.015 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [OneHot] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.295.039 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [ScatterNd] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.295.062 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Cumprod] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.295.126 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [CumulativeLogsumexp] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.295.169 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [MaskedSelect] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.295.597 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Concat] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.295.809 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [NonDeterministicInts] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.296.069 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [Flatten] has registered infer func
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.296.100 [operator_factory_impl.cc:222]618658 RegisterInferShapeFunc:op [DepthToSpace] has registered infer func
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.296.761 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.296.805 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[EluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.296.834 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.296.858 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.296.886 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SyncBNTrainingUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.296.913 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Abs] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.296.940 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Real] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.296.965 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Acos] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.296.995 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Acosh] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.022 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddMatMatElements] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.048 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Adds] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.074 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Asin] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.100 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Asinh] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.125 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AssignAdd] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.149 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AssignSub] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.174 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Atan] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.199 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Atanh] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.222 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.247 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BesselI0e] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.283 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BesselI1e] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.304 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.330 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.352 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.373 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.399 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Bucketize] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.424 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Cast] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.452 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Ceil] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.478 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CeluV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.511 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ComplexAbs] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.538 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Cos] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.564 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Cosh] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.585 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.610 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DataFormatDimMap] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.636 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Dequantize] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.662 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Elu] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.687 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Erf] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.711 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Erfc] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.736 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Exp] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.760 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Expm1] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.786 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FakeQuantWithMinMaxVars] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.811 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FastGelu] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.835 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FastGeluV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.860 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Floor] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.889 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FusedMulAddN] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.923 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HardSigmoid] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.948 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HardShrink] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.973 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HardShrinkGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.297.998 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HardSwish] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.023 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HardSwishGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.048 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HardtanhGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.074 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IndexFillD] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.098 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.119 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.148 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Inv] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.172 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Invert] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.200 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Log] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.226 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Log1p] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.254 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LogicalNot] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.279 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LogAddExp] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.304 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LpNormUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.329 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LpNormUpdateV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.356 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Dawsn] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.381 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Expint] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.405 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Erfinv] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.430 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FresnelCos] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.454 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FresnelSin] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.480 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Ndtri] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.506 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Spence] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.530 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Fills] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.562 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LeakyRelu] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.596 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[OnesLike] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.621 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Reciprocal] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.647 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Sign] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.672 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Sqrt] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.697 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Tanh] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.723 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ZerosLike] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.749 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Gelu] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.774 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GeluV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.799 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Relu] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.824 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Neg] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.850 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LogSoftmaxV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.872 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.897 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftmaxV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.919 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.944 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftplusV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.298.972 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Muls] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.000 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Power] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.026 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Relu6] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.051 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Relu6D] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.076 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Relu6Grad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.100 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.126 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Rint] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.151 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Round] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.178 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Rsqrt] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.210 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RsqrtGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.234 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Selu] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.259 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Shrink] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.284 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Sigmoid] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.309 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.336 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SigmoidGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.361 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Sin] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.386 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Sinh] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.412 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SmoothL1Loss] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.436 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SmoothL1LossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.460 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LogSigmoid] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.485 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LogSigmoidGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.509 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LogSpaceD] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.535 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Softplus] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.559 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Softsign] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.584 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SqrtGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.608 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Square] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.633 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Swish] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.658 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwishGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.684 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SiluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.709 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardElemt] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.734 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Tan] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.761 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftShrink] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.787 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftShrinkGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.812 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Threshold] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.842 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ThresholdV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.867 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ThresholdV2D] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.892 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Trunc] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.914 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.936 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.961 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MishGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.299.989 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HardSigmoidGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.010 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.031 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.053 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.075 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.100 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FillDiagonal] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.126 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IndexPut] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.151 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReadVariableOp] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.198 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CastLike] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.231 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FusedBiasLeakyRelu] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.257 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StatelessBernoulliV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.279 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.306 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InvertPermutation] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.327 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.351 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SearchSorted] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.373 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.394 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.416 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.444 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.468 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.586 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaskedScale] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.619 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AbsGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.646 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AccumulateNV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.671 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddN] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.697 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Eltwise] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.723 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.752 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AcosGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.777 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AcoshGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.802 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AsinGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.829 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AsinhGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.854 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Atan2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.879 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AtanGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.903 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Axpy] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.929 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BitwiseAnd] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.956 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BitwiseOr] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.300.982 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BitwiseXor] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.008 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Div] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.036 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DivNoNan] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.061 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[EluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.086 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FastGeluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.111 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FloorDiv] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.135 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FloorMod] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.161 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InvGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.193 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LeakyReluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.220 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TanhGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.246 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Add] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.271 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Addcdiv] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.298 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Addcmul] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.323 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AxpyV2] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.348 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LogicalAnd] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.373 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LogicalOr] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.399 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Mul] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.424 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Pow] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.449 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RealDiv] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.475 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ClipByNormNoDivSum] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.502 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ClipByValue] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.527 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ClipByValueV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.553 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FusedMulAdd] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.581 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftmaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.606 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Sub] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.634 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Gcd] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.659 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LarsV2Update] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.684 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaskedFill] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.709 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.734 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Xlog1py] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.760 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApproximateEqual] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.788 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Equal] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.816 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NotEqual] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.847 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Greater] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.873 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GreaterEqual] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.898 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Less] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.923 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LessEqual] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.949 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Maximum] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.301.976 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Minimum] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.302.001 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Mod] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.302.023 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.302.048 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MulNoNan] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.302.073 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReciprocalGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.302.098 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SeluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.302.123 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogits] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.302.148 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftplusGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.302.173 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftplusV2Grad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.302.197 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftsignGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.302.222 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SquaredDifference] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.302.244 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.302.271 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ThresholdGradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.302.296 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TruncateDiv] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.302.321 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TruncateMod] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.302.347 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Xdivy] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.302.374 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IsClose] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.302.401 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Xlogy] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.302.423 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.302.447 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SelectV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.302.479 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaskedSelectV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.302.503 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Lerp] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.302.529 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FusedBiasLeakyReluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.302.640 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.302.752 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.302.859 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.302.974 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.303.111 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.303.139 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.303.174 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.303.199 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.303.312 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.303.425 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.303.538 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.303.651 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.303.761 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.303.885 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.304.000 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Quantize] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.304.027 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.304.053 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AscendDequant] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.304.079 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.304.198 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.304.311 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.304.350 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.304.377 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.304.400 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.304.421 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.304.449 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BasicLSTMInplaceFillWindowCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.304.475 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BasicGRUInplaceFillWindowCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.304.595 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.304.703 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.304.825 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.304.941 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.304.967 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.305.084 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdaCast] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.305.192 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.305.217 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.305.240 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.305.261 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.305.368 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.305.477 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.305.587 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.305.691 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.305.716 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.305.820 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.305.940 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.305.978 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.306.081 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.306.187 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.306.296 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.306.404 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.306.430 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.306.538 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[L2Loss] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.306.659 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.306.765 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.306.869 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.306.978 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.307.086 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.307.117 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceAny] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.307.144 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceAll] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.307.175 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceMax] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.307.197 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.307.223 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceMeanWithCast] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.307.248 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceMin] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.307.272 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceProd] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.307.301 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.307.330 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[EuclideanNorm] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.307.356 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceLogSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.307.381 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceLogSumExp] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.307.510 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceNansum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.307.617 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.307.643 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.307.666 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.307.689 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.307.711 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.307.732 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.307.840 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.307.948 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.308.055 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.308.080 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.308.203 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.308.318 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [InferShape][InferShapeRange][InferDataType][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.308.350 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SplitD] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.308.373 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.308.482 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.308.590 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.308.704 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.308.813 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.308.921 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.309.038 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.309.143 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.309.261 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.309.368 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.309.482 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.309.595 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.309.622 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.309.645 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.309.753 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.309.862 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.309.888 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.309.992 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.310.100 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.310.204 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.310.329 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.310.432 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.310.459 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.310.561 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.310.669 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.310.778 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.310.890 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.310.915 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.311.026 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.311.134 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.311.243 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.311.361 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.311.463 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.311.580 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.311.607 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.311.631 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.311.737 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.311.762 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.311.785 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.311.807 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.311.829 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.311.851 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.311.872 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.311.893 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.311.914 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.311.935 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.311.956 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.311.977 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.311.998 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.312.020 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.312.040 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.312.062 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.312.084 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.312.201 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SegmentSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.312.308 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.312.431 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.312.550 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.312.654 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.312.764 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.312.877 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UnsortedSegmentMax] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.312.906 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UnsortedSegmentMin] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.312.933 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UnsortedSegmentProd] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.312.956 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.313.066 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdamApplyOne] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.313.098 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdamApplyOneAssign] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.313.124 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecay] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.313.150 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecayAssign] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.313.257 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BN3DTrainingReduce] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.313.281 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.313.303 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.313.325 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.313.439 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNTrainingReduce] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.313.544 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.313.655 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.313.760 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.313.867 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.313.979 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.314.092 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.314.230 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.314.341 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.314.454 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.314.564 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.314.681 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[INTrainingReduceV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.314.790 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.314.820 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[INTrainingUpdateGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.314.846 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[INTrainingUpdateGradGammaBeta] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.314.873 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[INTrainingUpdateV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.314.975 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.315.083 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.315.191 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.315.305 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.315.411 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.315.518 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.315.624 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.315.733 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPool] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.315.853 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPool3D] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.315.974 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.316.083 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPoolV3] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.316.201 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.316.317 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaximumGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.316.349 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MinimumGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.316.468 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.316.586 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LogSoftmaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.316.615 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.316.638 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.316.666 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftMarginLoss] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.316.689 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.316.714 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftmaxFocalLoss] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.316.736 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.316.758 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.316.864 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.316.893 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Mish] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.317.001 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.317.104 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.317.209 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.317.318 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.317.440 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.317.550 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftmaxCrossEntropyWithLogits] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.317.661 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.317.688 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.317.795 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.317.901 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.318.006 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.318.120 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.318.224 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.318.343 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.318.457 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyAdadeltaD] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.318.488 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.318.515 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyAdagradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.318.541 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyAdaMaxD] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.318.571 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyAdamD] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.318.596 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradD] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.318.621 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.318.645 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyAddSignD] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.318.670 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyCenteredRMSPropD] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.318.695 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyFtrlD] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.318.721 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyFtrlV2D] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.318.746 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyGradientDescent] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.318.775 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyKerasMomentumD] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.318.799 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyMomentumD] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.318.825 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyPowerSignD] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.318.850 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyProximalAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.318.875 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyProximalGradientDescent] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.318.901 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyRMSPropD] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.318.926 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyAdagradDAD] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.319.030 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.319.148 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FusedMulApplyMomentum] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.319.179 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FusedMulApplyKerasMomentum] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.319.297 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.319.407 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GeluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.319.520 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GeluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.319.607 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.319.716 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IsNegInf] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.319.834 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IsPosInf] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.319.945 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.320.024 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.320.136 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.320.250 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.320.358 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.320.473 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.320.594 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReluV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.320.706 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.320.814 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.320.924 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Cummax] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.320.950 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.321.062 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.321.171 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.321.276 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.321.383 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Col2ImV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.321.503 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.321.529 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.321.644 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.321.763 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.321.872 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.321.978 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.322.084 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.322.198 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2d] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.322.309 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.322.421 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.322.528 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.322.636 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.322.740 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.322.852 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaskedSelect] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.322.973 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.323.000 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.323.107 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.323.215 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.323.322 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.323.443 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.323.564 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.323.675 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.323.783 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.323.889 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.323.997 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.324.118 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RNNTLoss] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.324.246 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MultinomialWithReplacement] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.324.355 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.324.382 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.324.491 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StatelessBernoulli] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.324.596 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.324.707 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.324.813 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.324.932 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UniqueConsecutive] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.325.041 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UniqueWithCountsAndSorting] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.325.219 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[WarpAffine] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.325.345 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Histogram] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.325.449 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.325.568 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.325.676 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Unique] register OP_IMPL : [InferShapeRange]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.325.790 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UniqueWithCounts] register OP_IMPL : [InferShapeRange]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.325.901 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Dot] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.326.010 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.326.122 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.326.232 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.326.257 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.326.365 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardReduce] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.326.472 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStatsWithCounts] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.326.594 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.326.619 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.326.642 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.326.664 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.326.688 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.326.711 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.326.732 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.326.753 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.326.775 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.326.876 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.326.901 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.326.923 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.327.030 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.327.137 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.327.246 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.327.356 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.327.464 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.327.489 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.327.510 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.327.624 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.327.728 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.327.753 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.327.856 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.327.971 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.328.074 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.328.195 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.328.221 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.328.248 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.328.272 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.328.378 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.328.405 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.328.427 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.328.527 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.328.551 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.328.573 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.328.677 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.328.702 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.328.725 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.328.746 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.328.847 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.328.952 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.329.069 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.329.094 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.329.117 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.329.223 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.329.258 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.329.357 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.329.465 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.329.569 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.329.594 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.329.616 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.329.718 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.329.743 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.329.765 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.329.876 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.329.981 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.330.090 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.330.195 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.330.305 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.330.415 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.330.521 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.330.639 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.330.750 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2dAssistMatrix] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.330.854 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.330.967 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.331.079 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.331.186 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.331.306 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Cdist] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.331.417 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CdistGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.331.527 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.331.554 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.331.578 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.331.685 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.331.711 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.331.734 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.331.848 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.331.956 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.332.063 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.332.194 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GlobalLpPool] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.332.308 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GLU] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.332.426 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GLUGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.332.539 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.332.648 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.332.756 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LpLoss] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.332.864 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LpNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.332.890 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.332.913 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.332.935 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.333.179 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MinAreaPolygons] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.333.295 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.333.403 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.333.523 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.333.644 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.333.754 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.333.860 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.333.963 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.334.069 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.334.172 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.334.288 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.334.391 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.334.501 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.334.608 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.334.714 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.334.830 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.334.932 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.335.045 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.335.159 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.335.267 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.335.372 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.335.486 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.335.593 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.335.697 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.335.803 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.335.923 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.335.948 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.336.064 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotatedNMS] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.336.182 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.336.292 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.336.523 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SilentCheck] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.336.653 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.336.762 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.336.877 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3d] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.336.987 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.337.092 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.337.204 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ActiveRotatedFilter] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.337.322 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ActiveRotatedFilterGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.337.435 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.337.542 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.337.654 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.337.762 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.337.875 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.337.988 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.338.096 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.338.207 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PSAMask] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.338.323 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PSAMaskGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.338.440 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.338.556 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.338.660 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.338.884 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.339.108 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.339.318 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ThreeNN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.339.453 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Voxelization] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.339.600 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.339.635 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.339.669 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.339.705 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.339.736 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [InferShape][InferDataType][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.339.768 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.339.800 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [InferShape][InferDataType][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.339.827 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.339.854 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.339.877 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.339.898 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.339.920 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.339.943 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.339.978 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CompressFcOp] register OP_IMPL : [InferShape][InferDataType][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.340.004 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.340.123 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.340.240 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.340.350 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.340.465 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.340.573 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.340.690 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMatMulV4] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.340.797 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.340.889 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.340.922 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.341.031 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.341.145 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.341.256 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.341.368 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ResizeTrilinear] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.341.489 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.341.596 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.341.626 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.341.649 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.341.670 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.341.693 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.341.828 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.341.863 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.341.911 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.341.945 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.341.976 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.342.008 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.342.040 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.342.074 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.342.103 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.342.133 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.342.161 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.342.188 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.342.212 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.342.253 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.342.287 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.342.316 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.342.349 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.342.376 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.342.462 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.342.573 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ActULQClampMaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.342.603 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ActULQClampMinGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.342.717 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ActsULQ] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.342.839 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ActsULQInputGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.342.949 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.343.056 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.343.176 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdaptiveAvgPoolAssistMatrix] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.343.287 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.343.313 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.343.420 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.343.526 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.343.629 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.343.743 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.343.770 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.343.874 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.343.980 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.344.085 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.344.206 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.344.290 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.344.376 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.344.501 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AvgPoolUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.344.612 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.344.717 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.344.833 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Bitcast] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.344.949 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.345.033 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.345.140 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.345.239 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.345.349 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CTCLoss] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.345.456 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.345.564 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.345.662 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.345.788 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DropOutGenMask] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.345.820 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StatelessDropOutGenMask] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.345.930 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.346.033 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.346.138 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.346.242 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.346.354 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ExpandDims] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.346.470 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.346.608 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FillWindowCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.346.725 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.346.837 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FlattenV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.346.947 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GatherShapes] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.347.066 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GaussianBlur] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.347.203 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FileConstant] register OP_IMPL : [IsPrivateAtrrReg]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.347.241 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StatelessIf] register OP_IMPL : [InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.347.270 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[If] register OP_IMPL : [InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.347.297 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[_If] register OP_IMPL : [InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.347.335 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Case] register OP_IMPL : [InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.347.392 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ConstPlaceHolder] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.347.498 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.347.615 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.347.697 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Identity] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.347.727 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MemcpyAsync] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.347.758 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IdentityN] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.347.861 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.347.977 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.348.082 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.348.198 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.348.307 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.348.416 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.348.443 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.348.466 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.348.619 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.348.645 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.348.729 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.348.835 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.348.942 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.349.054 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.349.161 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.349.283 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.349.392 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.349.508 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RandomChoiceWithMask] register OP_IMPL : [InferShapeRange]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.349.619 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RandomUniform] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.349.702 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Rank] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.349.731 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Size] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.349.832 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.349.955 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Reshape] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.350.064 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RgbToGrayscale] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.350.173 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.350.281 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.350.387 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.350.494 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Rotate] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.350.592 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Shape] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.350.620 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ShapeN] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.350.843 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SilentCheckV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.351.070 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SilentCheckV3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.351.190 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.351.299 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.351.418 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyAdadelta] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.351.448 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyAdadeltaD] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.351.475 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.351.501 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyAdagrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.351.527 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.351.563 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.351.590 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.351.615 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.351.637 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.351.659 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.351.684 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.351.709 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2D] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.351.737 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyRMSProp] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.351.762 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyRMSPropD] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.351.873 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseFillEmptyRows] register OP_IMPL : [InferShapeRange][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.352.087 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.352.215 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Squeeze] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.352.248 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SqueezeV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.352.279 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SqueezeV3] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.352.385 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.352.498 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StatelessRandomNormalV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.352.611 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.352.716 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.352.840 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TopK] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.352.866 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.352.889 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.352.911 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.352.934 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.353.055 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TopKPQDistanceV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.353.161 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.353.280 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TransArgb] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.353.396 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Unsqueeze] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.353.425 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UnsqueezeV2] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.353.453 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UnsqueezeV3] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.353.564 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.353.594 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dGrad] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.353.700 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Where] register OP_IMPL : [InferShapeRange]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.353.810 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[WtsARQ] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.353.925 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.354.039 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.354.148 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.354.176 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.354.281 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.354.306 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.354.422 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdjustContrast] register OP_IMPL : [InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.354.452 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdjustHue] register OP_IMPL : [InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.354.480 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdjustSaturation] register OP_IMPL : [InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.354.507 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CropAndResize] register OP_IMPL : [InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.354.534 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CropAndResizeV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.354.560 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DecodeAndCropJpeg] register OP_IMPL : [InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.354.587 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DecodeJpeg] register OP_IMPL : [InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.354.625 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NormalizeV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.354.651 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdjustContrastWithMean] register OP_IMPL : [InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.354.676 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdjustBrightness] register OP_IMPL : [InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.354.702 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdjustBrightnessV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.354.728 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdjustSaturationV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.354.755 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[WarpAffineV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.354.782 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ImgCrop] register OP_IMPL : [InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.354.807 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[WarpPerspective] register OP_IMPL : [InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.354.914 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.354.941 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.354.964 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.355.090 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HcomAllReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.355.120 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HcomAllGather] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.355.146 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HcomBroadcast] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.355.172 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HcomReduceScatter] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.355.198 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HcomSend] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.355.226 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HcomReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.355.253 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HcomReceive] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.355.278 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HcomAllToAllV] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.355.305 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HcomAllToAllVC] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.355.331 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HcomGatherAllToAllV] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.356.450 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.356.565 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.356.658 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : [InferShape]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.356.740 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.356.822 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.356.899 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.357.029 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.357.132 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.357.239 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.357.324 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.357.405 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.357.486 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.357.512 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.357.648 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.357.733 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.357.866 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.357.949 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.358.030 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.358.113 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.358.463 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [InputsDependency]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.358.488 [opsproto_manager.cc:162]618658 LoadOpsProtoPluginSo:OpsProtoManager plugin load /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto.so success.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.358.533 [plugin_manager.cc:108]618658 GetOppPath:Enter get opp path schedule
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.358.574 [plugin_manager.cc:117]618658 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.359.005 [plugin_manager.cc:996]618658 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.359.071 [plugin_manager.cc:1011]618658 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.359.096 [plugin_manager.cc:1015]618658 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.359.175 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.359.194 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.359.253 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.359.270 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.359.283 [opp_so_manager.cc:56]618658 LoadOpsProtoPackage:Start load ops proto package, is_split:[1].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.359.298 [plugin_manager.cc:540]618658 GetOpsProtoPath:Enter GetOpsProtoPath schedule
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.359.314 [plugin_manager.cc:108]618658 GetOppPath:Enter get opp path schedule
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.359.339 [plugin_manager.cc:117]618658 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.359.358 [plugin_manager.cc:547]618658 GetOpsProtoPath:Opp plugin path structure is new version!
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.359.375 [plugin_manager.cc:206]618658 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.359.744 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.359.784 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.359.802 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.359.815 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.359.856 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.360.226 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.360.277 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.360.297 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.360.310 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.360.348 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.360.390 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.360.408 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.360.422 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.360.440 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.360.471 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.360.488 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.360.500 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.360.514 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.360.858 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.360.896 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.360.914 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.360.928 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.360.968 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.361.310 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.361.358 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.361.376 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.361.390 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.361.425 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.361.461 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.361.478 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.361.491 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.361.507 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.361.540 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.361.557 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.361.569 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.361.583 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.361.922 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.361.957 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.361.974 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.361.988 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.362.029 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.362.372 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.362.426 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.362.445 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.362.459 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.362.495 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.362.532 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.362.549 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.362.561 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.362.576 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.362.606 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.362.623 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.362.635 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.362.651 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.362.988 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.363.024 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.363.041 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.363.054 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.363.088 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.363.442 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.363.478 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.363.496 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.363.510 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.363.549 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.363.585 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.363.602 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.363.615 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.363.630 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.363.663 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.363.679 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.363.691 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.363.705 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.364.045 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.364.080 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.364.098 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.364.111 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.364.147 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.364.517 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.364.556 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.364.575 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.364.588 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.364.624 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.364.660 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.364.677 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.364.690 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.364.704 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.364.737 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.364.754 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.364.767 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.364.781 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.364.797 [plugin_manager.cc:218]618658 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.364.832 [plugin_manager.cc:422]618658 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.364.846 [plugin_manager.cc:155]618658 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.364.868 [plugin_manager.cc:158]618658 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.364.884 [plugin_manager.cc:426]618658 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.365.215 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.365.251 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.365.268 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.365.281 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.365.317 [plugin_manager.cc:439]618658 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspo
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.365.637 [plugin_manager.cc:996]618658 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.365.667 [plugin_manager.cc:1011]618658 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.365.690 [plugin_manager.cc:1015]618658 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.365.796 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.365.815 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.365.829 [opp_so_manager.cc:45]618658 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.368.141 [op_impl_registry_holder_manager.cc:208]618658 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.368.192 [op_impl_registry_holder_manager.cc:216]618658 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.368.228 [op_impl_registry_holder_manager.cc:208]618658 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.368.286 [op_impl_registry_holder_manager.cc:208]618658 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.368.804 [op_impl_space_registry.cc:273]618658 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so] success!
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.368.921 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.368.942 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.368.955 [opp_so_manager.cc:45]618658 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.371.156 [op_impl_registry_holder_manager.cc:208]618658 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.371.194 [op_impl_registry_holder_manager.cc:216]618658 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.371.215 [op_impl_registry_holder_manager.cc:208]618658 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.371.253 [op_impl_registry_holder_manager.cc:208]618658 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.371.594 [op_impl_space_registry.cc:80]618658 MergeFunctions:op type DecoderKvCache infer_shape func has been registered
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.371.618 [op_impl_space_registry.cc:83]618658 MergeFunctions:op type DecoderKvCache infer_datatype func has been registered
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.371.640 [op_impl_space_registry.cc:80]618658 MergeFunctions:op type PromptKvCache infer_shape func has been registered
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.371.656 [op_impl_space_registry.cc:83]618658 MergeFunctions:op type PromptKvCache infer_datatype func has been registered
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.371.670 [op_impl_space_registry.cc:273]618658 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so] success!
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.371.714 [opp_so_manager.cc:97]618658 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.371.751 [opp_so_manager.cc:97]618658 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.371.851 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.371.870 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.371.883 [opp_so_manager.cc:45]618658 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.372.609 [op_impl_space_registry.cc:240]618658 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.372.639 [opp_so_manager.cc:48]618658 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.372.734 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.372.753 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.372.766 [opp_so_manager.cc:45]618658 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.373.358 [op_impl_space_registry.cc:240]618658 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.373.386 [opp_so_manager.cc:48]618658 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.373.426 [opp_so_manager.cc:97]618658 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.373.461 [opp_so_manager.cc:97]618658 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.373.547 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.373.565 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.373.577 [opp_so_manager.cc:45]618658 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.374.145 [op_impl_space_registry.cc:240]618658 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.374.173 [opp_so_manager.cc:48]618658 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.374.278 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.374.297 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.374.309 [opp_so_manager.cc:45]618658 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.374.881 [op_impl_space_registry.cc:240]618658 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.374.909 [opp_so_manager.cc:48]618658 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.374.952 [opp_so_manager.cc:97]618658 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.374.987 [opp_so_manager.cc:97]618658 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.375.070 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.375.088 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.375.100 [opp_so_manager.cc:45]618658 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.375.661 [op_impl_space_registry.cc:240]618658 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.375.688 [opp_so_manager.cc:48]618658 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.375.779 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.375.799 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.375.810 [opp_so_manager.cc:45]618658 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.376.388 [op_impl_space_registry.cc:240]618658 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.376.432 [opp_so_manager.cc:48]618658 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.376.471 [opp_so_manager.cc:97]618658 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.376.508 [opp_so_manager.cc:97]618658 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.376.592 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.376.611 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.376.623 [opp_so_manager.cc:45]618658 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.377.185 [op_impl_space_registry.cc:240]618658 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.377.211 [opp_so_manager.cc:48]618658 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.377.299 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.377.318 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.377.330 [opp_so_manager.cc:45]618658 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.377.892 [op_impl_space_registry.cc:240]618658 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.377.920 [opp_so_manager.cc:48]618658 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.377.962 [opp_so_manager.cc:97]618658 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.377.997 [opp_so_manager.cc:97]618658 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.378.029 [opp_so_manager.cc:97]618658 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/usr/local/Ascend/ascend-toolkit/latest/opp/op_proto/custom/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.378.115 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 0 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.378.161 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.378.178 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.378.190 [opp_so_manager.cc:45]618658 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.402.838 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.402.886 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[EluGradV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.402.909 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.402.929 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.402.949 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SyncBNTrainingUpdate] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.402.969 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Abs] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.402.989 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Real] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.009 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Acos] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.028 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Acosh] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.047 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddMatMatElements] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.066 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Adds] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.086 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Asin] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.105 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Asinh] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.124 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AssignAdd] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.143 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AssignSub] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.163 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Atan] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.179 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Atanh] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.195 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.214 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BesselI0e] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.233 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BesselI1e] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.253 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.272 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.304 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.326 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.346 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Bucketize] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.365 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Cast] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.384 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Ceil] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.403 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CeluV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.422 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ComplexAbs] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.442 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Cos] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.461 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Cosh] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.481 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.500 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DataFormatDimMap] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.520 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Dequantize] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.539 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Elu] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.559 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Erf] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.578 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Erfc] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.598 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Exp] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.618 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Expm1] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.638 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FakeQuantWithMinMaxVars] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.657 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FastGelu] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.677 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FastGeluV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.696 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Floor] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.713 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FusedMulAddN] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.732 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HardSigmoid] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.751 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HardShrink] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.770 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HardShrinkGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.790 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HardSwish] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.809 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HardSwishGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.834 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HardtanhGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.854 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IndexFillD] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.873 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.893 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.913 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Inv] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.932 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Invert] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.951 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Log] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.971 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Log1p] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.403.990 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LogicalNot] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.010 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LogAddExp] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.029 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LpNormUpdate] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.048 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LpNormUpdateV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.067 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Dawsn] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.086 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Expint] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.107 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Erfinv] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.126 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FresnelCos] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.146 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FresnelSin] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.186 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Ndtri] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.214 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Spence] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.235 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Fills] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.254 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LeakyRelu] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.272 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[OnesLike] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.291 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Reciprocal] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.311 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Sign] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.330 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Sqrt] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.349 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Tanh] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.368 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ZerosLike] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.395 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Gelu] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.415 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GeluV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.435 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Relu] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.454 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Neg] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.474 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LogSoftmaxV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.493 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.512 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.532 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.551 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftplusV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.570 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Muls] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.590 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Power] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.609 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Relu6] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.628 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Relu6D] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.647 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Relu6Grad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.667 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReluGradV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.686 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Rint] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.706 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Round] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.725 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Rsqrt] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.745 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RsqrtGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.764 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Selu] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.783 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Shrink] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.800 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Sigmoid] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.819 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.839 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SigmoidGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.859 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Sin] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.881 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Sinh] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.907 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SmoothL1Loss] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.927 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SmoothL1LossGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.947 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LogSigmoid] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.966 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LogSigmoidGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.404.986 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LogSpaceD] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.005 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Softplus] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.024 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Softsign] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.043 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SqrtGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.062 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Square] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.081 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Swish] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.101 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwishGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.123 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SiluGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.146 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardElemt] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.167 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Tan] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.188 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftShrink] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.210 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftShrinkGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.234 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Threshold] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.256 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ThresholdV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.277 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ThresholdV2D] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.298 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Trunc] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.319 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.338 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.359 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MishGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.385 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HardSigmoidGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.406 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.427 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.448 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.475 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.496 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FillDiagonal] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.519 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IndexPut] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.542 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReadVariableOp] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.565 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CastLike] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.587 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FusedBiasLeakyRelu] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.608 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StatelessBernoulliV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.629 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.650 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InvertPermutation] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.671 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.692 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SearchSorted] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.713 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.734 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.761 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.784 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.807 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.913 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaskedScale] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.940 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AbsGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.962 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AccumulateNV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.405.984 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddN] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.003 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Eltwise] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.025 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.046 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AcosGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.066 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AcoshGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.088 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AsinGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.109 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AsinhGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.141 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Atan2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.162 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AtanGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.183 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Axpy] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.206 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BitwiseAnd] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.227 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BitwiseOr] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.248 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BitwiseXor] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.269 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Div] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.290 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DivNoNan] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.311 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[EluGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.333 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FastGeluGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.355 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FloorDiv] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.379 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FloorMod] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.403 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InvGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.425 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LeakyReluGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.447 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TanhGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.468 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Add] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.489 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Addcdiv] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.511 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Addcmul] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.532 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AxpyV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.554 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LogicalAnd] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.575 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LogicalOr] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.598 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Mul] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.619 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Pow] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.640 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RealDiv] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.663 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ClipByNormNoDivSum] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.686 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ClipByValue] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.706 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ClipByValueV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.733 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FusedMulAdd] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.755 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftmaxGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.776 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Sub] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.797 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Gcd] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.820 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LarsV2Update] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.841 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaskedFill] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.861 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReluGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.882 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Xlog1py] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.904 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApproximateEqual] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.925 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Equal] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.946 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NotEqual] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.967 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Greater] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.406.992 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GreaterEqual] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.012 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Less] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.035 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LessEqual] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.056 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Maximum] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.080 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Minimum] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.102 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Mod] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.124 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.145 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MulNoNan] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.166 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReciprocalGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.185 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SeluGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.206 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogits] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.228 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftplusGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.254 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftplusV2Grad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.276 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftsignGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.302 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SquaredDifference] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.323 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.344 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ThresholdGradV2D] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.365 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TruncateDiv] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.387 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TruncateMod] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.409 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Xdivy] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.430 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IsClose] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.451 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Xlogy] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.472 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.493 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SelectV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.514 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaskedSelectV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.537 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Lerp] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.559 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FusedBiasLeakyReluGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.665 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.768 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.871 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.407.968 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.408.073 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.408.099 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.408.127 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.408.150 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.408.268 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.408.371 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.408.471 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.408.566 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.408.665 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.408.785 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.408.894 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Quantize] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.408.919 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.408.942 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AscendDequant] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.408.964 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.409.059 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.409.157 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.409.181 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.409.205 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.409.226 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.409.247 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.409.269 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BasicLSTMInplaceFillWindowCache] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.409.290 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BasicGRUInplaceFillWindowCache] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.409.388 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.409.483 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.409.590 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.409.691 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.409.718 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.409.812 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdaCast] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.409.909 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.409.934 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.409.957 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.409.978 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.410.079 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.410.178 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.410.283 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.410.390 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.410.415 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.410.509 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.410.603 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.410.628 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.410.723 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.410.832 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.410.927 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.411.026 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.411.051 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.411.147 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[L2Loss] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.411.243 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.411.345 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.411.450 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.411.553 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.411.648 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.411.673 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceAny] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.411.695 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceAll] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.411.717 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceMax] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.411.739 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.411.762 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceMeanWithCast] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.411.785 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceMin] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.411.808 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceProd] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.411.830 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceSum] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.411.852 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[EuclideanNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.411.873 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceLogSum] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.411.905 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceLogSumExp] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.412.003 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceNansum] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.412.102 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.412.128 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.412.150 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.412.192 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.412.221 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.412.243 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.412.348 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.412.446 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.412.541 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.412.570 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.412.666 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.412.764 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [][][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.412.789 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SplitD] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.412.812 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.412.913 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.413.015 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.413.121 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.413.217 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.413.320 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.413.417 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.413.522 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.413.618 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.413.715 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.413.813 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.413.930 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.413.956 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.413.979 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.414.079 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.414.179 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.414.204 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.414.296 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.414.396 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.414.492 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.414.586 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.414.688 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.414.713 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.414.813 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.414.911 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.415.006 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.415.104 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.415.128 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.415.230 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.415.325 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.415.421 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.415.522 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.415.622 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.415.723 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.415.750 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.415.775 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.415.874 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.415.912 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.415.935 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.415.957 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.415.978 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.416.001 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.416.023 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.416.044 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.416.065 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.416.087 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.416.108 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.416.129 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.416.150 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.416.185 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.416.210 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.416.235 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.416.256 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.416.352 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SegmentSum] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.416.447 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.416.543 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.416.652 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.416.753 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.416.848 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.416.948 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UnsortedSegmentMax] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.416.974 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UnsortedSegmentMin] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.416.998 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UnsortedSegmentProd] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.417.035 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.417.127 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdamApplyOne] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.417.151 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdamApplyOneAssign] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.417.173 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecay] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.417.194 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecayAssign] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.417.289 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BN3DTrainingReduce] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.417.312 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.417.334 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.417.355 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.417.450 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNTrainingReduce] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.417.554 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.417.649 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.417.753 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.417.849 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.417.943 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.418.043 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.418.148 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.418.243 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.418.340 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.418.436 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.418.532 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[INTrainingReduceV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.418.634 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.418.659 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[INTrainingUpdateGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.418.682 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[INTrainingUpdateGradGammaBeta] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.418.707 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[INTrainingUpdateV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.418.817 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.418.911 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.419.007 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.419.103 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.419.200 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.419.306 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.419.403 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.419.498 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPool] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.419.602 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPool3D] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.419.699 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.419.808 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPoolV3] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.419.909 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.420.003 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaximumGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.420.028 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MinimumGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.420.122 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.420.238 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LogSoftmaxGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.420.266 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.420.292 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.420.314 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftMarginLoss] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.420.336 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.420.359 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftmaxFocalLoss] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.420.381 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.420.405 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.420.494 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.420.523 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Mish] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.420.621 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.420.732 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.420.829 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.420.933 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.421.032 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.421.133 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftmaxCrossEntropyWithLogits] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.421.232 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.421.257 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.421.349 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.421.447 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.421.541 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.421.636 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.421.739 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.421.836 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.421.934 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyAdadeltaD] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.421.959 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyAdagradD] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.421.982 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyAdagradV2D] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.422.004 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyAdaMaxD] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.422.031 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyAdamD] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.422.053 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradD] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.422.074 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.422.093 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyAddSignD] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.422.115 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyCenteredRMSPropD] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.422.136 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyFtrlD] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.422.158 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyFtrlV2D] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.422.182 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyGradientDescent] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.422.204 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyKerasMomentumD] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.422.236 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyMomentumD] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.422.259 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyPowerSignD] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.422.280 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyProximalAdagradD] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.422.302 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyProximalGradientDescent] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.422.323 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyRMSPropD] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.422.344 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyAdagradDAD] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.422.448 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.422.544 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FusedMulApplyMomentum] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.422.568 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FusedMulApplyKerasMomentum] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.422.666 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.422.764 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GeluGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.422.860 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GeluGradV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.422.936 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.423.032 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IsNegInf] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.423.131 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IsPosInf] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.423.231 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.423.301 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.423.398 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.423.493 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.423.595 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.423.691 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.423.790 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReluV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.423.884 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.423.982 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.424.081 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Cummax] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.424.121 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.424.225 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.424.320 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.424.424 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.424.519 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Col2ImV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.424.621 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.424.647 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.424.746 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.424.841 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.424.942 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.425.036 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.425.131 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.425.234 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2d] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.425.332 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.425.429 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.425.530 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.425.625 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.425.724 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.425.817 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaskedSelect] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.425.921 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.425.948 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.426.047 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.426.142 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.426.239 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.426.342 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.426.439 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.426.547 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.426.649 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.426.749 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.426.842 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.426.937 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RNNTLoss] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.427.035 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MultinomialWithReplacement] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.427.139 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.427.164 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.427.259 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StatelessBernoulli] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.427.367 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.427.463 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.427.557 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.427.654 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UniqueConsecutive] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.427.758 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UniqueWithCountsAndSorting] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.427.854 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[WarpAffine] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.427.948 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Histogram] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.428.044 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.428.138 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.428.252 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Unique] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.428.358 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UniqueWithCounts] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.428.461 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Dot] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.428.557 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.428.658 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.428.756 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.428.780 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.428.881 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardReduce] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.428.990 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStatsWithCounts] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.429.086 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.429.112 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.429.135 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.429.157 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.429.178 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.429.199 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.429.221 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.429.242 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.429.266 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.429.358 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.429.382 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.429.406 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.429.506 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.429.602 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.429.702 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.429.798 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.429.894 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.429.918 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.429.940 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.430.032 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.430.131 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.430.155 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.430.253 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.430.349 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.430.456 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.430.558 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.430.582 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.430.607 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.430.629 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.430.725 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.430.749 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.430.771 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.430.865 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.430.890 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.430.913 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.431.010 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.431.034 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.431.057 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.431.080 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.431.175 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.431.269 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.431.366 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.431.391 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.431.413 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.431.511 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.431.536 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.431.638 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.431.740 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.431.833 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.431.873 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.431.896 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.431.991 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.432.014 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.432.037 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.432.130 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.432.238 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.432.343 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.432.441 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.432.540 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.432.638 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.432.737 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.432.840 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.432.936 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2dAssistMatrix] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.433.032 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.433.131 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.433.225 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.433.320 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.433.424 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Cdist] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.433.526 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CdistGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.433.622 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.433.649 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.433.672 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.433.762 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.433.787 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.433.814 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.433.923 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.434.025 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.434.121 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.434.219 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GlobalLpPool] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.434.317 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GLU] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.434.415 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GLUGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.434.512 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.434.613 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.434.709 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LpLoss] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.434.803 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LpNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.434.832 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.434.860 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.434.884 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.434.980 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MinAreaPolygons] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.435.074 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.435.176 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.435.271 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.435.365 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.435.465 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.435.562 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.435.662 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.435.767 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.435.863 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.435.963 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.436.062 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.436.194 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.436.290 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.436.393 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.436.490 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.436.584 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.436.684 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.436.780 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.436.879 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.436.976 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.437.075 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.437.171 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.437.270 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.437.365 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.437.466 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.437.492 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.437.586 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotatedNMS] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.437.688 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.437.785 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.437.883 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SilentCheck] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.437.985 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.438.087 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.438.181 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3d] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.438.279 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.438.377 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.438.473 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ActiveRotatedFilter] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.438.584 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ActiveRotatedFilterGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.438.680 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.438.781 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.438.877 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.438.976 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.439.078 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.439.177 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.439.274 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.439.373 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PSAMask] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.439.467 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PSAMaskGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.439.570 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.439.671 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.439.768 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.439.863 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.439.956 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.440.053 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ThreeNN] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.440.163 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Voxelization] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.440.279 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.440.312 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.440.339 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.440.367 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.440.395 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.440.423 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [][][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.440.449 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.440.476 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [][][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.440.501 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : [][][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.440.537 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.440.559 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.440.581 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.440.604 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.440.628 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CompressFcOp] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.440.652 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.440.749 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.440.850 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.440.943 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.441.043 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.441.143 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.441.245 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMatMulV4] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.441.345 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.441.423 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.441.451 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.441.551 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.441.645 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.441.748 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.441.844 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ResizeTrilinear] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.441.937 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.442.040 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.442.065 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.442.088 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.442.111 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.442.133 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.442.267 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.442.298 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.442.324 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.442.355 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.442.382 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.442.408 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [][][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.442.435 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.442.461 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [][][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.442.486 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.442.510 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.442.535 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [][][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.442.566 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.442.589 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.442.618 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.442.647 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.442.674 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.442.700 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [][][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.442.724 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.442.799 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.442.900 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ActULQClampMaxGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.442.926 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ActULQClampMinGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.443.017 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ActsULQ] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.443.112 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ActsULQInputGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.443.212 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.443.321 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.443.419 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdaptiveAvgPoolAssistMatrix] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.443.520 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.443.544 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.443.640 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.443.733 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.443.838 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.443.930 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.443.955 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.444.053 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.444.150 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.444.260 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.444.361 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.444.431 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.444.512 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.444.615 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AvgPoolUpdate] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.444.712 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.444.818 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.444.921 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Bitcast] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.445.015 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.445.089 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.445.170 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.445.255 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.445.349 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CTCLoss] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.445.448 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.445.550 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.445.640 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.445.741 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DropOutGenMask] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.445.768 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StatelessDropOutGenMask] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.445.866 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.445.960 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.446.060 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.446.161 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.446.258 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ExpandDims] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.446.359 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.446.455 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FillWindowCache] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.446.555 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.446.651 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FlattenV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.446.750 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GatherShapes] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.446.845 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GaussianBlur] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.446.958 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FileConstant] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.446.984 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StatelessIf] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.447.007 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[If] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.447.030 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[_If] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.447.053 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Case] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.447.099 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ConstPlaceHolder] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.447.197 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.447.292 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.447.365 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Identity] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.447.390 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MemcpyAsync] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.447.417 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IdentityN] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.447.521 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.447.621 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.447.724 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.447.817 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.447.912 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.448.005 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.448.030 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.448.053 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.448.199 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.448.227 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.448.306 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.448.403 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.448.501 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.448.598 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.448.694 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.448.794 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.448.898 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.448.991 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RandomChoiceWithMask] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.449.085 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RandomUniform] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.449.160 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Rank] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.449.185 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Size] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.449.278 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.449.378 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Reshape] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.449.483 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RgbToGrayscale] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.449.584 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.449.679 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.449.786 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.449.889 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Rotate] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.449.962 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Shape] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.449.987 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ShapeN] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.450.086 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SilentCheckV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.450.181 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SilentCheckV3] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.450.276 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.450.374 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.450.468 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyAdadelta] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.450.495 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyAdadeltaD] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.450.518 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyAdagradD] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.450.540 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyAdagrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.450.566 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.450.587 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagradD] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.450.611 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.450.632 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2D] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.450.654 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.450.675 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.450.697 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.450.718 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2D] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.450.742 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyRMSProp] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.450.763 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyRMSPropD] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.450.862 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseFillEmptyRows] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.450.957 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.451.050 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Squeeze] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.451.086 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SqueezeV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.451.110 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SqueezeV3] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.451.210 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.451.310 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StatelessRandomNormalV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.451.405 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.451.507 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.451.602 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TopK] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.451.629 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.451.657 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.451.679 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.451.700 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.451.795 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TopKPQDistanceV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.451.890 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.451.988 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TransArgb] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.452.093 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Unsqueeze] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.452.118 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UnsqueezeV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.452.140 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UnsqueezeV3] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.452.243 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.452.271 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.452.367 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Where] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.452.465 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[WtsARQ] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.452.565 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.452.666 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.452.769 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.452.795 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.452.888 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.452.925 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.026 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdjustContrast] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.050 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdjustHue] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.073 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdjustSaturation] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.097 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CropAndResize] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.118 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CropAndResizeV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.140 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DecodeAndCropJpeg] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.163 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DecodeJpeg] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.184 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NormalizeV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.206 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdjustContrastWithMean] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.229 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdjustBrightness] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.251 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdjustBrightnessV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.272 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdjustSaturationV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.293 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[WarpAffineV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.315 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ImgCrop] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.336 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[WarpPerspective] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.428 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.455 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.477 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.572 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HcomAllReduce] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.597 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HcomAllGather] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.619 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HcomBroadcast] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.641 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HcomReduceScatter] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.664 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HcomSend] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.685 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HcomReduce] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.706 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HcomReceive] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.737 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HcomAllToAllV] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.761 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HcomAllToAllVC] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.785 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HcomGatherAllToAllV] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.909 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.453.983 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.454.101 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.454.176 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.454.246 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.454.317 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.454.620 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.454.693 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.454.766 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.454.843 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.454.920 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.454.986 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.455.054 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.455.161 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.455.258 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.455.356 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.455.433 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.455.503 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.455.571 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.455.592 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.455.833 [op_impl_registry_holder_manager.cc:208]618658 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 894
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.463.985 [op_impl_registry_holder_manager.cc:208]618658 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 894
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.468.397 [op_impl_registry_holder_manager.cc:208]618658 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.489.518 [op_impl_space_registry.cc:273]618658 ConvertSoToRegistry:Save so symbol and handle in path[/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so] success!
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.489.845 [plugin_manager.cc:554]618658 GetUpgradedOpsProtoPath:Start to get upgraded ops proto path
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.489.870 [plugin_manager.cc:134]618658 GetUpgradedOppPath:Enter get upgraded opp path schedule
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.489.915 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /usr/local/Ascend/ascend-toolkit/latest/opp_latest/, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.489.935 [plugin_manager.cc:145]618658 GetUpgradedOppPath:[Call][RealPath] Opp path /usr/local/Ascend/ascend-toolkit/latest/opp_latest/ is invalid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.489.947 [plugin_manager.cc:557]618658 GetUpgradedOpsProtoPath:Failed to get upgraded opp path!
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.489.962 [plugin_manager.cc:108]618658 GetOppPath:Enter get opp path schedule
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.489.990 [plugin_manager.cc:117]618658 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.490.611 [plugin_manager.cc:996]618658 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.490.665 [plugin_manager.cc:1011]618658 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.490.691 [plugin_manager.cc:1015]618658 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.490.769 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.490.787 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.490.842 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.490.859 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.490.872 [opp_so_manager.cc:66]618658 LoadOpMasterPackage:Start load op master package, is_split:[1].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.490.890 [plugin_manager.cc:616]618658 GetOpTilingForwardOrderPath:Enter GetOpTilingPath schedule
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.490.903 [plugin_manager.cc:108]618658 GetOppPath:Enter get opp path schedule
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.490.926 [plugin_manager.cc:117]618658 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.490.947 [plugin_manager.cc:624]618658 GetOpTilingForwardOrderPath:Opp plugin path structure is new version!
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.490.964 [plugin_manager.cc:206]618658 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.491.354 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.491.396 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.491.414 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.491.428 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.491.474 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.491.829 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.491.864 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.491.881 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.491.895 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.491.932 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.491.974 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.491.992 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.492.006 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.492.021 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.492.038 [plugin_manager.cc:215]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.492.397 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.492.448 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.492.468 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.492.481 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.492.518 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.492.862 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.492.896 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.492.914 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.492.927 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.492.963 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.493.002 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.493.019 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.493.032 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.493.046 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.493.064 [plugin_manager.cc:215]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.493.407 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.493.443 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.493.461 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.493.474 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.493.510 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.493.866 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.493.902 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.493.920 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.493.934 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.493.970 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.494.007 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.494.025 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.494.038 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.494.057 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.494.072 [plugin_manager.cc:215]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.494.412 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.494.448 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.494.466 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.494.480 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.494.516 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.494.856 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.494.891 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.494.908 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.494.942 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.494.978 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.495.015 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.495.032 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.495.046 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.495.064 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.495.079 [plugin_manager.cc:215]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.495.419 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.495.453 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.495.471 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.495.484 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.495.524 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.495.867 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.495.902 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.495.919 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.495.933 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.495.971 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.496.009 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.496.038 [plugin_manager.cc:1026]618658 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.496.051 [plugin_manager.cc:322]618658 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.496.066 [plugin_manager.cc:212]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.496.084 [plugin_manager.cc:215]618658 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.496.100 [plugin_manager.cc:218]618658 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-pack
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.496.122 [plugin_manager.cc:422]618658 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.496.135 [plugin_manager.cc:155]618658 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.496.170 [plugin_manager.cc:158]618658 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.496.191 [plugin_manager.cc:426]618658 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.496.525 [plugin_manager.cc:250]618658 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.496.562 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.496.579 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.496.592 [plugin_manager.cc:1063]618658 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.496.635 [plugin_manager.cc:439]618658 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.496.972 [plugin_manager.cc:996]618658 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.497.003 [plugin_manager.cc:1011]618658 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.497.025 [plugin_manager.cc:1015]618658 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.497.079 [opp_so_manager.cc:123]618658 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.497.183 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.497.201 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.497.212 [opp_so_manager.cc:45]618658 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.498.764 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff5408b2c0, registered count:4
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.498.804 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.498.826 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.498.846 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.498.869 [op_check.cc:71]618658 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.499.168 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff5408f978, registered count:4
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.499.193 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.499.212 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.499.232 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.499.250 [op_check.cc:71]618658 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.499.507 [op_impl_registry_holder_manager.cc:208]618658 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.499.548 [op_impl_registry_holder_manager.cc:216]618658 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.499.567 [op_impl_registry_holder_manager.cc:208]618658 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.499.605 [op_impl_registry_holder_manager.cc:208]618658 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.499.844 [op_impl_space_registry.cc:273]618658 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so] success!
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.499.898 [opp_so_manager.cc:123]618658 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.500.009 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.500.028 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.500.041 [opp_so_manager.cc:45]618658 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.501.490 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:AllFinite, funcPointer:(nil), registered count:4
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.501.528 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:AllFinite, funcPointer:(nil), registered count:6
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.501.550 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:AllFinite, funcPointer:(nil), registered count:3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.501.570 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:AllFinite, funcPointer:(nil), registered count:3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.501.591 [op_check.cc:71]618658 RegisterParamGeneralize:RegisterParamGeneralize: op_type:AllFinite, funcPointer:(nil), registered count:3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.501.873 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff5403c9b0, registered count:4
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.501.900 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.501.923 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.501.943 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.501.975 [op_check.cc:71]618658 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.502.261 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff5403fda0, registered count:4
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.502.285 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.502.306 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.502.328 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.502.348 [op_check.cc:71]618658 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.502.597 [op_impl_registry_holder_manager.cc:208]618658 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.502.624 [op_impl_registry_holder_manager.cc:216]618658 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.502.643 [op_impl_registry_holder_manager.cc:208]618658 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.502.680 [op_impl_registry_holder_manager.cc:208]618658 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.502.961 [op_impl_space_registry.cc:84]618658 MergeFunctions:op type DecoderKvCache tiling_parse func has been registered
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.502.982 [op_impl_space_registry.cc:85]618658 MergeFunctions:op type DecoderKvCache compile_info_creator func has been registered
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.502.994 [op_impl_space_registry.cc:86]618658 MergeFunctions:op type DecoderKvCache compile_info_deleter func has been registered
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.503.007 [op_impl_space_registry.cc:87]618658 MergeFunctions:op type DecoderKvCache tiling func has been registered
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.503.023 [op_impl_space_registry.cc:93]618658 MergeFunctions:op type DecoderKvCache max_tiling_data_size has been registered
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.503.040 [op_impl_space_registry.cc:84]618658 MergeFunctions:op type PromptKvCache tiling_parse func has been registered
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.503.054 [op_impl_space_registry.cc:85]618658 MergeFunctions:op type PromptKvCache compile_info_creator func has been registered
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.503.070 [op_impl_space_registry.cc:86]618658 MergeFunctions:op type PromptKvCache compile_info_deleter func has been registered
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.503.081 [op_impl_space_registry.cc:87]618658 MergeFunctions:op type PromptKvCache tiling func has been registered
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.503.093 [op_impl_space_registry.cc:93]618658 MergeFunctions:op type PromptKvCache max_tiling_data_size has been registered
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.503.124 [op_impl_space_registry.cc:273]618658 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so] success!
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.503.173 [opp_so_manager.cc:123]618658 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.503.214 [opp_so_manager.cc:126]618658 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.503.252 [opp_so_manager.cc:123]618658 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.503.352 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.503.370 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.503.382 [opp_so_manager.cc:45]618658 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.503.921 [op_impl_space_registry.cc:240]618658 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.503.948 [opp_so_manager.cc:48]618658 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.503.990 [opp_so_manager.cc:123]618658 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.504.088 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.504.106 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.504.118 [opp_so_manager.cc:45]618658 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.504.764 [op_impl_space_registry.cc:240]618658 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.504.794 [opp_so_manager.cc:48]618658 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.504.853 [opp_so_manager.cc:123]618658 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.504.891 [opp_so_manager.cc:126]618658 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.504.928 [opp_so_manager.cc:123]618658 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.505.022 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.505.040 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.505.053 [opp_so_manager.cc:45]618658 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.505.517 [op_impl_space_registry.cc:240]618658 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.505.542 [opp_so_manager.cc:48]618658 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.505.584 [opp_so_manager.cc:123]618658 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.505.678 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.505.697 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.505.710 [opp_so_manager.cc:45]618658 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.506.285 [op_impl_space_registry.cc:240]618658 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.506.312 [opp_so_manager.cc:48]618658 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.506.356 [opp_so_manager.cc:123]618658 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.506.406 [opp_so_manager.cc:126]618658 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.506.445 [opp_so_manager.cc:123]618658 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.506.538 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.506.555 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.506.567 [opp_so_manager.cc:45]618658 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.507.017 [op_impl_space_registry.cc:240]618658 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.507.041 [opp_so_manager.cc:48]618658 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.507.082 [opp_so_manager.cc:123]618658 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.507.176 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.507.193 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.507.204 [opp_so_manager.cc:45]618658 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.507.770 [op_impl_space_registry.cc:240]618658 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.507.797 [opp_so_manager.cc:48]618658 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.507.840 [opp_so_manager.cc:123]618658 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.507.877 [opp_so_manager.cc:126]618658 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.507.926 [opp_so_manager.cc:123]618658 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.508.020 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.508.037 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.508.048 [opp_so_manager.cc:45]618658 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.508.504 [op_impl_space_registry.cc:240]618658 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.508.531 [opp_so_manager.cc:48]618658 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.508.576 [opp_so_manager.cc:123]618658 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.508.671 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.508.688 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.508.700 [opp_so_manager.cc:45]618658 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.509.266 [op_impl_space_registry.cc:240]618658 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.509.293 [opp_so_manager.cc:48]618658 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.509.333 [opp_so_manager.cc:123]618658 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.509.371 [opp_so_manager.cc:126]618658 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.509.406 [opp_so_manager.cc:123]618658 LoadOpMasterSo:Get path with op_master path [/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.509.446 [opp_so_manager.cc:126]618658 LoadOpMasterSo:Get path with op_tiling path [/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.509.479 [opp_so_manager.cc:123]618658 LoadOpMasterSo:Get path with op_master path [/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.509.560 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_ct.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.509.577 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.509.622 [plugin_manager.cc:1126]618658 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.509.638 [plugin_manager.cc:1130]618658 GetFileListWithSuffix:Found 2 libs.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.509.650 [opp_so_manager.cc:45]618658 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.521.938 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.522.687 [op_impl_registry_holder_manager.cc:208]618658 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 1
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.522.744 [op_impl_registry_holder_manager.cc:208]618658 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 1
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.522.773 [op_impl_registry_holder_manager.cc:208]618658 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 11
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.525.400 [op_impl_space_registry.cc:273]618658 ConvertSoToRegistry:Save so symbol and handle in path[/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_ct.so] success!
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:39.556.187 [trs_cb_event.c:119][ascend][curpid:618658,618775][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =65; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:39.556.188 [trs_cb_event.c:119][ascend][curpid:618658,618774][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =64; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:39.556.215 [trs_sqcq.c:1491][ascend][curpid:618658,618775][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:39.556.221 [trs_sqcq.c:1491][ascend][curpid:618658,618774][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:39.556.230 [npu_driver.cc:3833] 618775 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:39.556.238 [npu_driver.cc:3833] 618774 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:39.556.275 [api_impl.cc:5058] 618774 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:39.556.294 [api_impl.cc:5058] 618775 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.556.307 [callback.cpp:132]618774 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.556.347 [callback.cpp:132]618775 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.556.363 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.556.380 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.556.384 [npu_driver.cc:3828] 618774 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=64.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.556.417 [npu_driver.cc:3828] 618775 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=65.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.627.026 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DefaultImpl] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.627.496 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.627.577 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.627.651 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.627.723 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AscendAntiQuantV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.627.789 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.627.865 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.627.888 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.627.951 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Concat] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.627.974 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ConcatV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.627.995 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.628.015 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.628.124 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.628.211 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.628.281 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.628.355 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.628.421 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.628.488 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.628.511 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.628.575 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.628.599 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.628.647 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.628.715 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.628.783 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.628.848 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.628.918 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.628.984 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.629.048 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.629.117 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.629.185 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.629.258 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.629.324 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.629.389 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.629.457 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.629.520 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.629.584 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.629.652 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.629.722 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.629.791 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.634.860 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.634.985 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.635.097 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.635.364 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : [][][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.635.478 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.635.582 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DeformableOffsetsGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.635.689 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.635.859 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.635.967 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.636.115 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.636.277 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.636.384 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.636.500 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.636.622 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachNonFiniteCheckAndUnscale] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.636.733 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.636.846 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.636.872 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.637.021 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GatherV3] register OP_IMPL : [][][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.637.134 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.637.270 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.637.382 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.637.493 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.637.519 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.637.628 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.637.737 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.637.883 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LinSpace] register OP_IMPL : [][][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.637.996 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MemSet] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.638.100 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.638.213 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.638.339 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.638.445 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.638.558 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.638.692 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NPUClearFloatStatus] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.638.794 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NPUGetFloatStatus] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.638.911 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.638.937 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.639.139 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.639.258 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.639.401 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.639.701 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:ReverseSequence, funcPointer:0xffff0d20d360, registered count:5
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.639.733 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:ReverseSequence, funcPointer:(nil), registered count:7
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.639.755 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:ReverseSequence, funcPointer:(nil), registered count:4
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.639.776 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:ReverseSequence, funcPointer:(nil), registered count:4
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.639.801 [op_check.cc:71]618658 RegisterParamGeneralize:RegisterParamGeneralize: op_type:ReverseSequence, funcPointer:(nil), registered count:4
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.639.823 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.639.946 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.640.058 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.640.254 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.640.421 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.640.529 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.640.554 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.640.656 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.640.682 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.640.790 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.640.904 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.640.930 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.641.048 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.641.153 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.641.257 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.641.370 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.641.562 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.641.588 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.641.691 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.641.796 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.641.984 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.642.100 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.642.203 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.642.305 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.642.418 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.642.613 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.642.769 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.642.907 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.643.049 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.643.167 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.643.280 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.643.391 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BlendFaceBgPartOne] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.643.496 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.643.604 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.643.854 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.644.019 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.644.044 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNN, funcPointer:0xffff0d297e08, registered count:7
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.644.229 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.644.256 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNNV2, funcPointer:0xffff0d2a0298, registered count:7
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.644.372 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.644.480 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.644.632 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.644.747 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GridSampler2D] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.644.852 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GridSampler3D] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.644.960 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandle] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.645.064 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandleV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.645.166 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.645.281 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PasteSubImg] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.645.391 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.645.417 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.645.523 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.645.631 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.645.735 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.645.842 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.645.951 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.646.061 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.646.164 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TabulateFusionGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.646.273 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[YUV4442YUV422] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.646.414 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.646.442 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.646.469 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.646.492 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.646.638 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.646.758 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.646.866 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.646.977 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.647.079 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.647.191 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.647.214 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.647.241 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.647.345 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.647.451 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.647.555 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.647.747 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicAtomicAddrClean] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.647.849 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.647.958 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.648.075 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.648.195 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.648.301 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.648.408 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.648.434 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceMeanD] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.648.539 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.648.641 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.648.668 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.648.946 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.649.052 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.649.160 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.649.267 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.649.382 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.649.493 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.649.594 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.649.700 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.649.898 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.650.003 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.650.119 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.652.571 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DepthToSpace] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.652.619 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.652.645 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SpaceToDepth] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.652.769 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.652.886 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.652.990 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.653.104 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.653.210 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.653.317 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.653.423 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.653.538 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.653.660 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.653.690 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.653.793 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.653.819 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.653.927 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.653.952 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.654.053 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.654.155 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.654.282 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.654.396 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.654.604 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.654.886 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.655.031 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.655.142 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.655.252 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.655.360 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.656.000 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNormGradV3] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.656.804 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.657.115 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.657.553 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.658.126 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.658.247 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.658.369 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.658.509 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.658.621 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.658.888 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPool3DWithArgmaxV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.661.021 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPool3DGradWithArgmax] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.662.041 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.662.202 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.662.355 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CTCLossV3Grad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.663.312 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CTCLossV3] register OP_IMPL : [][][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.663.466 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.663.619 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3DGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.664.082 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.664.203 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.664.317 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.664.441 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.664.546 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.664.659 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.664.768 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.664.875 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.664.987 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.665.102 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.665.210 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.665.364 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PadV3GradReplication] register OP_IMPL : [][][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.665.471 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.665.585 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.665.761 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.665.874 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.665.985 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.666.094 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.666.249 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.666.419 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.666.528 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.666.633 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.666.658 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.666.839 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.666.945 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.667.052 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.667.234 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.667.347 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.667.501 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.667.612 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.667.722 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.667.828 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.667.854 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.667.960 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.667.987 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.668.100 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.668.220 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.668.247 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.668.352 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.668.465 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.668.572 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.668.755 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.668.864 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.669.043 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GridSampler2DGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.669.192 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GridSampler3DGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.669.363 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.669.533 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.669.707 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PadV4Grad] register OP_IMPL : [][][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.669.895 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PadV3GradReplicate] register OP_IMPL : [][][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.670.006 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.670.113 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.670.218 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.670.342 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.670.367 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.670.554 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.670.663 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.670.767 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.670.872 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.670.974 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.671.087 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.671.200 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.671.226 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.671.333 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.671.545 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.672.550 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.674.916 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.675.108 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.675.307 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.675.629 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.675.786 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.675.938 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.676.734 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.676.893 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.677.024 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.677.173 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyAdamWV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.677.320 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.677.441 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.677.605 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.677.750 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.677.896 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.678.019 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.678.126 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.678.217 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.678.522 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.678.550 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.678.573 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.678.596 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.678.618 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.678.641 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.678.667 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.678.688 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.678.710 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.678.731 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.678.758 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.678.780 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.678.801 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.678.822 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.678.841 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.678.862 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.678.885 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.678.906 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.678.927 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.678.948 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.678.983 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.005 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.026 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.049 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.071 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.093 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.117 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.139 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.160 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.181 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.204 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.225 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.247 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.268 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.289 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.310 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.335 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.357 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.378 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.397 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.418 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.441 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.461 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.482 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.504 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.532 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.554 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.575 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.598 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.622 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.643 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.664 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.686 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.707 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.729 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.751 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.679.897 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachACosInplace] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.680.040 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachAddListInplace] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.680.212 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMulScalarInplace] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.680.242 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachLogInplace] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.680.267 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSubListInplace] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.680.290 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachMulListInplace] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.680.312 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachDivListInplace] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.680.453 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachSubScalarInplace] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.680.565 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.680.675 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.680.776 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.680.880 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.680.985 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.681.134 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3dGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.681.258 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.681.411 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.681.517 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.681.631 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.681.660 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.681.684 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.681.789 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.681.814 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.681.837 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.681.945 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.682.101 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.682.248 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.682.390 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.682.496 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.682.684 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IndexPutWithSort] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.682.792 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.682.967 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InplaceIndexAddWithSorted] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.683.078 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.683.194 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.683.220 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.683.244 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.683.392 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.683.541 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.683.690 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.683.834 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.684.006 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.684.173 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.684.298 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.684.448 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.684.601 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.684.766 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.684.897 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.685.004 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.685.112 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.685.223 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.685.328 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.685.474 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.685.618 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.685.729 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Resize] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.685.846 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.685.950 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.686.066 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.686.170 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.686.593 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.687.012 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.687.138 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.687.248 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.687.274 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.687.377 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.687.489 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.687.593 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.687.717 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.687.825 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.687.940 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.688.045 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.688.149 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.688.312 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.688.430 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.688.540 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.688.712 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.688.821 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.688.931 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.689.043 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.689.219 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.689.392 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.689.506 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RoiPoolingGradWithArgMax] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.689.618 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.689.724 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.689.826 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.689.931 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.690.042 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.690.150 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.690.304 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StackBallQuery] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.690.410 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.690.560 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.690.818 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScoreGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.690.999 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.691.159 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.691.336 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.691.539 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.691.733 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.691.935 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.691.960 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.691.982 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.692.003 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.692.026 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.692.049 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.692.071 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.692.092 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.692.823 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.693.213 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.693.615 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.693.806 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.693.994 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.694.399 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.694.517 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.694.674 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.697.261 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.698.995 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.699.120 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.699.231 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.699.350 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.699.628 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CircularPad] register OP_IMPL : [][][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.699.773 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[CircularPadGrad] register OP_IMPL : [][][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.699.957 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.700.289 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.700.322 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.700.348 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.700.375 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.700.399 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.700.569 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleLinear1d] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.700.596 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleBilinear2d] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.700.751 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleBicubic2d] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.700.908 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAA] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.701.070 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAAGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.701.228 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.701.401 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.701.428 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3dGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.701.579 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAA] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.701.750 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAABackward] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.701.907 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.702.067 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ResizeUpsampleTrilinear] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.702.229 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dBackward] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.702.378 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.702.406 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3d] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.702.566 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleNearest] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.702.745 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleNearestExact2dGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.702.772 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[UpsampleNearest2dGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.702.876 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.702.992 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.703.018 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.703.132 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.703.158 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.703.268 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.703.380 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.703.497 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.703.610 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.703.714 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.703.819 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.703.999 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.704.202 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.704.568 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.704.925 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.705.119 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.705.438 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.705.625 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.705.815 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ReflectionPad3dGrad] register OP_IMPL : [][][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.705.934 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.706.049 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.706.188 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.706.231 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.706.257 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.706.280 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantConv2D] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.707.326 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3d] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.707.752 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.707.911 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.708.064 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.708.219 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.708.252 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.708.400 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.708.541 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.708.688 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.708.716 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.708.866 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.709.012 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.709.150 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.709.312 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.709.455 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AGLU] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.709.826 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.710.173 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.710.397 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.710.573 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.711.595 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.712.004 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.712.540 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NLLLossGrad310p] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.712.713 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.712.866 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.712.975 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DropoutWithMulsAndSoftmaxGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.713.133 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.713.277 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.713.304 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.713.419 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.713.447 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.713.753 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.713.861 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.714.016 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ForeachBinaryOp] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.714.165 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.714.278 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.714.568 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.714.749 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.714.900 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.715.015 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.715.121 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.715.269 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InstanceNormV3] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.715.441 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IouV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.715.612 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BidirectionLSTM] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.715.640 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BidirectionLSTMV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.715.792 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.715.820 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.715.960 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaskedSelectV3] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.716.137 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.717.822 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.723.139 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.723.184 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.725.874 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.726.141 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.726.418 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MedianDim] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.726.734 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.726.938 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.727.143 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.727.297 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.727.447 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeTutelCombineGates] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.727.621 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeTutelCombineX] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.727.758 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeTutelDispatch] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.727.848 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.728.088 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScore] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.728.222 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.728.376 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.728.830 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Rfft1D] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.728.983 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.729.139 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.729.169 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GemmaRmsNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.729.285 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.729.399 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.729.571 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LinearIndex] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.729.748 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[LinearIndexV2] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.729.949 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScatterAddWithSorted] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.730.094 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[Sinkhorn] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.730.203 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.730.309 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.730.335 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.730.530 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.730.714 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StackGroupPoints] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.730.860 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [][][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.730.966 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.731.117 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.731.148 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.731.270 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.731.378 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.731.403 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.731.427 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.731.572 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [][][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.731.757 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.731.848 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.732.068 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.732.262 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.732.291 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.732.317 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.732.499 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.732.527 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.735.100 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: Conv2DBackpropFilter, registered count: 15
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.735.200 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: Conv2DBackpropInput, registered count: 15
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.735.226 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: Conv2DTranspose, registered count: 15
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.735.295 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: Conv2D, registered count: 15
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.735.375 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: Conv3DBackpropInput, registered count: 15
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.735.398 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: Conv3DTranspose, registered count: 15
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.735.463 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: Conv3D, registered count: 15
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.735.625 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: FFN, registered count: 15
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.735.646 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: MatmulTunnerTiling, registered count: 15
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.735.761 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: MatMulV2, registered count: 15
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.735.783 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: BatchMatmulFixpipe, registered count: 15
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.735.804 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: MatMulV3, registered count: 15
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.735.825 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: QuantBatchMatmulV3, registered count: 15
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.735.975 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: DynamicRNN, registered count: 15
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.735.997 [tuning_tiling_registry.cc:30]618658 RegisterTilingData:optype: MatMulTunnerTiling, registered count: 15
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.737.091 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:MatMulV2, funcPointer:0xffff0dbdc0b0, registered count:7
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.737.126 [op_check.cc:24]618658 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:MatMulV2, funcPointer:0xffff0dbdc310, registered count:5
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.737.493 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [][][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.737.985 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [][][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.739.561 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : [][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.739.726 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.739.802 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.740.167 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [][][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.740.612 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [][][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.770.376 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [][][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.770.486 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.770.675 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.770.752 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.770.889 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.771.026 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.771.674 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [][][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.771.762 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.772.017 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.772.099 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MlaAttentionScore] register OP_IMPL : []
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.772.252 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.772.481 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.772.659 [op_impl_registry.cc:122]618658 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [][][][]
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.773.297 [op_impl_registry_holder_manager.cc:208]618658 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 599
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.779.028 [op_impl_registry_holder_manager.cc:208]618658 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 599
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.781.024 [op_impl_registry_holder_manager.cc:208]618658 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.858.975 [op_impl_space_registry.cc:109]618658 MergeFunctions:op type AvgPool3DGrad inputs_dependency has been registered
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.860.299 [op_impl_space_registry.cc:84]618658 MergeFunctions:op type MoeInitRoutingV2 tiling_parse func has been registered
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.860.331 [op_impl_space_registry.cc:85]618658 MergeFunctions:op type MoeInitRoutingV2 compile_info_creator func has been registered
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.860.349 [op_impl_space_registry.cc:86]618658 MergeFunctions:op type MoeInitRoutingV2 compile_info_deleter func has been registered
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.860.363 [op_impl_space_registry.cc:87]618658 MergeFunctions:op type MoeInitRoutingV2 tiling func has been registered
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.860.378 [op_impl_space_registry.cc:93]618658 MergeFunctions:op type MoeInitRoutingV2 max_tiling_data_size has been registered
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.861.387 [op_impl_space_registry.cc:273]618658 ConvertSoToRegistry:Save so symbol and handle in path[/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so] success!
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.861.857 [plugin_manager.cc:564]618658 GetUpgradedOpMasterPath:Start to get upgraded op tiling path
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.861.887 [plugin_manager.cc:134]618658 GetUpgradedOppPath:Enter get upgraded opp path schedule
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.861.952 [file_utils.cc:47]618658 RealPath:[Util][realpath] Can not get real_path for /usr/local/Ascend/ascend-toolkit/latest/opp_latest/, reason:No such file or directory
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.861.999 [plugin_manager.cc:145]618658 GetUpgradedOppPath:[Call][RealPath] Opp path /usr/local/Ascend/ascend-toolkit/latest/opp_latest/ is invalid.
[WARNING] GE(618658,python3.9):2025-04-03-09:27:39.862.011 [plugin_manager.cc:567]618658 GetUpgradedOpMasterPath:Failed to get upgraded opp path!
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.862.088 [mem_manager.cc:31]618658 Initialize:MemManager Initialize.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.862.126 [rts_caching_mem_allocator.cc:131]618658 Initialize:RtsAllocatorManager Initialize.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.862.145 [mem_manager.cc:102]618658 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.862.160 [graph_mem_allocator.cc:17]618658 Initialize:MemoryAllocator::Initialize.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.862.177 [mem_manager.cc:102]618658 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.862.189 [graph_mem_allocator.cc:17]618658 Initialize:MemoryAllocator::Initialize.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.862.202 [mem_manager.cc:102]618658 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.862.218 [caching_allocator.cc:391]618658 FreeBlocks:Free blocks.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.862.231 [caching_allocator.cc:358]618658 FreeCachedBlocks:Free cached blocks
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.862.247 [mem_manager.cc:102]618658 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.862.262 [caching_allocator.cc:391]618658 FreeBlocks:Free blocks.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.862.273 [caching_allocator.cc:358]618658 FreeCachedBlocks:Free cached blocks
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.862.288 [mem_manager.cc:102]618658 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.862.304 [mem_manager.cc:102]618658 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.862.317 [mem_manager.cc:102]618658 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.862.330 [mem_manager.cc:102]618658 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.862.347 [mem_manager.cc:102]618658 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.862.359 [session_scope_mem_allocator.cc:73]618658 FreeAllMemory:Free all memory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.862.374 [mem_manager.cc:102]618658 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.862.389 [session_scope_mem_allocator.cc:73]618658 FreeAllMemory:Free all memory
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.862.433 [dump_manager.cc:152]618658 Init:exception dump is not enabled
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.862.480 [ge_executor.cc:315]618658 Initialize:Init GeExecutor over.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.862.507 [acl.cpp:321]618658 aclInit: set DumpConfig in aclInit
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.862.525 [dump.cpp:841]618658 HandleDumpConfig: start to execute HandleDumpConfig.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.862.692 [dump.cpp:759]618658 ConvertDumpCfg: start to execute ConvertDumpCfg.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.862.708 [dump.cpp:594]618658 IsValidDumpConfig: start to execute IsValidDumpConfig.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.862.719 [dump.cpp:224]618658 CheckDumpSceneSwitch: start to execute CheckDumpSceneSwitch.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.862.759 [dump.cpp:703]618658 SetUpDumpConfig: convert to ge dump config successfully, enable lite_exception dump, path=
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.862.789 [dump.cpp:771]618658 HandleDumpCommand: start to execute HandleDumpCommand.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.862.802 [dump.cpp:703]618658 SetUpDumpConfig: convert to ge dump config successfully, enable lite_exception dump, path=
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.862.873 [adx_datadump_server.cpp:77][tid:618658] start to do dump init
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.862.896 [adx_dump_record.cpp:210][tid:618658] dumpPath prefix is /home/jenkins/mindspore/testcases/testcases/tests/st/lccl
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.862.914 [adx_dump_record.cpp:214][tid:618658] record remote dump temp path : /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.863.136 [adx_server_manager.cpp:149][tid:618776] server manager add component (10)
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.863.153 [adx_dump_record.cpp:627][tid:618777] start dump thread, remote dump record temp path : /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/.
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.863.162 [adx_server_manager.cpp:165][tid:618776] server manager components init successfully
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.863.272 [adx_server_manager.cpp:203][tid:618778] Run Server(0) Process
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.863.325 [adx_server_manager.cpp:369][tid:618778] device up 0
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.863.344 [hdc_comm_opt.cpp:59][tid:618778] open device[0] server[13]
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.863.467 [drv_log_user.c:623][ascend][curpid:618658,618778][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=0; fid=0; service_type="service_dump"; pid=618658)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.863.486 [hdc_server.c:363][ascend][curpid:618658,618778][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=0)
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.863.504 [hdc_api.cpp:119][tid:618778] logDevId 0 create HDC server successfully
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.863.542 [adx_server_manager.cpp:111][tid:618778] create server info
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.863.558 [adx_server_manager.cpp:369][tid:618778] device up 1
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.863.570 [hdc_comm_opt.cpp:59][tid:618778] open device[1] server[13]
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.863.701 [drv_log_user.c:623][ascend][curpid:618658,618778][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=1; fid=0; service_type="service_dump"; pid=618658)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.863.718 [hdc_server.c:363][ascend][curpid:618658,618778][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=1)
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.863.731 [hdc_api.cpp:119][tid:618778] logDevId 1 create HDC server successfully
[WARNING] IDEDD(618658,python3.9):2025-04-03-09:27:39.863.744 [adx_hdc_epoll.cpp:34][tid:618778] hdc epoll has been created.
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.863.758 [adx_server_manager.cpp:111][tid:618778] create server info
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.863.773 [adx_server_manager.cpp:369][tid:618778] device up 2
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.863.783 [hdc_comm_opt.cpp:59][tid:618778] open device[2] server[13]
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.863.856 [drv_log_user.c:623][ascend][curpid:618658,618778][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=2; fid=0; service_type="service_dump"; pid=618658)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.863.872 [hdc_server.c:363][ascend][curpid:618658,618778][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=2)
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.863.885 [hdc_api.cpp:119][tid:618778] logDevId 2 create HDC server successfully
[WARNING] IDEDD(618658,python3.9):2025-04-03-09:27:39.863.916 [adx_hdc_epoll.cpp:34][tid:618778] hdc epoll has been created.
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.863.929 [adx_server_manager.cpp:111][tid:618778] create server info
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.863.942 [adx_server_manager.cpp:369][tid:618778] device up 3
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.863.956 [hdc_comm_opt.cpp:59][tid:618778] open device[3] server[13]
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.864.088 [drv_log_user.c:623][ascend][curpid:618658,618778][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=3; fid=0; service_type="service_dump"; pid=618658)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.864.105 [hdc_server.c:363][ascend][curpid:618658,618778][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=3)
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.864.118 [hdc_api.cpp:119][tid:618778] logDevId 3 create HDC server successfully
[WARNING] IDEDD(618658,python3.9):2025-04-03-09:27:39.864.131 [adx_hdc_epoll.cpp:34][tid:618778] hdc epoll has been created.
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.864.148 [adx_server_manager.cpp:111][tid:618778] create server info
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.864.180 [adx_server_manager.cpp:369][tid:618778] device up 4
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.864.199 [hdc_comm_opt.cpp:59][tid:618778] open device[4] server[13]
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.864.330 [drv_log_user.c:623][ascend][curpid:618658,618778][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=4; fid=0; service_type="service_dump"; pid=618658)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.864.347 [hdc_server.c:363][ascend][curpid:618658,618778][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=4)
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.864.360 [hdc_api.cpp:119][tid:618778] logDevId 4 create HDC server successfully
[WARNING] IDEDD(618658,python3.9):2025-04-03-09:27:39.864.373 [adx_hdc_epoll.cpp:34][tid:618778] hdc epoll has been created.
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.864.387 [adx_server_manager.cpp:111][tid:618778] create server info
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.864.402 [adx_server_manager.cpp:369][tid:618778] device up 5
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.864.412 [hdc_comm_opt.cpp:59][tid:618778] open device[5] server[13]
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.864.541 [drv_log_user.c:623][ascend][curpid:618658,618778][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=5; fid=0; service_type="service_dump"; pid=618658)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.864.557 [hdc_server.c:363][ascend][curpid:618658,618778][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=5)
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.864.570 [hdc_api.cpp:119][tid:618778] logDevId 5 create HDC server successfully
[WARNING] IDEDD(618658,python3.9):2025-04-03-09:27:39.864.582 [adx_hdc_epoll.cpp:34][tid:618778] hdc epoll has been created.
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.864.596 [adx_server_manager.cpp:111][tid:618778] create server info
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.864.608 [adx_server_manager.cpp:369][tid:618778] device up 6
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.864.619 [hdc_comm_opt.cpp:59][tid:618778] open device[6] server[13]
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.864.751 [drv_log_user.c:623][ascend][curpid:618658,618778][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=6; fid=0; service_type="service_dump"; pid=618658)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.864.768 [hdc_server.c:363][ascend][curpid:618658,618778][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=6)
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.864.781 [hdc_api.cpp:119][tid:618778] logDevId 6 create HDC server successfully
[WARNING] IDEDD(618658,python3.9):2025-04-03-09:27:39.864.793 [adx_hdc_epoll.cpp:34][tid:618778] hdc epoll has been created.
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.864.820 [adx_server_manager.cpp:111][tid:618778] create server info
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.864.832 [adx_server_manager.cpp:369][tid:618778] device up 7
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.864.843 [hdc_comm_opt.cpp:59][tid:618778] open device[7] server[13]
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.864.976 [drv_log_user.c:623][ascend][curpid:618658,618778][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=7; fid=0; service_type="service_dump"; pid=618658)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.864.993 [hdc_server.c:363][ascend][curpid:618658,618778][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=7)
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.865.006 [hdc_api.cpp:119][tid:618778] logDevId 7 create HDC server successfully
[WARNING] IDEDD(618658,python3.9):2025-04-03-09:27:39.865.019 [adx_hdc_epoll.cpp:34][tid:618778] hdc epoll has been created.
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.865.034 [adx_server_manager.cpp:111][tid:618778] create server info
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.866.243 [adx_server_manager.cpp:457][tid:618658] The server is initialized after waiting 3 times.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.866.265 [ge_executor.cc:1349]618658 SetDump:Start to set dump config
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.866.284 [dump_manager.cc:201]618658 NeedDoDump:Dump status: on, Overflow detection dump switch: off.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.866.322 [dump_manager.cc:261]618658 SetExceptionDump:Enable brief exception dump.
[INFO] GE(618658,python3.9):2025-04-03-09:27:39.866.369 [ge_executor.cc:1355]618658 SetDump:Set dump config successfully
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.866.405 [dump_manager.cpp:146][tid:618658] Set 3 dump setting, status: on, dump switch: 3
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:39.867.843 [dump_manager.cpp:301][tid:618658] Register exception callback, registered: 1
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.867.864 [dump.cpp:825]618658 HandleDumpCommand: set dump config for model successfully,adumpType = 3, dump_path = , dump_mode = , dump_op_switch = , dump_data = .
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.867.888 [acl.cpp:327]618658 aclInit: set HandleDumpConfig success in aclInit
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.867.904 [acl.cpp:329]618658 aclInit: set max_opqueue_num in aclInit
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.867.918 [acl_resource_manager.cpp:248]618658 HandleMaxOpQueueConfig: start to execute HandleMaxOpQueueConfig
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.868.014 [acl_resource_manager.cpp:275]618658 HandleMaxOpQueueConfig: no max_opqueue_num found, set default DEFAULT_MAX_OPQUEUE_NUM[20000].
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.868.033 [acl_resource_manager.cpp:278]618658 HandleMaxOpQueueConfig: HandleMaxOpQueueConfig end in HandleMaxOpQueueConfig
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.868.047 [acl.cpp:335]618658 aclInit: set HandleMaxOpQueueConfig success in aclInit
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.868.062 [acl.cpp:336]618658 aclInit: set HandleDefaultDevice in aclInit
[WARNING] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.868.130 [json_parser.cpp:260]618658 GetDefaultDeviceIdFromFile: no defaultDevice item!
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.868.148 [acl.cpp:343]618658 aclInit: set HandleDefaultDevice success in aclInit
[INFO] PROFILING(618658,python3.9):2025-04-03-09:27:39.868.193 [prof_atls_plugin.cpp:210] (tid:618658) Module[48] register callback of ctrl handle.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.868.210 [acl.cpp:351]618658 aclInit: set ProfilingConfig in aclInit
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.868.223 [profiling.cpp:141]618658 HandleProfilingConfig: start to execute HandleProfilingConfig
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.868.253 [profiling.cpp:135]618658 GetProfilingConfigFile: no profiling config file.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.868.317 [profiling.cpp:167]618658 HandleProfilingConfig: can not parse profiling config from file[/home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618658.json], errorCode = 0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.868.335 [profiling.cpp:172]618658 HandleProfilingConfig: profiling config file[/home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618658.json] is empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.868.346 [profiling.cpp:176]618658 HandleProfilingConfig: start to use profiling config by config file mode
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.868.359 [profiling.cpp:179]618658 HandleProfilingConfig: ParseJsonFromFile ok in HandleProfilingConfig
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.868.371 [profiling.cpp:92]618658 HandleProfilingCommand: start to execute HandleProfilingCommand
[INFO] PROFILING(618658,python3.9):2025-04-03-09:27:39.868.758 [ai_drv_dev_api.cpp:316] >>> (tid:618658) Succeeded to get device 64 frequency=100000
[INFO] PROFILING(618658,python3.9):2025-04-03-09:27:39.868.867 [msprof_callback_impl.cpp:132] >>> (tid:618658) Dynamic profiling environment not really set, so do nothing.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.868.886 [profiling.cpp:122]618658 HandleProfilingCommand: set profiling config successfully
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.868.899 [profiling.cpp:186]618658 HandleProfilingConfig: set HandleProfilingConfig success
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.868.912 [hash_utils.cpp:108]618658 CalculateSimpleHash: Begin to calculate hash for file: /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618658.json
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.868.953 [hash_utils.cpp:128]618658 CalculateSimpleHash: file: /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618658.json, hash: 3917491750093904922
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.868.971 [acl.cpp:115]618658 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.869.008 [acl.cpp:280]618658 IsEnableAutoUCMemeory: auto-uc-memory is enabled.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.869.024 [acl.cpp:385]618658 aclInit: register kernel launch fill function in aclInit
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.869.046 [runtime.cc:5394] 618658 RegKernelLaunchFillFunc: registercallback finish, symbol:g_opSystemRunCfg.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.869.066 [api_impl.cc:7407] 618658 RegStreamStateCallback: Reg stream state callback, regName=ACL_MODULE_STREAM.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.869.095 [api_impl.cc:4211] 618658 RegDeviceStateCallback: Reg device state callback, regName=ACL_MODULE_DEVICE.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.869.116 [acl.cpp:420]618658 aclInit: successfully execute aclInit, aclInitRefCount is 1
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.869.311 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:199] InitializeAcl] Call aclInit successfully, json is {"dump":{"dump_scene":"lite_exception"},"err_msg_mode":"1"}
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.869.439 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:295] Initialize] End initializing device context.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.869.504 [mindspore/ccsrc/plugin/res_manager/ascend/ascend_res_manager.cc:467] LoadCollectiveCommLib] Loading MACCL collective library successfully.
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.869.530 [mindspore/ccsrc/distributed/collective/collective_manager.cc:621] InitDeviceCommLib] Start initializing communication library on device side...
[INFO] PROFILING(618658,python3.9):2025-04-03-09:27:39.874.895 [prof_atls_plugin.cpp:210] (tid:618658) Module[0] register callback of ctrl handle.
[WARNING] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.875.734 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:76] Initialize] Loading LCCL because env MS_ENABLE_LCCL is set to on. Pay attention that LCCL only supports communication group within single node in KernelByKernel for now.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.875.766 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:80] Initialize] Successfully initialize LCCL.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.875.847 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ascend_deprecated_interface.cc:83] OpenTsd] Device id = 3, rank size = 8.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.875.868 [device.cpp:143]618658 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.875.896 [api_impl.cc:2999] 618658 SetDevice: device_id=3, deviceMode=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.875.915 [device.cc:306] 618658 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.875.935 [runtime.cc:3393] 618658 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.875.955 [runtime.cc:3560] 618658 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.875.973 [api_impl.cc:2987] 618658 NewDevice: SetCurRef = 0xaaab0b9e09a0,userDeviceId=3,deviceId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.875.992 [runtime.cc:5239] 618658 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.876.012 [api_impl.cc:2992] 618658 NewDevice: New device success, user_device_id=3, die_num=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.876.036 [api_impl.cc:3025] 618658 SetDevice: SetDevice success, curCtx=0xaaab0b9e09a0, user_device_id=3.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.876.053 [acl.cpp:115]618658 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.876.066 [acl.cpp:121]618658 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.876.093 [device.cpp:154]618658 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 3
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.876.150 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel _npu_log begins the construction process witch capacity 128
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.876.192 [tensor_data_transfer.cpp:898]618658 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 3, name is _npu_log, capacity is 128
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.876.219 [api_impl.cc:6077] 618658 MemQueueInit: Start to init queue on devId 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.876.235 [npu_driver.cc:4076] 618658 MemQueueInit: init mem queue, device_id=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.876.252 [npu_driver.cc:4026] 618658 CheckMemQueueSupported: get majorVersion 7
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.876.287 [queue_client.c:151][ascend][curpid:618658,618658][drv][queuemng][QueueGetHostpid]Query tgid. (tgid=618658)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.876.417 [queue_client.c:305][ascend][curpid:618658,618658][drv][queuemng][QueueGetDevPid]Query devpid succ. (devId=3; vfid=0; hostpid=618658; master_pid=618658; proc_type=0; devpid=30107).
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.880.560 [queue_client.c:362][ascend][curpid:618658,618658][drv][queuemng][QueueInit]QueueInit device. (devid=3; mcast_flag=0; mcast_gid=0; proc_sn=0; event_sn_offset=0)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.880.754 [npu_driver.cc:4114] 618658 MemQueueInit: get max queue cnt 4294967294 success.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.880.778 [api_impl.cc:6040] 618658 MemQueueCreate: Start to create queue on devId 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.880.794 [npu_driver.cc:3931] 618658 MemQueueCreate: create mem queue, deviceId=3, name=_npu_log.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.881.099 [queue_interface.c:182][ascend][curpid:618658,618658][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=0, actualQid=0, deploy_type=0)
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.881.119 [tensor_data_transfer.cpp:940]618658 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 3, name is _npu_log, real name is _npu_log, qid is 0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.881.329 [tensor_data_transfer.cpp:1054]618779 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is _npu_log
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.881.370 [tensor_data_transfer.cpp:1056]618779 acltdtReceiveTensor: new process, use queue process
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.881.379 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_tensor_dump begins the construction process witch capacity 128
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.881.401 [tensor_data_transfer.cpp:898]618658 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 3, name is ms_tensor_dump, capacity is 128
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.881.406 [api_impl.cc:6121] 618779 MemQueuePeek: Start to peek queue on devId 3, qid is 0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.881.425 [api_impl.cc:6077] 618658 MemQueueInit: Start to init queue on devId 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.881.428 [npu_driver.cc:4330] 618779 MemQueuePeek: peek mem queue, deviceId=3, qid=0, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.881.441 [npu_driver.cc:4076] 618658 MemQueueInit: init mem queue, device_id=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.881.453 [npu_driver.cc:4026] 618658 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:39.881.482 [npu_driver.cc:4087] 618658 MemQueueInit: repeated init
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.881.500 [api_impl.cc:6040] 618658 MemQueueCreate: Start to create queue on devId 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.881.514 [npu_driver.cc:3931] 618658 MemQueueCreate: create mem queue, deviceId=3, name=ms_tensor_dump.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.881.707 [queue_interface.c:182][ascend][curpid:618658,618658][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=1, actualQid=1, deploy_type=0)
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.881.727 [tensor_data_transfer.cpp:940]618658 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 3, name is ms_tensor_dump, real name is ms_tensor_dump, qid is 1
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.881.822 [tensor_data_transfer.cpp:1054]618781 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_tensor_dump
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.881.850 [tensor_data_transfer.cpp:1056]618781 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.881.880 [api_impl.cc:6121] 618781 MemQueuePeek: Start to peek queue on devId 3, qid is 1.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.881.881 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_tensor_summary begins the construction process witch capacity 128
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.881.898 [npu_driver.cc:4330] 618781 MemQueuePeek: peek mem queue, deviceId=3, qid=1, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.881.907 [tensor_data_transfer.cpp:898]618658 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 3, name is ms_tensor_summary, capacity is 128
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.881.936 [api_impl.cc:6077] 618658 MemQueueInit: Start to init queue on devId 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.881.952 [npu_driver.cc:4076] 618658 MemQueueInit: init mem queue, device_id=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.881.964 [npu_driver.cc:4026] 618658 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:39.881.989 [npu_driver.cc:4087] 618658 MemQueueInit: repeated init
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.882.006 [api_impl.cc:6040] 618658 MemQueueCreate: Start to create queue on devId 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.882.018 [npu_driver.cc:3931] 618658 MemQueueCreate: create mem queue, deviceId=3, name=ms_tensor_summary.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.882.167 [queue_interface.c:182][ascend][curpid:618658,618658][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=2, actualQid=2, deploy_type=0)
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.882.187 [tensor_data_transfer.cpp:940]618658 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 3, name is ms_tensor_summary, real name is ms_tensor_summary, qid is 2
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.882.291 [tensor_data_transfer.cpp:1054]618783 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_tensor_summary
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.882.317 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_image_summary begins the construction process witch capacity 128
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.882.328 [tensor_data_transfer.cpp:1056]618783 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.882.340 [tensor_data_transfer.cpp:898]618658 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 3, name is ms_image_summary, capacity is 128
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.882.348 [api_impl.cc:6121] 618783 MemQueuePeek: Start to peek queue on devId 3, qid is 2.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.882.360 [api_impl.cc:6077] 618658 MemQueueInit: Start to init queue on devId 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.882.364 [npu_driver.cc:4330] 618783 MemQueuePeek: peek mem queue, deviceId=3, qid=2, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.882.375 [npu_driver.cc:4076] 618658 MemQueueInit: init mem queue, device_id=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.882.388 [npu_driver.cc:4026] 618658 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:39.882.413 [npu_driver.cc:4087] 618658 MemQueueInit: repeated init
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.882.430 [api_impl.cc:6040] 618658 MemQueueCreate: Start to create queue on devId 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.882.443 [npu_driver.cc:3931] 618658 MemQueueCreate: create mem queue, deviceId=3, name=ms_image_summary.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.882.608 [queue_interface.c:182][ascend][curpid:618658,618658][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=3, actualQid=3, deploy_type=0)
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.882.628 [tensor_data_transfer.cpp:940]618658 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 3, name is ms_image_summary, real name is ms_image_summary, qid is 3
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.882.719 [tensor_data_transfer.cpp:1054]618785 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_image_summary
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.882.746 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_scalar_summary begins the construction process witch capacity 128
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.882.758 [tensor_data_transfer.cpp:1056]618785 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.882.769 [tensor_data_transfer.cpp:898]618658 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 3, name is ms_scalar_summary, capacity is 128
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.882.778 [api_impl.cc:6121] 618785 MemQueuePeek: Start to peek queue on devId 3, qid is 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.882.788 [api_impl.cc:6077] 618658 MemQueueInit: Start to init queue on devId 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.882.793 [npu_driver.cc:4330] 618785 MemQueuePeek: peek mem queue, deviceId=3, qid=3, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.882.803 [npu_driver.cc:4076] 618658 MemQueueInit: init mem queue, device_id=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.882.815 [npu_driver.cc:4026] 618658 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:39.882.844 [npu_driver.cc:4087] 618658 MemQueueInit: repeated init
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.882.860 [api_impl.cc:6040] 618658 MemQueueCreate: Start to create queue on devId 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.882.873 [npu_driver.cc:3931] 618658 MemQueueCreate: create mem queue, deviceId=3, name=ms_scalar_summary.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.883.052 [queue_interface.c:182][ascend][curpid:618658,618658][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=4, actualQid=4, deploy_type=0)
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.883.071 [tensor_data_transfer.cpp:940]618658 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 3, name is ms_scalar_summary, real name is ms_scalar_summary, qid is 4
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.883.246 [tensor_data_transfer.cpp:1054]618787 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_scalar_summary
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.883.263 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_histogram_summary begins the construction process witch capacity 128
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.883.281 [tensor_data_transfer.cpp:1056]618787 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.883.293 [tensor_data_transfer.cpp:898]618658 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 3, name is ms_histogram_summary, capacity is 128
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.883.301 [api_impl.cc:6121] 618787 MemQueuePeek: Start to peek queue on devId 3, qid is 4.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.883.313 [api_impl.cc:6077] 618658 MemQueueInit: Start to init queue on devId 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.883.317 [npu_driver.cc:4330] 618787 MemQueuePeek: peek mem queue, deviceId=3, qid=4, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.883.326 [npu_driver.cc:4076] 618658 MemQueueInit: init mem queue, device_id=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.883.337 [npu_driver.cc:4026] 618658 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:39.883.364 [npu_driver.cc:4087] 618658 MemQueueInit: repeated init
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.883.381 [api_impl.cc:6040] 618658 MemQueueCreate: Start to create queue on devId 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.883.393 [npu_driver.cc:3931] 618658 MemQueueCreate: create mem queue, deviceId=3, name=ms_histogram_summary.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.883.573 [queue_interface.c:182][ascend][curpid:618658,618658][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=5, actualQid=5, deploy_type=0)
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.883.592 [tensor_data_transfer.cpp:940]618658 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 3, name is ms_histogram_summary, real name is ms_histogram_summary, qid is 5
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.883.679 [tensor_data_transfer.cpp:1054]618789 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_histogram_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.883.708 [tensor_data_transfer.cpp:1056]618789 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.883.727 [api_impl.cc:6121] 618789 MemQueuePeek: Start to peek queue on devId 3, qid is 5.
[INFO] HCCL_ADPT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.883.733 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:273] InitHccl] Start init hccl adapter.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.883.744 [npu_driver.cc:4330] 618789 MemQueuePeek: peek mem queue, deviceId=3, qid=5, timeout=800.
[INFO] HCCL_ADPT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.883.886 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:569] InitKernelInfoStore] Start init hccl kernel info store.
[INFO] HCCL_ADPT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.883.922 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:586] InitKernelInfoStore] Get builder ops_kernel_info_hccl
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:39.883.943 [plugin_manager.cc:25] [618658]hcom ops plugin init start.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:39.883.983 [plugin_manager.cc:38] [618658]input BUILD_MODE is not set, result autoTune is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:39.884.006 [plugin_manager.cc:42] [618658]hcom running normal mode.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:39.884.050 [hcom_plugin.cc:50] [618658]Initialize start.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:39.884.067 [hcom_plugin.cc:52] [618658]initializeCount_ : 1
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:39.884.105 [hcom_plugin.cc:60] [618658]hvdOpsKernelInfoStoreInfoPtr_ is initialized
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:39.884.133 [hcom_plugin.cc:63] [618658]hvdGraphOptimizerPtr_ is initialized
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:39.884.150 [hcom_plugin.cc:329] [618658]ParserHcclAlgoDesc: there is no key named "HCCL_algorithm" in the options.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:39.884.185 [hcom_plugin.cc:281] [618658]ParserHcclExecTimeOut: there is no key named "HCCL_execTimeOut" in the options.
[WARNING] HCCL(618658,python3.9):2025-04-03-09:27:39.884.209 [hcom_plugin.cc:217] [618658]option profiling mode is not found.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:39.884.233 [hcom_plugin.cc:164] [618658][masterInfo]get Master Info:ip or port or deviceId not set.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:39.884.251 [hcom_plugin.cc:180] [618658][masterInfo]get Rank Info: worker size not set.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:39.884.264 [hcom_plugin.cc:244] [618658]InitializePlugin: Init without ranktable and masterInfo, please check your mode.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:39.884.392 [hcom_plugin.cc:82] [618658]hccl ops plugin init success.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:39.884.410 [plugin_manager.cc:48] [618658]hcom ops plugin init end. ret[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:39.884.424 [hcom_plugin.cc:126] [618658]get hccl kernel info store start.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:39.884.449 [hcom_plugin.cc:132] [618658]get hccl kernel info store finished.
[INFO] HCCL_ADPT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.884.478 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:608] InitKernelInfoStore] Init hccl kernel info store success.
[INFO] HCCL_ADPT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.884.516 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:786] InitHcclExec] Start init hccl exec.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:39.884.532 [hcom_executor.cc:29] [618658]Hcom Excutor Initialize start.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.884.584 [runtime.cc:5239] 618658 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:39.884.605 [adapter_rts.cc:234] [618658][hrtGetDevice]deviceLogicId[3]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.884.636 [api_c_soc.cc:70] 618658 rtGetSocVersion: soc version is Ascend910B3
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:39.884.730 [hcom_common.cc:85] [618658][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[3] 
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:39.884.758 [hcom_common.cc:88] [618658][HcomGetCurHcomCtx] is no Used deviceLogicId[3] 
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:39.884.786 [hcom.cc:486] [618658]Get Hcom Init Status: [0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:39.884.814 [hcom_common.cc:85] [618658][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[3] 
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:39.884.831 [hcom_rpc.cc:1019] [618658]Get Hcom Init Status: [0]
[WARNING] HCCL(618658,python3.9):2025-04-03-09:27:39.884.854 [hcom_base_funs.cc:36] [618658][HcomOpsKernelInfoStore][InitHcom]OPTION_EXEC_RANK_TABLE is not found.
[WARNING] HCCL(618658,python3.9):2025-04-03-09:27:39.884.881 [hcom_executor.cc:121] [618658][HcomOpsKernelInfoStore][InitHcom]OPTION_EXEC_HCOM_GROUPLIST is not found.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.884.949 [api_impl.cc:1120] 618658 StreamCreate: priority=0, flags=1536.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.884.979 [npu_driver.cc:404] 618658 StreamIdAlloc: stream id alloc begin, device_id=3, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.885.048 [stream.cc:2246] 618658 AllocExecutedTimesSvm: stream_id=4.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.885.114 [stream_sqcq_manage.cc:147] 618658 Alloc: deviceId=3, tsId=0, drvFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.885.134 [npu_driver.cc:882] 618658 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.885.421 [npu_driver.cc:6125] 618658 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.885.472 [npu_driver.cc:6137] 618658 LogicCqAllocateV2: success: deviceId=3, tsId=0, cqId=1042, streamId=4, logicCq=1042, cqeDepth=4096
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.885.502 [npu_driver.cc:6189] 618658 StreamBindLogicCq: success: deviceId=3, tsId=0, streamId=4, logicCq=1042.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.885.523 [npu_driver.cc:5916] 618658 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=ec029000, addr=dfffec029000size=4096
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.885.541 [stream.cc:653] 618658 Setup: Success to get sq=4 sq reg virtual addr length=4096.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.885.616 [devmm_svm.c:1972][ascend][curpid:618658,618658][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.885.636 [npu_driver.cc:6080] 618658 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.885.983 [stream.cc:291] 618658 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=4, flags_=0x600.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.886.610 [stream.cc:688] 618658 Setup: stream setup end, stream_id=4, IsTaskSink=0, sqId=4, cqId=4, deviceId=3, streamResId=65535
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.886.632 [acl_resource_manager.cpp:814]618658 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.886.660 [acl_resource_manager.cpp:816]618658 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.886.675 [api_impl.cc:1162] 618658 StreamCreate: Succ, flags=1536, stream_id=4, context=aaab0b9e09a0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:39.886.707 [stream.cc:73] [618658]Construct stream by stream type success, ptr[0xaaab15ec6c70] ctx[0xaaab0b9e09a0], stream id[4], cqId[4], logicCqid[1042]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.886.747 [api_impl.cc:1120] 618658 StreamCreate: priority=0, flags=1536.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.886.769 [npu_driver.cc:404] 618658 StreamIdAlloc: stream id alloc begin, device_id=3, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.886.801 [stream.cc:2246] 618658 AllocExecutedTimesSvm: stream_id=5.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.886.837 [stream_sqcq_manage.cc:147] 618658 Alloc: deviceId=3, tsId=0, drvFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.886.854 [npu_driver.cc:882] 618658 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.887.017 [npu_driver.cc:6125] 618658 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.887.067 [npu_driver.cc:6137] 618658 LogicCqAllocateV2: success: deviceId=3, tsId=0, cqId=1043, streamId=5, logicCq=1043, cqeDepth=4096
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.887.090 [npu_driver.cc:6189] 618658 StreamBindLogicCq: success: deviceId=3, tsId=0, streamId=5, logicCq=1043.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.887.109 [npu_driver.cc:5916] 618658 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=ec008000, addr=dfffec008000size=4096
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.887.127 [stream.cc:653] 618658 Setup: Success to get sq=5 sq reg virtual addr length=4096.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:39.887.172 [devmm_svm.c:1972][ascend][curpid:618658,618658][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.887.193 [npu_driver.cc:6080] 618658 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.887.505 [stream.cc:291] 618658 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=5, flags_=0x600.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.218 [stream.cc:688] 618658 Setup: stream setup end, stream_id=5, IsTaskSink=0, sqId=5, cqId=5, deviceId=3, streamResId=65535
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.888.240 [acl_resource_manager.cpp:814]618658 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.888.257 [acl_resource_manager.cpp:816]618658 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.272 [api_impl.cc:1162] 618658 StreamCreate: Succ, flags=1536, stream_id=5, context=aaab0b9e09a0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:39.888.294 [stream.cc:73] [618658]Construct stream by stream type success, ptr[0xaaab15f42cd0] ctx[0xaaab0b9e09a0], stream id[5], cqId[5], logicCqid[1043]
[WARNING] HCCL(618658,python3.9):2025-04-03-09:27:39.888.454 [sal.cc:619] [618791]err[34] link[Hccl_MessageProcess] nameSet failed.
[WARNING] HCCL(618658,python3.9):2025-04-03-09:27:39.888.479 [sal.cc:619] [618792]err[34] link[Hccl_MessageProcess] nameSet failed.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:39.888.494 [hcom_executor.cc:587] [618791]MessageProcessThreadLoop start queType:[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:39.888.507 [hcom_executor.cc:587] [618792]MessageProcessThreadLoop start queType:[1]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.591 [api_impl.cc:2999] 618791 SetDevice: device_id=3, deviceMode=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.591 [api_impl.cc:2999] 618792 SetDevice: device_id=3, deviceMode=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.620 [device.cc:306] 618791 Init: device mode has been already set, mode=0.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:39.888.625 [hcom_executor.cc:34] [618658][Initialize][HcomExecutor]Hcom Excutor Initialize end. ret[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.630 [api_impl.cc:2999] 618793 SetDevice: device_id=3, deviceMode=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.639 [device.cc:306] 618792 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.639 [runtime.cc:3393] 618791 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x3
[INFO] HCCL_ADPT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.888.665 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:792] InitHcclExec] Hcom DynamicKernel Initialize success
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.664 [api_impl.cc:2999] 618794 SetDevice: device_id=3, deviceMode=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.680 [runtime.cc:3393] 618792 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x4
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.682 [device.cc:306] 618793 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.683 [runtime.cc:3560] 618791 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=3
[INFO] HCCL_ADPT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.888.698 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:798] InitHcclExec] InitHcclExec success
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.712 [runtime.cc:3560] 618792 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.722 [runtime.cc:3393] 618793 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x5
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.724 [device.cc:306] 618794 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.725 [api_impl.cc:2987] 618791 NewDevice: SetCurRef = 0xaaab0b9e09a0,userDeviceId=3,deviceId=3
[INFO] HCCL_ADPT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.888.737 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:291] InitHccl] Init hccl adapter success.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.739 [api_impl.cc:2987] 618792 NewDevice: SetCurRef = 0xaaab0b9e09a0,userDeviceId=3,deviceId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.748 [runtime.cc:3560] 618793 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.754 [runtime.cc:3393] 618794 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x6
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.759 [runtime.cc:5239] 618791 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.772 [runtime.cc:5239] 618792 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.888.776 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:92] Initialize] Successfully initialize HCCL.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.779 [api_impl.cc:2987] 618793 NewDevice: SetCurRef = 0xaaab0b9e09a0,userDeviceId=3,deviceId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.785 [runtime.cc:3560] 618794 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.795 [api_impl.cc:2992] 618791 NewDevice: New device success, user_device_id=3, die_num=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.798 [api_impl.cc:2992] 618792 NewDevice: New device success, user_device_id=3, die_num=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.806 [runtime.cc:5239] 618793 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.812 [api_impl.cc:2987] 618794 NewDevice: SetCurRef = 0xaaab0b9e09a0,userDeviceId=3,deviceId=3
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.888.815 [mindspore/ccsrc/distributed/collective/collective_manager.cc:628] InitDeviceCommLib] Communication library on device side is successfully initialized.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:39.888.828 [awatchdog_core.c:175](tid:618791) create watchdog for id : 65543, tid : 618791, timeout : 300s
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:39.888.843 [awatchdog_core.c:175](tid:618792) create watchdog for id : 65543, tid : 618792, timeout : 300s
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.848 [runtime.cc:5239] 618794 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.848 [api_impl.cc:2992] 618793 NewDevice: New device success, user_device_id=3, die_num=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.861 [api_impl.cc:3025] 618791 SetDevice: SetDevice success, curCtx=0xaaab0b9e09a0, user_device_id=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.866 [api_impl.cc:3025] 618792 SetDevice: SetDevice success, curCtx=0xaaab0b9e09a0, user_device_id=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.874 [api_impl.cc:2992] 618794 NewDevice: New device success, user_device_id=3, die_num=1.
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.888.878 [mindspore/ccsrc/distributed/collective/collective_manager.cc:211] Initialize] [PROF]InitDeviceBackend costs 1115.17 msec.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:39.888.883 [awatchdog_core.c:175](tid:618793) create watchdog for id : 65543, tid : 618793, timeout : 300s
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:39.888.898 [awatchdog_core.c:175](tid:618794) create watchdog for id : 65543, tid : 618794, timeout : 300s
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.909 [api_impl.cc:3025] 618793 SetDevice: SetDevice success, curCtx=0xaaab0b9e09a0, user_device_id=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.888.917 [api_impl.cc:3025] 618794 SetDevice: SetDevice success, curCtx=0xaaab0b9e09a0, user_device_id=3.
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.888.922 [mindspore/ccsrc/distributed/collective/collective_manager.cc:860] IsAsyncInitGlobalComm] Async initialize global comm: 0. async_conf: 1, is_graph: 0, use_rank_table: 0, simulation: 0, use_mpi: 0, is_ascend: 1
[WARNING] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.888.949 [mindspore/ccsrc/distributed/collective/collective_manager.cc:335] CreateCommunicationGroup] Start to create communication group: hccl_world_group [const vector]{0, 1, 2, 3, 4, 5, 6, 7}, async: 0, submit_now: 1
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.889.009 [mindspore/ccsrc/distributed/collective/collective_manager.cc:367] CreateCommunicationGroup] [PROF]CreateCommunicationGroupOnHostSide costs 0.019 msec.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.889.072 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:148] CreateCommunicationGroup] Successfully create LCCL communication group hccl_world_group
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.889.112 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:166] CreateCommunicationGroup] Successfully create HCCL communication group hccl_world_group
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.889.137 [mindspore/ccsrc/distributed/collective/collective_manager.cc:374] CreateCommunicationGroup] [PROF]CreateCommunicationGroupOnDeviceSide costs 0.102 msec.
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.889.268 [mindspore/ccsrc/distributed/collective/collective_manager.cc:919] SubmitCreateDeviceCommTask] Launch init comm thread.
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:39.889.296 [mindspore/ccsrc/distributed/collective/collective_manager.cc:925] SubmitCreateDeviceCommTask] Submit init communicator task for hccl_world_group. Call 'WaitCommInitDone' later to wait initialization to be done.
[INFO] DISTRIBUTED(618658,fffec77eefa0,python3.9):2025-04-03-09:27:39.889.370 [mindspore/ccsrc/distributed/collective/collective_manager.cc:973] RunInitCommTasks] Create device communicator in thread for group: hccl_world_group
[INFO] DISTRIBUTED(618658,fffec77eefa0,python3.9):2025-04-03-09:27:39.889.401 [mindspore/ccsrc/distributed/collective/collective_manager.cc:764] CreateDeviceCommunicator] Create device communicator for hccl_world_group
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.889.446 [device.cpp:143]618795 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.889.475 [api_impl.cc:2999] 618795 SetDevice: device_id=3, deviceMode=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.889.492 [device.cc:306] 618795 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.889.505 [runtime.cc:3393] 618795 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x7
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.889.519 [runtime.cc:3560] 618795 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.889.535 [api_impl.cc:2987] 618795 NewDevice: SetCurRef = 0xaaab0b9e09a0,userDeviceId=3,deviceId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.889.548 [runtime.cc:5239] 618795 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.889.564 [api_impl.cc:2992] 618795 NewDevice: New device success, user_device_id=3, die_num=1.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:39.889.586 [awatchdog_core.c:175](tid:618795) create watchdog for id : 65543, tid : 618795, timeout : 300s
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.889.602 [api_impl.cc:3025] 618795 SetDevice: SetDevice success, curCtx=0xaaab0b9e09a0, user_device_id=3.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.889.616 [acl.cpp:115]618795 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.889.630 [acl.cpp:121]618795 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.889.648 [device.cpp:154]618795 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 3
[INFO] DISTRIBUTED(618658,fffec77eefa0,python3.9):2025-04-03-09:27:39.889.685 [mindspore/ccsrc/distributed/collective/collective_manager.cc:787] CreateDeviceCommunicator] [PROF]GenerateRootInfo costs 0.228 msec.
[WARNING] DEVICE(618658,fffec77eefa0,python3.9):2025-04-03-09:27:39.889.958 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:248] QueryUniqueID] Retry to lookup the unique id for group hccl_world_group from the meta server node...Retry time: 399/400, sleep 2
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:40.068.172 [trs_cb_event.c:119][ascend][curpid:618658,618774][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =64; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:40.068.181 [trs_cb_event.c:119][ascend][curpid:618658,618775][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =65; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:40.068.200 [trs_sqcq.c:1491][ascend][curpid:618658,618774][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:40.068.212 [trs_sqcq.c:1491][ascend][curpid:618658,618775][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:40.068.220 [npu_driver.cc:3833] 618774 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:40.068.233 [npu_driver.cc:3833] 618775 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:40.068.257 [api_impl.cc:5058] 618774 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:40.068.272 [api_impl.cc:5058] 618775 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:40.068.282 [callback.cpp:132]618774 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:40.068.297 [callback.cpp:132]618775 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:40.068.301 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:40.068.323 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:40.068.331 [npu_driver.cc:3828] 618774 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=64.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:40.068.347 [npu_driver.cc:3828] 618775 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=65.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:40.236.716 [runtime.cc:5239] 618772 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:40.236.783 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618772] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:40.236.812 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618772] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:40.236.823 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618772] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:40.236.843 [runtime.cc:3077] 618772 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=3, devId=3, tdt status=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:40.236.928 [npu_driver.cc:551] 618772 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[WARNING] DEVICE(618658,fffec77eefa0,python3.9):2025-04-03-09:27:40.390.138 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:248] QueryUniqueID] Retry to lookup the unique id for group hccl_world_group from the meta server node...Retry time: 398/400, sleep 2
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:40.580.167 [trs_cb_event.c:119][ascend][curpid:618658,618775][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =65; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:40.580.181 [trs_cb_event.c:119][ascend][curpid:618658,618774][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =64; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:40.580.195 [trs_sqcq.c:1491][ascend][curpid:618658,618775][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:40.580.206 [trs_sqcq.c:1491][ascend][curpid:618658,618774][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:40.580.218 [npu_driver.cc:3833] 618775 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:40.580.226 [npu_driver.cc:3833] 618774 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:40.580.238 [api_impl.cc:5058] 618775 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:40.580.246 [api_impl.cc:5058] 618774 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:40.580.274 [callback.cpp:132]618775 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:40.580.284 [callback.cpp:132]618774 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:40.580.295 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:40.580.304 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:40.580.318 [npu_driver.cc:3828] 618775 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=65.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:40.580.325 [npu_driver.cc:3828] 618774 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=64.
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:40.708.180 [queue_client_comm.c:114][ascend][curpid:618658,618781][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:40.708.182 [queue_client_comm.c:114][ascend][curpid:618658,618783][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:40.708.181 [queue_client_comm.c:114][ascend][curpid:618658,618779][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:40.708.193 [queue_client_comm.c:114][ascend][curpid:618658,618789][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:40.708.192 [queue_client_comm.c:114][ascend][curpid:618658,618785][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:40.708.261 [queue_client_comm.c:114][ascend][curpid:618658,618787][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:40.708.303 [npu_driver.cc:4338] 618781 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:40.708.324 [tensor_data_transfer.cpp:612]618781 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_tensor_dump
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:40.708.335 [npu_driver.cc:4338] 618783 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:40.708.342 [tensor_data_transfer.cpp:1054]618781 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_tensor_dump
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:40.708.349 [tensor_data_transfer.cpp:612]618783 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_tensor_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:40.708.359 [tensor_data_transfer.cpp:1056]618781 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:40.708.366 [tensor_data_transfer.cpp:1054]618783 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_tensor_summary
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:40.708.367 [npu_driver.cc:4338] 618779 MemQueuePeek: queue empty
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:40.708.372 [api_impl.cc:6121] 618781 MemQueuePeek: Start to peek queue on devId 3, qid is 1.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:40.708.379 [tensor_data_transfer.cpp:1056]618783 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:40.708.387 [tensor_data_transfer.cpp:612]618779 acltdtReceiveTensorV2: queue is empty, device is 3, name is _npu_log
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:40.708.393 [npu_driver.cc:4330] 618781 MemQueuePeek: peek mem queue, deviceId=3, qid=1, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:40.708.400 [api_impl.cc:6121] 618783 MemQueuePeek: Start to peek queue on devId 3, qid is 2.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:40.708.404 [npu_driver.cc:4338] 618789 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:40.708.423 [tensor_data_transfer.cpp:1054]618779 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is _npu_log
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:40.708.434 [npu_driver.cc:4330] 618783 MemQueuePeek: peek mem queue, deviceId=3, qid=2, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:40.708.442 [tensor_data_transfer.cpp:612]618789 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_histogram_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:40.708.446 [tensor_data_transfer.cpp:1056]618779 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:40.708.460 [tensor_data_transfer.cpp:1054]618789 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_histogram_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:40.708.465 [api_impl.cc:6121] 618779 MemQueuePeek: Start to peek queue on devId 3, qid is 0.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:40.708.468 [npu_driver.cc:4338] 618787 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:40.708.474 [tensor_data_transfer.cpp:1056]618789 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:40.708.480 [npu_driver.cc:4330] 618779 MemQueuePeek: peek mem queue, deviceId=3, qid=0, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:40.708.489 [tensor_data_transfer.cpp:612]618787 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_scalar_summary
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:40.708.460 [npu_driver.cc:4338] 618785 MemQueuePeek: queue empty
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:40.708.496 [api_impl.cc:6121] 618789 MemQueuePeek: Start to peek queue on devId 3, qid is 5.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:40.708.509 [tensor_data_transfer.cpp:1054]618787 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_scalar_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:40.708.531 [npu_driver.cc:4330] 618789 MemQueuePeek: peek mem queue, deviceId=3, qid=5, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:40.708.538 [tensor_data_transfer.cpp:1056]618787 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:40.708.553 [api_impl.cc:6121] 618787 MemQueuePeek: Start to peek queue on devId 3, qid is 4.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:40.708.545 [tensor_data_transfer.cpp:612]618785 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_image_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:40.708.569 [npu_driver.cc:4330] 618787 MemQueuePeek: peek mem queue, deviceId=3, qid=4, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:40.708.621 [tensor_data_transfer.cpp:1054]618785 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_image_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:40.708.657 [tensor_data_transfer.cpp:1056]618785 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:40.708.706 [api_impl.cc:6121] 618785 MemQueuePeek: Start to peek queue on devId 3, qid is 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:40.708.724 [npu_driver.cc:4330] 618785 MemQueuePeek: peek mem queue, deviceId=3, qid=3, timeout=800.
[WARNING] DEVICE(618658,fffec77eefa0,python3.9):2025-04-03-09:27:40.890.304 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:248] QueryUniqueID] Retry to lookup the unique id for group hccl_world_group from the meta server node...Retry time: 397/400, sleep 1
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:41.092.177 [trs_cb_event.c:119][ascend][curpid:618658,618775][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =65; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:41.092.205 [trs_sqcq.c:1491][ascend][curpid:618658,618775][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:41.092.211 [trs_cb_event.c:119][ascend][curpid:618658,618774][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =64; ret=16)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:41.092.225 [npu_driver.cc:3833] 618775 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=65, drvRetCode=16.
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:41.092.259 [trs_sqcq.c:1491][ascend][curpid:618658,618774][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:41.092.268 [api_impl.cc:5058] 618775 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:41.092.280 [npu_driver.cc:3833] 618774 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=64, drvRetCode=16.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:41.092.291 [callback.cpp:132]618775 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:41.092.301 [api_impl.cc:5058] 618774 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:41.092.309 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:41.092.324 [callback.cpp:132]618774 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:41.092.332 [npu_driver.cc:3828] 618775 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=65.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:41.092.345 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:41.092.367 [npu_driver.cc:3828] 618774 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=64.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.318.365 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:49] Start] The cpu collective rank 5 has been started successfully.
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.318.398 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:184] node_num] Number of role MS_WORKER is 8
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.318.424 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:81] Initialize] Query retry count is 400
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.318.441 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:89] Initialize] Interval of retry allgather hostname lower and upper are 1 and 2
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.318.464 [mindspore/ccsrc/distributed/collective/collective_manager.cc:597] InitHostCommlib] Communication library on host side is successfully initialized. Global rank id: 5, global rank size: 8
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.318.489 [mindspore/ccsrc/distributed/collective/collective_manager.cc:198] Initialize] [PROF]InitHostCommlib costs 3004.59 msec.
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.318.507 [mindspore/ccsrc/distributed/collective/collective_manager.cc:640] AssignLocalRank] Host name for rank 5 is devserver-c233-2
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.318.613 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:564] GetHostNames] Worker gets host names {"hostnames":["devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2"]}
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.318.666 [mindspore/ccsrc/distributed/collective/collective_manager.cc:661] AssignLocalRank] Successfully get all nodes' hostname.
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.318.687 [mindspore/ccsrc/distributed/collective/collective_manager.cc:678] AssignLocalRank] The local rank id assigned for this process is 5
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.318.702 [mindspore/ccsrc/distributed/collective/collective_manager.cc:679] AssignLocalRank] The env 'DEVICE_ID' assigned for this process is: 5
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.318.726 [mindspore/ccsrc/distributed/collective/collective_manager.cc:697] AssignLocalRank] The device_id of ms_context is set to local rank id [5].
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.318.746 [mindspore/ccsrc/distributed/collective/collective_manager.cc:206] Initialize] [PROF]AssignLocalRank costs 0.236 msec.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.318.793 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:236] Initialize] Start initializing device context.
[INFO] CORE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.318.821 [mindspore/core/utils/ms_context.cc:463] PrintJitLevelAndExecMode] The jit_level is: O0, and enable kernelbykernel executor in the PYNATIVE mode.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.318.850 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:250] Initialize] The current overflow detection mode is INFNAN.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.318.898 [device.cpp:365]618666 aclrtSetDeviceSatMode: start to execute aclrtSetDeviceSatMode, mode is 1
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:41.318.995 [api_impl.cc:249] 618666 CurrentContext: current ctx is nullptr!
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.319.011 [api_impl.cc:6795] 618666 SetDeviceSatMode: Set saturation mode to 1 for runtime process.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.319.023 [device.cpp:371]618666 aclrtSetDeviceSatMode: successfully execute aclrtSetDeviceSatMode, mode is 1
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.319.058 [callback.cpp:37]618666 aclrtSetExceptionInfoCallback: start to execute aclrtSetExceptionInfoCallback.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.319.091 [callback.cpp:44]618666 aclrtSetExceptionInfoCallback: successfully execute aclrtSetExceptionInfoCallback
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.319.115 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:235] Init] Start inititializing kernel runtime(SetDevice & CreateDefaultStream & MemoryManagerInitialization etc).
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.319.137 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:48] InitDevice] Enter SetRtDevice, current initialize device number:0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.319.155 [device.cpp:143]618666 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.319.247 [npu_driver.cc:124] 618666 NpuDriver: Run mode=1 [0:offline, 1:online], env type=3
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.319.276 [api_impl.cc:2999] 618666 SetDevice: device_id=5, deviceMode=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.319.304 [runtime.cc:3602] 618666 DeviceRetain: [dlog api] DlogReportStart exist.
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.319.558 [hdc_core.c:1982][ascend][curpid:618666,618666][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4145; pid=618666)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.319.734 [runtime.cc:3609] 618666 DeviceRetain: [dlog api] AtraceReportStart exist.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:41.319.766 [atrace_client_communication.c:103](tid:618666) send [hello] msg.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:41.319.781 [atrace_client_communication.c:63](tid:618666) send msg by adx[begin], resultLen=1024 bytes.
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.319.897 [hdc_core.c:1982][ascend][curpid:618666,618666][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4146; pid=618666)
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:41.319.914 [hdc_api.cpp:671][tid:618666] connect succ, peer_node: 0, peer_devid: 5
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.321.275 [hdc_client.c:417][ascend][curpid:618666,618666][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4146)
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:41.321.312 [atrace_client_communication.c:65](tid:618666) send msg by adx[finish], ret=0.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:41.321.325 [atrace_client_communication.c:97](tid:618666) msgType=1, magic=49959, version=1.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:41.321.337 [atrace_client_communication.c:135](tid:618666) send [hello] msg success.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:41.321.414 [atrace_client_core.c:160](tid:618666) start to receive device[5] trace log.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.321.432 [runtime.cc:5239] 618666 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.321.446 [runtime.cc:2855] 618666 startAicpuExecutor: TsdOpen devId=5, device mode=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.321.466 [runtime.cc:5239] 618666 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.321.504 [client_manager.cpp:160][GetPlatformInfo][tid:618666] [TsdClient] mode[1] chipType[5]
[WARNING] TDT(618666,python3.9):2025-04-03-09:27:41.321.538 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618666] Get env[ASCEND_RT_VISIBLE_DEVICES] failed
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.321.551 [client_manager.cpp:582][GetVisibleDevices][tid:618666] [TsdClient] Get env ASCEND_RT_VISIBLE_DEVICES [].
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.321.554 [hdc_core.c:1982][ascend][curpid:618666,618797][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4147; pid=618666)
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.321.565 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618666] [TsdClient] g_userDeviceInfo is empty.
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:41.321.589 [hdc_api.cpp:671][tid:618797] connect succ, peer_node: 0, peer_devid: 5
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.321.592 [client_manager.cpp:125][GetInstance][tid:618666] [ClientManager] GetInstance, deviceId[5], g_runningMode[0], begin saving instance
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.321.637 [client_manager.cpp:435][IsHostEnvironment][tid:618666] [TsdClient] logicDeviceId is [5], hostaicpunum[0]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.321.652 [client_manager.cpp:464][GetClientRunMode][tid:618666] runningMode:0
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.321.663 [client_manager.cpp:127][GetInstance][tid:618666] [ClientManager] Current mode:1
[WARNING] TDT(618666,python3.9):2025-04-03-09:27:41.321.675 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618666] Get env[AICPU_PROFILING_MODE] failed
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.321.686 [client_manager.cpp:347][GetProfilingMode][tid:618666] Get AICPU_PROFILING_MODE[]
[WARNING] TDT(618666,python3.9):2025-04-03-09:27:41.321.724 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618666] Get env[ASCEND_MODULE_LOG_LEVEL] failed
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.321.737 [process_mode_base.cpp:149][GetLogLevel][tid:618666] [TsdClient] get ASCEND_GLOBAL_LOG_LEVEL [1] ASCEND_GLOBAL_EVENT_ENABLE [0] ASCEND_MODULE_LOG_LEVEL []
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:41.321.829 [atrace_client_communication.c:177](tid:618797) send [start] msg.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.321.848 [process_mode_base.cpp:161][GetLogLevel][tid:618666] [TsdClient] Get Log Level[001]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.321.864 [process_mode_manager.cpp:71][OpenProcess][tid:618666] [ProcessModeManager] enter into open process deviceId[5] rankSize[0]
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:41.321.873 [atrace_client_communication.c:189](tid:618797) send [start] msg success.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.321.877 [process_mode_manager.cpp:615][CheckNeedToOpen][tid:618666] [TsdClient] get open para startCp[1] startHccp[0] (0:false 1:true)
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.321.945 [client_manager.cpp:261][CheckPackageExists][tid:618666] [TsdClient] check file[.], deviceId[5]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.322.025 [client_manager.cpp:261][CheckPackageExists][tid:618666] [TsdClient] check file[scene.info], deviceId[5]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.322.091 [client_manager.cpp:261][CheckPackageExists][tid:618666] [TsdClient] check file[Ascend-aicpu_syskernels.tar.gz], deviceId[5]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.322.172 [client_manager.cpp:264][CheckPackageExists][tid:618666] [TsdClient] find aicpu package[Ascend-aicpu_syskernels.tar.gz] in path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], deviceId[5]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.322.187 [client_manager.cpp:261][CheckPackageExists][tid:618666] [TsdClient] check file[ascend_install.info], deviceId[5]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.322.259 [client_manager.cpp:261][CheckPackageExists][tid:618666] [TsdClient] check file[version.info], deviceId[5]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.322.324 [client_manager.cpp:261][CheckPackageExists][tid:618666] [TsdClient] check file[..], deviceId[5]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.322.384 [client_manager.cpp:261][CheckPackageExists][tid:618666] [TsdClient] check file[Ascend-aicpu_extend_syskernels.tar.gz], deviceId[5]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.322.518 [client_manager.cpp:268][CheckPackageExists][tid:618666] [TsdClient] find extend package[Ascend-aicpu_extend_syskernels.tar.gz] in path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], deviceId[5]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.322.533 [client_manager.cpp:283][CheckPackageExists][tid:618666] [TsdClient][deviceId=5] set extend package path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], name[Ascend-aicpu_extend_syskernels.tar.gz]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.322.545 [client_manager.cpp:286][CheckPackageExists][tid:618666] [TsdClient][deviceId=5] set aicpu package path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], name[Ascend-aicpu_syskernels.tar.gz]
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.322.605 [devdrv_hccl.c:103][ascend][curpid:618666,618666][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618666)
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.322.620 [process_mode_manager.cpp:396][InitTsdClient][tid:618666] [TsdClient][deviceId=5] get process sign success, procPid[618666]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.322.631 [process_mode_manager.cpp:403][InitTsdClient][tid:618666] [TsdClient] deviceId[5] begin to init hdc client
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.322.652 [hdc_common.cpp:67][InitMsgSize][tid:618666] HdcCommon::InitMsgSize Start
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.322.664 [hdc_common.cpp:80][InitMsgSize][tid:618666] msgMaxSize_ = 524224 bytes, msgShortHeadDataMaxSize_ = 524212 bytes, msgLongHeadDataMaxSize_ = 524200 bytes
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.322.678 [hdc_client.cpp:184][CreateHdcSession][tid:618666] HdcClient::CreateHdcSession Start
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.322.763 [hdc_client.cpp:208][CreateHdcSession][tid:618666] [HdcClient] deviceId: 5 connect session
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.322.793 [hdc_core.c:1982][ascend][curpid:618666,618666][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4148; pid=618666)
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.322.807 [hdc_client.cpp:219][CreateHdcSession][tid:618666] [HdcClient] drvHdcSetSessionReference success
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.322.821 [hdc_client.cpp:230][CreateHdcSession][tid:618666] [HdcClient] deviceId: 5 connect session and drvHdcSetSessionReference success, sessionId=1
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.322.837 [version_verify.cpp:36][SetVersionInfo][tid:618666] VersionVerify: send client version to server
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.322.868 [version_verify.cpp:52][SetVersionInfo][tid:618666] send feature_info:{msg_type:35, features:{check before send aicpu package}}
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.322.882 [version_verify.cpp:52][SetVersionInfo][tid:618666] send feature_info:{msg_type:37, features:{check before send open qs message}}
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.322.894 [version_verify.cpp:52][SetVersionInfo][tid:618666] send feature_info:{msg_type:64, features:{get check code retry}}
[WARNING] TDT(618666,python3.9):2025-04-03-09:27:41.322.934 [internal_api.cpp:101][GetScheduleEnv][tid:618666] Get env[DATAMASTER_RUN_MODE] failed
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.323.384 [version_verify.cpp:68][PeerVersionCheck][tid:618666] VersionVerify: Check client version info, server[1230], client[1230]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.323.403 [version_verify.cpp:89][ParseVersionInfo][tid:618666] VersionVerify: pass client version info success
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.323.422 [hdc_client.cpp:275][CheckHdcConnection][tid:618666] Service[2] create hdc success
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.323.440 [version_verify.cpp:122][SpecialFeatureCheck][tid:618666] VersionVerify: new type[35], supported
[WARNING] TDT(618666,python3.9):2025-04-03-09:27:41.323.454 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618666] Get env[ASAN_RUN_MODE] failed
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.323.484 [process_mode_manager.cpp:627][GetDeviceCheckCodeOnce][tid:618666] [TsdClient][deviceId=5] [sessionId=1] wait package info respond
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.323.498 [hdc_client.cpp:154][TsdRecvData][tid:618666] recv timeout is:150000 ms
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.324.469 [process_mode_msg_parse.cpp:148][PackageInfoMsgProc][tid:618666] [PackageInfoMsgProc] [sessionID=1]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.324.484 [process_mode_msg_parse.cpp:151][PackageInfoMsgProc][tid:618666] [PackageInfoMsgProc] [sessionID=1] deviceId[5], checkCode[56684994]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.324.496 [hdc_client.cpp:172][TsdRecvData][tid:618666] [deviceId=5] the Tsd recv data already
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.324.510 [version_verify.cpp:122][SpecialFeatureCheck][tid:618666] VersionVerify: new type[64], supported
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.324.521 [hdc_client.cpp:411][Destroy][tid:618666] enter HdcClient::Destroy() function
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.324.534 [hdc_client.c:417][ascend][curpid:618666,618666][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4148)
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.324.559 [hdc_client.cpp:394][DestroyClient][tid:618666] begin drvHdcClientDestroy
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.324.573 [hdc_client.cpp:399][DestroyClient][tid:618666] end drvHdcClientDestroy
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.324.584 [hdc_client.cpp:377][ClearClientPtr][tid:618666] begin HdcClient::ClearClientPtr
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.324.595 [hdc_client.cpp:385][ClearClientPtr][tid:618666] end HdcClient::ClearClientPtr
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.324.606 [hdc_client.cpp:418][Destroy][tid:618666] end HdcClient::Destroy() function
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.324.635 [process_mode_manager.cpp:371][SendAICPUPackage][tid:618666] [TsdClient]the checksum of host package[56684994] is same to device[56684994], skip send package.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.324.652 [process_mode_manager.cpp:1870][SendExtendPackage][tid:618666] [TsdClient]the checksum of host extend package[9658754] is same to device[9658754], skip send package.
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.324.669 [devdrv_hccl.c:103][ascend][curpid:618666,618666][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618666)
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.324.682 [process_mode_manager.cpp:396][InitTsdClient][tid:618666] [TsdClient][deviceId=5] get process sign success, procPid[618666]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.324.694 [process_mode_manager.cpp:403][InitTsdClient][tid:618666] [TsdClient] deviceId[5] begin to init hdc client
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.324.708 [hdc_common.cpp:67][InitMsgSize][tid:618666] HdcCommon::InitMsgSize Start
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.324.720 [hdc_common.cpp:80][InitMsgSize][tid:618666] msgMaxSize_ = 524224 bytes, msgShortHeadDataMaxSize_ = 524212 bytes, msgLongHeadDataMaxSize_ = 524200 bytes
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.324.733 [hdc_client.cpp:184][CreateHdcSession][tid:618666] HdcClient::CreateHdcSession Start
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.324.789 [hdc_client.cpp:208][CreateHdcSession][tid:618666] [HdcClient] deviceId: 5 connect session
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.324.822 [hdc_core.c:1982][ascend][curpid:618666,618666][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4149; pid=618666)
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.324.836 [hdc_client.cpp:219][CreateHdcSession][tid:618666] [HdcClient] drvHdcSetSessionReference success
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.324.849 [hdc_client.cpp:230][CreateHdcSession][tid:618666] [HdcClient] deviceId: 5 connect session and drvHdcSetSessionReference success, sessionId=1
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.324.862 [version_verify.cpp:36][SetVersionInfo][tid:618666] VersionVerify: send client version to server
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.324.875 [version_verify.cpp:52][SetVersionInfo][tid:618666] send feature_info:{msg_type:35, features:{check before send aicpu package}}
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.324.887 [version_verify.cpp:52][SetVersionInfo][tid:618666] send feature_info:{msg_type:37, features:{check before send open qs message}}
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.324.899 [version_verify.cpp:52][SetVersionInfo][tid:618666] send feature_info:{msg_type:64, features:{get check code retry}}
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.325.151 [version_verify.cpp:68][PeerVersionCheck][tid:618666] VersionVerify: Check client version info, server[1230], client[1230]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.325.167 [version_verify.cpp:89][ParseVersionInfo][tid:618666] VersionVerify: pass client version info success
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.325.177 [hdc_client.cpp:275][CheckHdcConnection][tid:618666] Service[2] create hdc success
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.325.190 [process_mode_manager.cpp:458][ConstructOpenMsg][tid:618666] [TsdClient] tsd get process sign successfully, procpid[618666] signSize[48]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.325.206 [version_verify.cpp:114][SpecialFeatureCheck][tid:618666] VersionVerify: previous type[6], supported
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.325.230 [process_mode_manager.cpp:88][OpenProcess][tid:618666] [ProcessModeManager] deviceId[5] sessionId[1] rankSize[0], wait sub process start respond
[WARNING] TDT(618666,python3.9):2025-04-03-09:27:41.325.244 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618666] Get env[ASAN_RUN_MODE] failed
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.325.256 [hdc_client.cpp:154][TsdRecvData][tid:618666] recv timeout is:150000 ms
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.386.245 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:49] Start] The cpu collective rank 7 has been started successfully.
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.386.290 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:184] node_num] Number of role MS_WORKER is 8
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.386.352 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:81] Initialize] Query retry count is 400
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.386.374 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:89] Initialize] Interval of retry allgather hostname lower and upper are 1 and 2
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.386.409 [mindspore/ccsrc/distributed/collective/collective_manager.cc:597] InitHostCommlib] Communication library on host side is successfully initialized. Global rank id: 7, global rank size: 8
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.386.440 [mindspore/ccsrc/distributed/collective/collective_manager.cc:198] Initialize] [PROF]InitHostCommlib costs 3005.05 msec.
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.386.463 [mindspore/ccsrc/distributed/collective/collective_manager.cc:640] AssignLocalRank] Host name for rank 7 is devserver-c233-2
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.386.567 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:564] GetHostNames] Worker gets host names {"hostnames":["devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2"]}
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.386.645 [mindspore/ccsrc/distributed/collective/collective_manager.cc:661] AssignLocalRank] Successfully get all nodes' hostname.
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.386.671 [mindspore/ccsrc/distributed/collective/collective_manager.cc:678] AssignLocalRank] The local rank id assigned for this process is 7
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.386.691 [mindspore/ccsrc/distributed/collective/collective_manager.cc:679] AssignLocalRank] The env 'DEVICE_ID' assigned for this process is: 7
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.386.721 [mindspore/ccsrc/distributed/collective/collective_manager.cc:697] AssignLocalRank] The device_id of ms_context is set to local rank id [7].
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.386.745 [mindspore/ccsrc/distributed/collective/collective_manager.cc:206] Initialize] [PROF]AssignLocalRank costs 0.281 msec.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.386.828 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:236] Initialize] Start initializing device context.
[INFO] CORE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.386.876 [mindspore/core/utils/ms_context.cc:463] PrintJitLevelAndExecMode] The jit_level is: O0, and enable kernelbykernel executor in the PYNATIVE mode.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.386.901 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:250] Initialize] The current overflow detection mode is INFNAN.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.386.946 [device.cpp:365]618674 aclrtSetDeviceSatMode: start to execute aclrtSetDeviceSatMode, mode is 1
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:41.387.066 [api_impl.cc:249] 618674 CurrentContext: current ctx is nullptr!
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.387.085 [api_impl.cc:6795] 618674 SetDeviceSatMode: Set saturation mode to 1 for runtime process.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.387.101 [device.cpp:371]618674 aclrtSetDeviceSatMode: successfully execute aclrtSetDeviceSatMode, mode is 1
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.387.176 [callback.cpp:37]618674 aclrtSetExceptionInfoCallback: start to execute aclrtSetExceptionInfoCallback.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.387.221 [callback.cpp:44]618674 aclrtSetExceptionInfoCallback: successfully execute aclrtSetExceptionInfoCallback
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.387.248 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:235] Init] Start inititializing kernel runtime(SetDevice & CreateDefaultStream & MemoryManagerInitialization etc).
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.387.274 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:48] InitDevice] Enter SetRtDevice, current initialize device number:0
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.387.307 [device.cpp:143]618674 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.387.402 [npu_driver.cc:124] 618674 NpuDriver: Run mode=1 [0:offline, 1:online], env type=3
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.387.441 [api_impl.cc:2999] 618674 SetDevice: device_id=7, deviceMode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.387.482 [runtime.cc:3602] 618674 DeviceRetain: [dlog api] DlogReportStart exist.
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.387.727 [hdc_core.c:1982][ascend][curpid:618674,618674][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4150; pid=618674)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.387.883 [runtime.cc:3609] 618674 DeviceRetain: [dlog api] AtraceReportStart exist.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:41.387.936 [atrace_client_communication.c:103](tid:618674) send [hello] msg.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:41.387.957 [atrace_client_communication.c:63](tid:618674) send msg by adx[begin], resultLen=1024 bytes.
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.388.080 [hdc_core.c:1982][ascend][curpid:618674,618674][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4151; pid=618674)
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:41.388.099 [hdc_api.cpp:671][tid:618674] connect succ, peer_node: 0, peer_devid: 7
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.389.467 [hdc_client.c:417][ascend][curpid:618674,618674][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4151)
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:41.389.503 [atrace_client_communication.c:65](tid:618674) send msg by adx[finish], ret=0.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:41.389.523 [atrace_client_communication.c:97](tid:618674) msgType=1, magic=49959, version=1.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:41.389.537 [atrace_client_communication.c:135](tid:618674) send [hello] msg success.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:41.389.623 [atrace_client_core.c:160](tid:618674) start to receive device[7] trace log.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.389.654 [runtime.cc:5239] 618674 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.389.684 [runtime.cc:2855] 618674 startAicpuExecutor: TsdOpen devId=7, device mode=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.389.700 [runtime.cc:5239] 618674 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.389.759 [client_manager.cpp:160][GetPlatformInfo][tid:618674] [TsdClient] mode[1] chipType[5]
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.389.773 [hdc_core.c:1982][ascend][curpid:618674,618799][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4152; pid=618674)
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:41.389.800 [hdc_api.cpp:671][tid:618799] connect succ, peer_node: 0, peer_devid: 7
[WARNING] TDT(618674,python3.9):2025-04-03-09:27:41.389.803 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618674] Get env[ASCEND_RT_VISIBLE_DEVICES] failed
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.389.824 [client_manager.cpp:582][GetVisibleDevices][tid:618674] [TsdClient] Get env ASCEND_RT_VISIBLE_DEVICES [].
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.389.839 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618674] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.389.853 [client_manager.cpp:125][GetInstance][tid:618674] [ClientManager] GetInstance, deviceId[7], g_runningMode[0], begin saving instance
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.389.884 [client_manager.cpp:435][IsHostEnvironment][tid:618674] [TsdClient] logicDeviceId is [7], hostaicpunum[0]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.389.903 [client_manager.cpp:464][GetClientRunMode][tid:618674] runningMode:0
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.389.917 [client_manager.cpp:127][GetInstance][tid:618674] [ClientManager] Current mode:1
[WARNING] TDT(618674,python3.9):2025-04-03-09:27:41.389.933 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618674] Get env[AICPU_PROFILING_MODE] failed
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.389.947 [client_manager.cpp:347][GetProfilingMode][tid:618674] Get AICPU_PROFILING_MODE[]
[WARNING] TDT(618674,python3.9):2025-04-03-09:27:41.389.993 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618674] Get env[ASCEND_MODULE_LOG_LEVEL] failed
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.390.009 [process_mode_base.cpp:149][GetLogLevel][tid:618674] [TsdClient] get ASCEND_GLOBAL_LOG_LEVEL [1] ASCEND_GLOBAL_EVENT_ENABLE [0] ASCEND_MODULE_LOG_LEVEL []
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:41.390.035 [atrace_client_communication.c:177](tid:618799) send [start] msg.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:41.390.088 [atrace_client_communication.c:189](tid:618799) send [start] msg success.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.390.115 [process_mode_base.cpp:161][GetLogLevel][tid:618674] [TsdClient] Get Log Level[001]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.390.135 [process_mode_manager.cpp:71][OpenProcess][tid:618674] [ProcessModeManager] enter into open process deviceId[7] rankSize[0]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.390.153 [process_mode_manager.cpp:615][CheckNeedToOpen][tid:618674] [TsdClient] get open para startCp[1] startHccp[0] (0:false 1:true)
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.390.238 [client_manager.cpp:261][CheckPackageExists][tid:618674] [TsdClient] check file[.], deviceId[7]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.390.313 [client_manager.cpp:261][CheckPackageExists][tid:618674] [TsdClient] check file[scene.info], deviceId[7]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.390.378 [client_manager.cpp:261][CheckPackageExists][tid:618674] [TsdClient] check file[Ascend-aicpu_syskernels.tar.gz], deviceId[7]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.390.462 [client_manager.cpp:264][CheckPackageExists][tid:618674] [TsdClient] find aicpu package[Ascend-aicpu_syskernels.tar.gz] in path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], deviceId[7]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.390.500 [client_manager.cpp:261][CheckPackageExists][tid:618674] [TsdClient] check file[ascend_install.info], deviceId[7]
[WARNING] DEVICE(618658,fffec77eefa0,python3.9):2025-04-03-09:27:41.390.487 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:248] QueryUniqueID] Retry to lookup the unique id for group hccl_world_group from the meta server node...Retry time: 396/400, sleep 2
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.390.563 [client_manager.cpp:261][CheckPackageExists][tid:618674] [TsdClient] check file[version.info], deviceId[7]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.390.627 [client_manager.cpp:261][CheckPackageExists][tid:618674] [TsdClient] check file[..], deviceId[7]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.390.690 [client_manager.cpp:261][CheckPackageExists][tid:618674] [TsdClient] check file[Ascend-aicpu_extend_syskernels.tar.gz], deviceId[7]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.390.823 [client_manager.cpp:268][CheckPackageExists][tid:618674] [TsdClient] find extend package[Ascend-aicpu_extend_syskernels.tar.gz] in path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], deviceId[7]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.390.841 [client_manager.cpp:283][CheckPackageExists][tid:618674] [TsdClient][deviceId=7] set extend package path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], name[Ascend-aicpu_extend_syskernels.tar.gz]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.390.858 [client_manager.cpp:286][CheckPackageExists][tid:618674] [TsdClient][deviceId=7] set aicpu package path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], name[Ascend-aicpu_syskernels.tar.gz]
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.390.924 [devdrv_hccl.c:103][ascend][curpid:618674,618674][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618674)
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.390.942 [process_mode_manager.cpp:396][InitTsdClient][tid:618674] [TsdClient][deviceId=7] get process sign success, procPid[618674]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.390.959 [process_mode_manager.cpp:403][InitTsdClient][tid:618674] [TsdClient] deviceId[7] begin to init hdc client
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.390.994 [hdc_common.cpp:67][InitMsgSize][tid:618674] HdcCommon::InitMsgSize Start
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.391.010 [hdc_common.cpp:80][InitMsgSize][tid:618674] msgMaxSize_ = 524224 bytes, msgShortHeadDataMaxSize_ = 524212 bytes, msgLongHeadDataMaxSize_ = 524200 bytes
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.391.026 [hdc_client.cpp:184][CreateHdcSession][tid:618674] HdcClient::CreateHdcSession Start
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.391.114 [hdc_client.cpp:208][CreateHdcSession][tid:618674] [HdcClient] deviceId: 7 connect session
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.391.148 [hdc_core.c:1982][ascend][curpid:618674,618674][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4153; pid=618674)
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.391.165 [hdc_client.cpp:219][CreateHdcSession][tid:618674] [HdcClient] drvHdcSetSessionReference success
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.391.182 [hdc_client.cpp:230][CreateHdcSession][tid:618674] [HdcClient] deviceId: 7 connect session and drvHdcSetSessionReference success, sessionId=1
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.391.203 [version_verify.cpp:36][SetVersionInfo][tid:618674] VersionVerify: send client version to server
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.391.249 [version_verify.cpp:52][SetVersionInfo][tid:618674] send feature_info:{msg_type:35, features:{check before send aicpu package}}
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.391.274 [version_verify.cpp:52][SetVersionInfo][tid:618674] send feature_info:{msg_type:37, features:{check before send open qs message}}
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.391.291 [version_verify.cpp:52][SetVersionInfo][tid:618674] send feature_info:{msg_type:64, features:{get check code retry}}
[WARNING] TDT(618674,python3.9):2025-04-03-09:27:41.391.337 [internal_api.cpp:101][GetScheduleEnv][tid:618674] Get env[DATAMASTER_RUN_MODE] failed
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.391.673 [version_verify.cpp:68][PeerVersionCheck][tid:618674] VersionVerify: Check client version info, server[1230], client[1230]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.391.696 [version_verify.cpp:89][ParseVersionInfo][tid:618674] VersionVerify: pass client version info success
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.391.713 [hdc_client.cpp:275][CheckHdcConnection][tid:618674] Service[2] create hdc success
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.391.731 [version_verify.cpp:122][SpecialFeatureCheck][tid:618674] VersionVerify: new type[35], supported
[WARNING] TDT(618674,python3.9):2025-04-03-09:27:41.391.749 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618674] Get env[ASAN_RUN_MODE] failed
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.391.784 [process_mode_manager.cpp:627][GetDeviceCheckCodeOnce][tid:618674] [TsdClient][deviceId=7] [sessionId=1] wait package info respond
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.391.802 [hdc_client.cpp:154][TsdRecvData][tid:618674] recv timeout is:150000 ms
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.392.778 [process_mode_msg_parse.cpp:148][PackageInfoMsgProc][tid:618674] [PackageInfoMsgProc] [sessionID=1]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.392.796 [process_mode_msg_parse.cpp:151][PackageInfoMsgProc][tid:618674] [PackageInfoMsgProc] [sessionID=1] deviceId[7], checkCode[56684994]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.392.815 [hdc_client.cpp:172][TsdRecvData][tid:618674] [deviceId=7] the Tsd recv data already
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.392.831 [version_verify.cpp:122][SpecialFeatureCheck][tid:618674] VersionVerify: new type[64], supported
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.392.847 [hdc_client.cpp:411][Destroy][tid:618674] enter HdcClient::Destroy() function
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.392.863 [hdc_client.c:417][ascend][curpid:618674,618674][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4153)
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.392.892 [hdc_client.cpp:394][DestroyClient][tid:618674] begin drvHdcClientDestroy
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.392.909 [hdc_client.cpp:399][DestroyClient][tid:618674] end drvHdcClientDestroy
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.392.926 [hdc_client.cpp:377][ClearClientPtr][tid:618674] begin HdcClient::ClearClientPtr
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.392.939 [hdc_client.cpp:385][ClearClientPtr][tid:618674] end HdcClient::ClearClientPtr
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.392.952 [hdc_client.cpp:418][Destroy][tid:618674] end HdcClient::Destroy() function
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.392.987 [process_mode_manager.cpp:371][SendAICPUPackage][tid:618674] [TsdClient]the checksum of host package[56684994] is same to device[56684994], skip send package.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.393.007 [process_mode_manager.cpp:1870][SendExtendPackage][tid:618674] [TsdClient]the checksum of host extend package[9658754] is same to device[9658754], skip send package.
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.393.028 [devdrv_hccl.c:103][ascend][curpid:618674,618674][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618674)
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.393.044 [process_mode_manager.cpp:396][InitTsdClient][tid:618674] [TsdClient][deviceId=7] get process sign success, procPid[618674]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.393.059 [process_mode_manager.cpp:403][InitTsdClient][tid:618674] [TsdClient] deviceId[7] begin to init hdc client
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.393.076 [hdc_common.cpp:67][InitMsgSize][tid:618674] HdcCommon::InitMsgSize Start
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.393.089 [hdc_common.cpp:80][InitMsgSize][tid:618674] msgMaxSize_ = 524224 bytes, msgShortHeadDataMaxSize_ = 524212 bytes, msgLongHeadDataMaxSize_ = 524200 bytes
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.393.108 [hdc_client.cpp:184][CreateHdcSession][tid:618674] HdcClient::CreateHdcSession Start
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.393.180 [hdc_client.cpp:208][CreateHdcSession][tid:618674] [HdcClient] deviceId: 7 connect session
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.393.212 [hdc_core.c:1982][ascend][curpid:618674,618674][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4154; pid=618674)
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.393.229 [hdc_client.cpp:219][CreateHdcSession][tid:618674] [HdcClient] drvHdcSetSessionReference success
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.393.243 [hdc_client.cpp:230][CreateHdcSession][tid:618674] [HdcClient] deviceId: 7 connect session and drvHdcSetSessionReference success, sessionId=1
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.393.260 [version_verify.cpp:36][SetVersionInfo][tid:618674] VersionVerify: send client version to server
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.393.275 [version_verify.cpp:52][SetVersionInfo][tid:618674] send feature_info:{msg_type:35, features:{check before send aicpu package}}
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.393.292 [version_verify.cpp:52][SetVersionInfo][tid:618674] send feature_info:{msg_type:37, features:{check before send open qs message}}
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.393.308 [version_verify.cpp:52][SetVersionInfo][tid:618674] send feature_info:{msg_type:64, features:{get check code retry}}
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.393.293 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:49] Start] The cpu collective rank 4 has been started successfully.
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.393.340 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:184] node_num] Number of role MS_WORKER is 8
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.393.394 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:81] Initialize] Query retry count is 400
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.393.416 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:89] Initialize] Interval of retry allgather hostname lower and upper are 1 and 2
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.393.457 [mindspore/ccsrc/distributed/collective/collective_manager.cc:597] InitHostCommlib] Communication library on host side is successfully initialized. Global rank id: 4, global rank size: 8
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.393.487 [mindspore/ccsrc/distributed/collective/collective_manager.cc:198] Initialize] [PROF]InitHostCommlib costs 3004.96 msec.
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.393.508 [mindspore/ccsrc/distributed/collective/collective_manager.cc:640] AssignLocalRank] Host name for rank 4 is devserver-c233-2
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.393.542 [version_verify.cpp:68][PeerVersionCheck][tid:618674] VersionVerify: Check client version info, server[1230], client[1230]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.393.562 [version_verify.cpp:89][ParseVersionInfo][tid:618674] VersionVerify: pass client version info success
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.393.575 [hdc_client.cpp:275][CheckHdcConnection][tid:618674] Service[2] create hdc success
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.393.595 [process_mode_manager.cpp:458][ConstructOpenMsg][tid:618674] [TsdClient] tsd get process sign successfully, procpid[618674] signSize[48]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.393.614 [version_verify.cpp:114][SpecialFeatureCheck][tid:618674] VersionVerify: previous type[6], supported
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.393.611 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:564] GetHostNames] Worker gets host names {"hostnames":["devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2"]}
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.393.644 [process_mode_manager.cpp:88][OpenProcess][tid:618674] [ProcessModeManager] deviceId[7] sessionId[1] rankSize[0], wait sub process start respond
[WARNING] TDT(618674,python3.9):2025-04-03-09:27:41.393.663 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618674] Get env[ASAN_RUN_MODE] failed
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.393.670 [mindspore/ccsrc/distributed/collective/collective_manager.cc:661] AssignLocalRank] Successfully get all nodes' hostname.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.393.679 [hdc_client.cpp:154][TsdRecvData][tid:618674] recv timeout is:150000 ms
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.393.694 [mindspore/ccsrc/distributed/collective/collective_manager.cc:678] AssignLocalRank] The local rank id assigned for this process is 4
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.393.714 [mindspore/ccsrc/distributed/collective/collective_manager.cc:679] AssignLocalRank] The env 'DEVICE_ID' assigned for this process is: 4
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.393.743 [mindspore/ccsrc/distributed/collective/collective_manager.cc:697] AssignLocalRank] The device_id of ms_context is set to local rank id [4].
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.393.767 [mindspore/ccsrc/distributed/collective/collective_manager.cc:206] Initialize] [PROF]AssignLocalRank costs 0.255 msec.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.393.837 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:236] Initialize] Start initializing device context.
[INFO] CORE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.393.880 [mindspore/core/utils/ms_context.cc:463] PrintJitLevelAndExecMode] The jit_level is: O0, and enable kernelbykernel executor in the PYNATIVE mode.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.393.903 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:250] Initialize] The current overflow detection mode is INFNAN.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.393.938 [device.cpp:365]618662 aclrtSetDeviceSatMode: start to execute aclrtSetDeviceSatMode, mode is 1
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:41.394.063 [api_impl.cc:249] 618662 CurrentContext: current ctx is nullptr!
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.394.082 [api_impl.cc:6795] 618662 SetDeviceSatMode: Set saturation mode to 1 for runtime process.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.394.098 [device.cpp:371]618662 aclrtSetDeviceSatMode: successfully execute aclrtSetDeviceSatMode, mode is 1
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.394.163 [callback.cpp:37]618662 aclrtSetExceptionInfoCallback: start to execute aclrtSetExceptionInfoCallback.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.394.198 [callback.cpp:44]618662 aclrtSetExceptionInfoCallback: successfully execute aclrtSetExceptionInfoCallback
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.394.225 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:235] Init] Start inititializing kernel runtime(SetDevice & CreateDefaultStream & MemoryManagerInitialization etc).
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.394.250 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:48] InitDevice] Enter SetRtDevice, current initialize device number:0
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.394.289 [device.cpp:143]618662 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.394.369 [npu_driver.cc:124] 618662 NpuDriver: Run mode=1 [0:offline, 1:online], env type=3
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.394.397 [api_impl.cc:2999] 618662 SetDevice: device_id=4, deviceMode=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.394.435 [runtime.cc:3602] 618662 DeviceRetain: [dlog api] DlogReportStart exist.
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.394.654 [hdc_core.c:1982][ascend][curpid:618662,618662][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4155; pid=618662)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.394.793 [runtime.cc:3609] 618662 DeviceRetain: [dlog api] AtraceReportStart exist.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:41.394.841 [atrace_client_communication.c:103](tid:618662) send [hello] msg.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:41.394.863 [atrace_client_communication.c:63](tid:618662) send msg by adx[begin], resultLen=1024 bytes.
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.394.980 [hdc_core.c:1982][ascend][curpid:618662,618662][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4156; pid=618662)
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:41.395.000 [hdc_api.cpp:671][tid:618662] connect succ, peer_node: 0, peer_devid: 4
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.396.322 [hdc_client.c:417][ascend][curpid:618662,618662][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4156)
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:41.396.356 [atrace_client_communication.c:65](tid:618662) send msg by adx[finish], ret=0.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:41.396.376 [atrace_client_communication.c:97](tid:618662) msgType=1, magic=49959, version=1.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:41.396.389 [atrace_client_communication.c:135](tid:618662) send [hello] msg success.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:41.396.479 [atrace_client_core.c:160](tid:618662) start to receive device[4] trace log.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.396.511 [runtime.cc:5239] 618662 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.396.540 [runtime.cc:2855] 618662 startAicpuExecutor: TsdOpen devId=4, device mode=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.396.554 [runtime.cc:5239] 618662 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.396.596 [client_manager.cpp:160][GetPlatformInfo][tid:618662] [TsdClient] mode[1] chipType[5]
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.396.602 [hdc_core.c:1982][ascend][curpid:618662,618801][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4157; pid=618662)
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:41.396.634 [hdc_api.cpp:671][tid:618801] connect succ, peer_node: 0, peer_devid: 4
[WARNING] TDT(618662,python3.9):2025-04-03-09:27:41.396.637 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618662] Get env[ASCEND_RT_VISIBLE_DEVICES] failed
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.396.658 [client_manager.cpp:582][GetVisibleDevices][tid:618662] [TsdClient] Get env ASCEND_RT_VISIBLE_DEVICES [].
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.396.673 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618662] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.396.687 [client_manager.cpp:125][GetInstance][tid:618662] [ClientManager] GetInstance, deviceId[4], g_runningMode[0], begin saving instance
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.396.717 [client_manager.cpp:435][IsHostEnvironment][tid:618662] [TsdClient] logicDeviceId is [4], hostaicpunum[0]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.396.735 [client_manager.cpp:464][GetClientRunMode][tid:618662] runningMode:0
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.396.747 [client_manager.cpp:127][GetInstance][tid:618662] [ClientManager] Current mode:1
[WARNING] TDT(618662,python3.9):2025-04-03-09:27:41.396.762 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618662] Get env[AICPU_PROFILING_MODE] failed
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.396.775 [client_manager.cpp:347][GetProfilingMode][tid:618662] Get AICPU_PROFILING_MODE[]
[WARNING] TDT(618662,python3.9):2025-04-03-09:27:41.396.809 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618662] Get env[ASCEND_MODULE_LOG_LEVEL] failed
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.396.826 [process_mode_base.cpp:149][GetLogLevel][tid:618662] [TsdClient] get ASCEND_GLOBAL_LOG_LEVEL [1] ASCEND_GLOBAL_EVENT_ENABLE [0] ASCEND_MODULE_LOG_LEVEL []
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:41.396.862 [atrace_client_communication.c:177](tid:618801) send [start] msg.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.396.909 [process_mode_base.cpp:161][GetLogLevel][tid:618662] [TsdClient] Get Log Level[001]
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:41.396.914 [atrace_client_communication.c:189](tid:618801) send [start] msg success.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.396.928 [process_mode_manager.cpp:71][OpenProcess][tid:618662] [ProcessModeManager] enter into open process deviceId[4] rankSize[0]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.396.944 [process_mode_manager.cpp:615][CheckNeedToOpen][tid:618662] [TsdClient] get open para startCp[1] startHccp[0] (0:false 1:true)
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.396.998 [client_manager.cpp:261][CheckPackageExists][tid:618662] [TsdClient] check file[.], deviceId[4]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.397.073 [client_manager.cpp:261][CheckPackageExists][tid:618662] [TsdClient] check file[scene.info], deviceId[4]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.397.139 [client_manager.cpp:261][CheckPackageExists][tid:618662] [TsdClient] check file[Ascend-aicpu_syskernels.tar.gz], deviceId[4]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.397.225 [client_manager.cpp:264][CheckPackageExists][tid:618662] [TsdClient] find aicpu package[Ascend-aicpu_syskernels.tar.gz] in path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], deviceId[4]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.397.251 [client_manager.cpp:261][CheckPackageExists][tid:618662] [TsdClient] check file[ascend_install.info], deviceId[4]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.397.313 [client_manager.cpp:261][CheckPackageExists][tid:618662] [TsdClient] check file[version.info], deviceId[4]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.397.375 [client_manager.cpp:261][CheckPackageExists][tid:618662] [TsdClient] check file[..], deviceId[4]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.397.438 [client_manager.cpp:261][CheckPackageExists][tid:618662] [TsdClient] check file[Ascend-aicpu_extend_syskernels.tar.gz], deviceId[4]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.397.572 [client_manager.cpp:268][CheckPackageExists][tid:618662] [TsdClient] find extend package[Ascend-aicpu_extend_syskernels.tar.gz] in path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], deviceId[4]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.397.590 [client_manager.cpp:283][CheckPackageExists][tid:618662] [TsdClient][deviceId=4] set extend package path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], name[Ascend-aicpu_extend_syskernels.tar.gz]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.397.603 [client_manager.cpp:286][CheckPackageExists][tid:618662] [TsdClient][deviceId=4] set aicpu package path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], name[Ascend-aicpu_syskernels.tar.gz]
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.397.656 [devdrv_hccl.c:103][ascend][curpid:618662,618662][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618662)
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.397.675 [process_mode_manager.cpp:396][InitTsdClient][tid:618662] [TsdClient][deviceId=4] get process sign success, procPid[618662]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.397.693 [process_mode_manager.cpp:403][InitTsdClient][tid:618662] [TsdClient] deviceId[4] begin to init hdc client
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.397.727 [hdc_common.cpp:67][InitMsgSize][tid:618662] HdcCommon::InitMsgSize Start
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.397.743 [hdc_common.cpp:80][InitMsgSize][tid:618662] msgMaxSize_ = 524224 bytes, msgShortHeadDataMaxSize_ = 524212 bytes, msgLongHeadDataMaxSize_ = 524200 bytes
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.397.758 [hdc_client.cpp:184][CreateHdcSession][tid:618662] HdcClient::CreateHdcSession Start
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.397.841 [hdc_client.cpp:208][CreateHdcSession][tid:618662] [HdcClient] deviceId: 4 connect session
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.397.874 [hdc_core.c:1982][ascend][curpid:618662,618662][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4158; pid=618662)
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.397.892 [hdc_client.cpp:219][CreateHdcSession][tid:618662] [HdcClient] drvHdcSetSessionReference success
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.397.905 [hdc_client.cpp:230][CreateHdcSession][tid:618662] [HdcClient] deviceId: 4 connect session and drvHdcSetSessionReference success, sessionId=1
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.397.923 [version_verify.cpp:36][SetVersionInfo][tid:618662] VersionVerify: send client version to server
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.397.970 [version_verify.cpp:52][SetVersionInfo][tid:618662] send feature_info:{msg_type:35, features:{check before send aicpu package}}
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.398.001 [version_verify.cpp:52][SetVersionInfo][tid:618662] send feature_info:{msg_type:37, features:{check before send open qs message}}
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.398.018 [version_verify.cpp:52][SetVersionInfo][tid:618662] send feature_info:{msg_type:64, features:{get check code retry}}
[WARNING] TDT(618662,python3.9):2025-04-03-09:27:41.398.046 [internal_api.cpp:101][GetScheduleEnv][tid:618662] Get env[DATAMASTER_RUN_MODE] failed
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.398.423 [version_verify.cpp:68][PeerVersionCheck][tid:618662] VersionVerify: Check client version info, server[1230], client[1230]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.398.443 [version_verify.cpp:89][ParseVersionInfo][tid:618662] VersionVerify: pass client version info success
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.398.456 [hdc_client.cpp:275][CheckHdcConnection][tid:618662] Service[2] create hdc success
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.398.471 [version_verify.cpp:122][SpecialFeatureCheck][tid:618662] VersionVerify: new type[35], supported
[WARNING] TDT(618662,python3.9):2025-04-03-09:27:41.398.488 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618662] Get env[ASAN_RUN_MODE] failed
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.398.522 [process_mode_manager.cpp:627][GetDeviceCheckCodeOnce][tid:618662] [TsdClient][deviceId=4] [sessionId=1] wait package info respond
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.398.539 [hdc_client.cpp:154][TsdRecvData][tid:618662] recv timeout is:150000 ms
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.399.525 [process_mode_msg_parse.cpp:148][PackageInfoMsgProc][tid:618662] [PackageInfoMsgProc] [sessionID=1]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.399.543 [process_mode_msg_parse.cpp:151][PackageInfoMsgProc][tid:618662] [PackageInfoMsgProc] [sessionID=1] deviceId[4], checkCode[56684994]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.399.557 [hdc_client.cpp:172][TsdRecvData][tid:618662] [deviceId=4] the Tsd recv data already
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.399.572 [version_verify.cpp:122][SpecialFeatureCheck][tid:618662] VersionVerify: new type[64], supported
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.399.588 [hdc_client.cpp:411][Destroy][tid:618662] enter HdcClient::Destroy() function
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.399.602 [hdc_client.c:417][ascend][curpid:618662,618662][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4158)
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.399.630 [hdc_client.cpp:394][DestroyClient][tid:618662] begin drvHdcClientDestroy
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.399.647 [hdc_client.cpp:399][DestroyClient][tid:618662] end drvHdcClientDestroy
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.399.661 [hdc_client.cpp:377][ClearClientPtr][tid:618662] begin HdcClient::ClearClientPtr
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.399.676 [hdc_client.cpp:385][ClearClientPtr][tid:618662] end HdcClient::ClearClientPtr
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.399.691 [hdc_client.cpp:418][Destroy][tid:618662] end HdcClient::Destroy() function
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.399.709 [process_mode_manager.cpp:371][SendAICPUPackage][tid:618662] [TsdClient]the checksum of host package[56684994] is same to device[56684994], skip send package.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.399.728 [process_mode_manager.cpp:1870][SendExtendPackage][tid:618662] [TsdClient]the checksum of host extend package[9658754] is same to device[9658754], skip send package.
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.399.748 [devdrv_hccl.c:103][ascend][curpid:618662,618662][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618662)
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.399.765 [process_mode_manager.cpp:396][InitTsdClient][tid:618662] [TsdClient][deviceId=4] get process sign success, procPid[618662]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.399.778 [process_mode_manager.cpp:403][InitTsdClient][tid:618662] [TsdClient] deviceId[4] begin to init hdc client
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.399.795 [hdc_common.cpp:67][InitMsgSize][tid:618662] HdcCommon::InitMsgSize Start
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.399.810 [hdc_common.cpp:80][InitMsgSize][tid:618662] msgMaxSize_ = 524224 bytes, msgShortHeadDataMaxSize_ = 524212 bytes, msgLongHeadDataMaxSize_ = 524200 bytes
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.399.829 [hdc_client.cpp:184][CreateHdcSession][tid:618662] HdcClient::CreateHdcSession Start
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.399.930 [hdc_client.cpp:208][CreateHdcSession][tid:618662] [HdcClient] deviceId: 4 connect session
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.399.960 [hdc_core.c:1982][ascend][curpid:618662,618662][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4159; pid=618662)
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.399.978 [hdc_client.cpp:219][CreateHdcSession][tid:618662] [HdcClient] drvHdcSetSessionReference success
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.399.991 [hdc_client.cpp:230][CreateHdcSession][tid:618662] [HdcClient] deviceId: 4 connect session and drvHdcSetSessionReference success, sessionId=1
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.400.009 [version_verify.cpp:36][SetVersionInfo][tid:618662] VersionVerify: send client version to server
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.400.022 [version_verify.cpp:52][SetVersionInfo][tid:618662] send feature_info:{msg_type:35, features:{check before send aicpu package}}
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.400.036 [version_verify.cpp:52][SetVersionInfo][tid:618662] send feature_info:{msg_type:37, features:{check before send open qs message}}
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.400.053 [version_verify.cpp:52][SetVersionInfo][tid:618662] send feature_info:{msg_type:64, features:{get check code retry}}
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.400.530 [version_verify.cpp:68][PeerVersionCheck][tid:618662] VersionVerify: Check client version info, server[1230], client[1230]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.400.551 [version_verify.cpp:89][ParseVersionInfo][tid:618662] VersionVerify: pass client version info success
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.400.569 [hdc_client.cpp:275][CheckHdcConnection][tid:618662] Service[2] create hdc success
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.400.585 [process_mode_manager.cpp:458][ConstructOpenMsg][tid:618662] [TsdClient] tsd get process sign successfully, procpid[618662] signSize[48]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.400.605 [version_verify.cpp:114][SpecialFeatureCheck][tid:618662] VersionVerify: previous type[6], supported
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.400.632 [process_mode_manager.cpp:88][OpenProcess][tid:618662] [ProcessModeManager] deviceId[4] sessionId[1] rankSize[0], wait sub process start respond
[WARNING] TDT(618662,python3.9):2025-04-03-09:27:41.400.651 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618662] Get env[ASAN_RUN_MODE] failed
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.400.663 [hdc_client.cpp:154][TsdRecvData][tid:618662] recv timeout is:150000 ms
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.412.292 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:49] Start] The cpu collective rank 6 has been started successfully.
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.412.325 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:184] node_num] Number of role MS_WORKER is 8
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.412.377 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:81] Initialize] Query retry count is 400
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.412.399 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:89] Initialize] Interval of retry allgather hostname lower and upper are 1 and 2
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.412.433 [mindspore/ccsrc/distributed/collective/collective_manager.cc:597] InitHostCommlib] Communication library on host side is successfully initialized. Global rank id: 6, global rank size: 8
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.412.463 [mindspore/ccsrc/distributed/collective/collective_manager.cc:198] Initialize] [PROF]InitHostCommlib costs 3005.05 msec.
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.412.484 [mindspore/ccsrc/distributed/collective/collective_manager.cc:640] AssignLocalRank] Host name for rank 6 is devserver-c233-2
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.412.606 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:564] GetHostNames] Worker gets host names {"hostnames":["devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2"]}
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.412.681 [mindspore/ccsrc/distributed/collective/collective_manager.cc:661] AssignLocalRank] Successfully get all nodes' hostname.
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.412.707 [mindspore/ccsrc/distributed/collective/collective_manager.cc:678] AssignLocalRank] The local rank id assigned for this process is 6
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.412.727 [mindspore/ccsrc/distributed/collective/collective_manager.cc:679] AssignLocalRank] The env 'DEVICE_ID' assigned for this process is: 6
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.412.753 [mindspore/ccsrc/distributed/collective/collective_manager.cc:697] AssignLocalRank] The device_id of ms_context is set to local rank id [6].
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.412.777 [mindspore/ccsrc/distributed/collective/collective_manager.cc:206] Initialize] [PROF]AssignLocalRank costs 0.29 msec.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.412.854 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:236] Initialize] Start initializing device context.
[INFO] CORE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.412.901 [mindspore/core/utils/ms_context.cc:463] PrintJitLevelAndExecMode] The jit_level is: O0, and enable kernelbykernel executor in the PYNATIVE mode.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.412.927 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:250] Initialize] The current overflow detection mode is INFNAN.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.412.976 [device.cpp:365]618670 aclrtSetDeviceSatMode: start to execute aclrtSetDeviceSatMode, mode is 1
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:41.413.109 [api_impl.cc:249] 618670 CurrentContext: current ctx is nullptr!
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.413.131 [api_impl.cc:6795] 618670 SetDeviceSatMode: Set saturation mode to 1 for runtime process.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.413.147 [device.cpp:371]618670 aclrtSetDeviceSatMode: successfully execute aclrtSetDeviceSatMode, mode is 1
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.413.223 [callback.cpp:37]618670 aclrtSetExceptionInfoCallback: start to execute aclrtSetExceptionInfoCallback.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.413.268 [callback.cpp:44]618670 aclrtSetExceptionInfoCallback: successfully execute aclrtSetExceptionInfoCallback
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.413.295 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:235] Init] Start inititializing kernel runtime(SetDevice & CreateDefaultStream & MemoryManagerInitialization etc).
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.413.323 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:48] InitDevice] Enter SetRtDevice, current initialize device number:0
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.413.365 [device.cpp:143]618670 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.413.476 [npu_driver.cc:124] 618670 NpuDriver: Run mode=1 [0:offline, 1:online], env type=3
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.413.504 [api_impl.cc:2999] 618670 SetDevice: device_id=6, deviceMode=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.413.545 [runtime.cc:3602] 618670 DeviceRetain: [dlog api] DlogReportStart exist.
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.413.776 [hdc_core.c:1982][ascend][curpid:618670,618670][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4160; pid=618670)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.413.937 [runtime.cc:3609] 618670 DeviceRetain: [dlog api] AtraceReportStart exist.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:41.413.995 [atrace_client_communication.c:103](tid:618670) send [hello] msg.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:41.414.016 [atrace_client_communication.c:63](tid:618670) send msg by adx[begin], resultLen=1024 bytes.
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.414.129 [hdc_core.c:1982][ascend][curpid:618670,618670][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4161; pid=618670)
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:41.414.149 [hdc_api.cpp:671][tid:618670] connect succ, peer_node: 0, peer_devid: 6
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.415.493 [hdc_client.c:417][ascend][curpid:618670,618670][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4161)
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:41.415.530 [atrace_client_communication.c:65](tid:618670) send msg by adx[finish], ret=0.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:41.415.547 [atrace_client_communication.c:97](tid:618670) msgType=1, magic=49959, version=1.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:41.415.565 [atrace_client_communication.c:135](tid:618670) send [hello] msg success.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:41.415.641 [atrace_client_core.c:160](tid:618670) start to receive device[6] trace log.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.415.685 [runtime.cc:5239] 618670 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.415.717 [runtime.cc:2855] 618670 startAicpuExecutor: TsdOpen devId=6, device mode=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.415.735 [runtime.cc:5239] 618670 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.415.779 [client_manager.cpp:160][GetPlatformInfo][tid:618670] [TsdClient] mode[1] chipType[5]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.415.780 [hdc_core.c:1982][ascend][curpid:618670,618803][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4162; pid=618670)
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:41.415.810 [hdc_api.cpp:671][tid:618803] connect succ, peer_node: 0, peer_devid: 6
[WARNING] TDT(618670,python3.9):2025-04-03-09:27:41.415.820 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618670] Get env[ASCEND_RT_VISIBLE_DEVICES] failed
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.415.835 [client_manager.cpp:582][GetVisibleDevices][tid:618670] [TsdClient] Get env ASCEND_RT_VISIBLE_DEVICES [].
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.415.850 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618670] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.415.865 [client_manager.cpp:125][GetInstance][tid:618670] [ClientManager] GetInstance, deviceId[6], g_runningMode[0], begin saving instance
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.415.908 [client_manager.cpp:435][IsHostEnvironment][tid:618670] [TsdClient] logicDeviceId is [6], hostaicpunum[0]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.415.926 [client_manager.cpp:464][GetClientRunMode][tid:618670] runningMode:0
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.415.942 [client_manager.cpp:127][GetInstance][tid:618670] [ClientManager] Current mode:1
[WARNING] TDT(618670,python3.9):2025-04-03-09:27:41.415.962 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618670] Get env[AICPU_PROFILING_MODE] failed
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.415.977 [client_manager.cpp:347][GetProfilingMode][tid:618670] Get AICPU_PROFILING_MODE[]
[WARNING] TDT(618670,python3.9):2025-04-03-09:27:41.416.006 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618670] Get env[ASCEND_MODULE_LOG_LEVEL] failed
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.416.022 [process_mode_base.cpp:149][GetLogLevel][tid:618670] [TsdClient] get ASCEND_GLOBAL_LOG_LEVEL [1] ASCEND_GLOBAL_EVENT_ENABLE [0] ASCEND_MODULE_LOG_LEVEL []
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:41.416.039 [atrace_client_communication.c:177](tid:618803) send [start] msg.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:41.416.091 [atrace_client_communication.c:189](tid:618803) send [start] msg success.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.416.136 [process_mode_base.cpp:161][GetLogLevel][tid:618670] [TsdClient] Get Log Level[001]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.416.154 [process_mode_manager.cpp:71][OpenProcess][tid:618670] [ProcessModeManager] enter into open process deviceId[6] rankSize[0]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.416.181 [process_mode_manager.cpp:615][CheckNeedToOpen][tid:618670] [TsdClient] get open para startCp[1] startHccp[0] (0:false 1:true)
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.416.246 [client_manager.cpp:261][CheckPackageExists][tid:618670] [TsdClient] check file[.], deviceId[6]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.416.321 [client_manager.cpp:261][CheckPackageExists][tid:618670] [TsdClient] check file[scene.info], deviceId[6]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.416.386 [client_manager.cpp:261][CheckPackageExists][tid:618670] [TsdClient] check file[Ascend-aicpu_syskernels.tar.gz], deviceId[6]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.416.471 [client_manager.cpp:264][CheckPackageExists][tid:618670] [TsdClient] find aicpu package[Ascend-aicpu_syskernels.tar.gz] in path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], deviceId[6]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.416.496 [client_manager.cpp:261][CheckPackageExists][tid:618670] [TsdClient] check file[ascend_install.info], deviceId[6]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.416.557 [client_manager.cpp:261][CheckPackageExists][tid:618670] [TsdClient] check file[version.info], deviceId[6]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.416.620 [client_manager.cpp:261][CheckPackageExists][tid:618670] [TsdClient] check file[..], deviceId[6]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.416.683 [client_manager.cpp:261][CheckPackageExists][tid:618670] [TsdClient] check file[Ascend-aicpu_extend_syskernels.tar.gz], deviceId[6]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.416.817 [client_manager.cpp:268][CheckPackageExists][tid:618670] [TsdClient] find extend package[Ascend-aicpu_extend_syskernels.tar.gz] in path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], deviceId[6]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.416.834 [client_manager.cpp:283][CheckPackageExists][tid:618670] [TsdClient][deviceId=6] set extend package path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], name[Ascend-aicpu_extend_syskernels.tar.gz]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.416.851 [client_manager.cpp:286][CheckPackageExists][tid:618670] [TsdClient][deviceId=6] set aicpu package path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], name[Ascend-aicpu_syskernels.tar.gz]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.416.912 [devdrv_hccl.c:103][ascend][curpid:618670,618670][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618670)
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.416.930 [process_mode_manager.cpp:396][InitTsdClient][tid:618670] [TsdClient][deviceId=6] get process sign success, procPid[618670]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.416.947 [process_mode_manager.cpp:403][InitTsdClient][tid:618670] [TsdClient] deviceId[6] begin to init hdc client
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.416.985 [hdc_common.cpp:67][InitMsgSize][tid:618670] HdcCommon::InitMsgSize Start
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.417.001 [hdc_common.cpp:80][InitMsgSize][tid:618670] msgMaxSize_ = 524224 bytes, msgShortHeadDataMaxSize_ = 524212 bytes, msgLongHeadDataMaxSize_ = 524200 bytes
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.417.015 [hdc_client.cpp:184][CreateHdcSession][tid:618670] HdcClient::CreateHdcSession Start
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.417.095 [hdc_client.cpp:208][CreateHdcSession][tid:618670] [HdcClient] deviceId: 6 connect session
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.417.127 [hdc_core.c:1982][ascend][curpid:618670,618670][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4163; pid=618670)
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.417.144 [hdc_client.cpp:219][CreateHdcSession][tid:618670] [HdcClient] drvHdcSetSessionReference success
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.417.159 [hdc_client.cpp:230][CreateHdcSession][tid:618670] [HdcClient] deviceId: 6 connect session and drvHdcSetSessionReference success, sessionId=1
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.417.178 [version_verify.cpp:36][SetVersionInfo][tid:618670] VersionVerify: send client version to server
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.417.224 [version_verify.cpp:52][SetVersionInfo][tid:618670] send feature_info:{msg_type:35, features:{check before send aicpu package}}
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.417.241 [version_verify.cpp:52][SetVersionInfo][tid:618670] send feature_info:{msg_type:37, features:{check before send open qs message}}
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.417.253 [version_verify.cpp:52][SetVersionInfo][tid:618670] send feature_info:{msg_type:64, features:{get check code retry}}
[WARNING] TDT(618670,python3.9):2025-04-03-09:27:41.417.291 [internal_api.cpp:101][GetScheduleEnv][tid:618670] Get env[DATAMASTER_RUN_MODE] failed
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.417.663 [version_verify.cpp:68][PeerVersionCheck][tid:618670] VersionVerify: Check client version info, server[1230], client[1230]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.417.685 [version_verify.cpp:89][ParseVersionInfo][tid:618670] VersionVerify: pass client version info success
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.417.700 [hdc_client.cpp:275][CheckHdcConnection][tid:618670] Service[2] create hdc success
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.417.716 [version_verify.cpp:122][SpecialFeatureCheck][tid:618670] VersionVerify: new type[35], supported
[WARNING] TDT(618670,python3.9):2025-04-03-09:27:41.417.731 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618670] Get env[ASAN_RUN_MODE] failed
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.417.763 [process_mode_manager.cpp:627][GetDeviceCheckCodeOnce][tid:618670] [TsdClient][deviceId=6] [sessionId=1] wait package info respond
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.417.780 [hdc_client.cpp:154][TsdRecvData][tid:618670] recv timeout is:150000 ms
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.418.802 [process_mode_msg_parse.cpp:148][PackageInfoMsgProc][tid:618670] [PackageInfoMsgProc] [sessionID=1]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.418.819 [process_mode_msg_parse.cpp:151][PackageInfoMsgProc][tid:618670] [PackageInfoMsgProc] [sessionID=1] deviceId[6], checkCode[56684994]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.418.833 [hdc_client.cpp:172][TsdRecvData][tid:618670] [deviceId=6] the Tsd recv data already
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.418.850 [version_verify.cpp:122][SpecialFeatureCheck][tid:618670] VersionVerify: new type[64], supported
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.418.868 [hdc_client.cpp:411][Destroy][tid:618670] enter HdcClient::Destroy() function
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.418.883 [hdc_client.c:417][ascend][curpid:618670,618670][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4163)
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.418.909 [hdc_client.cpp:394][DestroyClient][tid:618670] begin drvHdcClientDestroy
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.418.925 [hdc_client.cpp:399][DestroyClient][tid:618670] end drvHdcClientDestroy
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.418.942 [hdc_client.cpp:377][ClearClientPtr][tid:618670] begin HdcClient::ClearClientPtr
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.418.954 [hdc_client.cpp:385][ClearClientPtr][tid:618670] end HdcClient::ClearClientPtr
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.418.966 [hdc_client.cpp:418][Destroy][tid:618670] end HdcClient::Destroy() function
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.419.010 [process_mode_manager.cpp:371][SendAICPUPackage][tid:618670] [TsdClient]the checksum of host package[56684994] is same to device[56684994], skip send package.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.419.030 [process_mode_manager.cpp:1870][SendExtendPackage][tid:618670] [TsdClient]the checksum of host extend package[9658754] is same to device[9658754], skip send package.
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.419.050 [devdrv_hccl.c:103][ascend][curpid:618670,618670][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618670)
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.419.067 [process_mode_manager.cpp:396][InitTsdClient][tid:618670] [TsdClient][deviceId=6] get process sign success, procPid[618670]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.419.079 [process_mode_manager.cpp:403][InitTsdClient][tid:618670] [TsdClient] deviceId[6] begin to init hdc client
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.419.095 [hdc_common.cpp:67][InitMsgSize][tid:618670] HdcCommon::InitMsgSize Start
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.419.109 [hdc_common.cpp:80][InitMsgSize][tid:618670] msgMaxSize_ = 524224 bytes, msgShortHeadDataMaxSize_ = 524212 bytes, msgLongHeadDataMaxSize_ = 524200 bytes
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.419.128 [hdc_client.cpp:184][CreateHdcSession][tid:618670] HdcClient::CreateHdcSession Start
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.419.195 [hdc_client.cpp:208][CreateHdcSession][tid:618670] [HdcClient] deviceId: 6 connect session
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.419.224 [hdc_core.c:1982][ascend][curpid:618670,618670][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4164; pid=618670)
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.419.241 [hdc_client.cpp:219][CreateHdcSession][tid:618670] [HdcClient] drvHdcSetSessionReference success
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.419.253 [hdc_client.cpp:230][CreateHdcSession][tid:618670] [HdcClient] deviceId: 6 connect session and drvHdcSetSessionReference success, sessionId=1
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.419.268 [version_verify.cpp:36][SetVersionInfo][tid:618670] VersionVerify: send client version to server
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.419.284 [version_verify.cpp:52][SetVersionInfo][tid:618670] send feature_info:{msg_type:35, features:{check before send aicpu package}}
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.419.300 [version_verify.cpp:52][SetVersionInfo][tid:618670] send feature_info:{msg_type:37, features:{check before send open qs message}}
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.419.316 [version_verify.cpp:52][SetVersionInfo][tid:618670] send feature_info:{msg_type:64, features:{get check code retry}}
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.419.574 [version_verify.cpp:68][PeerVersionCheck][tid:618670] VersionVerify: Check client version info, server[1230], client[1230]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.419.593 [version_verify.cpp:89][ParseVersionInfo][tid:618670] VersionVerify: pass client version info success
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.419.608 [hdc_client.cpp:275][CheckHdcConnection][tid:618670] Service[2] create hdc success
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.419.626 [process_mode_manager.cpp:458][ConstructOpenMsg][tid:618670] [TsdClient] tsd get process sign successfully, procpid[618670] signSize[48]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.419.645 [version_verify.cpp:114][SpecialFeatureCheck][tid:618670] VersionVerify: previous type[6], supported
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.419.672 [process_mode_manager.cpp:88][OpenProcess][tid:618670] [ProcessModeManager] deviceId[6] sessionId[1] rankSize[0], wait sub process start respond
[WARNING] TDT(618670,python3.9):2025-04-03-09:27:41.419.690 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618670] Get env[ASAN_RUN_MODE] failed
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.419.702 [hdc_client.cpp:154][TsdRecvData][tid:618670] recv timeout is:150000 ms
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:41.452.715 [runtime.cc:5239] 618772 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:41.452.742 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618772] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:41.452.757 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618772] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:41.452.773 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618772] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:41.452.791 [runtime.cc:3077] 618772 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=3, devId=3, tdt status=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:41.452.861 [npu_driver.cc:551] 618772 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.505.591 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:49] Start] The cpu collective rank 1 has been started successfully.
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.505.663 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:184] node_num] Number of role MS_WORKER is 8
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.505.728 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:81] Initialize] Query retry count is 400
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.505.753 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:89] Initialize] Interval of retry allgather hostname lower and upper are 1 and 2
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.505.793 [mindspore/ccsrc/distributed/collective/collective_manager.cc:597] InitHostCommlib] Communication library on host side is successfully initialized. Global rank id: 1, global rank size: 8
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.505.832 [mindspore/ccsrc/distributed/collective/collective_manager.cc:198] Initialize] [PROF]InitHostCommlib costs 3005.07 msec.
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.505.856 [mindspore/ccsrc/distributed/collective/collective_manager.cc:640] AssignLocalRank] Host name for rank 1 is devserver-c233-2
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.505.976 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:564] GetHostNames] Worker gets host names {"hostnames":["devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2"]}
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.506.058 [mindspore/ccsrc/distributed/collective/collective_manager.cc:661] AssignLocalRank] Successfully get all nodes' hostname.
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.506.086 [mindspore/ccsrc/distributed/collective/collective_manager.cc:678] AssignLocalRank] The local rank id assigned for this process is 1
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.506.107 [mindspore/ccsrc/distributed/collective/collective_manager.cc:679] AssignLocalRank] The env 'DEVICE_ID' assigned for this process is: 1
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.506.140 [mindspore/ccsrc/distributed/collective/collective_manager.cc:697] AssignLocalRank] The device_id of ms_context is set to local rank id [1].
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.506.165 [mindspore/ccsrc/distributed/collective/collective_manager.cc:206] Initialize] [PROF]AssignLocalRank costs 0.307 msec.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.506.284 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:236] Initialize] Start initializing device context.
[INFO] CORE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.506.327 [mindspore/core/utils/ms_context.cc:463] PrintJitLevelAndExecMode] The jit_level is: O0, and enable kernelbykernel executor in the PYNATIVE mode.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.506.354 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:250] Initialize] The current overflow detection mode is INFNAN.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.506.390 [device.cpp:365]618650 aclrtSetDeviceSatMode: start to execute aclrtSetDeviceSatMode, mode is 1
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:41.506.530 [api_impl.cc:249] 618650 CurrentContext: current ctx is nullptr!
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.506.552 [api_impl.cc:6795] 618650 SetDeviceSatMode: Set saturation mode to 1 for runtime process.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.506.569 [device.cpp:371]618650 aclrtSetDeviceSatMode: successfully execute aclrtSetDeviceSatMode, mode is 1
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.506.645 [callback.cpp:37]618650 aclrtSetExceptionInfoCallback: start to execute aclrtSetExceptionInfoCallback.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.506.695 [callback.cpp:44]618650 aclrtSetExceptionInfoCallback: successfully execute aclrtSetExceptionInfoCallback
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.506.723 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:235] Init] Start inititializing kernel runtime(SetDevice & CreateDefaultStream & MemoryManagerInitialization etc).
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.506.751 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:48] InitDevice] Enter SetRtDevice, current initialize device number:0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.506.790 [device.cpp:143]618650 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.506.891 [npu_driver.cc:124] 618650 NpuDriver: Run mode=1 [0:offline, 1:online], env type=3
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.506.930 [api_impl.cc:2999] 618650 SetDevice: device_id=1, deviceMode=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.506.973 [runtime.cc:3602] 618650 DeviceRetain: [dlog api] DlogReportStart exist.
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.507.210 [hdc_core.c:1982][ascend][curpid:618650,618650][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4165; pid=618650)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.507.447 [runtime.cc:3609] 618650 DeviceRetain: [dlog api] AtraceReportStart exist.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:41.507.496 [atrace_client_communication.c:103](tid:618650) send [hello] msg.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:41.507.516 [atrace_client_communication.c:63](tid:618650) send msg by adx[begin], resultLen=1024 bytes.
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.507.717 [hdc_core.c:1982][ascend][curpid:618650,618650][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4166; pid=618650)
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:41.507.737 [hdc_api.cpp:671][tid:618650] connect succ, peer_node: 0, peer_devid: 1
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.509.097 [hdc_client.c:417][ascend][curpid:618650,618650][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4166)
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:41.509.137 [atrace_client_communication.c:65](tid:618650) send msg by adx[finish], ret=0.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:41.509.157 [atrace_client_communication.c:97](tid:618650) msgType=1, magic=49959, version=1.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:41.509.175 [atrace_client_communication.c:135](tid:618650) send [hello] msg success.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:41.509.304 [atrace_client_core.c:160](tid:618650) start to receive device[1] trace log.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.509.350 [runtime.cc:5239] 618650 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.509.371 [runtime.cc:2855] 618650 startAicpuExecutor: TsdOpen devId=1, device mode=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.509.389 [runtime.cc:5239] 618650 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.509.435 [client_manager.cpp:160][GetPlatformInfo][tid:618650] [TsdClient] mode[1] chipType[5]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.509.457 [hdc_core.c:1982][ascend][curpid:618650,618805][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4167; pid=618650)
[WARNING] TDT(618650,python3.9):2025-04-03-09:27:41.509.480 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618650] Get env[ASCEND_RT_VISIBLE_DEVICES] failed
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:41.509.496 [hdc_api.cpp:671][tid:618805] connect succ, peer_node: 0, peer_devid: 1
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.509.501 [client_manager.cpp:582][GetVisibleDevices][tid:618650] [TsdClient] Get env ASCEND_RT_VISIBLE_DEVICES [].
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.509.522 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618650] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.509.537 [client_manager.cpp:125][GetInstance][tid:618650] [ClientManager] GetInstance, deviceId[1], g_runningMode[0], begin saving instance
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.509.578 [client_manager.cpp:435][IsHostEnvironment][tid:618650] [TsdClient] logicDeviceId is [1], hostaicpunum[0]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.509.597 [client_manager.cpp:464][GetClientRunMode][tid:618650] runningMode:0
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.509.611 [client_manager.cpp:127][GetInstance][tid:618650] [ClientManager] Current mode:1
[WARNING] TDT(618650,python3.9):2025-04-03-09:27:41.509.624 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618650] Get env[AICPU_PROFILING_MODE] failed
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.509.640 [client_manager.cpp:347][GetProfilingMode][tid:618650] Get AICPU_PROFILING_MODE[]
[WARNING] TDT(618650,python3.9):2025-04-03-09:27:41.509.684 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618650] Get env[ASCEND_MODULE_LOG_LEVEL] failed
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.509.701 [process_mode_base.cpp:149][GetLogLevel][tid:618650] [TsdClient] get ASCEND_GLOBAL_LOG_LEVEL [1] ASCEND_GLOBAL_EVENT_ENABLE [0] ASCEND_MODULE_LOG_LEVEL []
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:41.509.725 [atrace_client_communication.c:177](tid:618805) send [start] msg.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:41.509.774 [atrace_client_communication.c:189](tid:618805) send [start] msg success.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.509.801 [process_mode_base.cpp:161][GetLogLevel][tid:618650] [TsdClient] Get Log Level[001]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.509.821 [process_mode_manager.cpp:71][OpenProcess][tid:618650] [ProcessModeManager] enter into open process deviceId[1] rankSize[0]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.509.841 [process_mode_manager.cpp:615][CheckNeedToOpen][tid:618650] [TsdClient] get open para startCp[1] startHccp[0] (0:false 1:true)
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.509.931 [client_manager.cpp:261][CheckPackageExists][tid:618650] [TsdClient] check file[.], deviceId[1]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.510.009 [client_manager.cpp:261][CheckPackageExists][tid:618650] [TsdClient] check file[scene.info], deviceId[1]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.510.079 [client_manager.cpp:261][CheckPackageExists][tid:618650] [TsdClient] check file[Ascend-aicpu_syskernels.tar.gz], deviceId[1]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.510.193 [client_manager.cpp:264][CheckPackageExists][tid:618650] [TsdClient] find aicpu package[Ascend-aicpu_syskernels.tar.gz] in path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], deviceId[1]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.510.212 [client_manager.cpp:261][CheckPackageExists][tid:618650] [TsdClient] check file[ascend_install.info], deviceId[1]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.510.280 [client_manager.cpp:261][CheckPackageExists][tid:618650] [TsdClient] check file[version.info], deviceId[1]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.510.348 [client_manager.cpp:261][CheckPackageExists][tid:618650] [TsdClient] check file[..], deviceId[1]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.510.418 [client_manager.cpp:261][CheckPackageExists][tid:618650] [TsdClient] check file[Ascend-aicpu_extend_syskernels.tar.gz], deviceId[1]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.510.565 [client_manager.cpp:268][CheckPackageExists][tid:618650] [TsdClient] find extend package[Ascend-aicpu_extend_syskernels.tar.gz] in path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], deviceId[1]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.510.584 [client_manager.cpp:283][CheckPackageExists][tid:618650] [TsdClient][deviceId=1] set extend package path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], name[Ascend-aicpu_extend_syskernels.tar.gz]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.510.601 [client_manager.cpp:286][CheckPackageExists][tid:618650] [TsdClient][deviceId=1] set aicpu package path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], name[Ascend-aicpu_syskernels.tar.gz]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.510.671 [devdrv_hccl.c:103][ascend][curpid:618650,618650][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618650)
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.510.691 [process_mode_manager.cpp:396][InitTsdClient][tid:618650] [TsdClient][deviceId=1] get process sign success, procPid[618650]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.510.706 [process_mode_manager.cpp:403][InitTsdClient][tid:618650] [TsdClient] deviceId[1] begin to init hdc client
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.510.742 [hdc_common.cpp:67][InitMsgSize][tid:618650] HdcCommon::InitMsgSize Start
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.510.759 [hdc_common.cpp:80][InitMsgSize][tid:618650] msgMaxSize_ = 524224 bytes, msgShortHeadDataMaxSize_ = 524212 bytes, msgLongHeadDataMaxSize_ = 524200 bytes
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.510.779 [hdc_client.cpp:184][CreateHdcSession][tid:618650] HdcClient::CreateHdcSession Start
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.510.868 [hdc_client.cpp:208][CreateHdcSession][tid:618650] [HdcClient] deviceId: 1 connect session
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.510.904 [hdc_core.c:1982][ascend][curpid:618650,618650][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4168; pid=618650)
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.510.923 [hdc_client.cpp:219][CreateHdcSession][tid:618650] [HdcClient] drvHdcSetSessionReference success
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.510.941 [hdc_client.cpp:230][CreateHdcSession][tid:618650] [HdcClient] deviceId: 1 connect session and drvHdcSetSessionReference success, sessionId=1
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.510.962 [version_verify.cpp:36][SetVersionInfo][tid:618650] VersionVerify: send client version to server
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.511.008 [version_verify.cpp:52][SetVersionInfo][tid:618650] send feature_info:{msg_type:35, features:{check before send aicpu package}}
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.511.033 [version_verify.cpp:52][SetVersionInfo][tid:618650] send feature_info:{msg_type:37, features:{check before send open qs message}}
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.511.050 [version_verify.cpp:52][SetVersionInfo][tid:618650] send feature_info:{msg_type:64, features:{get check code retry}}
[WARNING] TDT(618650,python3.9):2025-04-03-09:27:41.511.107 [internal_api.cpp:101][GetScheduleEnv][tid:618650] Get env[DATAMASTER_RUN_MODE] failed
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.511.436 [version_verify.cpp:68][PeerVersionCheck][tid:618650] VersionVerify: Check client version info, server[1230], client[1230]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.511.460 [version_verify.cpp:89][ParseVersionInfo][tid:618650] VersionVerify: pass client version info success
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.511.476 [hdc_client.cpp:275][CheckHdcConnection][tid:618650] Service[2] create hdc success
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.511.494 [version_verify.cpp:122][SpecialFeatureCheck][tid:618650] VersionVerify: new type[35], supported
[WARNING] TDT(618650,python3.9):2025-04-03-09:27:41.511.513 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618650] Get env[ASAN_RUN_MODE] failed
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.511.549 [process_mode_manager.cpp:627][GetDeviceCheckCodeOnce][tid:618650] [TsdClient][deviceId=1] [sessionId=1] wait package info respond
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.511.567 [hdc_client.cpp:154][TsdRecvData][tid:618650] recv timeout is:150000 ms
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.512.549 [process_mode_msg_parse.cpp:148][PackageInfoMsgProc][tid:618650] [PackageInfoMsgProc] [sessionID=1]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.512.568 [process_mode_msg_parse.cpp:151][PackageInfoMsgProc][tid:618650] [PackageInfoMsgProc] [sessionID=1] deviceId[1], checkCode[56684994]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.512.584 [hdc_client.cpp:172][TsdRecvData][tid:618650] [deviceId=1] the Tsd recv data already
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.512.602 [version_verify.cpp:122][SpecialFeatureCheck][tid:618650] VersionVerify: new type[64], supported
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.512.619 [hdc_client.cpp:411][Destroy][tid:618650] enter HdcClient::Destroy() function
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.512.635 [hdc_client.c:417][ascend][curpid:618650,618650][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4168)
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.512.663 [hdc_client.cpp:394][DestroyClient][tid:618650] begin drvHdcClientDestroy
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.512.681 [hdc_client.cpp:399][DestroyClient][tid:618650] end drvHdcClientDestroy
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.512.695 [hdc_client.cpp:377][ClearClientPtr][tid:618650] begin HdcClient::ClearClientPtr
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.512.712 [hdc_client.cpp:385][ClearClientPtr][tid:618650] end HdcClient::ClearClientPtr
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.512.724 [hdc_client.cpp:418][Destroy][tid:618650] end HdcClient::Destroy() function
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.512.747 [process_mode_manager.cpp:371][SendAICPUPackage][tid:618650] [TsdClient]the checksum of host package[56684994] is same to device[56684994], skip send package.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.512.768 [process_mode_manager.cpp:1870][SendExtendPackage][tid:618650] [TsdClient]the checksum of host extend package[9658754] is same to device[9658754], skip send package.
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.512.789 [devdrv_hccl.c:103][ascend][curpid:618650,618650][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618650)
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.512.806 [process_mode_manager.cpp:396][InitTsdClient][tid:618650] [TsdClient][deviceId=1] get process sign success, procPid[618650]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.512.819 [process_mode_manager.cpp:403][InitTsdClient][tid:618650] [TsdClient] deviceId[1] begin to init hdc client
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.512.836 [hdc_common.cpp:67][InitMsgSize][tid:618650] HdcCommon::InitMsgSize Start
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.512.852 [hdc_common.cpp:80][InitMsgSize][tid:618650] msgMaxSize_ = 524224 bytes, msgShortHeadDataMaxSize_ = 524212 bytes, msgLongHeadDataMaxSize_ = 524200 bytes
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.512.880 [hdc_client.cpp:184][CreateHdcSession][tid:618650] HdcClient::CreateHdcSession Start
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.512.937 [hdc_client.cpp:208][CreateHdcSession][tid:618650] [HdcClient] deviceId: 1 connect session
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.512.969 [hdc_core.c:1982][ascend][curpid:618650,618650][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4169; pid=618650)
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.512.988 [hdc_client.cpp:219][CreateHdcSession][tid:618650] [HdcClient] drvHdcSetSessionReference success
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.513.003 [hdc_client.cpp:230][CreateHdcSession][tid:618650] [HdcClient] deviceId: 1 connect session and drvHdcSetSessionReference success, sessionId=1
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.513.021 [version_verify.cpp:36][SetVersionInfo][tid:618650] VersionVerify: send client version to server
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.513.034 [version_verify.cpp:52][SetVersionInfo][tid:618650] send feature_info:{msg_type:35, features:{check before send aicpu package}}
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.513.051 [version_verify.cpp:52][SetVersionInfo][tid:618650] send feature_info:{msg_type:37, features:{check before send open qs message}}
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.513.064 [version_verify.cpp:52][SetVersionInfo][tid:618650] send feature_info:{msg_type:64, features:{get check code retry}}
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.513.305 [version_verify.cpp:68][PeerVersionCheck][tid:618650] VersionVerify: Check client version info, server[1230], client[1230]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.513.325 [version_verify.cpp:89][ParseVersionInfo][tid:618650] VersionVerify: pass client version info success
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.513.339 [hdc_client.cpp:275][CheckHdcConnection][tid:618650] Service[2] create hdc success
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.513.357 [process_mode_manager.cpp:458][ConstructOpenMsg][tid:618650] [TsdClient] tsd get process sign successfully, procpid[618650] signSize[48]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.513.375 [version_verify.cpp:114][SpecialFeatureCheck][tid:618650] VersionVerify: previous type[6], supported
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.513.404 [process_mode_manager.cpp:88][OpenProcess][tid:618650] [ProcessModeManager] deviceId[1] sessionId[1] rankSize[0], wait sub process start respond
[WARNING] TDT(618650,python3.9):2025-04-03-09:27:41.513.424 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618650] Get env[ASAN_RUN_MODE] failed
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.513.435 [hdc_client.cpp:154][TsdRecvData][tid:618650] recv timeout is:150000 ms
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.524.993 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618666] [ServerToClientMsgProc] [sessionID=1]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.525.010 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618666] [TsdClient] DeviceMsgProc recvMsg realDeviceId[5] msgType[8] localDevId[5] rspCode[0]heterogeneousSubPid[0], tsdSupportLevel_[63]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.525.024 [hdc_client.cpp:172][TsdRecvData][tid:618666] [deviceId=5] the Tsd recv data already
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.525.048 [devmm_svm.c:132][ascend][curpid:618666,618666][drv][devmm][devmm_setup_device]DrvMemDeviceOpen. (devid=5)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.526.991 [devmm_virt_interface.c:450][ascend][curpid:618666,618666][drv][devmm][devmm_ioctl_init_process]Init_process details. (hostpid=618666)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.527.303 [drv_log_user.c:623][ascend][curpid:618666,618666][drv][devmm][share_log_read_in_single_module]Setup device succeeded. (logical_devid=5; devid=5; vfid=0; hostpid=618666; devpid=30062)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.527.325 [devmm_svm.c:122][ascend][curpid:618666,618666][drv][devmm][devmm_set_device_info]Device info. (devid=5; dvpp_size=17179869184; support_bar_mem=1; support_dev_read_only=1; support_dev_mem_map_host=1; support_bar_huge_mem=1; is_alloced_by_malloc=0; host_rw_dev_ro=1; double_pgtable_offset=17592186044416; is_support_host_pin_pre_register=0; is_support_host_mem_pool=0)
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.527.612 [stub_process_mode_nowin.cpp:60][ProcessQueueForMdc][tid:618666] [TsdClient] it is unnecessary of current mode[0] to grant queue auth to aicpusd
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.527.630 [stub_process_mode_nowin.cpp:99][OpenInHost][tid:618666] enter into OpenInHost deviceid[5]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.527.656 [client_manager.cpp:435][IsHostEnvironment][tid:618666] [TsdClient] logicDeviceId is [5], hostaicpunum[0]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.527.669 [stub_process_mode_nowin.cpp:103][OpenInHost][tid:618666] host cpu not support
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.527.678 [process_mode_manager.cpp:121][OpenProcess][tid:618666] [TsdClient][deviceId=5] [sessionId=1] start hccp and computer process success
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.527.692 [runtime.cc:2879] 618666 startAicpuExecutor: userDeviceId=5, devId=5, tsdOpen ret=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.527.703 [runtime.cc:2891] 618666 startAicpuExecutor: TsdOpen success, devId=5, ret=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.527.719 [runtime.cc:3627] 618666 DeviceRetain: new dev ok id=5, rawDevSize=1328 (bytes), ts_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.527.732 [raw_device.cc:936] 618666 DevSetTsId: DevSetTsId, tsId=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.527.744 [npu_driver.cc:2968] 618666 DeviceOpen: Open device start, device_id=5, tsId=0.
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.527.833 [trs_sqcq.c:458][ascend][curpid:618666,618666][drv][tsdrv][trsDevSqCqInit]Sqcq init. (devid=5)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.528.340 [trs_sqcq.c:394][ascend][curpid:618666,618666][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=5; tsId=0; id_type=6; num=2044)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.528.773 [trs_sqcq.c:394][ascend][curpid:618666,618666][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=5; tsId=0; id_type=7; num=2044)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.528.995 [trs_sqcq.c:394][ascend][curpid:618666,618666][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=5; tsId=0; id_type=10; num=1024)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.529.218 [trs_sqcq.c:394][ascend][curpid:618666,618666][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=5; tsId=0; id_type=11; num=1024)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.529.634 [trs_sqcq.c:394][ascend][curpid:618666,618666][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=5; tsId=0; id_type=12; num=2048)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.529.656 [trs_sqcq.c:394][ascend][curpid:618666,618666][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=5; tsId=0; id_type=8; num=16)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.529.675 [trs_sqcq.c:394][ascend][curpid:618666,618666][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=5; tsId=0; id_type=9; num=16)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.529.691 [trs_sqcq.c:394][ascend][curpid:618666,618666][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=5; tsId=0; id_type=13; num=4)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.529.707 [trs_sqcq.c:394][ascend][curpid:618666,618666][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=5; tsId=0; id_type=14; num=10)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.531.722 [trs_dev_drv.c:302][ascend][curpid:618666,618666][drv][tsdrv][drvDeviceOpenComm]Open success. (devid=5; fd=36; mmapFd=37)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.531.742 [devmm_svm.c:132][ascend][curpid:618666,618666][drv][devmm][devmm_setup_device]DrvMemDeviceOpen. (devid=5)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.531.762 [devmm_svm.c:122][ascend][curpid:618666,618666][drv][devmm][devmm_set_device_info]Device info. (devid=5; dvpp_size=17179869184; support_bar_mem=1; support_dev_read_only=1; support_dev_mem_map_host=1; support_bar_huge_mem=1; is_alloced_by_malloc=0; host_rw_dev_ro=1; double_pgtable_offset=17592186044416; is_support_host_pin_pre_register=0; is_support_host_mem_pool=0)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.531.830 [npu_driver.cc:3011] 618666 DeviceOpen: Open device success, device_id=5, tsId=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.531.846 [raw_device.cc:292] 618666 Init: chipType:0x5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.531.873 [raw_device.cc:304] 618666 Init: isAddrFlat:0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.531.888 [raw_device.cc:320] 618666 Init: GetDevInfo, device_id=5, hardwareVersion=0x503
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.531.903 [devmm_svm.c:1972][ascend][curpid:618666,618666][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0x1; out_feature=0x1)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.531.916 [npu_driver.cc:1578] 618666 SupportNumaTsMemCtrl: chip type=5, support flag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.532.818 [raw_device.cc:352] 618666 Init: Get phy info, phy chip id 5, phy die id 0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.532.837 [runtime.cc:2771] 618666 GetTsdQos: [TSD] start get qos, devId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.532.847 [runtime.cc:5239] 618666 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.532.858 [tsd_client.cpp:189][TsdCapabilityGet][tid:618666] TsdCapabilityGet Begin.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.532.870 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618666] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.532.881 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618666] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.532.891 [process_mode_manager.cpp:1042][CapabilityGet][tid:618666] [ProcessModeManager] enter into CapabilityGet process deviceId[5] type[0]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.532.904 [process_mode_manager.cpp:386][InitTsdClient][tid:618666] [TsdClient] tsd client has been inited before
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.532.919 [version_verify.cpp:114][SpecialFeatureCheck][tid:618666] VersionVerify: previous type[38], supported
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.532.950 [process_mode_manager.cpp:1065][CapabilityGet][tid:618666] [TsdClient][deviceId=5] [sessionId=1] [type=0]send capability success 
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.532.965 [hdc_client.cpp:154][TsdRecvData][tid:618666] recv timeout is:150000 ms
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.533.939 [process_mode_msg_parse.cpp:175][CapabilityResMsgProc][tid:618666] [CapabilityResMsgProc] [sessionID=1]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.533.953 [process_mode_msg_parse.cpp:170][PidQosMsgProc][tid:618666] [TsdClient] PidQosMsgProc recvMsg realDeviceId[5] msgType[39] localDevId[5] rspCode[0],pidqos[1]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.533.967 [hdc_client.cpp:172][TsdRecvData][tid:618666] [deviceId=5] the Tsd recv data already
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.533.979 [process_mode_manager.cpp:1070][CapabilityGet][tid:618666] [TsdClient][logicDeviceId_=5][type=0][pidQos=1][ret=0]recv capability respond finish
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.533.992 [runtime.cc:2782] 618666 GetTsdQos: [TSD] get qos success, userDeviceId=5, devId=5, qos=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.534.007 [engine.cc:78] 618666 Engine: Constructor.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.534.018 [stars_engine.cc:51] 618666 StarsEngine: Constructor.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.534.031 [engine_factory.cc:26] 618666 CreateEngine: new StarsEngine, Runtime_alloc_size 320
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.534.043 [engine_factory.cc:38] 618666 CreateEngine: Engine init success.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.534.055 [raw_device.cc:364] 618666 Init: new SpmPool ok, Runtime_alloc_size 56(bytes)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.534.073 [spm_pool.cc:42] 618666 Init: new buffer ok, Runtime_alloc_size 128
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.534.192 [buffer_allocator.cc:61] 618666 BufferAllocator: alloc success, Runtime_alloc_size 128(bytes)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.534.207 [spm_pool.cc:55] 618666 Init: new BufferAllocator ok, Runtime_alloc_size 152
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.534.218 [raw_device.cc:380] 618666 Init: new UmaArgLoader ok, Runtime_alloc_size 296(bytes)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.534.232 [devmm_svm.c:1972][ascend][curpid:618666,618666][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.534.245 [npu_driver.cc:6080] 618666 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.534.257 [devmm_svm.c:1972][ascend][curpid:618666,618666][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.534.270 [npu_driver.cc:6080] 618666 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:41.540.175 [queue_client_comm.c:114][ascend][curpid:618658,618781][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:41.540.176 [queue_client_comm.c:114][ascend][curpid:618658,618785][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:41.540.179 [queue_client_comm.c:114][ascend][curpid:618658,618789][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:41.540.179 [queue_client_comm.c:114][ascend][curpid:618658,618783][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:41.540.180 [queue_client_comm.c:114][ascend][curpid:618658,618787][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:41.540.180 [queue_client_comm.c:114][ascend][curpid:618658,618779][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:41.540.296 [npu_driver.cc:4338] 618781 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:41.540.314 [tensor_data_transfer.cpp:612]618781 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_tensor_dump
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:41.540.318 [npu_driver.cc:4338] 618785 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:41.540.328 [tensor_data_transfer.cpp:1054]618781 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_tensor_dump
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:41.540.357 [npu_driver.cc:4338] 618789 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:41.540.365 [tensor_data_transfer.cpp:1056]618781 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:41.540.357 [tensor_data_transfer.cpp:612]618785 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_image_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:41.540.376 [tensor_data_transfer.cpp:612]618789 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_histogram_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:41.540.380 [api_impl.cc:6121] 618781 MemQueuePeek: Start to peek queue on devId 3, qid is 1.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:41.540.388 [npu_driver.cc:4338] 618783 MemQueuePeek: queue empty
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:41.540.407 [npu_driver.cc:4330] 618781 MemQueuePeek: peek mem queue, deviceId=3, qid=1, timeout=800.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.540.397 [buffer_allocator.cc:61] 618666 BufferAllocator: alloc success, Runtime_alloc_size 32768(bytes)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.540.431 [task_allocator.cc:46] 618666 DefaultAlloc: Runtime_alloc_size 32768(bytes)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.540.463 [buffer_allocator.cc:61] 618666 BufferAllocator: alloc success, Runtime_alloc_size 104(bytes)
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:41.540.390 [tensor_data_transfer.cpp:1054]618785 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_image_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:41.540.401 [tensor_data_transfer.cpp:1054]618789 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_histogram_summary
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.540.477 [h2d_copy_mgr.cc:45] 618666 H2DCopyMgr: alloc h2d copy buff success, policy 2
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:41.540.414 [tensor_data_transfer.cpp:612]618783 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_tensor_summary
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:41.540.425 [npu_driver.cc:4338] 618787 MemQueuePeek: queue empty
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.540.495 [devmm_svm.c:1972][ascend][curpid:618666,618666][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:41.540.454 [npu_driver.cc:4338] 618779 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:41.540.472 [tensor_data_transfer.cpp:1056]618785 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.540.511 [npu_driver.cc:6080] 618666 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:41.540.483 [tensor_data_transfer.cpp:1056]618789 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:41.540.494 [tensor_data_transfer.cpp:1054]618783 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_tensor_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:41.540.500 [tensor_data_transfer.cpp:612]618787 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_scalar_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:41.540.509 [tensor_data_transfer.cpp:612]618779 acltdtReceiveTensorV2: queue is empty, device is 3, name is _npu_log
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:41.540.538 [api_impl.cc:6121] 618785 MemQueuePeek: Start to peek queue on devId 3, qid is 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:41.540.548 [api_impl.cc:6121] 618789 MemQueuePeek: Start to peek queue on devId 3, qid is 5.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:41.540.573 [tensor_data_transfer.cpp:1056]618783 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:41.540.580 [tensor_data_transfer.cpp:1054]618787 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_scalar_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:41.540.589 [tensor_data_transfer.cpp:1054]618779 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is _npu_log
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:41.540.603 [npu_driver.cc:4330] 618785 MemQueuePeek: peek mem queue, deviceId=3, qid=3, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:41.540.614 [npu_driver.cc:4330] 618789 MemQueuePeek: peek mem queue, deviceId=3, qid=5, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:41.540.621 [api_impl.cc:6121] 618783 MemQueuePeek: Start to peek queue on devId 3, qid is 2.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:41.540.626 [tensor_data_transfer.cpp:1056]618787 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:41.540.634 [tensor_data_transfer.cpp:1056]618779 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:41.540.663 [npu_driver.cc:4330] 618783 MemQueuePeek: peek mem queue, deviceId=3, qid=2, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:41.540.670 [api_impl.cc:6121] 618787 MemQueuePeek: Start to peek queue on devId 3, qid is 4.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:41.540.677 [api_impl.cc:6121] 618779 MemQueuePeek: Start to peek queue on devId 3, qid is 0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:41.540.688 [npu_driver.cc:4330] 618787 MemQueuePeek: peek mem queue, deviceId=3, qid=4, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:41.540.695 [npu_driver.cc:4330] 618779 MemQueuePeek: peek mem queue, deviceId=3, qid=0, timeout=800.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.541.440 [buffer_allocator.cc:61] 618666 BufferAllocator: alloc success, Runtime_alloc_size 262144(bytes)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.541.461 [task_allocator.cc:46] 618666 DefaultAlloc: Runtime_alloc_size 4096(bytes)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.541.474 [buffer_allocator.cc:61] 618666 BufferAllocator: alloc success, Runtime_alloc_size 128(bytes)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.541.486 [h2d_copy_mgr.cc:45] 618666 H2DCopyMgr: alloc h2d copy buff success, policy 2
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.541.496 [devmm_svm.c:1972][ascend][curpid:618666,618666][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.541.510 [npu_driver.cc:6080] 618666 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.542.273 [buffer_allocator.cc:61] 618666 BufferAllocator: alloc success, Runtime_alloc_size 524288(bytes)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.542.292 [task_allocator.cc:46] 618666 DefaultAlloc: Runtime_alloc_size 2048(bytes)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.542.304 [buffer_allocator.cc:61] 618666 BufferAllocator: alloc success, Runtime_alloc_size 136(bytes)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.542.316 [h2d_copy_mgr.cc:45] 618666 H2DCopyMgr: alloc h2d copy buff success, policy 2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.542.328 [uma_arg_loader.cc:86] 618666 Init: new BufferAllocator superArgAllocator_ ok, Runtime_alloc_size 152
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.542.341 [task_allocator.cc:46] 618666 DefaultAlloc: Runtime_alloc_size 32768(bytes)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.542.371 [buffer_allocator.cc:61] 618666 BufferAllocator: alloc success, Runtime_alloc_size 104(bytes)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.542.383 [uma_arg_loader.cc:93] 618666 Init: new BufferAllocator handleAllocator_ ok, Runtime_alloc_size 152
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.543.162 [buffer_allocator.cc:61] 618666 BufferAllocator: alloc success, Runtime_alloc_size 131072(bytes)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.543.179 [uma_arg_loader.cc:102] 618666 Init: new BufferAllocator kernelInfoAllocator_ ok, Runtime_alloc_size 152
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.543.190 [uma_arg_loader.cc:104] 618666 Init: ALLOC PCIE is support[1]
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.543.201 [devmm_svm.c:1972][ascend][curpid:618666,618666][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.543.215 [npu_driver.cc:6080] 618666 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.543.331 [buffer_allocator.cc:61] 618666 BufferAllocator: alloc success, Runtime_alloc_size 32768(bytes)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.543.345 [h2d_copy_mgr.cc:45] 618666 H2DCopyMgr: alloc h2d copy buff success, policy 1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.543.357 [raw_device.cc:393] 618666 Init: new StreamSqCqManage ok, Runtime_alloc_size 416(bytes)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.543.369 [raw_device.cc:398] 618666 Init: New taskFactory ok, Runtime_alloc_size 136(bytes)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.543.381 [task_allocator.cc:46] 618666 DefaultAlloc: Runtime_alloc_size 393216(bytes)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.543.539 [buffer_allocator.cc:61] 618666 BufferAllocator: alloc success, Runtime_alloc_size 104(bytes)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.543.715 [raw_device.cc:109] 618666 Init: ObjAllocator alloc success, Runtime_alloc_size 160000(bytes)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.544.056 [raw_device.cc:121] 618666 Init: ObjAllocator alloc success, Runtime_alloc_size 960000(bytes)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.544.071 [raw_device.cc:425] 618666 Init: Runtime_alloc_size=64000(bytes)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.544.122 [npu_driver.cc:404] 618666 StreamIdAlloc: stream id alloc begin, device_id=5, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.544.195 [stream.cc:2246] 618666 AllocExecutedTimesSvm: stream_id=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.544.228 [stream_sqcq_manage.cc:147] 618666 Alloc: deviceId=5, tsId=0, drvFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.544.249 [npu_driver.cc:882] 618666 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.544.753 [npu_driver.cc:6125] 618666 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.544.803 [npu_driver.cc:6137] 618666 LogicCqAllocateV2: success: deviceId=5, tsId=0, cqId=358, streamId=0, logicCq=358, cqeDepth=4096
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.544.826 [npu_driver.cc:6189] 618666 StreamBindLogicCq: success: deviceId=5, tsId=0, streamId=0, logicCq=358.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.544.843 [npu_driver.cc:5916] 618666 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=eaaf1000, addr=dfffeaaf1000size=4096
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.544.857 [stream.cc:653] 618666 Setup: Success to get sq=0 sq reg virtual addr length=4096.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.544.899 [stream.cc:276] 618666 CreateStreamTaskRes: Normal STREAM Setup stream_id=0 flags_=0xc0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.544.913 [stream.cc:688] 618666 Setup: stream setup end, stream_id=0, IsTaskSink=0, sqId=0, cqId=0, deviceId=5, streamResId=0
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:41.544.936 [stream_state_callback_manager.cc:45] 618666 Notify: not reg stream state callback func!
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.544.950 [raw_device.cc:593] 618666 Start: new primary Stream ok, Runtime_alloc_size 3872, stream_id=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.544.966 [npu_driver.cc:404] 618666 StreamIdAlloc: stream id alloc begin, device_id=5, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.544.983 [stream_sqcq_manage.cc:147] 618666 Alloc: deviceId=5, tsId=0, drvFlag=16
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.544.994 [npu_driver.cc:882] 618666 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.071 [tsch_stream.cc:45] 618666 Setup: stream setup end, stream_id=1, type=1, IsTaskSink=0, sqId=1, cqId=1, deviceId=5 streamResId=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.086 [raw_device.cc:1219] 618666 TschStreamSetup: Tsch setup ffts dsa stream ok, stream_id=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.159 [osal.cc:309] 618666 CreateThread: Runtime_alloc_size 56
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.258 [osal.cc:182] 618666 Start: mmCreateTaskWithThreadAttr, retCode=0, name_=MONITOR_0, i=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.276 [osal.cc:309] 618666 CreateThread: Runtime_alloc_size 56
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.332 [osal.cc:182] 618666 Start: mmCreateTaskWithThreadAttr, retCode=0, name_=RT_RECYCLE, i=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.337 [stars_engine.cc:1785] 618806 MonitoringRun: Starts Monitor thread has entered, ts_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.348 [stars_engine.cc:201] 618807 RecycleThreadRun: RecycleThreadRun thread enter.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.361 [runtime.cc:5239] 618806 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.545.379 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618806] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.545.397 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618806] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.545.410 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618806] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.429 [runtime.cc:3077] 618806 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=5, devId=5, tdt status=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.483 [npu_driver.cc:6306] 618806 GetDeviceStatus: GetDeviceStatus status=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.505 [stars_engine.cc:1855] 618806 ReportHBMRasProc: g_hbmRasCheckDeviceId init, dev_id=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.518 [npu_driver.cc:551] 618806 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.642 [engine.cc:188] 618666 SubmitTaskNormal: stream_id=0,task_id=0,task_type=97 (STARS_VERSION).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.664 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=0, head=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.683 [task_info.cc:1596] 618666 ConstructSqeForStarsVersionTask: Send GetStarsVersionTask succ,sqe_type=3,pre_p=1,sqe->rt_streamID=32768,stream_id=0,task_id=0,task_type=97.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.698 [stream.cc:1400] 618666 AddTaskToList: public task, stream_id=0, task_id=0, task_type=97 (STARS_VERSION), head=0, tail=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.718 [stream.cc:2595] 618666 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=0, type=97(STARS_VERSION), head=0, tail=1, sqe_num=1, lastTail=0, device_id=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.739 [npu_driver.cc:751] 618666 SqTaskSend: device_id=5, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.752 [stars_engine.cc:893] 618666 SendTask: Sq task send finished, device_id=5, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=0, task_type=97(STARS_VERSION).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.768 [stars_engine.cc:1122] 618666 SyncTask: Task Wait: device_id=5, stream_id=0, task_id=0, logicCqId=358.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.806 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=0, head=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.819 [stars_engine.cc:1071] 618666 IsSyncTaskFinish: Sync task finished, sqHead=0 finishedTaskId=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.835 [stars_engine.cc:1017] 618666 ProcReport: Get logic report: cnt=1, idx=0, stream_id=0, report task_id=0, sync task_id=0, sqeType=3, sqeHead=0, retCode=0x23, errType=0x20.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.851 [task.cc:185] 618666 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.863 [stars_engine.cc:1027] 618666 ProcReport: taskType=97.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.874 [task.cc:185] 618666 GetTask: this stream no taskRes, stream_id=0
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.884 [stars_engine.cc:1570] 618666 ProcLogicCqReport: CQE warning, device_id=5, stream_id=0, task_id=0, sqe_type=3(place holder), errType=0x20(sq sw status error), sqSwStatus=0x23
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.901 [task.cc:185] 618666 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.914 [logger.cc:152] 618666 TaskFinished: device_id=5, stream_id=0, task_id=0, task_type=97 (STARS_VERSION), task_finish_num=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.927 [task_info.cc:1614] 618666 DoCompleteSuccessForStarsVersionTask: Complete StarsVersionTask succ, retCode=35,tschVersion=35.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.940 [raw_device.cc:1305] 618666 SetTschVersion: Set tsch version=35.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.956 [stars_engine.cc:1351] 618666 StarsResumeRtsq: Begin to query sq status, stream_id=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.974 [npu_driver.cc:5618] 618666 GetSqEnable: deviceId=5, tsId=0, sqId=0, enable=0.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.986 [stars_engine.cc:1365] 618666 StarsResumeRtsq: sq already disable, stream_id=0, queryCnt=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.545.996 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=0, head=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.546.007 [npu_driver.cc:5595] 618666 GetSqTail: deviceId=5, tsId=0, sqId=0, tail=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.546.019 [npu_driver.cc:5406] 618666 SetSqHead: deviceId=5, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.546.036 [npu_driver.cc:5357] 618666 EnableSq: deviceId=5, tsId=0, sqId=0.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:41.546.051 [stars_engine.cc:1430] 618666 StarsResumeRtsq: Resume stream_id=0, sq_id=0, sq_head=0, task_id=0, taskType=97, head=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.546.067 [npu_driver.cc:5618] 618666 GetSqEnable: deviceId=5, tsId=0, sqId=0, enable=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.546.078 [stream.cc:1494] 618666 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.546.089 [raw_device.cc:1331] 618666 GetStarsVersion: send alloc get stars version task, stream_id=0, retCode:0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.546.107 [raw_device.cc:610] 618666 Start: Get TschVersion, tschVersion=35.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.218 [engine.cc:188] 618666 SubmitTaskNormal: stream_id=0,task_id=1,task_type=83 (DEVICE_RINGBUFFER_CONTROL).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.257 [ringbuffer_maintain_task.cc:98] 618666 ConstructSqeForRingBufferMaintainTask: RingBufferMaintainTask stream_id=0, task_id=1, offset=0x1940
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.272 [stream.cc:1400] 618666 AddTaskToList: public task, stream_id=0, task_id=1, task_type=83 (DEVICE_RINGBUFFER_CONTROL), head=1, tail=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.285 [stream.cc:2595] 618666 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=1, type=83(DEVICE_RINGBUFFER_CONTROL), head=1, tail=2, sqe_num=1, lastTail=1, device_id=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.301 [npu_driver.cc:751] 618666 SqTaskSend: device_id=5, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.312 [stars_engine.cc:893] 618666 SendTask: Sq task send finished, device_id=5, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=1, task_type=83(DEVICE_RINGBUFFER_CONTROL).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.326 [stream.cc:1494] 618666 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.339 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.367 [stars_engine.cc:622] 618666 ProcLogicCqUntilEmpty: Task Wait: stream_id=0, logicCqId=358, retCode=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.381 [stream.cc:2886] 618666 StarsWaitForTask: No.0 stream_id=0, taskId=1, currentId=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.394 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.406 [stream.cc:2886] 618666 StarsWaitForTask: No.1 stream_id=0, taskId=1, currentId=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.418 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.429 [stream.cc:2886] 618666 StarsWaitForTask: No.2 stream_id=0, taskId=1, currentId=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.440 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.452 [stream.cc:2886] 618666 StarsWaitForTask: No.3 stream_id=0, taskId=1, currentId=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.463 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.473 [stream.cc:2886] 618666 StarsWaitForTask: No.4 stream_id=0, taskId=1, currentId=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.484 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=0, head=2.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.496 [task.cc:185] 618666 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.507 [task.cc:185] 618666 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.519 [logger.cc:152] 618666 TaskFinished: device_id=5, stream_id=0, task_id=1, task_type=83 (DEVICE_RINGBUFFER_CONTROL), task_finish_num=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.535 [stars_engine.cc:437] 618666 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=1, sqHead=2, endTaskId=1, recycleTaskId=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.548 [stream.cc:2886] 618666 StarsWaitForTask: No.5 stream_id=0, taskId=1, currentId=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.593 [engine.cc:188] 618666 SubmitTaskNormal: stream_id=0,task_id=2,task_type=29 (ALLOC_DSA_ADDR).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.614 [task_info.cc:111] 618666 ConstructSqeForAllocDsaAddrTask: Send AllocDsaAddrTask succ, sqe_type=3, pre_p=1, stream_id=0, task_id=2, task_type=29, dsa_sq_id=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.628 [stream.cc:1400] 618666 AddTaskToList: public task, stream_id=0, task_id=2, task_type=29 (ALLOC_DSA_ADDR), head=2, tail=3
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.641 [stream.cc:2595] 618666 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=2, type=29(ALLOC_DSA_ADDR), head=2, tail=3, sqe_num=1, lastTail=2, device_id=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.656 [npu_driver.cc:751] 618666 SqTaskSend: device_id=5, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.667 [stars_engine.cc:893] 618666 SendTask: Sq task send finished, device_id=5, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=2, task_type=29(ALLOC_DSA_ADDR).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.680 [stars_engine.cc:1122] 618666 SyncTask: Task Wait: device_id=5, stream_id=0, task_id=2, logicCqId=358.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.804 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=0, head=3.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.816 [stars_engine.cc:1071] 618666 IsSyncTaskFinish: Sync task finished, sqHead=3 finishedTaskId=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.827 [stars_engine.cc:1017] 618666 ProcReport: Get logic report: cnt=1, idx=0, stream_id=0, report task_id=2, sync task_id=2, sqeType=3, sqeHead=2, retCode=0, errType=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.842 [task.cc:185] 618666 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.853 [stars_engine.cc:1027] 618666 ProcReport: taskType=29.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.862 [task.cc:185] 618666 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.873 [task.cc:185] 618666 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.884 [logger.cc:152] 618666 TaskFinished: device_id=5, stream_id=0, task_id=2, task_type=29 (ALLOC_DSA_ADDR), task_finish_num=3
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.903 [npu_driver.cc:5618] 618666 GetSqEnable: deviceId=5, tsId=0, sqId=0, enable=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.914 [stream.cc:1494] 618666 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=2.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.547.924 [raw_device.cc:1232] 618666 TschStreamAllocDsaAddr: send alloc dsa sq task, stream_id=1, retCode:0
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:41.547.945 [atrace_api.c:40](tid:618666) AtraceCreate start.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:41.549.061 [trace_rb_log.c:45](tid:618666) init ring buffer time finished, realTime 1743643661547998556, monotonicTime 4163075864730, freq 99977 kHz, minutesWest 480 minutes
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:41.549.078 [trace_rb_log.c:137](tid:618666) [RUNTIME_ATRACE_DEV5_TS0] create ring buffer success, msgSize 128 bytes, msgTxtSize 112 bytes, bufferSize 1024 bytes, msg space 128 bytes, total space 131568 bytes
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:41.549.093 [tracer_mgr_operate.c:66](tid:618666) create object RUNTIME_ATRACE_DEV5_TS0 success, exitSave(false), noLock(false).
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:41.549.105 [atrace_api.c:44](tid:618666) AtraceCreate end.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:41.549.138 [trace_event.c:70](tid:618666) limitedNum 1, processType 0 
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:41.549.150 [trace_event.c:372](tid:618666) set trace event attr limitedNum: 1, processType: 0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.549.165 [runtime.cc:3159] 618666 SetTsdProfCallback: set tsd prof callback
[INFO] TDT(618666,python3.9):2025-04-03-09:27:41.549.177 [client_manager.cpp:196][SetProfilingCallback][tid:618666] [TsdClient] set profiling callback success
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.549.201 [runtime.cc:3364] 618666 PrimaryContextRetain: new Context ok, Runtime_alloc_size 424
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.549.222 [context.cc:109] 618666 Init: ObjAllocator alloc success, Runtime_alloc_size 160000(bytes)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.549.284 [context.cc:121] 618666 Init: ObjAllocator alloc success, Runtime_alloc_size 960000(bytes)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.549.296 [context.cc:276] 618666 Init: Runtime_alloc_size is 16000.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.549.322 [raw_device.cc:803] 618666 UpdateTimeoutConfig: No need to update timeout config.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:41.549.335 [npu_driver_dcache_lock.cpp:39] 618666 AllocAddrForDcache: halMemCtl failed, drvRet=65534, outSize=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.549.441 [raw_device.cc:528] 618666 AllocStackPhyBase: AllocStackPhyBase device_id=5, stackPhyBase32k_=0x12c140000000, stackPhySize=2457600.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.549.488 [raw_device.cc:232] 618666 LaunchDcacheLockOp: dcache lock has been set or stack addr is not for dcache, dCacheLockFlag_=0, stackAddrIsDcache_=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.549.507 [runtime.cc:3393] 618666 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.549.520 [runtime.cc:3560] 618666 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.549.535 [api_impl.cc:2987] 618666 NewDevice: SetCurRef = 0xaaaaf6e2dcc0,userDeviceId=5,deviceId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.549.548 [runtime.cc:5239] 618666 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.549.561 [api_impl.cc:2992] 618666 NewDevice: New device success, user_device_id=5, die_num=1.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:41.549.579 [awatchdog_core.c:175](tid:618666) create watchdog for id : 65543, tid : 618666, timeout : 300s
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.549.592 [api_impl.cc:3025] 618666 SetDevice: SetDevice success, curCtx=0xaaaaf6e2dcc0, user_device_id=5.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.549.609 [acl.cpp:115]618666 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.549.622 [acl.cpp:121]618666 GetSocVersion: socVersion is Ascend910B3
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.551.843 [api_impl.cc:3476] 618666 GetDeviceInfo: get device info, deviceId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.551.874 [api_impl.cc:3476] 618666 GetDeviceInfo: get device info, deviceId=5
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.551.916 [device.cpp:133]618666 UpdatePlatformInfoWithDevice: Successfully to UpdatePlatformInfoWithDevice, deviceId = 5, aicCnt = 20, vecCoreCnt = 40, cubeCoreCnt = 20
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.551.934 [device.cpp:154]618666 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 5
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.551.949 [context.cpp:87]618666 aclrtGetCurrentContext: start to execute aclrtGetCurrentContext
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.551.970 [context.cpp:98]618666 aclrtGetCurrentContext: successfully execute aclrtGetCurrentContext
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.551.990 [stream.cpp:48]618666 aclrtCreateStreamWithConfig: start to execute aclrtCreateStreamWithConfig with priority:0, flag:3
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.552.023 [api_impl.cc:1120] 618666 StreamCreate: priority=0, flags=1536.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.552.073 [npu_driver.cc:404] 618666 StreamIdAlloc: stream id alloc begin, device_id=5, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.552.111 [stream.cc:2246] 618666 AllocExecutedTimesSvm: stream_id=2.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.552.143 [stream_sqcq_manage.cc:147] 618666 Alloc: deviceId=5, tsId=0, drvFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.552.177 [npu_driver.cc:882] 618666 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.552.458 [npu_driver.cc:6125] 618666 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.552.507 [npu_driver.cc:6137] 618666 LogicCqAllocateV2: success: deviceId=5, tsId=0, cqId=359, streamId=2, logicCq=359, cqeDepth=4096
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.552.526 [npu_driver.cc:6189] 618666 StreamBindLogicCq: success: deviceId=5, tsId=0, streamId=2, logicCq=359.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.552.540 [npu_driver.cc:5916] 618666 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=e061e000, addr=dfffe061e000size=4096
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.552.553 [stream.cc:653] 618666 Setup: Success to get sq=2 sq reg virtual addr length=4096.
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.552.597 [devmm_svm.c:1972][ascend][curpid:618666,618666][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.552.613 [npu_driver.cc:6080] 618666 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.552.765 [stream.cc:291] 618666 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=2, flags_=0x600.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.553.691 [stream.cc:688] 618666 Setup: stream setup end, stream_id=2, IsTaskSink=0, sqId=2, cqId=2, deviceId=5, streamResId=65535
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:41.553.711 [stream_state_callback_manager.cc:45] 618666 Notify: not reg stream state callback func!
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.553.724 [api_impl.cc:1162] 618666 StreamCreate: Succ, flags=1536, stream_id=2, context=aaaaf6e2dcc0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.553.745 [stream.cpp:189]618666 aclrtSetStreamFailureMode: start to execute aclrtSetStreamFailureMode, mode is 1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.553.764 [stream.cc:3161] 618666 SetFailMode: stream_id=2 is updated from CONTINUE to STOP.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.553.775 [stream.cpp:195]618666 aclrtSetStreamFailureMode: successfully execute aclrtSetStreamFailureMode, mode is 1
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.553.817 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:105] RegCallback] Register callback thread, stream : 0xaaaaf7e7d290.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.553.844 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:377] CreateDefaultStream] Create ascend default stream, stream id: 0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.553.855 [stream.cpp:48]618666 aclrtCreateStreamWithConfig: start to execute aclrtCreateStreamWithConfig with priority:0, flag:3
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.553.871 [api_impl.cc:1120] 618666 StreamCreate: priority=0, flags=1536.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.553.899 [npu_driver.cc:404] 618666 StreamIdAlloc: stream id alloc begin, device_id=5, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.553.928 [stream.cc:2246] 618666 AllocExecutedTimesSvm: stream_id=3.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.553.962 [stream_sqcq_manage.cc:147] 618666 Alloc: deviceId=5, tsId=0, drvFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.553.975 [npu_driver.cc:882] 618666 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.554.204 [npu_driver.cc:6125] 618666 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.554.246 [npu_driver.cc:6137] 618666 LogicCqAllocateV2: success: deviceId=5, tsId=0, cqId=360, streamId=3, logicCq=360, cqeDepth=4096
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.554.264 [npu_driver.cc:6189] 618666 StreamBindLogicCq: success: deviceId=5, tsId=0, streamId=3, logicCq=360.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.554.279 [npu_driver.cc:5916] 618666 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=e05fd000, addr=dfffe05fd000size=4096
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.554.291 [stream.cc:653] 618666 Setup: Success to get sq=3 sq reg virtual addr length=4096.
[INFO] DRV(618666,python3.9):2025-04-03-09:27:41.554.333 [devmm_svm.c:1972][ascend][curpid:618666,618666][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.554.348 [npu_driver.cc:6080] 618666 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.554.632 [stream.cc:291] 618666 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=3, flags_=0x600.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.555.237 [stream.cc:688] 618666 Setup: stream setup end, stream_id=3, IsTaskSink=0, sqId=3, cqId=3, deviceId=5, streamResId=0
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:41.555.253 [stream_state_callback_manager.cc:45] 618666 Notify: not reg stream state callback func!
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.555.264 [api_impl.cc:1162] 618666 StreamCreate: Succ, flags=1536, stream_id=3, context=aaaaf6e2dcc0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.555.278 [stream.cpp:189]618666 aclrtSetStreamFailureMode: start to execute aclrtSetStreamFailureMode, mode is 1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.555.295 [stream.cc:3161] 618666 SetFailMode: stream_id=3 is updated from CONTINUE to STOP.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.555.306 [stream.cpp:195]618666 aclrtSetStreamFailureMode: successfully execute aclrtSetStreamFailureMode, mode is 1
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.555.340 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:105] RegCallback] Register callback thread, stream : 0xaaaaf7fac160.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.555.437 [callback.cpp:25]618666 aclrtSubscribeReport: start to execute aclrtSubscribeReport, threadId is 281471193247648.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.555.459 [npu_driver.cc:462] 618666 EventIdAlloc: event id alloc begin, device_id=5, ts_id=0, remote_event_id=0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.555.475 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:41.555.514 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.555.517 [npu_driver.cc:483] 618666 EventIdAlloc: Event id alloc success, device_id=5, ts_id=0, event_id=0, eventFlag=0
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:41.555.530 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.555.533 [event.cc:347] 618666 GenEventId: Event id alloc success, device_id=5, tsId=0, eventFlag=1, event_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.555.549 [subscribe.cc:54] 618666 AssignGroupId: give groupId=64
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.555.561 [npu_driver.cc:3775] 618666 SqCqAllocate: deviceId=5, tsId=0, groupId=64.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.555.580 [npu_driver.cc:3785] 618666 SqCqAllocate: alloc success, deviceId=5 sqId=118, cqId=118.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.555.591 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.555.600 [subscribe.cc:131] 618666 Insert: callback subscribe: groupId=64, threadId=281471193247648, devId=5, tsId=0, streamId=2, sqId=118, cqId=118
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.555.614 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.555.615 [callback.cpp:31]618666 aclrtSubscribeReport: successfully execute aclrtSubscribeReport, threadId is 281471193247648.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.555.635 [npu_driver.cc:3828] 618808 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=64.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.555.647 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:125] RegCallback] Register callback thread success, stream : 0xaaaaf7e7d290.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.555.714 [callback.cpp:25]618666 aclrtSubscribeReport: start to execute aclrtSubscribeReport, threadId is 281471184793504.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.555.732 [npu_driver.cc:462] 618666 EventIdAlloc: event id alloc begin, device_id=5, ts_id=0, remote_event_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.555.749 [npu_driver.cc:483] 618666 EventIdAlloc: Event id alloc success, device_id=5, ts_id=0, event_id=1, eventFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.555.761 [event.cc:347] 618666 GenEventId: Event id alloc success, device_id=5, tsId=0, eventFlag=1, event_id=1
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.555.753 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.555.774 [subscribe.cc:54] 618666 AssignGroupId: give groupId=65
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.555.785 [npu_driver.cc:3775] 618666 SqCqAllocate: deviceId=5, tsId=0, groupId=65.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.555.800 [npu_driver.cc:3785] 618666 SqCqAllocate: alloc success, deviceId=5 sqId=119, cqId=119.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.555.812 [subscribe.cc:131] 618666 Insert: callback subscribe: groupId=65, threadId=281471184793504, devId=5, tsId=0, streamId=3, sqId=119, cqId=119
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.555.828 [callback.cpp:31]618666 aclrtSubscribeReport: successfully execute aclrtSubscribeReport, threadId is 281471184793504.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.555.836 [npu_driver.cc:3828] 618809 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=65.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.555.852 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:125] RegCallback] Register callback thread success, stream : 0xaaaaf7fac160.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.555.871 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:386] CreateDefaultStream] Create ascend communication stream, stream id: 1
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.555.918 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:110] Initialize] Config huge_page_reserve_size : 0, device_hbm_huge_page_reserved_size_ : 0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.556.240 [npu_driver.cc:2616] 618666 MemGetInfoEx: memory info type=1, type=2, free=8863141888, hug_free=56245616640
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.556.278 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:60] AscendVmmAdapter] VMM align size is 2097152
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.556.346 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:158] CheckVmmDriverVersion] Driver path is /usr/local/Ascend
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.556.399 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:187] CheckVmmDriverVersion] Driver version is 25.0.rc1.b070, major version is 25
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.556.423 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:113] IsVmmEnabled] VMM is enabled.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.556.441 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:180] Initialize] Device MOC Size:62420M, Device free MOC Size:62092M, Reserved MOC size for Other Components(HCCL/rts/etc.):3892M, Recommend Reserved MOC size for Other Components:3880M, User define MindSpore MOC Size:0G, MindSpore Used MOC Size:58200M.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.556.461 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_dynamic_mem_adapter.cc:57] Initialize] Ascend Memory Adapter initialize success, Memory Statistics:
Device MOC memory size: 62420M
MindSpore Used memory size: 58200M
Used peak memory usage (without fragments): 0M
Actual peak memory usage (with fragments): 0M

[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.556.482 [event.cpp:260]618666 aclrtSetOpWaitTimeout: start to execute aclrtSetOpWaitTimeout, timeout = 1980s
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.556.503 [api_impl.cc:5713] 618666 SetOpWaitTimeOut: set OP wait timeout:1980.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.576 [engine.cc:188] 618666 SubmitTaskNormal: stream_id=0,task_id=3,task_type=86 (TASK_TIMEOUT_SET).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.593 [timeout_set_task.cc:115] 618666 ConstructSqeForTimeoutSetTask: TaskTimeoutSetTask ConstructSqe finish,topic_type=0,cmd_type=13
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.606 [stream.cc:1400] 618666 AddTaskToList: public task, stream_id=0, task_id=3, task_type=86 (TASK_TIMEOUT_SET), head=3, tail=4
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.618 [stream.cc:2595] 618666 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=3, type=86(TASK_TIMEOUT_SET), head=3, tail=4, sqe_num=1, lastTail=3, device_id=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.635 [npu_driver.cc:751] 618666 SqTaskSend: device_id=5, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.646 [stars_engine.cc:893] 618666 SendTask: Sq task send finished, device_id=5, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=3, task_type=86(TASK_TIMEOUT_SET).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.660 [stream.cc:1494] 618666 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=3.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.672 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=0, head=3.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.699 [stars_engine.cc:622] 618666 ProcLogicCqUntilEmpty: Task Wait: stream_id=0, logicCqId=358, retCode=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.712 [stream.cc:2886] 618666 StarsWaitForTask: No.0 stream_id=0, taskId=3, currentId=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.725 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=0, head=3.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.736 [stream.cc:2886] 618666 StarsWaitForTask: No.1 stream_id=0, taskId=3, currentId=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.748 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.760 [task.cc:185] 618666 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.772 [task.cc:185] 618666 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.784 [logger.cc:152] 618666 TaskFinished: device_id=5, stream_id=0, task_id=3, task_type=86 (TASK_TIMEOUT_SET), task_finish_num=4
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.807 [stars_engine.cc:437] 618666 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=3, sqHead=4, endTaskId=3, recycleTaskId=3.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.821 [stream.cc:2886] 618666 StarsWaitForTask: No.2 stream_id=0, taskId=3, currentId=3
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.557.833 [event.cpp:262]618666 aclrtSetOpWaitTimeout: successfully execute aclrtSetOpWaitTimeout, timeout = 1980s
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.557.847 [event.cpp:269]618666 aclrtSetOpExecuteTimeOut: start to execute aclrtSetOpExecuteTimeOut, timeout = 900s
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.864 [engine.cc:188] 618666 SubmitTaskNormal: stream_id=0,task_id=4,task_type=86 (TASK_TIMEOUT_SET).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.877 [timeout_set_task.cc:115] 618666 ConstructSqeForTimeoutSetTask: TaskTimeoutSetTask ConstructSqe finish,topic_type=0,cmd_type=13
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.889 [stream.cc:1400] 618666 AddTaskToList: public task, stream_id=0, task_id=4, task_type=86 (TASK_TIMEOUT_SET), head=4, tail=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.901 [stream.cc:2595] 618666 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=4, type=86(TASK_TIMEOUT_SET), head=4, tail=5, sqe_num=1, lastTail=4, device_id=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.915 [npu_driver.cc:751] 618666 SqTaskSend: device_id=5, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.927 [stars_engine.cc:893] 618666 SendTask: Sq task send finished, device_id=5, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=4, task_type=86(TASK_TIMEOUT_SET).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.940 [stream.cc:1494] 618666 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=4.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.950 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.962 [stream.cc:2886] 618666 StarsWaitForTask: No.0 stream_id=0, taskId=4, currentId=3
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.974 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.985 [stream.cc:2886] 618666 StarsWaitForTask: No.1 stream_id=0, taskId=4, currentId=3
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.557.996 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.558.007 [stream.cc:2886] 618666 StarsWaitForTask: No.2 stream_id=0, taskId=4, currentId=3
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.558.017 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=0, head=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.558.027 [task.cc:185] 618666 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.558.038 [task.cc:185] 618666 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.558.048 [logger.cc:152] 618666 TaskFinished: device_id=5, stream_id=0, task_id=4, task_type=86 (TASK_TIMEOUT_SET), task_finish_num=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.558.062 [stars_engine.cc:437] 618666 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=4, sqHead=5, endTaskId=4, recycleTaskId=4.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.558.074 [stream.cc:2886] 618666 StarsWaitForTask: No.3 stream_id=0, taskId=4, currentId=4
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.558.088 [event.cpp:277]618666 aclrtSetOpExecuteTimeOut: successfully execute aclrtSetOpExecuteTimeOut, timeout = 900s
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.558.113 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:285] Init] End inititializing kernel runtime.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.558.149 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:48] InitDevice] Enter SetRtDevice, current initialize device number:1
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.558.166 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:50] InitDevice] Device 5 has been set
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.558.180 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:381] CreateDefaultStream] The default compute stream is already created, skip.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.558.194 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:390] CreateDefaultStream] The default communication stream is already created, skip.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.558.217 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_pool.cc:165] DefaultEnhancedAscendMemoryPool] DefaultEnhancedAscendMemoryPool constructed.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.558.238 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:397] Initialize] Skip initialization of memory pool since init size is not configured.
[INFO] UTILS(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:41.558.271 [mindspore/ccsrc/utils/offload_context.cc:86] enable_aio] On ascend devices, enable aio and enable pinned mem cannot be turned on at the same time.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.558.370 [context.cpp:72]618666 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.558.389 [api_impl.cc:3717] 618666 ContextSetCurrent: set context=aaaaf6e2dcc0, flag=0.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.558.404 [context.cpp:80]618666 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.558.421 [context.cpp:72]618666 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.558.435 [api_impl.cc:3717] 618666 ContextSetCurrent: set context=aaaaf6e2dcc0, flag=0.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.558.447 [context.cpp:80]618666 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.558.601 [acl.cpp:288]618666 aclInit: start to execute aclInit
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.558.624 [acl.cpp:298]618666 aclInit: call ErrorManager.Initialize
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.558.713 [acl.cpp:242]618666 HandleErrorManagerConfig: err_msg mode is set ["1"].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.567.493 [error_manager.cc:673]618666 ParseJsonFile:Parse json file:/usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/../conf/error_manager/error_code.json success
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.568.253 [acl.cpp:315]618666 aclInit: call ge interface executor.Initialize
[INFO] PROFILING(618666,python3.9):2025-04-03-09:27:41.568.305 [prof_atls_plugin.cpp:210] (tid:618666) Module[45] register callback of ctrl handle.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.568.326 [ge_executor.cc:273]618666 Initialize:Init GeExecutor begin.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.568.381 [op_lib_register.cc:117]618666 GetAllCustomOpApiSoPaths:value of env ASCEND_CUSTOM_OPP_PATH is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/ho
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.568.461 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.568.495 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.568.524 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.568.553 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.568.580 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.568.607 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.568.634 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.568.661 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.568.687 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.568.714 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.568.740 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.568.766 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.568.793 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.568.824 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.568.851 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.568.877 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.568.903 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.568.930 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.568.956 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.568.982 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.569.011 [op_lib_register.cc:165]618666 CallInitFunc:CallInitFunc 0 successfully, op_lib_paths_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/je
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.569.034 [plugin_manager.cc:616]618666 GetOpTilingForwardOrderPath:Enter GetOpTilingPath schedule
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.569.045 [plugin_manager.cc:108]618666 GetOppPath:Enter get opp path schedule
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.569.072 [plugin_manager.cc:117]618666 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.569.091 [plugin_manager.cc:624]618666 GetOpTilingForwardOrderPath:Opp plugin path structure is new version!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.569.104 [plugin_manager.cc:206]618666 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.569.593 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.569.634 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.569.648 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.569.661 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.569.703 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.570.007 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.570.037 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.570.050 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.570.063 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.570.097 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.570.132 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.570.145 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.570.157 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.570.170 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.570.185 [plugin_manager.cc:215]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.570.500 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.570.530 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.570.543 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.570.556 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.570.590 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.570.897 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.570.926 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.570.939 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.570.952 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.570.985 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.571.017 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.571.030 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.571.042 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.571.053 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.571.065 [plugin_manager.cc:215]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.571.363 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.571.392 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.571.405 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.571.417 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.571.458 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.571.758 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.571.788 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.571.800 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.571.813 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.571.846 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.571.878 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.571.891 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.571.903 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.571.916 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.571.930 [plugin_manager.cc:215]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.572.243 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.572.275 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.572.288 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.572.301 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.572.334 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.572.632 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.572.661 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.572.681 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.572.693 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.572.726 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.572.758 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.572.771 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.572.783 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.572.796 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.572.808 [plugin_manager.cc:215]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.573.107 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.573.136 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.573.149 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.573.161 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.573.194 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.573.490 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.573.519 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.573.532 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.573.544 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.573.576 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.573.616 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.573.629 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.573.641 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.573.653 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.573.667 [plugin_manager.cc:215]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.573.678 [plugin_manager.cc:218]618666 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-pack
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.573.696 [plugin_manager.cc:422]618666 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.573.708 [plugin_manager.cc:155]618666 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.573.728 [plugin_manager.cc:158]618666 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.573.739 [plugin_manager.cc:426]618666 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.574.038 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.574.067 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.574.080 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.574.092 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.574.126 [plugin_manager.cc:439]618666 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.574.151 [plugin_manager.cc:175]618666 ReversePathString:Enter ReversePathString schedule
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.574.171 [plugin_manager.cc:187]618666 ReversePathString:path_str is '/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/:/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.574.456 [plugin_manager.cc:996]618666 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.574.483 [plugin_manager.cc:1011]618666 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.574.501 [plugin_manager.cc:1015]618666 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.574.542 [op_tiling_manager.cc:58]618666 LoadSo:[FindSo][Check] Get path with op_master [/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_master/] failed
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.589.160 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618662] [ServerToClientMsgProc] [sessionID=1]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.589.185 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618662] [TsdClient] DeviceMsgProc recvMsg realDeviceId[4] msgType[8] localDevId[4] rspCode[0]heterogeneousSubPid[0], tsdSupportLevel_[63]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.589.200 [hdc_client.cpp:172][TsdRecvData][tid:618662] [deviceId=4] the Tsd recv data already
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.589.234 [devmm_svm.c:132][ascend][curpid:618662,618662][drv][devmm][devmm_setup_device]DrvMemDeviceOpen. (devid=4)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.591.382 [devmm_virt_interface.c:450][ascend][curpid:618662,618662][drv][devmm][devmm_ioctl_init_process]Init_process details. (hostpid=618662)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.591.693 [drv_log_user.c:623][ascend][curpid:618662,618662][drv][devmm][share_log_read_in_single_module]Setup device succeeded. (logical_devid=4; devid=4; vfid=0; hostpid=618662; devpid=29654)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.591.719 [devmm_svm.c:122][ascend][curpid:618662,618662][drv][devmm][devmm_set_device_info]Device info. (devid=4; dvpp_size=17179869184; support_bar_mem=1; support_dev_read_only=1; support_dev_mem_map_host=1; support_bar_huge_mem=1; is_alloced_by_malloc=0; host_rw_dev_ro=1; double_pgtable_offset=17592186044416; is_support_host_pin_pre_register=0; is_support_host_mem_pool=0)
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.592.111 [stub_process_mode_nowin.cpp:60][ProcessQueueForMdc][tid:618662] [TsdClient] it is unnecessary of current mode[0] to grant queue auth to aicpusd
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.592.134 [stub_process_mode_nowin.cpp:99][OpenInHost][tid:618662] enter into OpenInHost deviceid[4]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.592.715 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618674] [ServerToClientMsgProc] [sessionID=1]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.592.736 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618674] [TsdClient] DeviceMsgProc recvMsg realDeviceId[7] msgType[8] localDevId[7] rspCode[0]heterogeneousSubPid[0], tsdSupportLevel_[63]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.592.754 [hdc_client.cpp:172][TsdRecvData][tid:618674] [deviceId=7] the Tsd recv data already
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.592.762 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DefaultImpl] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.592.777 [devmm_svm.c:132][ascend][curpid:618674,618674][drv][devmm][devmm_setup_device]DrvMemDeviceOpen. (devid=7)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.593.389 [op_tiling_registry.cc:162]618666 OpTilingFuncRegistry:Register op tiling and parse function V4 for op_type:Aipp
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.593.510 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:AvgPool1DD
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.593.611 [op_tiling_registry.cc:162]618666 OpTilingFuncRegistry:Register op tiling and parse function V4 for op_type:AutoTiling
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.593.717 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Bias
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.593.819 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:INTrainingUpdateV2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.593.918 [op_tiling_registry.cc:134]618666 OpTilingFuncRegistry:Register op tiling function V2 for op_type:CheckValid
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.594.031 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ConcatD
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.594.047 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ConcatV2D
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.594.073 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Pack
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.594.169 [op_tiling_registry.cc:134]618666 OpTilingFuncRegistry:Register op tiling function V2 for op_type:ConcatOffset
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.594.266 [op_tiling_registry.cc:134]618666 OpTilingFuncRegistry:Register op tiling function V2 for op_type:Diag
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.594.360 [op_tiling_registry.cc:134]618666 OpTilingFuncRegistry:Register op tiling function V2 for op_type:DiagPart
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.594.458 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:DynSeqOuter
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.594.558 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Expand
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.594.761 [devmm_virt_interface.c:450][ascend][curpid:618674,618674][drv][devmm][devmm_ioctl_init_process]Init_process details. (hostpid=618674)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.594.900 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Ger
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.594.993 [op_tiling_registry.cc:122]618666 OpTilingFuncRegistry:Register op tiling function V1 for op_type:IFMR
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.595.061 [drv_log_user.c:623][ascend][curpid:618674,618674][drv][devmm][share_log_read_in_single_module]Setup device succeeded. (logical_devid=7; devid=7; vfid=0; hostpid=618674; devpid=29919)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.595.102 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:InTopKD
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.595.087 [devmm_svm.c:122][ascend][curpid:618674,618674][drv][devmm][devmm_set_device_info]Device info. (devid=7; dvpp_size=17179869184; support_bar_mem=1; support_dev_read_only=1; support_dev_mem_map_host=1; support_bar_huge_mem=1; is_alloced_by_malloc=0; host_rw_dev_ro=1; double_pgtable_offset=17592186044416; is_support_host_pin_pre_register=0; is_support_host_mem_pool=0)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.595.211 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:KlDivLossGrad
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.595.317 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:L1LossGrad
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.595.367 [stub_process_mode_nowin.cpp:60][ProcessQueueForMdc][tid:618674] [TsdClient] it is unnecessary of current mode[0] to grant queue auth to aicpusd
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.595.389 [stub_process_mode_nowin.cpp:99][OpenInHost][tid:618674] enter into OpenInHost deviceid[7]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.595.421 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNorm
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.595.416 [client_manager.cpp:435][IsHostEnvironment][tid:618674] [TsdClient] logicDeviceId is [7], hostaicpunum[0]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.595.432 [stub_process_mode_nowin.cpp:103][OpenInHost][tid:618674] host cpu not support
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.595.446 [process_mode_manager.cpp:121][OpenProcess][tid:618674] [TsdClient][deviceId=7] [sessionId=1] start hccp and computer process success
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.595.462 [runtime.cc:2879] 618674 startAicpuExecutor: userDeviceId=7, devId=7, tsdOpen ret=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.595.476 [runtime.cc:2891] 618674 startAicpuExecutor: TsdOpen success, devId=7, ret=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.595.497 [runtime.cc:3627] 618674 DeviceRetain: new dev ok id=7, rawDevSize=1328 (bytes), ts_id=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.595.514 [raw_device.cc:936] 618674 DevSetTsId: DevSetTsId, tsId=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.595.529 [npu_driver.cc:2968] 618674 DeviceOpen: Open device start, device_id=7, tsId=0.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.595.536 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNormBetaGammaBackpropV2
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.595.616 [trs_sqcq.c:458][ascend][curpid:618674,618674][drv][tsdrv][trsDevSqCqInit]Sqcq init. (devid=7)
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.595.674 [client_manager.cpp:435][IsHostEnvironment][tid:618662] [TsdClient] logicDeviceId is [4], hostaicpunum[0]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.595.702 [stub_process_mode_nowin.cpp:103][OpenInHost][tid:618662] host cpu not support
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.595.729 [process_mode_manager.cpp:121][OpenProcess][tid:618662] [TsdClient][deviceId=4] [sessionId=1] start hccp and computer process success
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.595.750 [runtime.cc:2879] 618662 startAicpuExecutor: userDeviceId=4, devId=4, tsdOpen ret=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.595.733 [op_tiling_registry.cc:122]618666 OpTilingFuncRegistry:Register op tiling function V1 for op_type:LayerNormXBackprop
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.595.765 [runtime.cc:2891] 618662 startAicpuExecutor: TsdOpen success, devId=4, ret=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.595.791 [runtime.cc:3627] 618662 DeviceRetain: new dev ok id=4, rawDevSize=1328 (bytes), ts_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.595.805 [raw_device.cc:936] 618662 DevSetTsId: DevSetTsId, tsId=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.595.842 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNormXBackpropV2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.595.823 [npu_driver.cc:2968] 618662 DeviceOpen: Open device start, device_id=4, tsId=0.
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.595.909 [trs_sqcq.c:458][ascend][curpid:618662,618662][drv][tsdrv][trsDevSqCqInit]Sqcq init. (devid=4)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.595.957 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNormXBackpropV3
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.596.061 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LpNormReduce
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.596.077 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LpNormReduceV2
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.596.099 [trs_sqcq.c:394][ascend][curpid:618674,618674][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=7; tsId=0; id_type=6; num=2044)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.596.196 [op_tiling_registry.cc:134]618666 OpTilingFuncRegistry:Register op tiling function V2 for op_type:LRUCacheV2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.596.311 [op_tiling_registry.cc:134]618666 OpTilingFuncRegistry:Register op tiling function V2 for op_type:MaxPoolGradWithArgmaxV2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.596.326 [op_tiling_registry.cc:134]618666 OpTilingFuncRegistry:Register op tiling function V2 for op_type:MaxPoolGradWithArgmaxV1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.596.423 [op_tiling_registry.cc:122]618666 OpTilingFuncRegistry:Register op tiling function V1 for op_type:MaxPoolWithArgmaxV2
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.596.429 [trs_sqcq.c:394][ascend][curpid:618662,618662][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=4; tsId=0; id_type=6; num=2044)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.596.527 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:MovingSumWithSigmoid
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.596.586 [trs_sqcq.c:394][ascend][curpid:618674,618674][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=7; tsId=0; id_type=7; num=2044)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.596.639 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:MseLossGrad
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.596.832 [trs_sqcq.c:394][ascend][curpid:618674,618674][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=7; tsId=0; id_type=10; num=1024)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.596.855 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:NMSWithMask
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.596.907 [trs_sqcq.c:394][ascend][curpid:618662,618662][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=4; tsId=0; id_type=7; num=2044)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.597.038 [op_tiling_registry.cc:122]618666 OpTilingFuncRegistry:Register op tiling function V1 for op_type:PadD
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.597.092 [trs_sqcq.c:394][ascend][curpid:618674,618674][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=7; tsId=0; id_type=11; num=1024)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.597.143 [op_tiling_registry.cc:122]618666 OpTilingFuncRegistry:Register op tiling function V1 for op_type:PadV3Grad
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.597.167 [trs_sqcq.c:394][ascend][curpid:618662,618662][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=4; tsId=0; id_type=10; num=1024)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.597.251 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ReduceStdWithMean
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.597.361 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Resize
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.597.416 [trs_sqcq.c:394][ascend][curpid:618662,618662][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=4; tsId=0; id_type=11; num=1024)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.597.563 [trs_sqcq.c:394][ascend][curpid:618674,618674][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=7; tsId=0; id_type=12; num=2048)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.597.588 [trs_sqcq.c:394][ascend][curpid:618674,618674][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=7; tsId=0; id_type=8; num=16)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.597.610 [trs_sqcq.c:394][ascend][curpid:618674,618674][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=7; tsId=0; id_type=9; num=16)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.597.630 [trs_sqcq.c:394][ascend][curpid:618674,618674][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=7; tsId=0; id_type=13; num=4)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.597.650 [trs_sqcq.c:394][ascend][curpid:618674,618674][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=7; tsId=0; id_type=14; num=10)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.597.815 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ResizeBilinearV2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.597.936 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ReverseV2
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.597.930 [trs_sqcq.c:394][ascend][curpid:618662,618662][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=4; tsId=0; id_type=12; num=2048)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.597.959 [trs_sqcq.c:394][ascend][curpid:618662,618662][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=4; tsId=0; id_type=8; num=16)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.597.983 [trs_sqcq.c:394][ascend][curpid:618662,618662][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=4; tsId=0; id_type=9; num=16)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.598.003 [trs_sqcq.c:394][ascend][curpid:618662,618662][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=4; tsId=0; id_type=13; num=4)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.598.023 [trs_sqcq.c:394][ascend][curpid:618662,618662][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=4; tsId=0; id_type=14; num=10)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.598.054 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Scale
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.598.244 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SigmoidFocalLoss
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.598.356 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SigmoidFocalLossGrad
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.598.482 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SignBitsPack
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.598.592 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SignBitsUnpack
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.598.694 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SmoothL1LossGradV2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.598.796 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SmoothL1LossV2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.598.896 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SoftMarginLossGrad
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.599.011 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SoftmaxFocalLossGrad
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.599.114 [op_tiling_registry.cc:134]618666 OpTilingFuncRegistry:Register op tiling function V2 for op_type:Sort
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.599.130 [op_tiling_registry.cc:134]618666 OpTilingFuncRegistry:Register op tiling function V2 for op_type:SortV2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.599.239 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SparseApplyFtrlD
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.599.347 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SparseReshape
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.599.453 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SplitV
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.599.468 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Split
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.599.565 [op_tiling_registry.cc:122]618666 OpTilingFuncRegistry:Register op tiling function V1 for op_type:SquareSumAll
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.599.673 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SyncBatchNormGatherStats
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.599.785 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Tile
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.599.886 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:TileD
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.599.904 [trs_dev_drv.c:302][ascend][curpid:618674,618674][drv][tsdrv][drvDeviceOpenComm]Open success. (devid=7; fd=36; mmapFd=37)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.599.929 [devmm_svm.c:132][ascend][curpid:618674,618674][drv][devmm][devmm_setup_device]DrvMemDeviceOpen. (devid=7)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.599.953 [devmm_svm.c:122][ascend][curpid:618674,618674][drv][devmm][devmm_set_device_info]Device info. (devid=7; dvpp_size=17179869184; support_bar_mem=1; support_dev_read_only=1; support_dev_mem_map_host=1; support_bar_huge_mem=1; is_alloced_by_malloc=0; host_rw_dev_ro=1; double_pgtable_offset=17592186044416; is_support_host_pin_pre_register=0; is_support_host_mem_pool=0)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.600.001 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:TileWithAxis
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.600.029 [npu_driver.cc:3011] 618674 DeviceOpen: Open device success, device_id=7, tsId=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.600.049 [raw_device.cc:292] 618674 Init: chipType:0x5
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.600.093 [raw_device.cc:304] 618674 Init: isAddrFlat:0
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.600.095 [trs_dev_drv.c:302][ascend][curpid:618662,618662][drv][tsdrv][drvDeviceOpenComm]Open success. (devid=4; fd=36; mmapFd=37)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.600.114 [raw_device.cc:320] 618674 Init: GetDevInfo, device_id=7, hardwareVersion=0x503
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.600.117 [devmm_svm.c:132][ascend][curpid:618662,618662][drv][devmm][devmm_setup_device]DrvMemDeviceOpen. (devid=4)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.600.132 [devmm_svm.c:1972][ascend][curpid:618674,618674][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0x1; out_feature=0x1)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.600.149 [npu_driver.cc:1578] 618674 SupportNumaTsMemCtrl: chip type=5, support flag=1
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.600.141 [devmm_svm.c:122][ascend][curpid:618662,618662][drv][devmm][devmm_set_device_info]Device info. (devid=4; dvpp_size=17179869184; support_bar_mem=1; support_dev_read_only=1; support_dev_mem_map_host=1; support_bar_huge_mem=1; is_alloced_by_malloc=0; host_rw_dev_ro=1; double_pgtable_offset=17592186044416; is_support_host_pin_pre_register=0; is_support_host_mem_pool=0)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.600.217 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Unpack
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.600.228 [npu_driver.cc:3011] 618662 DeviceOpen: Open device success, device_id=4, tsId=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.600.253 [raw_device.cc:292] 618662 Init: chipType:0x5
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.600.313 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [OpExecuteFunc]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.600.332 [raw_device.cc:304] 618662 Init: isAddrFlat:0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.600.353 [raw_device.cc:320] 618662 Init: GetDevInfo, device_id=4, hardwareVersion=0x503
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.600.371 [devmm_svm.c:1972][ascend][curpid:618662,618662][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0x1; out_feature=0x1)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.600.388 [npu_driver.cc:1578] 618662 SupportNumaTsMemCtrl: chip type=5, support flag=1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.600.410 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.600.492 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.600.568 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AscendAntiQuantV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.600.646 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.600.724 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.600.751 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.600.840 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Concat] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.600.864 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ConcatV2] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.600.887 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.600.908 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.601.037 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [OpExecuteFunc]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.601.081 [raw_device.cc:352] 618674 Init: Get phy info, phy chip id 7, phy die id 0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.601.105 [runtime.cc:2771] 618674 GetTsdQos: [TSD] start get qos, devId=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.601.118 [runtime.cc:5239] 618674 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.601.117 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [OpExecuteFunc]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.601.139 [tsd_client.cpp:189][TsdCapabilityGet][tid:618674] TsdCapabilityGet Begin.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.601.156 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618674] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.601.168 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618674] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.601.183 [process_mode_manager.cpp:1042][CapabilityGet][tid:618674] [ProcessModeManager] enter into CapabilityGet process deviceId[7] type[0]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.601.201 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.601.200 [process_mode_manager.cpp:386][InitTsdClient][tid:618674] [TsdClient] tsd client has been inited before
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.601.220 [version_verify.cpp:114][SpecialFeatureCheck][tid:618674] VersionVerify: previous type[38], supported
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.601.260 [process_mode_manager.cpp:1065][CapabilityGet][tid:618674] [TsdClient][deviceId=7] [sessionId=1] [type=0]send capability success 
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.601.280 [hdc_client.cpp:154][TsdRecvData][tid:618674] recv timeout is:150000 ms
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.601.285 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : [OpExecuteFunc]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.601.309 [raw_device.cc:352] 618662 Init: Get phy info, phy chip id 4, phy die id 0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.601.331 [runtime.cc:2771] 618662 GetTsdQos: [TSD] start get qos, devId=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.601.343 [runtime.cc:5239] 618662 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.601.357 [tsd_client.cpp:189][TsdCapabilityGet][tid:618662] TsdCapabilityGet Begin.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.601.372 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618662] [TsdClient] g_userDeviceInfo is empty.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.601.369 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [OpExecuteFunc]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.601.389 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618662] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.601.402 [process_mode_manager.cpp:1042][CapabilityGet][tid:618662] [ProcessModeManager] enter into CapabilityGet process deviceId[4] type[0]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.601.430 [process_mode_manager.cpp:386][InitTsdClient][tid:618662] [TsdClient] tsd client has been inited before
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.601.457 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [OpExecuteFunc]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.601.474 [version_verify.cpp:114][SpecialFeatureCheck][tid:618662] VersionVerify: previous type[38], supported
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.601.482 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [OpExecuteFunc]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.601.506 [process_mode_msg_parse.cpp:175][CapabilityResMsgProc][tid:618674] [CapabilityResMsgProc] [sessionID=1]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.601.509 [process_mode_manager.cpp:1065][CapabilityGet][tid:618662] [TsdClient][deviceId=4] [sessionId=1] [type=0]send capability success 
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.601.525 [hdc_client.cpp:154][TsdRecvData][tid:618662] recv timeout is:150000 ms
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.601.526 [process_mode_msg_parse.cpp:170][PidQosMsgProc][tid:618674] [TsdClient] PidQosMsgProc recvMsg realDeviceId[7] msgType[39] localDevId[7] rspCode[0],pidqos[1]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.601.544 [hdc_client.cpp:172][TsdRecvData][tid:618674] [deviceId=7] the Tsd recv data already
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.601.561 [process_mode_manager.cpp:1070][CapabilityGet][tid:618674] [TsdClient][logicDeviceId_=7][type=0][pidQos=1][ret=0]recv capability respond finish
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.601.568 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [OpExecuteFunc]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.601.578 [runtime.cc:2782] 618674 GetTsdQos: [TSD] get qos success, userDeviceId=7, devId=7, qos=1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.601.596 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [OpExecuteFunc]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.601.599 [engine.cc:78] 618674 Engine: Constructor.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.601.615 [stars_engine.cc:51] 618674 StarsEngine: Constructor.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.601.620 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [OpExecuteFunc]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.601.629 [engine_factory.cc:26] 618674 CreateEngine: new StarsEngine, Runtime_alloc_size 320
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.601.659 [engine_factory.cc:38] 618674 CreateEngine: Engine init success.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.601.672 [raw_device.cc:364] 618674 Init: new SpmPool ok, Runtime_alloc_size 56(bytes)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.601.686 [spm_pool.cc:42] 618674 Init: new buffer ok, Runtime_alloc_size 128
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.601.699 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.601.791 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [OpExecuteFunc]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.601.814 [buffer_allocator.cc:61] 618674 BufferAllocator: alloc success, Runtime_alloc_size 128(bytes)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.601.834 [spm_pool.cc:55] 618674 Init: new BufferAllocator ok, Runtime_alloc_size 152
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.601.847 [raw_device.cc:380] 618674 Init: new UmaArgLoader ok, Runtime_alloc_size 296(bytes)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.601.863 [devmm_svm.c:1972][ascend][curpid:618674,618674][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.601.880 [npu_driver.cc:6080] 618674 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.601.869 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [OpExecuteFunc]
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.601.895 [devmm_svm.c:1972][ascend][curpid:618674,618674][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.601.911 [npu_driver.cc:6080] 618674 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.601.947 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [OpExecuteFunc]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.602.008 [process_mode_msg_parse.cpp:175][CapabilityResMsgProc][tid:618662] [CapabilityResMsgProc] [sessionID=1]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.602.028 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [OpExecuteFunc]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.602.026 [process_mode_msg_parse.cpp:170][PidQosMsgProc][tid:618662] [TsdClient] PidQosMsgProc recvMsg realDeviceId[4] msgType[39] localDevId[4] rspCode[0],pidqos[1]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.602.047 [hdc_client.cpp:172][TsdRecvData][tid:618662] [deviceId=4] the Tsd recv data already
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.602.061 [process_mode_manager.cpp:1070][CapabilityGet][tid:618662] [TsdClient][logicDeviceId_=4][type=0][pidQos=1][ret=0]recv capability respond finish
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.602.078 [runtime.cc:2782] 618662 GetTsdQos: [TSD] get qos success, userDeviceId=4, devId=4, qos=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.602.095 [engine.cc:78] 618662 Engine: Constructor.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.602.110 [stars_engine.cc:51] 618662 StarsEngine: Constructor.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.602.106 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [OpExecuteFunc]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.602.124 [engine_factory.cc:26] 618662 CreateEngine: new StarsEngine, Runtime_alloc_size 320
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.602.149 [engine_factory.cc:38] 618662 CreateEngine: Engine init success.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.602.160 [raw_device.cc:364] 618662 Init: new SpmPool ok, Runtime_alloc_size 56(bytes)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.602.174 [spm_pool.cc:42] 618662 Init: new buffer ok, Runtime_alloc_size 128
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.602.196 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.602.278 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [OpExecuteFunc]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.602.289 [buffer_allocator.cc:61] 618662 BufferAllocator: alloc success, Runtime_alloc_size 128(bytes)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.602.307 [spm_pool.cc:55] 618662 Init: new BufferAllocator ok, Runtime_alloc_size 152
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.602.323 [raw_device.cc:380] 618662 Init: new UmaArgLoader ok, Runtime_alloc_size 296(bytes)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.602.338 [devmm_svm.c:1972][ascend][curpid:618662,618662][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.602.356 [npu_driver.cc:6080] 618662 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.602.356 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [OpExecuteFunc]
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.602.367 [devmm_svm.c:1972][ascend][curpid:618662,618662][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.602.385 [npu_driver.cc:6080] 618662 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.602.436 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.602.516 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.602.599 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.602.681 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.602.759 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.602.838 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.602.913 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.602.993 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : [OpExecuteFunc]
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:41.604.178 [trs_cb_event.c:119][ascend][curpid:618658,618774][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =64; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:41.604.185 [trs_cb_event.c:119][ascend][curpid:618658,618775][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =65; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:41.604.212 [trs_sqcq.c:1491][ascend][curpid:618658,618774][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:41.604.227 [trs_sqcq.c:1491][ascend][curpid:618658,618775][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:41.604.237 [npu_driver.cc:3833] 618774 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:41.604.246 [npu_driver.cc:3833] 618775 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:41.604.258 [api_impl.cc:5058] 618774 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:41.604.268 [api_impl.cc:5058] 618775 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:41.604.279 [callback.cpp:132]618774 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:41.604.290 [callback.cpp:132]618775 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:41.604.323 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:41.604.336 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:41.604.345 [npu_driver.cc:3828] 618774 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=64.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:41.604.357 [npu_driver.cc:3828] 618775 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=65.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.607.110 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:DepthToSpace
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.607.144 [op_tiling_registry.cc:148]618666 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SpaceToDepth
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.607.133 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:49] Start] The cpu collective rank 2 has been started successfully.
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.607.192 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:184] node_num] Number of role MS_WORKER is 8
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.607.254 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:81] Initialize] Query retry count is 400
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.607.278 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:89] Initialize] Interval of retry allgather hostname lower and upper are 1 and 2
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.607.313 [mindspore/ccsrc/distributed/collective/collective_manager.cc:597] InitHostCommlib] Communication library on host side is successfully initialized. Global rank id: 2, global rank size: 8
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.607.351 [mindspore/ccsrc/distributed/collective/collective_manager.cc:198] Initialize] [PROF]InitHostCommlib costs 3005.09 msec.
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.607.375 [mindspore/ccsrc/distributed/collective/collective_manager.cc:640] AssignLocalRank] Host name for rank 2 is devserver-c233-2
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.607.502 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:564] GetHostNames] Worker gets host names {"hostnames":["devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2"]}
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.607.576 [mindspore/ccsrc/distributed/collective/collective_manager.cc:661] AssignLocalRank] Successfully get all nodes' hostname.
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.607.604 [mindspore/ccsrc/distributed/collective/collective_manager.cc:678] AssignLocalRank] The local rank id assigned for this process is 2
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.607.624 [mindspore/ccsrc/distributed/collective/collective_manager.cc:679] AssignLocalRank] The env 'DEVICE_ID' assigned for this process is: 2
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.607.656 [mindspore/ccsrc/distributed/collective/collective_manager.cc:697] AssignLocalRank] The device_id of ms_context is set to local rank id [2].
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.607.682 [mindspore/ccsrc/distributed/collective/collective_manager.cc:206] Initialize] [PROF]AssignLocalRank costs 0.304 msec.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.607.769 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:236] Initialize] Start initializing device context.
[INFO] CORE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.607.817 [mindspore/core/utils/ms_context.cc:463] PrintJitLevelAndExecMode] The jit_level is: O0, and enable kernelbykernel executor in the PYNATIVE mode.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.607.843 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:250] Initialize] The current overflow detection mode is INFNAN.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.607.900 [device.cpp:365]618654 aclrtSetDeviceSatMode: start to execute aclrtSetDeviceSatMode, mode is 1
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:41.608.045 [api_impl.cc:249] 618654 CurrentContext: current ctx is nullptr!
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.608.067 [api_impl.cc:6795] 618654 SetDeviceSatMode: Set saturation mode to 1 for runtime process.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.608.080 [device.cpp:371]618654 aclrtSetDeviceSatMode: successfully execute aclrtSetDeviceSatMode, mode is 1
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.608.177 [callback.cpp:37]618654 aclrtSetExceptionInfoCallback: start to execute aclrtSetExceptionInfoCallback.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.608.228 [callback.cpp:44]618654 aclrtSetExceptionInfoCallback: successfully execute aclrtSetExceptionInfoCallback
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.608.259 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:235] Init] Start inititializing kernel runtime(SetDevice & CreateDefaultStream & MemoryManagerInitialization etc).
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.608.286 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:48] InitDevice] Enter SetRtDevice, current initialize device number:0
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.608.335 [device.cpp:143]618654 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.608.437 [npu_driver.cc:124] 618654 NpuDriver: Run mode=1 [0:offline, 1:online], env type=3
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.608.470 [api_impl.cc:2999] 618654 SetDevice: device_id=2, deviceMode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.608.514 [runtime.cc:3602] 618654 DeviceRetain: [dlog api] DlogReportStart exist.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.608.683 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.608.770 [hdc_core.c:1982][ascend][curpid:618654,618654][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4170; pid=618654)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.608.825 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.608.941 [runtime.cc:3609] 618654 DeviceRetain: [dlog api] AtraceReportStart exist.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.608.952 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [Tiling][TilingParse]
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:41.608.996 [atrace_client_communication.c:103](tid:618654) send [hello] msg.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:41.609.017 [atrace_client_communication.c:63](tid:618654) send msg by adx[begin], resultLen=1024 bytes.
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.609.135 [hdc_core.c:1982][ascend][curpid:618654,618654][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4171; pid=618654)
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:41.609.156 [hdc_api.cpp:671][tid:618654] connect succ, peer_node: 0, peer_devid: 2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.609.250 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.609.385 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.609.504 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DeformableOffsetsGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.609.517 [buffer_allocator.cc:61] 618674 BufferAllocator: alloc success, Runtime_alloc_size 32768(bytes)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.609.547 [task_allocator.cc:46] 618674 DefaultAlloc: Runtime_alloc_size 32768(bytes)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.609.582 [buffer_allocator.cc:61] 618674 BufferAllocator: alloc success, Runtime_alloc_size 104(bytes)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.609.599 [h2d_copy_mgr.cc:45] 618674 H2DCopyMgr: alloc h2d copy buff success, policy 2
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.609.615 [devmm_svm.c:1972][ascend][curpid:618674,618674][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.609.632 [npu_driver.cc:6080] 618674 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.609.622 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.609.777 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.609.895 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.609.992 [buffer_allocator.cc:61] 618662 BufferAllocator: alloc success, Runtime_alloc_size 32768(bytes)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.610.023 [task_allocator.cc:46] 618662 DefaultAlloc: Runtime_alloc_size 32768(bytes)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.610.058 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.610.061 [buffer_allocator.cc:61] 618662 BufferAllocator: alloc success, Runtime_alloc_size 104(bytes)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.610.079 [h2d_copy_mgr.cc:45] 618662 H2DCopyMgr: alloc h2d copy buff success, policy 2
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.610.094 [devmm_svm.c:1972][ascend][curpid:618662,618662][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.610.112 [npu_driver.cc:6080] 618662 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.610.212 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.610.333 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.610.453 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.610.496 [hdc_client.c:417][ascend][curpid:618654,618654][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4171)
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:41.610.534 [atrace_client_communication.c:65](tid:618654) send msg by adx[finish], ret=0.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:41.610.552 [atrace_client_communication.c:97](tid:618654) msgType=1, magic=49959, version=1.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:41.610.565 [atrace_client_communication.c:135](tid:618654) send [hello] msg success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.610.584 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachNonFiniteCheckAndUnscale] register OP_IMPL : [Tiling][TilingParse]
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:41.610.653 [atrace_client_core.c:160](tid:618654) start to receive device[2] trace log.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.610.711 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.610.713 [buffer_allocator.cc:61] 618674 BufferAllocator: alloc success, Runtime_alloc_size 262144(bytes)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.610.706 [runtime.cc:5239] 618654 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.610.737 [runtime.cc:2855] 618654 startAicpuExecutor: TsdOpen devId=2, device mode=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.610.735 [task_allocator.cc:46] 618674 DefaultAlloc: Runtime_alloc_size 4096(bytes)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.610.753 [runtime.cc:5239] 618654 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.610.753 [buffer_allocator.cc:61] 618674 BufferAllocator: alloc success, Runtime_alloc_size 128(bytes)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.610.768 [h2d_copy_mgr.cc:45] 618674 H2DCopyMgr: alloc h2d copy buff success, policy 2
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.610.782 [devmm_svm.c:1972][ascend][curpid:618674,618674][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.610.797 [npu_driver.cc:6080] 618674 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.610.785 [hdc_core.c:1982][ascend][curpid:618654,618811][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4172; pid=618654)
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.610.807 [client_manager.cpp:160][GetPlatformInfo][tid:618654] [TsdClient] mode[1] chipType[5]
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:41.610.817 [hdc_api.cpp:671][tid:618811] connect succ, peer_node: 0, peer_devid: 2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.610.834 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.610.861 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : [Tiling][TilingParse]
[WARNING] TDT(618654,python3.9):2025-04-03-09:27:41.610.851 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618654] Get env[ASCEND_RT_VISIBLE_DEVICES] failed
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.610.870 [client_manager.cpp:582][GetVisibleDevices][tid:618654] [TsdClient] Get env ASCEND_RT_VISIBLE_DEVICES [].
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.610.888 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618654] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.610.905 [client_manager.cpp:125][GetInstance][tid:618654] [ClientManager] GetInstance, deviceId[2], g_runningMode[0], begin saving instance
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.610.936 [client_manager.cpp:435][IsHostEnvironment][tid:618654] [TsdClient] logicDeviceId is [2], hostaicpunum[0]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.610.954 [client_manager.cpp:464][GetClientRunMode][tid:618654] runningMode:0
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.610.967 [client_manager.cpp:127][GetInstance][tid:618654] [ClientManager] Current mode:1
[WARNING] TDT(618654,python3.9):2025-04-03-09:27:41.610.992 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618654] Get env[AICPU_PROFILING_MODE] failed
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.611.009 [client_manager.cpp:347][GetProfilingMode][tid:618654] Get AICPU_PROFILING_MODE[]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.611.023 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GatherV3] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[WARNING] TDT(618654,python3.9):2025-04-03-09:27:41.611.040 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618654] Get env[ASCEND_MODULE_LOG_LEVEL] failed
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.611.058 [process_mode_base.cpp:149][GetLogLevel][tid:618654] [TsdClient] get ASCEND_GLOBAL_LOG_LEVEL [1] ASCEND_GLOBAL_EVENT_ENABLE [0] ASCEND_MODULE_LOG_LEVEL []
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:41.611.062 [atrace_client_communication.c:177](tid:618811) send [start] msg.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:41.611.109 [atrace_client_communication.c:189](tid:618811) send [start] msg success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.611.139 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.611.156 [process_mode_base.cpp:161][GetLogLevel][tid:618654] [TsdClient] Get Log Level[001]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.611.176 [process_mode_manager.cpp:71][OpenProcess][tid:618654] [ProcessModeManager] enter into open process deviceId[2] rankSize[0]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.611.195 [process_mode_manager.cpp:615][CheckNeedToOpen][tid:618654] [TsdClient] get open para startCp[1] startHccp[0] (0:false 1:true)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.611.221 [buffer_allocator.cc:61] 618662 BufferAllocator: alloc success, Runtime_alloc_size 262144(bytes)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.611.244 [task_allocator.cc:46] 618662 DefaultAlloc: Runtime_alloc_size 4096(bytes)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.611.262 [buffer_allocator.cc:61] 618662 BufferAllocator: alloc success, Runtime_alloc_size 128(bytes)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.611.278 [h2d_copy_mgr.cc:45] 618662 H2DCopyMgr: alloc h2d copy buff success, policy 2
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.611.270 [client_manager.cpp:261][CheckPackageExists][tid:618654] [TsdClient] check file[.], deviceId[2]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.611.283 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.611.292 [devmm_svm.c:1972][ascend][curpid:618662,618662][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.611.311 [npu_driver.cc:6080] 618662 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.611.347 [client_manager.cpp:261][CheckPackageExists][tid:618654] [TsdClient] check file[scene.info], deviceId[2]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.611.411 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.611.414 [client_manager.cpp:261][CheckPackageExists][tid:618654] [TsdClient] check file[Ascend-aicpu_syskernels.tar.gz], deviceId[2]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.611.504 [client_manager.cpp:264][CheckPackageExists][tid:618654] [TsdClient] find aicpu package[Ascend-aicpu_syskernels.tar.gz] in path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], deviceId[2]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.611.533 [client_manager.cpp:261][CheckPackageExists][tid:618654] [TsdClient] check file[ascend_install.info], deviceId[2]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.611.534 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.611.561 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.611.597 [client_manager.cpp:261][CheckPackageExists][tid:618654] [TsdClient] check file[version.info], deviceId[2]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.611.618 [buffer_allocator.cc:61] 618674 BufferAllocator: alloc success, Runtime_alloc_size 524288(bytes)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.611.640 [task_allocator.cc:46] 618674 DefaultAlloc: Runtime_alloc_size 2048(bytes)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.611.654 [buffer_allocator.cc:61] 618674 BufferAllocator: alloc success, Runtime_alloc_size 136(bytes)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.611.670 [h2d_copy_mgr.cc:45] 618674 H2DCopyMgr: alloc h2d copy buff success, policy 2
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.611.663 [client_manager.cpp:261][CheckPackageExists][tid:618654] [TsdClient] check file[..], deviceId[2]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.611.678 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.611.682 [uma_arg_loader.cc:86] 618674 Init: new BufferAllocator superArgAllocator_ ok, Runtime_alloc_size 152
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.611.711 [task_allocator.cc:46] 618674 DefaultAlloc: Runtime_alloc_size 32768(bytes)
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.611.726 [client_manager.cpp:261][CheckPackageExists][tid:618654] [TsdClient] check file[Ascend-aicpu_extend_syskernels.tar.gz], deviceId[2]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.611.740 [buffer_allocator.cc:61] 618674 BufferAllocator: alloc success, Runtime_alloc_size 104(bytes)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.611.754 [uma_arg_loader.cc:93] 618674 Init: new BufferAllocator handleAllocator_ ok, Runtime_alloc_size 152
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.611.810 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.611.861 [client_manager.cpp:268][CheckPackageExists][tid:618654] [TsdClient] find extend package[Ascend-aicpu_extend_syskernels.tar.gz] in path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], deviceId[2]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.611.881 [client_manager.cpp:283][CheckPackageExists][tid:618654] [TsdClient][deviceId=2] set extend package path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], name[Ascend-aicpu_extend_syskernels.tar.gz]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.611.895 [client_manager.cpp:286][CheckPackageExists][tid:618654] [TsdClient][deviceId=2] set aicpu package path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], name[Ascend-aicpu_syskernels.tar.gz]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.611.971 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LinSpace] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.611.964 [devdrv_hccl.c:103][ascend][curpid:618654,618654][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618654)
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.611.984 [process_mode_manager.cpp:396][InitTsdClient][tid:618654] [TsdClient][deviceId=2] get process sign success, procPid[618654]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.612.001 [process_mode_manager.cpp:403][InitTsdClient][tid:618654] [TsdClient] deviceId[2] begin to init hdc client
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.612.043 [hdc_common.cpp:67][InitMsgSize][tid:618654] HdcCommon::InitMsgSize Start
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.612.060 [hdc_common.cpp:80][InitMsgSize][tid:618654] msgMaxSize_ = 524224 bytes, msgShortHeadDataMaxSize_ = 524212 bytes, msgLongHeadDataMaxSize_ = 524200 bytes
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.612.075 [hdc_client.cpp:184][CreateHdcSession][tid:618654] HdcClient::CreateHdcSession Start
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.612.100 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MemSet] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.612.168 [hdc_client.cpp:208][CreateHdcSession][tid:618654] [HdcClient] deviceId: 2 connect session
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.612.178 [buffer_allocator.cc:61] 618662 BufferAllocator: alloc success, Runtime_alloc_size 524288(bytes)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.612.203 [task_allocator.cc:46] 618662 DefaultAlloc: Runtime_alloc_size 2048(bytes)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.612.206 [hdc_core.c:1982][ascend][curpid:618654,618654][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4173; pid=618654)
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.612.227 [hdc_client.cpp:219][CreateHdcSession][tid:618654] [HdcClient] drvHdcSetSessionReference success
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.612.221 [buffer_allocator.cc:61] 618662 BufferAllocator: alloc success, Runtime_alloc_size 136(bytes)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.612.232 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.612.236 [h2d_copy_mgr.cc:45] 618662 H2DCopyMgr: alloc h2d copy buff success, policy 2
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.612.243 [hdc_client.cpp:230][CreateHdcSession][tid:618654] [HdcClient] deviceId: 2 connect session and drvHdcSetSessionReference success, sessionId=1
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.612.262 [version_verify.cpp:36][SetVersionInfo][tid:618654] VersionVerify: send client version to server
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.612.255 [uma_arg_loader.cc:86] 618662 Init: new BufferAllocator superArgAllocator_ ok, Runtime_alloc_size 152
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.612.285 [task_allocator.cc:46] 618662 DefaultAlloc: Runtime_alloc_size 32768(bytes)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.612.319 [buffer_allocator.cc:61] 618662 BufferAllocator: alloc success, Runtime_alloc_size 104(bytes)
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.612.316 [version_verify.cpp:52][SetVersionInfo][tid:618654] send feature_info:{msg_type:35, features:{check before send aicpu package}}
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.612.334 [version_verify.cpp:52][SetVersionInfo][tid:618654] send feature_info:{msg_type:37, features:{check before send open qs message}}
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.612.332 [uma_arg_loader.cc:93] 618662 Init: new BufferAllocator handleAllocator_ ok, Runtime_alloc_size 152
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.612.349 [version_verify.cpp:52][SetVersionInfo][tid:618654] send feature_info:{msg_type:64, features:{get check code retry}}
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.612.357 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : [Tiling][TilingParse]
[WARNING] TDT(618654,python3.9):2025-04-03-09:27:41.612.389 [internal_api.cpp:101][GetScheduleEnv][tid:618654] Get env[DATAMASTER_RUN_MODE] failed
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.612.491 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.612.573 [buffer_allocator.cc:61] 618674 BufferAllocator: alloc success, Runtime_alloc_size 131072(bytes)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.612.593 [uma_arg_loader.cc:102] 618674 Init: new BufferAllocator kernelInfoAllocator_ ok, Runtime_alloc_size 152
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.612.611 [uma_arg_loader.cc:104] 618674 Init: ALLOC PCIE is support[1]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.612.606 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.612.627 [devmm_svm.c:1972][ascend][curpid:618674,618674][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.612.644 [npu_driver.cc:6080] 618674 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.612.729 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.612.737 [version_verify.cpp:68][PeerVersionCheck][tid:618654] VersionVerify: Check client version info, server[1230], client[1230]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.612.759 [version_verify.cpp:89][ParseVersionInfo][tid:618654] VersionVerify: pass client version info success
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.612.777 [hdc_client.cpp:275][CheckHdcConnection][tid:618654] Service[2] create hdc success
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.612.768 [buffer_allocator.cc:61] 618674 BufferAllocator: alloc success, Runtime_alloc_size 32768(bytes)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.612.784 [h2d_copy_mgr.cc:45] 618674 H2DCopyMgr: alloc h2d copy buff success, policy 1
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.612.795 [version_verify.cpp:122][SpecialFeatureCheck][tid:618654] VersionVerify: new type[35], supported
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.612.799 [raw_device.cc:393] 618674 Init: new StreamSqCqManage ok, Runtime_alloc_size 416(bytes)
[WARNING] TDT(618654,python3.9):2025-04-03-09:27:41.612.813 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618654] Get env[ASAN_RUN_MODE] failed
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.612.814 [raw_device.cc:398] 618674 Init: New taskFactory ok, Runtime_alloc_size 136(bytes)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.612.829 [task_allocator.cc:46] 618674 DefaultAlloc: Runtime_alloc_size 393216(bytes)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.612.852 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NPUClearFloatStatus] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.612.847 [process_mode_manager.cpp:627][GetDeviceCheckCodeOnce][tid:618654] [TsdClient][deviceId=2] [sessionId=1] wait package info respond
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.612.866 [hdc_client.cpp:154][TsdRecvData][tid:618654] recv timeout is:150000 ms
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.612.975 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NPUGetFloatStatus] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.612.998 [buffer_allocator.cc:61] 618674 BufferAllocator: alloc success, Runtime_alloc_size 104(bytes)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.613.099 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.613.125 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.613.127 [buffer_allocator.cc:61] 618662 BufferAllocator: alloc success, Runtime_alloc_size 131072(bytes)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.613.147 [uma_arg_loader.cc:102] 618662 Init: new BufferAllocator kernelInfoAllocator_ ok, Runtime_alloc_size 152
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.613.162 [uma_arg_loader.cc:104] 618662 Init: ALLOC PCIE is support[1]
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.613.176 [devmm_svm.c:1972][ascend][curpid:618662,618662][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.613.194 [npu_driver.cc:6080] 618662 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.613.196 [raw_device.cc:109] 618674 Init: ObjAllocator alloc success, Runtime_alloc_size 160000(bytes)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.613.319 [buffer_allocator.cc:61] 618662 BufferAllocator: alloc success, Runtime_alloc_size 32768(bytes)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.613.337 [h2d_copy_mgr.cc:45] 618662 H2DCopyMgr: alloc h2d copy buff success, policy 1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.613.351 [raw_device.cc:393] 618662 Init: new StreamSqCqManage ok, Runtime_alloc_size 416(bytes)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.613.356 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.613.368 [raw_device.cc:398] 618662 Init: New taskFactory ok, Runtime_alloc_size 136(bytes)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.613.386 [task_allocator.cc:46] 618662 DefaultAlloc: Runtime_alloc_size 393216(bytes)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.613.480 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.613.563 [buffer_allocator.cc:61] 618662 BufferAllocator: alloc success, Runtime_alloc_size 104(bytes)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.613.568 [raw_device.cc:121] 618674 Init: ObjAllocator alloc success, Runtime_alloc_size 960000(bytes)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.613.585 [raw_device.cc:425] 618674 Init: Runtime_alloc_size=64000(bytes)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.613.631 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.613.648 [npu_driver.cc:404] 618674 StreamIdAlloc: stream id alloc begin, device_id=7, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.613.730 [stream.cc:2246] 618674 AllocExecutedTimesSvm: stream_id=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.613.752 [raw_device.cc:109] 618662 Init: ObjAllocator alloc success, Runtime_alloc_size 160000(bytes)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.613.776 [stream_sqcq_manage.cc:147] 618674 Alloc: deviceId=7, tsId=0, drvFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.613.794 [npu_driver.cc:882] 618674 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.613.846 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.613.870 [process_mode_msg_parse.cpp:148][PackageInfoMsgProc][tid:618654] [PackageInfoMsgProc] [sessionID=1]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.613.889 [process_mode_msg_parse.cpp:151][PackageInfoMsgProc][tid:618654] [PackageInfoMsgProc] [sessionID=1] deviceId[2], checkCode[56684994]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.613.904 [hdc_client.cpp:172][TsdRecvData][tid:618654] [deviceId=2] the Tsd recv data already
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.613.920 [version_verify.cpp:122][SpecialFeatureCheck][tid:618654] VersionVerify: new type[64], supported
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.613.937 [hdc_client.cpp:411][Destroy][tid:618654] enter HdcClient::Destroy() function
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.613.951 [hdc_client.c:417][ascend][curpid:618654,618654][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4173)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.613.968 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.613.982 [hdc_client.cpp:394][DestroyClient][tid:618654] begin drvHdcClientDestroy
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.614.003 [hdc_client.cpp:399][DestroyClient][tid:618654] end drvHdcClientDestroy
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.614.016 [hdc_client.cpp:377][ClearClientPtr][tid:618654] begin HdcClient::ClearClientPtr
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.614.029 [hdc_client.cpp:385][ClearClientPtr][tid:618654] end HdcClient::ClearClientPtr
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.614.042 [hdc_client.cpp:418][Destroy][tid:618654] end HdcClient::Destroy() function
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.614.066 [process_mode_manager.cpp:371][SendAICPUPackage][tid:618654] [TsdClient]the checksum of host package[56684994] is same to device[56684994], skip send package.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.614.087 [process_mode_manager.cpp:1870][SendExtendPackage][tid:618654] [TsdClient]the checksum of host extend package[9658754] is same to device[9658754], skip send package.
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.614.109 [devdrv_hccl.c:103][ascend][curpid:618654,618654][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618654)
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.614.127 [process_mode_manager.cpp:396][InitTsdClient][tid:618654] [TsdClient][deviceId=2] get process sign success, procPid[618654]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.614.139 [process_mode_manager.cpp:403][InitTsdClient][tid:618654] [TsdClient] deviceId[2] begin to init hdc client
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.614.144 [raw_device.cc:121] 618662 Init: ObjAllocator alloc success, Runtime_alloc_size 960000(bytes)
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.614.156 [hdc_common.cpp:67][InitMsgSize][tid:618654] HdcCommon::InitMsgSize Start
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.614.162 [raw_device.cc:425] 618662 Init: Runtime_alloc_size=64000(bytes)
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.614.172 [hdc_common.cpp:80][InitMsgSize][tid:618654] msgMaxSize_ = 524224 bytes, msgShortHeadDataMaxSize_ = 524212 bytes, msgLongHeadDataMaxSize_ = 524200 bytes
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.614.191 [hdc_c[INFO] GE(618666,python3.9):2025-04-03-09:27:41.614.186 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [Tiling][TilingParse]
lient.cpp:184][CreateHdcSession][tid:618654] HdcClient::CreateHdcSession Start
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.614.211 [npu_driver.cc:404] 618662 StreamIdAlloc: stream id alloc begin, device_id=4, priority=0, ts_id=0, remote_stream_id=0
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.614.284 [hdc_client.cpp:208][CreateHdcSession][tid:618654] [HdcClient] deviceId: 2 connect session
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.614.288 [stream.cc:2246] 618662 AllocExecutedTimesSvm: stream_id=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.614.322 [stream_sqcq_manage.cc:147] 618662 Alloc: deviceId=4, tsId=0, drvFlag=0
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.614.319 [hdc_core.c:1982][ascend][curpid:618654,618654][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4174; pid=618654)
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.614.338 [hdc_client.cpp:219][CreateHdcSession][tid:618654] [HdcClient] drvHdcSetSessionReference success
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.614.339 [npu_driver.cc:882] 618662 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.614.355 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.614.357 [hdc_client.cpp:230][CreateHdcSession][tid:618654] [HdcClient] deviceId: 2 connect session and drvHdcSetSessionReference success, sessionId=1
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.614.376 [version_verify.cpp:36][SetVersionInfo][tid:618654] VersionVerify: send client version to server
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.614.392 [version_verify.cpp:52][SetVersionInfo][tid:618654] send feature_info:{msg_type:35, features:{check before send aicpu package}}
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.614.410 [version_verify.cpp:52][SetVersionInfo][tid:618654] send feature_info:{msg_type:37, features:{check before send open qs message}}
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.614.422 [version_verify.cpp:52][SetVersionInfo][tid:618654] send feature_info:{msg_type:64, features:{get check code retry}}
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.614.417 [npu_driver.cc:6125] 618674 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.614.470 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.614.497 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.614.500 [npu_driver.cc:6137] 618674 LogicCqAllocateV2: success: deviceId=7, tsId=0, cqId=331, streamId=0, logicCq=331, cqeDepth=4096
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.614.528 [npu_driver.cc:6189] 618674 StreamBindLogicCq: success: deviceId=7, tsId=0, streamId=0, logicCq=331.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.614.546 [npu_driver.cc:5916] 618674 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=cf021000, addr=dfffcf021000size=4096
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.614.562 [stream.cc:653] 618674 Setup: Success to get sq=0 sq reg virtual addr length=4096.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.614.621 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.614.633 [stream.cc:276] 618674 CreateStreamTaskRes: Normal STREAM Setup stream_id=0 flags_=0xc0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.614.652 [stream.cc:688] 618674 Setup: stream setup end, stream_id=0, IsTaskSink=0, sqId=0, cqId=0, deviceId=7, streamResId=0
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.614.649 [version_verify.cpp:68][PeerVersionCheck][tid:618654] VersionVerify: Check client version info, server[1230], client[1230]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.614.648 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : [Tiling][TilingParse]
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:41.614.671 [stream_state_callback_manager.cc:45] 618674 Notify: not reg stream state callback func!
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.614.671 [version_verify.cpp:89][ParseVersionInfo][tid:618654] VersionVerify: pass client version info success
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.614.690 [hdc_client.cpp:275][CheckHdcConnection][tid:618654] Service[2] create hdc success
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.614.687 [raw_device.cc:593] 618674 Start: new primary Stream ok, Runtime_alloc_size 3872, stream_id=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.614.710 [npu_driver.cc:404] 618674 StreamIdAlloc: stream id alloc begin, device_id=7, priority=0, ts_id=0, remote_stream_id=0
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.614.710 [process_mode_manager.cpp:458][ConstructOpenMsg][tid:618654] [TsdClient] tsd get process sign successfully, procpid[618654] signSize[48]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.614.727 [npu_driver.cc:6125] 618662 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.614.734 [stream_sqcq_manage.cc:147] 618674 Alloc: deviceId=7, tsId=0, drvFlag=16
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.614.733 [version_verify.cpp:114][SpecialFeatureCheck][tid:618654] VersionVerify: previous type[6], supported
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.614.750 [npu_driver.cc:882] 618674 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.614.761 [process_mode_manager.cpp:88][OpenProcess][tid:618654] [ProcessModeManager] deviceId[2] sessionId[1] rankSize[0], wait sub process start respond
[WARNING] TDT(618654,python3.9):2025-04-03-09:27:41.614.781 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618654] Get env[ASAN_RUN_MODE] failed
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.614.774 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.614.781 [npu_driver.cc:6137] 618662 LogicCqAllocateV2: success: deviceId=4, tsId=0, cqId=311, streamId=0, logicCq=311, cqeDepth=4096
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.614.796 [hdc_client.cpp:154][TsdRecvData][tid:618654] recv timeout is:150000 ms
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.614.807 [npu_driver.cc:6189] 618662 StreamBindLogicCq: success: deviceId=4, tsId=0, streamId=0, logicCq=311.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.614.827 [npu_driver.cc:5916] 618662 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=ea942000, addr=dfffea942000size=4096
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.614.848 [tsch_stream.cc:45] 618674 Setup: stream setup end, stream_id=1, type=1, IsTaskSink=0, sqId=1, cqId=1, deviceId=7 streamResId=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.614.844 [stream.cc:653] 618662 Setup: Success to get sq=0 sq reg virtual addr length=4096.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.614.865 [raw_device.cc:1219] 618674 TschStreamSetup: Tsch setup ffts dsa stream ok, stream_id=1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.614.889 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.614.916 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.614.911 [stream.cc:276] 618662 CreateStreamTaskRes: Normal STREAM Setup stream_id=0 flags_=0xc0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.614.930 [stream.cc:688] 618662 Setup: stream setup end, stream_id=0, IsTaskSink=0, sqId=0, cqId=0, deviceId=4, streamResId=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.614.941 [osal.cc:309] 618674 CreateThread: Runtime_alloc_size 56
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:41.614.956 [stream_state_callback_manager.cc:45] 618662 Notify: not reg stream state callback func!
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.614.975 [raw_device.cc:593] 618662 Start: new primary Stream ok, Runtime_alloc_size 3872, stream_id=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.614.997 [npu_driver.cc:404] 618662 StreamIdAlloc: stream id alloc begin, device_id=4, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.615.019 [stream_sqcq_manage.cc:147] 618662 Alloc: deviceId=4, tsId=0, drvFlag=16
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.615.035 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.615.035 [npu_driver.cc:882] 618662 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.067 [osal.cc:182] 618674 Start: mmCreateTaskWithThreadAttr, retCode=0, name_=MONITOR_0, i=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.107 [osal.cc:309] 618674 CreateThread: Runtime_alloc_size 56
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.615.132 [tsch_stream.cc:45] 618662 Setup: stream setup end, stream_id=1, type=1, IsTaskSink=0, sqId=1, cqId=1, deviceId=4 streamResId=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.615.153 [raw_device.cc:1219] 618662 TschStreamSetup: Tsch setup ffts dsa stream ok, stream_id=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.146 [stars_engine.cc:1785] 618812 MonitoringRun: Starts Monitor thread has entered, ts_id=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.615.154 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.187 [runtime.cc:5239] 618812 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.191 [osal.cc:182] 618674 Start: mmCreateTaskWithThreadAttr, retCode=0, name_=RT_RECYCLE, i=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.203 [stars_engine.cc:201] 618813 RecycleThreadRun: RecycleThreadRun thread enter.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.615.206 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618812] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.615.230 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618812] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.615.230 [osal.cc:309] 618662 CreateThread: Runtime_alloc_size 56
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.615.244 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618812] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.269 [runtime.cc:3077] 618812 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=7, devId=7, tdt status=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.615.273 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.320 [npu_driver.cc:6306] 618812 GetDeviceStatus: GetDeviceStatus status=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.341 [stars_engine.cc:1855] 618812 ReportHBMRasProc: g_hbmRasCheckDeviceId init, dev_id=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.355 [npu_driver.cc:551] 618812 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.615.343 [osal.cc:182] 618662 Start: mmCreateTaskWithThreadAttr, retCode=0, name_=MONITOR_0, i=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.615.385 [osal.cc:309] 618662 CreateThread: Runtime_alloc_size 56
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.615.395 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.615.461 [osal.cc:182] 618662 Start: mmCreateTaskWithThreadAttr, retCode=0, name_=RT_RECYCLE, i=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.615.463 [stars_engine.cc:1785] 618814 MonitoringRun: Starts Monitor thread has entered, ts_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.615.474 [stars_engine.cc:201] 618815 RecycleThreadRun: RecycleThreadRun thread enter.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.615.515 [runtime.cc:5239] 618814 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.615.536 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618814] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.552 [engine.cc:188] 618674 SubmitTaskNormal: stream_id=0,task_id=0,task_type=97 (STARS_VERSION).
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.615.556 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618814] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.574 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=0, head=0.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.615.575 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618814] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.615.602 [runtime.cc:3077] 618814 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=4, devId=4, tdt status=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.615.618 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.610 [task_info.cc:1596] 618674 ConstructSqeForStarsVersionTask: Send GetStarsVersionTask succ,sqe_type=3,pre_p=1,sqe->rt_streamID=32768,stream_id=0,task_id=0,task_type=97.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.641 [stream.cc:1400] 618674 AddTaskToList: public task, stream_id=0, task_id=0, task_type=97 (STARS_VERSION), head=0, tail=1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.615.647 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.657 [stream.cc:2595] 618674 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=0, type=97(STARS_VERSION), head=0, tail=1, sqe_num=1, lastTail=0, device_id=7
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.615.659 [npu_driver.cc:6306] 618814 GetDeviceStatus: GetDeviceStatus status=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.615.686 [stars_engine.cc:1855] 618814 ReportHBMRasProc: g_hbmRasCheckDeviceId init, dev_id=4
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.688 [npu_driver.cc:751] 618674 SqTaskSend: device_id=7, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.615.702 [npu_driver.cc:551] 618814 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.710 [stars_engine.cc:893] 618674 SendTask: Sq task send finished, device_id=7, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=0, task_type=97(STARS_VERSION).
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.727 [stars_engine.cc:1122] 618674 SyncTask: Task Wait: device_id=7, stream_id=0, task_id=0, logicCqId=331.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.748 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=0, head=0.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.615.760 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.762 [stars_engine.cc:1071] 618674 IsSyncTaskFinish: Sync task finished, sqHead=0 finishedTaskId=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.778 [stars_engine.cc:1017] 618674 ProcReport: Get logic report: cnt=1, idx=0, stream_id=0, report task_id=0, sync task_id=0, sqeType=3, sqeHead=0, retCode=0x23, errType=0x20.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.795 [task.cc:185] 618674 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.808 [stars_engine.cc:1027] 618674 ProcReport: taskType=97.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.833 [task.cc:185] 618674 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.615.828 [engine.cc:188] 618662 SubmitTaskNormal: stream_id=0,task_id=0,task_type=97 (STARS_VERSION).
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.848 [stars_engine.cc:1570] 618674 ProcLogicCqReport: CQE warning, device_id=7, stream_id=0, task_id=0, sqe_type=3(place holder), errType=0x20(sq sw status error), sqSwStatus=0x23
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.615.857 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=0, head=0.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.615.876 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.876 [task.cc:185] 618674 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.893 [logger.cc:152] 618674 TaskFinished: device_id=7, stream_id=0, task_id=0, task_type=97 (STARS_VERSION), task_finish_num=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.908 [task_info.cc:1614] 618674 DoCompleteSuccessForStarsVersionTask: Complete StarsVersionTask succ, retCode=35,tschVersion=35.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.921 [raw_device.cc:1305] 618674 SetTschVersion: Set tsch version=35.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.615.901 [task_info.cc:1596] 618662 ConstructSqeForStarsVersionTask: Send GetStarsVersionTask succ,sqe_type=3,pre_p=1,sqe->rt_streamID=32768,stream_id=0,task_id=0,task_type=97.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.615.934 [stream.cc:1400] 618662 AddTaskToList: public task, stream_id=0, task_id=0, task_type=97 (STARS_VERSION), head=0, tail=1
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.950 [stars_engine.cc:1351] 618674 StarsResumeRtsq: Begin to query sq status, stream_id=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.615.952 [stream.cc:2595] 618662 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=0, type=97(STARS_VERSION), head=0, tail=1, sqe_num=1, lastTail=0, device_id=4
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.968 [npu_driver.cc:5618] 618674 GetSqEnable: deviceId=7, tsId=0, sqId=0, enable=0.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.982 [stars_engine.cc:1365] 618674 StarsResumeRtsq: sq already disable, stream_id=0, queryCnt=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.615.997 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=0, head=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.615.991 [npu_driver.cc:751] 618662 SqTaskSend: device_id=4, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.616.012 [npu_driver.cc:5595] 618674 GetSqTail: deviceId=7, tsId=0, sqId=0, tail=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.616.009 [stars_engine.cc:893] 618662 SendTask: Sq task send finished, device_id=4, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=0, task_type=97(STARS_VERSION).
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.616.026 [npu_driver.cc:5406] 618674 SetSqHead: deviceId=7, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.616.028 [stars_engine.cc:1122] 618662 SyncTask: Task Wait: device_id=4, stream_id=0, task_id=0, logicCqId=311.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.616.046 [npu_driver.cc:5357] 618674 EnableSq: deviceId=7, tsId=0, sqId=0.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:41.616.063 [stars_engine.cc:1430] 618674 StarsResumeRtsq: Resume stream_id=0, sq_id=0, sq_head=0, task_id=0, taskType=97, head=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.616.072 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=0, head=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.616.081 [npu_driver.cc:5618] 618674 GetSqEnable: deviceId=7, tsId=0, sqId=0, enable=1.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.616.089 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.616.090 [stars_engine.cc:1071] 618662 IsSyncTaskFinish: Sync task finished, sqHead=0 finishedTaskId=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.616.095 [stream.cc:1494] 618674 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.616.118 [raw_device.cc:1331] 618674 GetStarsVersion: send alloc get stars version task, stream_id=0, retCode:0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.616.133 [raw_device.cc:610] 618674 Start: Get TschVersion, tschVersion=35.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.616.124 [stars_engine.cc:1017] 618662 ProcReport: Get logic report: cnt=1, idx=0, stream_id=0, report task_id=0, sync task_id=0, sqeType=3, sqeHead=0, retCode=0x23, errType=0x20.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.616.145 [task.cc:185] 618662 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.616.184 [stars_engine.cc:1027] 618662 ProcReport: taskType=97.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.616.218 [task.cc:185] 618662 GetTask: this stream no taskRes, stream_id=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.616.218 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [Tiling][TilingParse]
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:41.616.238 [stars_engine.cc:1570] 618662 ProcLogicCqReport: CQE warning, device_id=4, stream_id=0, task_id=0, sqe_type=3(place holder), errType=0x20(sq sw status error), sqSwStatus=0x23
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.616.260 [task.cc:185] 618662 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.616.279 [logger.cc:152] 618662 TaskFinished: device_id=4, stream_id=0, task_id=0, task_type=97 (STARS_VERSION), task_finish_num=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.616.297 [task_info.cc:1614] 618662 DoCompleteSuccessForStarsVersionTask: Complete StarsVersionTask succ, retCode=35,tschVersion=35.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.616.310 [raw_device.cc:1305] 618662 SetTschVersion: Set tsch version=35.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:41.616.343 [stars_engine.cc:1351] 618662 StarsResumeRtsq: Begin to query sq status, stream_id=0.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.616.349 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.616.366 [npu_driver.cc:5618] 618662 GetSqEnable: deviceId=4, tsId=0, sqId=0, enable=0.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:41.616.383 [stars_engine.cc:1365] 618662 StarsResumeRtsq: sq already disable, stream_id=0, queryCnt=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.616.398 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=0, head=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.616.413 [npu_driver.cc:5595] 618662 GetSqTail: deviceId=4, tsId=0, sqId=0, tail=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.616.429 [npu_driver.cc:5406] 618662 SetSqHead: deviceId=4, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.616.454 [npu_driver.cc:5357] 618662 EnableSq: deviceId=4, tsId=0, sqId=0.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.616.467 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : [Tiling][TilingParse]
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:41.616.474 [stars_engine.cc:1430] 618662 StarsResumeRtsq: Resume stream_id=0, sq_id=0, sq_head=0, task_id=0, taskType=97, head=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.616.495 [npu_driver.cc:5618] 618662 GetSqEnable: deviceId=4, tsId=0, sqId=0, enable=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.616.511 [stream.cc:1494] 618662 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.616.540 [raw_device.cc:1331] 618662 GetStarsVersion: send alloc get stars version task, stream_id=0, retCode:0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.616.554 [raw_device.cc:610] 618662 Start: Get TschVersion, tschVersion=35.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.616.594 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.616.806 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.616.970 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.617.128 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.617.314 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.617.448 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.617.565 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.617.685 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BlendFaceBgPartOne] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.617.768 [engine.cc:188] 618662 SubmitTaskNormal: stream_id=0,task_id=1,task_type=83 (DEVICE_RINGBUFFER_CONTROL).
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.617.805 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.617.815 [ringbuffer_maintain_task.cc:98] 618662 ConstructSqeForRingBufferMaintainTask: RingBufferMaintainTask stream_id=0, task_id=1, offset=0x16c0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.617.836 [stream.cc:1400] 618662 AddTaskToList: public task, stream_id=0, task_id=1, task_type=83 (DEVICE_RINGBUFFER_CONTROL), head=1, tail=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.617.855 [stream.cc:2595] 618662 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=1, type=83(DEVICE_RINGBUFFER_CONTROL), head=1, tail=2, sqe_num=1, lastTail=1, device_id=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.617.876 [npu_driver.cc:751] 618662 SqTaskSend: device_id=4, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.617.892 [stars_engine.cc:893] 618662 SendTask: Sq task send finished, device_id=4, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=1, task_type=83(DEVICE_RINGBUFFER_CONTROL).
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.617.910 [stream.cc:1494] 618662 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.617.926 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=0, head=1.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.617.930 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.617.962 [stars_engine.cc:622] 618662 ProcLogicCqUntilEmpty: Task Wait: stream_id=0, logicCqId=311, retCode=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.617.982 [stream.cc:2886] 618662 StarsWaitForTask: No.0 stream_id=0, taskId=1, currentId=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.000 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.018 [stream.cc:2886] 618662 StarsWaitForTask: No.1 stream_id=0, taskId=1, currentId=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.032 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.048 [stream.cc:2886] 618662 StarsWaitForTask: No.2 stream_id=0, taskId=1, currentId=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.061 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.075 [stream.cc:2886] 618662 StarsWaitForTask: No.3 stream_id=0, taskId=1, currentId=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.091 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=0, head=2.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.104 [task.cc:185] 618662 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.120 [task.cc:185] 618662 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.133 [logger.cc:152] 618662 TaskFinished: device_id=4, stream_id=0, task_id=1, task_type=83 (DEVICE_RINGBUFFER_CONTROL), task_finish_num=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.153 [stars_engine.cc:437] 618662 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=1, sqHead=2, endTaskId=1, recycleTaskId=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.170 [stream.cc:2886] 618662 StarsWaitForTask: No.4 stream_id=0, taskId=1, currentId=1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.618.216 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.224 [engine.cc:188] 618662 SubmitTaskNormal: stream_id=0,task_id=2,task_type=29 (ALLOC_DSA_ADDR).
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.245 [task_info.cc:111] 618662 ConstructSqeForAllocDsaAddrTask: Send AllocDsaAddrTask succ, sqe_type=3, pre_p=1, stream_id=0, task_id=2, task_type=29, dsa_sq_id=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.271 [stream.cc:1400] 618662 AddTaskToList: public task, stream_id=0, task_id=2, task_type=29 (ALLOC_DSA_ADDR), head=2, tail=3
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.284 [stream.cc:2595] 618662 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=2, type=29(ALLOC_DSA_ADDR), head=2, tail=3, sqe_num=1, lastTail=2, device_id=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.304 [npu_driver.cc:751] 618662 SqTaskSend: device_id=4, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.320 [stars_engine.cc:893] 618662 SendTask: Sq task send finished, device_id=4, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=2, task_type=29(ALLOC_DSA_ADDR).
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.339 [stars_engine.cc:1122] 618662 SyncTask: Task Wait: device_id=4, stream_id=0, task_id=2, logicCqId=311.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.618.388 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.618.438 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNN, funcPointer:0xfffef9345d70, registered count:1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.501 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=0, head=3.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.558 [stars_engine.cc:1071] 618662 IsSyncTaskFinish: Sync task finished, sqHead=3 finishedTaskId=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.581 [stars_engine.cc:1017] 618662 ProcReport: Get logic report: cnt=1, idx=0, stream_id=0, report task_id=2, sync task_id=2, sqeType=3, sqeHead=2, retCode=0, errType=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.603 [task.cc:185] 618662 GetTask: this stream no taskRes, stream_id=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.618.610 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.623 [stars_engine.cc:1027] 618662 ProcReport: taskType=29.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.638 [task.cc:185] 618662 GetTask: this stream no taskRes, stream_id=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.618.633 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNNV2, funcPointer:0xfffef934e248, registered count:2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.657 [task.cc:185] 618662 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.676 [logger.cc:152] 618662 TaskFinished: device_id=4, stream_id=0, task_id=2, task_type=29 (ALLOC_DSA_ADDR), task_finish_num=3
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.712 [npu_driver.cc:5618] 618662 GetSqEnable: deviceId=4, tsId=0, sqId=0, enable=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.730 [stream.cc:1494] 618662 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=2.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.618.747 [raw_device.cc:1232] 618662 TschStreamAllocDsaAddr: send alloc dsa sq task, stream_id=1, retCode:0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.618.765 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:41.618.781 [atrace_api.c:40](tid:618662) AtraceCreate start.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.618.889 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.619.040 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.619.158 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GridSampler2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.619.238 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618670] [ServerToClientMsgProc] [sessionID=1]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.619.259 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618670] [TsdClient] DeviceMsgProc recvMsg realDeviceId[6] msgType[8] localDevId[6] rspCode[0]heterogeneousSubPid[0], tsdSupportLevel_[63]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.619.277 [hdc_client.cpp:172][TsdRecvData][tid:618670] [deviceId=6] the Tsd recv data already
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.619.287 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GridSampler3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.619.312 [devmm_svm.c:132][ascend][curpid:618670,618670][drv][devmm][devmm_setup_device]DrvMemDeviceOpen. (devid=6)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.619.412 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandle] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.619.526 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandleV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.619.645 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.619.770 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PasteSubImg] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.619.883 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.619.911 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : [Tiling][TilingParse]
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:41.619.930 [trace_rb_log.c:45](tid:618662) init ring buffer time finished, realTime 1743643661618867067, monotonicTime 4163082951569, freq 99994 kHz, minutesWest 480 minutes
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:41.619.951 [trace_rb_log.c:137](tid:618662) [RUNTIME_ATRACE_DEV4_TS0] create ring buffer success, msgSize 128 bytes, msgTxtSize 112 bytes, bufferSize 1024 bytes, msg space 128 bytes, total space 131568 bytes
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:41.619.973 [tracer_mgr_operate.c:66](tid:618662) create object RUNTIME_ATRACE_DEV4_TS0 success, exitSave(false), noLock(false).
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:41.619.989 [atrace_api.c:44](tid:618662) AtraceCreate end.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.620.029 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [Tiling][TilingParse]
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:41.620.041 [trace_event.c:70](tid:618662) limitedNum 1, processType 0 
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:41.620.060 [trace_event.c:372](tid:618662) set trace event attr limitedNum: 1, processType: 0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.620.082 [runtime.cc:3159] 618662 SetTsdProfCallback: set tsd prof callback
[INFO] TDT(618662,python3.9):2025-04-03-09:27:41.620.097 [client_manager.cpp:196][SetProfilingCallback][tid:618662] [TsdClient] set profiling callback success
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.620.143 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.620.170 [runtime.cc:3364] 618662 PrimaryContextRetain: new Context ok, Runtime_alloc_size 424
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.620.222 [context.cc:109] 618662 Init: ObjAllocator alloc success, Runtime_alloc_size 160000(bytes)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.620.279 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.620.343 [context.cc:121] 618662 Init: ObjAllocator alloc success, Runtime_alloc_size 960000(bytes)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.620.359 [context.cc:276] 618662 Init: Runtime_alloc_size is 16000.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.620.399 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.620.452 [raw_device.cc:803] 618662 UpdateTimeoutConfig: No need to update timeout config.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:41.620.471 [npu_driver_dcache_lock.cpp:39] 618662 AllocAddrForDcache: halMemCtl failed, drvRet=65534, outSize=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.620.528 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.620.656 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.620.655 [raw_device.cc:528] 618662 AllocStackPhyBase: AllocStackPhyBase device_id=4, stackPhyBase32k_=0x12c140000000, stackPhySize=2457600.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.620.707 [raw_device.cc:232] 618662 LaunchDcacheLockOp: dcache lock has been set or stack addr is not for dcache, dCacheLockFlag_=0, stackAddrIsDcache_=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.620.740 [runtime.cc:3393] 618662 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.620.757 [runtime.cc:3560] 618662 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=4
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.620.768 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TabulateFusionGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.620.783 [api_impl.cc:2987] 618662 NewDevice: SetCurRef = 0xaaab087d6320,userDeviceId=4,deviceId=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.620.801 [runtime.cc:5239] 618662 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.620.817 [api_impl.cc:2992] 618662 NewDevice: New device success, user_device_id=4, die_num=1.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:41.620.843 [awatchdog_core.c:175](tid:618662) create watchdog for id : 65543, tid : 618662, timeout : 300s
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.620.860 [api_impl.cc:3025] 618662 SetDevice: SetDevice success, curCtx=0xaaab087d6320, user_device_id=4.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.620.887 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[YUV4442YUV422] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.620.904 [acl.cpp:115]618662 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.620.923 [acl.cpp:121]618662 GetSocVersion: socVersion is Ascend910B3
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.621.045 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.621.072 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.621.098 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.621.121 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.621.272 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.621.392 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.621.417 [devmm_virt_interface.c:450][ascend][curpid:618670,618670][drv][devmm][devmm_ioctl_init_process]Init_process details. (hostpid=618670)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.621.507 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.621.628 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.621.748 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.621.741 [drv_log_user.c:623][ascend][curpid:618670,618670][drv][devmm][share_log_read_in_single_module]Setup device succeeded. (logical_devid=6; devid=6; vfid=0; hostpid=618670; devpid=29743)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.621.769 [devmm_svm.c:122][ascend][curpid:618670,618670][drv][devmm][devmm_set_device_info]Device info. (devid=6; dvpp_size=17179869184; support_bar_mem=1; support_dev_read_only=1; support_dev_mem_map_host=1; support_bar_huge_mem=1; is_alloced_by_malloc=0; host_rw_dev_ro=1; double_pgtable_offset=17592186044416; is_support_host_pin_pre_register=0; is_support_host_mem_pool=0)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.621.860 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.621.885 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.621.910 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.622.041 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.622.054 [stub_process_mode_nowin.cpp:60][ProcessQueueForMdc][tid:618670] [TsdClient] it is unnecessary of current mode[0] to grant queue auth to aicpusd
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.622.076 [stub_process_mode_nowin.cpp:99][OpenInHost][tid:618670] enter into OpenInHost deviceid[6]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.622.103 [client_manager.cpp:435][IsHostEnvironment][tid:618670] [TsdClient] logicDeviceId is [6], hostaicpunum[0]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.622.119 [stub_process_mode_nowin.cpp:103][OpenInHost][tid:618670] host cpu not support
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.622.130 [process_mode_manager.cpp:121][OpenProcess][tid:618670] [TsdClient][deviceId=6] [sessionId=1] start hccp and computer process success
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.622.145 [runtime.cc:2879] 618670 startAicpuExecutor: userDeviceId=6, devId=6, tsdOpen ret=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.622.158 [runtime.cc:2891] 618670 startAicpuExecutor: TsdOpen success, devId=6, ret=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.622.156 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.622.175 [runtime.cc:3627] 618670 DeviceRetain: new dev ok id=6, rawDevSize=1328 (bytes), ts_id=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.622.191 [raw_device.cc:936] 618670 DevSetTsId: DevSetTsId, tsId=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.622.215 [npu_driver.cc:2968] 618670 DeviceOpen: Open device start, device_id=6, tsId=0.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.622.275 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.622.317 [trs_sqcq.c:458][ascend][curpid:618670,618670][drv][tsdrv][trsDevSqCqInit]Sqcq init. (devid=6)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.622.482 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicAtomicAddrClean] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.622.604 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.622.720 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.622.837 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.622.830 [trs_sqcq.c:394][ascend][curpid:618670,618670][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=6; tsId=0; id_type=6; num=2044)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.622.971 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.623.090 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.623.210 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.623.235 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceMeanD] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.623.305 [trs_sqcq.c:394][ascend][curpid:618670,618670][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=6; tsId=0; id_type=7; num=2044)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.623.351 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.623.464 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.623.495 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.623.565 [trs_sqcq.c:394][ascend][curpid:618670,618670][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=6; tsId=0; id_type=10; num=1024)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.623.790 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.623.796 [trs_sqcq.c:394][ascend][curpid:618670,618670][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=6; tsId=0; id_type=11; num=1024)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.623.906 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.623.996 [engine.cc:188] 618674 SubmitTaskNormal: stream_id=0,task_id=1,task_type=83 (DEVICE_RINGBUFFER_CONTROL).
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.624.018 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.044 [ringbuffer_maintain_task.cc:98] 618674 ConstructSqeForRingBufferMaintainTask: RingBufferMaintainTask stream_id=0, task_id=1, offset=0x1480
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.063 [stream.cc:1400] 618674 AddTaskToList: public task, stream_id=0, task_id=1, task_type=83 (DEVICE_RINGBUFFER_CONTROL), head=1, tail=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.078 [stream.cc:2595] 618674 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=1, type=83(DEVICE_RINGBUFFER_CONTROL), head=1, tail=2, sqe_num=1, lastTail=1, device_id=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.110 [npu_driver.cc:751] 618674 SqTaskSend: device_id=7, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.132 [stars_engine.cc:893] 618674 SendTask: Sq task send finished, device_id=7, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=1, task_type=83(DEVICE_RINGBUFFER_CONTROL).
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.148 [stream.cc:1494] 618674 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=1.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.624.147 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.171 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.225 [stars_engine.cc:622] 618674 ProcLogicCqUntilEmpty: Task Wait: stream_id=0, logicCqId=331, retCode=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.241 [stream.cc:2886] 618674 StarsWaitForTask: No.0 stream_id=0, taskId=1, currentId=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.255 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.269 [stream.cc:2886] 618674 StarsWaitForTask: No.1 stream_id=0, taskId=1, currentId=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.282 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=0, head=1.
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.624.270 [trs_sqcq.c:394][ascend][curpid:618670,618670][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=6; tsId=0; id_type=12; num=2048)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.624.283 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.296 [stream.cc:2886] 618674 StarsWaitForTask: No.2 stream_id=0, taskId=1, currentId=0
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.624.298 [trs_sqcq.c:394][ascend][curpid:618670,618670][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=6; tsId=0; id_type=8; num=16)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.311 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=0, head=2.
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.624.321 [trs_sqcq.c:394][ascend][curpid:618670,618670][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=6; tsId=0; id_type=9; num=16)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.347 [task.cc:185] 618674 GetTask: this stream no taskRes, stream_id=0
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.624.343 [trs_sqcq.c:394][ascend][curpid:618670,618670][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=6; tsId=0; id_type=13; num=4)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.362 [task.cc:185] 618674 GetTask: this stream no taskRes, stream_id=0
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.624.363 [trs_sqcq.c:394][ascend][curpid:618670,618670][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=6; tsId=0; id_type=14; num=10)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.374 [logger.cc:152] 618674 TaskFinished: device_id=7, stream_id=0, task_id=1, task_type=83 (DEVICE_RINGBUFFER_CONTROL), task_finish_num=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.393 [stars_engine.cc:437] 618674 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=1, sqHead=2, endTaskId=1, recycleTaskId=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.408 [stream.cc:2886] 618674 StarsWaitForTask: No.3 stream_id=0, taskId=1, currentId=1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.624.409 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.467 [engine.cc:188] 618674 SubmitTaskNormal: stream_id=0,task_id=2,task_type=29 (ALLOC_DSA_ADDR).
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.485 [task_info.cc:111] 618674 ConstructSqeForAllocDsaAddrTask: Send AllocDsaAddrTask succ, sqe_type=3, pre_p=1, stream_id=0, task_id=2, task_type=29, dsa_sq_id=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.501 [stream.cc:1400] 618674 AddTaskToList: public task, stream_id=0, task_id=2, task_type=29 (ALLOC_DSA_ADDR), head=2, tail=3
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.527 [stream.cc:2595] 618674 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=2, type=29(ALLOC_DSA_ADDR), head=2, tail=3, sqe_num=1, lastTail=2, device_id=7
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.624.528 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.545 [npu_driver.cc:751] 618674 SqTaskSend: device_id=7, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.565 [stars_engine.cc:893] 618674 SendTask: Sq task send finished, device_id=7, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=2, task_type=29(ALLOC_DSA_ADDR).
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.581 [stars_engine.cc:1122] 618674 SyncTask: Task Wait: device_id=7, stream_id=0, task_id=2, logicCqId=331.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.624.649 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.703 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=0, head=3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.717 [stars_engine.cc:1071] 618674 IsSyncTaskFinish: Sync task finished, sqHead=3 finishedTaskId=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.731 [stars_engine.cc:1017] 618674 ProcReport: Get logic report: cnt=1, idx=0, stream_id=0, report task_id=2, sync task_id=2, sqeType=3, sqeHead=2, retCode=0, errType=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.747 [task.cc:185] 618674 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.759 [stars_engine.cc:1027] 618674 ProcReport: taskType=29.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.771 [task.cc:185] 618674 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.785 [task.cc:185] 618674 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.798 [logger.cc:152] 618674 TaskFinished: device_id=7, stream_id=0, task_id=2, task_type=29 (ALLOC_DSA_ADDR), task_finish_num=3
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.817 [npu_driver.cc:5618] 618674 GetSqEnable: deviceId=7, tsId=0, sqId=0, enable=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.831 [stream.cc:1494] 618674 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=2.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.624.844 [raw_device.cc:1232] 618674 TschStreamAllocDsaAddr: send alloc dsa sq task, stream_id=1, retCode:0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.624.859 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : [Tiling][TilingParse]
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:41.624.865 [atrace_api.c:40](tid:618674) AtraceCreate start.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.624.981 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.625.107 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.625.234 [api_impl.cc:3476] 618662 GetDeviceInfo: get device info, deviceId=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.625.271 [api_impl.cc:3476] 618662 GetDeviceInfo: get device info, deviceId=4
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.625.334 [device.cpp:133]618662 UpdatePlatformInfoWithDevice: Successfully to UpdatePlatformInfoWithDevice, deviceId = 4, aicCnt = 20, vecCoreCnt = 40, cubeCoreCnt = 20
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.625.358 [device.cpp:154]618662 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 4
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.625.379 [context.cpp:87]618662 aclrtGetCurrentContext: start to execute aclrtGetCurrentContext
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.625.406 [context.cpp:98]618662 aclrtGetCurrentContext: successfully execute aclrtGetCurrentContext
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.625.433 [stream.cpp:48]618662 aclrtCreateStreamWithConfig: start to execute aclrtCreateStreamWithConfig with priority:0, flag:3
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.625.470 [api_impl.cc:1120] 618662 StreamCreate: priority=0, flags=1536.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.625.536 [npu_driver.cc:404] 618662 StreamIdAlloc: stream id alloc begin, device_id=4, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.625.574 [stream.cc:2246] 618662 AllocExecutedTimesSvm: stream_id=2.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.625.625 [stream_sqcq_manage.cc:147] 618662 Alloc: deviceId=4, tsId=0, drvFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.625.643 [npu_driver.cc:882] 618662 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.625.911 [npu_driver.cc:6125] 618662 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.625.959 [npu_driver.cc:6137] 618662 LogicCqAllocateV2: success: deviceId=4, tsId=0, cqId=312, streamId=2, logicCq=312, cqeDepth=4096
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:41.625.971 [trace_rb_log.c:45](tid:618674) init ring buffer time finished, realTime 1743643661624907251, monotonicTime 4163083555586, freq 99994 kHz, minutesWest 480 minutes
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.625.983 [npu_driver.cc:6189] 618662 StreamBindLogicCq: success: deviceId=4, tsId=0, streamId=2, logicCq=312.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:41.625.989 [trace_rb_log.c:137](tid:618674) [RUNTIME_ATRACE_DEV7_TS0] create ring buffer success, msgSize 128 bytes, msgTxtSize 112 bytes, bufferSize 1024 bytes, msg space 128 bytes, total space 131568 bytes
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:41.626.007 [tracer_mgr_operate.c:66](tid:618674) create object RUNTIME_ATRACE_DEV7_TS0 success, exitSave(false), noLock(false).
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.626.003 [npu_driver.cc:5916] 618662 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=e046f000, addr=dfffe046f000size=4096
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:41.626.022 [atrace_api.c:44](tid:618674) AtraceCreate end.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.626.021 [stream.cc:653] 618662 Setup: Success to get sq=2 sq reg virtual addr length=4096.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:41.626.042 [trace_event.c:70](tid:618674) limitedNum 1, processType 0 
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:41.626.056 [trace_event.c:372](tid:618674) set trace event attr limitedNum: 1, processType: 0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.626.073 [runtime.cc:3159] 618674 SetTsdProfCallback: set tsd prof callback
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.626.076 [devmm_svm.c:1972][ascend][curpid:618662,618662][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.626.096 [npu_driver.cc:6080] 618662 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] TDT(618674,python3.9):2025-04-03-09:27:41.626.087 [client_manager.cpp:196][SetProfilingCallback][tid:618674] [TsdClient] set profiling callback success
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.626.139 [runtime.cc:3364] 618674 PrimaryContextRetain: new Context ok, Runtime_alloc_size 424
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.626.167 [context.cc:109] 618674 Init: ObjAllocator alloc success, Runtime_alloc_size 160000(bytes)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.626.250 [context.cc:121] 618674 Init: ObjAllocator alloc success, Runtime_alloc_size 960000(bytes)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.626.264 [context.cc:276] 618674 Init: Runtime_alloc_size is 16000.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.626.262 [stream.cc:291] 618662 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=2, flags_=0x600.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.626.351 [raw_device.cc:803] 618674 UpdateTimeoutConfig: No need to update timeout config.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:41.626.367 [npu_driver_dcache_lock.cpp:39] 618674 AllocAddrForDcache: halMemCtl failed, drvRet=65534, outSize=0
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.626.430 [trs_dev_drv.c:302][ascend][curpid:618670,618670][drv][tsdrv][drvDeviceOpenComm]Open success. (devid=6; fd=36; mmapFd=37)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.626.455 [devmm_svm.c:132][ascend][curpid:618670,618670][drv][devmm][devmm_setup_device]DrvMemDeviceOpen. (devid=6)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.626.475 [devmm_svm.c:122][ascend][curpid:618670,618670][drv][devmm][devmm_set_device_info]Device info. (devid=6; dvpp_size=17179869184; support_bar_mem=1; support_dev_read_only=1; support_dev_mem_map_host=1; support_bar_huge_mem=1; is_alloced_by_malloc=0; host_rw_dev_ro=1; double_pgtable_offset=17592186044416; is_support_host_pin_pre_register=0; is_support_host_mem_pool=0)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.626.512 [raw_device.cc:528] 618674 AllocStackPhyBase: AllocStackPhyBase device_id=7, stackPhyBase32k_=0x12c140000000, stackPhySize=2457600.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.626.551 [npu_driver.cc:3011] 618670 DeviceOpen: Open device success, device_id=6, tsId=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.626.560 [raw_device.cc:232] 618674 LaunchDcacheLockOp: dcache lock has been set or stack addr is not for dcache, dCacheLockFlag_=0, stackAddrIsDcache_=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.626.571 [raw_device.cc:292] 618670 Init: chipType:0x5
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.626.585 [runtime.cc:3393] 618674 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.626.599 [runtime.cc:3560] 618674 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.626.621 [api_impl.cc:2987] 618674 NewDevice: SetCurRef = 0xaaab0103b880,userDeviceId=7,deviceId=7
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.626.619 [raw_device.cc:304] 618670 Init: isAddrFlat:0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.626.637 [runtime.cc:5239] 618674 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.626.640 [raw_device.cc:320] 618670 Init: GetDevInfo, device_id=6, hardwareVersion=0x503
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.626.658 [devmm_svm.c:1972][ascend][curpid:618670,618670][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0x1; out_feature=0x1)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.626.651 [api_impl.cc:2992] 618674 NewDevice: New device success, user_device_id=7, die_num=1.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:41.626.671 [awatchdog_core.c:175](tid:618674) create watchdog for id : 65543, tid : 618674, timeout : 300s
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.626.673 [npu_driver.cc:1578] 618670 SupportNumaTsMemCtrl: chip type=5, support flag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.626.686 [api_impl.cc:3025] 618674 SetDevice: SetDevice success, curCtx=0xaaab0103b880, user_device_id=7.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.626.720 [acl.cpp:115]618674 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.626.735 [acl.cpp:121]618674 GetSocVersion: socVersion is Ascend910B3
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.627.640 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DepthToSpace] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.627.662 [raw_device.cc:352] 618670 Init: Get phy info, phy chip id 6, phy die id 0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.627.685 [runtime.cc:2771] 618670 GetTsdQos: [TSD] start get qos, devId=6
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.627.686 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.627.698 [runtime.cc:5239] 618670 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.627.711 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SpaceToDepth] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.627.714 [tsd_client.cpp:189][TsdCapabilityGet][tid:618670] TsdCapabilityGet Begin.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.627.730 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618670] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.627.744 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618670] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.627.757 [process_mode_manager.cpp:1042][CapabilityGet][tid:618670] [ProcessModeManager] enter into CapabilityGet process deviceId[6] type[0]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.627.774 [process_mode_manager.cpp:386][InitTsdClient][tid:618670] [TsdClient] tsd client has been inited before
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.627.787 [version_verify.cpp:114][SpecialFeatureCheck][tid:618670] VersionVerify: previous type[38], supported
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.627.821 [process_mode_manager.cpp:1065][CapabilityGet][tid:618670] [TsdClient][deviceId=6] [sessionId=1] [type=0]send capability success 
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.627.840 [hdc_client.cpp:154][TsdRecvData][tid:618670] recv timeout is:150000 ms
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.627.845 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.627.879 [stream.cc:688] 618662 Setup: stream setup end, stream_id=2, IsTaskSink=0, sqId=2, cqId=2, deviceId=4, streamResId=65535
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:41.627.905 [stream_state_callback_manager.cc:45] 618662 Notify: not reg stream state callback func!
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.627.921 [api_impl.cc:1162] 618662 StreamCreate: Succ, flags=1536, stream_id=2, context=aaab087d6320
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.627.938 [stream.cpp:189]618662 aclrtSetStreamFailureMode: start to execute aclrtSetStreamFailureMode, mode is 1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.627.960 [stream.cc:3161] 618662 SetFailMode: stream_id=2 is updated from CONTINUE to STOP.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.627.972 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.627.976 [stream.cpp:195]618662 aclrtSetStreamFailureMode: successfully execute aclrtSetStreamFailureMode, mode is 1
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.628.034 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:105] RegCallback] Register callback thread, stream : 0xaaab0965fde0.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.628.069 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:377] CreateDefaultStream] Create ascend default stream, stream id: 0
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.628.085 [stream.cpp:48]618662 aclrtCreateStreamWithConfig: start to execute aclrtCreateStreamWithConfig with priority:0, flag:3
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.628.095 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.628.105 [api_impl.cc:1120] 618662 StreamCreate: priority=0, flags=1536.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.628.140 [npu_driver.cc:404] 618662 StreamIdAlloc: stream id alloc begin, device_id=4, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.628.186 [stream.cc:2246] 618662 AllocExecutedTimesSvm: stream_id=3.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.628.229 [stream_sqcq_manage.cc:147] 618662 Alloc: deviceId=4, tsId=0, drvFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.628.247 [npu_driver.cc:882] 618662 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.628.245 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.628.369 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.628.407 [process_mode_msg_parse.cpp:175][CapabilityResMsgProc][tid:618670] [CapabilityResMsgProc] [sessionID=1]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.628.427 [process_mode_msg_parse.cpp:170][PidQosMsgProc][tid:618670] [TsdClient] PidQosMsgProc recvMsg realDeviceId[6] msgType[39] localDevId[6] rspCode[0],pidqos[1]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.628.444 [hdc_client.cpp:172][TsdRecvData][tid:618670] [deviceId=6] the Tsd recv data already
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.628.458 [process_mode_manager.cpp:1070][CapabilityGet][tid:618670] [TsdClient][logicDeviceId_=6][type=0][pidQos=1][ret=0]recv capability respond finish
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.628.459 [npu_driver.cc:6125] 618662 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.628.475 [runtime.cc:2782] 618670 GetTsdQos: [TSD] get qos success, userDeviceId=6, devId=6, qos=1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.628.482 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.628.496 [engine.cc:78] 618670 Engine: Constructor.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.628.509 [stars_engine.cc:51] 618670 StarsEngine: Constructor.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.628.525 [engine_factory.cc:26] 618670 CreateEngine: new StarsEngine[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.628.522 [npu_driver.cc:6137] 618662 LogicCqAllocateV2: success: deviceId=4, tsId=0, cqId=313, streamId=3, logicCq=313, cqeDepth=4096
, Runtime_alloc_size 320
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.628.547 [npu_driver.cc:6189] 618662 StreamBindLogicCq: success: deviceId=4, tsId=0, streamId=3, logicCq=313.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.628.550 [engine_factory.cc:38] 618670 CreateEngine: Engine init success.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.628.568 [raw_device.cc:364] 618670 Init: new SpmPool ok, Runtime_alloc_size 56(bytes)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.628.566 [npu_driver.cc:5916] 618662 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=e044e000, addr=dfffe044e000size=4096
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.628.584 [stream.cc:653] 618662 Setup: Success to get sq=3 sq reg virtual addr length=4096.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.628.582 [spm_pool.cc:42] 618670 Init: new buffer ok, Runtime_alloc_size 128
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.628.605 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618662,python3.9):2025-04-03-09:27:41.628.634 [devmm_svm.c:1972][ascend][curpid:618662,618662][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.628.654 [npu_driver.cc:6080] 618662 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.628.711 [buffer_allocator.cc:61] 618670 BufferAllocator: alloc success, Runtime_alloc_size 128(bytes)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.628.729 [spm_pool.cc:55] 618670 Init: new BufferAllocator ok, Runtime_alloc_size 152
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.628.719 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.628.745 [raw_device.cc:380] 618670 Init: new UmaArgLoader ok, Runtime_alloc_size 296(bytes)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.628.763 [devmm_svm.c:1972][ascend][curpid:618670,618670][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.628.780 [npu_driver.cc:6080] 618670 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.628.799 [devmm_svm.c:1972][ascend][curpid:618670,618670][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.628.816 [npu_driver.cc:6080] 618670 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.628.846 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.628.872 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.628.960 [stream.cc:291] 618662 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=3, flags_=0x600.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.629.004 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.629.031 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.629.154 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.629.179 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.629.291 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.629.406 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.629.524 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.629.510 [api_impl.cc:3476] 618674 GetDeviceInfo: get device info, deviceId=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.629.542 [api_impl.cc:3476] 618674 GetDeviceInfo: get device info, deviceId=7
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.629.586 [device.cpp:133]618674 UpdatePlatformInfoWithDevice: Successfully to UpdatePlatformInfoWithDevice, deviceId = 7, aicCnt = 20, vecCoreCnt = 40, cubeCoreCnt = 20
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.629.588 [stream.cc:688] 618662 Setup: stream setup end, stream_id=3, IsTaskSink=0, sqId=3, cqId=3, deviceId=4, streamResId=0
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:41.629.609 [stream_state_callback_manager.cc:45] 618662 Notify: not reg stream state callback func!
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.629.605 [device.cpp:154]618674 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 7
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.629.623 [context.cpp:87]618674 aclrtGetCurrentContext: start to execute aclrtGetCurrentContext
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.629.625 [api_impl.cc:1162] 618662 StreamCreate: Succ, flags=1536, stream_id=3, context=aaab087d6320
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.629.643 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.629.647 [context.cpp:98]618674 aclrtGetCurrentContext: successfully execute aclrtGetCurrentContext
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.629.644 [stream.cpp:189]618662 aclrtSetStreamFailureMode: start to execute aclrtSetStreamFailureMode, mode is 1
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.629.669 [stream.cpp:48]618674 aclrtCreateStreamWithConfig: start to execute aclrtCreateStreamWithConfig with priority:0, flag:3
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.629.665 [stream.cc:3161] 618662 SetFailMode: stream_id=3 is updated from CONTINUE to STOP.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.629.683 [stream.cpp:195]618662 aclrtSetStreamFailureMode: successfully execute aclrtSetStreamFailureMode, mode is 1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.629.704 [api_impl.cc:1120] 618674 StreamCreate: priority=0, flags=1536.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.629.719 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:105] RegCallback] Register callback thread, stream : 0xaaab09790360.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.629.764 [npu_driver.cc:404] 618674 StreamIdAlloc: stream id alloc begin, device_id=7, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.629.799 [stream.cc:2246] 618674 AllocExecutedTimesSvm: stream_id=2.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.629.820 [callback.cpp:25]618662 aclrtSubscribeReport: start to execute aclrtSubscribeReport, threadId is 281471738572704.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.629.837 [stream_sqcq_manage.cc:147] 618674 Alloc: deviceId=7, tsId=0, drvFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.629.847 [npu_driver.cc:462] 618662 EventIdAlloc: event id alloc begin, device_id=4, ts_id=0, remote_event_id=0
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.629.851 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.629.853 [npu_driver.cc:882] 618674 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.629.887 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [Tiling][TilingParse]
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:41.629.896 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.629.912 [npu_driver.cc:483] 618662 EventIdAlloc: Event id alloc success, device_id=4, ts_id=0, event_id=0, eventFlag=0
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:41.629.915 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.629.928 [event.cc:347] 618662 GenEventId: Event id alloc success, device_id=4, tsId=0, eventFlag=1, event_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.629.949 [subscribe.cc:54] 618662 AssignGroupId: give groupId=832
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.629.966 [npu_driver.cc:3775] 618662 SqCqAllocate: deviceId=4, tsId=0, groupId=832.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.629.986 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.629.992 [npu_driver.cc:3785] 618662 SqCqAllocate: alloc success, deviceId=4 sqId=82, cqId=82.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.630.024 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.630.030 [subscribe.cc:131] 618662 Insert: callback subscribe: groupId=832, threadId=281471738572704, devId=4, tsId=0, streamId=2, sqId=82, cqId=82
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.630.049 [callback.cpp:31]618662 aclrtSubscribeReport: successfully execute aclrtSubscribeReport, threadId is 281471738572704.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.630.057 [npu_driver.cc:3828] 618816 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=832.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.630.081 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:125] RegCallback] Register callback thread success, stream : 0xaaab0965fde0.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.630.157 [callback.cpp:25]618662 aclrtSubscribeReport: start to execute aclrtSubscribeReport, threadId is 281471730118560.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.630.180 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.630.179 [npu_driver.cc:462] 618662 EventIdAlloc: event id alloc begin, device_id=4, ts_id=0, remote_event_id=0
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.630.188 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.630.200 [npu_driver.cc:483] 618662 EventIdAlloc: Event id alloc success, device_id=4, ts_id=0, event_id=1, eventFlag=0
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:41.630.226 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.630.228 [event.cc:347] 618662 GenEventId: Event id alloc success, device_id=4, tsId=0, eventFlag=1, event_id=1
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:41.630.242 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.630.249 [subscribe.cc:54] 618662 AssignGroupId: give groupId=833
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.630.244 [npu_driver.cc:6125] 618674 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.630.257 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.630.265 [npu_driver.cc:3775] 618662 SqCqAllocate: deviceId=4, tsId=0, groupId=833.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.630.271 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.630.283 [npu_driver.cc:3785] 618662 SqCqAllocate: alloc success, deviceId=4 sqId=83, cqId=83.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.630.294 [npu_driver.cc:6137] 618674 LogicCqAllocateV2: success: deviceId=7, tsId=0, cqId=332, streamId=2, logicCq=332, cqeDepth=4096
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.630.301 [subscribe.cc:131] 618662 Insert: callback subscribe: groupId=833, threadId=281471730118560, devId=4, tsId=0, streamId=3, sqId=83, cqId=83
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.630.317 [npu_driver.cc:6189] 618674 StreamBindLogicCq: success: deviceId=7, tsId=0, streamId=2, logicCq=332.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.630.322 [callback.cpp:31]618662 aclrtSubscribeReport: successfully execute aclrtSubscribeReport, threadId is 281471730118560.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.630.328 [npu_driver.cc:3828] 618817 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=833.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.630.333 [npu_driver.cc:5916] 618674 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=c800a000, addr=dfffc800a000size=4096
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.630.340 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.630.349 [stream.cc:653] 618674 Setup: Success to get sq=2 sq reg virtual addr length=4096.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.630.350 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:125] RegCallback] Register callback thread success, stream : 0xaaab09790360.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.630.375 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:386] CreateDefaultStream] Create ascend communication stream, stream id: 1
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.630.398 [devmm_svm.c:1972][ascend][curpid:618674,618674][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.630.416 [npu_driver.cc:6080] 618674 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.630.460 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.630.459 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:110] Initialize] Config huge_page_reserve_size : 0, device_hbm_huge_page_reserved_size_ : 0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.630.591 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.630.600 [stream.cc:291] 618674 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=2, flags_=0x600.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.630.717 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.630.813 [npu_driver.cc:2616] 618662 MemGetInfoEx: memory info type=1, type=2, free=8863678464, hug_free=56245616640
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.630.859 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:60] AscendVmmAdapter] VMM align size is 2097152
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.630.945 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:158] CheckVmmDriverVersion] Driver path is /usr/local/Ascend
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.630.993 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:187] CheckVmmDriverVersion] Driver version is 25.0.rc1.b070, major version is 25
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.631.022 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:113] IsVmmEnabled] VMM is enabled.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.631.045 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:180] Initialize] Device MOC Size:62420M, Device free MOC Size:62093M, Reserved MOC size for Other Components(HCCL/rts/etc.):3891M, Recommend Reserved MOC size for Other Components:3880M, User define MindSpore MOC Size:0G, MindSpore Used MOC Size:58202M.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.631.070 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_dynamic_mem_adapter.cc:57] Initialize] Ascend Memory Adapter initialize success, Memory Statistics:
Device MOC memory size: 62420M
MindSpore Used memory size: 58202M
Used peak memory usage (without fragments): 0M
Actual peak memory usage (with fragments): 0M

[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.631.100 [event.cpp:260]618662 aclrtSetOpWaitTimeout: start to execute aclrtSetOpWaitTimeout, timeout = 1980s
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.631.123 [api_impl.cc:5713] 618662 SetOpWaitTimeOut: set OP wait timeout:1980.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.631.397 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNormGradV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.171 [engine.cc:188] 618662 SubmitTaskNormal: stream_id=0,task_id=3,task_type=86 (TASK_TIMEOUT_SET).
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.195 [timeout_set_task.cc:115] 618662 ConstructSqeForTimeoutSetTask: TaskTimeoutSetTask ConstructSqe finish,topic_type=0,cmd_type=13
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.215 [stream.cc:1400] 618662 AddTaskToList: public task, stream_id=0, task_id=3, task_type=86 (TASK_TIMEOUT_SET), head=3, tail=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.233 [stream.cc:2595] 618662 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=3, type=86(TASK_TIMEOUT_SET), head=3, tail=4, sqe_num=1, lastTail=3, device_id=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.253 [npu_driver.cc:751] 618662 SqTaskSend: device_id=4, ts_id=0, sq_id=0, sqe_num=1.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.632.241 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.269 [stars_engine.cc:893] 618662 SendTask: Sq task send finished, device_id=4, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=3, task_type=86(TASK_TIMEOUT_SET).
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.290 [stream.cc:1494] 618662 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=3.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.307 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=0, head=3.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.344 [stars_engine.cc:622] 618662 ProcLogicCqUntilEmpty: Task Wait: stream_id=0, logicCqId=311, retCode=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.363 [stream.cc:2886] 618662 StarsWaitForTask: No.0 stream_id=0, taskId=3, currentId=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.377 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.392 [task.cc:185] 618662 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.418 [task.cc:185] 618662 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.431 [logger.cc:152] 618662 TaskFinished: device_id=4, stream_id=0, task_id=3, task_type=86 (TASK_TIMEOUT_SET), task_finish_num=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.452 [stars_engine.cc:437] 618662 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=3, sqHead=4, endTaskId=3, recycleTaskId=3.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.469 [stream.cc:2886] 618662 StarsWaitForTask: No.1 stream_id=0, taskId=3, currentId=3
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.632.483 [event.cpp:262]618662 aclrtSetOpWaitTimeout: successfully execute aclrtSetOpWaitTimeout, timeout = 1980s
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.632.501 [event.cpp:269]618662 aclrtSetOpExecuteTimeOut: start to execute aclrtSetOpExecuteTimeOut, timeout = 900s
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.522 [engine.cc:188] 618662 SubmitTaskNormal: stream_id=0,task_id=4,task_type=86 (TASK_TIMEOUT_SET).
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.540 [timeout_set_task.cc:115] 618662 ConstructSqeForTimeoutSetTask: TaskTimeoutSetTask ConstructSqe finish,topic_type=0,cmd_type=13
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.557 [stream.cc:1400] 618662 AddTaskToList: public task, stream_id=0, task_id=4, task_type=86 (TASK_TIMEOUT_SET), head=4, tail=5
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.574 [stream.cc:2595] 618662 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=4, type=86(TASK_TIMEOUT_SET), head=4, tail=5, sqe_num=1, lastTail=4, device_id=4
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.632.593 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.594 [npu_driver.cc:751] 618662 SqTaskSend: device_id=4, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.611 [stars_engine.cc:893] 618662 SendTask: Sq task send finished, device_id=4, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=4, task_type=86(TASK_TIMEOUT_SET).
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.627 [stream.cc:1494] 618662 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.641 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.657 [stream.cc:2886] 618662 StarsWaitForTask: No.0 stream_id=0, taskId=4, currentId=3
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.671 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.685 [stream.cc:2886] 618662 StarsWaitForTask: No.1 stream_id=0, taskId=4, currentId=3
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.701 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.714 [stream.cc:2886] 618662 StarsWaitForTask: No.2 stream_id=0, taskId=4, currentId=3
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.729 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.744 [stream.cc:2886] 618662 StarsWaitForTask: No.3 stream_id=0, taskId=4, currentId=3
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.757 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.771 [stream.cc:2886] 618662 StarsWaitForTask: No.4 stream_id=0, taskId=4, currentId=3
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.787 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=0, head=5.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.799 [task.cc:185] 618662 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.812 [task.cc:185] 618662 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.838 [logger.cc:152] 618662 TaskFinished: device_id=4, stream_id=0, task_id=4, task_type=86 (TASK_TIMEOUT_SET), task_finish_num=5
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.854 [stars_engine.cc:437] 618662 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=4, sqHead=5, endTaskId=4, recycleTaskId=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.632.871 [stream.cc:2886] 618662 StarsWaitForTask: No.5 stream_id=0, taskId=4, currentId=4
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.632.884 [event.cpp:277]618662 aclrtSetOpExecuteTimeOut: successfully execute aclrtSetOpExecuteTimeOut, timeout = 900s
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.632.911 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:285] Init] End inititializing kernel runtime.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.632.948 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:48] InitDevice] Enter SetRtDevice, current initialize device number:1
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.632.967 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:50] InitDevice] Device 4 has been set
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.632.986 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:381] CreateDefaultStream] The default compute stream is already created, skip.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.633.004 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:390] CreateDefaultStream] The default communication stream is already created, skip.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.633.056 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_pool.cc:165] DefaultEnhancedAscendMemoryPool] DefaultEnhancedAscendMemoryPool constructed.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.633.074 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.633.088 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:397] Initialize] Skip initialization of memory pool since init size is not configured.
[INFO] UTILS(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:41.633.138 [mindspore/ccsrc/utils/offload_context.cc:86] enable_aio] On ascend devices, enable aio and enable pinned mem cannot be turned on at the same time.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.633.266 [context.cpp:72]618662 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.633.289 [api_impl.cc:3717] 618662 ContextSetCurrent: set context=aaab087d6320, flag=0.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.633.327 [context.cpp:80]618662 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.633.351 [context.cpp:72]618662 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.633.369 [api_impl.cc:3717] 618662 ContextSetCurrent: set context=aaab087d6320, flag=0.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.633.381 [context.cpp:80]618662 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.633.533 [acl.cpp:288]618662 aclInit: start to execute aclInit
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.633.573 [acl.cpp:298]618662 aclInit: call ErrorManager.Initialize
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.633.685 [acl.cpp:242]618662 HandleErrorManagerConfig: err_msg mode is set ["1"].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.633.706 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.633.825 [stream.cc:688] 618674 Setup: stream setup end, stream_id=2, IsTaskSink=0, sqId=2, cqId=2, deviceId=7, streamResId=65535
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:41.633.851 [stream_state_callback_manager.cc:45] 618674 Notify: not reg stream state callback func!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.633.840 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.633.868 [api_impl.cc:1162] 618674 StreamCreate: Succ, flags=1536, stream_id=2, context=aaab0103b880
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.633.891 [stream.cpp:189]618674 aclrtSetStreamFailureMode: start to execute aclrtSetStreamFailureMode, mode is 1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.633.910 [stream.cc:3161] 618674 SetFailMode: stream_id=2 is updated from CONTINUE to STOP.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.633.922 [stream.cpp:195]618674 aclrtSetStreamFailureMode: successfully execute aclrtSetStreamFailureMode, mode is 1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.633.959 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.633.970 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:105] RegCallback] Register callback thread, stream : 0xaaab0208b2f0.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.634.032 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:377] CreateDefaultStream] Create ascend default stream, stream id: 0
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.634.045 [stream.cpp:48]618674 aclrtCreateStreamWithConfig: start to execute aclrtCreateStreamWithConfig with priority:0, flag:3
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.634.064 [api_impl.cc:1120] 618674 StreamCreate: priority=0, flags=1536.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.634.095 [npu_driver.cc:404] 618674 StreamIdAlloc: stream id alloc begin, device_id=7, priority=0, ts_id=0, remote_stream_id=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.634.115 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.634.128 [stream.cc:2246] 618674 AllocExecutedTimesSvm: stream_id=3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.634.166 [stream_sqcq_manage.cc:147] 618674 Alloc: deviceId=7, tsId=0, drvFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.634.181 [npu_driver.cc:882] 618674 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.634.242 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.634.409 [npu_driver.cc:6125] 618674 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.634.479 [npu_driver.cc:6137] 618674 LogicCqAllocateV2: success: deviceId=7, tsId=0, cqId=333, streamId=3, logicCq=333, cqeDepth=4096
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.634.512 [npu_driver.cc:6189] 618674 StreamBindLogicCq: success: deviceId=7, tsId=0, streamId=3, logicCq=333.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.634.528 [npu_driver.cc:5916] 618674 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=c8009000, addr=dfffc8009000size=4096
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.634.543 [stream.cc:653] 618674 Setup: Success to get sq=3 sq reg virtual addr length=4096.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.634.541 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPool3DWithArgmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618674,python3.9):2025-04-03-09:27:41.634.587 [devmm_svm.c:1972][ascend][curpid:618674,618674][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.634.606 [npu_driver.cc:6080] 618674 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.634.873 [buffer_allocator.cc:61] 618670 BufferAllocator: alloc success, Runtime_alloc_size 32768(bytes)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.634.906 [task_allocator.cc:46] 618670 DefaultAlloc: Runtime_alloc_size 32768(bytes)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.634.899 [stream.cc:291] 618674 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=3, flags_=0x600.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.634.942 [buffer_allocator.cc:61] 618670 BufferAllocator: alloc success, Runtime_alloc_size 104(bytes)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.634.958 [h2d_copy_mgr.cc:45] 618670 H2DCopyMgr: alloc h2d copy buff success, policy 2
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.634.973 [devmm_svm.c:1972][ascend][curpid:618670,618670][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.634.991 [npu_driver.cc:6080] 618670 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.635.538 [stream.cc:688] 618674 Setup: stream setup end, stream_id=3, IsTaskSink=0, sqId=3, cqId=3, deviceId=7, streamResId=0
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:41.635.556 [stream_state_callback_manager.cc:45] 618674 Notify: not reg stream state callback func!
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.635.568 [api_impl.cc:1162] 618674 StreamCreate: Succ, flags=1536, stream_id=3, context=aaab0103b880
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.635.583 [stream.cpp:189]618674 aclrtSetStreamFailureMode: start to execute aclrtSetStreamFailureMode, mode is 1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.635.602 [stream.cc:3161] 618674 SetFailMode: stream_id=3 is updated from CONTINUE to STOP.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.635.614 [stream.cpp:195]618674 aclrtSetStreamFailureMode: successfully execute aclrtSetStreamFailureMode, mode is 1
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.635.648 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:105] RegCallback] Register callback thread, stream : 0xaaab021bc480.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.635.814 [callback.cpp:25]618674 aclrtSubscribeReport: start to execute aclrtSubscribeReport, threadId is 281471008829344.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.635.837 [npu_driver.cc:462] 618674 EventIdAlloc: event id alloc begin, device_id=7, ts_id=0, remote_event_id=0
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.635.857 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:41.635.895 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.635.896 [npu_driver.cc:483] 618674 EventIdAlloc: Event id alloc success, device_id=7, ts_id=0, event_id=0, eventFlag=0
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:41.635.910 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.635.916 [event.cc:347] 618674 GenEventId: Event id alloc success, device_id=7, tsId=0, eventFlag=1, event_id=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.635.908 [buffer_allocator.cc:61] 618670 BufferAllocator: alloc success, Runtime_alloc_size 262144(bytes)
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.635.932 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.635.932 [task_allocator.cc:46] 618670 DefaultAlloc: Runtime_alloc_size 4096(bytes)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.635.934 [subscribe.cc:54] 618674 AssignGroupId: give groupId=64
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.635.955 [npu_driver.cc:3775] 618674 SqCqAllocate: deviceId=7, tsId=0, groupId=64.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.635.950 [buffer_allocator.cc:61] 618670 BufferAllocator: alloc success, Runtime_alloc_size 128(bytes)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.635.966 [h2d_copy_mgr.cc:45] 618670 H2DCopyMgr: alloc h2d copy buff success, policy 2
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.635.976 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.635.987 [devmm_svm.c:1972][ascend][curpid:618670,618670][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.636.005 [npu_driver.cc:6080] 618670 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.635.997 [npu_driver.cc:3785] 618674 SqCqAllocate: alloc success, deviceId=7 sqId=116, cqId=116.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.636.025 [subscribe.cc:131] 618674 Insert: callback subscribe: groupId=64, threadId=281471008829344, devId=7, tsId=0, streamId=2, sqId=116, cqId=116
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.636.044 [callback.cpp:31]618674 aclrtSubscribeReport: successfully execute aclrtSubscribeReport, threadId is 281471008829344.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.636.051 [npu_driver.cc:3828] 618818 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=64.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.636.074 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:125] RegCallback] Register callback thread success, stream : 0xaaab0208b2f0.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.636.175 [callback.cpp:25]618674 aclrtSubscribeReport: start to execute aclrtSubscribeReport, threadId is 281471000375200.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.636.197 [npu_driver.cc:462] 618674 EventIdAlloc: event id alloc begin, device_id=7, ts_id=0, remote_event_id=0
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.636.199 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.636.219 [npu_driver.cc:483] 618674 EventIdAlloc: Event id alloc success, device_id=7, ts_id=0, event_id=1, eventFlag=0
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:41.636.228 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.636.234 [event.cc:347] 618674 GenEventId: Event id alloc success, device_id=7, tsId=0, eventFlag=1, event_id=1
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:41.636.242 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.636.248 [subscribe.cc:54] 618674 AssignGroupId: give groupId=65
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.636.256 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.636.261 [npu_driver.cc:3775] 618674 SqCqAllocate: deviceId=7, tsId=0, groupId=65.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.636.270 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.636.280 [npu_driver.cc:3785] 618674 SqCqAllocate: alloc success, deviceId=7 sqId=117, cqId=117.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.636.293 [subscribe.cc:131] 618674 Insert: callback subscribe: groupId=65, threadId=281471000375200, devId=7, tsId=0, streamId=3, sqId=117, cqId=117
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.636.311 [callback.cpp:31]618674 aclrtSubscribeReport: successfully execute aclrtSubscribeReport, threadId is 281471000375200.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.636.316 [npu_driver.cc:3828] 618819 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=65.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.636.337 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:125] RegCallback] Register callback thread success, stream : 0xaaab021bc480.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.636.359 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:386] CreateDefaultStream] Create ascend communication stream, stream id: 1
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.636.436 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:110] Initialize] Config huge_page_reserve_size : 0, device_hbm_huge_page_reserved_size_ : 0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.636.765 [npu_driver.cc:2616] 618674 MemGetInfoEx: memory info type=1, type=2, free=8863907840, hug_free=56245616640
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.636.783 [buffer_allocator.cc:61] 618670 BufferAllocator: alloc success, Runtime_alloc_size 524288(bytes)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.636.807 [task_allocator.cc:46] 618670 DefaultAlloc: Runtime_alloc_size 2048(bytes)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.636.825 [buffer_allocator.cc:61] 618670 BufferAllocator: alloc success, Runtime_alloc_size 136(bytes)
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.636.839 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:60] AscendVmmAdapter] VMM align size is 2097152
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.636.841 [h2d_copy_mgr.cc:45] 618670 H2DCopyMgr: alloc h2d copy buff success, policy 2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.636.853 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPool3DGradWithArgmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.636.858 [uma_arg_loader.cc:86] 618670 Init: new BufferAllocator superArgAllocator_ ok, Runtime_alloc_size 152
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.636.885 [task_allocator.cc:46] 618670 DefaultAlloc: Runtime_alloc_size 32768(bytes)
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.636.903 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:158] CheckVmmDriverVersion] Driver path is /usr/local/Ascend
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.636.913 [buffer_allocator.cc:61] 618670 BufferAllocator: alloc success, Runtime_alloc_size 104(bytes)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.636.928 [uma_arg_loader.cc:93] 618670 Init: new BufferAllocator handleAllocator_ ok, Runtime_alloc_size 152
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.636.942 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:187] CheckVmmDriverVersion] Driver version is 25.0.rc1.b070, major version is 25
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.636.969 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:113] IsVmmEnabled] VMM is enabled.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.636.989 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:180] Initialize] Device MOC Size:62420M, Device free MOC Size:62093M, Reserved MOC size for Other Components(HCCL/rts/etc.):3891M, Recommend Reserved MOC size for Other Components:3880M, User define MindSpore MOC Size:0G, MindSpore Used MOC Size:58202M.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.637.010 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_dynamic_mem_adapter.cc:57] Initialize] Ascend Memory Adapter initialize success, Memory Statistics:
Device MOC memory size: 62420M
MindSpore Used memory size: 58202M
Used peak memory usage (without fragments): 0M
Actual peak memory usage (with fragments): 0M

[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.637.033 [event.cpp:260]618674 aclrtSetOpWaitTimeout: start to execute aclrtSetOpWaitTimeout, timeout = 1980s
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.637.052 [api_impl.cc:5713] 618674 SetOpWaitTimeOut: set OP wait timeout:1980.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.637.717 [buffer_allocator.cc:61] 618670 BufferAllocator: alloc success, Runtime_alloc_size 131072(bytes)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.637.739 [uma_arg_loader.cc:102] 618670 Init: new BufferAllocator kernelInfoAllocator_ ok, Runtime_alloc_size 152
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.637.724 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.637.753 [uma_arg_loader.cc:104] 618670 Init: ALLOC PCIE is support[1]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.637.767 [devmm_svm.c:1972][ascend][curpid:618670,618670][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.637.784 [npu_driver.cc:6080] 618670 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.637.895 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.637.905 [buffer_allocator.cc:61] 618670 BufferAllocator: alloc success, Runtime_alloc_size 32768(bytes)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.637.923 [h2d_copy_mgr.cc:45] 618670 H2DCopyMgr: alloc h2d copy buff success, policy 1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.637.936 [raw_device.cc:393] 618670 Init: new StreamSqCqManage ok, Runtime_alloc_size 416(bytes)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.637.953 [raw_device.cc:398] 618670 Init: New taskFactory ok, Runtime_alloc_size 136(bytes)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.637.967 [task_allocator.cc:46] 618670 DefaultAlloc: Runtime_alloc_size 393216(bytes)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.638.064 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CTCLossV3Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.126 [engine.cc:188] 618674 SubmitTaskNormal: stream_id=0,task_id=3,task_type=86 (TASK_TIMEOUT_SET).
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.638.131 [buffer_allocator.cc:61] 618670 BufferAllocator: alloc success, Runtime_alloc_size 104(bytes)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.146 [timeout_set_task.cc:115] 618674 ConstructSqeForTimeoutSetTask: TaskTimeoutSetTask ConstructSqe finish,topic_type=0,cmd_type=13
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.160 [stream.cc:1400] 618674 AddTaskToList: public task, stream_id=0, task_id=3, task_type=86 (TASK_TIMEOUT_SET), head=3, tail=4
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.176 [stream.cc:2595] 618674 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=3, type=86(TASK_TIMEOUT_SET), head=3, tail=4, sqe_num=1, lastTail=3, device_id=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.195 [npu_driver.cc:751] 618674 SqTaskSend: device_id=7, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.215 [stars_engine.cc:893] 618674 SendTask: Sq task send finished, device_id=7, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=3, task_type=86(TASK_TIMEOUT_SET).
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.229 [stream.cc:1494] 618674 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.244 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=0, head=3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.277 [stars_engine.cc:622] 618674 ProcLogicCqUntilEmpty: Task Wait: stream_id=0, logicCqId=331, retCode=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.293 [stream.cc:2886] 618674 StarsWaitForTask: No.0 stream_id=0, taskId=3, currentId=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.306 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=0, head=3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.320 [stream.cc:2886] 618674 StarsWaitForTask: No.1 stream_id=0, taskId=3, currentId=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.333 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.638.330 [raw_device.cc:109] 618670 Init: ObjAllocator alloc success, Runtime_alloc_size 160000(bytes)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.348 [task.cc:185] 618674 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.373 [task.cc:185] 618674 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.387 [logger.cc:152] 618674 TaskFinished: device_id=7, stream_id=0, task_id=3, task_type=86 (TASK_TIMEOUT_SET), task_finish_num=4
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.404 [stars_engine.cc:437] 618674 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=3, sqHead=4, endTaskId=3, recycleTaskId=3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.419 [stream.cc:2886] 618674 StarsWaitForTask: No.2 stream_id=0, taskId=3, currentId=3
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.638.434 [event.cpp:262]618674 aclrtSetOpWaitTimeout: successfully execute aclrtSetOpWaitTimeout, timeout = 1980s
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.638.449 [event.cpp:269]618674 aclrtSetOpExecuteTimeOut: start to execute aclrtSetOpExecuteTimeOut, timeout = 900s
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.466 [engine.cc:188] 618674 SubmitTaskNormal: stream_id=0,task_id=4,task_type=86 (TASK_TIMEOUT_SET).
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.481 [timeout_set_task.cc:115] 618674 ConstructSqeForTimeoutSetTask: TaskTimeoutSetTask ConstructSqe finish,topic_type=0,cmd_type=13
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.494 [stream.cc:1400] 618674 AddTaskToList: public task, stream_id=0, task_id=4, task_type=86 (TASK_TIMEOUT_SET), head=4, tail=5
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.507 [stream.cc:2595] 618674 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=4, type=86(TASK_TIMEOUT_SET), head=4, tail=5, sqe_num=1, lastTail=4, device_id=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.524 [npu_driver.cc:751] 618674 SqTaskSend: device_id=7, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.543 [stars_engine.cc:893] 618674 SendTask: Sq task send finished, device_id=7, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=4, task_type=86(TASK_TIMEOUT_SET).
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.558 [stream.cc:1494] 618674 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=4.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.572 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.586 [stream.cc:2886] 618674 StarsWaitForTask: No.0 stream_id=0, taskId=4, currentId=3
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.598 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.612 [stream.cc:2886] 618674 StarsWaitForTask: No.1 stream_id=0, taskId=4, currentId=3
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.625 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.637 [stream.cc:2886] 618674 StarsWaitForTask: No.2 stream_id=0, taskId=4, currentId=3
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.651 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=0, head=5.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.662 [task.cc:185] 618674 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.675 [task.cc:185] 618674 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.688 [logger.cc:152] 618674 TaskFinished: device_id=7, stream_id=0, task_id=4, task_type=86 (TASK_TIMEOUT_SET), task_finish_num=5
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.703 [stars_engine.cc:437] 618674 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=4, sqHead=5, endTaskId=4, recycleTaskId=4.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.638.717 [stream.cc:2886] 618674 StarsWaitForTask: No.3 stream_id=0, taskId=4, currentId=4
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.638.711 [raw_device.cc:121] 618670 Init: ObjAllocator alloc success, Runtime_alloc_size 960000(bytes)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.638.729 [raw_device.cc:425] 618670 Init: Runtime_alloc_size=64000(bytes)
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.638.731 [event.cpp:277]618674 aclrtSetOpExecuteTimeOut: successfully execute aclrtSetOpExecuteTimeOut, timeout = 900s
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.638.760 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:285] Init] End inititializing kernel runtime.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.638.790 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:48] InitDevice] Enter SetRtDevice, current initialize device number:1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.638.790 [npu_driver.cc:404] 618670 StreamIdAlloc: stream id alloc begin, device_id=6, priority=0, ts_id=0, remote_stream_id=0
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.638.807 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:50] InitDevice] Device 7 has been set
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.638.824 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:381] CreateDefaultStream] The default compute stream is already created, skip.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.638.840 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:390] CreateDefaultStream] The default communication stream is already created, skip.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.638.873 [stream.cc:2246] 618670 AllocExecutedTimesSvm: stream_id=0.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.638.892 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_pool.cc:165] DefaultEnhancedAscendMemoryPool] DefaultEnhancedAscendMemoryPool constructed.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.638.911 [stream_sqcq_manage.cc:147] 618670 Alloc: deviceId=6, tsId=0, drvFlag=0
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.638.918 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:397] Initialize] Skip initialization of memory pool since init size is not configured.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.638.928 [npu_driver.cc:882] 618670 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] UTILS(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:41.638.957 [mindspore/ccsrc/utils/offload_context.cc:86] enable_aio] On ascend devices, enable aio and enable pinned mem cannot be turned on at the same time.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.639.043 [context.cpp:72]618674 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.639.062 [api_impl.cc:3717] 618674 ContextSetCurrent: set context=aaab0103b880, flag=0.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.639.093 [context.cpp:80]618674 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.639.091 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CTCLossV3] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.639.124 [context.cpp:72]618674 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.639.140 [api_impl.cc:3717] 618674 ContextSetCurrent: set context=aaab0103b880, flag=0.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.639.153 [context.cpp:80]618674 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.639.257 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.639.301 [acl.cpp:288]618674 aclInit: start to execute aclInit
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.639.336 [acl.cpp:298]618674 aclInit: call ErrorManager.Initialize
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.639.423 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3DGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.639.435 [acl.cpp:242]618674 HandleErrorManagerConfig: err_msg mode is set ["1"].
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.639.553 [npu_driver.cc:6125] 618670 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.639.652 [npu_driver.cc:6137] 618670 LogicCqAllocateV2: success: deviceId=6, tsId=0, cqId=297, streamId=0, logicCq=297, cqeDepth=4096
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.639.687 [npu_driver.cc:6189] 618670 StreamBindLogicCq: success: deviceId=6, tsId=0, streamId=0, logicCq=297.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.639.707 [npu_driver.cc:5916] 618670 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=cf406000, addr=dfffcf406000size=4096
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.639.724 [stream.cc:653] 618670 Setup: Success to get sq=0 sq reg virtual addr length=4096.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.639.819 [stream.cc:276] 618670 CreateStreamTaskRes: Normal STREAM Setup stream_id=0 flags_=0xc0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.639.838 [stream.cc:688] 618670 Setup: stream setup end, stream_id=0, IsTaskSink=0, sqId=0, cqId=0, deviceId=6, streamResId=0
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:41.639.859 [stream_state_callback_manager.cc:45] 618670 Notify: not reg stream state callback func!
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.639.874 [raw_device.cc:593] 618670 Start: new primary Stream ok, Runtime_alloc_size 3872, stream_id=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.639.900 [npu_driver.cc:404] 618670 StreamIdAlloc: stream id alloc begin, device_id=6, priority=0, ts_id=0, remote_stream_id=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.639.918 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.639.926 [stream_sqcq_manage.cc:147] 618670 Alloc: deviceId=6, tsId=0, drvFlag=16
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.639.942 [npu_driver.cc:882] 618670 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.640.042 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.640.042 [tsch_stream.cc:45] 618670 Setup: stream setup end, stream_id=1, type=1, IsTaskSink=0, sqId=1, cqId=1, deviceId=6 streamResId=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.640.062 [raw_device.cc:1219] 618670 TschStreamSetup: Tsch setup ffts dsa stream ok, stream_id=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.640.141 [osal.cc:309] 618670 CreateThread: Runtime_alloc_size 56
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.640.175 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.640.295 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.640.417 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.640.543 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.640.661 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.640.777 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.640.900 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.641.015 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.641.148 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.641.306 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PadV3GradReplication] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.641.427 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.641.544 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.641.736 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.641.862 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.641.978 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.642.096 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.642.246 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.642.435 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.642.561 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.642.683 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.642.709 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.642.877 [error_manager.cc:673]618662 ParseJsonFile:Parse json file:/usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/../conf/error_manager/error_code.json success
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.642.903 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.643.024 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.643.148 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.643.327 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.643.447 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.643.612 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.643.630 [acl.cpp:315]618662 aclInit: call ge interface executor.Initialize
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.643.730 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] PROFILING(618662,python3.9):2025-04-03-09:27:41.643.708 [prof_atls_plugin.cpp:210] (tid:618662) Module[45] register callback of ctrl handle.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.643.768 [ge_executor.cc:273]618662 Initialize:Init GeExecutor begin.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.643.837 [op_lib_register.cc:117]618662 GetAllCustomOpApiSoPaths:value of env ASCEND_CUSTOM_OPP_PATH is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/ho
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.643.857 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.643.926 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.643.965 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.643.986 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.643.999 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.644.013 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.644.035 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.644.068 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.644.100 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.644.130 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.644.136 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.644.173 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.644.175 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.644.211 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.644.244 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.644.285 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.644.297 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.644.316 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.644.347 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.644.377 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.644.408 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.644.416 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.644.438 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.644.444 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.644.437 [osal.cc:182] 618670 Start: mmCreateTaskWithThreadAttr, retCode=0, name_=MONITOR_0, i=0
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.644.469 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.644.502 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.644.522 [osal.cc:309] 618670 CreateThread: Runtime_alloc_size 56
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.644.533 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.644.569 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.644.564 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.644.557 [stars_engine.cc:1785] 618820 MonitoringRun: Starts Monitor thread has entered, ts_id=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.644.606 [osal.cc:182] 618670 Start: mmCreateTaskWithThreadAttr, retCode=0, name_=RT_RECYCLE, i=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.644.610 [runtime.cc:5239] 618820 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.644.608 [op_lib_register.cc:165]618662 CallInitFunc:CallInitFunc 0 successfully, op_lib_paths_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/je
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.644.634 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618820] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.644.642 [stars_engine.cc:201] 618821 RecycleThreadRun: RecycleThreadRun thread enter.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.644.656 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618820] [TsdClient] g_userDeviceInfo is empty.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.644.665 [plugin_manager.cc:616]618662 GetOpTilingForwardOrderPath:Enter GetOpTilingPath schedule
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.644.684 [plugin_manager.cc:108]618662 GetOppPath:Enter get opp path schedule
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.644.689 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.644.695 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618820] [TsdClient] g_userDeviceInfo is empty.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.644.719 [plugin_manager.cc:117]618662 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.644.727 [runtime.cc:3077] 618820 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=6, devId=6, tdt status=0
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.644.744 [plugin_manager.cc:624]618662 GetOpTilingForwardOrderPath:Opp plugin path structure is new version!
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.644.762 [plugin_manager.cc:206]618662 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.644.797 [npu_driver.cc:6306] 618820 GetDeviceStatus: GetDeviceStatus status=1.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.644.812 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.644.821 [stars_engine.cc:1855] 618820 ReportHBMRasProc: g_hbmRasCheckDeviceId init, dev_id=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.644.838 [npu_driver.cc:551] 618820 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.645.004 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.035 [engine.cc:188] 618670 SubmitTaskNormal: stream_id=0,task_id=0,task_type=97 (STARS_VERSION).
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.072 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=0, head=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.107 [task_info.cc:1596] 618670 ConstructSqeForStarsVersionTask: Send GetStarsVersionTask succ,sqe_type=3,pre_p=1,sqe->rt_streamID=32768,stream_id=0,task_id=0,task_type=97.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.645.132 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.135 [stream.cc:1400] 618670 AddTaskToList: public task, stream_id=0, task_id=0, task_type=97 (STARS_VERSION), head=0, tail=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.152 [stream.cc:2595] 618670 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=0, type=97(STARS_VERSION), head=0, tail=1, sqe_num=1, lastTail=0, device_id=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.198 [npu_driver.cc:751] 618670 SqTaskSend: device_id=6, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.214 [stars_engine.cc:893] 618670 SendTask: Sq task send finished, device_id=6, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=0, task_type=97(STARS_VERSION).
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.231 [stars_engine.cc:1122] 618670 SyncTask: Task Wait: device_id=6, stream_id=0, task_id=0, logicCqId=297.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.277 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=0, head=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.302 [stars_engine.cc:1071] 618670 IsSyncTaskFinish: Sync task finished, sqHead=0 finishedTaskId=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.332 [stars_engine.cc:1017] 618670 ProcReport: Get logic report: cnt=1, idx=0, stream_id=0, report task_id=0, sync task_id=0, sqeType=3, sqeHead=0, retCode=0x23, errType=0x20.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.645.339 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GridSampler2DGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.371 [task.cc:185] 618670 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.387 [stars_engine.cc:1027] 618670 ProcReport: taskType=97.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.410 [task.cc:185] 618670 GetTask: this stream no taskRes, stream_id=0
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.425 [stars_engine.cc:1570] 618670 ProcLogicCqReport: CQE warning, device_id=6, stream_id=0, task_id=0, sqe_type=3(place holder), errType=0x20(sq sw status error), sqSwStatus=0x23
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.458 [task.cc:185] 618670 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.474 [logger.cc:152] 618670 TaskFinished: device_id=6, stream_id=0, task_id=0, task_type=97 (STARS_VERSION), task_finish_num=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.490 [task_info.cc:1614] 618670 DoCompleteSuccessForStarsVersionTask: Complete StarsVersionTask succ, retCode=35,tschVersion=35.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.503 [raw_device.cc:1305] 618670 SetTschVersion: Set tsch version=35.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.645.493 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GridSampler3DGrad] register OP_IMPL : [Tiling][TilingParse]
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.533 [stars_engine.cc:1351] 618670 StarsResumeRtsq: Begin to query sq status, stream_id=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.553 [npu_driver.cc:5618] 618670 GetSqEnable: deviceId=6, tsId=0, sqId=0, enable=0.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.568 [stars_engine.cc:1365] 618670 StarsResumeRtsq: sq already disable, stream_id=0, queryCnt=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.580 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=0, head=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.595 [npu_driver.cc:5595] 618670 GetSqTail: deviceId=6, tsId=0, sqId=0, tail=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.609 [npu_driver.cc:5406] 618670 SetSqHead: deviceId=6, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.625 [npu_driver.cc:5357] 618670 EnableSq: deviceId=6, tsId=0, sqId=0.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.645.627 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.643 [stars_engine.cc:1430] 618670 StarsResumeRtsq: Resume stream_id=0, sq_id=0, sq_head=0, task_id=0, taskType=97, head=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.660 [npu_driver.cc:5618] 618670 GetSqEnable: deviceId=6, tsId=0, sqId=0, enable=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.676 [stream.cc:1494] 6186[INFO] GE(618666,python3.9):2025-04-03-09:27:41.645.676 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.645.672 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
70 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.645.692 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.703 [raw_device.cc:1331] 618670 GetStarsVersion: send alloc get stars version task, stream_id=0, retCode:0
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.645.708 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.645.721 [raw_device.cc:610] 618670 Start: Get TschVersion, tschVersion=35.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.645.760 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.645.864 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.646.051 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PadV4Grad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.646.104 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.646.140 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.646.157 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.646.171 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.646.210 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.646.246 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PadV3GradReplicate] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.646.251 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.646.269 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.646.299 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.646.314 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.646.329 [plugin_manager.cc:215]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.646.370 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.646.499 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.646.618 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.646.664 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.646.700 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.646.717 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.646.730 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.646.731 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.646.766 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.646.763 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.646.963 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.647.081 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.647.104 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.647.139 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.647.156 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.647.170 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.647.205 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.647.209 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.647.247 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.647.263 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.647.276 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.647.290 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.647.308 [plugin_manager.cc:215]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.647.324 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.647.402 [engine.cc:188] 618670 SubmitTaskNormal: stream_id=0,task_id=1,task_type=83 (DEVICE_RINGBUFFER_CONTROL).
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.647.446 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.647.515 [ringbuffer_maintain_task.cc:98] 618670 ConstructSqeForRingBufferMaintainTask: RingBufferMaintainTask stream_id=0, task_id=1, offset=0x1280
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.647.540 [stream.cc:1400] 618670 AddTaskToList: public task, stream_id=0, task_id=1, task_type=83 (DEVICE_RINGBUFFER_CONTROL), head=1, tail=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.647.558 [stream.cc:2595] 618670 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=1, type=83(DEVICE_RINGBUFFER_CONTROL), head=1, tail=2, sqe_num=1, lastTail=1, device_id=6
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.647.568 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.647.588 [npu_driver.cc:751] 618670 SqTaskSend: device_id=6, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.647.606 [stars_engine.cc:893] 618670 SendTask: Sq task send finished, device_id=6, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=1, task_type=83(DEVICE_RINGBUFFER_CONTROL).
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.647.624 [stream.cc:1494] 618670 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.647.646 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=0, head=1.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.647.652 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.647.683 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.647.687 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.647.705 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.647.712 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.647.720 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.647.710 [stars_engine.cc:622] 618670 ProcLogicCqUntilEmpty: Task Wait: stream_id=0, logicCqId=297, retCode=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.647.730 [stream.cc:2886] 618670 StarsWaitForTask: No.0 stream_id=0, taskId=1, currentId=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.647.746 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=0, head=1.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.647.755 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.647.761 [stream.cc:2886] 618670 StarsWaitForTask: No.1 stream_id=0, taskId=1, currentId=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.647.776 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.647.791 [stream.cc:2886] 618670 StarsWaitForTask: No.2 stream_id=0, taskId=1, currentId=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.647.804 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=0, head=2.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.647.823 [task.cc:185] 618670 GetTask: this stream no taskRes, stream_id=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.647.836 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.647.841 [task.cc:185] 618670 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.647.859 [logger.cc:152] 618670 TaskFinished: device_id=6, stream_id=0, task_id=1, task_type=83 (DEVICE_RINGBUFFER_CONTROL), task_finish_num=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.647.885 [stars_engine.cc:437] 618670 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=1, sqHead=2, endTaskId=1, recycleTaskId=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.647.902 [stream.cc:2886] 618670 StarsWaitForTask: No.3 stream_id=0, taskId=1, currentId=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.648.004 [engine.cc:188] 618670 SubmitTaskNormal: stream_id=0,task_id=2,task_type=29 (ALLOC_DSA_ADDR).
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.648.025 [task_info.cc:111] 618670 ConstructSqeForAllocDsaAddrTask: Send AllocDsaAddrTask succ, sqe_type=3, pre_p=1, stream_id=0, task_id=2, task_type=29, dsa_sq_id=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.648.043 [stream.cc:1400] 618670 AddTaskToList: public task, stream_id=0, task_id=2, task_type=29 (ALLOC_DSA_ADDR), head=2, tail=3
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.648.067 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.648.071 [stream.cc:2595] 618670 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=2, type=29(ALLOC_DSA_ADDR), head=2, tail=3, sqe_num=1, lastTail=2, device_id=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.648.093 [npu_driver.cc:751] 618670 SqTaskSend: device_id=6, ts_id=0, sq_id=0, sqe_num=1.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.648.091 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.648.110 [stars_engine.cc:893] 618670 SendTask: Sq task send finished, device_id=6, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=2, task_type=29(ALLOC_DSA_ADDR).
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.648.125 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.648.141 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.648.128 [stars_engine.cc:1122] 618670 SyncTask: Task Wait: device_id=6, stream_id=0, task_id=2, logicCqId=297.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.648.164 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.648.205 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.648.242 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.648.259 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.648.272 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.648.290 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.648.264 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=0, head=3.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.648.305 [stars_engine.cc:1071] 618670 IsSyncTaskFinish: Sync task finished, sqHead=3 finishedTaskId=2
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.648.310 [plugin_manager.cc:215]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.648.313 [error_manager.cc:673]618674 ParseJsonFile:Parse json file:/usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/../conf/error_manager/error_code.json success
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.648.324 [stars_engine.cc:1017] 618670 ProcReport: Get logic report: cnt=1, idx=0, stream_id=0, report task_id=2, sync task_id=2, sqeType=3, sqeHead=2, retCode=0, errType=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.648.345 [task.cc:185] 618670 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.648.361 [stars_engine.cc:1027] 618670 ProcReport: taskType=29.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.648.376 [task.cc:185] 618670 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.648.390 [task.cc:185] 618670 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.648.407 [logger.cc:152] 618670 TaskFinished: device_id=6, stream_id=0, task_id=2, task_type=29 (ALLOC_DSA_ADDR), task_finish_num=3
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.648.434 [npu_driver.cc:5618] 618670 GetSqEnable: deviceId=6, tsId=0, sqId=0, enable=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.648.451 [stream.cc:1494] 618670 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=2.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.648.464 [raw_device.cc:1232] 618670 TschStreamAllocDsaAddr: send alloc dsa sq task, stream_id=1, retCode:0
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:41.648.490 [atrace_api.c:40](tid:618670) AtraceCreate start.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.648.645 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.648.680 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.648.697 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.648.725 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.648.759 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.649.070 [acl.cpp:315]618674 aclInit: call ge interface executor.Initialize
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.649.093 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.649.128 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] PROFILING(618674,python3.9):2025-04-03-09:27:41.649.131 [prof_atls_plugin.cpp:210] (tid:618674) Module[45] register callback of ctrl handle.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.649.146 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.649.165 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.649.166 [ge_executor.cc:273]618674 Initialize:Init GeExecutor begin.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.649.202 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.649.216 [op_lib_register.cc:117]618674 GetAllCustomOpApiSoPaths:value of env ASCEND_CUSTOM_OPP_PATH is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/ho
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.649.240 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.649.258 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.649.274 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.649.288 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.649.306 [plugin_manager.cc:215]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.649.306 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.649.349 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.649.383 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.649.375 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.649.414 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.649.444 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.649.473 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.649.501 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.649.529 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.649.557 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.649.585 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:41.649.587 [trace_rb_log.c:45](tid:618670) init ring buffer time finished, realTime 1743643661648522906, monotonicTime 4163085917149, freq 99996 kHz, minutesWest 480 minutes
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.649.613 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:41.649.607 [trace_rb_log.c:137](tid:618670) [RUNTIME_ATRACE_DEV6_TS0] create ring buffer success, msgSize 128 bytes, msgTxtSize 112 bytes, bufferSize 1024 bytes, msg space 128 bytes, total space 131568 bytes
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:41.649.628 [tracer_mgr_operate.c:66](tid:618670) create object RUNTIME_ATRACE_DEV6_TS0 success, exitSave(false), noLock(false).
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:41.649.642 [atrace_api.c:44](tid:618670) AtraceCreate end.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.649.642 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.649.648 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:41.649.660 [trace_event.c:70](tid:618670) limitedNum 1, processType 0 
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:41.649.676 [trace_event.c:372](tid:618670) set trace event attr limitedNum: 1, processType: 0
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.649.681 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.649.683 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.649.696 [runtime.cc:3159] 618670 SetTsdProfCallback: set tsd prof callback
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.649.701 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.649.711 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[INFO] TDT(618670,python3.9):2025-04-03-09:27:41.649.715 [client_manager.cpp:196][SetProfilingCallback][tid:618670] [TsdClient] set profiling callback success
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.649.720 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.649.739 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.649.758 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.649.769 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.649.779 [runtime.cc:3364] 618670 PrimaryContextRetain: new Context ok, Runtime_alloc_size 424
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.649.804 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.649.811 [context.cc:109] 618670 Init: ObjAllocator alloc success, Runtime_alloc_size 160000(bytes)
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.649.835 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.649.864 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.649.892 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.649.890 [context.cc:121] 618670 Init: ObjAllocator alloc success, Runtime_alloc_size 960000(bytes)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.649.909 [context.cc:276] 618670 Init: Runtime_alloc_size is 16000.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.649.913 [op_lib_register.cc:165]618674 CallInitFunc:CallInitFunc 0 successfully, op_lib_paths_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/je
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.649.952 [plugin_manager.cc:616]618674 GetOpTilingForwardOrderPath:Enter GetOpTilingPath schedule
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.649.967 [plugin_manager.cc:108]618674 GetOppPath:Enter get opp path schedule
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.650.000 [plugin_manager.cc:117]618674 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.650.005 [raw_device.cc:803] 618670 UpdateTimeoutConfig: No need to update timeout config.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.650.021 [plugin_manager.cc:624]618674 GetOpTilingForwardOrderPath:Opp plugin path structure is new version!
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:41.650.024 [npu_driver_dcache_lock.cpp:39] 618670 AllocAddrForDcache: halMemCtl failed, drvRet=65534, outSize=0
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.650.044 [plugin_manager.cc:206]618674 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.650.105 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.650.149 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.650.166 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.650.179 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.650.198 [raw_device.cc:528] 618670 AllocStackPhyBase: AllocStackPhyBase device_id=6, stackPhyBase32k_=0x12c140000000, stackPhySize=2457600.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.650.218 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.650.251 [raw_device.cc:232] 618670 LaunchDcacheLockOp: dcache lock has been set or stack addr is not for dcache, dCacheLockFlag_=0, stackAddrIsDcache_=0.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.650.261 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.650.279 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.650.278 [runtime.cc:3393] 618670 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x1
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.650.294 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.650.296 [runtime.cc:3560] 618670 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=6
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.650.312 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.650.321 [api_impl.cc:2987] 618670 NewDevice: SetCurRef = 0xaaaad9a630c0,userDeviceId=6,deviceId=6
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.650.328 [plugin_manager.cc:215]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.650.339 [runtime.cc:5239] 618670 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.650.344 [plugin_manager.cc:218]618662 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-pack
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.650.354 [api_impl.cc:2992] 618670 NewDevice: New device success, user_device_id=6, die_num=1.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.650.368 [plugin_manager.cc:422]618662 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:41.650.377 [awatchdog_core.c:175](tid:618670) create watchdog for id : 65543, tid : 618670, timeout : 300s
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.650.385 [plugin_manager.cc:155]618662 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.650.393 [api_impl.cc:3025] 618670 SetDevice: SetDevice success, curCtx=0xaaaad9a630c0, user_device_id=6.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.650.412 [plugin_manager.cc:158]618662 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.650.429 [plugin_manager.cc:426]618662 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.650.435 [acl.cpp:115]618670 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.650.453 [acl.cpp:121]618670 GetSocVersion: socVersion is Ascend910B3
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.650.768 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.650.789 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.650.815 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.650.833 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.650.836 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.650.852 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.650.846 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.650.867 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.650.888 [plugin_manager.cc:439]618662 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.650.911 [plugin_manager.cc:175]618662 ReversePathString:Enter ReversePathString schedule
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.650.911 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.650.934 [plugin_manager.cc:187]618662 ReversePathString:path_str is '/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/:/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.651.229 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.651.265 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.651.271 [plugin_manager.cc:996]618662 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.651.280 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.651.295 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.651.302 [plugin_manager.cc:1011]618662 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.651.326 [plugin_manager.cc:1015]618662 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.651.330 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.651.368 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.651.376 [op_tiling_manager.cc:58]618662 LoadSo:[FindSo][Check] Get path with op_master [/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.651.384 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.651.398 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.651.412 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.651.439 [plugin_manager.cc:215]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.651.760 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.651.792 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.651.807 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.651.820 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.651.855 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.651.859 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.652.066 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.652.176 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.652.210 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.652.227 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.652.240 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.652.275 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.652.296 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.652.310 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.652.327 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.652.340 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.652.354 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.652.370 [plugin_manager.cc:215]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.652.630 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.652.677 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.652.709 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.652.734 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.652.748 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.652.783 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.652.805 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.652.968 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.653.092 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.653.123 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.653.138 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.653.152 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.653.187 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.653.222 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.653.236 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.653.251 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.653.222 [api_impl.cc:3476] 618670 GetDeviceInfo: get device info, deviceId=6
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.653.264 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.653.264 [api_impl.cc:3476] 618670 GetDeviceInfo: get device info, deviceId=6
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.653.280 [plugin_manager.cc:215]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.653.320 [device.cpp:133]618670 UpdatePlatformInfoWithDevice: Successfully to UpdatePlatformInfoWithDevice, deviceId = 6, aicCnt = 20, vecCoreCnt = 40, cubeCoreCnt = 20
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.653.345 [device.cpp:154]618670 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 6
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.653.367 [context.cpp:87]618670 aclrtGetCurrentContext: start to execute aclrtGetCurrentContext
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.653.387 [context.cpp:98]618670 aclrtGetCurrentContext: successfully execute aclrtGetCurrentContext
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.653.415 [stream.cpp:48]618670 aclrtCreateStreamWithConfig: start to execute aclrtCreateStreamWithConfig with priority:0, flag:3
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.653.443 [api_impl.cc:1120] 618670 StreamCreate: priority=0, flags=1536.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.653.503 [npu_driver.cc:404] 618670 StreamIdAlloc: stream id alloc begin, device_id=6, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.653.537 [stream.cc:2246] 618670 AllocExecutedTimesSvm: stream_id=2.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.653.588 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.653.594 [stream_sqcq_manage.cc:147] 618670 Alloc: deviceId=6, tsId=0, drvFlag=0
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.653.619 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.653.612 [npu_driver.cc:882] 618670 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.653.634 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.653.649 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.653.684 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.653.818 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.653.988 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.654.004 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.654.035 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.654.049 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.654.062 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.654.077 [npu_driver.cc:6125] 618670 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.654.096 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.654.119 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.654.131 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.654.128 [npu_driver.cc:6137] 618670 LogicCqAllocateV2: success: deviceId=6, tsId=0, cqId=298, streamId=2, logicCq=298, cqeDepth=4096
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.654.146 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.654.152 [npu_driver.cc:6189] 618670 StreamBindLogicCq: success: deviceId=6, tsId=0, streamId=2, logicCq=298.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.654.161 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.654.176 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.654.171 [npu_driver.cc:5916] 618670 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=c80e4000, addr=dfffc80e4000size=4096
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.654.189 [stream.cc:653] 618670 Setup: Success to get sq=2 sq reg virtual addr length=4096.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.654.192 [plugin_manager.cc:215]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.654.242 [devmm_svm.c:1972][ascend][curpid:618670,618670][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.654.263 [npu_driver.cc:6080] 618670 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.654.275 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyAdamWV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.654.438 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.654.455 [stream.cc:291] 618670 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=2, flags_=0x600.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.654.500 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.654.530 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.654.545 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.654.559 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.654.577 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.654.592 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.654.737 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.654.887 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.654.899 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.654.930 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.654.945 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.654.958 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.655.002 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.655.023 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.655.036 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.655.053 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.655.066 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.655.080 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.655.095 [plugin_manager.cc:215]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.655.107 [plugin_manager.cc:218]618674 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-pack
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.655.127 [plugin_manager.cc:422]618674 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.655.140 [plugin_manager.cc:155]618674 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.655.156 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.655.161 [plugin_manager.cc:158]618674 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.655.175 [plugin_manager.cc:426]618674 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.655.269 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.655.362 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.655.472 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.655.503 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.655.518 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.655.531 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.655.576 [plugin_manager.cc:439]618674 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.655.596 [plugin_manager.cc:175]618674 ReversePathString:Enter ReversePathString schedule
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.655.618 [plugin_manager.cc:187]618674 ReversePathString:path_str is '/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/:/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.655.666 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.655.700 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.655.724 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.655.746 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.655.768 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.655.789 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.655.811 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.655.834 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.655.856 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.655.878 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.655.899 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.655.909 [plugin_manager.cc:996]618674 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.655.922 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.655.939 [plugin_manager.cc:1011]618674 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.655.949 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.655.960 [plugin_manager.cc:1015]618674 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.655.978 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.655.999 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.656.004 [op_tiling_manager.cc:58]618674 LoadSo:[FindSo][Check] Get path with op_master [/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.021 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.052 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.074 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.095 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.117 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.138 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.174 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.197 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.219 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.240 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.264 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.285 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.307 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.329 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.349 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.370 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.393 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.414 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.434 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.455 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.475 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.500 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.522 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.542 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.574 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.599 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.620 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.640 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.661 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.682 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.703 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.724 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.745 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.766 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.787 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.808 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.831 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.853 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.875 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.895 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.656.917 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.657.075 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachACosInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.657.226 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.657.390 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMulScalarInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.657.417 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachLogInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.657.440 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSubListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.657.461 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMulListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.657.490 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachDivListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.657.640 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSubScalarInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.657.628 [stream.cc:688] 618670 Setup: stream setup end, stream_id=2, IsTaskSink=0, sqId=2, cqId=2, deviceId=6, streamResId=65535
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:41.657.663 [stream_state_callback_manager.cc:45] 618670 Notify: not reg stream state callback func!
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.657.681 [api_impl.cc:1162] 618670 StreamCreate: Succ, flags=1536, stream_id=2, context=aaaad9a630c0
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.657.702 [stream.cpp:189]618670 aclrtSetStreamFailureMode: start to execute aclrtSetStreamFailureMode, mode is 1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.657.724 [stream.cc:3161] 618670 SetFailMode: stream_id=2 is updated from CONTINUE to STOP.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.657.739 [stream.cpp:195]618670 aclrtSetStreamFailureMode: successfully execute aclrtSetStreamFailureMode, mode is 1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.657.751 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [Tiling][TilingParse]
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.657.809 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:105] RegCallback] Register callback thread, stream : 0xaaaada9cc680.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.657.859 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [Tiling][TilingParse]
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.657.868 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:377] CreateDefaultStream] Create ascend default stream, stream id: 0
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.657.884 [stream.cpp:48]618670 aclrtCreateStreamWithConfig: start to execute aclrtCreateStreamWithConfig with priority:0, flag:3
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.657.906 [api_impl.cc:1120] 618670 StreamCreate: priority=0, flags=1536.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.657.936 [npu_driver.cc:404] 618670 StreamIdAlloc: stream id alloc begin, device_id=6, priority=0, ts_id=0, remote_stream_id=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.657.967 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.657.969 [stream.cc:2246] 618670 AllocExecutedTimesSvm: stream_id=3.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.658.008 [stream_sqcq_manage.cc:147] 618670 Alloc: deviceId=6, tsId=0, drvFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.658.025 [npu_driver.cc:882] 618670 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.658.079 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.658.188 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.658.247 [npu_driver.cc:6125] 618670 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.658.300 [npu_driver.cc:6137] 618670 LogicCqAllocateV2: success: deviceId=6, tsId=0, cqId=299, streamId=3, logicCq=299, cqeDepth=4096
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.658.334 [npu_driver.cc:6189] 618670 StreamBindLogicCq: success: deviceId=6, tsId=0, streamId=3, logicCq=299.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.658.349 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.658.352 [npu_driver.cc:5916] 618670 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=c80c3000, addr=dfffc80c3000size=4096
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.658.369 [stream.cc:653] 618670 Setup: Success to get sq=3 sq reg virtual addr length=4096.
[INFO] DRV(618670,python3.9):2025-04-03-09:27:41.658.411 [devmm_svm.c:1972][ascend][curpid:618670,618670][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.658.430 [npu_driver.cc:6080] 618670 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.658.463 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.658.620 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.658.744 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.658.751 [stream.cc:291] 618670 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=3, flags_=0x600.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.658.857 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.658.884 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.658.907 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.659.019 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.659.046 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.659.068 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.659.174 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.659.326 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.659.384 [stream.cc:688] 618670 Setup: stream setup end, stream_id=3, IsTaskSink=0, sqId=3, cqId=3, deviceId=6, streamResId=0
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:41.659.404 [stream_state_callback_manager.cc:45] 618670 Notify: not reg stream state callback func!
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.659.416 [api_impl.cc:1162] 618670 StreamCreate: Succ, flags=1536, stream_id=3, context=aaaad9a630c0
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.659.431 [stream.cpp:189]618670 aclrtSetStreamFailureMode: start to execute aclrtSetStreamFailureMode, mode is 1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.659.451 [stream.cc:3161] 618670 SetFailMode: stream_id=3 is updated from CONTINUE to STOP.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.659.466 [stream.cpp:195]618670 aclrtSetStreamFailureMode: successfully execute aclrtSetStreamFailureMode, mode is 1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.659.490 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.659.502 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:105] RegCallback] Register callback thread, stream : 0xaaaadaafcb60.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.659.634 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.659.639 [callback.cpp:25]618670 aclrtSubscribeReport: start to execute aclrtSubscribeReport, threadId is 281471545700256.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.659.712 [npu_driver.cc:462] 618670 EventIdAlloc: event id alloc begin, device_id=6, ts_id=0, remote_event_id=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.659.748 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.659.729 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.659.779 [npu_driver.cc:483] 618670 EventIdAlloc: Event id alloc success, device_id=6, ts_id=0, event_id=0, eventFlag=0
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:41.659.784 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.659.799 [event.cc:347] 618670 GenEventId: Event id alloc success, device_id=6, tsId=0, eventFlag=1, event_id=0
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:41.659.806 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.659.823 [subscribe.cc:54] 618670 AssignGroupId: give groupId=64
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.659.838 [npu_driver.cc:3775] 618670 SqCqAllocate: deviceId=6, tsId=0, groupId=64.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.659.886 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.659.897 [npu_driver.cc:3785] 618670 SqCqAllocate: alloc success, deviceId=6 sqId=89, cqId=89.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.659.916 [subscribe.cc:131] 618670 Insert: callback subscribe: groupId=64, threadId=281471545700256, devId=6, tsId=0, streamId=2, sqId=89, cqId=89
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.659.934 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.659.941 [callback.cpp:31]618670 aclrtSubscribeReport: successfully execute aclrtSubscribeReport, threadId is 281471545700256.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.659.935 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IndexPutWithSort] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.659.957 [npu_driver.cc:3828] 618822 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=64.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.659.977 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:125] RegCallback] Register callback thread success, stream : 0xaaaada9cc680.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.660.065 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.660.065 [callback.cpp:25]618670 aclrtSubscribeReport: start to execute aclrtSubscribeReport, threadId is 281471537246112.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.660.088 [npu_driver.cc:462] 618670 EventIdAlloc: event id alloc begin, device_id=6, ts_id=0, remote_event_id=0
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.660.089 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.660.110 [npu_driver.cc:483] 618670 EventIdAlloc: Event id alloc success, device_id=6, ts_id=0, event_id=1, eventFlag=0
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:41.660.118 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.660.125 [event.cc:347] 618670 GenEventId: Event id alloc success, device_id=6, tsId=0, eventFlag=1, event_id=1
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:41.660.134 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.660.143 [subscribe.cc:54] 618670 AssignGroupId: give groupId=65
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.660.149 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.660.168 [npu_driver.cc:3775] 618670 SqCqAllocate: deviceId=6, tsId=0, groupId=65.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.660.183 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.660.220 [npu_driver.cc:3785] 618670 SqCqAllocate: alloc success, deviceId=6 sqId=90, cqId=90.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.660.239 [subscribe.cc:131] 618670 Insert: callback subscribe: groupId=65, threadId=281471537246112, devId=6, tsId=0, streamId=3, sqId=90, cqId=90
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.660.260 [callback.cpp:31]618670 aclrtSubscribeReport: successfully execute aclrtSubscribeReport, threadId is 281471537246112.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.660.268 [npu_driver.cc:3828] 618823 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=65.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.660.268 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InplaceIndexAddWithSorted] register OP_IMPL : [Tiling][TilingParse]
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.660.293 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:125] RegCallback] Register callback thread success, stream : 0xaaaadaafcb60.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.660.318 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:386] CreateDefaultStream] Create ascend communication stream, stream id: 1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.660.388 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : [Tiling][TilingParse]
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.660.410 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:110] Initialize] Config huge_page_reserve_size : 0, device_hbm_huge_page_reserved_size_ : 0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.660.498 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.660.526 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.660.549 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.660.707 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.660.736 [npu_driver.cc:2616] 618670 MemGetInfoEx: memory info type=1, type=2, free=8864165888, hug_free=56245616640
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.660.808 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:60] AscendVmmAdapter] VMM align size is 2097152
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.660.868 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [Tiling][TilingParse]
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.660.919 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:158] CheckVmmDriverVersion] Driver path is /usr/local/Ascend
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.660.966 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:187] CheckVmmDriverVersion] Driver version is 25.0.rc1.b070, major version is 25
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.660.995 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:113] IsVmmEnabled] VMM is enabled.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.661.017 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.661.018 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:180] Initialize] Device MOC Size:62420M, Device free MOC Size:62093M, Reserved MOC size for Other Components(HCCL/rts/etc.):3891M, Recommend Reserved MOC size for Other Components:3880M, User define MindSpore MOC Size:0G, MindSpore Used MOC Size:58202M.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.661.045 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_dynamic_mem_adapter.cc:57] Initialize] Ascend Memory Adapter initialize success, Memory Statistics:
Device MOC memory size: 62420M
MindSpore Used memory size: 58202M
Used peak memory usage (without fragments): 0M
Actual peak memory usage (with fragments): 0M

[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.661.076 [event.cpp:260]618670 aclrtSetOpWaitTimeout: start to execute aclrtSetOpWaitTimeout, timeout = 1980s
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.661.098 [api_impl.cc:5713] 618670 SetOpWaitTimeOut: set OP wait timeout:1980.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.661.168 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.661.346 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.661.492 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.661.606 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.661.761 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.661.916 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.662.097 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.175 [engine.cc:188] 618670 SubmitTaskNormal: stream_id=0,task_id=3,task_type=86 (TASK_TIMEOUT_SET).
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.196 [timeout_set_task.cc:115] 618670 ConstructSqeForTimeoutSetTask: TaskTimeoutSetTask ConstructSqe finish,topic_type=0,cmd_type=13
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.212 [stream.cc:1400] 618670 AddTaskToList: public task, stream_id=0, task_id=3, task_type=86 (TASK_TIMEOUT_SET), head=3, tail=4
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.662.224 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.229 [stream.cc:2595] 618670 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=3, type=86(TASK_TIMEOUT_SET), head=3, tail=4, sqe_num=1, lastTail=3, device_id=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.251 [npu_driver.cc:751] 618670 SqTaskSend: device_id=6, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.266 [stars_engine.cc:893] 618670 SendTask: Sq task send finished, device_id=6, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=3, task_type=86(TASK_TIMEOUT_SET).
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.284 [stream.cc:1494] 618670 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=3.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.298 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=0, head=3.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.662.335 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.344 [stars_engine.cc:622] 618670 ProcLogicCqUntilEmpty: Task Wait: stream_id=0, logicCqId=297, retCode=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.362 [stream.cc:2886] 618670 StarsWaitForTask: No.0 stream_id=0, taskId=3, currentId=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.379 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=0, head=3.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.396 [stream.cc:2886] 618670 StarsWaitForTask: No.1 stream_id=0, taskId=3, currentId=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.408 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=0, head=3.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.423 [stream.cc:2886] 618670 StarsWaitForTask: No.2 stream_id=0, taskId=3, currentId=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.448 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.461 [task.cc:185] 618670 GetTask: this stream no taskRes, stream_id=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.662.451 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.475 [task.cc:185] 618670 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.490 [logger.cc:152] 618670 TaskFinished: device_id=6, stream_id=0, task_id=3, task_type=86 (TASK_TIMEOUT_SET), task_finish_num=4
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.509 [stars_engine.cc:437] 618670 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=3, sqHead=4, endTaskId=3, recycleTaskId=3.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.526 [stream.cc:2886] 618670 StarsWaitForTask: No.3 stream_id=0, taskId=3, currentId=3
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.662.539 [event.cpp:262]618670 aclrtSetOpWaitTimeout: successfully execute aclrtSetOpWaitTimeout, timeout = 1980s
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.662.555 [event.cpp:269]618670 aclrtSetOpExecuteTimeOut: start to execute aclrtSetOpExecuteTimeOut, timeout = 900s
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.662.565 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.572 [engine.cc:188] 618670 SubmitTaskNormal: stream_id=0,task_id=4,task_type=86 (TASK_TIMEOUT_SET).
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.589 [timeout_set_task.cc:115] 618670 ConstructSqeForTimeoutSetTask: TaskTimeoutSetTask ConstructSqe finish,topic_type=0,cmd_type=13
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.603 [stream.cc:1400] 618670 AddTaskToList: public task, stream_id=0, task_id=4, task_type=86 (TASK_TIMEOUT_SET), head=4, tail=5
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.618 [stream.cc:2595] 618670 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=4, type=86(TASK_TIMEOUT_SET), head=4, tail=5, sqe_num=1, lastTail=4, device_id=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.637 [npu_driver.cc:751] 618670 SqTaskSend: device_id=6, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.653 [stars_engine.cc:893] 618670 SendTask: Sq task send finished, device_id=6, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=4, task_type=86(TASK_TIMEOUT_SET).
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.669 [stream.cc:1494] 618670 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=4.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.681 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=0, head=4.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.662.679 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.695 [stream.cc:2886] 618670 StarsWaitForTask: No.0 stream_id=0, taskId=4, currentId=3
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.710 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.722 [stream.cc:2886] 618670 StarsWaitForTask: No.1 stream_id=0, taskId=4, currentId=3
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.735 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.750 [stream.cc:2886] 618670 StarsWaitForTask: No.2 stream_id=0, taskId=4, currentId=3
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.762 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=0, head=5.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.777 [task.cc:185] 618670 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.788 [task.cc:185] 618670 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.800 [logger.cc:152] 618670 TaskFinished: device_id=6, stream_id=0, task_id=4, task_type=86 (TASK_TIMEOUT_SET), task_finish_num=5
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.817 [stars_engine.cc:437] 618670 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=4, sqHead=5, endTaskId=4, recycleTaskId=4.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.662.838 [stream.cc:2886] 618670 StarsWaitForTask: No.3 stream_id=0, taskId=4, currentId=4
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.662.831 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.662.852 [event.cpp:277]618670 aclrtSetOpExecuteTimeOut: successfully execute aclrtSetOpExecuteTimeOut, timeout = 900s
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.662.881 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:285] Init] End inititializing kernel runtime.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.662.921 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:48] InitDevice] Enter SetRtDevice, current initialize device number:1
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.662.941 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:50] InitDevice] Device 6 has been set
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.662.959 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:381] CreateDefaultStream] The default compute stream is already created, skip.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.662.977 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:390] CreateDefaultStream] The default communication stream is already created, skip.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.662.976 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.663.027 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_pool.cc:165] DefaultEnhancedAscendMemoryPool] DefaultEnhancedAscendMemoryPool constructed.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.663.059 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:397] Initialize] Skip initialization of memory pool since init size is not configured.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.663.097 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Resize] register OP_IMPL : [Tiling][TilingParse]
[INFO] UTILS(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:41.663.121 [mindspore/ccsrc/utils/offload_context.cc:86] enable_aio] On ascend devices, enable aio and enable pinned mem cannot be turned on at the same time.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.663.209 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.663.242 [context.cpp:72]618670 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.663.274 [api_impl.cc:3717] 618670 ContextSetCurrent: set context=aaaad9a630c0, flag=0.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.663.312 [context.cpp:80]618670 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.663.324 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.663.349 [context.cpp:72]618670 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.663.368 [api_impl.cc:3717] 618670 ContextSetCurrent: set context=aaaad9a630c0, flag=0.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.663.381 [context.cpp:80]618670 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.663.440 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.663.533 [acl.cpp:288]618670 aclInit: start to execute aclInit
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.663.555 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.663.575 [acl.cpp:298]618670 aclInit: call ErrorManager.Initialize
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.663.686 [acl.cpp:242]618670 HandleErrorManagerConfig: err_msg mode is set ["1"].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.663.982 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.664.425 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.664.543 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.664.663 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.664.689 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.664.804 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.664.916 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.665.027 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.665.138 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.665.248 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.665.360 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.665.473 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.665.584 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.665.735 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.665.849 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.665.960 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.666.148 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.666.267 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.666.383 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.666.491 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.666.678 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.666.855 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.666.969 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RoiPoolingGradWithArgMax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.667.083 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.667.197 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.667.315 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.667.426 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.667.536 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.667.645 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.667.798 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StackBallQuery] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.667.913 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.667.943 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DefaultImpl] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.668.066 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.668.326 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScoreGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.668.324 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DefaultImpl] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.668.522 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.668.579 [op_tiling_registry.cc:162]618662 OpTilingFuncRegistry:Register op tiling and parse function V4 for op_type:Aipp
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.668.691 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.668.701 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:AvgPool1DD
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.668.806 [op_tiling_registry.cc:162]618662 OpTilingFuncRegistry:Register op tiling and parse function V4 for op_type:AutoTiling
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.668.866 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.668.925 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Bias
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.669.027 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:INTrainingUpdateV2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.669.086 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.669.106 [op_tiling_registry.cc:162]618674 OpTilingFuncRegistry:Register op tiling and parse function V4 for op_type:Aipp
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.669.125 [op_tiling_registry.cc:134]618662 OpTilingFuncRegistry:Register op tiling function V2 for op_type:CheckValid
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.669.235 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ConcatD
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.669.246 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:AvgPool1DD
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.669.255 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ConcatV2D
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.669.279 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Pack
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.669.304 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.669.366 [op_tiling_registry.cc:162]618674 OpTilingFuncRegistry:Register op tiling and parse function V4 for op_type:AutoTiling
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.669.375 [op_tiling_registry.cc:134]618662 OpTilingFuncRegistry:Register op tiling function V2 for op_type:ConcatOffset
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.669.468 [op_tiling_registry.cc:134]618662 OpTilingFuncRegistry:Register op tiling function V2 for op_type:Diag
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.669.498 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Bias
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.669.526 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.669.553 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.669.560 [op_tiling_registry.cc:134]618662 OpTilingFuncRegistry:Register op tiling function V2 for op_type:DiagPart
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.669.588 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.669.609 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.669.626 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:INTrainingUpdateV2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.669.642 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.669.660 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:DynSeqOuter
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.669.669 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.669.693 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.669.716 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.669.759 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Expand
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.669.750 [op_tiling_registry.cc:134]618674 OpTilingFuncRegistry:Register op tiling function V2 for op_type:CheckValid
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.669.894 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ConcatD
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.669.913 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ConcatV2D
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.669.934 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Pack
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.670.055 [op_tiling_registry.cc:134]618674 OpTilingFuncRegistry:Register op tiling function V2 for op_type:ConcatOffset
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.670.085 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Ger
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.670.169 [op_tiling_registry.cc:134]618674 OpTilingFuncRegistry:Register op tiling function V2 for op_type:Diag
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.670.175 [op_tiling_registry.cc:122]618662 OpTilingFuncRegistry:Register op tiling function V1 for op_type:IFMR
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.670.280 [op_tiling_registry.cc:134]618674 OpTilingFuncRegistry:Register op tiling function V2 for op_type:DiagPart
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.670.283 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:InTopKD
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.670.384 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:KlDivLossGrad
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.670.398 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:DynSeqOuter
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.670.436 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.670.480 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:L1LossGrad
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.670.517 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Expand
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.670.583 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNorm
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.670.685 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNormBetaGammaBackpropV2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.670.862 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.670.872 [op_tiling_registry.cc:122]618662 OpTilingFuncRegistry:Register op tiling function V1 for op_type:LayerNormXBackprop
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.670.921 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Ger
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.670.977 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNormXBackpropV2
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.671.028 [op_tiling_registry.cc:122]618674 OpTilingFuncRegistry:Register op tiling function V1 for op_type:IFMR
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.671.083 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNormXBackpropV3
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.671.149 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:InTopKD
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.671.185 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LpNormReduce
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.671.204 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LpNormReduceV2
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.671.269 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:KlDivLossGrad
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.671.271 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.671.319 [op_tiling_registry.cc:134]618662 OpTilingFuncRegistry:Register op tiling function V2 for op_type:LRUCacheV2
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.671.384 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:L1LossGrad
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.671.433 [op_tiling_registry.cc:134]618662 OpTilingFuncRegistry:Register op tiling function V2 for op_type:MaxPoolGradWithArgmaxV2
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.671.451 [op_tiling_registry.cc:134]618662 OpTilingFuncRegistry:Register op tiling function V2 for op_type:MaxPoolGradWithArgmaxV1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.671.468 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.671.482 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNorm
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.671.545 [op_tiling_registry.cc:122]618662 OpTilingFuncRegistry:Register op tiling function V1 for op_type:MaxPoolWithArgmaxV2
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.671.585 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNormBetaGammaBackpropV2
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.671.645 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:MovingSumWithSigmoid
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.671.666 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.671.745 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:MseLossGrad
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.671.766 [op_tiling_registry.cc:122]618674 OpTilingFuncRegistry:Register op tiling function V1 for op_type:LayerNormXBackprop
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.671.863 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNormXBackpropV2
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.671.940 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:NMSWithMask
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.671.962 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNormXBackpropV3
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.672.056 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.672.056 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LpNormReduce
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.672.076 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LpNormReduceV2
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.672.114 [op_tiling_registry.cc:122]618662 OpTilingFuncRegistry:Register op tiling function V1 for op_type:PadD
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.672.183 [op_tiling_registry.cc:134]618674 OpTilingFuncRegistry:Register op tiling function V2 for op_type:LRUCacheV2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.672.195 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.672.223 [op_tiling_registry.cc:122]618662 OpTilingFuncRegistry:Register op tiling function V1 for op_type:PadV3Grad
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.672.290 [op_tiling_registry.cc:134]618674 OpTilingFuncRegistry:Register op tiling function V2 for op_type:MaxPoolGradWithArgmaxV2
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.672.311 [op_tiling_registry.cc:134]618674 OpTilingFuncRegistry:Register op tiling function V2 for op_type:MaxPoolGradWithArgmaxV1
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.672.327 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ReduceStdWithMean
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.672.367 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.672.401 [op_tiling_registry.cc:122]618674 OpTilingFuncRegistry:Register op tiling function V1 for op_type:MaxPoolWithArgmaxV2
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.672.434 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Resize
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.672.511 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:MovingSumWithSigmoid
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.672.604 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:MseLossGrad
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.672.692 [error_manager.cc:673]618670 ParseJsonFile:Parse json file:/usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/../conf/error_manager/error_code.json success
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.672.794 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:NMSWithMask
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.672.853 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ResizeBilinearV2
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.672.958 [op_tiling_registry.cc:122]618674 OpTilingFuncRegistry:Register op tiling function V1 for op_type:PadD
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.672.960 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ReverseV2
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.673.051 [op_tiling_registry.cc:122]618674 OpTilingFuncRegistry:Register op tiling function V1 for op_type:PadV3Grad
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.673.071 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Scale
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.673.146 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ReduceStdWithMean
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.673.245 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Resize
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.673.249 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SigmoidFocalLoss
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.673.363 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SigmoidFocalLossGrad
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.673.449 [acl.cpp:315]618670 aclInit: call ge interface executor.Initialize
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.673.482 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SignBitsPack
[INFO] PROFILING(618670,python3.9):2025-04-03-09:27:41.673.515 [prof_atls_plugin.cpp:210] (tid:618670) Module[45] register callback of ctrl handle.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.673.564 [ge_executor.cc:273]618670 Initialize:Init GeExecutor begin.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.673.584 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SignBitsUnpack
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.673.621 [op_lib_register.cc:117]618670 GetAllCustomOpApiSoPaths:value of env ASCEND_CUSTOM_OPP_PATH is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/ho
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.673.643 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ResizeBilinearV2
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.673.685 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SmoothL1LossGradV2
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.673.717 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.673.747 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ReverseV2
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.673.755 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.673.784 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SmoothL1LossV2
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.673.789 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.673.822 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.673.853 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.673.854 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Scale
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.673.883 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.673.885 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SoftMarginLossGrad
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.673.914 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.673.944 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.673.975 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.673.997 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SoftmaxFocalLossGrad
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.674.005 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.674.029 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SigmoidFocalLoss
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.674.036 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.674.072 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.674.095 [op_tiling_registry.cc:134]618662 OpTilingFuncRegistry:Register op tiling function V2 for op_type:Sort
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.674.102 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.674.114 [op_tiling_registry.cc:134]618662 OpTilingFuncRegistry:Register op tiling function V2 for op_type:SortV2
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.674.132 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.674.131 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SigmoidFocalLossGrad
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.674.163 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.674.193 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.674.223 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.674.229 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SparseApplyFtrlD
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.674.240 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SignBitsPack
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.674.253 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.674.284 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.674.314 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.674.334 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SparseReshape
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.674.338 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SignBitsUnpack
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.674.338 [op_lib_register.cc:165]618670 CallInitFunc:CallInitFunc 0 successfully, op_lib_paths_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/je
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.674.383 [plugin_manager.cc:616]618670 GetOpTilingForwardOrderPath:Enter GetOpTilingPath schedule
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.674.400 [plugin_manager.cc:108]618670 GetOppPath:Enter get opp path schedule
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.674.432 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SmoothL1LossGradV2
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.674.437 [plugin_manager.cc:117]618670 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.674.436 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SplitV
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.674.456 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Split
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.674.462 [plugin_manager.cc:624]618670 GetOpTilingForwardOrderPath:Opp plugin path structure is new version!
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.674.479 [plugin_manager.cc:206]618670 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.674.529 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SmoothL1LossV2
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.674.554 [op_tiling_registry.cc:122]618662 OpTilingFuncRegistry:Register op tiling function V1 for op_type:SquareSumAll
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.674.628 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SoftMarginLossGrad
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.674.649 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SyncBatchNormGatherStats
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.674.731 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SoftmaxFocalLossGrad
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.674.753 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Tile
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.674.823 [op_tiling_registry.cc:134]618674 OpTilingFuncRegistry:Register op tiling function V2 for op_type:Sort
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.674.842 [op_tiling_registry.cc:134]618674 OpTilingFuncRegistry:Register op tiling function V2 for op_type:SortV2
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.674.849 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:TileD
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.674.937 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SparseApplyFtrlD
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.674.960 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:TileWithAxis
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.675.028 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.675.041 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SparseReshape
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.675.142 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SplitV
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.675.155 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Unpack
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.675.171 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Split
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.675.246 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.675.259 [op_tiling_registry.cc:122]618674 OpTilingFuncRegistry:Register op tiling function V1 for op_type:SquareSumAll
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.675.264 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.675.309 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.675.326 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.675.338 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.675.341 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.675.352 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SyncBatchNormGatherStats
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.675.385 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.675.417 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.675.455 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Tile
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.675.497 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AscendAntiQuantV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.675.548 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:TileD
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.675.579 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.675.652 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:TileWithAxis
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.675.655 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.675.682 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.675.732 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.675.765 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.675.772 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Concat] register OP_IMPL : [HostInputs][OpExecuteFunc]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.675.782 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.675.800 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.675.801 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ConcatV2] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.675.828 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.675.831 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Unpack
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.675.840 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.675.854 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [OpExecuteFunc]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.675.880 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.675.897 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.675.917 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [OpExecuteFunc]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.675.911 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.675.939 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.675.956 [plugin_manager.cc:215]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.675.983 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.676.001 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.676.061 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.676.080 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.676.149 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.676.173 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AscendAntiQuantV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.676.241 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.676.247 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.676.308 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.676.322 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.676.321 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [OpExecuteFunc]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.676.345 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.676.349 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [OpExecuteFunc]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.676.362 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.676.377 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.676.410 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.676.414 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.676.431 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Concat] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.676.438 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.676.459 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ConcatV2] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.676.486 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.676.512 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.676.516 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.676.543 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.676.569 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.676.636 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.676.643 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.676.710 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.676.731 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.676.754 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.676.788 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.676.788 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [HostInputs][OpExecuteFunc]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.676.805 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.676.810 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [OpExecuteFunc]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.676.819 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.676.836 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.676.858 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.676.864 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.676.889 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [OpExecuteFunc]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.676.894 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.676.911 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.676.924 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.676.940 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.676.953 [plugin_manager.cc:215]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.676.945 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.676.965 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.676.978 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.677.040 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.677.041 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.677.068 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.677.094 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.677.119 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.677.142 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.677.168 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.677.194 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.677.197 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.677.209 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.677.265 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.677.272 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.677.292 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.677.342 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.677.347 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.677.354 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [OpExecuteFunc]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.677.359 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.677.375 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.677.414 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.677.426 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.677.452 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.677.488 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CircularPad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.677.503 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.677.533 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.677.581 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.677.614 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.677.644 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CircularPadGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.677.654 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.677.689 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.677.730 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.677.754 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.677.767 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [OpExecuteFunc]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.677.786 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.677.803 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.677.811 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [OpExecuteFunc]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.677.816 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.677.828 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.677.854 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.677.842 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.677.888 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [OpExecuteFunc]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.677.890 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.677.907 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.677.920 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.677.931 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.677.935 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.677.953 [plugin_manager.cc:215]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.677.962 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.678.056 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.678.132 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.678.175 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.678.207 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.678.208 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.678.232 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.678.255 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.678.278 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.678.282 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.678.287 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.678.320 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.678.337 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.678.362 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [OpExecuteFunc]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.678.350 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.678.405 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.678.435 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.678.452 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleLinear1d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.678.481 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleBilinear2d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.678.510 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.678.648 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleBicubic2d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.678.744 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.678.776 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.678.792 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.678.805 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.678.811 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.678.842 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.678.878 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.678.894 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.678.906 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.678.923 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.678.937 [plugin_manager.cc:215]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.678.974 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAAGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.679.145 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.679.275 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.679.307 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.679.324 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.679.330 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.679.336 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.679.362 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.679.375 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.679.515 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.679.683 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAABackward] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.679.713 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.679.745 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.679.761 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.679.785 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.679.819 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.679.849 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dGrad] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.679.855 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.679.871 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.679.885 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.679.901 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.679.914 [plugin_manager.cc:215]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.679.929 [plugin_manager.cc:218]618670 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-pack
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.679.951 [plugin_manager.cc:422]618670 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.679.967 [plugin_manager.cc:155]618670 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.679.988 [plugin_manager.cc:158]618670 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.680.003 [plugin_manager.cc:426]618670 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.680.022 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ResizeUpsampleTrilinear] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.680.213 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dBackward] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.680.354 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.680.374 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.680.388 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.680.402 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3d] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.680.406 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.680.433 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.680.470 [plugin_manager.cc:439]618670 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.680.491 [plugin_manager.cc:175]618670 ReversePathString:Enter ReversePathString schedule
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.680.512 [plugin_manager.cc:187]618670 ReversePathString:path_str is '/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/:/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.680.549 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleNearest] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.680.738 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleNearestExact2dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.680.774 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleNearest2dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.680.836 [plugin_manager.cc:996]618670 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.680.866 [plugin_manager.cc:1011]618670 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.680.879 [op_tiling_registry.cc:134]618666 OpTilingFuncRegistry:Register op tiling function V2 for op_type:AvgPoolGrad
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.680.888 [plugin_manager.cc:1015]618670 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.680.911 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.680.932 [op_tiling_manager.cc:58]618670 LoadSo:[FindSo][Check] Get path with op_master [/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.681.028 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.681.055 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.681.179 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.681.204 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.681.327 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.681.439 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.681.557 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.681.676 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.681.783 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.681.891 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.682.078 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.682.096 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:DepthToSpace
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.682.133 [op_tiling_registry.cc:148]618662 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SpaceToDepth
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.682.296 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.682.523 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:DepthToSpace
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.682.554 [op_tiling_registry.cc:148]618674 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SpaceToDepth
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.682.666 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.683.039 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.683.246 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.683.548 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.683.594 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.683.679 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.683.796 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.683.799 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.683.874 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.683.997 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.684.004 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReflectionPad3dGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.684.075 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.684.111 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.684.120 [op_tiling_registry.cc:134]618666 OpTilingFuncRegistry:Register op tiling function V2 for op_type:AvgPool
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.684.172 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.684.232 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.684.286 [op_tiling_registry.cc:134]618666 OpTilingFuncRegistry:Register op tiling function V2 for op_type:AvgPoolV2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.684.318 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.684.346 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DeformableOffsetsGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.684.399 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.684.464 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.684.481 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.684.511 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.684.523 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.684.543 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.684.569 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantConv2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.684.614 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.684.633 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DeformableOffsetsGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.684.730 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.684.743 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.684.882 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.684.883 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.684.996 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.685.029 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.685.140 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.685.141 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.685.256 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.685.281 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.685.382 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachNonFiniteCheckAndUnscale] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.685.394 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.685.503 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.685.507 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.685.629 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachNonFiniteCheckAndUnscale] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.685.627 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.685.659 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.685.675 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.685.745 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.685.814 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GatherV3] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.685.862 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.685.890 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.685.928 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.686.037 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GatherV3] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.686.081 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.686.146 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.686.143 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.686.198 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.686.280 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.686.314 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.686.315 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.686.342 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.686.394 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.686.455 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.686.481 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.686.504 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.686.545 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.686.574 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.686.645 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.686.655 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.686.677 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.686.727 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LinSpace] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.686.766 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.686.831 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.686.850 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MemSet] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.686.916 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LinSpace] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.686.960 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.686.993 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.687.026 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MemSet] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.687.077 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.687.134 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.687.154 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.687.183 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.687.207 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.687.247 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.687.319 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.687.350 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.687.370 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.687.434 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.687.481 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.687.509 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.687.549 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NPUClearFloatStatus] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.687.592 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.687.659 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.687.663 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NPUGetFloatStatus] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.687.703 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NPUClearFloatStatus] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.687.783 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.687.811 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NPUGetFloatStatus] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.687.815 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.687.827 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.687.932 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.687.963 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.687.972 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AGLU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.688.031 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.688.150 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.688.180 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.688.298 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.688.313 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.688.397 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.688.441 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.688.523 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.688.624 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.688.640 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.688.736 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.688.751 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.688.839 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.688.930 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.689.004 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.689.010 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.689.079 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.689.121 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.689.150 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.689.191 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.689.193 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.689.220 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.689.276 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.689.304 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.689.344 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.689.376 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.689.415 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.689.483 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.689.522 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.689.552 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.689.589 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.689.618 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.689.669 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.689.733 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.689.778 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.689.840 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.689.887 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.689.947 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.690.001 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.690.058 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.690.204 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.690.238 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.690.257 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.690.270 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.690.289 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.690.348 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.690.394 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.690.461 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.690.502 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.690.655 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.690.685 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.690.686 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.690.766 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.690.791 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.690.889 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.690.906 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.690.998 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.691.013 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.691.116 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.691.121 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.691.229 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NLLLossGrad310p] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.691.312 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.691.312 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.691.388 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.691.472 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.691.470 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.691.542 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.691.628 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.691.632 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.691.662 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DropoutWithMulsAndSoftmaxGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.691.785 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.691.784 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.691.820 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.691.913 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.691.914 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.691.974 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.692.004 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.692.027 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.692.034 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.692.113 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.692.145 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.692.146 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BlendFaceBgPartOne] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.692.151 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BlendFaceBgPartOne] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.692.269 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.692.276 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.692.388 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.692.389 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.692.477 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.692.591 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.692.654 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.692.655 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.692.748 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachBinaryOp] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.692.822 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.692.823 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.692.879 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNN, funcPointer:0xfffef5345d70, registered count:1
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.692.879 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNN, funcPointer:0xffff25345d70, registered count:1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.692.904 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.693.025 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.693.044 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.693.046 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.693.067 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNNV2, funcPointer:0xfffef534e248, registered count:2
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.693.069 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNNV2, funcPointer:0xffff2534e248, registered count:2
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.693.191 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.693.193 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.693.306 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.693.309 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.693.327 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.693.449 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.693.450 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.693.513 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.693.565 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GridSampler2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.693.562 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GridSampler2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.693.661 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.693.688 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GridSampler3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.693.689 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GridSampler3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.693.776 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.693.810 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandle] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.693.810 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandle] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.693.891 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.693.921 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandleV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.693.921 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandleV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.694.033 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.694.039 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.694.056 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InstanceNormV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.694.154 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PasteSubImg] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.694.157 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PasteSubImg] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.694.240 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IouV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.694.263 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.694.265 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.694.291 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.694.294 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.694.406 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BidirectionLSTM] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.694.408 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.694.419 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.694.440 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BidirectionLSTMV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.694.520 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.694.527 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.694.603 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.694.631 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.694.644 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.694.645 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.694.756 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.694.765 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.694.789 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaskedSelectV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.694.866 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.694.868 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.694.971 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.694.992 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.694.990 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.695.102 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TabulateFusionGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.695.102 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TabulateFusionGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.695.216 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[YUV4442YUV422] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.695.220 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[YUV4442YUV422] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.695.361 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.695.363 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.695.391 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.695.391 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.695.417 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.695.418 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.695.444 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.695.441 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.695.594 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.695.593 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.695.712 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.695.714 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.695.825 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.695.824 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.695.935 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.695.937 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.696.041 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.696.045 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.696.150 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.696.151 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.696.193 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.696.203 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.696.222 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.696.233 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.696.346 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.696.350 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.696.444 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.696.456 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.696.464 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.696.568 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.696.574 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.696.759 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicAtomicAddrClean] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.696.772 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicAtomicAddrClean] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.696.874 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.696.887 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.696.995 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.696.985 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.697.106 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.697.110 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.697.230 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.697.230 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.697.336 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.697.343 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.697.451 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.697.454 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.697.484 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceMeanD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.697.485 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceMeanD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.697.596 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.697.600 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.697.706 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.697.706 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.697.735 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.697.738 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.698.013 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.698.011 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.698.124 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.698.125 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.698.233 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.698.233 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.698.352 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.698.352 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.698.459 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.698.465 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.698.576 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.698.581 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.698.698 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.698.698 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.698.805 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.698.808 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.699.000 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.699.000 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.699.115 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.699.119 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.699.243 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.699.242 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.699.699 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DefaultImpl] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.700.452 [op_tiling_registry.cc:162]618670 OpTilingFuncRegistry:Register op tiling and parse function V4 for op_type:Aipp
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.700.585 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:AvgPool1DD
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.700.698 [op_tiling_registry.cc:162]618670 OpTilingFuncRegistry:Register op tiling and parse function V4 for op_type:AutoTiling
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.700.817 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Bias
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.700.929 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:INTrainingUpdateV2
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.701.049 [op_tiling_registry.cc:134]618670 OpTilingFuncRegistry:Register op tiling function V2 for op_type:CheckValid
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.701.174 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ConcatD
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.701.193 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ConcatV2D
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.701.218 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Pack
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.701.324 [op_tiling_registry.cc:134]618670 OpTilingFuncRegistry:Register op tiling function V2 for op_type:ConcatOffset
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.701.429 [op_tiling_registry.cc:134]618670 OpTilingFuncRegistry:Register op tiling function V2 for op_type:Diag
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.701.532 [op_tiling_registry.cc:134]618670 OpTilingFuncRegistry:Register op tiling function V2 for op_type:DiagPart
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.701.640 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:DynSeqOuter
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.701.748 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Expand
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.701.889 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DepthToSpace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.701.941 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.701.922 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DepthToSpace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.701.969 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SpaceToDepth] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.701.980 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.702.010 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SpaceToDepth] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.702.037 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.702.084 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.702.116 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Ger
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.702.113 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.702.139 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.702.214 [op_tiling_registry.cc:122]618670 OpTilingFuncRegistry:Register op tiling function V1 for op_type:IFMR
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.702.251 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.702.257 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.702.332 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:InTopKD
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.702.376 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.702.374 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.702.448 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:KlDivLossGrad
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.702.486 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.702.487 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.702.554 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:L1LossGrad
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.702.595 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.702.599 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.702.663 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNorm
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.702.704 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.702.705 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.702.775 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNormBetaGammaBackpropV2
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.702.819 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.702.824 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.702.937 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.702.936 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.702.973 [op_tiling_registry.cc:122]618670 OpTilingFuncRegistry:Register op tiling function V1 for op_type:LayerNormXBackprop
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.703.056 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.703.056 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.703.082 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNormXBackpropV2
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.703.086 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.703.086 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.703.194 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNormXBackpropV3
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.703.215 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.703.214 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.703.246 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.703.246 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.703.304 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LpNormReduce
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.703.323 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LpNormReduceV2
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.703.370 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.703.369 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.703.398 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.703.399 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.703.435 [op_tiling_registry.cc:134]618670 OpTilingFuncRegistry:Register op tiling function V2 for op_type:LRUCacheV2
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.703.507 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.703.508 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.703.555 [op_tiling_registry.cc:134]618670 OpTilingFuncRegistry:Register op tiling function V2 for op_type:MaxPoolGradWithArgmaxV2
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.703.582 [op_tiling_registry.cc:134]618670 OpTilingFuncRegistry:Register op tiling function V2 for op_type:MaxPoolGradWithArgmaxV1
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.703.621 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.703.621 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.703.682 [op_tiling_registry.cc:122]618670 OpTilingFuncRegistry:Register op tiling function V1 for op_type:MaxPoolWithArgmaxV2
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.703.730 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.703.737 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.703.786 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:MovingSumWithSigmoid
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.703.839 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.703.844 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.703.894 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:MseLossGrad
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.704.076 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.704.078 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.704.107 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:NMSWithMask
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.704.327 [op_tiling_registry.cc:122]618670 OpTilingFuncRegistry:Register op tiling function V1 for op_type:PadD
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.704.314 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:49] Start] The cpu collective rank 0 has been started successfully.
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.704.355 [mindspore/ccsrc/distributed/cluster/cluster_context.cc:184] node_num] Number of role MS_WORKER is 8
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.704.375 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.704.375 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.704.410 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:81] Initialize] Query retry count is 400
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.704.427 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:89] Initialize] Interval of retry allgather hostname lower and upper are 1 and 2
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.704.429 [op_tiling_registry.cc:122]618670 OpTilingFuncRegistry:Register op tiling function V1 for op_type:PadV3Grad
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.704.453 [mindspore/ccsrc/distributed/collective/collective_manager.cc:597] InitHostCommlib] Communication library on host side is successfully initialized. Global rank id: 0, global rank size: 8
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.704.489 [mindspore/ccsrc/distributed/collective/collective_manager.cc:198] Initialize] [PROF]InitHostCommlib costs 3005 msec.
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.704.508 [mindspore/ccsrc/distributed/collective/collective_manager.cc:640] AssignLocalRank] Host name for rank 0 is devserver-c233-2
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.704.526 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.704.539 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ReduceStdWithMean
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.704.526 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.704.642 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:564] GetHostNames] Worker gets host names {"hostnames":["devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2","devserver-c233-2"]}
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.704.644 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.704.652 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Resize
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.704.654 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.704.706 [mindspore/ccsrc/distributed/collective/collective_manager.cc:661] AssignLocalRank] Successfully get all nodes' hostname.
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.704.726 [mindspore/ccsrc/distributed/collective/collective_manager.cc:678] AssignLocalRank] The local rank id assigned for this process is 0
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.704.741 [mindspore/ccsrc/distributed/collective/collective_manager.cc:679] AssignLocalRank] The env 'DEVICE_ID' assigned for this process is: 0
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.704.778 [mindspore/ccsrc/distributed/collective/collective_manager.cc:697] AssignLocalRank] The device_id of ms_context is set to local rank id [0].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.704.770 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.704.778 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.704.802 [mindspore/ccsrc/distributed/collective/collective_manager.cc:206] Initialize] [PROF]AssignLocalRank costs 0.291 msec.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.704.847 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.704.873 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:236] Initialize] Start initializing device context.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.704.892 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] CORE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.704.903 [mindspore/core/utils/ms_context.cc:463] PrintJitLevelAndExecMode] The jit_level is: O0, and enable kernelbykernel executor in the PYNATIVE mode.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.704.886 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.704.925 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:250] Initialize] The current overflow detection mode is INFNAN.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.704.970 [device.cpp:365]618646 aclrtSetDeviceSatMode: start to execute aclrtSetDeviceSatMode, mode is 1
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:41.705.088 [api_impl.cc:249] 618646 CurrentContext: current ctx is nullptr!
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.705.104 [api_impl.cc:6795] 618646 SetDeviceSatMode: Set saturation mode to 1 for runtime process.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.705.104 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.705.116 [device.cpp:371]618646 aclrtSetDeviceSatMode: successfully execute aclrtSetDeviceSatMode, mode is 1
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.705.109 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ResizeBilinearV2
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.705.186 [callback.cpp:37]618646 aclrtSetExceptionInfoCallback: start to execute aclrtSetExceptionInfoCallback.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.705.224 [callback.cpp:44]618646 aclrtSetExceptionInfoCallback: successfully execute aclrtSetExceptionInfoCallback
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.705.227 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ReverseV2
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.705.247 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:235] Init] Start inititializing kernel runtime(SetDevice & CreateDefaultStream & MemoryManagerInitialization etc).
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.705.271 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:48] InitDevice] Enter SetRtDevice, current initialize device number:0
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.705.308 [device.cpp:143]618646 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 0.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.705.347 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Scale
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.705.394 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MedianDim] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.705.415 [npu_driver.cc:124] 618646 NpuDriver: Run mode=1 [0:offline, 1:online], env type=3
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.705.446 [api_impl.cc:2999] 618646 SetDevice: device_id=0, deviceMode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.705.487 [runtime.cc:3602] 618646 DeviceRetain: [dlog api] DlogReportStart exist.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.705.535 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SigmoidFocalLoss
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.705.546 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNormGradV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.705.547 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNormGradV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.705.651 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SigmoidFocalLossGrad
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.705.714 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.705.745 [hdc_core.c:1982][ascend][curpid:618646,618646][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4175; pid=618646)
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.705.782 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SignBitsPack
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.705.891 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SignBitsUnpack
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.705.927 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.705.954 [runtime.cc:3609] 618646 DeviceRetain: [dlog api] AtraceReportStart exist.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:41.705.998 [atrace_client_communication.c:103](tid:618646) send [hello] msg.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.705.996 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SmoothL1LossGradV2
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:41.706.018 [atrace_client_communication.c:63](tid:618646) send msg by adx[begin], resultLen=1024 bytes.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.706.102 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SmoothL1LossV2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.706.129 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.706.134 [hdc_core.c:1982][ascend][curpid:618646,618646][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4176; pid=618646)
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:41.706.150 [hdc_api.cpp:671][tid:618646] connect succ, peer_node: 0, peer_devid: 0
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.706.212 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SoftMarginLossGrad
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.706.302 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.706.336 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SoftmaxFocalLossGrad
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.706.347 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.706.346 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.706.439 [op_tiling_registry.cc:134]618670 OpTilingFuncRegistry:Register op tiling function V2 for op_type:Sort
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.706.459 [op_tiling_registry.cc:134]618670 OpTilingFuncRegistry:Register op tiling function V2 for op_type:SortV2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.706.473 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeTutelCombineGates] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.706.569 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SparseApplyFtrlD
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.706.669 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeTutelCombineX] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.706.668 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.706.669 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.706.693 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SparseReshape
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.706.801 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SplitV
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.706.819 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeTutelDispatch] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.706.821 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Split
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.706.911 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.706.928 [op_tiling_registry.cc:122]618670 OpTilingFuncRegistry:Register op tiling function V1 for op_type:SquareSumAll
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.707.033 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SyncBatchNormGatherStats
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.707.121 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.707.121 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.707.140 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Tile
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.707.183 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScore] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.707.242 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:TileD
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.707.315 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.707.369 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:TileWithAxis
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.707.472 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.707.471 [hdc_client.c:417][ascend][curpid:618646,618646][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4176)
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:41.707.515 [atrace_client_communication.c:65](tid:618646) send msg by adx[finish], ret=0.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:41.707.527 [atrace_client_communication.c:97](tid:618646) msgType=1, magic=49959, version=1.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:41.707.540 [atrace_client_communication.c:135](tid:618646) send [hello] msg success.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.707.582 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Unpack
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:41.707.617 [atrace_client_core.c:160](tid:618646) start to receive device[0] trace log.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.707.658 [runtime.cc:5239] 618646 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.707.673 [runtime.cc:2855] 618646 startAicpuExecutor: TsdOpen devId=0, device mode=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.707.685 [runtime.cc:5239] 618646 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.707.676 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.707.716 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.707.729 [client_manager.cpp:160][GetPlatformInfo][tid:618646] [TsdClient] mode[1] chipType[5]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.707.716 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.707.757 [hdc_core.c:1982][ascend][curpid:618646,618825][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4177; pid=618646)
[WARNING] TDT(618646,python3.9):2025-04-03-09:27:41.707.769 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618646] Get env[ASCEND_RT_VISIBLE_DEVICES] failed
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.707.777 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [OpExecuteFunc]
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:41.707.793 [hdc_api.cpp:671][tid:618825] connect succ, peer_node: 0, peer_devid: 0
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.707.797 [client_manager.cpp:582][GetVisibleDevices][tid:618646] [TsdClient] Get env ASCEND_RT_VISIBLE_DEVICES [].
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.707.811 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618646] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.707.822 [client_manager.cpp:125][GetInstance][tid:618646] [ClientManager] GetInstance, deviceId[0], g_runningMode[0], begin saving instance
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.707.839 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.707.839 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.707.862 [client_manager.cpp:435][IsHostEnvironment][tid:618646] [TsdClient] logicDeviceId is [0], hostaicpunum[0]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.707.858 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [OpExecuteFunc]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.707.878 [client_manager.cpp:464][GetClientRunMode][tid:618646] runningMode:0
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.707.889 [client_manager.cpp:127][GetInstance][tid:618646] [ClientManager] Current mode:1
[WARNING] TDT(618646,python3.9):2025-04-03-09:27:41.707.900 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618646] Get env[AICPU_PROFILING_MODE] failed
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.707.911 [client_manager.cpp:347][GetProfilingMode][tid:618646] Get AICPU_PROFILING_MODE[]
[WARNING] TDT(618646,python3.9):2025-04-03-09:27:41.707.952 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618646] Get env[ASCEND_MODULE_LOG_LEVEL] failed
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.707.942 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AscendAntiQuantV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.707.954 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.707.956 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.707.966 [process_mode_base.cpp:149][GetLogLevel][tid:618646] [TsdClient] get ASCEND_GLOBAL_LOG_LEVEL [1] ASCEND_GLOBAL_EVENT_ENABLE [0] ASCEND_MODULE_LOG_LEVEL []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.707.976 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Rfft1D] register OP_IMPL : [Tiling][TilingParse]
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:41.708.013 [atrace_client_communication.c:177](tid:618825) send [start] msg.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.708.025 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [OpExecuteFunc]
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:41.708.054 [atrace_client_communication.c:189](tid:618825) send [start] msg success.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.708.077 [process_mode_base.cpp:161][GetLogLevel][tid:618646] [TsdClient] Get Log Level[001]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.708.092 [process_mode_manager.cpp:71][OpenProcess][tid:618646] [ProcessModeManager] enter into open process deviceId[0] rankSize[0]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.708.106 [process_mode_manager.cpp:615][CheckNeedToOpen][tid:618646] [TsdClient] get open para startCp[1] startHccp[0] (0:false 1:true)
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.708.105 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.708.105 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.708.106 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.708.134 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.708.143 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.708.216 [client_manager.cpp:261][CheckPackageExists][tid:618646] [TsdClient] check file[.], deviceId[0]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.708.252 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.708.254 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.708.270 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Concat] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.708.298 [client_manager.cpp:261][CheckPackageExists][tid:618646] [TsdClient] check file[scene.info], deviceId[0]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.708.305 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ConcatV2] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.708.331 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.708.336 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.708.361 [client_manager.cpp:261][CheckPackageExists][tid:618646] [TsdClient] check file[Ascend-aicpu_syskernels.tar.gz], deviceId[0]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.708.357 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.708.371 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GemmaRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.708.445 [client_manager.cpp:264][CheckPackageExists][tid:618646] [TsdClient] find aicpu package[Ascend-aicpu_syskernels.tar.gz] in path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], deviceId[0]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.708.459 [client_manager.cpp:261][CheckPackageExists][tid:618646] [TsdClient] check file[ascend_install.info], deviceId[0]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.708.492 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.708.491 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [OpExecuteFunc]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.708.519 [client_manager.cpp:261][CheckPackageExists][tid:618646] [TsdClient] check file[version.info], deviceId[0]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.708.537 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPool3DWithArgmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.708.537 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPool3DWithArgmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.708.578 [client_manager.cpp:261][CheckPackageExists][tid:618646] [TsdClient] check file[..], deviceId[0]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.708.576 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.708.622 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.708.638 [client_manager.cpp:261][CheckPackageExists][tid:618646] [TsdClient] check file[Ascend-aicpu_extend_syskernels.tar.gz], deviceId[0]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.708.659 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.708.736 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : [OpExecuteFunc]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.708.770 [client_manager.cpp:268][CheckPackageExists][tid:618646] [TsdClient] find extend package[Ascend-aicpu_extend_syskernels.tar.gz] in path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], deviceId[0]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.708.785 [client_manager.cpp:283][CheckPackageExists][tid:618646] [TsdClient][deviceId=0] set extend package path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], name[Ascend-aicpu_extend_syskernels.tar.gz]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.708.797 [client_manager.cpp:286][CheckPackageExists][tid:618646] [TsdClient][deviceId=0] set aicpu package path[/usr/local/Ascend/ascend-toolkit/latest/opp/Ascend/aicpu/], name[Ascend-aicpu_syskernels.tar.gz]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.708.811 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LinearIndex] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.708.828 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [OpExecuteFunc]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.708.856 [devdrv_hccl.c:103][ascend][curpid:618646,618646][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618646)
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.708.872 [process_mode_manager.cpp:396][InitTsdClient][tid:618646] [TsdClient][deviceId=0] get process sign success, procPid[618646]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.708.883 [process_mode_manager.cpp:403][InitTsdClient][tid:618646] [TsdClient] deviceId[0] begin to init hdc client
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.708.922 [hdc_common.cpp:67][InitMsgSize][tid:618646] HdcCommon::InitMsgSize Start
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.708.920 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [OpExecuteFunc]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.708.939 [hdc_common.cpp:80][InitMsgSize][tid:618646] msgMaxSize_ = 524224 bytes, msgShortHeadDataMaxSize_ = 524212 bytes, msgLongHeadDataMaxSize_ = 524200 bytes
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.708.952 [hdc_client.cpp:184][CreateHdcSession][tid:618646] HdcClient::CreateHdcSession Start
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.708.951 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.709.007 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LinearIndexV2] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.709.030 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [OpExecuteFunc]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.709.037 [hdc_client.cpp:208][CreateHdcSession][tid:618646] [HdcClient] deviceId: 0 connect session
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.709.058 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [OpExecuteFunc]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.709.070 [hdc_core.c:1982][ascend][curpid:618646,618646][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4178; pid=618646)
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.709.086 [hdc_client.cpp:219][CreateHdcSession][tid:618646] [HdcClient] drvHdcSetSessionReference success
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.709.085 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [OpExecuteFunc]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.709.102 [hdc_client.cpp:230][CreateHdcSession][tid:618646] [HdcClient] deviceId: 0 connect session and drvHdcSetSessionReference success, sessionId=1
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.709.118 [version_verify.cpp:36][SetVersionInfo][tid:618646] VersionVerify: send client version to server
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.709.160 [version_verify.cpp:52][SetVersionInfo][tid:618646] send feature_info:{msg_type:35, features:{check before send aicpu package}}
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.709.164 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [OpExecuteFunc]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.709.195 [version_verify.cpp:52][SetVersionInfo][tid:618646] send feature_info:{msg_type:37, features:{check before send open qs message}}
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.709.197 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterAddWithSorted] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.709.208 [version_verify.cpp:52][SetVersionInfo][tid:618646] send feature_info:{msg_type:64, features:{get check code retry}}
[WARNING] TDT(618646,python3.9):2025-04-03-09:27:41.709.249 [internal_api.cpp:101][GetScheduleEnv][tid:618646] Get env[DATAMASTER_RUN_MODE] failed
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.709.256 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.709.344 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.709.352 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Sinkhorn] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.709.421 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.709.468 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.709.503 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.709.576 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.709.584 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.709.604 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.709.614 [version_verify.cpp:68][PeerVersionCheck][tid:618646] VersionVerify: Check client version info, server[1230], client[1230]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.709.633 [version_verify.cpp:89][ParseVersionInfo][tid:618646] VersionVerify: pass client version info success
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.709.644 [hdc_client.cpp:275][CheckHdcConnection][tid:618646] Service[2] create hdc success
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.709.660 [version_verify.cpp:122][SpecialFeatureCheck][tid:618646] VersionVerify: new type[35], supported
[WARNING] TDT(618646,python3.9):2025-04-03-09:27:41.709.674 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618646] Get env[ASAN_RUN_MODE] failed
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.709.670 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [OpExecuteFunc]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.709.706 [process_mode_manager.cpp:627][GetDeviceCheckCodeOnce][tid:618646] [TsdClient][deviceId=0] [sessionId=1] wait package info respond
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.709.720 [hdc_client.cpp:154][TsdRecvData][tid:618646] recv timeout is:150000 ms
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.709.752 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.709.833 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.709.915 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.709.968 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.710.013 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.710.100 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.710.172 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StackGroupPoints] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.710.187 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.710.272 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.710.334 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.710.353 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.710.436 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.710.459 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.710.515 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.710.616 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.710.644 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.710.728 [process_mode_msg_parse.cpp:148][PackageInfoMsgProc][tid:618646] [PackageInfoMsgProc] [sessionID=1]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.710.743 [process_mode_msg_parse.cpp:151][PackageInfoMsgProc][tid:618646] [PackageInfoMsgProc] [sessionID=1] deviceId[0], checkCode[56684994]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.710.731 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPool3DGradWithArgmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.710.731 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPool3DGradWithArgmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.710.758 [hdc_client.cpp:172][TsdRecvData][tid:618646] [deviceId=0] the Tsd recv data already
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.710.772 [version_verify.cpp:122][SpecialFeatureCheck][tid:618646] VersionVerify: new type[64], supported
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.710.784 [hdc_client.cpp:411][Destroy][tid:618646] enter HdcClient::Destroy() function
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.710.782 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.710.798 [hdc_client.c:417][ascend][curpid:618646,618646][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4178)
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.710.823 [hdc_client.cpp:394][DestroyClient][tid:618646] begin drvHdcClientDestroy
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.710.836 [hdc_client.cpp:399][DestroyClient][tid:618646] end drvHdcClientDestroy
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.710.847 [hdc_client.cpp:377][ClearClientPtr][tid:618646] begin HdcClient::ClearClientPtr
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.710.857 [hdc_client.cpp:385][ClearClientPtr][tid:618646] end HdcClient::ClearClientPtr
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.710.867 [hdc_client.cpp:418][Destroy][tid:618646] end HdcClient::Destroy() function
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.710.888 [process_mode_manager.cpp:371][SendAICPUPackage][tid:618646] [TsdClient]the checksum of host package[56684994] is same to device[56684994], skip send package.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.710.904 [process_mode_manager.cpp:1870][SendExtendPackage][tid:618646] [TsdClient]the checksum of host extend package[9658754] is same to device[9658754], skip send package.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.710.909 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.710.920 [devdrv_hccl.c:103][ascend][curpid:618646,618646][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618646)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.710.937 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.710.932 [process_mode_manager.cpp:396][InitTsdClient][tid:618646] [TsdClient][deviceId=0] get process sign success, procPid[618646]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.710.950 [process_mode_manager.cpp:403][InitTsdClient][tid:618646] [TsdClient] deviceId[0] begin to init hdc client
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.710.959 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.710.963 [hdc_common.cpp:67][InitMsgSize][tid:618646] HdcCommon::InitMsgSize Start
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.710.974 [hdc_common.cpp:80][InitMsgSize][tid:618646] msgMaxSize_ = 524224 bytes, msgShortHeadDataMaxSize_ = 524212 bytes, msgLongHeadDataMaxSize_ = 524200 bytes
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.710.987 [hdc_client.cpp:184][CreateHdcSession][tid:618646] HdcClient::CreateHdcSession Start
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.711.064 [hdc_client.cpp:208][CreateHdcSession][tid:618646] [HdcClient] deviceId: 0 connect session
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.711.091 [hdc_core.c:1982][ascend][curpid:618646,618646][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4179; pid=618646)
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.711.105 [hdc_client.cpp:219][CreateHdcSession][tid:618646] [HdcClient] drvHdcSetSessionReference success
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.711.116 [hdc_client.cpp:230][CreateHdcSession][tid:618646] [HdcClient] deviceId: 0 connect session and drvHdcSetSessionReference success, sessionId=1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.711.116 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.711.128 [version_verify.cpp:36][SetVersionInfo][tid:618646] VersionVerify: send client version to server
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.711.140 [version_verify.cpp:52][SetVersionInfo][tid:618646] send feature_info:{msg_type:35, features:{check before send aicpu package}}
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.711.151 [version_verify.cpp:52][SetVersionInfo][tid:618646] send feature_info:{msg_type:37, features:{check before send open qs message}}
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.711.162 [version_verify.cpp:52][SetVersionInfo][tid:618646] send feature_info:{msg_type:64, features:{get check code retry}}
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.711.320 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.711.414 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.711.425 [version_verify.cpp:68][PeerVersionCheck][tid:618646] VersionVerify: Check client version info, server[1230], client[1230]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.711.441 [version_verify.cpp:89][ParseVersionInfo][tid:618646] VersionVerify: pass client version info success
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.711.452 [hdc_client.cpp:275][CheckHdcConnection][tid:618646] Service[2] create hdc success
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.711.466 [process_mode_manager.cpp:458][ConstructOpenMsg][tid:618646] [TsdClient] tsd get process sign successfully, procpid[618646] signSize[48]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.711.481 [version_verify.cpp:114][SpecialFeatureCheck][tid:618646] VersionVerify: previous type[6], supported
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.711.506 [process_mode_manager.cpp:88][OpenProcess][tid:618646] [ProcessModeManager] deviceId[0] sessionId[1] rankSize[0], wait sub process start respond
[WARNING] TDT(618646,python3.9):2025-04-03-09:27:41.711.520 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618646] Get env[ASAN_RUN_MODE] failed
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.711.529 [hdc_client.cpp:154][TsdRecvData][tid:618646] recv timeout is:150000 ms
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.711.562 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.711.562 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.711.664 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.711.734 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.711.734 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.711.854 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.711.884 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.711.893 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CTCLossV3Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.711.893 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CTCLossV3Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.711.908 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.712.094 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.712.123 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.712.334 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618650] [ServerToClientMsgProc] [sessionID=1]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.712.356 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618650] [TsdClient] DeviceMsgProc recvMsg realDeviceId[1] msgType[8] localDevId[1] rspCode[0]heterogeneousSubPid[0], tsdSupportLevel_[63]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.712.370 [hdc_client.cpp:172][TsdRecvData][tid:618650] [deviceId=1] the Tsd recv data already
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.712.402 [devmm_svm.c:132][ascend][curpid:618650,618650][drv][devmm][devmm_setup_device]DrvMemDeviceOpen. (devid=1)
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.712.890 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CTCLossV3] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.712.890 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CTCLossV3] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.713.046 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.713.053 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.713.207 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3DGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.713.206 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3DGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.713.675 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.713.675 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.713.793 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.713.793 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.713.917 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.713.915 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.714.028 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.714.043 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.714.143 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.714.160 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.714.276 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.714.263 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.714.389 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.714.390 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.714.452 [devmm_virt_interface.c:450][ascend][curpid:618650,618650][drv][devmm][devmm_ioctl_init_process]Init_process details. (hostpid=618650)
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.714.501 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.714.505 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.714.613 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.714.616 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.714.725 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.714.726 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.714.749 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:DepthToSpace
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.714.779 [op_tiling_registry.cc:148]618670 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SpaceToDepth
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.714.858 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.714.859 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.714.885 [drv_log_user.c:623][ascend][curpid:618650,618650][drv][devmm][share_log_read_in_single_module]Setup device succeeded. (logical_devid=1; devid=1; vfid=0; hostpid=618650; devpid=30483)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.714.927 [devmm_svm.c:122][ascend][curpid:618650,618650][drv][devmm][devmm_set_device_info]Device info. (devid=1; dvpp_size=17179869184; support_bar_mem=1; support_dev_read_only=1; support_dev_mem_map_host=1; support_bar_huge_mem=1; is_alloced_by_malloc=0; host_rw_dev_ro=1; double_pgtable_offset=17592186044416; is_support_host_pin_pre_register=0; is_support_host_mem_pool=0)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.714.977 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: Conv2DBackpropFilter, registered count: 1
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.715.018 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PadV3GradReplication] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.715.018 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PadV3GradReplication] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.715.079 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: Conv2DBackpropInput, registered count: 2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.715.102 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: Conv2DTranspose, registered count: 3
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.715.142 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.715.143 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.715.178 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: Conv2D, registered count: 4
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.715.208 [stub_process_mode_nowin.cpp:60][ProcessQueueForMdc][tid:618650] [TsdClient] it is unnecessary of current mode[0] to grant queue auth to aicpusd
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.715.230 [stub_process_mode_nowin.cpp:99][OpenInHost][tid:618650] enter into OpenInHost deviceid[1]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.715.254 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: Conv3DBackpropInput, registered count: 5
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.715.262 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.715.260 [client_manager.cpp:435][IsHostEnvironment][tid:618650] [TsdClient] logicDeviceId is [1], hostaicpunum[0]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.715.279 [stub_process_mode_nowin.cpp:103][OpenInHost][tid:618650] host cpu not support
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.715.262 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.715.274 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: Conv3DTranspose, registered count: 6
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.715.293 [process_mode_manager.cpp:121][OpenProcess][tid:618650] [TsdClient][deviceId=1] [sessionId=1] start hccp and computer process success
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.715.308 [runtime.cc:2879] 618650 startAicpuExecutor: userDeviceId=1, devId=1, tsdOpen ret=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.715.321 [runtime.cc:2891] 618650 startAicpuExecutor: TsdOpen success, devId=1, ret=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.715.338 [runtime.cc:3627] 618650 DeviceRetain: new dev ok id=1, rawDevSize=1328 (bytes), ts_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.715.355 [raw_device.cc:936] 618650 DevSetTsId: DevSetTsId, tsId=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.715.356 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: Conv3D, registered count: 7
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.715.370 [npu_driver.cc:2968] 618650 DeviceOpen: Open device start, device_id=1, tsId=0.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.715.457 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.715.458 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.715.465 [trs_sqcq.c:458][ascend][curpid:618650,618650][drv][tsdrv][trsDevSqCqInit]Sqcq init. (devid=1)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.715.521 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: FFN, registered count: 8
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.715.540 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: MatmulTunnerTiling, registered count: 9
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.715.579 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.715.579 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.715.657 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: MatMulV2, registered count: 10
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.715.676 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: BatchMatmulFixpipe, registered count: 11
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.715.692 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.715.694 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.715.694 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: MatMulV3, registered count: 12
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.715.725 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: QuantBatchMatmulV3, registered count: 13
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.715.810 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.715.811 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.715.900 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: DynamicRNN, registered count: 14
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.715.919 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: MatMulTunnerTiling, registered count: 15
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.715.963 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.715.963 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.715.996 [trs_sqcq.c:394][ascend][curpid:618650,618650][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=1; tsId=0; id_type=6; num=2044)
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.716.139 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.716.141 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.716.275 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.716.275 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.716.339 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.716.402 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.716.408 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.716.432 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.716.436 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.716.478 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.716.532 [trs_sqcq.c:394][ascend][curpid:618650,618650][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=1; tsId=0; id_type=7; num=2044)
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.716.602 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.716.620 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.716.626 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.716.736 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.716.737 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.716.811 [trs_sqcq.c:394][ascend][curpid:618650,618650][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=1; tsId=0; id_type=10; num=1024)
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.716.865 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.716.864 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.716.893 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.717.034 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.717.045 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.717.050 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.717.086 [trs_sqcq.c:394][ascend][curpid:618650,618650][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=1; tsId=0; id_type=11; num=1024)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.717.097 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:MatMulV2, funcPointer:0xfffef9c98a10, registered count:3
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.717.134 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:MatMulV2, funcPointer:0xfffef9c98c70, registered count:1
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.717.155 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DeformableOffsetsGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.717.161 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.717.163 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.717.275 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.717.321 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.717.321 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.717.437 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.717.436 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.717.443 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.717.535 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.717.558 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.717.561 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.717.557 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.717.602 [trs_sqcq.c:394][ascend][curpid:618650,618650][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=1; tsId=0; id_type=12; num=2048)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.717.629 [trs_sqcq.c:394][ascend][curpid:618650,618650][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=1; tsId=0; id_type=8; num=16)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.717.653 [trs_sqcq.c:394][ascend][curpid:618650,618650][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=1; tsId=0; id_type=9; num=16)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.717.673 [trs_sqcq.c:394][ascend][curpid:618650,618650][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=1; tsId=0; id_type=13; num=4)
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.717.683 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.717.682 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.717.694 [trs_sqcq.c:394][ascend][curpid:618650,618650][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=1; tsId=0; id_type=14; num=10)
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.717.712 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.717.713 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.717.729 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.717.825 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.717.832 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.717.854 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.717.859 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.717.885 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.717.964 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.717.965 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.718.006 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.718.018 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.718.078 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.718.077 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.718.107 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.718.108 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.718.124 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.718.230 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.718.230 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.718.263 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachNonFiniteCheckAndUnscale] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.718.348 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.718.350 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.718.396 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.718.469 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.718.470 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.718.518 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.718.547 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.718.651 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.718.649 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.718.708 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GatherV3] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.718.771 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.718.773 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.718.827 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.718.981 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.718.980 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GridSampler2DGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.718.982 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GridSampler2DGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.719.107 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.719.133 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GridSampler3DGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.719.134 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GridSampler3DGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.719.246 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.719.275 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.719.304 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.719.303 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.719.395 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.719.484 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.719.483 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.719.517 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.719.667 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PadV4Grad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.719.667 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PadV4Grad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.719.683 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LinSpace] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.719.689 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.719.786 [trs_dev_drv.c:302][ascend][curpid:618650,618650][drv][tsdrv][drvDeviceOpenComm]Open success. (devid=1; fd=36; mmapFd=37)
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.719.807 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MemSet] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.719.814 [devmm_svm.c:132][ascend][curpid:618650,618650][drv][devmm][devmm_setup_device]DrvMemDeviceOpen. (devid=1)
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.719.852 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PadV3GradReplicate] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.719.852 [devmm_svm.c:122][ascend][curpid:618650,618650][drv][devmm][devmm_set_device_info]Device info. (devid=1; dvpp_size=17179869184; support_bar_mem=1; support_dev_read_only=1; support_dev_mem_map_host=1; support_bar_huge_mem=1; is_alloced_by_malloc=0; host_rw_dev_ro=1; double_pgtable_offset=17592186044416; is_support_host_pin_pre_register=0; is_support_host_mem_pool=0)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.719.860 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.719.852 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PadV3GradReplicate] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.719.920 [npu_driver.cc:3011] 618650 DeviceOpen: Open device success, device_id=1, tsId=0
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.719.924 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.719.941 [raw_device.cc:292] 618650 Init: chipType:0x5
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.719.947 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.719.966 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.719.978 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.719.985 [raw_device.cc:304] 618650 Init: isAddrFlat:0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.720.008 [raw_device.cc:320] 618650 Init: GetDevInfo, device_id=1, hardwareVersion=0x503
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.720.028 [devmm_svm.c:1972][ascend][curpid:618650,618650][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0x1; out_feature=0x1)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.720.046 [npu_driver.cc:1578] 618650 SupportNumaTsMemCtrl: chip type=5, support flag=1
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.720.050 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.720.097 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.720.098 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.720.234 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.720.235 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.720.234 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.720.328 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.720.357 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.720.359 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.720.365 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.720.391 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.720.391 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.720.490 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.720.578 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.720.577 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.720.614 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NPUClearFloatStatus] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.720.689 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.720.690 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.720.733 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NPUGetFloatStatus] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.720.780 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.720.813 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.720.813 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.720.859 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.720.895 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.720.931 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.720.931 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.721.026 [raw_device.cc:352] 618650 Init: Get phy info, phy chip id 1, phy die id 0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.721.052 [runtime.cc:2771] 618650 GetTsdQos: [TSD] start get qos, devId=1
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.721.046 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.721.047 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.721.072 [runtime.cc:5239] 618650 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.721.088 [tsd_client.cpp:189][TsdCapabilityGet][tid:618650] TsdCapabilityGet Begin.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.721.105 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618650] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.721.117 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618650] [TsdClient] g_userDeviceInfo is empty.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.721.125 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.721.131 [process_mode_manager.cpp:1042][CapabilityGet][tid:618650] [ProcessModeManager] enter into CapabilityGet process deviceId[1] type[0]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.721.149 [process_mode_manager.cpp:386][InitTsdClient][tid:618650] [TsdClient] tsd client has been inited before
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.721.156 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.721.157 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.721.169 [version_verify.cpp:114][SpecialFeatureCheck][tid:618650] VersionVerify: previous type[38], supported
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.721.207 [process_mode_manager.cpp:1065][CapabilityGet][tid:618650] [TsdClient][deviceId=1] [sessionId=1] [type=0]send capability success 
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.721.226 [hdc_client.cpp:154][TsdRecvData][tid:618650] recv timeout is:150000 ms
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.721.251 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.721.265 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.721.274 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.721.301 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.721.305 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.721.402 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.721.427 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.721.429 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.721.544 [process_mode_msg_parse.cpp:175][CapabilityResMsgProc][tid:618650] [CapabilityResMsgProc] [sessionID=1]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.721.585 [process_mode_msg_parse.cpp:170][PidQosMsgProc][tid:618650] [TsdClient] PidQosMsgProc recvMsg realDeviceId[1] msgType[39] localDevId[1] rspCode[0],pidqos[1]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.721.605 [hdc_client.cpp:172][TsdRecvData][tid:618650] [deviceId=1] the Tsd recv data already
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.721.623 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.721.627 [process_mode_manager.cpp:1070][CapabilityGet][tid:618650] [TsdClient][logicDeviceId_=1][type=0][pidQos=1][ret=0]recv capability respond finish
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.721.649 [runtime.cc:2782] 618650 GetTsdQos: [TSD] get qos success, userDeviceId=1, devId=1, qos=1
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.721.658 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.721.662 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.721.673 [engine.cc:78] 618650 Engine: Constructor.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.721.689 [stars_engine.cc:51] 618650 StarsEngine: Constructor.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.721.720 [engine_factory.cc:26] 618650 CreateEngine: new StarsEngine, Runtime_alloc_size 320
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.721.736 [engine_factory.cc:38] 618650 CreateEngine: Engine init success.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.721.745 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.721.752 [raw_device.cc:364] 618650 Init: new SpmPool ok, Runtime_alloc_size 56(bytes)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.721.769 [spm_pool.cc:42] 618650 Init: new buffer ok, Runtime_alloc_size 128
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.721.936 [buffer_allocator.cc:61] 618650 BufferAllocator: alloc success, Runtime_alloc_size 128(bytes)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.721.954 [spm_pool.cc:55] 618650 Init: new BufferAllocator ok, Runtime_alloc_size 152
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.721.963 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.721.968 [raw_device.cc:380] 618650 Init: new UmaArgLoader ok, Runtime_alloc_size 296(bytes)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.721.988 [devmm_svm.c:1972][ascend][curpid:618650,618650][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.722.004 [npu_driver.cc:6080] 618650 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.722.015 [devmm_svm.c:1972][ascend][curpid:618650,618650][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.722.030 [npu_driver.cc:6080] 618650 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.722.129 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.722.257 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.722.286 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.722.416 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.722.446 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.722.564 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.722.678 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.722.707 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.722.828 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.722.919 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.722.919 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.722.951 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.723.068 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.723.191 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.723.411 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.723.441 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.723.559 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.723.675 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.723.876 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.723.994 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.724.127 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.724.280 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.724.405 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.724.630 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.724.799 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.724.965 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.725.136 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.725.289 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.725.372 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.725.371 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.725.409 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.725.539 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BlendFaceBgPartOne] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.725.588 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.725.588 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.725.656 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.725.779 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.725.793 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.725.793 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.726.068 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.726.106 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.726.115 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.726.243 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.726.279 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.726.279 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.726.297 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNN, funcPointer:0xffff15345d70, registered count:1
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.726.435 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.726.435 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.726.474 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.726.498 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNNV2, funcPointer:0xffff1534e248, registered count:2
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.726.638 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.726.766 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.726.920 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.727.039 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GridSampler2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.727.172 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GridSampler3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.727.244 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.727.244 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.727.298 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandle] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.727.408 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.727.419 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.727.422 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandleV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.727.537 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.727.540 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.727.542 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.727.667 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PasteSubImg] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.727.689 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyAdamWV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.727.688 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyAdamWV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.727.785 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.727.814 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.727.845 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.727.852 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.727.946 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.727.989 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.727.990 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.728.074 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.728.151 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.728.152 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.728.246 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.728.324 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.728.323 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.728.366 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.728.472 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.728.473 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.728.483 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.728.617 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.728.618 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.728.618 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.728.734 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.728.734 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.728.740 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TabulateFusionGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.728.833 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.728.833 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.728.865 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[YUV4442YUV422] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.729.023 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.729.053 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.729.080 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.729.106 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.141 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.143 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.175 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.176 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.202 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.203 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.227 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.230 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.253 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.255 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.729.269 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.278 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.280 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.303 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.305 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.329 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.331 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.357 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.357 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.382 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.383 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.729.401 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.407 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.407 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.433 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.433 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.462 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.472 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.488 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.498 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.523 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.729.522 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.513 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.548 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.552 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.574 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.578 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.600 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.602 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.624 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.627 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.729.641 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.649 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.653 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.677 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.675 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.701 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.701 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.726 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.725 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.752 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.750 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.729.761 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.775 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.776 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.802 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.804 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.826 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.828 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.853 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.855 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.729.874 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.881 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.881 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.729.902 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.904 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.907 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.931 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.930 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.729.930 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.959 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.959 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.729.984 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.729.985 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.730.009 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.730.010 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.730.035 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.730.034 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.730.060 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.730.062 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.730.067 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.730.086 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.730.093 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.730.111 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.730.119 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.730.148 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.730.150 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.730.174 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.730.175 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.730.184 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.730.199 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.730.204 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.730.229 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.730.225 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.730.250 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.730.253 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.730.277 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.730.278 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.730.302 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.730.303 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.730.303 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.730.330 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.730.329 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.730.356 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.730.355 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.730.380 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.730.379 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.730.405 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.730.405 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.730.429 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.730.431 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.730.455 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.730.455 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.730.483 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.730.487 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.730.507 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicAtomicAddrClean] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.730.511 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.730.509 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.730.536 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.730.536 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.730.558 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.730.561 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.730.588 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.730.588 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.730.637 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.730.753 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachACosInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.730.753 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachACosInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.730.767 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.730.888 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.730.910 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.730.910 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.731.020 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.731.078 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMulScalarInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.731.083 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMulScalarInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.731.112 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachLogInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.731.112 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachLogInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.731.101 [buffer_allocator.cc:61] 618650 BufferAllocator: alloc success, Runtime_alloc_size 32768(bytes)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.731.138 [task_allocator.cc:46] 618650 DefaultAlloc: Runtime_alloc_size 32768(bytes)
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.731.135 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.731.140 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSubListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.731.150 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSubListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.731.168 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMulListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.731.175 [buffer_allocator.cc:61] 618650 BufferAllocator: alloc success, Runtime_alloc_size 104(bytes)
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.731.177 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMulListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.731.192 [h2d_copy_mgr.cc:45] 618650 H2DCopyMgr: alloc h2d copy buff success, policy 2
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.731.193 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachDivListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.731.203 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachDivListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.731.212 [devmm_svm.c:1972][ascend][curpid:618650,618650][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.731.231 [npu_driver.cc:6080] 618650 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.731.260 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.731.290 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceMeanD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.731.344 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSubScalarInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.731.343 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSubScalarInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.731.414 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.731.458 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.731.458 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.731.528 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.731.561 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.731.570 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.731.575 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.731.688 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.731.688 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.731.806 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.731.807 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.731.867 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.731.922 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.731.922 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.731.988 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.732.089 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.732.088 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.732.103 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.732.219 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.732.219 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.732.271 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.732.316 [buffer_allocator.cc:61] 618650 BufferAllocator: alloc success, Runtime_alloc_size 262144(bytes)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.732.339 [task_allocator.cc:46] 618650 DefaultAlloc: Runtime_alloc_size 4096(bytes)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.732.358 [buffer_allocator.cc:61] 618650 BufferAllocator: alloc success, Runtime_alloc_size 128(bytes)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.732.370 [h2d_copy_mgr.cc:45] 618650 H2DCopyMgr: alloc h2d copy buff success, policy 2
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.732.385 [devmm_svm.c:1972][ascend][curpid:618650,618650][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.732.388 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.732.385 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.732.388 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.732.403 [npu_driver.cc:6080] 618650 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.732.513 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.732.518 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.732.518 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.732.636 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.732.636 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.732.644 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.732.668 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.732.673 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.732.695 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.732.700 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.732.753 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.732.816 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.732.815 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.732.847 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.732.849 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.732.872 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.732.876 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.732.969 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.732.991 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.732.991 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.733.100 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.733.152 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.733.159 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.733.221 [buffer_allocator.cc:61] 618650 BufferAllocator: alloc success, Runtime_alloc_size 524288(bytes)
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.733.233 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.733.243 [task_allocator.cc:46] 618650 DefaultAlloc: Runtime_alloc_size 2048(bytes)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.733.257 [buffer_allocator.cc:61] 618650 BufferAllocator: alloc success, Runtime_alloc_size 136(bytes)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.733.285 [h2d_copy_mgr.cc:45] 618650 H2DCopyMgr: alloc h2d copy buff success, policy 2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.733.296 [uma_arg_loader.cc:86] 618650 Init: new BufferAllocator superArgAllocator_ ok, Runtime_alloc_size 152
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.733.310 [task_allocator.cc:46] 618650 DefaultAlloc: Runtime_alloc_size 32768(bytes)
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.733.324 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.733.326 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.733.341 [buffer_allocator.cc:61] 618650 BufferAllocator: alloc success, Runtime_alloc_size 104(bytes)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.733.357 [uma_arg_loader.cc:93] 618650 Init: new BufferAllocator handleAllocator_ ok, Runtime_alloc_size 152
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.733.476 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.733.476 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.733.596 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.733.598 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.733.790 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IndexPutWithSort] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.733.791 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IndexPutWithSort] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.733.912 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.733.919 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.734.107 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InplaceIndexAddWithSorted] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.734.112 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InplaceIndexAddWithSorted] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.734.181 [buffer_allocator.cc:61] 618650 BufferAllocator: alloc success, Runtime_alloc_size 131072(bytes)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.734.201 [uma_arg_loader.cc:102] 618650 Init: new BufferAllocator kernelInfoAllocator_ ok, Runtime_alloc_size 152
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.734.213 [uma_arg_loader.cc:104] 618650 Init: ALLOC PCIE is support[1]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.734.227 [devmm_svm.c:1972][ascend][curpid:618650,618650][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.734.227 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.734.228 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.734.245 [npu_driver.cc:6080] 618650 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.734.348 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.734.348 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.734.377 [buffer_allocator.cc:61] 618650 BufferAllocator: alloc success, Runtime_alloc_size 32768(bytes)
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.734.380 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.734.378 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.734.396 [h2d_copy_mgr.cc:45] 618650 H2DCopyMgr: alloc h2d copy buff success, policy 1
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.734.406 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.734.408 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.734.414 [raw_device.cc:393] 618650 Init: new StreamSqCqManage ok, Runtime_alloc_size 416(bytes)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.734.431 [raw_device.cc:398] 618650 Init: New taskFactory ok, Runtime_alloc_size 136(bytes)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.734.445 [task_allocator.cc:46] 618650 DefaultAlloc: Runtime_alloc_size 393216(bytes)
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.734.578 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.734.579 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.734.626 [buffer_allocator.cc:61] 618650 BufferAllocator: alloc success, Runtime_alloc_size 104(bytes)
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.734.753 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.734.754 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.734.818 [raw_device.cc:109] 618650 Init: ObjAllocator alloc success, Runtime_alloc_size 160000(bytes)
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.734.911 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.734.914 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.735.068 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.735.068 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.735.230 [raw_device.cc:121] 618650 Init: ObjAllocator alloc success, Runtime_alloc_size 960000(bytes)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.735.248 [raw_device.cc:425] 618650 Init: Runtime_alloc_size=64000(bytes)
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.735.257 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.735.261 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.735.304 [npu_driver.cc:404] 618650 StreamIdAlloc: stream id alloc begin, device_id=1, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.735.382 [stream.cc:2246] 618650 AllocExecutedTimesSvm: stream_id=0.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.735.410 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.735.408 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.735.418 [stream_sqcq_manage.cc:147] 618650 Alloc: deviceId=1, tsId=0, drvFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.735.435 [npu_driver.cc:882] 618650 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.735.532 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.735.534 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.735.697 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.735.697 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.735.770 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DepthToSpace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.735.810 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.735.838 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SpaceToDepth] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.735.858 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.735.858 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.735.950 [npu_driver.cc:6125] 618650 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.735.993 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.736.035 [npu_driver.cc:6137] 618650 LogicCqAllocateV2: success: deviceId=1, tsId=0, cqId=401, streamId=0, logicCq=401, cqeDepth=4096
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.736.040 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.736.040 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.736.070 [npu_driver.cc:6189] 618650 StreamBindLogicCq: success: deviceId=1, tsId=0, streamId=0, logicCq=401.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.736.091 [npu_driver.cc:5916] 618650 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=dcf0c000, addr=dfffdcf0c000size=4096
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.736.126 [stream.cc:653] 618650 Setup: Success to get sq=0 sq reg virtual addr length=4096.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.736.123 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.736.191 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.736.191 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.736.218 [stream.cc:276] 618650 CreateStreamTaskRes: Normal STREAM Setup stream_id=0 flags_=0xc0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.736.241 [stream.cc:688] 618650 Setup: stream setup end, stream_id=0, IsTaskSink=0, sqId=0, cqId=0, deviceId=1, streamResId=0
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:41.736.262 [stream_state_callback_manager.cc:45] 618650 Notify: not reg stream state callback func!
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.736.279 [raw_device.cc:593] 618650 Start: new primary Stream ok, Runtime_alloc_size 3872, stream_id=0.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.736.291 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.736.310 [npu_driver.cc:404] 618650 StreamIdAlloc: stream id alloc begin, device_id=1, priority=0, ts_id=0, remote_stream_id=0
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.736.312 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.736.314 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.736.338 [stream_sqcq_manage.cc:147] 618650 Alloc: deviceId=1, tsId=0, drvFlag=16
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.736.355 [npu_driver.cc:882] 618650 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.736.418 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.736.442 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.736.444 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.736.455 [tsch_stream.cc:45] 618650 Setup: stream setup end, stream_id=1, type=1, IsTaskSink=0, sqId=1, cqId=1, deviceId=1 streamResId=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.736.476 [raw_device.cc:1219] 618650 TschStreamSetup: Tsch setup ffts dsa stream ok, stream_id=1
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.736.537 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.736.565 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.736.564 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.736.647 [osal.cc:309] 618650 CreateThread: Runtime_alloc_size 56
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.736.653 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.736.682 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.736.681 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.736.779 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.736.832 [osal.cc:182] 618650 Start: mmCreateTaskWithThreadAttr, retCode=0, name_=MONITOR_0, i=0
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.736.853 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.736.854 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.736.858 [osal.cc:309] 618650 CreateThread: Runtime_alloc_size 56
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.736.897 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.736.919 [stars_engine.cc:1785] 618826 MonitoringRun: Starts Monitor thread has entered, ts_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.736.939 [osal.cc:182] 618650 Start: mmCreateTaskWithThreadAttr, retCode=0, name_=RT_RECYCLE, i=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.736.971 [runtime.cc:5239] 618826 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.736.967 [stars_engine.cc:201] 618827 RecycleThreadRun: RecycleThreadRun thread enter.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.736.994 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618826] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.737.022 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618826] [TsdClient] g_userDeviceInfo is empty.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.737.014 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.737.014 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.737.037 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618826] [TsdClient] g_userDeviceInfo is empty.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.737.028 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.737.059 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.076 [runtime.cc:3077] 618826 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=1, devId=1, tdt status=0
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.737.134 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Resize] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.737.133 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Resize] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.142 [npu_driver.cc:6306] 618826 GetDeviceStatus: GetDeviceStatus status=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.166 [stars_engine.cc:1855] 618826 ReportHBMRasProc: g_hbmRasCheckDeviceId init, dev_id=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.183 [npu_driver.cc:551] 618826 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.737.200 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.737.229 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.737.247 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.737.248 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.331 [engine.cc:188] 618650 SubmitTaskNormal: stream_id=0,task_id=0,task_type=97 (STARS_VERSION).
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.358 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=0, head=0.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.737.358 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.737.368 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.737.368 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.737.387 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.402 [task_info.cc:1596] 618650 ConstructSqeForStarsVersionTask: Send GetStarsVersionTask succ,sqe_type=3,pre_p=1,sqe->rt_streamID=32768,stream_id=0,task_id=0,task_type=97.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.433 [stream.cc:1400] 618650 AddTaskToList: public task, stream_id=0, task_id=0, task_type=97 (STARS_VERSION), head=0, tail=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.449 [stream.cc:2595] 618650 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=0, type=97(STARS_VERSION), head=0, tail=1, sqe_num=1, lastTail=0, device_id=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.487 [npu_driver.cc:751] 618650 SqTaskSend: device_id=1, ts_id=0, sq_id=0, sqe_num=1.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.737.495 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.737.495 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.737.500 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.504 [stars_engine.cc:893] 618650 SendTask: Sq task send finished, device_id=1, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=0, task_type=97(STARS_VERSION).
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.521 [stars_engine.cc:1122] 618650 SyncTask: Task Wait: device_id=1, stream_id=0, task_id=0, logicCqId=401.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.545 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=0, head=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.561 [stars_engine.cc:1071] 618650 IsSyncTaskFinish: Sync task finished, sqHead=0 finishedTaskId=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.591 [stars_engine.cc:1017] 618650 ProcReport: Get logic report: cnt=1, idx=0, stream_id=0, report task_id=0, sync task_id=0, sqeType=3, sqeHead=0, retCode=0x23, errType=0x20.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.737.611 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.737.618 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.737.615 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.611 [task.cc:185] 618650 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.639 [stars_engine.cc:1027] 618650 ProcReport: taskType=97.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.665 [task.cc:185] 618650 GetTask: this stream no taskRes, stream_id=0
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.681 [stars_engine.cc:1570] 618650 ProcLogicCqReport: CQE warning, device_id=1, stream_id=0, task_id=0, sqe_type=3(place holder), errType=0x20(sq sw status error), sqSwStatus=0x23
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.715 [task.cc:185] 618650 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.733 [logger.cc:152] 618650 TaskFinished: device_id=1, stream_id=0, task_id=0, task_type=97 (STARS_VERSION), task_finish_num=1
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.737.738 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.751 [task_info.cc:1614] 618650 DoCompleteSuccessForStarsVersionTask: Complete StarsVersionTask succ, retCode=35,tschVersion=35.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.767 [raw_device.cc:1305] 618650 SetTschVersion: Set tsch version=35.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.805 [stars_engine.cc:1351] 618650 StarsResumeRtsq: Begin to query sq status, stream_id=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.824 [npu_driver.cc:5618] 618650 GetSqEnable: deviceId=1, tsId=0, sqId=0, enable=0.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.840 [stars_engine.cc:1365] 618650 StarsResumeRtsq: sq already disable, stream_id=0, queryCnt=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.853 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=0, head=0.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.737.854 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.870 [npu_driver.cc:5595] 618650 GetSqTail: deviceId=1, tsId=0, sqId=0, tail=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.884 [npu_driver.cc:5406] 618650 SetSqHead: deviceId=1, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.905 [npu_driver.cc:5357] 618650 EnableSq: deviceId=1, tsId=0, sqId=0.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.924 [stars_engine.cc:1430] 618650 StarsResumeRtsq: Resume stream_id=0, sq_id=0, sq_head=0, task_id=0, taskType=97, head=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.944 [npu_driver.cc:5618] 618650 GetSqEnable: deviceId=1, tsId=0, sqId=0, enable=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.967 [stream.cc:1494] 618650 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.982 [raw_device.cc:1331] 618650 GetStarsVersion: send alloc get stars version task, stream_id=0, retCode:0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.737.998 [raw_device.cc:610] 618650 Start: Get TschVersion, tschVersion=35.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.738.062 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.738.061 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.738.097 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.738.389 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.738.523 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.738.522 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.738.554 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.738.643 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.738.642 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.738.672 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.738.765 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.738.766 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.738.795 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.738.796 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.738.803 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.738.922 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.738.925 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.738.941 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.739.039 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.739.040 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.739.159 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.739.162 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.739.282 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.739.281 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.739.396 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.739.399 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.739.517 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.739.517 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.739.621 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNormGradV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.739.613 [engine.cc:188] 618650 SubmitTaskNormal: stream_id=0,task_id=1,task_type=83 (DEVICE_RINGBUFFER_CONTROL).
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.739.640 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.739.642 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.739.699 [ringbuffer_maintain_task.cc:98] 618650 ConstructSqeForRingBufferMaintainTask: RingBufferMaintainTask stream_id=0, task_id=1, offset=0x1640
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.739.722 [stream.cc:1400] 618650 AddTaskToList: public task, stream_id=0, task_id=1, task_type=83 (DEVICE_RINGBUFFER_CONTROL), head=1, tail=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.739.742 [stream.cc:2595] 618650 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=1, type=83(DEVICE_RINGBUFFER_CONTROL), head=1, tail=2, sqe_num=1, lastTail=1, device_id=1
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.739.756 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.739.767 [npu_driver.cc:751] 618650 SqTaskSend: device_id=1, ts_id=0, sq_id=0, sqe_num=1.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.739.756 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.739.784 [stars_engine.cc:893] 618650 SendTask: Sq task send finished, device_id=1, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=1, task_type=83(DEVICE_RINGBUFFER_CONTROL).
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.739.803 [stream.cc:1494] 618650 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.739.823 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.739.868 [stars_engine.cc:622] 618650 ProcLogicCqUntilEmpty: Task Wait: stream_id=0, logicCqId=401, retCode=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.739.887 [stream.cc:2886] 618650 StarsWaitForTask: No.0 stream_id=0, taskId=1, currentId=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.739.904 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.739.921 [stream.cc:2886] 618650 StarsWaitForTask: No.1 stream_id=0, taskId=1, currentId=0
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.739.925 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.739.925 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.739.938 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.739.955 [stream.cc:2886] 618650 StarsWaitForTask: No.2 stream_id=0, taskId=1, currentId=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.739.973 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=0, head=2.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.739.989 [task.cc:185] 618650 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.740.006 [task.cc:185] 618650 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.740.024 [logger.cc:152] 618650 TaskFinished: device_id=1, stream_id=0, task_id=1, task_type=83 (DEVICE_RINGBUFFER_CONTROL), task_finish_num=2
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.740.043 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.740.045 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.740.046 [stars_engine.cc:437] 618650 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=1, sqHead=2, endTaskId=1, recycleTaskId=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.740.065 [stream.cc:2886] 618650 StarsWaitForTask: No.3 stream_id=0, taskId=1, currentId=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.740.138 [engine.cc:188] 618650 SubmitTaskNormal: stream_id=0,task_id=2,task_type=29 (ALLOC_DSA_ADDR).
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.740.174 [task_info.cc:111] 618650 ConstructSqeForAllocDsaAddrTask: Send AllocDsaAddrTask succ, sq[INFO] GE(618662,python3.9):2025-04-03-09:27:41.740.175 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [Tiling][TilingParse]
e_type=3, pre_p=1, stream_id=0, task_id=2, task_type=29, dsa_sq_id=1.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.740.182 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.740.220 [stream.cc:1400] 618650 AddTaskToList: public task, stream_id=0, task_id=2, task_type=29 (ALLOC_DSA_ADDR), head=2, tail=3
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.740.237 [stream.cc:2595] 618650 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=2, type=29(ALLOC_DSA_ADDR), head=2, tail=3, sqe_num=1, lastTail=2, device_id=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.740.257 [npu_driver.cc:751] 618650 SqTaskSend: device_id=1, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.740.270 [stars_engine.cc:893] 618650 SendTask: Sq task send finished, device_id=1, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=2, task_type=29(ALLOC_DSA_ADDR).
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.740.288 [stars_engine.cc:1122] 618650 SyncTask: Task Wait: device_id=1, stream_id=0, task_id=2, logicCqId=401.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.740.379 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.740.381 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.740.411 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=0, head=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.740.428 [stars_engine.cc:1071] 618650 IsSyncTaskFinish: Sync task finished, sqHead=3 finishedTaskId=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.740.443 [stars_engine.cc:1017] 618650 ProcReport: Get logic report: cnt=1, idx=0, stream_id=0, report task_id=2, sync task_id=2, sqeType=3, sqeHead=2, retCode=0, errType=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.740.461 [task.cc:185] 618650 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.740.475 [stars_engine.cc:1027] 618650 ProcReport: taskType=29.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.740.488 [task.cc:185] 618650 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.740.501 [task.cc:185] 618650 GetTask: this stream no taskRes, stream_id=0
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.740.498 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.740.503 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.740.516 [logger.cc:152] 618650 TaskFinished: device_id=1, stream_id=0, task_id=2, task_type=29 (ALLOC_DSA_ADDR), task_finish_num=3
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.740.500 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.740.542 [npu_driver.cc:5618] 618650 GetSqEnable: deviceId=1, tsId=0, sqId=0, enable=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.740.558 [stream.cc:1494] 618650 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=2.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.740.570 [raw_device.cc:1232] 618650 TschStreamAllocDsaAddr: send alloc dsa sq task, stream_id=1, retCode:0
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:41.740.598 [atrace_api.c:40](tid:618650) AtraceCreate start.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.740.626 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.740.626 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.740.746 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.740.747 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.740.849 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.740.945 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.740.946 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.741.123 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.741.125 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.741.242 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RoiPoolingGradWithArgMax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.741.241 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RoiPoolingGradWithArgMax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.741.332 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.741.356 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.741.357 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.741.482 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.741.482 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.741.612 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.741.612 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.741.727 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.741.735 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:41.741.755 [trace_rb_log.c:45](tid:618650) init ring buffer time finished, realTime 1743643661740687920, monotonicTime 4163095133639, freq 99994 kHz, minutesWest 480 minutes
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:41.741.774 [trace_rb_log.c:137](tid:618650) [RUNTIME_ATRACE_DEV1_TS0] create ring buffer success, msgSize 128 bytes, msgTxtSize 112 bytes, bufferSize 1024 bytes, msg space 128 bytes, total space 131568 bytes
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:41.741.794 [tracer_mgr_operate.c:66](tid:618650) create object RUNTIME_ATRACE_DEV1_TS0 success, exitSave(false), noLock(false).
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:41.741.808 [atrace_api.c:44](tid:618650) AtraceCreate end.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.741.848 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.741.849 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:41.741.859 [trace_event.c:70](tid:618650) limitedNum 1, processType 0 
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:41.741.876 [trace_event.c:372](tid:618650) set trace event attr limitedNum: 1, processType: 0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.741.894 [runtime.cc:3159] 618650 SetTsdProfCallback: set tsd prof callback
[INFO] TDT(618650,python3.9):2025-04-03-09:27:41.741.908 [client_manager.cpp:196][SetProfilingCallback][tid:618650] [TsdClient] set profiling callback success
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.741.948 [runtime.cc:3364] 618650 PrimaryContextRetain: new Context ok, Runtime_alloc_size 424
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.741.963 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.741.965 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.741.966 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.742.026 [context.cc:109] 618650 Init: ObjAllocator alloc success, Runtime_alloc_size 160000(bytes)
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.742.095 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.742.121 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StackBallQuery] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.742.121 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StackBallQuery] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.742.216 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.742.241 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.742.242 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.742.257 [context.cc:121] 618650 Init: ObjAllocator alloc success, Runtime_alloc_size 960000(bytes)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.742.273 [context.cc:276] 618650 Init: Runtime_alloc_size is 16000.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.742.326 [raw_device.cc:803] 618650 UpdateTimeoutConfig: No need to update timeout config.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:41.742.344 [npu_driver_dcache_lock.cpp:39] 618650 AllocAddrForDcache: halMemCtl failed, drvRet=65534, outSize=0
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.742.376 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.742.403 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.742.404 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.742.487 [raw_device.cc:528] 618650 AllocStackPhyBase: AllocStackPhyBase device_id=1, stackPhyBase32k_=0x12c140000000, stackPhySize=2457600.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.742.508 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.742.539 [raw_device.cc:232] 618650 LaunchDcacheLockOp: dcache lock has been set or stack addr is not for dcache, dCacheLockFlag_=0, stackAddrIsDcache_=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.742.565 [runtime.cc:3393] 618650 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.742.581 [runtime.cc:3560] 618650 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.742.599 [api_impl.cc:2987] 618650 NewDevice: SetCurRef = 0xaaab312ab590,userDeviceId=1,deviceId=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.742.614 [runtime.cc:5239] 618650 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.742.631 [api_impl.cc:2992] 618650 NewDevice: New device success, user_device_id=1, die_num=1.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:41.742.654 [awatchdog_core.c:175](tid:618650) create watchdog for id : 65543, tid : 618650, timeout : 300s
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.742.664 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScoreGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.742.664 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScoreGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.742.671 [api_impl.cc:3025] 618650 SetDevice: SetDevice success, curCtx=0xaaab312ab590, user_device_id=1.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.742.715 [acl.cpp:115]618650 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.742.732 [acl.cpp:121]618650 GetSocVersion: socVersion is Ascend910B3
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.742.815 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPool3DWithArgmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.742.861 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.742.861 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.743.045 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.743.043 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.743.227 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.743.227 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.743.449 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.743.449 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.743.668 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.743.666 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.743.899 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.743.901 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.743.926 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.743.927 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.743.950 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.743.951 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.743.972 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.743.972 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.744.007 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.744.010 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.744.033 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.744.037 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.744.059 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.744.067 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.744.085 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.744.092 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.744.856 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.744.856 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.745.138 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPool3DGradWithArgmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.745.280 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.745.279 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.745.698 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.745.698 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.745.747 [api_impl.cc:3476] 618650 GetDeviceInfo: get device info, deviceId=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.745.783 [api_impl.cc:3476] 618650 GetDeviceInfo: get device info, deviceId=1
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.745.830 [device.cpp:133]618650 UpdatePlatformInfoWithDevice: Successfully to UpdatePlatformInfoWithDevice, deviceId = 1, aicCnt = 20, vecCoreCnt = 40, cubeCoreCnt = 20
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.745.853 [device.cpp:154]618650 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 1
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.745.872 [context.cpp:87]618650 aclrtGetCurrentContext: start to execute aclrtGetCurrentContext
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.745.897 [context.cpp:98]618650 aclrtGetCurrentContext: successfully execute aclrtGetCurrentContext
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.745.896 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.745.897 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.745.923 [stream.cpp:48]618650 aclrtCreateStreamWithConfig: start to execute aclrtCreateStreamWithConfig with priority:0, flag:3
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.745.957 [api_impl.cc:1120] 618650 StreamCreate: priority=0, flags=1536.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.746.018 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.746.029 [npu_driver.cc:404] 618650 StreamIdAlloc: stream id alloc begin, device_id=1, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.746.068 [stream.cc:2246] 618650 AllocExecutedTimesSvm: stream_id=2.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.746.114 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.746.114 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.746.123 [stream_sqcq_manage.cc:147] 618650 Alloc: deviceId=1, tsId=0, drvFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.746.141 [npu_driver.cc:882] 618650 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.746.193 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.746.360 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CTCLossV3Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.746.463 [npu_driver.cc:6125] 618650 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.746.515 [npu_driver.cc:6137] 618650 LogicCqAllocateV2: success: deviceId=1, tsId=0, cqId=402, streamId=2, logicCq=402, cqeDepth=4096
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.746.518 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.746.518 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.746.539 [npu_driver.cc:6189] 618650 StreamBindLogicCq: success: deviceId=1, tsId=0, streamId=2, logicCq=402.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.746.559 [npu_driver.cc:5916] 618650 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=d442a000, addr=dfffd442a000size=4096
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.746.576 [stream.cc:653] 618650 Setup: Success to get sq=2 sq reg virtual addr length=4096.
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.746.628 [devmm_svm.c:1972][ascend][curpid:618650,618650][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.746.647 [npu_driver.cc:6080] 618650 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.746.652 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.746.654 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.746.826 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.746.826 [stream.cc:291] 618650 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=2, flags_=0x600.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.746.826 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.747.397 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CTCLossV3] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.747.558 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.747.724 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3DGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.748.264 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.748.387 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.748.507 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.748.628 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.748.721 [stream.cc:688] 618650 Setup: stream setup end, stream_id=2, IsTaskSink=0, sqId=2, cqId=2, deviceId=1, streamResId=65535
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:41.748.750 [stream_state_callback_manager.cc:45] 618650 Notify: not reg stream state callback func!
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.748.768 [api_impl.cc:1162] 618650 StreamCreate: Succ, flags=1536, stream_id=2, context=aaab312ab590
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.748.756 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.748.787 [stream.cpp:189]618650 aclrtSetStreamFailureMode: start to execute aclrtSetStreamFailureMode, mode is 1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.748.808 [stream.cc:3161] 618650 SetFailMode: stream_id=2 is updated from CONTINUE to STOP.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.748.822 [stream.cpp:195]618650 aclrtSetStreamFailureMode: successfully execute aclrtSetStreamFailureMode, mode is 1
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.748.879 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:105] RegCallback] Register callback thread, stream : 0xaaab322faa00.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.748.896 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [Tiling][TilingParse]
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.748.911 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:377] CreateDefaultStream] Create ascend default stream, stream id: 0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.748.926 [stream.cpp:48]618650 aclrtCreateStreamWithConfig: start to execute aclrtCreateStreamWithConfig with priority:0, flag:3
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.748.946 [api_impl.cc:1120] 618650 StreamCreate: priority=0, flags=1536.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.748.981 [npu_driver.cc:404] 618650 StreamIdAlloc: stream id alloc begin, device_id=1, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.749.015 [stream.cc:2246] 618650 AllocExecutedTimesSvm: stream_id=3.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.749.022 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.749.052 [stream_sqcq_manage.cc:147] 618650 Alloc: deviceId=1, tsId=0, drvFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.749.069 [npu_driver.cc:882] 618650 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.749.141 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.749.267 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.749.309 [npu_driver.cc:6125] 618650 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.749.375 [npu_driver.cc:6137] 618650 LogicCqAllocateV2: success: deviceId=1, tsId=0, cqId=403, streamId=3, logicCq=403, cqeDepth=4096
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.749.387 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.749.398 [npu_driver.cc:6189] 618650 StreamBindLogicCq: success: deviceId=1, tsId=0, streamId=3, logicCq=403.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.749.416 [npu_driver.cc:5916] 618650 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=d4409000, addr=dfffd4409000size=4096
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.749.433 [stream.cc:653] 618650 Setup: Success to get sq=3 sq reg virtual addr length=4096.
[INFO] DRV(618650,python3.9):2025-04-03-09:27:41.749.482 [devmm_svm.c:1972][ascend][curpid:618650,618650][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.749.501 [npu_driver.cc:6080] 618650 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.749.531 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.749.604 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.749.604 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.749.695 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PadV3GradReplication] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.749.820 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.749.819 [stream.cc:291] 618650 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=3, flags_=0x600.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.749.949 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.750.141 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.750.268 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.750.384 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.750.465 [stream.cc:688] 618650 Setup: stream setup end, stream_id=3, IsTaskSink=0, sqId=3, cqId=3, deviceId=1, streamResId=0
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:41.750.485 [stream_state_callback_manager.cc:45] 618650 Notify: not reg stream state callback func!
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.750.498 [api_impl.cc:1162] 618650 StreamCreate: Succ, flags=1536, stream_id=3, context=aaab312ab590
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.750.511 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.750.515 [stream.cpp:189]618650 aclrtSetStreamFailureMode: start to execute aclrtSetStreamFailureMode, mode is 1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.750.536 [stream.cc:3161] 618650 SetFailMode: stream_id=3 is updated from CONTINUE to STOP.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.750.549 [stream.cpp:195]618650 aclrtSetStreamFailureMode: successfully execute aclrtSetStreamFailureMode, mode is 1
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.750.587 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:105] RegCallback] Register callback thread, stream : 0xaaab3242b9f0.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.750.674 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.750.725 [callback.cpp:25]618650 aclrtSubscribeReport: start to execute aclrtSubscribeReport, threadId is 281471881244576.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.750.750 [npu_driver.cc:462] 618650 EventIdAlloc: event id alloc begin, device_id=1, ts_id=0, remote_event_id=0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.750.769 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:41.750.807 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.750.814 [npu_driver.cc:483] 618650 EventIdAlloc: Event id alloc success, device_id=1, ts_id=0, event_id=0, eventFlag=0
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:41.750.824 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.750.829 [event.cc:347] 618650 GenEventId: Event id alloc success, device_id=1, tsId=0, eventFlag=1, event_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.750.847 [subscribe.cc:54] 618650 AssignGroupId: give groupId=320
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.750.862 [npu_driver.cc:3775] 618650 SqCqAllocate: deviceId=1, tsId=0, groupId=320.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.750.857 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.750.884 [npu_driver.cc:3785] 618650 SqCqAllocate: alloc success, deviceId=1 sqId=131, cqId=131.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.750.892 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.750.902 [subscribe.cc:131] 618650 Insert: callback subscribe: groupId=320, threadId=281471881244576, devId=1, tsId=0, streamId=2, sqId=131, cqId=131
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.750.922 [callback.cpp:31]618650 aclrtSubscribeReport: successfully execute aclrtSubscribeReport, threadId is 281471881244576.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.750.945 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.750.949 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:125] RegCallback] Register callback thread success, stream : 0xaaab322faa00.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.750.964 [npu_driver.cc:3828] 618828 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=320.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.750.982 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.751.036 [callback.cpp:25]618650 aclrtSubscribeReport: start to execute aclrtSubscribeReport, threadId is 281471872790432.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.751.058 [npu_driver.cc:462] 618650 EventIdAlloc: event id alloc begin, device_id=1, ts_id=0, remote_event_id=0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.751.068 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.751.078 [npu_driver.cc:483] 618650 EventIdAlloc: Event id alloc success, device_id=1, ts_id=0, event_id=1, eventFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.751.097 [event.cc:347] 618650 GenEventId: Event id alloc success, device_id=1, tsId=0, eventFlag=1, event_id=1
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:41.751.104 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.751.111 [subscribe.cc:54] 618650 AssignGroupId: give groupId=321
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:41.751.120 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.751.109 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.751.129 [npu_driver.cc:3775] 618650 SqCqAllocate: deviceId=1, tsId=0, groupId=321.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.751.135 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.751.139 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.751.145 [npu_driver.cc:3785] 618650 SqCqAllocate: alloc success, deviceId=1 sqId=132, cqId=132.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.751.151 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.751.162 [subscribe.cc:131] 618650 Insert: callback subscribe: groupId=321, threadId=281471872790432, devId=1, tsId=0, streamId=3, sqId=132, cqId=132
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.751.180 [callback.cpp:31]618650 aclrtSubscribeReport: successfully execute aclrtSubscribeReport, threadId is 281471872790432.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.751.188 [npu_driver.cc:3828] 618829 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=321.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.751.207 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:125] RegCallback] Register callback thread success, stream : 0xaaab3242b9f0.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.751.229 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:386] CreateDefaultStream] Create ascend communication stream, stream id: 1
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.751.305 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:110] Initialize] Config huge_page_reserve_size : 0, device_hbm_huge_page_reserved_size_ : 0
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.751.334 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.751.368 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.751.452 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.751.467 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.751.467 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.751.497 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.751.583 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.751.627 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.751.627 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.751.640 [npu_driver.cc:2616] 618650 MemGetInfoEx: memory info type=1, type=2, free=8864006144, hug_free=56245616640
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.751.683 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:60] AscendVmmAdapter] VMM align size is 2097152
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.751.693 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.751.749 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [Tiling][TilingParse]
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.751.762 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:158] CheckVmmDriverVersion] Driver path is /usr/local/Ascend
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.751.767 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.751.755 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.751.778 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [OpExecuteFunc]
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.751.805 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:187] CheckVmmDriverVersion] Driver version is 25.0.rc1.b070, major version is 25
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.751.833 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:113] IsVmmEnabled] VMM is enabled.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.751.855 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:180] Initialize] Device MOC Size:62420M, Device free MOC Size:62093M, Reserved MOC size for Other Components(HCCL/rts/etc.):3891M, Recommend Reserved MOC size for Other Components:3880M, User define MindSpore MOC Size:0G, MindSpore Used MOC Size:58202M.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.751.878 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_dynamic_mem_adapter.cc:57] Initialize] Ascend Memory Adapter initialize success, Memory Statistics:
Device MOC memory size: 62420M
MindSpore Used memory size: 58202M
Used peak memory usage (without fragments): 0M
Actual peak memory usage (with fragments): 0M

[INFO] GE(618674,python3.9):2025-04-03-09:27:41.751.879 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.751.884 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.751.892 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.751.904 [event.cpp:260]618650 aclrtSetOpWaitTimeout: start to execute aclrtSetOpWaitTimeout, timeout = 1980s
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.751.925 [api_impl.cc:5713] 618650 SetOpWaitTimeOut: set OP wait timeout:1980.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.751.928 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.752.071 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.752.075 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.752.180 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CircularPad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.752.180 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CircularPad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.752.230 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.752.347 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CircularPadGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.752.360 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.752.347 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CircularPadGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.752.487 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.752.519 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.752.545 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.752.546 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.752.639 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.752.668 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.752.735 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.752.784 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.752.836 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.752.885 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.752.883 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.752.902 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.752.917 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.752.918 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.752.930 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.752.945 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.752.949 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.752.976 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.752.976 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.753.002 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.753.004 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.752.999 [engine.cc:188] 618650 SubmitTaskNormal: stream_id=0,task_id=3,task_type=86 (TASK_TIMEOUT_SET).
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.026 [timeout_set_task.cc:115] 618650 ConstructSqeForTimeoutSetTask: TaskTimeoutSetTask ConstructSqe finish,topic_type=0,cmd_type=13
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.047 [stream.cc:1400] 618650 AddTaskToList: public task, stream_id=0, task_id=3, task_type=86 (TASK_TIMEOUT_SET), head=3, tail=4
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.753.062 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.063 [stream.cc:2595] 618650 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=3, type=86(TASK_TIMEOUT_SET), head=3, tail=4, sqe_num=1, lastTail=3, device_id=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.085 [npu_driver.cc:751] 618650 SqTaskSend: device_id=1, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.099 [stars_engine.cc:893] 618650 SendTask: Sq task send finished, device_id=1, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=3, task_type=86(TASK_TIMEOUT_SET).
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.753.101 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.116 [stream.cc:1494] 618650 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.135 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=0, head=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.169 [stars_engine.cc:622] 618650 ProcLogicCqUntilEmpty: Task Wait: stream_id=0, logicCqId=401, retCode=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.186 [stream.cc:2886] 618650 StarsWaitForTask: No.0 stream_id=0, taskId=3, currentId=2
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.753.188 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.753.194 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleLinear1d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.753.194 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleLinear1d] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.201 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=0, head=3.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.753.204 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MlaAttentionScore] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.753.226 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleBilinear2d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.753.227 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleBilinear2d] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.217 [stream.cc:2886] 618650 StarsWaitForTask: No.1 stream_id=0, taskId=3, currentId=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.247 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=0, head=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.260 [stream.cc:2886] 618650 StarsWaitForTask: No.2 stream_id=0, taskId=3, currentId=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.274 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.290 [task.cc:185] 618650 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.305 [task.cc:185] 618650 GetTask: this stream no taskRes, stream_id=0
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.753.317 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.320 [logger.cc:152] 618650 TaskFinished: device_id=1, stream_id=0, task_id=3, task_type=86 (TASK_TIMEOUT_SET), task_finish_num=4
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.340 [stars_engine.cc:437] 618650 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=3, sqHead=4, endTaskId=3, recycleTaskId=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.358 [stream.cc:2886] 618650 StarsWaitForTask: No.3 stream_id=0, taskId=3, currentId=3
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.753.373 [event.cpp:262]618650 aclrtSetOpWaitTimeout: successfully execute aclrtSetOpWaitTimeout, timeout = 1980s
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.753.374 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.753.389 [event.cpp:269]618650 aclrtSetOpExecuteTimeOut: start to execute aclrtSetOpExecuteTimeOut, timeout = 900s
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.753.395 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleBicubic2d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.753.395 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleBicubic2d] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.411 [engine.cc:188] 618650 SubmitTaskNormal: stream_id=0,task_id=4,task_type=86 (TASK_TIMEOUT_SET).
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.427 [timeout_set_task.cc:115] 618650 ConstructSqeForTimeoutSetTask: TaskTimeoutSetTask ConstructSqe finish,topic_type=0,cmd_type=13
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.444 [stream.cc:1400] 618650 AddTaskToList: public task, stream_id=0, task_id=4, task_type=86 (TASK_TIMEOUT_SET), head=4, tail=5
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.458 [stream.cc:2595] 618650 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=4, type=86(TASK_TIMEOUT_SET), head=4, tail=5, sqe_num=1, lastTail=4, device_id=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.476 [npu_driver.cc:751] 618650 SqTaskSend: device_id=1, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.492 [stars_engine.cc:893] 618650 SendTask: Sq task send finished, device_id=1, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=4, task_type=86(TASK_TIMEOUT_SET).
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.509 [stream.cc:1494] 618650 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=4.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.753.506 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.522 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.538 [stream.cc:2886] 618650 StarsWaitForTask: No.0 stream_id=0, taskId=4, currentId=3
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.553 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.568 [stream.cc:2886] 618650 StarsWaitForTask: No.1 stream_id=0, taskId=4, currentId=3
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.753.573 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.753.572 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAA] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.581 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.598 [stream.cc:2886] 618650 StarsWaitForTask: No.2 stream_id=0, taskId=4, currentId=3
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.613 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=0, head=5.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.753.623 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.628 [task.cc:185] 618650 GetTask: this stream no taskRes, stream_id=0
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.753.639 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.645 [task.cc:185] 618650 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.662 [logger.cc:152] 618650 TaskFinished: device_id=1, stream_id=0, task_id=4, task_type=86 (TASK_TIMEOUT_SET), task_finish_num=5
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.686 [stars_engine.cc:437] 618650 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=4, sqHead=5, endTaskId=4, recycleTaskId=4.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.753.703 [stream.cc:2886] 618650 StarsWaitForTask: No.3 stream_id=0, taskId=4, currentId=4
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.753.718 [event.cpp:277]618650 aclrtSetOpExecuteTimeOut: successfully execute aclrtSetOpExecuteTimeOut, timeout = 900s
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.753.739 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAAGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.753.739 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAAGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.753.745 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:285] Init] End inititializing kernel runtime.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.753.786 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:48] InitDevice] Enter SetRtDevice, current initialize device number:1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.753.792 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.753.806 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:50] InitDevice] Device 1 has been set
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.753.825 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:381] CreateDefaultStream] The default compute stream is already created, skip.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.753.843 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:390] CreateDefaultStream] The default communication stream is already created, skip.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.753.862 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GridSampler2DGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.753.888 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_pool.cc:165] DefaultEnhancedAscendMemoryPool] DefaultEnhancedAscendMemoryPool constructed.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.753.905 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.753.908 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.753.915 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:397] Initialize] Skip initialization of memory pool since init size is not configured.
[INFO] UTILS(618650,ffffbf562de0,python3.9):2025-04-03-09:27:41.753.971 [mindspore/ccsrc/utils/offload_context.cc:86] enable_aio] On ascend devices, enable aio and enable pinned mem cannot be turned on at the same time.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.754.020 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GridSampler3DGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.754.056 [context.cpp:72]618650 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.754.078 [api_impl.cc:3717] 618650 ContextSetCurrent: set context=aaab312ab590, flag=0.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.754.096 [context.cpp:80]618650 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.754.106 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.754.107 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.754.120 [context.cpp:72]618650 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.754.137 [api_impl.cc:3717] 618650 ContextSetCurrent: set context=aaab312ab590, flag=0.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.754.150 [context.cpp:80]618650 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.754.140 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.754.145 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.754.203 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.754.207 [op_tiling_manager.cc:79]618666 LoadSo:dlopen file /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so successfully!
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.754.270 [op_tiling_manager.cc:58]618666 LoadSo:[FindSo][Check] Get path with op_master [/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_master/] failed
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.754.285 [acl.cpp:288]618650 aclInit: start to execute aclInit
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.754.306 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.754.306 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAA] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.754.326 [acl.cpp:298]618650 aclInit: call ErrorManager.Initialize
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.754.397 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.754.434 [op_tiling_manager.cc:67]618666 LoadSo:Failed to dlopen /usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.754.434 [acl.cpp:242]618650 HandleErrorManagerConfig: err_msg mode is set ["1"].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.754.479 [op_tiling_manager.cc:73]618666 LoadSo:Failed to dlopen /usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.754.479 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAABackward] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.754.479 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAABackward] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.754.536 [op_tiling_manager.cc:58]618666 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.754.592 [op_tiling_manager.cc:67]618666 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.754.597 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PadV4Grad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.754.629 [op_tiling_manager.cc:73]618666 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.754.654 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.754.654 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dGrad] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.754.669 [op_tiling_manager.cc:58]618666 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.754.711 [op_tiling_manager.cc:67]618666 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.754.789 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PadV3GradReplicate] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.754.839 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ResizeUpsampleTrilinear] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.754.841 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ResizeUpsampleTrilinear] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.754.913 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.755.012 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dBackward] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.755.037 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dBackward] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.755.058 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.755.180 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.755.183 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.755.204 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.755.210 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.755.237 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.755.298 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.755.327 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.755.379 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleNearest] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.755.387 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleNearest] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.755.525 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.755.574 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleNearestExact2dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.755.575 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleNearestExact2dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.755.604 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleNearest2dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.755.604 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleNearest2dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.755.604 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:AllFinite, funcPointer:(nil), registered count:2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.755.642 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:AllFinite, funcPointer:(nil), registered count:4
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.755.644 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.755.661 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:AllFinite, funcPointer:(nil), registered count:1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.755.680 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:AllFinite, funcPointer:(nil), registered count:1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.755.697 [op_check.cc:71]618666 RegisterParamGeneralize:RegisterParamGeneralize: op_type:AllFinite, funcPointer:(nil), registered count:1
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.755.718 [op_tiling_registry.cc:134]618662 OpTilingFuncRegistry:Register op tiling function V2 for op_type:AvgPoolGrad
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.755.718 [op_tiling_registry.cc:134]618674 OpTilingFuncRegistry:Register op tiling function V2 for op_type:AvgPoolGrad
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.755.754 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.755.757 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.755.777 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.755.879 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.755.878 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.755.908 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.755.910 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.755.908 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.756.011 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff2c0bd9b0, registered count:3
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.756.036 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:5
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.756.033 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.756.039 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.756.039 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.756.055 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.756.072 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:2
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.756.069 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.756.069 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.756.091 [op_check.cc:71]618666 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:2
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.756.154 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.756.208 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.756.208 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.756.317 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.756.332 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.756.331 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.756.351 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.756.410 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff2c0c0da0, registered count:4
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.756.434 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.756.451 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.756.467 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.756.465 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.756.466 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.756.483 [op_check.cc:71]618666 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.756.485 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.756.598 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.756.598 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.756.710 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.756.712 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.756.734 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.756.761 [op_tiling_manager.cc:75]618666 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.756.814 [op_tiling_manager.cc:58]618666 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.756.819 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.756.820 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.756.898 [op_tiling_manager.cc:67]618666 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.757.019 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.757.019 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.757.233 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.757.236 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.757.599 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff2c0772c0, registered count:4
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.757.619 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.757.617 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.757.631 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.757.649 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.757.664 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.757.679 [op_check.cc:71]618666 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.757.990 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff2c07b978, registered count:4
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.758.013 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.758.013 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.758.013 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.758.029 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.758.023 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.758.047 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.758.062 [op_check.cc:71]618666 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.758.222 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.758.222 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.758.334 [op_tiling_manager.cc:75]618666 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.758.383 [op_tiling_manager.cc:58]618666 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.758.452 [op_tiling_manager.cc:67]618666 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.758.507 [op_tiling_manager.cc:73]618666 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.758.545 [op_tiling_manager.cc:58]618666 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.758.556 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.758.558 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.758.597 [op_tiling_manager.cc:67]618666 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.758.628 [op_tiling_manager.cc:75]618666 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.758.665 [op_tiling_manager.cc:58]618666 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.758.702 [op_tiling_manager.cc:67]618666 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.758.730 [op_tiling_manager.cc:75]618666 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.758.751 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.758.754 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.758.765 [op_tiling_manager.cc:58]618666 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.758.801 [op_tiling_manager.cc:67]618666 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.758.834 [op_tiling_manager.cc:73]618666 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.758.867 [op_tiling_manager.cc:58]618666 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.758.902 [op_tiling_manager.cc:67]618666 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.758.930 [op_tiling_manager.cc:75]618666 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.758.940 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReflectionPad3dGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.758.940 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReflectionPad3dGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.758.972 [op_tiling_manager.cc:58]618666 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.759.010 [op_tiling_manager.cc:67]618666 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.759.039 [op_tiling_manager.cc:75]618666 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.759.050 [op_tiling_registry.cc:134]618662 OpTilingFuncRegistry:Register op tiling function V2 for op_type:AvgPool
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.759.073 [op_tiling_manager.cc:58]618666 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.759.067 [op_tiling_registry.cc:134]618674 OpTilingFuncRegistry:Register op tiling function V2 for op_type:AvgPool
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.759.088 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.759.100 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.759.110 [op_tiling_manager.cc:67]618666 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.759.145 [op_tiling_manager.cc:73]618666 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.759.179 [op_tiling_manager.cc:58]618666 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.759.205 [op_tiling_registry.cc:134]618674 OpTilingFuncRegistry:Register op tiling function V2 for op_type:AvgPoolV2
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.759.213 [op_tiling_manager.cc:67]618666 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.759.209 [op_tiling_registry.cc:134]618662 OpTilingFuncRegistry:Register op tiling function V2 for op_type:AvgPoolV2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.759.243 [op_tiling_manager.cc:75]618666 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.759.241 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.759.240 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.759.281 [op_tiling_manager.cc:58]618666 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.759.316 [op_tiling_manager.cc:67]618666 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.759.351 [op_tiling_manager.cc:75]618666 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.759.385 [op_tiling_manager.cc:58]618666 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.759.397 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.759.398 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.759.420 [op_tiling_manager.cc:67]618666 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.759.428 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.759.431 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.759.455 [op_tiling_manager.cc:73]618666 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.759.460 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.759.461 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.759.490 [op_tiling_manager.cc:58]618666 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.759.487 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantConv2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.759.491 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantConv2D] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.759.530 [op_tiling_manager.cc:67]618666 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.759.560 [op_tiling_manager.cc:75]618666 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.759.593 [op_tiling_manager.cc:58]618666 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.759.627 [op_tiling_manager.cc:67]618666 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.759.654 [op_tiling_manager.cc:75]618666 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.759.676 [op_tiling_manager.cc:109]618666 ~FuncPerfScope:[GEPERFTRACE] The time cost of OpTilingManager::LoadSo is [190642] micro seconds.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.759.764 [plugin_manager.cc:639]618666 GetConstantFoldingOpsPath:Enter GetConstantFoldingOpsPath schedule
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.759.780 [plugin_manager.cc:108]618666 GetOppPath:Enter get opp path schedule
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.759.803 [plugin_manager.cc:117]618666 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.759.849 [host_cpu_engine.cc:254]618666 LoadLib:To invoke dlopen on lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libconstant_folding_ops.so
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.760.544 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.760.615 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.760.615 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.760.756 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.760.977 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.761.077 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.761.077 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.761.233 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.761.232 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.761.306 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.761.387 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.761.386 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.761.491 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.761.541 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.761.540 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.761.574 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.761.575 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.761.662 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.761.720 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.761.721 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.761.869 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.761.869 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.762.016 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.762.019 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.762.047 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.762.049 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.762.208 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.762.214 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.762.372 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.762.371 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.762.521 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.762.530 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.762.531 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.762.698 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.762.698 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.762.689 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.762.840 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.762.848 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AGLU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.762.847 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AGLU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.763.003 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyAdamWV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.763.168 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.763.250 [error_manager.cc:673]618650 ParseJsonFile:Parse json file:/usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/../conf/error_manager/error_code.json success
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.763.267 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.763.272 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.763.318 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.763.478 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.763.624 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.763.624 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.763.641 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.763.787 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.763.860 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.763.860 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.763.935 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.763.997 [acl.cpp:315]618650 aclInit: call ge interface executor.Initialize
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.764.060 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.764.058 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.764.058 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] PROFILING(618650,python3.9):2025-04-03-09:27:41.764.067 [prof_atls_plugin.cpp:210] (tid:618650) Module[45] register callback of ctrl handle.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.764.127 [ge_executor.cc:273]618650 Initialize:Init GeExecutor begin.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.764.197 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.764.207 [op_lib_register.cc:117]618650 GetAllCustomOpApiSoPaths:value of env ASCEND_CUSTOM_OPP_PATH is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/ho
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.764.287 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.764.325 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.764.358 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.764.390 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.764.420 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.764.451 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.764.482 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.764.512 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.764.513 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.764.542 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.764.544 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.764.571 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.764.572 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.764.599 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.764.613 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.764.628 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.764.644 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.764.655 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.764.674 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.764.681 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.764.705 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.764.709 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.764.734 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.764.736 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.764.759 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.764.766 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.764.783 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.764.797 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.764.808 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.764.827 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.764.835 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.764.857 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.764.871 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.764.887 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.764.897 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.764.922 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.764.926 [op_lib_register.cc:165]618650 CallInitFunc:CallInitFunc 0 successfully, op_lib_paths_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/je
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.764.952 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.764.967 [plugin_manager.cc:616]618650 GetOpTilingForwardOrderPath:Enter GetOpTilingPath schedule
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.764.978 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.764.991 [plugin_manager.cc:108]618650 GetOppPath:Enter get opp path schedule
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.003 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.029 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.765.028 [plugin_manager.cc:117]618650 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.765.053 [plugin_manager.cc:624]618650 GetOpTilingForwardOrderPath:Opp plugin path structure is new version!
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.054 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.765.070 [plugin_manager.cc:206]618650 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.080 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.106 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.130 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.155 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.765.138 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.765.138 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.185 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.209 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.235 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.260 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.284 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.310 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.334 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.361 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.389 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.414 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.440 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.472 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.497 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.525 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.551 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.765.559 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.576 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.765.582 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.765.582 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.601 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.765.602 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.765.620 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.765.634 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.626 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.653 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.765.677 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.678 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.704 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.730 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.756 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.781 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.805 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.829 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.855 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.879 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.904 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.929 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.765.954 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.765.990 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.766.025 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.766.042 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.766.059 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.766.100 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.766.127 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachACosInplace] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.766.138 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.766.148 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NLLLossGrad310p] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.766.148 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NLLLossGrad310p] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.766.156 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.766.185 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.766.200 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.766.217 [plugin_manager.cc:215]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.766.289 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.766.317 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.766.317 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.766.475 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.766.477 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.766.467 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMulScalarInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.766.516 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachLogInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.766.533 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.766.544 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSubListInplace] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.766.569 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.766.572 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMulListInplace] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.766.585 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.766.598 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DropoutWithMulsAndSoftmaxGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.766.601 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachDivListInplace] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.766.602 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.766.597 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DropoutWithMulsAndSoftmaxGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.766.643 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.766.759 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSubScalarInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.766.769 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.766.769 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.766.876 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.766.921 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.766.920 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.766.952 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.766.954 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.766.954 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.766.988 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.766.996 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.767.005 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.767.019 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.767.058 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.767.071 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.767.074 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.767.094 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.767.102 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.767.105 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.767.111 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.767.117 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.767.125 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.767.141 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.767.157 [plugin_manager.cc:215]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.767.244 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.767.358 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.767.418 [host_cpu_engine.cc:273]618666 LoadLib:Lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libconstant_folding_ops.so has been opened
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.767.445 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.767.446 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.767.477 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.767.496 [host_cpu_engine.cc:254]618666 LoadLib:To invoke dlopen on lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libops_host_cpu.so
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.767.514 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.767.531 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.767.528 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3dGrad] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.767.549 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.767.564 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.767.564 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.767.583 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.767.649 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.767.725 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachBinaryOp] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.767.724 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachBinaryOp] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.767.818 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.767.884 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.767.886 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.767.894 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.767.927 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.767.942 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.767.957 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.767.954 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.767.995 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.768.013 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.768.013 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.768.030 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.768.048 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.768.064 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.768.081 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.768.079 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.768.096 [plugin_manager.cc:215]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.768.110 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.768.138 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.768.301 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.768.332 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.768.358 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.768.359 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.768.419 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.768.454 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.768.474 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.768.472 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.768.507 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.768.543 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.768.564 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.768.644 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.768.728 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.768.832 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.768.856 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.768.863 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.768.889 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.768.907 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.768.921 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.768.958 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.768.984 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.768.994 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.768.999 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.769.011 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.769.028 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.769.043 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.769.057 [plugin_manager.cc:215]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.769.119 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.769.157 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InstanceNormV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.769.318 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IndexPutWithSort] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.769.349 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IouV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.769.366 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.769.399 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.769.415 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.769.430 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.769.443 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.769.466 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.769.539 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BidirectionLSTM] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.769.572 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BidirectionLSTMV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.769.655 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InplaceIndexAddWithSorted] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.769.745 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.769.777 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.769.777 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.769.776 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.769.824 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.769.841 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.769.856 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.769.892 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.769.902 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.769.927 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.769.931 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.769.944 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.769.948 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaskedSelectV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.769.958 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.769.958 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.769.977 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.769.993 [plugin_manager.cc:215]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.770.008 [plugin_manager.cc:218]618650 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-pack
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.770.030 [plugin_manager.cc:422]618650 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.770.046 [plugin_manager.cc:155]618650 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.770.069 [plugin_manager.cc:158]618650 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.770.083 [plugin_manager.cc:426]618650 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.770.139 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.770.148 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.770.329 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.770.381 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.770.412 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.770.434 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.770.449 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.770.486 [plugin_manager.cc:439]618650 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.770.488 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.770.509 [plugin_manager.cc:175]618650 ReversePathString:Enter ReversePathString schedule
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.770.535 [plugin_manager.cc:187]618650 ReversePathString:path_str is '/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/:/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.770.526 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.770.648 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.770.743 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.770.828 [plugin_manager.cc:996]618650 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.770.846 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.770.858 [plugin_manager.cc:1011]618650 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.770.880 [plugin_manager.cc:1015]618650 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.770.902 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.770.924 [op_tiling_manager.cc:58]618650 LoadSo:[FindSo][Check] Get path with op_master [/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.771.002 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.771.021 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.771.129 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.771.134 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.771.295 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InstanceNormV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.771.297 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.771.474 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.771.470 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IouV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.771.636 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BidirectionLSTM] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.771.666 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.771.668 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BidirectionLSTMV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.771.675 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.771.810 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.771.828 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.771.863 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.771.931 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.772.015 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaskedSelectV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.772.055 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.772.204 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.772.218 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.772.353 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.772.521 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.772.681 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.772.803 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Resize] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.772.928 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.772.918 [host_cpu_engine.cc:267]618666 LoadLib:Invoke function Initialize in lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libops_host_cpu.so
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.773.053 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.773.190 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.773.308 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.773.724 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] OP(618666,python3.9):2025-04-03-09:27:41.773.748 [host_cpu_kernel_wrapper.cpp:88][OP_PROTO][Initialize][618666] OpName:[HostCpuKernelWrapperOp] "Host cpu dlopen so[/usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libaicpu_const_folding.so] success"
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.773.783 [folding.cc:404][InitCpuConstantFoldingNew][tid:618666]:"Init cpu constant folding begin."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.773.778 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.773.845 [folding.cc:408][InitCpuConstantFoldingNew][tid:618666]:"Number of registered ops: 234"
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.773.860 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Acos]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.773.877 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Acosh]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.773.891 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[ActiveRotatedFilter]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.773.904 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[ActiveRotatedFilterGrad]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.773.916 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[AdaptiveAvgPool2dAssistMatrix]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.773.928 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[AdaptiveAvgPoolAssistMatrix]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.773.941 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[AdaptiveMaxPool2d]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.773.953 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Add]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.773.966 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Addcdiv]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.773.979 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Addcmul]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.773.991 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[AffineGrid]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.003 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[ApplyAdamV2]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.016 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Asin]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.028 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Asinh]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.051 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Assert]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.064 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Atan]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.077 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Atan2]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.089 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Atanh]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.102 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[AvgPoolV2]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.114 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Betainc]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.127 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Bucketize]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.139 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[CTCLossV2]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.151 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[CTCLossV2Grad]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.164 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[CacheSwapTable]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.176 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[CalcBucketsLimitAndOffset]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.189 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[CaseCondition]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.201 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Cast]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.214 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Ceil]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.226 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[CheckNumerics]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.238 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[ClipByValue]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.250 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[ClipByValueV2]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.263 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Combinations]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.774.259 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.273 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[CompareAndBitpack]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.288 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[ComputeAccidentalHits]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.299 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[ConcatV2]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.311 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Conj]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.323 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[ConjugateTranspose]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.336 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Coordinates1DTo2D]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.348 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Cosh]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.361 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[CropAndResize]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.373 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Cross]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.385 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Cummax]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.774.385 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.397 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Cummin]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.420 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Cumsum]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.433 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Div]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.445 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[DynamicStitch]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.457 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[EditDistance]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.470 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Elu]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.483 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[EluGrad]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.495 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[EmbeddingApplyAdaGrad]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.507 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[EmbeddingApplyAdam]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.774.506 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.520 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[EmbeddingApplyAdamW]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.534 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[EmbeddingApplyFtrl]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.774.537 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.546 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[EmbeddingApplyRmsprop]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.559 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[EmbeddingApplySgd]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.569 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[EmbeddingComputeVarExport]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.580 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[EmbeddingComputeVarImport]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.590 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[EmbeddingFeatureMappingExport]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.602 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[EmbeddingFeatureMappingFileSize]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.614 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[EmbeddingFeatureMappingImport]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.627 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[EmbeddingHashmapExport]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.639 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[EmbeddingHashmapFileSize]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.651 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[EmbeddingHashmapImport]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.663 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[EmbeddingLookup]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.676 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[EmbeddingTableEvict]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.774.675 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.688 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[EmbeddingTableExport]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.701 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[EmbeddingTableFind]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.713 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[EmbeddingTableFindAndInit]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.725 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[EmbeddingTableImport]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.738 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Equal]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.754 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Expand]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.766 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[ExpandDims]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.779 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Exponential]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.791 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[ExponentialDecayLR]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.774.794 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.804 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Fill]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.817 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[FillDiagonal]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.828 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Fills]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.840 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Floor]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.852 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[FloorDiv]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.864 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[FloorMod]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.877 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[GEMM]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.888 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[GatherElements]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.900 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[GatherV2]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.911 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Geometric]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.774.913 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.923 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[GetDynamicDims]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.937 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Greater]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.947 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[GreaterEqual]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.959 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[GridSampler2D]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.971 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[GridSampler2DGrad]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.984 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[GridSampler3D]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.774.996 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[GridSampler3DGrad]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.008 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Histogram]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.021 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[IMGWarpOffsets]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.033 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Identity]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.046 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[IndexToAddr]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.775.041 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.061 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[InitEmbeddingHashmap]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.073 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[InitPartitionMap]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.085 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[InplaceIndexAdd]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.097 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[InplaceTopKDistance]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.113 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[InvGrad]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.126 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[InvertPermutation]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.138 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[IsClose]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.150 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[IsInf]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.163 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[IsNan]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.775.160 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.175 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Less]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.188 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[LinSpace]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.199 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[LinearSumAssignment]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.209 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Log]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.221 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Log1p]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.233 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[LogMatrixDeterminant]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.245 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[LogSoftmaxV2]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.257 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[LogUniformCandidateSampler]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.270 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[MaskedFill]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.282 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[MaskedScatter]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.294 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[MaskedSelect]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.775.290 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.310 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[MaskedSelectGrad]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.322 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[MatMul]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.334 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[MatrixDiagPartV3]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.347 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[MatrixDiagV3]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.359 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[MinAreaPolygons]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.372 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Mul]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.384 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[MultinomialAliasDraw]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.396 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[MultinomialAliasSetup]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.408 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[MultinomialWithReplacement]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.420 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[NLLLoss]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.775.423 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.433 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[NLLLossGrad]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.446 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[NMSWithMask]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.463 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Neg]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.476 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[NonMaxSuppressionV3]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.489 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[NonZero]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.501 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[NonZeroWithValueShape]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.512 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[NonZeroWithValueShapeV2]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.524 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[NotEqual]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.536 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[OnesLike]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.549 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[PSAMask]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.775.540 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.562 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[PSAMaskGrad]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.574 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Pad]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.587 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[PadD]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.599 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[PadV3]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.612 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[PadV3Grad]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.624 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Pinverse]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.636 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Poisson]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.648 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Pow]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.661 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[ProdEnvMatACalcRij]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.673 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[RNNTLoss]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.686 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[RandomStandardNormal]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.698 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[RandomUniform]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.711 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[RealDiv]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.725 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[ReduceAll]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.775.704 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.737 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[ReduceMean]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.750 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[ReduceSum]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.762 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Reshape]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.774 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Resize]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.786 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[ResizeBilinear]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.798 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[ResizeBilinearGrad]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.811 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[ResizeBilinearV2Grad]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.828 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[ResizeGrad]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.838 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[ResizeTrilinear]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.775.835 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.853 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[ReverseSequence]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.866 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[RightShift]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.879 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[RoiPoolingWithArgMax]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.894 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[RotatedNMS]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.907 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Round]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.919 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Rsqrt]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.931 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[STFT]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.944 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[ScatterAddWithAxis]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.956 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[ScatterElements]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.969 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[ScatterNdAdd]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.775.965 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.982 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[ScatterNdMax]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.775.995 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[ScatterNdMin]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.008 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[SearchSorted]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.020 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[SelectV2]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.032 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Sigmoid]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.044 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[SigmoidGrad]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.056 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Sign]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.069 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[SilentCheck]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.081 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[SilentCheckV2]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.093 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[SilentCheckV3]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.106 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[SliceWrite]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.118 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[SoftmaxV2]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.130 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Sort]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.142 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[SparseFillEmptyRows]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.155 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[SparseSegmentMean]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.180 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[SparseSegmentMeanGrad]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.191 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[SparseSegmentSum]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.208 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[SparseToDense]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.776.204 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.224 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[SpatialTransformer]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.238 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[SplitD]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.251 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[SplitV]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.264 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Sqrt]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.276 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[SqrtGrad]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.288 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Square]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.300 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[SquaredDifference]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.312 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[StatelessBernoulli]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.324 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[StatelessRandomUniformV2]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.337 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[StatelessRandperm]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.776.331 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.352 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[StridedSlice]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.363 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[StridedSliceV2]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.377 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Sub]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.390 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[TableToResource]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.403 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Tan]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.415 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[TanhGrad]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.427 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[TensorEqual]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.439 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[TensorScatterUpdate]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.452 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[ThreeNN]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.465 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Tile]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.476 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[TileWithAxis]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.776.467 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.489 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[TopK]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.501 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[TopKPQDistance]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.513 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[TopKPQDistanceV2]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.526 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[TopKV2D]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.538 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Trace]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.550 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[TransData]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.569 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[TransDataRNN]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.582 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Tril]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.594 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Triu]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.776.587 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.608 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[UniformCandidateSampler]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.621 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[UninitEmbeddingHashmap]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.633 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[UninitPartitionMap]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.645 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[UniqueConsecutive]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.658 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[UniqueWithCountsAndSorting]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.670 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[UniqueWithCountsExt2]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.683 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[UpsampleNearest3d]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.695 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[UpsampleNearest3dGrad]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.707 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[UpsampleTrilinear3d]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.719 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[UpsampleTrilinear3dGrad]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.732 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[ViewCopy]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.744 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Voxelization]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.756 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[WarpAffine]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.768 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[ZerosLike]."
[INFO] AICPU(618666,python3.9):2025-04-03-09:27:41.776.780 [folding.cc:413][InitCpuConstantFoldingNew][tid:618666]:"Register op[Zeta]."
[INFO] OP(618666,python3.9):2025-04-03-09:27:41.776.796 [host_cpu_kernel_wrapper.cpp:118][OP_PROTO][Initialize][618666] OpName:[HostCpuKernelWrapperOp] "Host cpu init success"
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.776.796 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.776.809 [host_cpu_engine.cc:273]618666 LoadLib:Lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libops_host_cpu.so has been opened
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.776.914 [plugin_manager.cc:872]618666 LoadWithFlags:Dlopen path: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/plugin/engines/runtime/libdvpp_rtkernel.so. flags is 4354
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.776.982 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.777.104 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RoiPoolingGradWithArgMax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.777.219 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.777.351 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.777.429 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.777.478 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.777.489 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.777.611 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.777.733 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.777.851 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.778.026 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StackBallQuery] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.778.147 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.778.318 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.778.595 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScoreGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.778.799 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.778.985 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.779.178 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.779.411 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.779.427 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.779.479 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.779.653 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.779.903 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.779.931 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.779.956 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.779.979 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.780.016 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.780.042 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.780.045 [plugin_manager.cc:883]618666 LoadWithFlags:The shared library will not be checked. Please ensure that the source of the shared library is trusted.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.780.069 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.780.096 [ops_kernel_executor_manager.cc:37]618666 Initialize:No library to load
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.780.094 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.780.113 [plugin_manager.cc:540]618666 GetOpsProtoPath:Enter GetOpsProtoPath schedule
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.780.125 [plugin_manager.cc:108]618666 GetOppPath:Enter get opp path schedule
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.780.155 [plugin_manager.cc:117]618666 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.780.189 [plugin_manager.cc:547]618666 GetOpsProtoPath:Opp plugin path structure is new version!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.780.213 [plugin_manager.cc:206]618666 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.780.316 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.780.585 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.780.771 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.780.816 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.780.830 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.780.842 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.780.889 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.780.889 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MedianDim] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.780.928 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.781.200 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.781.234 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.781.225 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.781.250 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.781.262 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.781.296 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.781.332 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.781.346 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.781.358 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.781.371 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.781.372 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.781.414 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.781.427 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.781.439 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.781.449 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.781.438 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.781.648 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.781.770 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.781.803 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.781.816 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.781.813 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.781.829 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.781.826 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.781.865 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.781.991 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeTutelCombineGates] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.782.016 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.782.179 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.782.184 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeTutelCombineX] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.782.210 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.782.225 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.782.236 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.782.243 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.782.268 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.782.302 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.782.286 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.782.317 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.782.327 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.782.339 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.782.347 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeTutelDispatch] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.782.378 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.782.391 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.782.402 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.782.414 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.782.435 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.782.537 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.782.664 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.782.689 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScore] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.782.722 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.782.753 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.782.766 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.782.778 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.782.807 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.782.817 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.782.818 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.782.820 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MedianDim] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.782.976 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.782.990 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.783.137 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.783.137 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.783.170 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.783.183 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.783.196 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.783.229 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.783.262 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.783.275 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.783.287 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.783.308 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.783.337 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.783.331 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.783.351 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.783.362 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.783.373 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.783.444 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Rfft1D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.783.528 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.783.608 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.783.684 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.783.702 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.783.716 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.783.732 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.783.744 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.783.776 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.783.769 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.783.803 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GemmaRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.783.849 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeTutelCombineGates] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.783.916 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.784.032 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeTutelCombineX] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.784.046 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.784.093 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.784.124 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.784.137 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.784.149 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.784.195 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.784.188 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeTutelDispatch] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.784.231 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.784.245 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.784.251 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LinearIndex] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.784.258 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.784.285 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.784.284 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.784.316 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.784.329 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.784.340 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.784.351 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.784.457 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LinearIndexV2] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.784.523 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScore] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.784.645 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.784.658 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.784.659 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterAddWithSorted] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.784.691 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.784.705 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.784.717 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.784.749 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.784.796 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.784.830 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Sinkhorn] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.784.953 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.785.067 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.785.071 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.785.099 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.785.101 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.785.113 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.785.126 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.785.158 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.785.191 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.785.204 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.785.226 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.785.239 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.785.253 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Rfft1D] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.785.268 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.785.282 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.785.293 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.785.304 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.785.313 [plugin_manager.cc:218]618666 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.785.330 [plugin_manager.cc:422]618666 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.785.342 [plugin_manager.cc:155]618666 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.785.362 [plugin_manager.cc:158]618666 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.785.374 [plugin_manager.cc:426]618666 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.785.408 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.785.564 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.785.597 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GemmaRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.785.680 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.785.712 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.785.706 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.785.728 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.785.738 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.785.745 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.785.771 [plugin_manager.cc:439]618666 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspo
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.785.804 [ge_executor.cc:259]618666 InitOpsProtoManager:Get opsproto path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/minds
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.785.830 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.785.825 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.785.960 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StackGroupPoints] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.786.009 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LinearIndex] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.786.117 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.786.147 [plugin_manager.cc:996]618666 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.786.178 [plugin_manager.cc:1011]618666 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.786.197 [plugin_manager.cc:1015]618666 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.786.194 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LinearIndexV2] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.786.235 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.786.292 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.786.307 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.786.375 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.786.388 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.786.382 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterAddWithSorted] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.786.386 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.786.421 [opsproto_manager.cc:123]618666 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.786.431 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.786.466 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.786.479 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.786.506 [opsproto_manager.cc:123]618666 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.786.539 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Sinkhorn] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.786.555 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.786.570 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 2 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.786.568 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.786.632 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.786.645 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.786.655 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.786.693 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.786.706 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.786.720 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.786.723 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.786.746 [opsproto_manager.cc:123]618666 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.786.752 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.786.768 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.786.786 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.786.800 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 3 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.786.800 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.786.827 [opsproto_manager.cc:123]618666 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.786.866 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.786.878 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 4 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.786.905 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.786.938 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.786.951 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.787.011 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.787.023 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.787.048 [opsproto_manager.cc:123]618666 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.787.091 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.787.103 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 5 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.787.103 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.787.129 [opsproto_manager.cc:123]618666 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.787.167 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.787.179 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 6 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.787.195 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.787.240 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.787.253 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.787.313 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.787.325 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.787.351 [opsproto_manager.cc:123]618666 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.787.388 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.787.400 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 7 libs.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.787.425 [opsproto_manager.cc:123]618666 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.787.439 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.787.462 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.787.459 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.787.476 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 8 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.787.539 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.787.551 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.787.610 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.787.627 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.787.633 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.787.652 [opsproto_manager.cc:123]618666 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.787.665 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.787.660 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StackGroupPoints] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.787.666 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.787.693 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.787.705 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 9 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.787.693 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.787.732 [opsproto_manager.cc:123]618666 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.787.769 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.787.781 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 10 libs.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.787.806 [opsproto_manager.cc:123]618666 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/usr/local/Ascend/ascend-toolkit/latest/opp/op_proto/custom/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.787.827 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.787.829 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.787.842 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 10 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.787.903 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.787.894 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.787.917 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt2.0.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.787.928 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.787.937 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 3 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.787.927 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.787.950 [opsproto_manager.cc:147]618666 LoadOpsProtoPluginSo:[LoadSo][Check] Shared library will not be checked. Please make sure that the source of shared library is trusted.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.787.944 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.787.954 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.788.076 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.788.096 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.788.127 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.788.275 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.788.290 [operator_factory_impl.cc:215]618666 RegisterInferShapeFunc:operator_infershape_funcs_ init
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.788.317 [operator_factory_impl.cc:269]618666 RegisterVerifyFunc:operator_verify_funcs_ init
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.788.347 [opsproto_manager.cc:162]618666 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.788.390 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.788.422 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.788.423 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CircularPad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.788.449 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.788.606 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.788.606 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CircularPadGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.788.795 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.788.804 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.788.811 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DefaultImpl] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.788.883 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.789.116 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.789.149 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.789.184 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.789.212 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.789.239 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.789.265 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.789.303 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.789.335 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.789.363 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.789.467 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleLinear1d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.789.498 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleBilinear2d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.789.545 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.789.578 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.789.623 [op_tiling_registry.cc:162]618650 OpTilingFuncRegistry:Register op tiling and parse function V4 for op_type:Aipp
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.789.672 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleBicubic2d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.789.767 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:AvgPool1DD
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.789.862 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.789.887 [op_tiling_registry.cc:162]618650 OpTilingFuncRegistry:Register op tiling and parse function V4 for op_type:AutoTiling
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.790.032 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Bias
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.790.040 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAAGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.790.169 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:INTrainingUpdateV2
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.790.216 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.790.289 [op_tiling_registry.cc:134]618650 OpTilingFuncRegistry:Register op tiling function V2 for op_type:CheckValid
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.790.425 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.790.425 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ConcatD
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.790.447 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ConcatV2D
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.790.461 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.790.469 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Pack
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.790.587 [op_tiling_registry.cc:134]618650 OpTilingFuncRegistry:Register op tiling function V2 for op_type:ConcatOffset
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.790.631 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.790.701 [op_tiling_registry.cc:134]618650 OpTilingFuncRegistry:Register op tiling function V2 for op_type:Diag
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.790.728 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: Conv2DBackpropFilter, registered count: 1
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.790.806 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAABackward] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.790.813 [op_tiling_registry.cc:134]618650 OpTilingFuncRegistry:Register op tiling function V2 for op_type:DiagPart
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.790.824 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: Conv2DBackpropInput, registered count: 2
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.790.855 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: Conv2DTranspose, registered count: 3
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.790.926 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: Conv2D, registered count: 4
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.790.932 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:DynSeqOuter
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.790.987 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.791.003 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: Conv3DBackpropInput, registered count: 5
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.791.026 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: Conv3DTranspose, registered count: 6
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.791.054 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Expand
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.791.100 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: Conv3D, registered count: 7
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.791.188 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ResizeUpsampleTrilinear] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.791.266 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: FFN, registered count: 8
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.791.287 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: MatmulTunnerTiling, registered count: 9
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.791.361 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dBackward] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.791.398 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: MatMulV2, registered count: 10
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.791.432 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: BatchMatmulFixpipe, registered count: 11
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.791.453 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: MatMulV3, registered count: 12
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.791.459 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Ger
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.791.473 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: QuantBatchMatmulV3, registered count: 13
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.791.528 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.791.567 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.791.570 [op_tiling_registry.cc:122]618650 OpTilingFuncRegistry:Register op tiling function V1 for op_type:IFMR
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.791.643 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: DynamicRNN, registered count: 14
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.791.664 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: MatMulTunnerTiling, registered count: 15
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.791.699 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:InTopKD
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.791.727 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleNearest] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.791.823 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:KlDivLossGrad
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.791.928 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleNearestExact2dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.791.940 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:L1LossGrad
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.791.960 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleNearest2dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.792.043 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNorm
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.792.081 [op_tiling_registry.cc:134]618670 OpTilingFuncRegistry:Register op tiling function V2 for op_type:AvgPoolGrad
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.792.114 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.792.131 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: Conv2DBackpropFilter, registered count: 1
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.792.152 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNormBetaGammaBackpropV2
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.792.230 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: Conv2DBackpropInput, registered count: 2
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.792.259 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: Conv2DTranspose, registered count: 3
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.792.276 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.792.309 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.792.327 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: Conv2D, registered count: 4
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.792.351 [op_tiling_registry.cc:122]618650 OpTilingFuncRegistry:Register op tiling function V1 for op_type:LayerNormXBackprop
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.792.403 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: Conv3DBackpropInput, registered count: 5
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.792.428 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: Conv3DTranspose, registered count: 6
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.792.450 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.792.459 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNormXBackpropV2
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.792.480 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.792.500 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: Conv3D, registered count: 7
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.792.567 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNormXBackpropV3
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.792.609 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.792.670 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: FFN, registered count: 8
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.792.670 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LpNormReduce
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.792.692 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LpNormReduceV2
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.792.692 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: MatmulTunnerTiling, registered count: 9
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.792.734 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.792.806 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: MatMulV2, registered count: 10
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.792.798 [op_tiling_registry.cc:134]618650 OpTilingFuncRegistry:Register op tiling function V2 for op_type:LRUCacheV2
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.792.829 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: BatchMatmulFixpipe, registered count: 11
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.792.851 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: MatMulV3, registered count: 12
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.792.867 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.792.873 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: QuantBatchMatmulV3, registered count: 13
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.792.864 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:MatMulV2, funcPointer:0xfffef5c98a10, registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.792.902 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:MatMulV2, funcPointer:0xfffef5c98c70, registered count:1
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.792.921 [op_tiling_registry.cc:134]618650 OpTilingFuncRegistry:Register op tiling function V2 for op_type:MaxPoolGradWithArgmaxV2
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.792.941 [op_tiling_registry.cc:134]618650 OpTilingFuncRegistry:Register op tiling function V2 for op_type:MaxPoolGradWithArgmaxV1
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.793.004 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.793.037 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: DynamicRNN, registered count: 14
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.793.042 [op_tiling_registry.cc:122]618650 OpTilingFuncRegistry:Register op tiling function V1 for op_type:MaxPoolWithArgmaxV2
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.793.058 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: MatMulTunnerTiling, registered count: 15
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.793.118 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.793.148 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:MovingSumWithSigmoid
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.793.231 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.793.251 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:MseLossGrad
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.793.235 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Igammac] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.793.334 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.793.438 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.793.456 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:NMSWithMask
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.793.629 [op_tiling_registry.cc:122]618650 OpTilingFuncRegistry:Register op tiling function V1 for op_type:PadD
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.793.663 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.793.725 [op_tiling_registry.cc:122]618650 OpTilingFuncRegistry:Register op tiling function V1 for op_type:PadV3Grad
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.793.809 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.793.831 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ReduceStdWithMean
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.793.939 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Resize
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.793.962 [opsproto_manager.cc:162]618666 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.794.049 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.794.074 [opsproto_manager.cc:162]618666 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.794.123 [opsproto_manager.cc:162]618666 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.794.135 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:MatMulV2, funcPointer:0xffff25c98a10, registered count:3
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.794.154 [opsproto_manager.cc:162]618666 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.794.169 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:MatMulV2, funcPointer:0xffff25c98c70, registered count:1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.794.185 [opsproto_manager.cc:162]618666 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.794.214 [opsproto_manager.cc:162]618666 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.794.241 [opsproto_manager.cc:162]618666 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.794.268 [opsproto_manager.cc:162]618666 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.794.294 [opsproto_manager.cc:162]618666 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.794.374 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ResizeBilinearV2
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.794.456 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.794.484 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ReverseV2
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.794.557 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.794.595 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Scale
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.794.681 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.794.775 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SigmoidFocalLoss
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.794.883 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SigmoidFocalLossGrad
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.795.011 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SignBitsPack
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.795.013 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.795.027 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.795.115 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SignBitsUnpack
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.795.216 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SmoothL1LossGradV2
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.795.251 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.795.316 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SmoothL1LossV2
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.795.423 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SoftMarginLossGrad
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.795.448 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReflectionPad3dGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.795.516 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.795.539 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SoftmaxFocalLossGrad
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.795.567 [op_tiling_registry.cc:134]618670 OpTilingFuncRegistry:Register op tiling function V2 for op_type:AvgPool
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.795.603 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.795.642 [op_tiling_registry.cc:134]618650 OpTilingFuncRegistry:Register op tiling function V2 for op_type:Sort
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.795.663 [op_tiling_registry.cc:134]618650 OpTilingFuncRegistry:Register op tiling function V2 for op_type:SortV2
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.795.689 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.795.721 [op_tiling_registry.cc:134]618670 OpTilingFuncRegistry:Register op tiling function V2 for op_type:AvgPoolV2
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.795.752 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.795.775 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SparseApplyFtrlD
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.795.776 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.795.884 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SparseReshape
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.795.923 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.795.957 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.795.986 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.795.985 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SplitV
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.796.005 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Split
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.796.013 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantConv2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.796.100 [op_tiling_registry.cc:122]618650 OpTilingFuncRegistry:Register op tiling function V1 for op_type:SquareSumAll
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.796.203 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.796.216 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SyncBatchNormGatherStats
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.796.323 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Tile
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.796.424 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:TileD
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.796.536 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:TileWithAxis
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.796.603 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.796.661 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.796.737 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Unpack
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.796.764 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.796.830 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.796.842 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.796.925 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.797.006 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.797.083 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AscendAntiQuantV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.797.164 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.797.206 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.797.242 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.797.229 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.797.274 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.797.369 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Concat] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.797.398 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ConcatV2] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.797.427 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.797.453 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.797.578 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.797.644 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.797.667 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.797.712 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.797.750 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.797.841 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.797.884 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.797.921 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.798.007 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.798.037 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.798.057 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.798.114 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.798.143 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.798.171 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.798.225 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.798.251 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.798.259 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.798.344 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.798.416 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.798.425 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.798.504 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.798.573 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.798.589 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.798.664 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.798.731 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.798.755 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.798.764 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.798.833 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.798.914 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.798.945 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.798.991 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.799.088 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.799.113 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.799.176 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.799.258 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.799.272 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.799.338 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.799.424 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.799.472 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.799.501 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.799.596 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.799.630 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AGLU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.800.052 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.800.453 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.800.710 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.800.913 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.801.999 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.802.461 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.803.030 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NLLLossGrad310p] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.803.196 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.803.360 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.803.484 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DropoutWithMulsAndSoftmaxGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.803.667 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.803.799 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:DepthToSpace
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.803.831 [op_tiling_registry.cc:148]618650 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SpaceToDepth
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.803.826 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.803.860 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.803.978 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.804.010 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.804.410 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.804.540 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.804.717 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachBinaryOp] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.804.885 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.805.019 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.805.256 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.805.337 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.805.386 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.805.516 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.805.549 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.805.711 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.805.789 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.805.833 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.805.923 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.805.955 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.806.040 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DeformableOffsetsGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.806.135 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InstanceNormV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.806.154 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.806.305 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.806.325 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IouV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.806.416 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.806.514 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BidirectionLSTM] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.806.548 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BidirectionLSTMV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.806.570 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.806.722 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.806.731 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.806.753 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.806.847 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.806.927 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaskedSelectV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.806.960 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.807.087 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachNonFiniteCheckAndUnscale] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.807.126 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.807.212 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.807.331 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.807.361 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.807.518 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GatherV3] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.807.633 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.807.786 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.807.916 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.808.033 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.808.062 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.808.190 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.808.310 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.808.466 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LinSpace] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.808.590 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MemSet] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.808.703 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.808.695 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.808.827 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.808.956 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.809.070 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.809.197 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.809.315 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NPUClearFloatStatus] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.809.428 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NPUGetFloatStatus] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.809.546 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.809.578 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.809.804 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.809.927 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.810.072 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.810.287 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.810.413 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.810.621 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.810.792 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.810.907 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.810.937 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.811.059 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.811.096 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.811.207 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.811.222 [operator_factory_impl.cc:368]618666 RegisterInferAxisTypeInfoFunc:axis type info derivation funcs init
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.811.316 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.811.347 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.811.456 [operator_factory_impl.cc:284]618666 RegisterInferDataSliceFunc:operator_infer_data_slice_funcs_ init
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.811.466 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.811.577 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.811.624 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [MatrixBandPart] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.811.647 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [CheckNumerics] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.811.661 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [UnravelIndex] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.811.674 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [UpperBound] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.811.687 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [ListDiff] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.811.694 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.811.708 [operator_factory_impl.cc:254]618666 RegisterInferFormatFunc:operator_inferformat_funcs_ init
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.811.731 [operator_factory_impl.cc:340]618666 RegisterInferAxisSliceFunc:axis slice derivation funcs init
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.811.752 [operator_factory_impl.cc:307]618666 RegisterInferValueRangeFunc:operator_infervalue_paras_ init
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.811.778 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [IdentityN] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.811.804 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [LowerBound] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.811.821 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Expand] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.811.816 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.811.918 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [LeftShift] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.812.025 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.812.057 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.812.178 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.812.292 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.812.496 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.812.611 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.812.702 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Reciprocal] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.812.736 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Sign] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.812.731 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.812.756 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Div] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.812.772 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Exp] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.812.789 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [LessEqual] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.812.804 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Log1p] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.812.827 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [DivNoNan] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.812.859 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Mul] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.812.851 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.812.878 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [SqrtGrad] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.812.891 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Log] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.812.905 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [AddN] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.812.926 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [AcosGrad] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.812.939 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [AcoshGrad] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.812.966 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [BiasAdd] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.812.975 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.812.993 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [FloorDiv] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.813.014 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [ArgMin] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.813.075 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [MulNoNan] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.813.113 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [AsinGrad] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.813.130 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Cos] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.813.144 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Sin] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.813.170 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [AsinhGrad] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.813.191 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Expm1] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.813.182 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.813.339 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.813.507 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.813.665 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.813.672 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618654] [ServerToClientMsgProc] [sessionID=1]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.813.723 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618654] [TsdClient] DeviceMsgProc recvMsg realDeviceId[2] msgType[8] localDevId[2] rspCode[0]heterogeneousSubPid[0], tsdSupportLevel_[63]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.813.746 [hdc_client.cpp:172][TsdRecvData][tid:618654] [deviceId=2] the Tsd recv data already
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.813.785 [devmm_svm.c:132][ascend][curpid:618654,618654][drv][devmm][devmm_setup_device]DrvMemDeviceOpen. (devid=2)
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.813.795 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.813.909 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.814.025 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BlendFaceBgPartOne] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.814.142 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.814.262 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.814.288 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [AdjustHue] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.814.324 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [AdjustSaturation] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.814.346 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [ExtractGlimpse] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.814.363 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [ResizeArea] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.814.376 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [ResizeBicubic] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.814.391 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [RGBToHSV] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.814.408 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [NonMaxSuppressionWithOverlaps] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.814.444 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [ScaleAndTranslate] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.814.456 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [ScaleAndTranslateGrad] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.814.469 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [CombinedNonMaxSuppression] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.814.463 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.814.512 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.814.530 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.814.557 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [CholeskyGrad] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.814.574 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Cholesky] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.814.589 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [MatrixDeterminant] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.814.604 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [MatrixSolve] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.814.617 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [MatrixTriangularSolve] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.814.629 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Qr] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.814.697 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.814.753 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNN, funcPointer:0xffff29345d70, registered count:1
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.814.923 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Digamma] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.814.925 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.814.942 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Igamma] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.814.956 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Igammac] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.814.950 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNNV2, funcPointer:0xffff2934e248, registered count:2
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.814.973 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Bincount] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.814.984 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Betainc] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.814.997 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Bucketize] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.815.014 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [IgammaGradA] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.815.036 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [NextAfter] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.815.049 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [IsInf] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.815.062 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [IsNan] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.815.085 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Conj] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.815.078 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.815.109 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Complex] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.815.122 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Angle] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.815.198 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.815.336 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [ScatterNdUpdate] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.815.356 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [TensorScatterUpdate] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.815.350 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.815.414 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Tril] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.815.427 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [IndexPut] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.815.440 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Eye] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.815.452 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [FillDiagonal] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.815.464 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Trace] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.815.472 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GridSampler2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.815.598 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GridSampler3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.815.720 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandle] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.815.833 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandleV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.815.943 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.816.069 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PasteSubImg] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.816.088 [devmm_virt_interface.c:450][ascend][curpid:618654,618654][drv][devmm][devmm_ioctl_init_process]Init_process details. (hostpid=618654)
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.816.202 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.816.234 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.816.304 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [DecodeBbox] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.816.332 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [ClipBoxes] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.816.349 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [ClipBoxesD] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.816.368 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [DecodeBoundariesTarget] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.816.368 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.816.381 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [DecodeCornerpointsTargetBG] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.816.396 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [DecodeCornerpointsTargetWrtCenterV1] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.816.407 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [DecodeWheelsTarget] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.816.486 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.816.470 [drv_log_user.c:623][ascend][curpid:618654,618654][drv][devmm][share_log_read_in_single_module]Setup device succeeded. (logical_devid=2; devid=2; vfid=0; hostpid=618654; devpid=5065)
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.816.519 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [SparseSoftmaxCrossEntropyWithLogits] has registered infer func
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.816.503 [devmm_svm.c:122][ascend][curpid:618654,618654][drv][devmm][devmm_set_device_info]Device info. (devid=2; dvpp_size=17179869184; support_bar_mem=1; support_dev_read_only=1; support_dev_mem_map_host=1; support_bar_huge_mem=1; is_alloced_by_malloc=0; host_rw_dev_ro=1; double_pgtable_offset=17592186044416; is_support_host_pin_pre_register=0; is_support_host_mem_pool=0)
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.816.605 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [KlDivLossGrad] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.816.611 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.816.729 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.816.841 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.816.944 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [FractionalMaxPoolGrad] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.816.964 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [FractionalAvgPool] has registered infer func
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.816.957 [stub_process_mode_nowin.cpp:60][ProcessQueueForMdc][tid:618654] [TsdClient] it is unnecessary of current mode[0] to grant queue auth to aicpusd
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.816.982 [stub_process_mode_nowin.cpp:99][OpenInHost][tid:618654] enter into OpenInHost deviceid[2]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.816.968 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.816.981 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [FractionalMaxPool] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.816.994 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [DataFormatVecPermute] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.817.006 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [FractionalAvgPoolGrad] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.817.019 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [NthElement] has registered infer func
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.817.025 [client_manager.cpp:435][IsHostEnvironment][tid:618654] [TsdClient] logicDeviceId is [2], hostaicpunum[0]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.817.045 [stub_process_mode_nowin.cpp:103][OpenInHost][tid:618654] host cpu not support
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.817.061 [process_mode_manager.cpp:121][OpenProcess][tid:618654] [TsdClient][deviceId=2] [sessionId=1] start hccp and computer process success
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.817.080 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TabulateFusionGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.817.084 [runtime.cc:2879] 618654 startAicpuExecutor: userDeviceId=2, devId=2, tsdOpen ret=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.817.101 [runtime.cc:2891] 618654 startAicpuExecutor: TsdOpen success, devId=2, ret=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.817.121 [runtime.cc:3627] 618654 DeviceRetain: new dev ok id=2, rawDevSize=1328 (bytes), ts_id=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.817.139 [raw_device.cc:936] 618654 DevSetTsId: DevSetTsId, tsId=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.817.168 [npu_driver.cc:2968] 618654 DeviceOpen: Open device start, device_id=2, tsId=0.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.817.197 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[YUV4442YUV422] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.817.280 [trs_sqcq.c:458][ascend][curpid:618654,618654][drv][tsdrv][trsDevSqCqInit]Sqcq init. (devid=2)
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.817.351 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.817.381 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.817.365 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.817.411 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.817.439 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.817.470 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Tanh] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.817.590 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.817.640 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.817.709 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.817.765 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Pad] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.817.787 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [PadV3] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.817.801 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [PadV3Grad] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.817.816 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [BroadcastTo] has registered infer func
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.817.806 [trs_sqcq.c:394][ascend][curpid:618654,618654][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=2; tsId=0; id_type=6; num=2044)
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.817.827 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.817.946 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.817.944 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MedianDim] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.817.959 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [RaggedRange] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.818.060 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.818.100 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [ShuffleChannel] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.818.170 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.818.200 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.818.228 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.818.278 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.818.300 [trs_sqcq.c:394][ascend][curpid:618654,618654][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=2; tsId=0; id_type=7; num=2044)
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.818.352 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.818.369 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [ReduceSum] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.818.392 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [ReduceProd] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.818.428 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [INInferV2] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.818.441 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [INInferV2] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.818.465 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.818.490 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.818.581 [trs_sqcq.c:394][ascend][curpid:618654,618654][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=2; tsId=0; id_type=10; num=1024)
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.818.579 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.818.705 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.818.788 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicAtomicAddrClean] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.818.868 [trs_sqcq.c:394][ascend][curpid:618654,618654][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=2; tsId=0; id_type=11; num=1024)
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.818.885 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.818.906 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.818.970 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [UnsortedSegmentSum] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.819.014 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [ReverseV2] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.819.030 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Select] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.819.026 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.819.053 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [SegmentSum] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.819.073 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Slice] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.819.055 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeTutelCombineGates] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.819.090 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [OneHot] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.819.111 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [ScatterNd] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.819.130 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Cumprod] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.819.144 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.819.179 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [CumulativeLogsumexp] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.819.217 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [MaskedSelect] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.819.268 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeTutelCombineX] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.819.273 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.819.375 [trs_sqcq.c:394][ascend][curpid:618654,618654][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=2; tsId=0; id_type=12; num=2048)
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.819.386 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.819.402 [trs_sqcq.c:394][ascend][curpid:618654,618654][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=2; tsId=0; id_type=8; num=16)
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.819.417 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeTutelDispatch] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.819.428 [trs_sqcq.c:394][ascend][curpid:618654,618654][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=2; tsId=0; id_type=9; num=16)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.819.452 [trs_sqcq.c:394][ascend][curpid:618654,618654][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=2; tsId=0; id_type=13; num=4)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.819.474 [trs_sqcq.c:394][ascend][curpid:618654,618654][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=2; tsId=0; id_type=14; num=10)
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.819.504 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.819.513 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.819.537 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceMeanD] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.819.590 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Concat] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.819.654 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.819.768 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [NonDeterministicInts] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.819.766 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.819.788 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScore] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.819.801 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.819.921 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.820.023 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [Flatten] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.820.050 [operator_factory_impl.cc:222]618666 RegisterInferShapeFunc:op [DepthToSpace] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.820.084 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.820.094 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.820.222 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.820.335 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.820.461 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.820.572 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.820.626 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Rfft1D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.820.647 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.820.693 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[EluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.820.691 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.820.727 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.820.754 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.820.786 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SyncBNTrainingUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.820.804 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.820.816 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Abs] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.820.809 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.820.845 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Real] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.820.866 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Acos] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.820.888 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Acosh] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.820.914 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddMatMatElements] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.820.921 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.820.938 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Adds] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.820.962 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Asin] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.820.984 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Asinh] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.820.974 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.007 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AssignAdd] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.821.009 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GemmaRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.028 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AssignSub] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.051 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Atan] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.071 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Atanh] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.094 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.118 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BesselI0e] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.821.121 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.138 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BesselI1e] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.821.133 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.157 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.179 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.199 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.219 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.821.242 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.246 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Bucketize] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.821.273 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.282 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Cast] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.308 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Ceil] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.333 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CeluV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.358 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ComplexAbs] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.821.365 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.387 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Cos] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.411 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Cosh] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.428 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.451 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DataFormatDimMap] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.478 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Dequantize] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.821.471 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LinearIndex] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.501 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Elu] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.525 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Erf] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.546 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Erfc] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.566 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Exp] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.587 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Expm1] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.612 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FakeQuantWithMinMaxVars] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.632 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FastGelu] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.655 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FastGeluV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.680 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Floor] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.821.671 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LinearIndexV2] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.712 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FusedMulAddN] register OP_IMPL : [InferShape]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.821.711 [trs_dev_drv.c:302][ascend][curpid:618654,618654][drv][tsdrv][drvDeviceOpenComm]Open success. (devid=2; fd=36; mmapFd=37)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.821.747 [devmm_svm.c:132][ascend][curpid:618654,618654][drv][devmm][devmm_setup_device]DrvMemDeviceOpen. (devid=2)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.744 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HardSigmoid] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.766 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HardShrink] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.788 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HardShrinkGrad] register OP_IMPL : [InferShape]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.821.775 [devmm_svm.c:122][ascend][curpid:618654,618654][drv][devmm][devmm_set_device_info]Device info. (devid=2; dvpp_size=17179869184; support_bar_mem=1; support_dev_read_only=1; support_dev_mem_map_host=1; support_bar_huge_mem=1; is_alloced_by_malloc=0; host_rw_dev_ro=1; double_pgtable_offset=17592186044416; is_support_host_pin_pre_register=0; is_support_host_mem_pool=0)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.811 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HardSwish] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.833 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HardSwishGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.853 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HardtanhGrad] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.821.860 [npu_driver.cc:3011] 618654 DeviceOpen: Open device success, device_id=2, tsId=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.883 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IndexFillD] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.821.872 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterAddWithSorted] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.821.883 [raw_device.cc:292] 618654 Init: chipType:0x5
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.904 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.924 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.948 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Inv] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.821.943 [raw_device.cc:304] 618654 Init: isAddrFlat:0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.821.973 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Invert] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.821.964 [raw_device.cc:320] 618654 Init: GetDevInfo, device_id=2, hardwareVersion=0x503
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.821.987 [devmm_svm.c:1972][ascend][curpid:618654,618654][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0x1; out_feature=0x1)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.822.006 [npu_driver.cc:1578] 618654 SupportNumaTsMemCtrl: chip type=5, support flag=1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.006 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Log] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.029 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Log1p] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.058 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LogicalNot] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.822.048 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Sinkhorn] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.081 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LogAddExp] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.102 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LpNormUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.125 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LpNormUpdateV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.145 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Dawsn] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.170 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Expint] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.822.179 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.191 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Erfinv] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.214 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FresnelCos] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.234 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FresnelSin] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.260 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Ndtri] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.284 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Spence] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.305 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Fills] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.822.297 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.331 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LeakyRelu] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.822.330 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.355 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[OnesLike] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.376 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Reciprocal] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.405 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Sign] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.428 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Sqrt] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.449 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Tanh] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.480 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ZerosLike] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.506 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Gelu] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.530 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GeluV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.555 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Relu] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.575 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Neg] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.596 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LogSoftmaxV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.617 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.644 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftmaxV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.661 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.682 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftplusV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.712 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Muls] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.742 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Power] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.762 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Relu6] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.787 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Relu6D] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.809 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Relu6Grad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.829 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.857 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Rint] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.884 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Round] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.904 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Rsqrt] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.926 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RsqrtGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.946 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Selu] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.966 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Shrink] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.822.987 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Sigmoid] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.007 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGrad] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.823.015 [raw_device.cc:352] 618654 Init: Get phy info, phy chip id 2, phy die id 0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.823.041 [runtime.cc:2771] 618654 GetTsdQos: [TSD] start get qos, devId=2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.028 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SigmoidGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.061 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Sin] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.823.058 [runtime.cc:5239] 618654 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.823.076 [tsd_client.cpp:189][TsdCapabilityGet][tid:618654] TsdCapabilityGet Begin.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.823.092 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618654] [TsdClient] g_userDeviceInfo is empty.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.086 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Sinh] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.109 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SmoothL1Loss] register OP_IMPL : [InferShape]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.823.108 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618654] [TsdClient] g_userDeviceInfo is empty.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.135 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SmoothL1LossGrad] register OP_IMPL : [InferShape]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.823.126 [process_mode_manager.cpp:1042][CapabilityGet][tid:618654] [ProcessModeManager] enter into CapabilityGet process deviceId[2] type[0]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.823.147 [process_mode_manager.cpp:386][InitTsdClient][tid:618654] [TsdClient] tsd client has been inited before
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.157 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LogSigmoid] register OP_IMPL : [InferShape]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.823.169 [version_verify.cpp:114][SpecialFeatureCheck][tid:618654] VersionVerify: previous type[38], supported
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.179 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LogSigmoidGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.823.173 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.202 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LogSpaceD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.223 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Softplus] register OP_IMPL : [InferShape]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.823.224 [process_mode_manager.cpp:1065][CapabilityGet][tid:618654] [TsdClient][deviceId=2] [sessionId=1] [type=0]send capability success 
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.243 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Softsign] register OP_IMPL : [InferShape]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.823.246 [hdc_client.cpp:154][TsdRecvData][tid:618654] recv timeout is:150000 ms
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.265 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SqrtGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.288 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Square] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.310 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Swish] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.330 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwishGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.353 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SiluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.376 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardElemt] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.397 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Tan] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.823.403 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StackGroupPoints] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.418 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftShrink] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.447 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftShrinkGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.469 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Threshold] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.493 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ThresholdV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.515 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ThresholdV2D] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.537 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Trunc] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.557 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : [InferShape]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.823.563 [process_mode_msg_parse.cpp:175][CapabilityResMsgProc][tid:618654] [CapabilityResMsgProc] [sessionID=1]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.577 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.823.579 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.823.585 [process_mode_msg_parse.cpp:170][PidQosMsgProc][tid:618654] [TsdClient] PidQosMsgProc recvMsg realDeviceId[2] msgType[39] localDevId[2] rspCode[0],pidqos[1]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.823.605 [hdc_client.cpp:172][TsdRecvData][tid:618654] [deviceId=2] the Tsd recv data already
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.611 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MishGrad] register OP_IMPL : [InferShape]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.823.622 [process_mode_manager.cpp:1070][CapabilityGet][tid:618654] [TsdClient][logicDeviceId_=2][type=0][pidQos=1][ret=0]recv capability respond finish
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.638 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HardSigmoidGrad] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.823.640 [runtime.cc:2782] 618654 GetTsdQos: [TSD] get qos success, userDeviceId=2, devId=2, qos=1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.657 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.823.665 [engine.cc:78] 618654 Engine: Constructor.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.823.681 [stars_engine.cc:51] 618654 StarsEngine: Constructor.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.676 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.823.695 [engine_factory.cc:26] 618654 CreateEngine: new StarsEngine[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.700 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : [InferShape]
, Runtime_alloc_size 320
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.823.727 [engine_factory.cc:38] 618654 CreateEngine: Engine init success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.724 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.823.703 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.746 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FillDiagonal] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.823.743 [raw_device.cc:364] 618654 Init: new SpmPool ok, Runtime_alloc_size 56(bytes)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.823.760 [spm_pool.cc:42] 618654 Init: new buffer ok, Runtime_alloc_size 128
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.770 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IndexPut] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.792 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReadVariableOp] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.813 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CastLike] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.835 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FusedBiasLeakyRelu] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.857 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StatelessBernoulliV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.878 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.823.879 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.898 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InvertPermutation] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.916 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.823.909 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.823.909 [buffer_allocator.cc:61] 618654 BufferAllocator: alloc success, Runtime_alloc_size 128(bytes)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.823.930 [spm_pool.cc:55] 618654 Init: new BufferAllocator ok, Runtime_alloc_size 152
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.940 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SearchSorted] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.958 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.823.949 [raw_device.cc:380] 618654 Init: new UmaArgLoader ok, Runtime_alloc_size 296(bytes)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.977 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : [InferShape]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.823.971 [devmm_svm.c:1972][ascend][curpid:618654,618654][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.823.997 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.823.983 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DepthToSpace] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.823.993 [npu_driver.cc:6080] 618654 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.824.014 [devmm_svm.c:1972][ascend][curpid:618654,618654][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.020 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.824.030 [npu_driver.cc:6080] 618654 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.042 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.824.029 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.824.057 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.824.074 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SpaceToDepth] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.164 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaskedScale] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.193 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AbsGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.218 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AccumulateNV2] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.824.220 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.241 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddN] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.824.228 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.824.253 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.265 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Eltwise] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.824.281 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.293 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.322 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AcosGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.342 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AcoshGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.364 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AsinGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.824.361 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.386 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AsinhGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.409 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Atan2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.430 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AtanGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.824.440 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.452 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Axpy] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.475 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BitwiseAnd] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.824.481 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.497 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BitwiseOr] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.519 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BitwiseXor] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.543 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Div] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.565 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DivNoNan] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.586 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[EluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.606 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FastGeluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.824.599 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.629 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FloorDiv] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.649 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FloorMod] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.824.658 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.670 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InvGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.693 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LeakyReluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.714 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TanhGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.824.713 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.738 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Add] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.759 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Addcdiv] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.824.752 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.782 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Addcmul] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.804 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AxpyV2] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.826 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LogicalAnd] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.824.824 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.854 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LogicalOr] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.880 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Mul] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.903 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Pow] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.923 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RealDiv] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.948 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ClipByNormNoDivSum] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.824.943 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.975 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ClipByValue] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.824.996 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ClipByValueV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.016 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FusedMulAdd] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.825.012 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.047 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftmaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.825.055 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.070 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Sub] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.097 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Gcd] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.119 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LarsV2Update] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.140 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaskedFill] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.161 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.182 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Xlog1py] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.825.177 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.208 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApproximateEqual] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.825.208 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.825.212 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.231 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Equal] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.825.243 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.253 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NotEqual] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.825.271 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.279 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Greater] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.302 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GreaterEqual] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.322 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Less] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.344 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LessEqual] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.825.339 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.374 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Maximum] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.825.368 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.398 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Minimum] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.421 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Mod] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.443 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.464 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MulNoNan] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.825.469 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.485 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReciprocalGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.507 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SeluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.825.502 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.825.499 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.529 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogits] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.825.531 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.550 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftplusGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.572 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftplusV2Grad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.592 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftsignGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.612 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SquaredDifference] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.630 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.825.642 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.653 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ThresholdGradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.676 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TruncateDiv] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.696 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TruncateMod] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.717 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Xdivy] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.740 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IsClose] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.825.754 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.766 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Xlogy] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.788 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.808 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SelectV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.832 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaskedSelectV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.852 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Lerp] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.874 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FusedBiasLeakyReluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.825.871 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.825.986 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.826.009 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.826.085 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.826.189 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.826.246 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.826.289 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.826.417 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.826.439 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.826.469 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.826.490 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.826.522 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.826.592 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.826.678 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.826.689 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.826.790 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.826.798 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.826.898 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.826.940 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.826.995 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.827.060 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.827.114 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.827.224 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Quantize] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.827.246 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.827.269 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AscendDequant] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.827.291 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.827.383 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.827.485 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.827.511 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.827.532 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.827.552 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.827.569 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.827.594 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BasicLSTMInplaceFillWindowCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.827.616 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BasicGRUInplaceFillWindowCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.827.725 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.827.728 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNormGradV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.827.823 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.827.941 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.828.040 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.828.064 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.828.179 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdaCast] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.828.280 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.828.303 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.828.323 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.828.342 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.828.362 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.828.433 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.828.518 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.828.506 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: Conv2DBackpropFilter, registered count: 1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.828.540 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.828.569 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.828.610 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: Conv2DBackpropInput, registered count: 2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.828.640 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.828.637 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: Conv2DTranspose, registered count: 3
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.828.712 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: Conv2D, registered count: 4
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.828.729 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.828.740 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.828.764 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.828.793 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: Conv3DBackpropInput, registered count: 5
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.828.817 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: Conv3DTranspose, registered count: 6
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.828.820 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.828.857 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.828.888 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.828.896 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: Conv3D, registered count: 7
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.828.956 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.828.967 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.828.982 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.829.063 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: FFN, registered count: 8
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.829.084 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.829.084 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: MatmulTunnerTiling, registered count: 9
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.829.118 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.829.129 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.829.185 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.829.221 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: MatMulV2, registered count: 10
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.829.244 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: BatchMatmulFixpipe, registered count: 11
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.829.255 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.829.266 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: MatMulV3, registered count: 12
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.829.284 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.829.287 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: QuantBatchMatmulV3, registered count: 13
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.829.346 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.829.391 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.829.414 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.829.434 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.829.472 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: DynamicRNN, registered count: 14
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.829.492 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: MatMulTunnerTiling, registered count: 15
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.829.521 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[L2Loss] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.829.519 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.829.629 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.829.660 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.829.731 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.829.778 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.829.816 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.829.828 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.829.870 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.829.929 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.829.950 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.830.027 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.830.056 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceAny] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.830.082 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceAll] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.830.080 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.830.104 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceMax] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.830.124 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.830.148 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceMeanWithCast] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.830.141 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.830.172 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceMin] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.830.193 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceProd] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.830.199 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.830.220 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.830.228 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MlaAttentionScore] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.830.249 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[EuclideanNorm] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.830.272 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceLogSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.830.293 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceLogSumExp] register OP_IMPL : [InferShape][InputsDependency]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.830.330 [buffer_allocator.cc:61] 618654 BufferAllocator: alloc success, Runtime_alloc_size 32768(bytes)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.830.361 [task_allocator.cc:46] 618654 DefaultAlloc: Runtime_alloc_size 32768(bytes)
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.830.353 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.830.391 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceNansum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.830.387 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.830.395 [buffer_allocator.cc:61] 618654 BufferAllocator: alloc success, Runtime_alloc_size 104(bytes)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.830.412 [h2d_copy_mgr.cc:45] 618654 H2DCopyMgr: alloc h2d copy buff success, policy 2
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.830.430 [devmm_svm.c:1972][ascend][curpid:618654,618654][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.830.449 [npu_driver.cc:6080] 618654 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.830.442 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.830.475 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.830.495 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.830.520 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.830.525 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.830.540 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.830.561 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.830.580 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.830.604 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.830.634 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.830.708 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.830.722 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:MatMulV2, funcPointer:0xffff15c98a10, registered count:3
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.830.759 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:MatMulV2, funcPointer:0xffff15c98c70, registered count:1
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.830.759 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPool3DWithArgmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.830.769 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.830.803 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.830.814 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.830.851 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MlaAttentionScore] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.830.917 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.830.940 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.830.998 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.831.038 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.831.134 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [InferShape][InferShapeRange][InferDataType][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.831.159 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SplitD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.831.179 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.831.197 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.831.228 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.831.232 [op_tiling_manager.cc:79]618674 LoadSo:dlopen file /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so successfully!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.831.277 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.831.303 [op_tiling_manager.cc:58]618674 LoadSo:[FindSo][Check] Get path with op_master [/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_master/] failed
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.831.378 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.831.394 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.831.420 [buffer_allocator.cc:61] 618654 BufferAllocator: alloc success, Runtime_alloc_size 262144(bytes)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.831.443 [task_allocator.cc:46] 618654 DefaultAlloc: Runtime_alloc_size 4096(bytes)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.831.458 [buffer_allocator.cc:61] 618654 BufferAllocator: alloc success, Runtime_alloc_size 128(bytes)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.831.476 [h2d_copy_mgr.cc:45] 618654 H2DCopyMgr: alloc h2d copy buff success, policy 2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.831.485 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.831.491 [devmm_svm.c:1972][ascend][curpid:618654,618654][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.831.511 [npu_driver.cc:6080] 618654 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.831.530 [op_tiling_manager.cc:67]618674 LoadSo:Failed to dlopen /usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.831.578 [op_tiling_manager.cc:73]618674 LoadSo:Failed to dlopen /usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.831.586 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : [InferShape]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.831.647 [op_tiling_manager.cc:58]618674 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.831.686 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.831.699 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.831.709 [op_tiling_manager.cc:67]618674 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.831.752 [op_tiling_manager.cc:73]618674 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.831.760 [op_tiling_manager.cc:79]618662 LoadSo:dlopen file /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so successfully!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.831.787 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.831.799 [op_tiling_manager.cc:58]618674 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.831.809 [op_tiling_manager.cc:58]618662 LoadSo:[FindSo][Check] Get path with op_master [/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_master/] failed
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.831.847 [op_tiling_manager.cc:67]618674 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.831.889 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.831.990 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.832.000 [op_tiling_manager.cc:67]618662 LoadSo:Failed to dlopen /usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.832.049 [op_tiling_manager.cc:73]618662 LoadSo:Failed to dlopen /usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.832.090 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.832.093 [op_tiling_manager.cc:58]618662 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.832.152 [op_tiling_manager.cc:67]618662 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.832.200 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.832.214 [op_tiling_manager.cc:73]618662 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.832.272 [op_tiling_manager.cc:58]618662 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.832.286 [buffer_allocator.cc:61] 618654 BufferAllocator: alloc success, Runtime_alloc_size 524288(bytes)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.832.311 [task_allocator.cc:46] 618654 DefaultAlloc: Runtime_alloc_size 2048(bytes)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.832.309 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.832.317 [op_tiling_manager.cc:67]618662 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.832.328 [buffer_allocator.cc:61] 618654 BufferAllocator: alloc success, Runtime_alloc_size 136(bytes)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.832.341 [h2d_copy_mgr.cc:45] 618654 H2DCopyMgr: alloc h2d copy buff success, policy 2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.832.336 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.832.360 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [InferShape][InputsDependency]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.832.356 [uma_arg_loader.cc:86] 618654 Init: new BufferAllocator superArgAllocator_ ok, Runtime_alloc_size 152
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.832.391 [task_allocator.cc:46] 618654 DefaultAlloc: Runtime_alloc_size 32768(bytes)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.832.420 [buffer_allocator.cc:61] 618654 BufferAllocator: alloc success, Runtime_alloc_size 104(bytes)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.832.436 [uma_arg_loader.cc:93] 618654 Init: new BufferAllocator handleAllocator_ ok, Runtime_alloc_size 152
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.832.469 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.832.571 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.832.595 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.832.689 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.832.787 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.832.884 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.832.864 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:AllFinite, funcPointer:(nil), registered count:2
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.832.900 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:AllFinite, funcPointer:(nil), registered count:4
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.832.927 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:AllFinite, funcPointer:(nil), registered count:1
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.832.948 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:AllFinite, funcPointer:(nil), registered count:1
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.832.972 [op_check.cc:71]618674 RegisterParamGeneralize:RegisterParamGeneralize: op_type:AllFinite, funcPointer:(nil), registered count:1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.832.988 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.832.991 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:AllFinite, funcPointer:(nil), registered count:2
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.832.999 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPool3DGradWithArgmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.833.030 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:AllFinite, funcPointer:(nil), registered count:4
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.833.054 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:AllFinite, funcPointer:(nil), registered count:1
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.833.076 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:AllFinite, funcPointer:(nil), registered count:1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.833.090 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.833.095 [op_check.cc:71]618662 RegisterParamGeneralize:RegisterParamGeneralize: op_type:AllFinite, funcPointer:(nil), registered count:1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.833.114 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.833.212 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [InferShape][InputsDependency]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.833.238 [buffer_allocator.cc:61] 618654 BufferAllocator: alloc success, Runtime_alloc_size 131072(bytes)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.833.258 [uma_arg_loader.cc:102] 618654 Init: new BufferAllocator kernelInfoAllocator_ ok, Runtime_alloc_size 152
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.833.272 [uma_arg_loader.cc:104] 618654 Init: ALLOC PCIE is support[1]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.833.286 [devmm_svm.c:1972][ascend][curpid:618654,618654][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.833.305 [npu_driver.cc:6080] 618654 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.833.316 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.833.309 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff2868b9b0, registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.833.335 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:5
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.833.356 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:2
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.833.375 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:2
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.833.395 [op_check.cc:71]618674 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.833.415 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.833.411 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff5414f9b0, registered count:3
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.833.437 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:5
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.833.440 [buffer_allocator.cc:61] 618654 BufferAllocator: alloc success, Runtime_alloc_size 32768(bytes)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.833.457 [h2d_copy_mgr.cc:45] 618654 H2DCopyMgr: alloc h2d copy buff success, policy 1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.833.471 [raw_device.cc:393] 618654 Init: new StreamSqCqManage ok, Runtime_alloc_size 416(bytes)
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.833.459 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:2
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.833.479 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.833.486 [raw_device.cc:398] 618654 Init: New taskFactory ok, Runtime_alloc_size 136(bytes)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.833.502 [task_allocator.cc:46] 618654 DefaultAlloc: Runtime_alloc_size 393216(bytes)
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.833.499 [op_check.cc:71]618662 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:2
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.833.489 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.833.517 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.833.541 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.833.639 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.833.670 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.833.682 [buffer_allocator.cc:61] 618654 BufferAllocator: alloc success, Runtime_alloc_size 104(bytes)
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.833.710 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff2868eda0, registered count:4
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.833.736 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.833.742 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.833.757 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.833.757 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.833.779 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.833.798 [op_check.cc:71]618674 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.833.800 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff54152da0, registered count:4
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.833.824 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.833.840 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.833.845 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.833.855 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.833.867 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.833.878 [raw_device.cc:109] 618654 Init: ObjAllocator alloc success, Runtime_alloc_size 160000(bytes)
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.833.887 [op_check.cc:71]618662 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.833.941 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.834.022 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.834.037 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.834.100 [op_tiling_manager.cc:75]618674 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.834.139 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.834.166 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.834.159 [op_tiling_manager.cc:58]618674 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.834.159 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.834.149 [op_tiling_manager.cc:75]618662 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.834.188 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.834.182 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CTCLossV3Grad] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.834.213 [op_tiling_manager.cc:58]618662 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.834.273 [op_tiling_manager.cc:67]618674 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.834.293 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.834.308 [op_tiling_manager.cc:67]618662 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.834.308 [raw_device.cc:121] 618654 Init: ObjAllocator alloc success, Runtime_alloc_size 960000(bytes)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.834.327 [raw_device.cc:425] 618654 Init: Runtime_alloc_size=64000(bytes)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.834.326 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.834.348 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.834.369 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.834.389 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.834.395 [npu_driver.cc:404] 618654 StreamIdAlloc: stream id alloc begin, device_id=2, priority=0, ts_id=0, remote_stream_id=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.834.407 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.834.426 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.834.442 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.834.459 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.834.475 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.834.491 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.834.495 [stream.cc:2246] 618654 AllocExecutedTimesSvm: stream_id=0.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.834.507 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.834.526 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.834.544 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.834.538 [stream_sqcq_manage.cc:147] 618654 Alloc: deviceId=2, tsId=0, drvFlag=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.834.566 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.834.558 [npu_driver.cc:882] 618654 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.834.587 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.834.603 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.834.620 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.834.703 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SegmentSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.834.798 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.834.899 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.834.993 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [InferShape][InputsDependency]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.834.993 [npu_driver.cc:6125] 618654 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.835.062 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff286452c0, registered count:4
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.835.065 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff541092c0, registered count:4
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.835.087 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.835.094 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.835.092 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:6
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.835.089 [npu_driver.cc:6137] 618654 LogicCqAllocateV2: success: deviceId=2, tsId=0, cqId=997, streamId=0, logicCq=997, cqeDepth=4096
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.835.112 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.835.113 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.835.125 [npu_driver.cc:6189] 618654 StreamBindLogicCq: success: deviceId=2, tsId=0, streamId=0, logicCq=997.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.835.134 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.835.132 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.835.150 [op_check.cc:71]618674 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.835.147 [npu_driver.cc:5916] 618654 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=d8bfb000, addr=dfffd8bfb000size=4096
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.835.152 [op_check.cc:71]618662 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.835.169 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CTCLossV3] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.835.167 [stream.cc:653] 618654 Setup: Success to get sq=0 sq reg virtual addr length=4096.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.835.198 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.835.270 [stream.cc:276] 618654 CreateStreamTaskRes: Normal STREAM Setup stream_id=0 flags_=0xc0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.835.290 [stream.cc:688] 618654 Setup: stream setup end, stream_id=0, IsTaskSink=0, sqId=0, cqId=0, deviceId=2, streamResId=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.835.308 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UnsortedSegmentMax] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:41.835.308 [stream_state_callback_manager.cc:45] 618654 Notify: not reg stream state callback func!
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.835.326 [raw_device.cc:593] 618654 Start: new primary Stream ok, Runtime_alloc_size 3872, stream_id=0.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.835.326 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.835.335 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UnsortedSegmentMin] register OP_IMPL : [InferShape][InputsDependency]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.835.357 [npu_driver.cc:404] 618654 StreamIdAlloc: stream id alloc begin, device_id=2, priority=0, ts_id=0, remote_stream_id=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.835.367 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UnsortedSegmentProd] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.835.387 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.835.386 [stream_sqcq_manage.cc:147] 618654 Alloc: deviceId=2, tsId=0, drvFlag=16
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.835.406 [npu_driver.cc:882] 618654 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.835.482 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdamApplyOne] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.835.474 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff5410d978, registered count:4
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.835.477 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff28649978, registered count:4
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.835.486 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3DGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.835.501 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.835.502 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.835.519 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.835.513 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdamApplyOneAssign] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.835.508 [tsch_stream.cc:45] 618654 Setup: stream setup end, stream_id=1, type=1, IsTaskSink=0, sqId=1, cqId=1, deviceId=2 streamResId=0
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.835.519 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.835.531 [raw_device.cc:1219] 618654 TschStreamSetup: Tsch setup ffts dsa stream ok, stream_id=1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.835.540 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecay] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.835.539 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.835.539 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.835.563 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecayAssign] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.835.560 [op_check.cc:71]618674 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.835.559 [op_check.cc:71]618662 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.835.613 [osal.cc:309] 618654 CreateThread: Runtime_alloc_size 56
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.835.662 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BN3DTrainingReduce] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.835.684 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.835.702 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.835.720 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.835.760 [osal.cc:182] 618654 Start: mmCreateTaskWithThreadAttr, retCode=0, name_=MONITOR_0, i=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.835.788 [osal.cc:309] 618654 CreateThread: Runtime_alloc_size 56
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.835.817 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNTrainingReduce] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.835.848 [op_tiling_manager.cc:75]618674 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.835.848 [op_tiling_manager.cc:75]618662 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.835.873 [osal.cc:182] 618654 Start: mmCreateTaskWithThreadAttr, retCode=0, name_=RT_RECYCLE, i=0
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.835.903 [op_tiling_manager.cc:58]618674 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.835.903 [op_tiling_manager.cc:58]618662 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.835.920 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.835.894 [stars_engine.cc:201] 618831 RecycleThreadRun: RecycleThreadRun thread enter.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.835.920 [stars_engine.cc:1785] 618830 MonitoringRun: Starts Monitor thread has entered, ts_id=0
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.835.965 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.835.987 [op_tiling_manager.cc:67]618674 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.835.988 [runtime.cc:5239] 618830 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.835.987 [op_tiling_manager.cc:67]618662 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.836.010 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618830] [TsdClient] g_userDeviceInfo is empty.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.836.023 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : [InferShape]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.836.033 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618830] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.836.050 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618830] [TsdClient] g_userDeviceInfo is empty.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.836.039 [op_tiling_manager.cc:73]618674 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.836.054 [op_tiling_manager.cc:73]618662 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.836.077 [runtime.cc:3077] 618830 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=2, devId=2, tdt status=0
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.836.082 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.836.091 [op_tiling_manager.cc:58]618674 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.836.095 [op_tiling_manager.cc:58]618662 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.836.120 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : [InferShape]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.836.141 [op_tiling_manager.cc:67]618674 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.836.141 [npu_driver.cc:6306] 618830 GetDeviceStatus: GetDeviceStatus status=1.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.836.141 [op_tiling_manager.cc:67]618662 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.836.186 [stars_engine.cc:1855] 618830 ReportHBMRasProc: g_hbmRasCheckDeviceId init, dev_id=2
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.836.194 [op_tiling_manager.cc:75]618662 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.836.194 [op_tiling_manager.cc:75]618674 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.836.209 [npu_driver.cc:551] 618830 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.836.232 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : [InferShape]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.836.238 [op_tiling_manager.cc:58]618662 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.836.240 [op_tiling_manager.cc:58]618674 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.836.215 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.836.281 [op_tiling_manager.cc:67]618662 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.836.282 [op_tiling_manager.cc:67]618674 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.836.316 [op_tiling_manager.cc:75]618674 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.836.316 [op_tiling_manager.cc:75]618662 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.836.335 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : [InferShape]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.836.355 [op_tiling_manager.cc:58]618674 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.836.351 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.836.355 [op_tiling_manager.cc:58]618662 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.836.396 [op_tiling_manager.cc:67]618674 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.836.396 [op_tiling_manager.cc:67]618662 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.836.432 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : [InferShape]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.836.434 [op_tiling_manager.cc:73]618674 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.836.435 [op_tiling_manager.cc:73]618662 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.836.473 [op_tiling_manager.cc:58]618674 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.836.477 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.836.484 [op_tiling_manager.cc:58]618662 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.836.526 [op_tiling_manager.cc:67]618662 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.836.517 [op_tiling_manager.cc:67]618674 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.836.554 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.836.558 [op_tiling_manager.cc:75]618662 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.836.559 [op_tiling_manager.cc:75]618674 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.836.597 [op_tiling_manager.cc:58]618662 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.836.598 [op_tiling_manager.cc:58]618674 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.836.603 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.836.637 [op_tiling_manager.cc:67]618674 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.836.636 [op_tiling_manager.cc:67]618662 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.836.663 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.836.670 [op_tiling_manager.cc:75]618662 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.836.670 [op_tiling_manager.cc:75]618674 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.836.708 [op_tiling_manager.cc:58]618662 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.836.709 [op_tiling_manager.cc:58]618674 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.836.726 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.836.747 [op_tiling_manager.cc:67]618674 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.836.749 [op_tiling_manager.cc:67]618662 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.836.768 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : [InferShape]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.836.785 [op_tiling_manager.cc:73]618674 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.836.788 [op_tiling_manager.cc:73]618662 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.836.824 [op_tiling_manager.cc:58]618674 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.836.826 [op_tiling_manager.cc:58]618662 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.836.842 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.836.865 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : [InferShape]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.836.862 [op_tiling_manager.cc:67]618674 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.836.864 [op_tiling_manager.cc:67]618662 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.836.895 [op_tiling_manager.cc:75]618674 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.836.907 [op_tiling_manager.cc:75]618662 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.836.933 [op_tiling_manager.cc:58]618674 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.836.945 [op_tiling_manager.cc:58]618662 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.836.955 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.836.969 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[INTrainingReduceV2] register OP_IMPL : [InferShape]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.836.981 [op_tiling_manager.cc:67]618674 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.836.983 [op_tiling_manager.cc:67]618662 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.837.014 [op_tiling_manager.cc:75]618674 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.837.016 [op_tiling_manager.cc:75]618662 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.837.052 [op_tiling_manager.cc:58]618674 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.837.053 [op_tiling_manager.cc:58]618662 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.837.070 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.837.075 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.837.089 [op_tiling_manager.cc:67]618674 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.837.090 [op_tiling_manager.cc:67]618662 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.837.108 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[INTrainingUpdateGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.837.133 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[INTrainingUpdateGradGammaBeta] register OP_IMPL : [InferShape]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.837.132 [op_tiling_manager.cc:73]618674 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.837.131 [op_tiling_manager.cc:73]618662 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.837.160 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[INTrainingUpdateV2] register OP_IMPL : [InferShape]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.837.172 [op_tiling_manager.cc:58]618662 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.837.173 [op_tiling_manager.cc:58]618674 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.837.214 [op_tiling_manager.cc:67]618674 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.837.214 [op_tiling_manager.cc:67]618662 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.837.214 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.837.247 [op_tiling_manager.cc:75]618674 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.837.247 [op_tiling_manager.cc:75]618662 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.837.254 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : [InferShape]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.837.286 [op_tiling_manager.cc:58]618674 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.837.286 [op_tiling_manager.cc:58]618662 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.837.333 [op_tiling_manager.cc:67]618662 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.837.326 [op_tiling_manager.cc:67]618674 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.837.356 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.837.368 [op_tiling_manager.cc:75]618674 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.837.368 [op_tiling_manager.cc:75]618662 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.837.377 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PadV3GradReplication] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.837.390 [op_tiling_manager.cc:109]618662 ~FuncPerfScope:[GEPERFTRACE] The time cost of OpTilingManager::LoadSo is [192727] micro seconds.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.837.391 [op_tiling_manager.cc:109]618674 ~FuncPerfScope:[GEPERFTRACE] The time cost of OpTilingManager::LoadSo is [187439] micro seconds.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.837.458 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.837.499 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.837.526 [plugin_manager.cc:639]618662 GetConstantFoldingOpsPath:Enter GetConstantFoldingOpsPath schedule
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.837.526 [plugin_manager.cc:639]618674 GetConstantFoldingOpsPath:Enter GetConstantFoldingOpsPath schedule
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.837.545 [plugin_manager.cc:108]618674 GetOppPath:Enter get opp path schedule
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.837.546 [plugin_manager.cc:108]618662 GetOppPath:Enter get opp path schedule
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.837.555 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.837.574 [plugin_manager.cc:117]618674 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.837.574 [plugin_manager.cc:117]618662 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.837.621 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.837.643 [host_cpu_engine.cc:254]618674 LoadLib:To invoke dlopen on lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libconstant_folding_ops.so
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.837.643 [host_cpu_engine.cc:254]618662 LoadLib:To invoke dlopen on lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libconstant_folding_ops.so
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.837.650 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.837.754 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.837.814 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.837.851 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.837.939 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.837.957 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPool] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.838.057 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.838.066 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPool3D] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.838.168 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.838.174 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.838.270 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPoolV3] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.838.336 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.838.367 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.838.467 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaximumGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.838.492 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MinimumGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.838.522 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.838.592 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.838.642 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.838.699 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LogSoftmaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.838.726 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.838.747 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.838.770 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftMarginLoss] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.838.765 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.838.792 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.838.799 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.838.821 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftmaxFocalLoss] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.838.840 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.838.857 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.838.953 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.838.979 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Mish] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.838.991 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.839.080 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.839.112 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.839.177 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.839.238 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.839.279 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.839.381 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.839.419 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.839.479 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.839.549 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.839.588 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftmaxCrossEntropyWithLogits] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.839.686 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.839.708 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.839.726 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.839.800 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.839.841 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.839.903 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.839.967 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.840.002 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.840.090 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.840.104 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.840.121 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.840.231 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.840.253 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.840.284 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.840.332 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.840.352 [engine.cc:188] 618654 SubmitTaskNormal: stream_id=0,task_id=0,task_type=97 (STARS_VERSION).
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.840.399 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.840.430 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=0, head=0.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.840.441 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyAdadeltaD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.840.468 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.840.491 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyAdagradV2D] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.840.474 [task_info.cc:1596] 618654 ConstructSqeForStarsVersionTask: Send GetStarsVersionTask succ,sqe_type=3,pre_p=1,sqe->rt_streamID=32768,stream_id=0,task_id=0,task_type=97.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.840.514 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyAdaMaxD] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.840.510 [stream.cc:1400] 618654 AddTaskToList: public task, stream_id=0, task_id=0, task_type=97 (STARS_VERSION), head=0, tail=1
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.840.514 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.840.530 [stream.cc:2595] 618654 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=0, type=97(STARS_VERSION), head=0, tail=1, sqe_num=1, lastTail=0, device_id=2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.840.542 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyAdamD] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.840.546 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.840.576 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradD] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.840.580 [npu_driver.cc:751] 618654 SqTaskSend: device_id=2, ts_id=0, sq_id=0, sqe_num=1.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.840.598 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradV2] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.840.599 [stars_engine.cc:893] 618654 SendTask: Sq task send finished, device_id=2, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=0, task_type=97(STARS_VERSION).
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.840.621 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyAddSignD] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.840.621 [stars_engine.cc:1122] 618654 SyncTask: Task Wait: device_id=2, stream_id=0, task_id=0, logicCqId=997.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.840.645 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyCenteredRMSPropD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.840.666 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyFtrlD] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.840.663 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=0, head=0.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.840.670 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.840.682 [stars_engine.cc:1071] 618654 IsSyncTaskFinish: Sync task finished, sqHead=0 finishedTaskId=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.840.693 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyFtrlV2D] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.840.714 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyGradientDescent] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.840.713 [stars_engine.cc:1017] 618654 ProcReport: Get logic report: cnt=1, idx=0, stream_id=0, report task_id=0, sync task_id=0, sqeType=3, sqeHead=0, retCode=0x23, errType=0x20.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.840.735 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyKerasMomentumD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.840.757 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyMomentumD] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.840.746 [task.cc:185] 618654 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.840.765 [stars_engine.cc:1027] 618654 ProcReport: taskType=97.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.840.779 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyPowerSignD] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.840.786 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.840.795 [task.cc:185] 618654 GetTask: this stream no taskRes, stream_id=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.840.800 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyProximalAdagradD] register OP_IMPL : [InferShape]
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:41.840.810 [stars_engine.cc:1570] 618654 ProcLogicCqReport: CQE warning, device_id=2, stream_id=0, task_id=0, sqe_type=3(place holder), errType=0x20(sq sw status error), sqSwStatus=0x23
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.840.824 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyProximalGradientDescent] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.840.848 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyRMSPropD] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.840.845 [task.cc:185] 618654 GetTask: this stream no taskRes, stream_id=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.840.871 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyAdagradDAD] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.840.865 [logger.cc:152] 618654 TaskFinished: device_id=2, stream_id=0, task_id=0, task_type=97 (STARS_VERSION), task_finish_num=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.840.884 [task_info.cc:1614] 618654 DoCompleteSuccessForStarsVersionTask: Complete StarsVersionTask succ, retCode=35,tschVersion=35.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.840.899 [raw_device.cc:1305] 618654 SetTschVersion: Set tsch version=35.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.840.917 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : [Tiling][TilingParse]
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:41.840.940 [stars_engine.cc:1351] 618654 StarsResumeRtsq: Begin to query sq status, stream_id=0.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.840.967 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.840.961 [npu_driver.cc:5618] 618654 GetSqEnable: deviceId=2, tsId=0, sqId=0, enable=0.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:41.840.978 [stars_engine.cc:1365] 618654 StarsResumeRtsq: sq already disable, stream_id=0, queryCnt=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.840.993 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=0, head=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.841.009 [npu_driver.cc:5595] 618654 GetSqTail: deviceId=2, tsId=0, sqId=0, tail=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.841.026 [npu_driver.cc:5406] 618654 SetSqHead: deviceId=2, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.841.044 [npu_driver.cc:5357] 618654 EnableSq: deviceId=2, tsId=0, sqId=0.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:41.841.063 [stars_engine.cc:1430] 618654 StarsResumeRtsq: Resume stream_id=0, sq_id=0, sq_head=0, task_id=0, taskType=97, head=1.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.841.073 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FusedMulApplyMomentum] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.841.102 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FusedMulApplyKerasMomentum] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.841.083 [npu_driver.cc:5618] 618654 GetSqEnable: deviceId=2, tsId=0, sqId=0, enable=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.841.099 [stream.cc:1494] 618654 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.841.104 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.841.127 [raw_device.cc:1331] 618654 GetStarsVersion: send alloc get stars version task, stream_id=0, retCode:0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.841.142 [raw_device.cc:610] 618654 Start: Get TschVersion, tschVersion=35.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.841.204 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.841.227 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.841.304 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GeluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.841.406 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GeluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.841.432 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GridSampler2DGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.841.483 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.841.582 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IsNegInf] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.841.586 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GridSampler3DGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.841.686 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IsPosInf] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.841.764 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.841.791 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.841.877 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.841.953 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.841.977 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.842.071 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.842.143 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PadV4Grad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.842.168 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.842.267 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.842.335 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PadV3GradReplicate] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.842.370 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReluV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.842.464 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.842.477 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.842.495 [engine.cc:188] 618654 SubmitTaskNormal: stream_id=0,task_id=1,task_type=83 (DEVICE_RINGBUFFER_CONTROL).
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.842.548 [ringbuffer_maintain_task.cc:98] 618654 ConstructSqeForRingBufferMaintainTask: RingBufferMaintainTask stream_id=0, task_id=1, offset=0x52c0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.842.568 [stream.cc:1400] 618654 AddTaskToList: public task, stream_id=0, task_id=1, task_type=83 (DEVICE_RINGBUFFER_CONTROL), head=1, tail=2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.842.583 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.842.582 [stream.cc:2595] 618654 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=1, type=83(DEVICE_RINGBUFFER_CONTROL), head=1, tail=2, sqe_num=1, lastTail=1, device_id=2
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.842.593 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.842.605 [npu_driver.cc:751] 618654 SqTaskSend: device_id=2, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.842.622 [stars_engine.cc:893] 618654 SendTask: Sq task send finished, device_id=2, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=1, task_type=83(DEVICE_RINGBUFFER_CONTROL).
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.842.642 [stream.cc:1494] 618654 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.842.657 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=0, head=1.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.842.686 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Cummax] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.842.708 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.842.702 [stars_engine.cc:622] 618654 ProcLogicCqUntilEmpty: Task Wait: stream_id=0, logicCqId=997, retCode=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.842.722 [stream.cc:2886] 618654 StarsWaitForTask: No.0 stream_id=0, taskId=1, currentId=0
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.842.713 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.842.737 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.842.753 [stream.cc:2886] 618654 StarsWaitForTask: No.1 stream_id=0, taskId=1, currentId=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.842.766 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.842.780 [stream.cc:2886] 618654 StarsWaitForTask: No.2 stream_id=0, taskId=1, currentId=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.842.794 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=0, head=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.842.810 [task.cc:185] 618654 GetTask: this stream no taskRes, stream_id=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.842.803 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.842.825 [task.cc:185] 618654 GetTask: this stream no taskRes, stream_id=0
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.842.826 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.842.841 [logger.cc:152] 618654 TaskFinished: device_id=2, stream_id=0, task_id=1, task_type=83 (DEVICE_RINGBUFFER_CONTROL), task_finish_num=2
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.842.855 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.842.863 [stars_engine.cc:437] 618654 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=1, sqHead=2, endTaskId=1, recycleTaskId=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.842.878 [stream.cc:2886] 618654 StarsWaitForTask: No.3 stream_id=0, taskId=1, currentId=1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.842.904 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.842.949 [engine.cc:188] 618654 SubmitTaskNormal: stream_id=0,task_id=2,task_type=29 (ALLOC_DSA_ADDR).
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.842.971 [task_info.cc:111] 618654 ConstructSqeForAllocDsaAddrTask: Send AllocDsaAddrTask succ, sqe_type=3, pre_p=1, stream_id=0, task_id=2, task_type=29, dsa_sq_id=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.842.990 [stream.cc:1400] 618654 AddTaskToList: public task, stream_id=0, task_id=2, task_type=29 (ALLOC_DSA_ADDR), head=2, tail=3
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.843.006 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [InferShape][InputsDependency]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.843.016 [stream.cc:2595] 618654 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=2, type=29(ALLOC_DSA_ADDR), head=2, tail=3, sqe_num=1, lastTail=2, device_id=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.843.037 [npu_driver.cc:751] 618654 SqTaskSend: device_id=2, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.843.052 [stars_engine.cc:893] 618654 SendTask: Sq task send finished, device_id=2, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=2, task_type=29(ALLOC_DSA_ADDR).
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.843.053 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.843.070 [stars_engine.cc:1122] 618654 SyncTask: Task Wait: device_id=2, stream_id=0, task_id=2, logicCqId=997.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.843.109 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Col2ImV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.843.167 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.843.192 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=0, head=3.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.843.209 [stars_engine.cc:1071] 618654 IsSyncTaskFinish: Sync task finished, sqHead=3 finishedTaskId=2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.843.212 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.843.222 [stars_engine.cc:1017] 618654 ProcReport: Get logic report: cnt=1, idx=0, stream_id=0, report task_id=2, sync task_id=2, sqeType=3, sqeHead=2, retCode=0, errType=0.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.843.237 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.843.241 [task.cc:185] 618654 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.843.257 [stars_engine.cc:1027] 618654 ProcReport: taskType=29.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.843.269 [task.cc:185] 618654 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.843.284 [task.cc:185] 618654 GetTask: this stream no taskRes, stream_id=0
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.843.289 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.843.299 [logger.cc:152] 618654 TaskFinished: device_id=2, stream_id=0, task_id=2, task_type=29 (ALLOC_DSA_ADDR), task_finish_num=3
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.843.319 [npu_driver.cc:5618] 618654 GetSqEnable: deviceId=2, tsId=0, sqId=0, enable=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.843.335 [stream.cc:1494] 618654 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=2.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.843.331 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.843.350 [raw_device.cc:1232] 618654 TschStreamAllocDsaAddr: send alloc dsa sq task, stream_id=1, retCode:0
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:41.843.394 [atrace_api.c:40](tid:618654) AtraceCreate start.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.843.415 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.843.426 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.843.530 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.843.535 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.843.625 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.843.652 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.843.722 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.843.764 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.843.797 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.843.826 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2d] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.843.922 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.843.943 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.843.994 [host_cpu_engine.cc:273]618674 LoadLib:Lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libconstant_folding_ops.so has been opened
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.843.997 [host_cpu_engine.cc:273]618662 LoadLib:Lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libconstant_folding_ops.so has been opened
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.844.040 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.844.063 [host_cpu_engine.cc:254]618674 LoadLib:To invoke dlopen on lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libops_host_cpu.so
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.844.063 [host_cpu_engine.cc:254]618662 LoadLib:To invoke dlopen on lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libops_host_cpu.so
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.844.143 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.844.174 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.844.256 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.844.356 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.844.456 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaskedSelect] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:41.844.524 [trace_rb_log.c:45](tid:618654) init ring buffer time finished, realTime 1743643661843457429, monotonicTime 4163105410579, freq 99991 kHz, minutesWest 480 minutes
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:41.844.547 [trace_rb_log.c:137](tid:618654) [RUNTIME_ATRACE_DEV2_TS0] create ring buffer success, msgSize 128 bytes, msgTxtSize 112 bytes, bufferSize 1024 bytes, msg space 128 bytes, total space 131568 bytes
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.844.558 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : [InferShape]
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:41.844.570 [tracer_mgr_operate.c:66](tid:618654) create object RUNTIME_ATRACE_DEV2_TS0 success, exitSave(false), noLock(false).
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:41.844.589 [atrace_api.c:44](tid:618654) AtraceCreate end.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.844.581 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : [InferShape]
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:41.844.639 [trace_event.c:70](tid:618654) limitedNum 1, processType 0 
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:41.844.657 [trace_event.c:372](tid:618654) set trace event attr limitedNum: 1, processType: 0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.844.678 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.844.677 [runtime.cc:3159] 618654 SetTsdProfCallback: set tsd prof callback
[INFO] TDT(618654,python3.9):2025-04-03-09:27:41.844.696 [client_manager.cpp:196][SetProfilingCallback][tid:618654] [TsdClient] set profiling callback success
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.844.780 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.844.779 [runtime.cc:3364] 618654 PrimaryContextRetain: new Context ok, Runtime_alloc_size 424
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.844.817 [context.cc:109] 618654 Init: ObjAllocator alloc success, Runtime_alloc_size 160000(bytes)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.844.881 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [InferShape][InputsDependency]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.844.878 [context.cc:121] 618654 Init: ObjAllocator alloc success, Runtime_alloc_size 960000(bytes)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.844.894 [context.cc:276] 618654 Init: Runtime_alloc_size is 16000.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.844.980 [raw_device.cc:803] 618654 UpdateTimeoutConfig: No need to update timeout config.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.844.989 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:41.844.999 [npu_driver_dcache_lock.cpp:39] 618654 AllocAddrForDcache: halMemCtl failed, drvRet=65534, outSize=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.845.095 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.845.155 [raw_device.cc:528] 618654 AllocStackPhyBase: AllocStackPhyBase device_id=2, stackPhyBase32k_=0x12c140000000, stackPhySize=2457600.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.845.196 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.845.206 [raw_device.cc:232] 618654 LaunchDcacheLockOp: dcache lock has been set or stack addr is not for dcache, dCacheLockFlag_=0, stackAddrIsDcache_=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.845.237 [runtime.cc:3393] 618654 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.845.256 [runtime.cc:3560] 618654 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.845.273 [api_impl.cc:2987] 618654 NewDevice: SetCurRef = 0xaaaaf5082ff0,userDeviceId=2,deviceId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.845.290 [runtime.cc:5239] 618654 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.845.309 [api_impl.cc:2992] 618654 NewDevice: New device success, user_device_id=2, die_num=1.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.845.301 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : [InferShape]
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:41.845.334 [awatchdog_core.c:175](tid:618654) create watchdog for id : 65543, tid : 618654, timeout : 300s
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.845.352 [api_impl.cc:3025] 618654 SetDevice: SetDevice success, curCtx=0xaaaaf5082ff0, user_device_id=2.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.845.391 [acl.cpp:115]618654 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.845.409 [acl.cpp:121]618654 GetSocVersion: socVersion is Ascend910B3
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.845.401 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.845.460 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.845.500 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.845.600 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RNNTLoss] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.845.703 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MultinomialWithReplacement] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.845.798 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.845.819 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.845.924 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StatelessBernoulli] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.846.020 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.846.128 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.846.222 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.846.323 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UniqueConsecutive] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.846.424 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UniqueWithCountsAndSorting] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.846.582 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[WarpAffine] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.846.685 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Histogram] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.846.784 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.846.884 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.846.988 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Unique] register OP_IMPL : [InferShapeRange]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.847.092 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UniqueWithCounts] register OP_IMPL : [InferShapeRange]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.847.193 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Dot] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.847.289 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.847.384 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.847.484 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.847.505 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.847.606 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardReduce] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.847.707 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStatsWithCounts] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.847.807 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.847.832 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.847.851 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.847.872 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.847.892 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.847.912 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.847.938 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.847.958 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.847.946 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.847.978 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.848.071 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.848.094 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.848.113 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.848.152 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.848.215 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.848.322 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.848.391 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.848.422 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.848.518 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.848.504 [api_impl.cc:3476] 618654 GetDeviceInfo: get device info, deviceId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.848.549 [api_impl.cc:3476] 618654 GetDeviceInfo: get device info, deviceId=2
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.848.608 [device.cpp:133]618654 UpdatePlatformInfoWithDevice: Successfully to UpdatePlatformInfoWithDevice, deviceId = 2, aicCnt = 20, vecCoreCnt = 40, cubeCoreCnt = 20
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.848.622 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.848.632 [device.cpp:154]618654 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.848.647 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.848.656 [context.cpp:87]618654 aclrtGetCurrentContext: start to execute aclrtGetCurrentContext
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.848.667 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [InferShape][InferDataType]
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.848.676 [context.cpp:98]618654 aclrtGetCurrentContext: successfully execute aclrtGetCurrentContext
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.848.706 [stream.cpp:48]618654 aclrtCreateStreamWithConfig: start to execute aclrtCreateStreamWithConfig with priority:0, flag:3
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.848.710 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.848.747 [api_impl.cc:1120] 618654 StreamCreate: priority=0, flags=1536.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.848.760 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.848.802 [npu_driver.cc:404] 618654 StreamIdAlloc: stream id alloc begin, device_id=2, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.848.841 [stream.cc:2246] 618654 AllocExecutedTimesSvm: stream_id=2.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.848.861 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.848.884 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.848.880 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.848.886 [stream_sqcq_manage.cc:147] 618654 Alloc: deviceId=2, tsId=0, drvFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.848.905 [npu_driver.cc:882] 618654 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.848.985 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.849.039 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.849.081 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.849.185 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.849.177 [npu_driver.cc:6125] 618654 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.849.234 [npu_driver.cc:6137] 618654 LogicCqAllocateV2: success: deviceId=2, tsId=0, cqId=998, streamId=2, logicCq=998, cqeDepth=4096
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.849.260 [npu_driver.cc:6189] 618654 StreamBindLogicCq: success: deviceId=2, tsId=0, streamId=2, logicCq=998.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.849.286 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.849.279 [npu_driver.cc:5916] 618654 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=d0119000, addr=dfffd0119000size=4096
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.849.297 [stream.cc:653] 618654 Setup: Success to get sq=2 sq reg virtual addr length=4096.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.849.310 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.849.332 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.849.353 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [InferShape][InferDataType]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.849.355 [devmm_svm.c:1972][ascend][curpid:618654,618654][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.849.377 [npu_driver.cc:6080] 618654 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.849.460 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.849.484 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.849.505 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.849.593 [stream.cc:291] 618654 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=2, flags_=0x600.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.849.603 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.849.627 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.849.646 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.849.747 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.849.770 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.849.788 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.849.808 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.849.875 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.849.906 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.850.003 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.850.056 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.850.100 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.850.121 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.850.139 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.850.185 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.850.237 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.850.261 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.850.340 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyAdamWV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.850.326 [host_cpu_engine.cc:267]618662 LoadLib:Invoke function Initialize in lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libops_host_cpu.so
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.850.326 [host_cpu_engine.cc:267]618674 LoadLib:Invoke function Initialize in lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libops_host_cpu.so
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.850.357 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.850.456 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.850.498 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.850.551 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.850.574 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.850.598 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.850.640 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.850.691 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.850.714 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.850.733 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.850.800 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.850.827 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.850.925 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.850.963 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.851.026 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.851.121 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.851.113 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [Tiling][TilingParse]
[INFO] OP(618674,python3.9):2025-04-03-09:27:41.851.162 [host_cpu_kernel_wrapper.cpp:88][OP_PROTO][Initialize][618674] OpName:[HostCpuKernelWrapperOp] "Host cpu dlopen so[/usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libaicpu_const_folding.so] success"
[INFO] OP(618662,python3.9):2025-04-03-09:27:41.851.162 [host_cpu_kernel_wrapper.cpp:88][OP_PROTO][Initialize][618662] OpName:[HostCpuKernelWrapperOp] "Host cpu dlopen so[/usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libaicpu_const_folding.so] success"
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.193 [folding.cc:404][InitCpuConstantFoldingNew][tid:618662]:"Init cpu constant folding begin."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.193 [folding.cc:404][InitCpuConstantFoldingNew][tid:618674]:"Init cpu constant folding begin."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.851.222 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.238 [folding.cc:408][InitCpuConstantFoldingNew][tid:618674]:"Number of registered ops: 234"
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.256 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Acos]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.261 [folding.cc:408][InitCpuConstantFoldingNew][tid:618662]:"Number of registered ops: 234"
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.280 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Acos]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.851.262 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.274 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Acosh]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.291 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[ActiveRotatedFilter]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.298 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Acosh]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.306 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[ActiveRotatedFilterGrad]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.315 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[ActiveRotatedFilter]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.851.321 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.322 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[AdaptiveAvgPool2dAssistMatrix]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.330 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[ActiveRotatedFilterGrad]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.340 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[AdaptiveAvgPoolAssistMatrix]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.346 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[AdaptiveAvgPool2dAssistMatrix]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.356 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[AdaptiveMaxPool2d]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.372 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Add]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.361 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[AdaptiveAvgPoolAssistMatrix]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.378 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[AdaptiveMaxPool2d]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.386 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Addcdiv]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.851.385 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.400 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Addcmul]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.392 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Add]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.414 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[AffineGrid]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.426 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Addcdiv]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.851.419 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.428 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[ApplyAdamV2]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.443 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Addcmul]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.459 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[AffineGrid]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.457 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Asin]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.475 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[ApplyAdamV2]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.472 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Asinh]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.488 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Assert]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.490 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Asin]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.503 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Atan]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.851.490 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.503 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Asinh]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.520 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Assert]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.518 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Atan2]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.851.522 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.533 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Atanh]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.534 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Atan]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.551 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Atan2]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.551 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[AvgPoolV2]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.567 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Betainc]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.566 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Atanh]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.584 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[AvgPoolV2]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.582 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Bucketize]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.597 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[CTCLossV2]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.599 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Betainc]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.613 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[CTCLossV2Grad]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.614 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Bucketize]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.630 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[CTCLossV2]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.851.627 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2dAssistMatrix] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.631 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[CacheSwapTable]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.646 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[CalcBucketsLimitAndOffset]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.646 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[CTCLossV2Grad]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.664 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[CacheSwapTable]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.662 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[CaseCondition]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.680 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Cast]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.679 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[CalcBucketsLimitAndOffset]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.695 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[CaseCondition]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.696 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Ceil]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.710 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Cast]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.713 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[CheckNumerics]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.726 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Ceil]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.851.728 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : [InferShape]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.731 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[ClipByValue]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.740 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[CheckNumerics]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.748 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[ClipByValueV2]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.756 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[ClipByValue]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.770 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[ClipByValueV2]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.765 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Combinations]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.782 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[CompareAndBitpack]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.796 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[ComputeAccidentalHits]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.784 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Combinations]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.799 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[CompareAndBitpack]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.851.800 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.811 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[ConcatV2]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.814 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[ComputeAccidentalHits]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.829 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[ConcatV2]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.827 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Conj]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.851.832 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.851.834 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.841 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[ConjugateTranspose]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.857 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Coordinates1DTo2D]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.844 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Conj]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.859 [f[INFO] GE(618650,python3.9):2025-04-03-09:27:41.851.865 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.872 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Cosh]."
olding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[ConjugateTranspose]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.888 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[CropAndResize]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.888 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Coordinates1DTo2D]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.903 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Cosh]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.851.894 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.902 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Cross]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.927 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Cummax]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.917 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[CropAndResize]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.851.922 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.851.928 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : [InferShape]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.933 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Cross]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.942 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Cummin]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.952 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Cummax]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.851.950 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.959 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Cumsum]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.969 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Cummin]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.974 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Div]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.851.978 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.851.988 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[DynamicStitch]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.001 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[EditDistance]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.851.985 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Cumsum]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.004 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Div]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.007 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.016 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Elu]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.019 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[DynamicStitch]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.032 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[EluGrad]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.852.032 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.034 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.036 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[EditDistance]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.047 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[EmbeddingApplyAdaGrad]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.056 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Elu]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.063 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[EmbeddingApplyAdam]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.063 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.071 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[EluGrad]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.080 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[EmbeddingApplyAdamW]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.088 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[EmbeddingApplyAdaGrad]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.094 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[EmbeddingApplyFtrl]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.092 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.102 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[EmbeddingApplyAdam]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.111 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[EmbeddingApplyRmsprop]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.125 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[EmbeddingApplySgd]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.120 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[EmbeddingApplyAdamW]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.852.136 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Cdist] register OP_IMPL : [InferShape]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.136 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[EmbeddingApplyFtrl]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.121 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.140 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[EmbeddingComputeVarExport]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.176 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[EmbeddingApplyRmsprop]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.172 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[EmbeddingComputeVarImport]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.197 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[EmbeddingFeatureMappingExport]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.198 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[EmbeddingApplySgd]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.210 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[EmbeddingFeatureMappingFileSize]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.212 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[EmbeddingComputeVarExport]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.205 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.225 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[EmbeddingFeatureMappingImport]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.228 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[EmbeddingComputeVarImport]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.243 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[EmbeddingFeatureMappingExport]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.242 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[EmbeddingHashmapExport]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.241 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.852.248 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CdistGrad] register OP_IMPL : [InferShape]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.257 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[EmbeddingFeatureMappingFileSize]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.259 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[EmbeddingHashmapFileSize]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.270 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.277 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[EmbeddingHashmapImport]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.275 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[EmbeddingFeatureMappingImport]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.292 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[EmbeddingLookup]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.306 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[EmbeddingTableEvict]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.295 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[EmbeddingHashmapExport]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.310 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[EmbeddingHashmapFileSize]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.299 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.321 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[EmbeddingHashmapImport]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.320 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[EmbeddingTableExport]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.336 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[EmbeddingTableFind]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.327 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.335 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[EmbeddingLookup]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.852.348 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.356 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.350 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[EmbeddingTableFindAndInit]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.376 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[EmbeddingTableImport]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.353 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[EmbeddingTableEvict]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.379 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[EmbeddingTableExport]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.852.372 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : [InferShape]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.394 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[EmbeddingTableFind]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.384 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.852.393 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : [InferShape]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.392 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Equal]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.410 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Expand]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.409 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[EmbeddingTableFindAndInit]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.412 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.427 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[EmbeddingTableImport]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.424 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[ExpandDims]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.441 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Equal]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.454 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Expand]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.441 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.440 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Exponential]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.454 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[ExponentialDecayLR]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.467 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Fill]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.467 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[ExpandDims]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.480 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[FillDiagonal]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.467 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.483 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Exponential]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.495 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Fills]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.852.492 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : [InferShape]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.510 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Floor]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.494 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.497 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[ExponentialDecayLR]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.525 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[FloorDiv]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.852.523 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : [InferShape]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.515 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Fill]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.529 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[FillDiagonal]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.542 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Fills]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.527 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.540 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[FloorMod]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.852.543 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : [InferShape]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.556 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[GEMM]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.574 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[GatherElements]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.556 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Floor]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.575 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[FloorDiv]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.556 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.589 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[FloorMod]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.588 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[GatherV2]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.602 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[GEMM]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.588 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.604 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Geometric]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.617 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[GetDynamicDims]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.616 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.619 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[GatherElements]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.638 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[GatherV2]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.634 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Greater]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.652 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Geometric]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.852.645 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.644 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.651 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[GreaterEqual]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.667 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[GetDynamicDims]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.669 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[GridSampler2D]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.686 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[GridSampler2DGrad]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.673 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.852.641 [stream.cc:688] 618654 Setup: stream setup end, stream_id=2, IsTaskSink=0, sqId=2, cqId=2, deviceId=2, streamResId=65535
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:41.852.682 [stream_state_callback_manager.cc:45] 618654 Notify: not reg stream state callback func!
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.685 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Greater]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.703 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[GreaterEqual]."
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.852.702 [api_impl.cc:1162] 618654 StreamCreate: Succ, flags=1536, stream_id=2, context=aaaaf5082ff0
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.702 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[GridSampler3D]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.719 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[GridSampler3DGrad]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.699 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.719 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[GridSampler2D]."
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.852.724 [stream.cpp:189]618654 aclrtSetStreamFailureMode: start to execute aclrtSetStreamFailureMode, mode is 1
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.734 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Histogram]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.731 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.736 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[GridSampler2DGrad]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.750 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[GridSampler3D]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.749 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[IMGWarpOffsets]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.852.748 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.755 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.766 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[GridSampler3DGrad]."
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.852.748 [stream.cc:3161] 618654 SetFailMode: stream_id=2 is updated from CONTINUE to STOP.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.852.770 [stream.cpp:195]618654 aclrtSetStreamFailureMode: successfully execute aclrtSetStreamFailureMode, mode is 1
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.764 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Identity]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.779 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Histogram]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.780 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[IndexToAddr]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.795 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[InitEmbeddingHashmap]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.782 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.797 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[IMGWarpOffsets]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.809 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.823 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Identity]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.809 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[InitPartitionMap]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.833 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[InplaceIndexAdd]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.836 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[IndexToAddr]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.852.848 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.848 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[InplaceTopKDistance]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.851 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[InitEmbeddingHashmap]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.836 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.852.829 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:105] RegCallback] Register callback thread, stream : 0xaaaaf60d2940.
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.864 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[InvGrad]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.879 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[InvertPermutation]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.871 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[InitPartitionMap]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.885 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[InplaceIndexAdd]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.880 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.852.887 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:377] CreateDefaultStream] Create ascend default stream, stream id: 0
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.891 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[IsClose]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.901 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[InplaceTopKDistance]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.905 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[IsInf]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.904 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.914 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[InvGrad]."
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.852.902 [stream.cpp:48]618654 aclrtCreateStreamWithConfig: start to execute aclrtCreateStreamWithConfig with priority:0, flag:3
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.922 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[IsNan]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.938 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Less]."
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.852.927 [api_impl.cc:1120] 618654 StreamCreate: priority=0, flags=1536.
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.928 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[InvertPermutation]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.932 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.947 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[IsClose]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.852.949 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GlobalLpPool] register OP_IMPL : [InferShape]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.953 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[LinSpace]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.970 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[LinearSumAssignment]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.961 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[IsInf]."
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.852.962 [npu_driver.cc:404] 618654 StreamIdAlloc: stream id alloc begin, device_id=2, priority=0, ts_id=0, remote_stream_id=0
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.965 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.978 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[IsNan]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.852.996 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Less]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.852.985 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Log]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.001 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Log1p]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.852.994 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.852.998 [stream.cc:2246] 618654 AllocExecutedTimesSvm: stream_id=3.
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.013 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[LinSpace]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.016 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[LogMatrixDeterminant]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.029 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[LinearSumAssignment]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.853.026 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.033 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[LogSoftmaxV2]."
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.853.039 [stream_sqcq_manage.cc:147] 618654 Alloc: deviceId=2, tsId=0, drvFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.853.057 [npu_driver.cc:882] 618654 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.047 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[LogUniformCandidateSampler]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.060 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[MaskedFill]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.044 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Log]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.061 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Log1p]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.853.053 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GLU] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.853.052 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.078 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[LogMatrixDeterminant]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.076 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[MaskedScatter]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.091 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[MaskedSelect]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.091 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[LogSoftmaxV2]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.853.081 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.106 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[LogUniformCandidateSampler]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.105 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[MaskedSelectGrad]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.853.108 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.120 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[MaskedFill]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.120 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[MatMul]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.135 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[MatrixDiagPartV3]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.137 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[MaskedScatter]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.150 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[MatrixDiagV3]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.853.136 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.853.154 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GLUGrad] register OP_IMPL : [InferShape]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.151 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[MaskedSelect]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.168 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[MaskedSelectGrad]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.182 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[MatMul]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.853.165 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.166 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[MinAreaPolygons]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.183 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Mul]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.197 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[MultinomialAliasDraw]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.853.194 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.197 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[MatrixDiagPartV3]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.212 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[MultinomialAliasSetup]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.214 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[MatrixDiagV3]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.853.223 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.230 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[MinAreaPolygons]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.228 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[MultinomialWithReplacement]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.244 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Mul]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.853.249 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.853.245 [npu_driver.cc:6125] 618654 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.853.258 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : [InferShape]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.244 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[NLLLoss]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.269 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[NLLLossGrad]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.257 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[MultinomialAliasDraw]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.281 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[MultinomialAliasSetup]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.853.276 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.285 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[NMSWithMask]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.298 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Neg]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.297 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[MultinomialWithReplacement]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.314 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[NLLLoss]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.853.304 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.313 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[NonMaxSuppressionV3]."
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.853.307 [npu_driver.cc:6137] 618654 LogicCqAllocateV2: success: deviceId=2, tsId=0, cqId=999, streamId=3, logicCq=999, cqeDepth=4096
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.328 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[NLLLossGrad]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.329 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[NonZero]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.853.332 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.347 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[NonZeroWithValueShape]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.346 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[NMSWithMask]."
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.853.345 [npu_driver.cc:6189] 618654 StreamBindLogicCq: success: deviceId=2, tsId=0, streamId=3, logicCq=999.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.853.357 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : [InferShape]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.365 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Neg]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.853.359 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.364 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[NonZeroWithValueShapeV2]."
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.853.366 [npu_driver.cc:5916] 618654 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=d00f8000, addr=dfffd00f8000size=4096
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.380 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[NonMaxSuppressionV3]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.382 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[NotEqual]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.396 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[OnesLike]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.853.387 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.853.382 [stream.cc:653] 618654 Setup: Success to get sq=3 sq reg virtual addr length=4096.
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.397 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[NonZero]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.410 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[PSAMask]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.853.411 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.411 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[NonZeroWithValueShape]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.424 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[NonZeroWithValueShapeV2]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.423 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[PSAMaskGrad]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.437 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[NotEqual]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.438 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Pad]."
[INFO] DRV(618654,python3.9):2025-04-03-09:27:41.853.432 [devmm_svm.c:1972][ascend][curpid:618654,618654][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.853.452 [npu_driver.cc:6080] 618654 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.453 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[OnesLike]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.853.439 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.853.456 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LpLoss] register OP_IMPL : [InferShape]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.452 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[PadD]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.471 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[PadV3]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.469 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[PSAMask]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.487 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[PSAMaskGrad]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.485 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[PadV3Grad]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.500 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Pinverse]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.501 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Pad]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.517 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[PadD]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.515 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Poisson]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.531 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Pow]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.531 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[PadV3]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.547 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[PadV3Grad]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.545 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[ProdEnvMatACalcRij]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.561 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[RNNTLoss]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.853.560 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LpNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.561 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Pinverse]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.575 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[RandomStandardNormal]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.589 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[RandomUniform]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.853.586 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.578 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Poisson]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.591 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Pow]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.603 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[RealDiv]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.603 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[ProdEnvMatACalcRij]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.853.607 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.618 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[RNNTLoss]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.853.626 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.617 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[ReduceAll]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.634 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[ReduceMean]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.853.615 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachACosInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.636 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[RandomStandardNormal]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.649 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[ReduceSum]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.649 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[RandomUniform]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.663 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Reshape]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.664 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[RealDiv]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.680 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[ReduceAll]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.678 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Resize]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.693 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[ReduceMean]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.715 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[ReduceSum]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.693 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[ResizeBilinear]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.723 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[ResizeBilinearGrad]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.728 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Reshape]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.743 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Resize]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.738 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[ResizeBilinearV2Grad]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.754 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[ResizeGrad]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.756 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[ResizeBilinear]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.771 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[ResizeTrilinear]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.772 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[ResizeBilinearGrad]."
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.853.778 [stream.cc:291] 618654 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=3, flags_=0x600.
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.784 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[ReverseSequence]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.800 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[RightShift]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.787 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[ResizeBilinearV2Grad]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.816 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[RoiPoolingWithArgMax]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.853.783 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.805 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[ResizeGrad]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.820 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[ResizeTrilinear]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.832 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[ReverseSequence]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.830 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[RotatedNMS]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.845 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[RightShift]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.845 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Round]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.853.850 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MinAreaPolygons] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.861 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[RoiPoolingWithArgMax]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.861 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Rsqrt]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.880 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[STFT]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.878 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[RotatedNMS]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.895 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Round]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.895 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[ScatterAddWithAxis]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.910 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Rsqrt]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.910 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[ScatterElements]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.926 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[STFT]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.927 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[ScatterNdAdd]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.940 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[ScatterNdMax]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.940 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[ScatterAddWithAxis]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.955 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[ScatterElements]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.954 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[ScatterNdMin]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.967 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[SearchSorted]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.853.958 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.969 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[ScatterNdAdd]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.984 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[ScatterNdMax]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.981 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[SelectV2]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.853.979 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMulScalarInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.853.997 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Sigmoid]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.853.999 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[ScatterNdMin]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.015 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[SearchSorted]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.013 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[SigmoidGrad]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.854.013 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachLogInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.028 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Sign]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.030 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[SelectV2]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.046 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Sigmoid]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.043 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[SilentCheck]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.854.043 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSubListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.061 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[SilentCheckV2]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.062 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[SigmoidGrad]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.854.069 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.854.073 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMulListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.078 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Sign]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.076 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[SilentCheckV3]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.094 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[SliceWrite]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.092 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[SilentCheck]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.108 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[SoftmaxV2]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.854.100 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachDivListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.108 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[SilentCheckV2]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.122 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Sort]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.123 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[SilentCheckV3]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.137 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[SparseFillEmptyRows]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.137 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[SliceWrite]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.160 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[SoftmaxV2]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.150 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[SparseSegmentMean]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.171 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[SparseSegmentMeanGrad]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.854.164 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.173 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Sort]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.186 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[SparseSegmentSum]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.189 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[SparseFillEmptyRows]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.202 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[SparseToDense]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.206 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[SparseSegmentMean]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.219 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[SpatialTransformer]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.224 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[SparseSegmentMeanGrad]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.232 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[SplitD]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.238 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[SparseSegmentSum]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.248 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[SplitV]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.255 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[SparseToDense]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.854.263 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.854.251 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSubScalarInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.262 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Sqrt]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.277 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[SqrtGrad]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.272 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[SpatialTransformer]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.293 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Square]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.290 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[SplitD]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.305 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[SquaredDifference]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.306 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[SplitV]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.322 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Sqrt]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.320 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[StatelessBernoulli]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.335 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[StatelessRandomUniformV2]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.336 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[SqrtGrad]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.352 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Square]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.350 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[StatelessRandperm]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.366 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[StridedSlice]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.854.365 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.366 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[SquaredDifference]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.385 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[StatelessBernoulli]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.854.370 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.381 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[StridedSliceV2]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.399 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Sub]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.399 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[StatelessRandomUniformV2]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.416 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[StatelessRandperm]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.417 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[TableToResource]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.433 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Tan]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.432 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[StridedSlice]."
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.854.426 [stream.cc:688] 618654 Setup: stream setup end, stream_id=3, IsTaskSink=0, sqId=3, cqId=3, deviceId=2, streamResId=0
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:41.854.450 [stream_state_callback_manager.cc:45] 618654 Notify: not reg stream state callback func!
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.447 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[TanhGrad]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.450 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[StridedSliceV2]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.463 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[TensorEqual]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.854.469 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.468 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Sub]."
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.854.467 [api_impl.cc:1162] 618654 StreamCreate: Succ, flags=1536, stream_id=3, context=aaaaf5082ff0
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.485 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[TableToResource]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.480 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[TensorScatterUpdate]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.497 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[ThreeNN]."
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.854.487 [stream.cpp:189]618654 aclrtSetStreamFailureMode: start to execute aclrtSetStreamFailureMode, mode is 1
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.854.486 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.500 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Tan]."
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.854.506 [stream.cc:3161] 618654 SetFailMode: stream_id=3 is updated from CONTINUE to STOP.
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.517 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[TanhGrad]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.513 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Tile]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.530 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[TileWithAxis]."
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.854.520 [stream.cpp:195]618654 aclrtSetStreamFailureMode: successfully execute aclrtSetStreamFailureMode, mode is 1
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.532 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[TensorEqual]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.548 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[TensorScatterUpdate]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.546 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[TopK]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.561 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[TopKPQDistance]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.562 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[ThreeNN]."
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.854.557 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:105] RegCallback] Register callback thread, stream : 0xaaaaf6202300.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.854.567 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.579 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Tile]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.576 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[TopKPQDistanceV2]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.592 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[TopKV2D]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.617 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Trace]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.593 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[TileWithAxis]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.617 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[TopK]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.854.605 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.632 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[TopKPQDistance]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.634 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[TransData]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.647 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[TopKPQDistanceV2]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.662 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[TopKV2D]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.651 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[TransDataRNN]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.667 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Tril]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.854.665 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.676 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Trace]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.685 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Triu]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.702 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[UniformCandidateSampler]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.695 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[TransData]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.713 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[TransDataRNN]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.716 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[UninitEmbeddingHashmap]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.730 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[UninitPartitionMap]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.854.726 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.729 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Tril]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.748 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Triu]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.746 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[UniqueConsecutive]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.764 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[UniqueWithCountsAndSorting]."
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.854.755 [callback.cpp:25]618654 aclrtSubscribeReport: start to execute aclrtSubscribeReport, threadId is 281471067484064.
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.762 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[UniformCandidateSampler]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.854.773 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.780 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[UninitEmbeddingHashmap]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.795 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[UninitPartitionMap]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.779 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[UniqueWithCountsExt2]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.796 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[UpsampleNearest3d]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.809 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[UpsampleNearest3dGrad]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.810 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[UniqueConsecutive]."
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.854.807 [npu_driver.cc:462] 618654 EventIdAlloc: event id alloc begin, device_id=2, ts_id=0, remote_event_id=0
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.854.817 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.823 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[UpsampleTrilinear3d]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.829 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[UniqueWithCountsAndSorting]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.839 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[UpsampleTrilinear3dGrad]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.854.840 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.848 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[UniqueWithCountsExt2]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.853 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[ViewCopy]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.864 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[UpsampleNearest3d]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.867 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Voxelization]."
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:41.854.857 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.854.873 [npu_driver.cc:483] 618654 EventIdAlloc: Event id alloc success, device_id=2, ts_id=0, event_id=0, eventFlag=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.854.873 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : [InferShape]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.878 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[UpsampleNearest3dGrad]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.881 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[WarpAffine]."
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:41.854.884 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.896 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[UpsampleTrilinear3d]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.897 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[ZerosLike]."
[INFO] AICPU(618674,python3.9):2025-04-03-09:27:41.854.912 [folding.cc:413][InitCpuConstantFoldingNew][tid:618674]:"Register op[Zeta]."
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.854.898 [event.cc:347] 618654 GenEventId: Event id alloc success, device_id=2, tsId=0, eventFlag=1, event_id=0
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.910 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[UpsampleTrilinear3dGrad]."
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.854.924 [subscribe.cc:54] 618654 AssignGroupId: give groupId=320
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.854.943 [npu_driver.cc:3775] 618654 SqCqAllocate: deviceId=2, tsId=0, groupId=320.
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.928 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[ViewCopy]."
[INFO] OP(618674,python3.9):2025-04-03-09:27:41.854.932 [host_cpu_kernel_wrapper.cpp:118][OP_PROTO][Initialize][618674] OpName:[HostCpuKernelWrapperOp] "Host cpu init success"
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.946 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Voxelization]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.963 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[WarpAffine]."
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.854.948 [host_cpu_engine.cc:273]618674 LoadLib:Lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libops_host_cpu.so has been opened
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.854.975 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : [InferShape]
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.976 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[ZerosLike]."
[INFO] AICPU(618662,python3.9):2025-04-03-09:27:41.854.994 [folding.cc:413][InitCpuConstantFoldingNew][tid:618662]:"Register op[Zeta]."
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.854.977 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.855.002 [npu_driver.cc:3785] 618654 SqCqAllocate: alloc success, deviceId=2 sqId=456, cqId=456.
[INFO] OP(618662,python3.9):2025-04-03-09:27:41.855.013 [host_cpu_kernel_wrapper.cpp:118][OP_PROTO][Initialize][618662] OpName:[HostCpuKernelWrapperOp] "Host cpu init success"
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.855.030 [host_cpu_engine.cc:273]618662 LoadLib:Lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libops_host_cpu.so has been opened
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.855.013 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.855.027 [subscribe.cc:131] 618654 Insert: callback subscribe: groupId=320, threadId=281471067484064, devId=2, tsId=0, streamId=2, sqId=456, cqId=456
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.855.035 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.855.060 [callback.cpp:31]618654 aclrtSubscribeReport: successfully execute aclrtSubscribeReport, threadId is 281471067484064.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.855.078 [npu_driver.cc:3828] 618832 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=320.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.855.078 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.855.096 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:125] RegCallback] Register callback thread success, stream : 0xaaaaf60d2940.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.855.086 [plugin_manager.cc:872]618674 LoadWithFlags:Dlopen path: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/plugin/engines/runtime/libdvpp_rtkernel.so. flags is 4354
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.855.122 [plugin_manager.cc:872]618662 LoadWithFlags:Dlopen path: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/plugin/engines/runtime/libdvpp_rtkernel.so. flags is 4354
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.855.141 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.855.177 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.855.198 [callback.cpp:25]618654 aclrtSubscribeReport: start to execute aclrtSubscribeReport, threadId is 281471059029920.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.855.222 [npu_driver.cc:462] 618654 EventIdAlloc: event id alloc begin, device_id=2, ts_id=0, remote_event_id=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.855.241 [npu_driver.cc:483] 618654 EventIdAlloc: Event id alloc success, device_id=2, ts_id=0, event_id=1, eventFlag=0
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.855.245 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.855.258 [event.cc:347] 618654 GenEventId: Event id alloc success, device_id=2, tsId=0, eventFlag=1, event_id=1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.855.275 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.855.296 [subscribe.cc:54] 618654 AssignGroupId: give groupId=321
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:41.855.293 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.855.307 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.855.314 [npu_driver.cc:3775] 618654 SqCqAllocate: deviceId=2, tsId=0, groupId=321.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:41.855.332 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.855.348 [npu_driver.cc:3785] 618654 SqCqAllocate: alloc success, deviceId=2 sqId=457, cqId=457.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.855.356 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.855.384 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.855.374 [subscribe.cc:131] 618654 Insert: callback subscribe: groupId=321, threadId=281471059029920, devId=2, tsId=0, streamId=3, sqId=457, cqId=457
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.855.378 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.855.396 [callback.cpp:31]618654 aclrtSubscribeReport: successfully execute aclrtSubscribeReport, threadId is 281471059029920.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.855.410 [npu_driver.cc:3828] 618833 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=321.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.855.427 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:125] RegCallback] Register callback thread success, stream : 0xaaaaf6202300.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.855.438 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : [Tiling][TilingParse]
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.855.454 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:386] CreateDefaultStream] Create ascend communication stream, stream id: 1
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.855.480 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [InferShape][InferDataType]
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.855.554 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:110] Initialize] Config huge_page_reserve_size : 0, device_hbm_huge_page_reserved_size_ : 0
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.855.563 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.855.584 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.855.593 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.855.623 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.855.686 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.855.749 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.855.783 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.855.780 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.855.807 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.855.882 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.855.891 [npu_driver.cc:2616] 618654 MemGetInfoEx: memory info type=1, type=2, free=8857341952, hug_free=56245616640
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.855.924 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.855.983 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.855.980 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:60] AscendVmmAdapter] VMM align size is 2097152
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.856.072 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:158] CheckVmmDriverVersion] Driver path is /usr/local/Ascend
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.856.085 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.856.088 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.856.122 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:187] CheckVmmDriverVersion] Driver version is 25.0.rc1.b070, major version is 25
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.856.150 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:113] IsVmmEnabled] VMM is enabled.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.856.184 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:180] Initialize] Device MOC Size:62420M, Device free MOC Size:62087M, Reserved MOC size for Other Components(HCCL/rts/etc.):3891M, Recommend Reserved MOC size for Other Components:3880M, User define MindSpore MOC Size:0G, MindSpore Used MOC Size:58196M.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.856.192 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [InferShape][InferDataType]
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.856.214 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_dynamic_mem_adapter.cc:57] Initialize] Ascend Memory Adapter initialize success, Memory Statistics:
Device MOC memory size: 62420M
MindSpore Used memory size: 58196M
Used peak memory usage (without fragments): 0M
Actual peak memory usage (with fragments): 0M

[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.856.246 [event.cpp:260]618654 aclrtSetOpWaitTimeout: start to execute aclrtSetOpWaitTimeout, timeout = 1980s
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.856.272 [api_impl.cc:5713] 618654 SetOpWaitTimeOut: set OP wait timeout:1980.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.856.292 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.856.302 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.856.393 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.856.414 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.856.463 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.856.518 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotatedNMS] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.856.587 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.856.617 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.856.721 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.856.782 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IndexPutWithSort] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.856.904 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.856.926 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SilentCheck] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.857.041 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.857.117 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InplaceIndexAddWithSorted] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.857.149 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.857.240 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.857.252 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3d] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.857.356 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.354 [engine.cc:188] 618654 SubmitTaskNormal: stream_id=0,task_id=3,task_type=86 (TASK_TIMEOUT_SET).
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.857.361 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.380 [timeout_set_task.cc:115] 618654 ConstructSqeForTimeoutSetTask: TaskTimeoutSetTask ConstructSqe finish,topic_type=0,cmd_type=13
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.857.391 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.398 [stream.cc:1400] 618654 AddTaskToList: public task, stream_id=0, task_id=3, task_type=86 (TASK_TIMEOUT_SET), head=3, tail=4
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.415 [stream.cc:2595] 618654 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=3, type=86(TASK_TIMEOUT_SET), head=3, tail=4, sqe_num=1, lastTail=3, device_id=2
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.857.419 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.435 [npu_driver.cc:751] 618654 SqTaskSend: device_id=2, ts_id=0, sq_id=0, sqe_num=1.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.857.451 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.451 [stars_engine.cc:893] 618654 SendTask: Sq task send finished, device_id=2, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=3, task_type=86(TASK_TIMEOUT_SET).
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.471 [stream.cc:1494] 618654 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=3.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.487 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=0, head=3.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.528 [stars_engine.cc:622] 618654 ProcLogicCqUntilEmpty: Task Wait: stream_id=0, logicCqId=997, retCode=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.547 [stream.cc:2886] 618654 StarsWaitForTask: No.0 stream_id=0, taskId=3, currentId=2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.857.550 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ActiveRotatedFilter] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.562 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=0, head=3.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.579 [stream.cc:2886] 618654 StarsWaitForTask: No.1 stream_id=0, taskId=3, currentId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.593 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=0, head=3.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.857.593 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.607 [stream.cc:2886] 618654 StarsWaitForTask: No.2 stream_id=0, taskId=3, currentId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.635 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.649 [task.cc:185] 618654 GetTask: this stream no taskRes, stream_id=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.857.652 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ActiveRotatedFilterGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.663 [task.cc:185] 618654 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.681 [logger.cc:152] 618654 TaskFinished: device_id=2, stream_id=0, task_id=3, task_type=86 (TASK_TIMEOUT_SET), task_finish_num=4
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.702 [stars_engine.cc:437] 618654 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=3, sqHead=4, endTaskId=3, recycleTaskId=3.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.719 [stream.cc:2886] 618654 StarsWaitForTask: No.3 stream_id=0, taskId=3, currentId=3
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.857.733 [event.cpp:262]618654 aclrtSetOpWaitTimeout: successfully execute aclrtSetOpWaitTimeout, timeout = 1980s
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.857.749 [event.cpp:269]618654 aclrtSetOpExecuteTimeOut: start to execute aclrtSetOpExecuteTimeOut, timeout = 900s
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.857.754 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.768 [engine.cc:188] 618654 SubmitTaskNormal: stream_id=0,task_id=4,task_type=86 (TASK_TIMEOUT_SET).
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.857.778 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.787 [timeout_set_task.cc:115] 618654 ConstructSqeForTimeoutSetTask: TaskTimeoutSetTask ConstructSqe finish,topic_type=0,cmd_type=13
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.800 [stream.cc:1400] 618654 AddTaskToList: public task, stream_id=0, task_id=4, task_type=86 (TASK_TIMEOUT_SET), head=4, tail=5
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.816 [stream.cc:2595] 618654 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=4, type=86(TASK_TIMEOUT_SET), head=4, tail=5, sqe_num=1, lastTail=4, device_id=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.835 [npu_driver.cc:751] 618654 SqTaskSend: device_id=2, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.846 [stars_engine.cc:893] 618654 SendTask: Sq task send finished, device_id=2, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=4, task_type=86(TASK_TIMEOUT_SET).
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.864 [stream.cc:1494] 618654 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=4.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.857.861 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.879 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.895 [stream.cc:2886] 618654 StarsWaitForTask: No.0 stream_id=0, taskId=4, currentId=3
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.907 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.923 [stream.cc:2886] 618654 StarsWaitForTask: No.1 stream_id=0, taskId=4, currentId=3
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.935 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=0, head=4.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.857.942 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.949 [stream.cc:2886] 618654 StarsWaitForTask: No.2 stream_id=0, taskId=4, currentId=3
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.964 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=0, head=5.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.857.962 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.980 [task.cc:185] 618654 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.857.996 [task.cc:185] 618654 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.858.008 [logger.cc:152] 618654 TaskFinished: device_id=2, stream_id=0, task_id=4, task_type=86 (TASK_TIMEOUT_SET), task_finish_num=5
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.858.023 [stars_engine.cc:437] 618654 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=4, sqHead=5, endTaskId=4, recycleTaskId=4.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.858.056 [stream.cc:2886] 618654 StarsWaitForTask: No.3 stream_id=0, taskId=4, currentId=4
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.858.063 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.858.069 [event.cpp:277]618654 aclrtSetOpExecuteTimeOut: successfully execute aclrtSetOpExecuteTimeOut, timeout = 900s
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.858.096 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:285] Init] End inititializing kernel runtime.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.858.097 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.858.160 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [InferShape][InferDataType]
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.858.168 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:48] InitDevice] Enter SetRtDevice, current initialize device number:1
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.858.190 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:50] InitDevice] Device 2 has been set
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.858.210 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:381] CreateDefaultStream] The default compute stream is already created, skip.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.858.229 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:390] CreateDefaultStream] The default communication stream is already created, skip.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.858.255 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.858.273 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_pool.cc:165] DefaultEnhancedAscendMemoryPool] DefaultEnhancedAscendMemoryPool constructed.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.858.293 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [Tiling][TilingParse]
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.858.306 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:397] Initialize] Skip initialization of memory pool since init size is not configured.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.858.359 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [InferShape][InferDataType]
[INFO] UTILS(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:41.858.371 [mindspore/ccsrc/utils/offload_context.cc:86] enable_aio] On ascend devices, enable aio and enable pinned mem cannot be turned on at the same time.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.858.451 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.858.460 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PSAMask] register OP_IMPL : [InferShape][InferDataType]
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.858.501 [context.cpp:72]618654 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.858.526 [api_impl.cc:3717] 618654 ContextSetCurrent: set context=aaaaf5082ff0, flag=0.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.858.517 [plugin_manager.cc:883]618674 LoadWithFlags:The shared library will not be checked. Please ensure that the source of the shared library is trusted.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.858.516 [plugin_manager.cc:883]618662 LoadWithFlags:The shared library will not be checked. Please ensure that the source of the shared library is trusted.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.858.548 [context.cpp:80]618654 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.858.567 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PSAMaskGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.858.573 [context.cpp:72]618654 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.858.579 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.858.584 [ops_kernel_executor_manager.cc:37]618662 Initialize:No library to load
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.858.584 [ops_kernel_executor_manager.cc:37]618674 Initialize:No library to load
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.858.591 [api_impl.cc:3717] 618654 ContextSetCurrent: set context=aaaaf5082ff0, flag=0.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.858.610 [context.cpp:80]618654 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.858.605 [plugin_manager.cc:540]618674 GetOpsProtoPath:Enter GetOpsProtoPath schedule
[INFO] GE(618674,python3.9):2025-04-03-09[INFO] GE(618662,python3.9):2025-04-03-09:27:41.858.605 [plugin_manager.cc:540]618662 GetOpsProtoPath:Enter GetOpsProtoPath schedule
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.858.623 [plugin_manager.cc:108]618662 GetOppPath:Enter get opp path schedule
:27:41.858.621 [plugin_manager.cc:108]618674 GetOppPath:Enter get opp path schedule
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.858.656 [plugin_manager.cc:117]618662 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.858.663 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.858.663 [plugin_manager.cc:117]618674 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.858.678 [plugin_manager.cc:547]618662 GetOpsProtoPath:Opp plugin path structure is new version!
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.858.683 [plugin_manager.cc:547]618674 GetOpsProtoPath:Opp plugin path structure is new version!
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.858.699 [plugin_manager.cc:206]618674 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.858.698 [plugin_manager.cc:206]618662 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.858.749 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.858.764 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.858.777 [acl.cpp:288]618654 aclInit: start to execute aclInit
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.858.828 [acl.cpp:298]618654 aclInit: call ErrorManager.Initialize
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.858.865 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.858.921 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.858.942 [acl.cpp:242]618654 HandleErrorManagerConfig: err_msg mode is set ["1"].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.859.071 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.859.115 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.859.267 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.859.263 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.859.385 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.859.461 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ThreeNN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.859.520 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.859.573 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.859.573 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.859.585 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Voxelization] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.859.618 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.859.618 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.859.635 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.859.637 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.859.652 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.859.650 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.859.651 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.859.699 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.859.700 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.859.715 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.859.750 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.859.773 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.859.781 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.859.819 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.859.850 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [InferShape][InferDataType][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.859.877 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.859.904 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [InferShape][InferDataType][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.859.928 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.859.941 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.859.952 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.859.974 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.859.991 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.860.009 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.860.027 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.860.054 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CompressFcOp] register OP_IMPL : [InferShape][InferDataType][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.860.074 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.860.104 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.860.111 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.860.111 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.860.146 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.860.146 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.860.174 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.860.178 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.860.195 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.860.183 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.860.202 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.860.236 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.860.242 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.860.241 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Resize] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.860.281 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.860.296 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.860.298 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.860.280 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.860.315 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.860.331 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.860.316 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.860.345 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.860.347 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.860.370 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.860.380 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.860.396 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.860.380 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.860.397 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.860.400 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.860.412 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.860.412 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.860.430 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.860.428 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.860.497 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.860.502 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.860.595 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.860.638 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.860.710 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMatMulV4] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.860.758 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.860.807 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.860.822 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.860.822 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.860.858 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.860.858 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.860.875 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.860.875 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.860.890 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.860.888 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.860.894 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.860.924 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.860.926 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.860.926 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.861.028 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.861.126 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.861.218 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.861.230 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.861.324 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.861.325 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.861.341 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ResizeTrilinear] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.861.358 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.861.358 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.861.375 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.861.376 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.861.392 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.861.391 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.861.428 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.861.438 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.861.429 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.861.465 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.861.479 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.861.495 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.861.482 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.861.508 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.861.508 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.861.525 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.861.523 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.861.536 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.861.555 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.861.572 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.861.564 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.861.556 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.861.572 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.861.588 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.861.585 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.861.602 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.861.587 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.861.605 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.861.605 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.861.626 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.861.690 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.861.764 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.861.797 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.861.812 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.861.828 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.861.864 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.861.891 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.861.922 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.861.934 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.861.952 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.861.965 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.861.993 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.861.994 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.861.994 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.862.021 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.862.028 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.862.029 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.862.046 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.862.047 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.862.046 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.862.060 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.862.060 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.862.076 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.862.099 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.862.099 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.862.097 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.862.108 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.862.130 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.862.168 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.862.200 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.862.226 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.862.222 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.862.256 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.862.280 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.862.340 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.862.352 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.862.460 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ActULQClampMaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.862.472 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.862.488 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ActULQClampMinGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.862.490 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.862.490 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.862.524 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.862.525 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.862.541 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.862.542 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.862.555 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.862.555 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.862.589 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ActsULQ] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.862.589 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.862.594 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.862.590 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.862.628 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.862.644 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/a[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.862.643 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
naconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.862.660 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.862.674 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.862.673 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.862.691 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.862.689 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.862.697 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ActsULQInputGrad] register OP_IMPL : [InferShape]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.862.722 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.862.723 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.862.739 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.862.723 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.862.739 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.862.755 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.862.756 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.862.770 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.862.772 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.862.796 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.862.853 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.862.899 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.862.979 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.863.000 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdaptiveAvgPoolAssistMatrix] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.863.104 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.863.127 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.863.158 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.863.158 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.863.157 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.863.193 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.863.193 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.863.210 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.863.224 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.863.211 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.863.225 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.863.232 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.863.258 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.863.258 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.863.280 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.863.337 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.863.404 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.863.434 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.863.529 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.863.551 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.863.604 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.863.644 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.863.652 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.863.652 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.863.685 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.863.687 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.863.703 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.863.701 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.863.718 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.863.719 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.863.725 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.863.745 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.863.752 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.863.752 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.863.790 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.863.801 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.863.817 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.863.807 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.863.832 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.863.831 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.863.847 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.863.841 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.863.847 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.863.861 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.863.880 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.863.895 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.863.879 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.863.896 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.863.910 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.863.923 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.863.910 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.863.926 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.863.943 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.863.981 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.864.020 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.864.098 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.864.198 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.864.215 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AvgPoolUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.864.322 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.864.329 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.864.329 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.864.365 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.864.365 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.864.384 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.864.384 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.864.398 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.864.398 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.864.397 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.864.422 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.864.437 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.864.442 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.864.524 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Bitcast] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.864.522 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RoiPoolingGradWithArgMax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.864.630 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.864.644 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.864.702 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.864.773 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.864.787 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.864.833 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.864.833 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.864.875 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.864.869 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.864.885 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.864.869 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.864.886 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.864.901 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.864.901 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.864.910 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.864.937 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.864.950 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.864.981 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CTCLoss] register OP_IMPL : [InferShape]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.864.973 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.864.985 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.865.002 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
WARNING] GE(618674,python3.9):2025-04-03-09:27:41.864.989 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.865.021 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.865.017 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.865.034 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.865.037 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.865.031 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.865.069 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.865.066 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.865.082 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.865.083 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.865.084 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.865.096 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.865.110 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.865.102 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.865.119 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.865.123 [plugin_manager.cc:218]618662 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.865.133 [plugin_manager.cc:218]618674 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.865.145 [plugin_manager.cc:422]618662 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.865.155 [plugin_manager.cc:422]618674 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.865.154 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.865.163 [plugin_manager.cc:155]618662 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.865.171 [plugin_manager.cc:155]618674 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.865.182 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.865.187 [plugin_manager.cc:158]618662 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.865.203 [plugin_manager.cc:426]618662 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.865.190 [plugin_manager.cc:158]618674 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.865.204 [plugin_manager.cc:426]618674 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.865.276 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.865.275 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.865.392 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DropOutGenMask] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.865.420 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StatelessDropOutGenMask] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.865.442 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StackBallQuery] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.865.516 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.865.566 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.865.589 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.865.589 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.865.616 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.865.623 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.865.601 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.865.641 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.865.642 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.865.670 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.865.659 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.865.673 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.865.712 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.865.708 [plugin_manager.cc:439]618662 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspo
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.865.708 [plugin_manager.cc:439]618674 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspo
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.865.732 [ge_executor.cc:259]618662 InitOpsProtoManager:Get opsproto path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/minds
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.865.732 [ge_executor.cc:259]618674 InitOpsProtoManager:Get opsproto path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/minds
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.865.735 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.865.741 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.865.815 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.865.917 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ExpandDims] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.865.936 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.866.016 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.866.010 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScoreGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.866.023 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.866.150 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FillWindowCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.866.148 [plugin_manager.cc:996]618674 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.866.148 [plugin_manager.cc:996]618662 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.866.176 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.866.181 [plugin_manager.cc:1011]618674 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.866.181 [plugin_manager.cc:1011]618662 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.866.204 [plugin_manager.cc:1015]618662 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.866.204 [plugin_manager.cc:1015]618674 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.866.216 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.866.250 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.866.302 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.866.320 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.866.305 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.866.321 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.866.324 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.866.353 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FlattenV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.866.396 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.866.412 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.866.395 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.866.412 [plugin_manager.cc:1130]6[INFO] GE(618650,python3.9):2025-04-03-09:27:41.866.403 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [Tiling][TilingParse]
18662 GetFileListWithSuffix:Found 1 libs.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.866.447 [opsproto_manager.cc:123]618674 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.866.452 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GatherShapes] register OP_IMPL : [InferShape]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.866.458 [opsproto_manager.cc:123]618662 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.866.504 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.866.520 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.866.496 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.866.521 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.866.551 [opsproto_manager.cc:123]618674 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.866.550 [opsproto_manager.cc:123]618662 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.866.561 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GaussianBlur] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.866.596 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.866.614 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 2 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.866.597 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.866.614 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 2 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.866.592 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.866.681 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.866.698 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.866.682 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.866.698 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.866.695 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FileConstant] register OP_IMPL : [IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.866.726 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StatelessIf] register OP_IMPL : [InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.866.751 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[If] register OP_IMPL : [InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.866.767 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.866.782 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.866.768 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.866.784 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.866.774 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[_If] register OP_IMPL : [InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.866.799 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Case] register OP_IMPL : [InputsDependency]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.866.813 [opsproto_manager.cc:123]618674 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.866.814 [opsproto_manager.cc:123]618662 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.866.843 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.866.853 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ConstPlaceHolder] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.866.858 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.866.858 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.866.875 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 3 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.866.876 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 3 libs.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.866.905 [opsproto_manager.cc:123]618674 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.866.907 [opsproto_manager.cc:123]618662 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.866.948 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.866.962 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 4 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.866.949 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.866.964 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 4 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.866.954 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.866.977 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.867.028 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.867.044 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.867.030 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.867.051 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.867.057 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.867.070 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.867.076 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.867.108 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.867.124 [[INFO] GE(618662,python3.9):2025-04-03-09:27:41.867.120 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.867.136 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.867.134 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Identity] register OP_IMPL : [InferShape]
plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.867.169 [opsproto_manager.cc:123]618662 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.867.166 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MemcpyAsync] register OP_IMPL : [InferShape]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.867.172 [opsproto_manager.cc:123]618674 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.867.200 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IdentityN] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.867.214 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.867.231 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 5 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.867.217 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.867.233 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 5 libs.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.867.260 [opsproto_manager.cc:123]618674 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.867.260 [opsproto_manager.cc:123]618662 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.867.294 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.867.303 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.867.319 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 6 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.867.305 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.867.321 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 6 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.867.317 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.867.343 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.867.348 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.867.376 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.867.385 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.867.402 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.867.393 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.867.391 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.867.406 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.867.401 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.867.434 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MlaAttentionScore] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.867.439 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.867.471 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.867.471 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.867.489 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.867.475 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.867.492 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.867.498 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.867.500 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.867.518 [opsproto_manager.cc:123]618662 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.867.522 [opsproto_manager.cc:123]618674 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.867.529 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.867.565 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.867.564 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.867.579 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 7 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.867.580 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 7 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.867.602 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.867.606 [opsproto_manager.cc:123]618662 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.867.610 [opsproto_manager.cc:123]618674 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.867.608 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.867.654 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.867.668 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 8 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.867.651 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.867.673 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 8 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.867.704 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.867.731 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.867.753 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.867.741 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.867.756 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.867.799 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.867.817 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.867.832 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.867.823 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.867.821 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.867.836 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.867.845 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.867.863 [opsproto_manager.cc:123]618674 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.867.862 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [HostInputs][OpExecuteFunc]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.867.867 [opsproto_manager.cc:123]618662 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.867.907 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.867.923 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 9 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.867.912 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.867.927 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 9 libs.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.867.950 [opsproto_manager.cc:123]618674 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.867.957 [opsproto_manager.cc:123]618662 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.867.941 [error_manager.cc:673]618654 ParseJsonFile:Parse json file:/usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/../conf/error_manager/error_code.json success
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.867.984 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.867.993 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.868.010 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 10 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.868.006 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.868.001 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.868.017 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 10 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.868.034 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.868.041 [opsproto_manager.cc:123]618674 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/usr/local/Ascend/ascend-toolkit/latest/opp/op_proto/custom/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.868.042 [opsproto_manager.cc:123]618662 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/usr/local/Ascend/ascend-toolkit/latest/opp/op_proto/custom/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.868.080 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.868.083 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 10 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.868.081 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 10 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.868.151 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.868.180 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.868.151 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.868.180 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.868.200 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.868.199 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.868.215 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 3 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.868.197 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.868.214 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 3 libs.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.868.232 [opsproto_manager.cc:147]618674 LoadOpsProtoPluginSo:[LoadSo][Check] Shared library will not be checked. Please make sure that the source of shared library is trusted.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.868.234 [opsproto_manager.cc:147]618662 LoadOpsProtoPluginSo:[LoadSo][Check] Shared library will not be checked. Please make sure that the source of shared library is trusted.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.868.303 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.868.320 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.868.407 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.868.503 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.868.517 [op_tiling_manager.cc:79]618670 LoadSo:dlopen file /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so successfully!
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.868.578 [operator_factory_impl.cc:215]618662 RegisterInferShapeFunc:operator_infershape_funcs_ init
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.868.577 [operator_factory_impl.cc:215]618674 RegisterInferShapeFunc:operator_infershape_funcs_ init
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.868.585 [op_tiling_manager.cc:58]618670 LoadSo:[FindSo][Check] Get path with op_master [/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_master/] failed
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.868.599 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.868.603 [operator_factory_impl.cc:269]618674 RegisterVerifyFunc:operator_verify_funcs_ init
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.868.603 [operator_factory_impl.cc:269]618662 RegisterVerifyFunc:operator_verify_funcs_ init
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.868.636 [opsproto_manager.cc:162]618662 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.868.637 [opsproto_manager.cc:162]618674 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.868.702 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.868.724 [acl.cpp:315]618654 aclInit: call ge interface executor.Initialize
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.868.754 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.868.806 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RandomChoiceWithMask] register OP_IMPL : [InferShapeRange]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.868.813 [op_tiling_manager.cc:67]618670 LoadSo:Failed to dlopen /usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.868.862 [op_tiling_manager.cc:73]618670 LoadSo:Failed to dlopen /usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] PROFILING(618654,python3.9):2025-04-03-09:27:41.868.873 [prof_atls_plugin.cpp:210] (tid:618654) Module[45] register callback of ctrl handle.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.868.905 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RandomUniform] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.868.933 [op_tiling_manager.cc:58]618670 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.868.930 [ge_executor.cc:273]618654 Initialize:Init GeExecutor begin.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.868.990 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Rank] register OP_IMPL : [InferShape]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.868.991 [op_tiling_manager.cc:67]618670 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.869.018 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Size] register OP_IMPL : [InferShape]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.869.033 [op_tiling_manager.cc:73]618670 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.869.079 [op_tiling_manager.cc:58]618670 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.869.110 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : [InferShape]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.869.138 [op_tiling_manager.cc:67]618670 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.869.110 [op_lib_register.cc:117]618654 GetAllCustomOpApiSoPaths:value of env ASCEND_CUSTOM_OPP_PATH is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/ho
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.869.192 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.869.222 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Reshape] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.869.231 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.869.272 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.869.307 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.869.325 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RgbToGrayscale] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.869.340 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.869.373 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.869.393 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.869.404 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.869.426 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.869.437 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.869.470 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.869.502 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.869.527 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.869.533 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.869.565 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.869.604 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.869.623 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.869.614 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.869.636 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.869.669 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.869.700 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.869.721 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Rotate] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.869.732 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.869.763 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.869.795 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.869.801 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Shape] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.869.827 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ShapeN] register OP_IMPL : [InferShape]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.869.826 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.869.860 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.869.898 [op_lib_register.cc:165]618654 CallInitFunc:CallInitFunc 0 successfully, op_lib_paths_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/je
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.869.939 [plugin_manager.cc:616]618654 GetOpTilingForwardOrderPath:Enter GetOpTilingPath schedule
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.869.956 [plugin_manager.cc:108]618654 GetOppPath:Enter get opp path schedule
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.869.996 [plugin_manager.cc:117]618654 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.870.020 [plugin_manager.cc:624]618654 GetOpTilingForwardOrderPath:Opp plugin path structure is new version!
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.870.032 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.870.042 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SilentCheckV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.870.037 [plugin_manager.cc:206]618654 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.870.170 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.870.220 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:AllFinite, funcPointer:(nil), registered count:2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.870.251 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SilentCheckV3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.870.255 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:AllFinite, funcPointer:(nil), registered count:4
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.870.279 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:AllFinite, funcPointer:(nil), registered count:1
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.870.300 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:AllFinite, funcPointer:(nil), registered count:1
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.870.325 [op_check.cc:71]618670 RegisterParamGeneralize:RegisterParamGeneralize: op_type:AllFinite, funcPointer:(nil), registered count:1
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.870.356 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.870.369 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.870.473 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.870.508 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.870.555 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.870.575 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.870.578 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyAdadelta] register OP_IMPL : [InferShape]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.870.589 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.870.606 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyAdadeltaD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.870.629 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.870.634 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.870.651 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyAdagrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.870.657 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff482b49b0, registered count:3
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.870.673 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.870.695 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.870.690 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:5
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.870.718 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.870.711 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:2
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.870.731 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.870.741 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.870.752 [op_check.cc:71]618670 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.870.761 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.870.780 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.870.800 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.870.828 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2D] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.870.849 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyRMSProp] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.870.873 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyRMSPropD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.870.975 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseFillEmptyRows] register OP_IMPL : [InferShapeRange][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.870.991 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.871.028 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.871.046 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.871.059 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.871.074 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff482b7da0, registered count:4
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.871.098 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.871.098 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.871.118 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.871.134 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.871.139 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.871.156 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.871.153 [op_check.cc:71]618670 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.871.169 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : [InferShape]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.871.172 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.871.204 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.871.220 [plugin_manager.cc:215]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.871.275 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Squeeze] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.871.303 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SqueezeV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.871.326 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SqueezeV3] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.871.421 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.871.460 [op_tiling_manager.cc:75]618670 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.871.521 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StatelessRandomNormalV2] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.871.524 [op_tiling_manager.cc:58]618670 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.871.570 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.871.607 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.871.625 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.871.621 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.871.622 [op_tiling_manager.cc:67]618670 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.871.641 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.871.682 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.871.730 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.871.838 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TopK] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.871.859 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.871.879 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.871.897 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.871.916 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.872.014 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TopKPQDistanceV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.872.039 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.872.076 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.872.093 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.872.107 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.872.108 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.872.145 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.872.201 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.872.221 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.872.222 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TransArgb] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.872.237 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.872.256 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.872.273 [plugin_manager.cc:215]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.872.332 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Unsqueeze] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.872.364 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UnsqueezeV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.872.386 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UnsqueezeV3] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.872.446 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff4826e2c0, registered count:4
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.872.480 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.872.498 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.872.501 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.872.524 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.872.521 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.872.542 [op_check.cc:71]618670 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.872.624 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Where] register OP_IMPL : [InferShapeRange]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.872.621 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.872.674 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.872.692 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.872.706 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.872.723 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[WtsARQ] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.872.743 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.872.821 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.872.877 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff48272978, registered count:4
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.872.902 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.872.918 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.872.922 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.872.940 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.872.958 [op_check.cc:71]618670 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.873.024 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.873.048 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.873.094 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.873.130 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.873.148 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.873.149 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.873.161 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.873.172 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.873.177 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.873.200 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.873.238 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.873.256 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.873.270 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.873.255 [op_tiling_manager.cc:75]618670 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.873.274 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdjustContrast] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.873.287 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.873.300 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdjustHue] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.873.310 [plugin_manager.cc:215]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.873.316 [op_tiling_manager.cc:58]618670 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.873.324 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdjustSaturation] register OP_IMPL : [InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.873.350 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CropAndResize] register OP_IMPL : [InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.873.374 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CropAndResizeV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.873.396 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DecodeAndCropJpeg] register OP_IMPL : [InputsDependency]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.873.397 [op_tiling_manager.cc:67]618670 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.873.419 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DecodeJpeg] register OP_IMPL : [InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.873.441 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NormalizeV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.873.462 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdjustContrastWithMean] register OP_IMPL : [InputsDependency]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.873.448 [op_tiling_manager.cc:73]618670 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.873.485 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdjustBrightness] register OP_IMPL : [InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.873.506 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdjustBrightnessV2] register OP_IMPL : [InputsDependency]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.873.512 [op_tiling_manager.cc:58]618670 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.873.529 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdjustSaturationV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.873.552 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[WarpAffineV2] register OP_IMPL : [InputsDependency]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.873.558 [op_tiling_manager.cc:67]618670 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.873.583 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ImgCrop] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.873.593 [op_tiling_manager.cc:75]618670 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.873.606 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[WarpPerspective] register OP_IMPL : [InputsDependency]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.873.635 [op_tiling_manager.cc:58]618670 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.873.664 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.873.673 [op_tiling_manager.cc:67]618670 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.873.705 [op_tiling_manager.cc:75]618670 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.873.707 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.873.700 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.873.718 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.873.731 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.873.750 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.873.743 [op_tiling_manager.cc:58]618670 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.873.735 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.873.782 [op_tiling_manager.cc:67]618670 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.873.791 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.873.819 [op_tiling_manager.cc:73]618670 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.873.857 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HcomAllReduce] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.873.868 [op_tiling_manager.cc:58]618670 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.873.882 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HcomAllGather] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.873.906 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HcomBroadcast] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.873.916 [op_tiling_manager.cc:67]618670 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.873.931 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HcomReduceScatter] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.873.948 [op_tiling_manager.cc:75]618670 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.873.955 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HcomSend] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.873.979 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HcomReduce] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.873.986 [op_tiling_manager.cc:58]618670 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.874.000 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HcomReceive] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.874.023 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HcomAllToAllV] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.874.028 [op_tiling_manager.cc:67]618670 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.874.046 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HcomAllToAllVC] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.874.061 [op_tiling_manager.cc:75]618670 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.874.069 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HcomGatherAllToAllV] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.874.099 [op_tiling_manager.cc:58]618670 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.874.135 [op_tiling_manager.cc:67]618670 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.874.152 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.874.172 [op_tiling_manager.cc:73]618670 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.874.187 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.874.205 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.874.210 [op_tiling_manager.cc:58]618670 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.874.220 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.874.250 [op_tiling_manager.cc:67]618670 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.874.255 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.874.280 [op_tiling_manager.cc:75]618670 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.874.304 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.874.322 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.874.336 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.874.332 [op_tiling_manager.cc:58]618670 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.874.352 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.874.370 [op_tiling_manager.cc:67]618670 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.874.373 [plugin_manager.cc:215]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.874.402 [op_tiling_manager.cc:75]618670 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.874.450 [op_tiling_manager.cc:58]618670 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.874.439 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Igammac] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.874.439 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Igammac] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.874.487 [op_tiling_manager.cc:67]618670 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.874.523 [op_tiling_manager.cc:73]618670 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.874.560 [op_tiling_manager.cc:58]618670 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.874.597 [op_tiling_manager.cc:67]618670 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.874.627 [op_tiling_manager.cc:75]618670 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.874.665 [op_tiling_manager.cc:58]618670 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.874.702 [op_tiling_manager.cc:67]618670 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.874.728 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.874.740 [op_tiling_manager.cc:75]618670 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.874.760 [op_tiling_manager.cc:109]618670 ~FuncPerfScope:[GEPERFTRACE] The time cost of OpTilingManager::LoadSo is [200377] micro seconds.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.874.762 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.874.782 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.874.800 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.874.835 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.874.896 [plugin_manager.cc:639]618670 GetConstantFoldingOpsPath:Enter GetConstantFoldingOpsPath schedule
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.874.918 [plugin_manager.cc:108]618670 GetOppPath:Enter get opp path schedule
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.874.945 [plugin_manager.cc:117]618670 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.875.009 [host_cpu_engine.cc:254]618670 LoadLib:To invoke dlopen on lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libconstant_folding_ops.so
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.875.052 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.875.046 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.875.148 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.875.194 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.875.201 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.875.211 [opsproto_manager.cc:162]618674 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.875.228 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.875.211 [opsproto_manager.cc:162]618662 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.875.229 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.875.262 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.875.276 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.875.300 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.875.315 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.875.316 [opsproto_manager.cc:162]618662 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.875.317 [opsproto_manager.cc:162]618674 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.875.329 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.875.362 [opsproto_manager.cc:162]618674 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.875.355 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.875.372 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.875.363 [opsproto_manager.cc:162]618662 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.875.388 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.875.384 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.875.395 [opsproto_manager.cc:162]618662 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.875.394 [opsproto_manager.cc:162]618674 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.875.403 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.875.421 [plugin_manager.cc:215]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.875.426 [opsproto_manager.cc:162]618662 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.875.426 [opsproto_manager.cc:162]618674 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.875.438 [plugin_manager.cc:218]618654 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-pack
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.875.456 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.875.457 [opsproto_manager.cc:162]618674 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.875.456 [opsproto_manager.cc:162]618662 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.875.462 [plugin_manager.cc:422]618654 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.875.480 [plugin_manager.cc:155]618654 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.875.467 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.875.489 [opsproto_manager.cc:162]618674 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.875.490 [opsproto_manager.cc:162]618662 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.875.504 [plugin_manager.cc:158]618654 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.875.520 [plugin_manager.cc:426]618654 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.875.519 [opsproto_manager.cc:162]618674 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.875.522 [opsproto_manager.cc:162]618662 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.875.549 [opsproto_manager.cc:162]618674 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.875.551 [opsproto_manager.cc:162]618662 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.875.571 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.875.685 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.875.761 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CircularPad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.875.784 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.875.858 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.875.872 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.875.907 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] [INFO] GE(618666,python3.9):2025-04-03-09:27:41.875.931 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.875.934 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CircularPadGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
GE(618654,python3.9):2025-04-03-09:27:41.875.925 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.875.958 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.876.008 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.875.999 [plugin_manager.cc:439]618654 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.876.022 [plugin_manager.cc:175]618654 ReversePathString:Enter ReversePathString schedule
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.876.032 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.876.051 [plugin_manager.cc:187]618654 ReversePathString:path_str is '/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/:/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.876.131 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.876.181 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.876.259 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.876.383 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.876.411 [plugin_manager.cc:996]618654 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.876.448 [plugin_manager.cc:1011]618654 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.876.462 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.876.473 [plugin_manager.cc:1015]618654 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.876.497 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:41.876.523 [op_tiling_manager.cc:58]618654 LoadSo:[FindSo][Check] Get path with op_master [/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.876.533 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.876.541 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.876.563 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.876.591 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.876.620 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.876.618 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.876.815 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleLinear1d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.876.847 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleBilinear2d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.876.951 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.876.975 [opsproto_manager.cc:162]618666 LoadOpsProtoPluginSo:OpsProtoManager plugin load /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto.so success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.877.022 [plugin_manager.cc:108]618666 GetOppPath:Enter get opp path schedule
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.877.020 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleBicubic2d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.877.061 [plugin_manager.cc:117]618666 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.877.210 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.877.388 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAAGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.877.563 [plugin_manager.cc:996]618666 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.877.563 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.877.612 [plugin_manager.cc:1011]618666 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.877.632 [plugin_manager.cc:1015]618666 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.877.705 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.877.719 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.877.779 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.877.769 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.877.794 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.877.803 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.877.814 [opp_so_manager.cc:56]618666 LoadOpsProtoPackage:Start load ops proto package, is_split:[1].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.877.828 [plugin_manager.cc:540]618666 GetOpsProtoPath:Enter GetOpsProtoPath schedule
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.877.839 [plugin_manager.cc:108]618666 GetOppPath:Enter get opp path schedule
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.877.861 [plugin_manager.cc:117]618666 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.877.876 [plugin_manager.cc:547]618666 GetOpsProtoPath:Opp plugin path structure is new version!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.877.888 [plugin_manager.cc:206]618666 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.877.974 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.878.150 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAABackward] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.878.229 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.878.267 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.878.281 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.878.293 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.878.325 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.878.334 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.878.521 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ResizeUpsampleTrilinear] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.878.661 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.878.693 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.878.706 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.878.720 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.878.694 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dBackward] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.878.755 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.878.795 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.878.816 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.878.827 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.878.838 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.878.868 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.878.880 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.878.877 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.878.891 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.878.905 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.878.909 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.879.066 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleNearest] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.879.222 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.879.255 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.879.268 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.879.270 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleNearestExact2dGrad] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.879.280 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.879.302 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleNearest2dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.879.320 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.879.422 [op_tiling_registry.cc:134]618650 OpTilingFuncRegistry:Register op tiling function V2 for op_type:AvgPoolGrad
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.879.458 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.879.591 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.879.622 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.879.640 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.879.671 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.879.684 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.879.697 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.879.730 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.879.756 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.879.763 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.879.786 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.879.787 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.879.798 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.879.812 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.879.840 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.879.852 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.879.863 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.879.875 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.879.920 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.880.043 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.880.202 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.880.194 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.880.238 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.880.251 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.880.264 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.880.303 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.880.330 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.880.449 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.880.549 [host_cpu_engine.cc:273]618670 LoadLib:Lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libconstant_folding_ops.so has been opened
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.880.568 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.880.617 [host_cpu_engine.cc:254]618670 LoadLib:To invoke dlopen on lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libops_host_cpu.so
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.880.630 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.880.663 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.880.676 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.880.688 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.880.722 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.880.754 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.880.775 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.880.769 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.880.791 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.880.803 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.880.832 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.880.844 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.880.855 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.880.867 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.880.995 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.881.183 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.881.215 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.881.228 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.881.240 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.881.274 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.881.388 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.881.591 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.881.622 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.881.635 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.881.647 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.881.681 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.881.719 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.881.732 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.881.743 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.881.755 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.881.783 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.881.795 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.881.789 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.881.807 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.881.821 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.882.007 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.882.129 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.882.159 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.882.172 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.882.184 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.882.218 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.882.360 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.882.537 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.882.568 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.882.560 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.882.583 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.882.596 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.882.629 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.882.667 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.882.680 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.882.692 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.882.704 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.882.732 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.882.744 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.882.755 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.882.767 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.882.756 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReflectionPad3dGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.882.780 [plugin_manager.cc:218]618666 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.882.797 [plugin_manager.cc:422]618666 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.882.809 [plugin_manager.cc:155]618666 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.882.827 [plugin_manager.cc:158]618666 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.882.838 [plugin_manager.cc:426]618666 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.882.866 [op_tiling_registry.cc:134]618650 OpTilingFuncRegistry:Register op tiling function V2 for op_type:AvgPool
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.882.904 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.883.020 [op_tiling_registry.cc:134]618650 OpTilingFuncRegistry:Register op tiling function V2 for op_type:AvgPoolV2
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.883.052 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.883.145 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.883.183 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.883.196 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.883.209 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.883.208 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.883.243 [plugin_manager.cc:439]618666 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspo
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.883.243 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.883.272 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.883.301 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantConv2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.883.540 [plugin_manager.cc:996]618666 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.883.566 [plugin_manager.cc:1011]618666 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.883.584 [plugin_manager.cc:1015]618666 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.883.683 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.883.697 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.883.709 [opp_so_manager.cc:45]618666 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.884.450 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.884.915 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.885.074 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.885.233 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.885.395 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.885.428 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.885.576 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.885.725 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.885.877 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.885.878 [op_impl_registry_holder_manager.cc:208]618666 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.885.909 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.885.919 [op_impl_registry_holder_manager.cc:216]618666 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.885.937 [op_impl_registry_holder_manager.cc:208]618666 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.885.983 [op_impl_registry_holder_manager.cc:208]618666 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.886.076 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.886.237 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.886.314 [op_impl_space_registry.cc:273]618666 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so] success!
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.886.404 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.886.418 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.886.444 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.886.457 [opp_so_manager.cc:45]618666 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.886.583 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.886.737 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AGLU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.886.906 [host_cpu_engine.cc:267]618670 LoadLib:Invoke function Initialize in lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libops_host_cpu.so
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.887.160 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.887.518 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] OP(618670,python3.9):2025-04-03-09:27:41.887.695 [host_cpu_kernel_wrapper.cpp:88][OP_PROTO][Initialize][618670] OpName:[HostCpuKernelWrapperOp] "Host cpu dlopen so[/usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libaicpu_const_folding.so] success"
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.887.728 [folding.cc:404][InitCpuConstantFoldingNew][tid:618670]:"Init cpu constant folding begin."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.887.768 [folding.cc:408][InitCpuConstantFoldingNew][tid:618670]:"Number of registered ops: 234"
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.887.763 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.887.786 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Acos]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.887.805 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Acosh]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.887.822 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[ActiveRotatedFilter]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.887.833 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[ActiveRotatedFilterGrad]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.887.843 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[AdaptiveAvgPool2dAssistMatrix]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.887.853 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[AdaptiveAvgPoolAssistMatrix]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.887.863 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[AdaptiveMaxPool2d]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.887.873 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Add]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.887.883 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Addcdiv]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.887.894 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Addcmul]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.887.924 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[AffineGrid]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.887.940 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[ApplyAdamV2]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.887.955 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Asin]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.887.969 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.887.967 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Asinh]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.887.982 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Assert]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.887.995 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Atan]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.006 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Atan2]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.018 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Atanh]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.028 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[AvgPoolV2]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.042 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Betainc]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.057 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Bucketize]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.070 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[CTCLossV2]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.085 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[CTCLossV2Grad]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.097 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[CacheSwapTable]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.113 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[CalcBucketsLimitAndOffset]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.125 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[CaseCondition]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.140 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Cast]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.152 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Ceil]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.209 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[CheckNumerics]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.222 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[ClipByValue]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.238 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[ClipByValueV2]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.255 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Combinations]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.272 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[CompareAndBitpack]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.284 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[ComputeAccidentalHits]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.294 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[ConcatV2]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.304 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Conj]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.313 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[ConjugateTranspose]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.327 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Coordinates1DTo2D]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.341 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Cosh]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.372 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[CropAndResize]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.385 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Cross]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.401 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Cummax]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.414 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Cummin]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.430 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Cumsum]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.443 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Div]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.459 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[DynamicStitch]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.477 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[EditDistance]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.495 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Elu]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.513 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[EluGrad]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.531 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[EmbeddingApplyAdaGrad]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.888.530 [op_impl_registry_holder_manager.cc:208]618666 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.549 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[EmbeddingApplyAdam]."
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.888.566 [op_impl_registry_holder_manager.cc:216]618666 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.568 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[EmbeddingApplyAdamW]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.888.582 [op_impl_registry_holder_manager.cc:208]618666 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.586 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[EmbeddingApplyFtrl]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.603 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[EmbeddingApplyRmsprop]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.888.615 [op_impl_registry_holder_manager.cc:208]618666 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.621 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[EmbeddingApplySgd]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.639 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[EmbeddingComputeVarExport]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.656 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[EmbeddingComputeVarImport]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.674 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[EmbeddingFeatureMappingExport]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.692 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[EmbeddingFeatureMappingFileSize]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.709 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[EmbeddingFeatureMappingImport]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.725 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[EmbeddingHashmapExport]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.742 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[EmbeddingHashmapFileSize]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.755 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[EmbeddingHashmapImport]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.771 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[EmbeddingLookup]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.783 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[EmbeddingTableEvict]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.798 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[EmbeddingTableExport]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.820 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[EmbeddingTableFind]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.833 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[EmbeddingTableFindAndInit]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.849 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[EmbeddingTableImport]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.865 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Equal]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.882 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Expand]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.898 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[ExpandDims]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.911 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Exponential]."
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.888.914 [op_impl_space_registry.cc:80]618666 MergeFunctions:op type DecoderKvCache infer_shape func has been registered
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.888.933 [op_impl_space_registry.cc:83]618666 MergeFunctions:op type DecoderKvCache infer_datatype func has been registered
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.927 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[ExponentialDecayLR]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.944 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Fill]."
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.888.952 [op_impl_space_registry.cc:80]618666 MergeFunctions:op type PromptKvCache infer_shape func has been registered
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.959 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[FillDiagonal]."
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.888.965 [op_impl_space_registry.cc:83]618666 MergeFunctions:op type PromptKvCache infer_datatype func has been registered
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.888.979 [op_impl_space_registry.cc:273]618666 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so] success!
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.974 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Fills]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.888.992 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Floor]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.009 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[FloorDiv]."
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.889.019 [opp_so_manager.cc:97]618666 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.022 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[FloorMod]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.037 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[GEMM]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.052 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[GatherElements]."
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.889.058 [opp_so_manager.cc:97]618666 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.064 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[GatherV2]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.080 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Geometric]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.093 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[GetDynamicDims]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.109 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Greater]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.889.093 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.126 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[GreaterEqual]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.889.143 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.143 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[GridSampler2D]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.889.159 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.161 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[GridSampler2DGrad]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.889.172 [opp_so_manager.cc:45]618666 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.179 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[GridSampler3D]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.196 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[GridSampler3DGrad]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.213 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Histogram]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.229 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[IMGWarpOffsets]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.242 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Identity]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.257 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[IndexToAddr]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.277 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[InitEmbeddingHashmap]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.290 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[InitPartitionMap]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.305 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[InplaceIndexAdd]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.318 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[InplaceTopKDistance]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.334 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[InvGrad]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.346 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[InvertPermutation]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.359 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[IsClose]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.375 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[IsInf]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.387 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[IsNan]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.402 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Less]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.414 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[LinSpace]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.429 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[LinearSumAssignment]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.441 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Log]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.457 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Log1p]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.470 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[LogMatrixDeterminant]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.485 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[LogSoftmaxV2]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.497 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[LogUniformCandidateSampler]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.513 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[MaskedFill]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.525 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[MaskedScatter]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.541 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[MaskedSelect]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.553 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[MaskedSelectGrad]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.889.547 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.569 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[MatMul]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.586 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[MatrixDiagPartV3]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.599 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[MatrixDiagV3]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.615 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[MinAreaPolygons]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.627 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Mul]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.642 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[MultinomialAliasDraw]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.654 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[MultinomialAliasSetup]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.675 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[MultinomialWithReplacement]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.687 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[NLLLoss]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.701 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[NLLLossGrad]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.716 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[NMSWithMask]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.728 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Neg]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.741 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[NonMaxSuppressionV3]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.757 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[NonZero]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.770 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[NonZeroWithValueShape]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.786 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[NonZeroWithValueShapeV2]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.798 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[NotEqual]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.813 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[OnesLike]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.825 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[PSAMask]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.841 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[PSAMaskGrad]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.853 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Pad]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.889.857 [op_impl_space_registry.cc:240]618666 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.869 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[PadD]."
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.889.881 [opp_so_manager.cc:48]618666 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.886 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[PadV3]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.903 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[PadV3Grad]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.917 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Pinverse]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.933 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Poisson]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.945 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Pow]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.961 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[ProdEnvMatACalcRij]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.974 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[RNNTLoss]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.889.979 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.889.995 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.889.990 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[RandomStandardNormal]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.890.008 [opp_so_manager.cc:45]618666 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.007 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[RandomUniform]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.025 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[RealDiv]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.039 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[ReduceAll]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.051 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[ReduceMean]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.067 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[ReduceSum]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.079 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Reshape]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.099 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Resize]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.111 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[ResizeBilinear]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.127 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[ResizeBilinearGrad]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.890.126 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NLLLossGrad310p] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.141 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[ResizeBilinearV2Grad]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.158 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[ResizeGrad]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.175 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[ResizeTrilinear]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.187 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[ReverseSequence]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.203 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[RightShift]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.216 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[RoiPoolingWithArgMax]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.231 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[RotatedNMS]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.244 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Round]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.260 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Rsqrt]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.272 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[STFT]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.287 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[ScatterAddWithAxis]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.300 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[ScatterElements]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.890.297 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.315 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[ScatterNdAdd]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.333 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[ScatterNdMax]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.349 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[ScatterNdMin]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.362 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[SearchSorted]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.377 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[SelectV2]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.389 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Sigmoid]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.405 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[SigmoidGrad]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.417 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Sign]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.430 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[SilentCheck]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.446 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[SilentCheckV2]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.461 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[SilentCheckV3]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.890.466 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.477 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[SliceWrite]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.494 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[SoftmaxV2]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.511 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Sort]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.532 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[SparseFillEmptyRows]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.545 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[SparseSegmentMean]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.560 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[SparseSegmentMeanGrad]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.573 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[SparseSegmentSum]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.890.577 [op_impl_space_registry.cc:240]618666 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.589 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[SparseToDense]."
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.890.600 [opp_so_manager.cc:48]618666 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.890.597 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DropoutWithMulsAndSoftmaxGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.606 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[SpatialTransformer]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.623 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[SplitD]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.636 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[SplitV]."
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.890.641 [opp_so_manager.cc:97]618666 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.652 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Sqrt]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.668 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[SqrtGrad]."
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.890.674 [opp_so_manager.cc:97]618666 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.682 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Square]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.698 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[SquaredDifference]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.715 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[StatelessBernoulli]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.727 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[StatelessRandomUniformV2]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.743 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[StatelessRandperm]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.890.754 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.756 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[StridedSlice]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.890.769 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.773 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[StridedSliceV2]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.890.782 [opp_so_manager.cc:45]618666 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.890.778 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.790 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Sub]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.807 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[TableToResource]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.825 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Tan]."
[WARNING] DEVICE(618658,fffec77eefa0,python3.9):2025-04-03-09:27:41.890.779 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:248] QueryUniqueID] Retry to lookup the unique id for group hccl_world_group from the meta server node...Retry time: 395/400, sleep 2
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.842 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[TanhGrad]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.859 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[TensorEqual]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.876 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[TensorScatterUpdate]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.889 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[ThreeNN]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.904 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Tile]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.916 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[TileWithAxis]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.932 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[TopK]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.890.938 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.944 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[TopKPQDistance]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.965 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[TopKPQDistanceV2]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.890.972 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.980 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[TopKV2D]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.890.995 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Trace]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.891.008 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[TransData]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.891.024 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[TransDataRNN]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.891.039 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Tril]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.891.055 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Triu]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.891.072 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[UniformCandidateSampler]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.891.089 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[UninitEmbeddingHashmap]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.891.093 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.891.105 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[UninitPartitionMap]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.891.123 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[UniqueConsecutive]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.891.127 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.891.140 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[UniqueWithCountsAndSorting]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.891.154 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[UniqueWithCountsExt2]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.891.170 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[UpsampleNearest3d]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.891.183 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[UpsampleNearest3dGrad]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.891.198 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[UpsampleTrilinear3d]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.891.211 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[UpsampleTrilinear3dGrad]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.891.227 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[ViewCopy]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.891.239 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Voxelization]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.891.255 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[WarpAffine]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.891.267 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[ZerosLike]."
[INFO] AICPU(618670,python3.9):2025-04-03-09:27:41.891.283 [folding.cc:413][InitCpuConstantFoldingNew][tid:618670]:"Register op[Zeta]."
[INFO] OP(618670,python3.9):2025-04-03-09:27:41.891.299 [host_cpu_kernel_wrapper.cpp:118][OP_PROTO][Initialize][618670] OpName:[HostCpuKernelWrapperOp] "Host cpu init success"
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.891.315 [host_cpu_engine.cc:273]618670 LoadLib:Lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libops_host_cpu.so has been opened
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.891.330 [op_impl_space_registry.cc:240]618666 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.891.351 [opp_so_manager.cc:48]618666 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.891.433 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.891.447 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.891.438 [plugin_manager.cc:872]618670 LoadWithFlags:Dlopen path: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/plugin/engines/runtime/libdvpp_rtkernel.so. flags is 4354
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.891.460 [opp_so_manager.cc:45]618666 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.891.477 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.891.596 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.891.768 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachBinaryOp] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.891.935 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.891.996 [op_impl_space_registry.cc:240]618666 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.892.025 [opp_so_manager.cc:48]618666 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.892.061 [opp_so_manager.cc:97]618666 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.892.069 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.892.091 [opp_so_manager.cc:97]618666 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.892.184 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.892.201 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.892.212 [opp_so_manager.cc:45]618666 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.892.179 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DefaultImpl] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.892.417 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.892.620 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.892.748 [op_impl_space_registry.cc:240]618666 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.892.769 [opp_so_manager.cc:48]618666 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.892.779 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.892.852 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.892.868 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.892.853 [op_tiling_registry.cc:162]618654 OpTilingFuncRegistry:Register op tiling and parse function V4 for op_type:Aipp
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.892.881 [opp_so_manager.cc:45]618666 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.892.904 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.892.986 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:AvgPool1DD
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.893.029 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.893.099 [op_tiling_registry.cc:162]618654 OpTilingFuncRegistry:Register op tiling and parse function V4 for op_type:AutoTiling
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.893.212 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InstanceNormV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.893.215 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Bias
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.893.341 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:INTrainingUpdateV2
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.893.398 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IouV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.893.414 [op_impl_space_registry.cc:240]618666 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.893.436 [opp_so_manager.cc:48]618666 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.893.449 [op_tiling_registry.cc:134]618654 OpTilingFuncRegistry:Register op tiling function V2 for op_type:CheckValid
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.893.472 [opp_so_manager.cc:97]618666 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.893.504 [opp_so_manager.cc:97]618666 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.893.566 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ConcatD
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.893.581 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.893.583 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BidirectionLSTM] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.893.588 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ConcatV2D
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.893.607 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.893.619 [opp_so_manager.cc:45]618666 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.893.614 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Pack
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.893.616 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BidirectionLSTMV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.893.722 [op_tiling_registry.cc:134]618654 OpTilingFuncRegistry:Register op tiling function V2 for op_type:ConcatOffset
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.893.793 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.893.822 [op_tiling_registry.cc:134]618654 OpTilingFuncRegistry:Register op tiling function V2 for op_type:Diag
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.893.824 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.893.924 [op_tiling_registry.cc:134]618654 OpTilingFuncRegistry:Register op tiling function V2 for op_type:DiagPart
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.893.997 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaskedSelectV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.894.029 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:DynSeqOuter
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.894.136 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Expand
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.894.156 [op_impl_space_registry.cc:240]618666 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.894.177 [opp_so_manager.cc:48]618666 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.894.189 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.894.259 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.894.274 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.894.285 [opp_so_manager.cc:45]618666 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.894.492 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Ger
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.894.590 [op_tiling_registry.cc:122]618654 OpTilingFuncRegistry:Register op tiling function V1 for op_type:IFMR
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.894.702 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:InTopKD
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.894.810 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:KlDivLossGrad
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.894.818 [op_impl_space_registry.cc:240]618666 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.894.840 [opp_so_manager.cc:48]618666 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.894.875 [opp_so_manager.cc:97]618666 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.894.905 [opp_so_manager.cc:97]618666 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.894.917 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:L1LossGrad
[WARNING] GE(618666,python3.9):2025-04-03-09:27:41.894.938 [opp_so_manager.cc:97]618666 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/usr/local/Ascend/ascend-toolkit/latest/opp/op_proto/custom/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.895.005 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 0 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.895.020 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNorm
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.895.047 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.895.029 [plugin_manager.cc:883]618670 LoadWithFlags:The shared library will not be checked. Please ensure that the source of the shared library is trusted.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.895.063 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.895.074 [opp_so_manager.cc:45]618666 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.895.043 [operator_factory_impl.cc:368]618662 RegisterInferAxisTypeInfoFunc:axis type info derivation funcs init
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.895.048 [operator_factory_impl.cc:368]618674 RegisterInferAxisTypeInfoFunc:axis type info derivation funcs init
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.895.099 [ops_kernel_executor_manager.cc:37]618670 Initialize:No library to load
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.895.127 [plugin_manager.cc:540]618670 GetOpsProtoPath:Enter GetOpsProtoPath schedule
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.895.128 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNormBetaGammaBackpropV2
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.895.139 [plugin_manager.cc:108]618670 GetOppPath:Enter get opp path schedule
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.895.175 [plugin_manager.cc:117]618670 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.895.197 [plugin_manager.cc:547]618670 GetOpsProtoPath:Opp plugin path structure is new version!
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.895.214 [plugin_manager.cc:206]618670 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.895.280 [operator_factory_impl.cc:284]618674 RegisterInferDataSliceFunc:operator_infer_data_slice_funcs_ init
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.895.280 [operator_factory_impl.cc:284]618662 RegisterInferDataSliceFunc:operator_infer_data_slice_funcs_ init
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.895.315 [op_tiling_registry.cc:122]618654 OpTilingFuncRegistry:Register op tiling function V1 for op_type:LayerNormXBackprop
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.895.435 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNormXBackpropV2
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.895.479 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [MatrixBandPart] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.895.481 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [MatrixBandPart] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.895.505 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [CheckNumerics] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.895.522 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [UnravelIndex] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.895.535 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [UpperBound] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.895.504 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [CheckNumerics] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.895.522 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [UnravelIndex] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.895.550 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [ListDiff] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.895.554 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [UpperBound] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.895.548 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNormXBackpropV3
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.895.572 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [ListDiff] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.895.574 [operator_factory_impl.cc:254]618674 RegisterInferFormatFunc:operator_inferformat_funcs_ init
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.895.594 [operator_factory_impl.cc:254]618662 RegisterInferFormatFunc:operator_inferformat_funcs_ init
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.895.600 [operator_factory_impl.cc:340]618674 RegisterInferAxisSliceFunc:axis slice derivation funcs init
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.895.619 [operator_factory_impl.cc:340]618662 RegisterInferAxisSliceFunc:axis slice derivation funcs init
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.895.636 [operator_factory_impl.cc:307]618674 RegisterInferValueRangeFunc:operator_infervalue_paras_ init
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.895.644 [operator_factory_impl.cc:307]618662 RegisterInferValueRangeFunc:operator_infervalue_paras_ init
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.895.649 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LpNormReduce
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.895.666 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LpNormReduceV2
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.895.672 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [IdentityN] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.895.678 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [IdentityN] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.895.697 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [LowerBound] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.895.697 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [LowerBound] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.895.718 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Expand] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.895.718 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Expand] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.895.724 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.895.770 [op_tiling_registry.cc:134]618654 OpTilingFuncRegistry:Register op tiling function V2 for op_type:LRUCacheV2
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.895.840 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [LeftShift] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.895.845 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [LeftShift] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.895.882 [op_tiling_registry.cc:134]618654 OpTilingFuncRegistry:Register op tiling function V2 for op_type:MaxPoolGradWithArgmaxV2
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.895.910 [op_tiling_registry.cc:134]618654 OpTilingFuncRegistry:Register op tiling function V2 for op_type:MaxPoolGradWithArgmaxV1
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.896.006 [op_tiling_registry.cc:122]618654 OpTilingFuncRegistry:Register op tiling function V1 for op_type:MaxPoolWithArgmaxV2
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.896.113 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:MovingSumWithSigmoid
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.896.113 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.896.198 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.896.217 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.896.231 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.896.236 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:MseLossGrad
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.896.284 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.896.434 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:NMSWithMask
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.896.612 [op_tiling_registry.cc:122]618654 OpTilingFuncRegistry:Register op tiling function V1 for op_type:PadD
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.896.631 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.896.666 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.896.683 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.896.695 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.896.711 [op_tiling_registry.cc:122]618654 OpTilingFuncRegistry:Register op tiling function V1 for op_type:PadV3Grad
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.896.734 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.896.745 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Reciprocal] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.896.745 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Reciprocal] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.896.776 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Sign] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.896.776 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.896.777 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Sign] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.896.801 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Div] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.896.799 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Div] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.896.796 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.896.820 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Exp] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.896.814 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ReduceStdWithMean
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.896.824 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.896.822 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Exp] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.896.840 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.896.844 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [LessEqual] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.896.842 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [LessEqual] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.896.859 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Log1p] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.896.859 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Log1p] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.896.873 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.896.888 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.896.880 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [DivNoNan] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.896.879 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [DivNoNan] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.896.902 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.896.918 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.896.918 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Mul] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.896.918 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Mul] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.896.921 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Resize
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.896.938 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [SqrtGrad] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.896.937 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [SqrtGrad] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.896.952 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Log] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.896.955 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Log] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.896.972 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [AddN] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.896.971 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [AddN] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.896.996 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [AcosGrad] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.896.999 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [AcosGrad] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.897.015 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [AcoshGrad] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.897.014 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [AcoshGrad] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.897.046 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [BiasAdd] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.897.045 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [BiasAdd] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.897.076 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [FloorDiv] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.897.077 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [FloorDiv] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.897.099 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [ArgMin] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.897.100 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [ArgMin] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.897.165 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [MulNoNan] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.897.166 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [MulNoNan] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.897.206 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [AsinGrad] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.897.218 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [AsinGrad] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.897.226 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Cos] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.897.236 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Cos] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.897.244 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Sin] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.897.254 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Sin] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.897.256 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.897.286 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [AsinhGrad] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.897.275 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [AsinhGrad] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.897.289 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.897.310 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Expm1] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.897.310 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Expm1] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.897.306 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.897.319 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.897.346 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ResizeBilinearV2
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.897.357 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.897.458 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ReverseV2
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.897.567 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Scale
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.897.701 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.897.733 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.897.750 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.897.761 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.897.750 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SigmoidFocalLoss
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.897.797 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.897.833 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.897.859 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.897.857 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SigmoidFocalLossGrad
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.897.876 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.897.893 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.897.924 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.897.939 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.897.951 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.897.967 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.897.977 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SignBitsPack
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.898.084 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SignBitsUnpack
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.898.184 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SmoothL1LossGradV2
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.898.284 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SmoothL1LossV2
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.898.304 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.898.336 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.898.352 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.898.364 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.898.387 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SoftMarginLossGrad
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.898.401 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.898.502 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SoftmaxFocalLossGrad
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.898.548 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [AdjustHue] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.898.548 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [AdjustHue] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.898.574 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [AdjustSaturation] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.898.574 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [AdjustSaturation] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.898.597 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [ExtractGlimpse] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.898.597 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [ExtractGlimpse] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.898.601 [op_tiling_registry.cc:134]618654 OpTilingFuncRegistry:Register op tiling function V2 for op_type:Sort
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.898.619 [op_tiling_registry.cc:134]618654 OpTilingFuncRegistry:Register op tiling function V2 for op_type:SortV2
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.898.619 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [ResizeArea] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.898.619 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [ResizeArea] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.898.635 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [ResizeBicubic] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.898.636 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [ResizeBicubic] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.898.655 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [RGBToHSV] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.898.656 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [RGBToHSV] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.898.678 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [NonMaxSuppressionWithOverlaps] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.898.676 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [NonMaxSuppressionWithOverlaps] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.898.715 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [ScaleAndTranslate] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.898.731 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [ScaleAndTranslateGrad] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.898.715 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [ScaleAndTranslate] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.898.732 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [ScaleAndTranslateGrad] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.898.719 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SparseApplyFtrlD
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.898.745 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [CombinedNonMaxSuppression] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.898.742 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.898.746 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [CombinedNonMaxSuppression] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.898.774 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.898.791 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.898.803 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.898.833 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SparseReshape
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.898.840 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.898.844 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [CholeskyGrad] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.898.843 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [CholeskyGrad] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.898.863 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Cholesky] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.898.863 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Cholesky] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.898.880 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [MatrixDeterminant] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.898.881 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [MatrixDeterminant] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.898.876 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.898.903 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.898.895 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [MatrixSolve] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.898.895 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [MatrixSolve] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.898.912 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [MatrixTriangularSolve] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.898.912 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [MatrixTriangularSolve] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.898.927 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Qr] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.898.919 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.898.926 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Qr] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.898.936 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.898.944 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SplitV
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.898.963 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Split
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.898.967 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.898.983 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.898.998 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.899.013 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.899.059 [op_tiling_registry.cc:122]618654 OpTilingFuncRegistry:Register op tiling function V1 for op_type:SquareSumAll
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.899.164 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SyncBatchNormGatherStats
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.899.259 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Digamma] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.899.259 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Digamma] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.899.272 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Tile
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.899.281 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Igamma] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.899.280 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Igamma] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.899.296 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Igammac] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.899.299 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Igammac] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.899.312 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Bincount] has registered infer func
[WARNING] GE([WARNING] GE(618674,python3.9):2025-04-03-09:27:41.899.317 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Bincount] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.899.332 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Betainc] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.899.346 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Bucketize] has registered infer func
618662,python3.9):2025-04-03-09:27:41.899.328 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Betainc] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.899.347 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.899.363 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Bucketize] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.899.362 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [IgammaGradA] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.899.370 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:TileD
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.899.380 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [IgammaGradA] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.899.381 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.899.398 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.899.413 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.899.388 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [NextAfter] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.899.406 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [NextAfter] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.899.421 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [IsInf] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.899.436 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [IsNan] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.899.425 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [IsInf] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.899.441 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [IsNan] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.899.448 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.899.451 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Conj] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.899.456 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Conj] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.899.477 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Complex] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.899.484 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Complex] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.899.480 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:TileWithAxis
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.899.493 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Angle] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.899.500 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Angle] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.899.674 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Unpack
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.899.732 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [ScatterNdUpdate] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.899.732 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [ScatterNdUpdate] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.899.754 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [TensorScatterUpdate] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.899.753 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [TensorScatterUpdate] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.899.775 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.899.788 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.899.811 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Tril] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.899.812 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Tril] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.899.819 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.899.830 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [IndexPut] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.899.829 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [IndexPut] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.899.836 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.899.845 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Eye] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.899.846 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Eye] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.899.860 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [FillDiagonal] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.899.850 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.899.873 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Trace] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.899.860 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [FillDiagonal] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.899.869 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [OpExecuteFunc]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.899.878 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Trace] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.899.886 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.899.922 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.899.945 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.899.958 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.899.950 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.899.972 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.900.004 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.900.020 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.900.032 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.900.049 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.900.031 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AscendAntiQuantV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.900.117 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.900.215 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.900.245 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.900.335 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Concat] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.900.363 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ConcatV2] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.900.390 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.900.418 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.900.421 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.900.457 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.900.475 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.900.487 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.900.530 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.900.545 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.900.624 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.900.709 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.900.786 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : [OpExecuteFunc]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.900.799 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [DecodeBbox] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.900.828 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [ClipBoxes] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.900.799 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [DecodeBbox] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.900.827 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [ClipBoxes] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.900.846 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [ClipBoxesD] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.900.847 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [ClipBoxesD] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.900.870 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [DecodeBoundariesTarget] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.900.869 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [DecodeBoundariesTarget] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.900.871 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.900.887 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [DecodeCornerpointsTargetBG] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.900.885 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [DecodeCornerpointsTargetBG] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.900.881 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [OpExecuteFunc]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.900.902 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [DecodeCornerpointsTargetWrtCenterV1] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.900.904 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [DecodeCornerpointsTargetWrtCenterV1] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.900.905 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.900.922 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [DecodeWheelsTarget] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.900.920 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [DecodeWheelsTarget] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.900.924 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.900.939 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.900.971 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.900.974 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.901.000 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [OpExecuteFunc]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.901.012 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.901.044 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.901.057 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.901.050 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [SparseSoftmaxCrossEntropyWithLogits] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.901.052 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [SparseSoftmaxCrossEntropyWithLogits] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.901.071 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.901.075 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [OpExecuteFunc]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.901.104 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.901.108 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [OpExecuteFunc]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.901.121 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.901.135 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.901.151 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.901.135 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [OpExecuteFunc]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.901.142 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [KlDivLossGrad] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.901.144 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [KlDivLossGrad] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.901.164 [plugin_manager.cc:218]618670 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.901.186 [plugin_manager.cc:422]618670 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.901.202 [plugin_manager.cc:155]618670 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.901.216 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.901.226 [plugin_manager.cc:158]618670 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.901.242 [plugin_manager.cc:426]618670 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.901.306 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.901.390 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.901.469 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [OpExecuteFunc]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.901.531 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [FractionalMaxPoolGrad] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.901.552 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [FractionalAvgPool] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.901.550 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [OpExecuteFunc]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.901.533 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [FractionalMaxPoolGrad] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.901.538 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.901.568 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [FractionalAvgPool] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.901.567 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [FractionalMaxPool] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.901.583 [operator_fac[INFO] GE(618670,python3.9):2025-04-03-09:27:41.901.575 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.901.585 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [FractionalMaxPool] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.901.587 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
tory_impl.cc:222]618674 RegisterInferShapeFunc:op [DataFormatVecPermute] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.901.601 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [DataFormatVecPermute] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.901.614 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [FractionalAvgPoolGrad] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.901.612 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [FractionalAvgPoolGrad] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.901.628 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [NthElement] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.901.609 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.901.637 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.901.627 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [NthElement] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.901.629 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [OpExecuteFunc]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.901.652 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.901.690 [plugin_manager.cc:439]618670 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspo
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.901.708 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.901.711 [ge_executor.cc:259]618670 InitOpsProtoManager:Get opsproto path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/minds
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.901.788 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.901.869 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.901.952 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.902.057 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.902.069 [plugin_manager.cc:996]618670 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.902.101 [plugin_manager.cc:1011]618670 GetCurEnvPackageOsAndCpuType:Get os:linux
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.902.111 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Tanh] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.902.111 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Tanh] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.902.124 [plugin_manager.cc:1015]618670 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.902.143 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.902.228 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.902.228 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.902.246 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.902.309 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.902.324 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.902.341 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.902.373 [opsproto_manager.cc:123]618670 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.902.391 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.902.432 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.902.448 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.902.441 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Pad] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.902.440 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Pad] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.902.466 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [PadV3] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.902.465 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [PadV3] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.902.467 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [OpExecuteFunc]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.902.479 [opsproto_manager.cc:123]618670 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.902.484 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [PadV3Grad] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.902.482 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [PadV3Grad] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.902.505 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [BroadcastTo] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.902.503 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [BroadcastTo] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.902.529 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.902.544 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 2 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.902.551 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.902.606 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.902.622 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.902.680 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [RaggedRange] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.902.681 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [RaggedRange] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.902.684 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.902.701 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.902.729 [opsproto_manager.cc:123]618670 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.902.772 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.902.787 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 3 libs.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.902.814 [opsproto_manager.cc:123]618670 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.902.831 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [ShuffleChannel] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.902.831 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [ShuffleChannel] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.902.856 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.902.873 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 4 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.902.935 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.902.951 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.903.013 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.903.034 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.903.061 [opsproto_manager.cc:123]618670 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.903.104 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.903.119 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 5 libs.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.903.127 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [ReduceSum] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.903.126 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [ReduceSum] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.903.145 [opsproto_manager.cc:123]618670 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.903.152 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [ReduceProd] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.903.155 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [ReduceProd] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.903.189 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.903.206 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 6 libs.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.903.187 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [INInferV2] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.903.205 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [INInferV2] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.903.191 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [INInferV2] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.903.209 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [INInferV2] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.903.273 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.903.288 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.903.351 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.903.367 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.903.393 [opsproto_manager.cc:123]618670 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.903.435 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.903.450 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 7 libs.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.903.476 [opsproto_manager.cc:123]618670 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.903.518 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.903.533 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 8 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.903.598 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.903.614 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.903.675 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.903.690 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.903.716 [opsproto_manager.cc:123]618670 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.903.759 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.903.774 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 9 libs.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.903.800 [opsproto_manager.cc:123]618670 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.903.819 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [UnsortedSegmentSum] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.903.819 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [UnsortedSegmentSum] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.903.842 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.903.857 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 10 libs.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.903.861 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [ReverseV2] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.903.859 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [ReverseV2] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.903.880 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Select] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.903.884 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Select] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.903.885 [opsproto_manager.cc:123]618670 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/usr/local/Ascend/ascend-toolkit/latest/opp/op_proto/custom/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.903.904 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [SegmentSum] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.903.907 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [SegmentSum] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.903.925 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Slice] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.903.928 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 10 libs.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.903.928 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Slice] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.903.946 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [OneHot] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.903.948 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [OneHot] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.903.970 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [ScatterNd] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.903.973 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [ScatterNd] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.903.994 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.904.010 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt2.0.so.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.903.996 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Cumprod] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.903.997 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Cumprod] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.904.023 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.904.038 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 3 libs.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.904.049 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [CumulativeLogsumexp] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.904.051 [opsproto_manager.cc:147]618670 LoadOpsProtoPluginSo:[LoadSo][Check] Shared library will not be checked. Please make sure that the source of shared library is trusted.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.904.049 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [CumulativeLogsumexp] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.904.092 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [MaskedSelect] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.904.103 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [MaskedSelect] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.904.431 [operator_factory_impl.cc:215]618670 RegisterInferShapeFunc:operator_infershape_funcs_ init
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.904.459 [operator_factory_impl.cc:269]618670 RegisterVerifyFunc:operator_verify_funcs_ init
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.904.452 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.904.504 [opsproto_manager.cc:162]618670 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.904.532 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Concat] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.904.532 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Concat] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.904.725 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.904.732 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [NonDeterministicInts] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.904.735 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [NonDeterministicInts] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.905.033 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [Flatten] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.905.035 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [Flatten] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.905.035 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MedianDim] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.905.064 [operator_factory_impl.cc:222]618674 RegisterInferShapeFunc:op [DepthToSpace] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.905.063 [operator_factory_impl.cc:222]618662 RegisterInferShapeFunc:op [DepthToSpace] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.905.372 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.905.583 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.905.692 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.905.692 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.905.733 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[EluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.905.732 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[EluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.905.759 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.905.758 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.905.781 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.905.783 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.905.795 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.905.809 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SyncBNTrainingUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.905.810 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SyncBNTrainingUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.905.837 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Abs] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.905.844 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Abs] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.905.866 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Real] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.905.871 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Real] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.905.891 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Acos] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.905.895 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Acos] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.905.917 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Acosh] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.905.919 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Acosh] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.905.943 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddMatMatElements] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.905.945 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddMatMatElements] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.905.970 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Adds] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.905.970 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Adds] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.905.964 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.905.995 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Asin] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.905.995 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Asin] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.021 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Asinh] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.023 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Asinh] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.046 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AssignAdd] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.048 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AssignAdd] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.071 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AssignSub] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.072 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AssignSub] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.097 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Atan] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.097 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Atan] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.122 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Atanh] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.121 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Atanh] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.142 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.146 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.906.151 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeTutelCombineGates] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.164 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BesselI0e] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.172 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BesselI0e] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.195 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BesselI1e] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.190 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BesselI1e] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.215 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.222 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.239 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.246 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.267 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.262 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.288 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.295 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.315 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Bucketize] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.323 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Bucketize] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.341 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Cast] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.348 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Cast] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.906.346 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeTutelCombineX] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.366 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Ceil] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.373 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Ceil] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.392 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CeluV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.398 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CeluV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.421 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ComplexAbs] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.429 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ComplexAbs] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.453 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Cos] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.459 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Cos] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.479 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Cosh] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.484 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Cosh] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.906.495 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeTutelDispatch] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.500 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.505 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.527 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DataFormatDimMap] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.530 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DataFormatDimMap] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.554 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Dequantize] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.555 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Dequantize] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.580 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Elu] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.580 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Elu] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.906.592 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.605 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Erf] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.606 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Erf] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.632 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Erfc] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.632 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Erfc] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.657 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Exp] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.657 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Exp] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.682 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Expm1] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.683 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Expm1] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.906.683 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:DepthToSpace
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.906.713 [op_tiling_registry.cc:148]618654 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SpaceToDepth
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.708 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FakeQuantWithMinMaxVars] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.711 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FakeQuantWithMinMaxVars] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.734 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FastGelu] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.736 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FastGelu] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.759 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FastGeluV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.760 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FastGeluV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.785 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Floor] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.786 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Floor] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.813 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FusedMulAddN] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.812 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FusedMulAddN] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.842 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HardSigmoid] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.843 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HardSigmoid] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.906.854 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScore] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.866 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HardShrink] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.874 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HardShrink] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.893 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HardShrinkGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.899 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HardShrinkGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.919 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HardSwish] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.923 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HardSwish] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.946 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HardSwishGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.944 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HardSwishGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.971 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HardtanhGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.906.975 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HardtanhGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.906.991 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.906.997 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IndexFillD] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.000 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IndexFillD] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.020 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.023 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.042 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.046 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.070 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Inv] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.073 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Inv] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.095 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Invert] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.098 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Invert] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.122 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Log] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.125 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Log] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.147 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Log1p] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.149 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Log1p] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.907.146 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.173 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LogicalNot] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.174 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LogicalNot] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.201 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LogAddExp] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.207 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LogAddExp] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.226 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LpNormUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.234 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LpNormUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.250 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LpNormUpdateV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.257 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LpNormUpdateV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.281 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Dawsn] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.283 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Dawsn] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.307 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Expint] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.308 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Expint] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.333 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Erfinv] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.332 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Erfinv] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.357 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FresnelCos] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.357 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FresnelCos] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.381 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FresnelSin] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.382 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FresnelSin] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.408 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Ndtri] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.408 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Ndtri] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.433 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Spence] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.434 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Spence] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.458 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Fills] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.458 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Fills] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.483 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LeakyRelu] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.487 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LeakyRelu] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.508 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[OnesLike] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.517 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[OnesLike] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.533 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Reciprocal] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.547 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Reciprocal] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.562 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Sign] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.574 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Sign] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.588 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Sqrt] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.600 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Sqrt] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.618 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Tanh] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.624 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Tanh] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.907.633 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Rfft1D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.646 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ZerosLike] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.648 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ZerosLike] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.673 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Gelu] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.672 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Gelu] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.698 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GeluV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.698 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GeluV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.725 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Relu] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.727 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Relu] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.749 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Neg] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.751 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Neg] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.775 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LogSoftmaxV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.774 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LogSoftmaxV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.796 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.797 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.907.795 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.823 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftmaxV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.823 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftmaxV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.846 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.845 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.872 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftplusV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.871 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftplusV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.899 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Muls] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.900 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Muls] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.926 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Power] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.927 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Power] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.953 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Relu6] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.951 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Relu6] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.907.959 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.907.976 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Relu6D] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.907.977 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Relu6D] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.907.994 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GemmaRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.001 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Relu6Grad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.002 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Relu6Grad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.026 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.029 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.052 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Rint] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.054 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Rint] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.079 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Round] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.078 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Round] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.105 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Rsqrt] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.105 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Rsqrt] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.908.107 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.908.112 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.134 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RsqrtGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.130 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RsqrtGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.179 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Selu] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.180 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Selu] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.211 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Shrink] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.210 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Shrink] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.235 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Sigmoid] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.237 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Sigmoid] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.908.248 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.265 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.260 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.908.267 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.293 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SigmoidGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.298 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SigmoidGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.319 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Sin] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.327 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Sin] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.343 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Sinh] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.351 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Sinh] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.368 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SmoothL1Loss] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.375 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SmoothL1Loss] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.908.369 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.394 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SmoothL1LossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.399 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SmoothL1LossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.422 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LogSigmoid] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.423 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LogSigmoid] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.448 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LogSigmoidGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.448 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LogSigmoidGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.908.461 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LinearIndex] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.473 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LogSpaceD] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.472 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LogSpaceD] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.495 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Softplus] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.497 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Softplus] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.521 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Softsign] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.520 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Softsign] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.545 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SqrtGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.546 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SqrtGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.570 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Square] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.569 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Square] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.595 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Swish] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.595 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Swish] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.619 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwishGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.621 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwishGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.643 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SiluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.647 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SiluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.908.643 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.669 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardElemt] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.670 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardElemt] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.908.666 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LinearIndexV2] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.696 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Tan] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.696 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Tan] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.721 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftShrink] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.722 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftShrink] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.747 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftShrinkGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.751 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftShrinkGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.908.769 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.777 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Threshold] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.779 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Threshold] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.802 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ThresholdV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.801 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ThresholdV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.826 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ThresholdV2D] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.833 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ThresholdV2D] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.852 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Trunc] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.857 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Trunc] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.877 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.908.871 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterAddWithSorted] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.874 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.908.890 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DeformableOffsetsGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.903 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.906 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.930 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MishGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.936 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MishGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.958 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HardSigmoidGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.960 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HardSigmoidGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.908.979 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.908.980 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.002 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.001 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.909.003 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.025 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.025 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.046 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.047 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.909.046 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Sinkhorn] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.071 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FillDiagonal] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.071 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FillDiagonal] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.097 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IndexPut] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.104 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IndexPut] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.123 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReadVariableOp] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.131 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReadVariableOp] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.149 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CastLike] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.156 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CastLike] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.909.154 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.175 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FusedBiasLeakyRelu] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.909.171 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.181 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FusedBiasLeakyRelu] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.206 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StatelessBernoulliV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.202 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StatelessBernoulliV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.225 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.227 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.247 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InvertPermutation] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.252 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InvertPermutation] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.269 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.909.265 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.273 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.295 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SearchSorted] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.294 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SearchSorted] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.909.297 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.316 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.315 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.909.328 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.339 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.339 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.361 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.361 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.382 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.382 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.405 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.405 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.909.421 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.528 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaskedScale] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.529 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaskedScale] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.558 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AbsGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.559 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AbsGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.909.569 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.587 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AccumulateNV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.583 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AccumulateNV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.612 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddN] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.621 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddN] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.638 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Eltwise] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.647 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Eltwise] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.664 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.671 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.909.684 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.691 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AcosGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.697 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AcosGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.715 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AcoshGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.720 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AcoshGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.741 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AsinGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.749 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AsinGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.766 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AsinhGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.773 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AsinhGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.792 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Atan2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.797 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Atan2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.909.799 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.816 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AtanGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.820 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AtanGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.844 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Axpy] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.842 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Axpy] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.867 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BitwiseAnd] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.868 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BitwiseAnd] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.892 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BitwiseOr] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.892 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BitwiseOr] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.917 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BitwiseXor] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.919 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BitwiseXor] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.909.927 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachNonFiniteCheckAndUnscale] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.944 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Div] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.950 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Div] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.909.971 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DivNoNan] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.975 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DivNoNan] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.909.999 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[EluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.000 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[EluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.025 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FastGeluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.027 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FastGeluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.910.027 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.050 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FloorDiv] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.052 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FloorDiv] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.910.051 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.076 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FloorMod] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.078 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FloorMod] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.101 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InvGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.103 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InvGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.126 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LeakyReluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.128 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LeakyReluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.150 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TanhGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.158 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TanhGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.175 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Add] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.910.174 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.184 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Add] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.200 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Addcdiv] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.910.205 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.208 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Addcdiv] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.232 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Addcmul] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.224 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Addcmul] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.910.248 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StackGroupPoints] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.257 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AxpyV2] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.259 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AxpyV2] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.283 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LogicalAnd] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.285 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LogicalAnd] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.309 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LogicalOr] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.309 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LogicalOr] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.335 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Mul] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.337 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Mul] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.361 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Pow] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.361 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Pow] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.910.360 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GatherV3] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.386 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RealDiv] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.386 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RealDiv] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.413 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ClipByNormNoDivSum] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.416 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ClipByNormNoDivSum] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.910.411 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.440 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ClipByValue] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.439 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ClipByValue] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.463 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ClipByValueV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.468 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ClipByValueV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.910.472 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.492 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FusedMulAdd] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.492 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FusedMulAdd] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.520 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftmaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.519 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftmaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.544 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Sub] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.545 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Sub] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.910.556 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.569 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Gcd] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.570 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Gcd] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.594 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LarsV2Update] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.597 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LarsV2Update] register OP_IMPL : [InferShape]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.910.581 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618646] [ServerToClientMsgProc] [sessionID=1]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.910.612 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618646] [TsdClient] DeviceMsgProc recvMsg realDeviceId[0] msgType[8] localDevId[0] rspCode[0]heterogeneousSubPid[0], tsdSupportLevel_[63]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.910.627 [hdc_client.cpp:172][TsdRecvData][tid:618646] [deviceId=0] the Tsd recv data already
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.910.611 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.621 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaskedFill] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.621 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaskedFill] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.646 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.646 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReluGrad] register OP_IMPL : [InferShape]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.910.660 [devmm_svm.c:132][ascend][curpid:618646,618646][drv][devmm][devmm_setup_device]DrvMemDeviceOpen. (devid=0)
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.672 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Xlog1py] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.674 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Xlog1py] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.698 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApproximateEqual] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.702 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApproximateEqual] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.910.716 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.727 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Equal] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.727 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Equal] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.910.736 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.910.749 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.752 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NotEqual] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.755 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NotEqual] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.779 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Greater] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.781 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Greater] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.803 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GreaterEqual] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.813 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GreaterEqual] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.827 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Less] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.838 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Less] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.852 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LessEqual] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.863 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LessEqual] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.910.863 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.878 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Maximum] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.888 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Maximum] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.910.888 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.910.892 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.913 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Minimum] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.912 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Minimum] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.938 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Mod] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.938 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Mod] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.959 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.960 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : [InferShape]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.910.958 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Igammac] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.910.987 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MulNoNan] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.910.986 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MulNoNan] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.911.011 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReciprocalGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.911.008 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.911.011 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReciprocalGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.911.009 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.911.038 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SeluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.911.038 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SeluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.911.040 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.911.065 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogits] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.911.064 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogits] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.911.071 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.911.091 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftplusGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.911.090 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftplusGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.911.117 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftplusV2Grad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.911.118 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftplusV2Grad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.911.128 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.911.142 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftsignGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.911.142 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftsignGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.911.166 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SquaredDifference] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.911.166 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SquaredDifference] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.911.187 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.911.188 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.911.212 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ThresholdGradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.911.212 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ThresholdGradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.911.225 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.911.236 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TruncateDiv] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.911.236 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TruncateDiv] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.911.260 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TruncateMod] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.911.265 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TruncateMod] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.911.285 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Xdivy] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.911.280 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LinSpace] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.911.288 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Xdivy] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.911.310 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IsClose] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.911.312 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IsClose] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.911.339 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Xlogy] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.911.341 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Xlogy] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.911.361 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.911.363 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.911.386 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SelectV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.911.385 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SelectV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.911.409 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaskedSelectV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.911.409 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MemSet] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.911.411 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaskedSelectV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.911.433 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Lerp] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.911.433 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.911.441 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Lerp] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.911.459 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FusedBiasLeakyReluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.911.467 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FusedBiasLeakyReluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.911.521 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.911.530 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.911.580 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.911.584 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.911.642 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.911.691 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.911.695 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.911.770 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.911.780 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.911.801 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.911.800 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.911.811 [opsproto_manager.cc:162]618670 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.911.882 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.911.895 [opsproto_manager.cc:162]618670 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.911.907 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.911.911 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.911.941 [opsproto_manager.cc:162]618670 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.911.974 [opsproto_manager.cc:162]618670 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.911.985 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.912.004 [opsproto_manager.cc:162]618670 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.912.003 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.912.017 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.912.035 [opsproto_manager.cc:162]618670 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.912.036 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.912.036 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.912.046 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.912.064 [opsproto_manager.cc:162]618670 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.912.064 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.912.065 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.912.094 [opsproto_manager.cc:162]618670 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.912.097 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.912.097 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.912.122 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.912.122 [opsproto_manager.cc:162]618670 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.912.121 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.912.125 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NPUClearFloatStatus] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.912.257 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.912.257 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.912.263 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NPUGetFloatStatus] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.912.268 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.912.303 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.912.368 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.912.370 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.912.384 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.912.415 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.912.476 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.912.475 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.912.590 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.912.591 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.912.644 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.912.694 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.912.694 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.912.762 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.912.754 [devmm_virt_interface.c:450][ascend][curpid:618646,618646][drv][devmm][devmm_ioctl_init_process]Init_process details. (hostpid=618646)
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.912.823 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.912.823 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.912.911 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.912.940 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Quantize] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.912.940 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Quantize] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.912.966 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.912.965 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.912.992 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AscendDequant] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.912.991 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AscendDequant] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.913.016 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.913.017 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.913.118 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.913.118 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : [InferShape]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.913.129 [drv_log_user.c:623][ascend][curpid:618646,618646][drv][devmm][share_log_read_in_single_module]Setup device succeeded. (logical_devid=0; devid=0; vfid=0; hostpid=618646; devpid=31737)
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.913.137 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.913.154 [devmm_svm.c:122][ascend][curpid:618646,618646][drv][devmm][devmm_set_device_info]Device info. (devid=0; dvpp_size=17179869184; support_bar_mem=1; support_dev_read_only=1; support_dev_mem_map_host=1; support_bar_huge_mem=1; is_alloced_by_malloc=0; host_rw_dev_ro=1; double_pgtable_offset=17592186044416; is_support_host_pin_pre_register=0; is_support_host_mem_pool=0)
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.913.228 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.913.230 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.913.255 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.913.261 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.913.255 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.913.282 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.913.291 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.913.304 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.913.313 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.913.323 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.913.335 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.913.359 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BasicLSTMInplaceFillWindowCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.913.361 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BasicLSTMInplaceFillWindowCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.913.384 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BasicGRUInplaceFillWindowCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.913.385 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BasicGRUInplaceFillWindowCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.913.421 [stub_process_mode_nowin.cpp:60][ProcessQueueForMdc][tid:618646] [TsdClient] it is unnecessary of current mode[0] to grant queue auth to aicpusd
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.913.441 [stub_process_mode_nowin.cpp:99][OpenInHost][tid:618646] enter into OpenInHost deviceid[0]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.913.463 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.913.479 [client_manager.cpp:435][IsHostEnvironment][tid:618646] [TsdClient] logicDeviceId is [0], hostaicpunum[0]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.913.494 [stub_process_mode_nowin.cpp:103][OpenInHost][tid:618646] host cpu not support
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.913.496 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.913.494 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : [InferShape]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.913.506 [process_mode_manager.cpp:121][OpenProcess][tid:618646] [TsdClient][deviceId=0] [sessionId=1] start hccp and computer process success
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.913.524 [runtime.cc:2879] 618646 startAicpuExecutor: userDeviceId=0, devId=0, tsdOpen ret=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.913.536 [runtime.cc:2891] 618646 startAicpuExecutor: TsdOpen success, devId=0, ret=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.913.553 [runtime.cc:3627] 618646 DeviceRetain: new dev ok id=0, rawDevSize=1328 (bytes), ts_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.913.565 [raw_device.cc:936] 618646 DevSetTsId: DevSetTsId, tsId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.913.579 [npu_driver.cc:2968] 618646 DeviceOpen: Open device start, device_id=0, tsId=0.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.913.602 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.913.606 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.913.621 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.913.679 [trs_sqcq.c:458][ascend][curpid:618646,618646][drv][tsdrv][trsDevSqCqInit]Sqcq init. (devid=0)
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.913.729 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.913.731 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.913.743 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.913.771 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.913.837 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.913.838 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.913.864 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.913.864 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.913.902 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.913.932 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.913.982 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdaCast] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.913.985 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdaCast] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.914.042 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.914.090 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.914.090 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.914.116 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.914.115 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.914.137 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.914.138 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : [InferShape]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.914.152 [trs_sqcq.c:394][ascend][curpid:618646,618646][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=0; tsId=0; id_type=6; num=2044)
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.914.153 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.914.160 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.914.159 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.914.184 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.914.266 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.914.266 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.914.298 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.914.381 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.914.378 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.914.410 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.914.489 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.914.489 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.914.526 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.914.594 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.914.595 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : [InferShape]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.914.597 [trs_sqcq.c:394][ascend][curpid:618646,618646][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=0; tsId=0; id_type=7; num=2044)
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.914.619 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.914.620 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.914.641 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.914.724 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.914.724 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.914.830 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.914.830 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [InferShape]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.914.835 [trs_sqcq.c:394][ascend][curpid:618646,618646][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=0; tsId=0; id_type=10; num=1024)
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.914.846 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.914.857 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.914.857 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.914.878 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.914.964 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.914.964 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.914.989 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.915.065 [trs_sqcq.c:394][ascend][curpid:618646,618646][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=0; tsId=0; id_type=11; num=1024)
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.915.078 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.915.078 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.915.110 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.915.159 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: Conv2DBackpropFilter, registered count: 1
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.915.185 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.915.192 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.915.251 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: Conv2DBackpropInput, registered count: 2
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.915.279 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: Conv2DTranspose, registered count: 3
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.915.298 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.915.301 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.915.297 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.915.322 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.915.335 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.915.355 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: Conv2D, registered count: 4
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.915.410 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.915.429 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[L2Loss] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.915.428 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[L2Loss] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.915.442 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: Conv3DBackpropInput, registered count: 5
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.915.469 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: Conv3DTranspose, registered count: 6
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.915.496 [trs_sqcq.c:394][ascend][curpid:618646,618646][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=0; tsId=0; id_type=12; num=2048)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.915.518 [trs_sqcq.c:394][ascend][curpid:618646,618646][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=0; tsId=0; id_type=8; num=16)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.915.536 [trs_sqcq.c:394][ascend][curpid:618646,618646][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=0; tsId=0; id_type=9; num=16)
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.915.529 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.915.537 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.915.537 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : [InferShape]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.915.552 [trs_sqcq.c:394][ascend][curpid:618646,618646][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=0; tsId=0; id_type=13; num=4)
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.915.546 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: Conv3D, registered count: 7
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.915.571 [trs_sqcq.c:394][ascend][curpid:618646,618646][drv][tsdrv][trsIdTypeInit]Id type init success. (devId=0; tsId=0; id_type=14; num=10)
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.915.647 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.915.644 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.915.647 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.915.725 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: FFN, registered count: 8
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.915.747 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: MatmulTunnerTiling, registered count: 9
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.915.750 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.915.750 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.915.768 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.915.858 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.915.858 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.915.868 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: MatMulV2, registered count: 10
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.915.892 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: BatchMatmulFixpipe, registered count: 11
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.915.914 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: MatMulV3, registered count: 12
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.915.933 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: QuantBatchMatmulV3, registered count: 13
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.915.965 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.915.963 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.915.970 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.915.994 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceAny] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.915.993 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceAny] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.916.022 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceAll] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.916.026 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceAll] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.916.052 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceMax] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.916.051 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceMax] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.916.073 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.916.073 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.916.099 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceMeanWithCast] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.916.099 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceMeanWithCast] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.916.112 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: DynamicRNN, registered count: 14
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.916.135 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: MatMulTunnerTiling, registered count: 15
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.916.124 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceMin] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.916.124 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceMin] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.916.125 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.916.149 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceProd] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.916.150 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceProd] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.916.191 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.916.191 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.916.226 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[EuclideanNorm] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.916.226 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[EuclideanNorm] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.916.252 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceLogSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.916.252 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceLogSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.916.276 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceLogSumExp] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.916.277 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceLogSumExp] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.916.296 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.916.380 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceNansum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.916.379 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceNansum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.916.461 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.916.489 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.916.494 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.916.513 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.916.519 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.916.541 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.916.538 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.916.563 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.916.570 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.916.584 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.916.592 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.916.597 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.916.605 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.916.614 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.916.713 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.916.723 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.916.729 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.916.828 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.916.829 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.916.831 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BlendFaceBgPartOne] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.916.931 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.916.931 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.916.943 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.916.955 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.916.956 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.917.062 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.917.060 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.917.062 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.917.166 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [InferShape][InferShapeRange][InferDataType][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.917.165 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [InferShape][InferShapeRange][InferDataType][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.917.194 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SplitD] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.917.193 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SplitD] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.917.216 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.917.217 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.917.322 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.917.330 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.917.331 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.917.362 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:MatMulV2, funcPointer:0xffff29c98a10, registered count:3
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.917.401 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:MatMulV2, funcPointer:0xffff29c98c70, registered count:1
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.917.435 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.917.435 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : [InferShape]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.917.454 [trs_dev_drv.c:302][ascend][curpid:618646,618646][drv][tsdrv][drvDeviceOpenComm]Open success. (devid=0; fd=36; mmapFd=37)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.917.480 [devmm_svm.c:132][ascend][curpid:618646,618646][drv][devmm][devmm_setup_device]DrvMemDeviceOpen. (devid=0)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.917.500 [devmm_svm.c:122][ascend][curpid:618646,618646][drv][devmm][devmm_set_device_info]Device info. (devid=0; dvpp_size=17179869184; support_bar_mem=1; support_dev_read_only=1; support_dev_mem_map_host=1; support_bar_huge_mem=1; is_alloced_by_malloc=0; host_rw_dev_ro=1; double_pgtable_offset=17592186044416; is_support_host_pin_pre_register=0; is_support_host_mem_pool=0)
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.917.498 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.917.551 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.917.551 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.917.557 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNN, funcPointer:0xfffefd345d70, registered count:1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.917.566 [npu_driver.cc:3011] 618646 DeviceOpen: Open device success, device_id=0, tsId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.917.585 [raw_device.cc:292] 618646 Init: chipType:0x5
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.917.635 [raw_device.cc:304] 618646 Init: isAddrFlat:0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.917.650 [raw_device.cc:320] 618646 Init: GetDevInfo, device_id=0, hardwareVersion=0x503
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.917.656 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : [InferShape]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.917.665 [devmm_svm.c:1972][ascend][curpid:618646,618646][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0x1; out_feature=0x1)
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.917.659 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.917.681 [npu_driver.cc:1578] 618646 SupportNumaTsMemCtrl: chip type=5, support flag=1
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.917.724 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.917.749 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNNV2, funcPointer:0xfffefd34e248, registered count:2
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.917.765 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.917.767 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.917.828 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.917.874 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.917.873 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.917.876 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.917.985 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.917.985 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.917.991 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.918.092 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.918.092 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.918.136 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.918.199 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.918.194 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.918.258 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GridSampler2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.918.304 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.918.305 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.918.322 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.918.379 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GridSampler3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.918.413 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.918.415 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.918.438 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.918.440 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.918.461 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.918.473 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.918.498 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandle] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.918.571 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.918.573 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.918.613 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandleV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.918.627 [raw_device.cc:352] 618646 Init: Get phy info, phy chip id 0, phy die id 0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.918.648 [runtime.cc:2771] 618646 GetTsdQos: [TSD] start get qos, devId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.918.661 [runtime.cc:5239] 618646 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.918.674 [tsd_client.cpp:189][TsdCapabilityGet][tid:618646] TsdCapabilityGet Begin.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.918.676 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.918.678 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : [InferShape]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.918.687 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618646] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.918.701 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618646] [TsdClient] g_userDeviceInfo is empty.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.918.701 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.918.702 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : [InferShape]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.918.711 [process_mode_manager.cpp:1042][CapabilityGet][tid:618646] [ProcessModeManager] enter into CapabilityGet process deviceId[0] type[0]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.918.725 [process_mode_manager.cpp:386][InitTsdClient][tid:618646] [TsdClient] tsd client has been inited before
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.918.728 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.918.740 [version_verify.cpp:114][SpecialFeatureCheck][tid:618646] VersionVerify: previous type[38], supported
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.918.792 [process_mode_manager.cpp:1065][CapabilityGet][tid:618646] [TsdClient][deviceId=0] [sessionId=1] [type=0]send capability success 
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.918.806 [hdc_client.cpp:154][TsdRecvData][tid:618646] recv timeout is:150000 ms
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.918.806 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.918.804 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.918.856 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PasteSubImg] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.918.909 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.918.908 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.918.969 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.918.998 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.919.011 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.919.011 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.919.115 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.919.113 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.919.115 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [Tiling][TilingParse]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.919.180 [process_mode_msg_parse.cpp:175][CapabilityResMsgProc][tid:618646] [CapabilityResMsgProc] [sessionID=1]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.919.195 [process_mode_msg_parse.cpp:170][PidQosMsgProc][tid:618646] [TsdClient] PidQosMsgProc recvMsg realDeviceId[0] msgType[39] localDevId[0] rspCode[0],pidqos[1]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.919.209 [hdc_client.cpp:172][TsdRecvData][tid:618646] [deviceId=0] the Tsd recv data already
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.919.221 [process_mode_manager.cpp:1070][CapabilityGet][tid:618646] [TsdClient][logicDeviceId_=0][type=0][pidQos=1][ret=0]recv capability respond finish
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.919.225 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.919.225 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.919.245 [runtime.cc:2782] 618646 GetTsdQos: [TSD] get qos success, userDeviceId=0, devId=0, qos=1
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.919.237 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.919.252 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.919.252 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.919.262 [engine.cc:78] 618646 Engine: Constructor.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.919.275 [stars_engine.cc:51] 618646 StarsEngine: Constructor.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.919.284 [engine_factory.cc:26] 618646 CreateEngine: new StarsEngine, Runtime_alloc_size 320
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.919.295 [engine_factory.cc:38] 618646 CreateEngine: Engine init success.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.919.304 [raw_device.cc:364] 618646 Init: new SpmPool ok, Runtime_alloc_size 56(bytes)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.919.315 [spm_pool.cc:42] 618646 Init: new buffer ok, Runtime_alloc_size 128
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.919.361 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.919.361 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.919.361 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.919.428 [buffer_allocator.cc:61] 618646 BufferAllocator: alloc success, Runtime_alloc_size 128(bytes)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.919.442 [spm_pool.cc:55] 618646 Init: new BufferAllocator ok, Runtime_alloc_size 152
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.919.455 [raw_device.cc:380] 618646 Init: new UmaArgLoader ok, Runtime_alloc_size 296(bytes)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.919.468 [devmm_svm.c:1972][ascend][curpid:618646,618646][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.919.467 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.919.471 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.919.484 [npu_driver.cc:6080] 618646 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.919.479 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : [Tiling][TilingParse]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.919.499 [devmm_svm.c:1972][ascend][curpid:618646,618646][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.919.511 [npu_driver.cc:6080] 618646 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.919.573 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.919.573 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.919.592 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.919.678 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.919.684 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.919.703 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.919.709 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.919.713 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.919.809 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.919.810 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.919.828 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TabulateFusionGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.919.919 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.919.922 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.919.944 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[YUV4442YUV422] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.920.024 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.920.023 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.920.050 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.920.100 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.920.127 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.920.131 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.920.128 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.920.170 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.920.206 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.920.229 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.920.256 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.920.323 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.920.357 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.920.373 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.920.399 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.920.424 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.920.476 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.920.544 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.920.569 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.920.592 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.920.592 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.920.614 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.920.637 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.920.658 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.920.679 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.920.700 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.920.712 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.920.721 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.920.742 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.920.735 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.920.764 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.920.785 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.920.807 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.920.828 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.920.826 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.920.850 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.920.872 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.920.893 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.920.937 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.920.967 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.920.995 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.920.999 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SegmentSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.921.105 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.921.118 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.921.217 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.921.212 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.921.234 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.921.333 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.921.351 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.921.440 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.921.548 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicAtomicAddrClean] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.921.570 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.921.676 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.921.679 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UnsortedSegmentMax] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.921.708 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UnsortedSegmentMin] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.921.734 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UnsortedSegmentProd] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.921.756 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.921.792 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.921.863 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdamApplyOne] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.921.892 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdamApplyOneAssign] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.921.919 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecay] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.921.917 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.921.944 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecayAssign] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.922.040 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.922.056 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BN3DTrainingReduce] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.922.079 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.922.101 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.922.122 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.922.153 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.922.226 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNTrainingReduce] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.922.267 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.922.297 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceMeanD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.922.309 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.922.341 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.922.415 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.922.430 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.922.446 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.922.458 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.922.495 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.922.531 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.922.551 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.922.564 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.922.597 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.922.622 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.922.644 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.922.654 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.922.666 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.922.688 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.922.709 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.922.729 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.922.749 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.922.759 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.922.770 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.922.791 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.922.811 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.922.832 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.922.842 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.922.852 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.922.862 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.922.873 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.922.895 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.922.917 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.922.938 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.922.953 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.923.010 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.923.036 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SegmentSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.923.062 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.923.128 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.923.135 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.923.187 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.923.232 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.923.244 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.923.298 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.923.331 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.923.350 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.923.419 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.923.426 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.923.460 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[INTrainingReduceV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.923.540 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.923.537 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.923.570 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.923.601 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[INTrainingUpdateGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.923.627 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[INTrainingUpdateGradGammaBeta] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.923.648 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.923.652 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UnsortedSegmentMax] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.923.654 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[INTrainingUpdateV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.923.680 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UnsortedSegmentMin] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.923.710 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UnsortedSegmentProd] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.923.733 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.923.757 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.923.831 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdamApplyOne] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.923.852 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.923.859 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdamApplyOneAssign] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.923.861 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.923.887 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecay] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.923.914 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecayAssign] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.923.969 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.923.970 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.924.013 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BN3DTrainingReduce] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.924.037 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.924.058 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.924.073 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.924.080 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.924.091 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.924.188 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNTrainingReduce] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.924.203 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.924.296 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.924.318 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.924.393 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.924.423 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.924.490 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.924.536 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPool] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.924.588 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.924.654 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPool3D] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.924.682 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.924.763 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.924.778 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.924.880 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPoolV3] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.924.911 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.924.986 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.925.012 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.925.096 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaximumGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.925.124 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MinimumGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.925.124 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.925.222 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.925.227 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.925.334 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[INTrainingReduceV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.925.350 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LogSoftmaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.925.375 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.925.398 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.925.425 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftMarginLoss] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.925.434 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.925.448 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.925.462 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[INTrainingUpdateGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.925.474 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftmaxFocalLoss] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.925.490 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[INTrainingUpdateGradGammaBeta] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.925.496 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.925.517 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.925.518 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[INTrainingUpdateV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.925.544 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.925.594 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[EluGradV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.925.613 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.925.620 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.925.626 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.925.640 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.925.658 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SyncBNTrainingUpdate] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.925.656 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Mish] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.925.676 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Abs] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.925.693 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Real] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.925.708 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Acos] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.925.710 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.925.723 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Acosh] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.925.739 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddMatMatElements] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.925.754 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Adds] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.925.769 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Asin] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.925.772 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.925.783 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Asinh] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.925.800 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AssignAdd] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.925.815 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AssignSub] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.925.814 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.925.830 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Atan] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.925.846 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Atanh] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.925.860 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.925.875 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BesselI0e] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.925.890 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BesselI1e] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.925.880 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.925.906 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.925.920 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.925.912 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.925.937 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.925.952 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.925.967 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Bucketize] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.925.982 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Cast] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.925.985 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.925.997 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Ceil] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.013 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CeluV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.926.008 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.031 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ComplexAbs] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.052 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Cos] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.067 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Cosh] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.083 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.098 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DataFormatDimMap] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.926.091 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.116 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Dequantize] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.926.108 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.133 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Elu] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.148 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Erf] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.164 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Erfc] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.179 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Exp] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.194 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Expm1] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.209 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FakeQuantWithMinMaxVars] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.926.201 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.926.212 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.226 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FastGelu] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.241 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FastGeluV2] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.255 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Floor] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.270 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FusedMulAddN] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.285 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HardSigmoid] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.300 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HardShrink] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.315 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HardShrinkGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.926.313 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPool] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.926.319 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftmaxCrossEntropyWithLogits] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.330 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HardSwish] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.347 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HardSwishGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.361 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HardtanhGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.376 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IndexFillD] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.391 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.406 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.421 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Inv] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.926.424 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPool3D] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.926.426 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.436 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Invert] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.453 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Log] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.926.450 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.475 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Log1p] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.492 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LogicalNot] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.508 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LogAddExp] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.523 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LpNormUpdate] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.926.524 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.538 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LpNormUpdateV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.554 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Dawsn] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.926.555 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.569 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Expint] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.585 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Erfinv] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.600 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FresnelCos] register OP_IMPL : []
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.926.580 [buffer_allocator.cc:61] 618646 BufferAllocator: alloc success, Runtime_alloc_size 32768(bytes)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.926.610 [task_allocator.cc:46] 618646 DefaultAlloc: Runtime_alloc_size 32768(bytes)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.615 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FresnelSin] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.631 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Ndtri] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.926.629 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPoolV3] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.926.639 [buffer_allocator.cc:61] 618646 BufferAllocator: alloc success, Runtime_alloc_size 104(bytes)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.645 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Spence] register OP_IMPL : []
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.926.653 [h2d_copy_mgr.cc:45] 618646 H2DCopyMgr: alloc h2d copy buff success, policy 2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.661 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Fills] register OP_IMPL : []
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.926.667 [devmm_svm.c:1972][ascend][curpid:618646,618646][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.926.664 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.676 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LeakyRelu] register OP_IMPL : []
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.926.683 [npu_driver.cc:6080] 618646 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.691 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[OnesLike] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.706 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Reciprocal] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.721 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Sign] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.736 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Sqrt] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.926.726 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.752 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Tanh] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.767 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ZerosLike] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.926.769 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.782 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Gelu] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.926.760 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DepthToSpace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.799 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GeluV2] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.813 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Relu] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.926.806 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.831 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Neg] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.926.826 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaximumGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.849 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LogSoftmaxV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.926.837 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SpaceToDepth] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.864 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.926.857 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MinimumGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.926.875 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.881 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.904 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.919 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftplusV2] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.934 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Muls] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.949 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Power] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.926.952 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.964 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Relu6] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.980 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Relu6D] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.926.995 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Relu6Grad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.926.985 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.926.986 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.011 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReluGradV2] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.026 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Rint] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.041 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Round] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.056 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Rsqrt] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.071 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RsqrtGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.927.064 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LogSoftmaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.088 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Selu] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.927.091 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.103 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Shrink] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.927.107 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.120 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Sigmoid] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.927.096 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.927.115 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.137 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.153 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SigmoidGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.927.142 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftMarginLoss] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.170 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Sin] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.927.177 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.187 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Sinh] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.204 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SmoothL1Loss] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.927.203 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftmaxFocalLoss] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.219 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SmoothL1LossGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.927.226 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.927.224 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyAdadeltaD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.235 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LogSigmoid] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.927.222 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.251 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LogSigmoidGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.927.246 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.267 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LogSpaceD] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.927.258 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.284 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Softplus] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.927.286 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyAdagradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.299 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Softsign] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.927.313 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyAdaMaxD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.320 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SqrtGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.338 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Square] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.927.343 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyAdamD] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.927.343 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.353 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Swish] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.927.345 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.371 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwishGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.927.370 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradD] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.927.372 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Mish] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.388 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SiluGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.927.395 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.407 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardElemt] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.426 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Tan] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.927.421 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyAddSignD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.446 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftShrink] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.927.446 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyCenteredRMSPropD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.465 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftShrinkGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.927.461 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.927.471 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyFtrlD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.486 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Threshold] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.927.478 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.927.497 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyFtrlV2D] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.505 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ThresholdV2] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.523 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ThresholdV2D] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.927.523 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyGradientDescent] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.540 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Trunc] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.927.547 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyKerasMomentumD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.557 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.576 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.927.572 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyMomentumD] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.927.578 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.927.579 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.596 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MishGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.927.598 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyPowerSignD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.613 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HardSigmoidGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.927.623 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyProximalAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.631 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.650 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.927.648 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyProximalGradientDescent] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.667 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.927.675 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyRMSPropD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.686 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.927.674 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.703 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FillDiagonal] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.927.699 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.927.704 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyAdagradDAD] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.927.717 [buffer_allocator.cc:61] 618646 BufferAllocator: alloc success, Runtime_alloc_size 262144(bytes)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.726 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IndexPut] register OP_IMPL : []
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.927.737 [task_allocator.cc:46] 618646 DefaultAlloc: Runtime_alloc_size 4096(bytes)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.744 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReadVariableOp] register OP_IMPL : []
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.927.751 [buffer_allocator.cc:61] 618646 BufferAllocator: alloc success, Runtime_alloc_size 128(bytes)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.927.762 [h2d_copy_mgr.cc:45] 618646 H2DCopyMgr: alloc h2d copy buff success, policy 2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.766 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CastLike] register OP_IMPL : []
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.927.774 [devmm_svm.c:1972][ascend][curpid:618646,618646][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.927.786 [npu_driver.cc:6080] 618646 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.927.776 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.787 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FusedBiasLeakyRelu] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.805 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StatelessBernoulliV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.927.811 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.927.811 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.827 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.845 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InvertPermutation] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.862 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.879 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SearchSorted] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.927.877 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.896 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.914 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.927.919 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FusedMulApplyMomentum] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.935 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.927.936 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.955 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.927.953 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FusedMulApplyKerasMomentum] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.927.977 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.927.968 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.927.984 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftmaxCrossEntropyWithLogits] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.928.068 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.085 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaskedScale] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.928.086 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.928.096 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.109 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AbsGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.928.113 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.128 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AccumulateNV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.928.125 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.148 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddN] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.180 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Eltwise] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.199 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddV2] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.219 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AcosGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.928.193 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GeluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.239 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AcoshGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.928.223 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.256 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AsinGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.275 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AsinhGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.928.262 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.295 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Atan2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.928.295 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.312 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AtanGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.928.317 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GeluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.330 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Axpy] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.928.326 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.349 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BitwiseAnd] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.370 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BitwiseOr] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.386 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BitwiseXor] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.928.399 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.404 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Div] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.928.407 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.432 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DivNoNan] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.928.426 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.452 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[EluGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.469 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FastGeluGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.486 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FloorDiv] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.507 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FloorMod] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.928.508 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IsNegInf] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.928.518 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.527 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InvGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.928.527 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.547 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LeakyReluGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.566 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TanhGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.583 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Add] register OP_IMPL : []
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.928.577 [buffer_allocator.cc:61] 618646 BufferAllocator: alloc success, Runtime_alloc_size 524288(bytes)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.600 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Addcdiv] register OP_IMPL : []
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.928.605 [task_allocator.cc:46] 618646 DefaultAlloc: Runtime_alloc_size 2048(bytes)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.928.616 [buffer_allocator.cc:61] 618646 BufferAllocator: alloc success, Runtime_alloc_size 136(bytes)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.617 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Addcmul] register OP_IMPL : []
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.928.626 [h2d_copy_mgr.cc:45] 618646 H2DCopyMgr: alloc h2d copy buff success, policy 2
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.928.620 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IsPosInf] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.634 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AxpyV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.928.629 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.928.640 [uma_arg_loader.cc:86] 618646 Init: new BufferAllocator superArgAllocator_ ok, Runtime_alloc_size 152
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.928.653 [task_allocator.cc:46] 618646 DefaultAlloc: Runtime_alloc_size 32768(bytes)
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.928.639 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.654 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LogicalAnd] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.671 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LogicalOr] register OP_IMPL : []
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.928.678 [buffer_allocator.cc:61] 618646 BufferAllocator: alloc success, Runtime_alloc_size 104(bytes)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.928.689 [uma_arg_loader.cc:93] 618646 Init: new BufferAllocator handleAllocator_ ok, Runtime_alloc_size 152
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.688 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Mul] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.705 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Pow] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.721 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RealDiv] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.928.728 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.738 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ClipByNormNoDivSum] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.928.736 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.760 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ClipByValue] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.928.755 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.781 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ClipByValueV2] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.798 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FusedMulAdd] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.815 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftmaxGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.928.815 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.832 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Sub] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.928.838 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyAdadeltaD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.856 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Gcd] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.928.867 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.874 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LarsV2Update] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.897 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaskedFill] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.928.894 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyAdagradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.917 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReluGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.928.926 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.941 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Xlog1py] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.928.937 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyAdaMaxD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.961 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApproximateEqual] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.928.963 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyAdamD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.978 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Equal] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.928.997 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NotEqual] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.928.992 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.928.999 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.020 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Greater] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.929.017 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.929.029 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.041 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GreaterEqual] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.929.043 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyAddSignD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.059 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Less] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.929.070 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyCenteredRMSPropD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.078 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LessEqual] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.097 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Maximum] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.929.096 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyFtrlD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.117 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Minimum] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.929.122 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyFtrlV2D] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.135 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Mod] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.929.137 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.929.146 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyGradientDescent] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.153 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.173 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MulNoNan] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.929.173 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyKerasMomentumD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.190 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReciprocalGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.929.198 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyMomentumD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.208 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SeluGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.226 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogits] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.929.224 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyPowerSignD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.245 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftplusGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.929.240 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.929.251 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyProximalAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.268 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftplusV2Grad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.929.277 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyProximalGradientDescent] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.285 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftsignGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.929.278 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.304 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SquaredDifference] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.929.303 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyRMSPropD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.321 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.929.330 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyAdagradDAD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.339 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ThresholdGradV2D] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.357 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TruncateDiv] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.929.355 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReluV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.374 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TruncateMod] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.392 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Xdivy] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.412 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IsClose] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.433 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Xlogy] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.929.429 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.929.428 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.454 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.471 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SelectV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.929.464 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.929.477 [buffer_allocator.cc:61] 618646 BufferAllocator: alloc success, Runtime_alloc_size 131072(bytes)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.492 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaskedSelectV2] register OP_IMPL : []
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.929.494 [uma_arg_loader.cc:102] 618646 Init: new BufferAllocator kernelInfoAllocator_ ok, Runtime_alloc_size 152
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.929.505 [uma_arg_loader.cc:104] 618646 Init: ALLOC PCIE is support[1]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.509 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Lerp] register OP_IMPL : []
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.929.516 [devmm_svm.c:1972][ascend][curpid:618646,618646][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.526 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FusedBiasLeakyReluGrad] register OP_IMPL : []
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.929.529 [npu_driver.cc:6080] 618646 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.929.534 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FusedMulApplyMomentum] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.929.548 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.929.564 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FusedMulApplyKerasMomentum] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.929.574 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.634 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.929.643 [buffer_allocator.cc:61] 618646 BufferAllocator: alloc success, Runtime_alloc_size 32768(bytes)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.929.657 [h2d_copy_mgr.cc:45] 618646 H2DCopyMgr: alloc h2d copy buff success, policy 1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.929.668 [raw_device.cc:393] 618646 Init: new StreamSqCqManage ok, Runtime_alloc_size 416(bytes)
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.929.665 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.929.683 [raw_device.cc:398] 618646 Init: New taskFactory ok, Runtime_alloc_size 136(bytes)
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.929.681 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Cummax] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.929.672 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.929.696 [task_allocator.cc:46] 618646 DefaultAlloc: Runtime_alloc_size 393216(bytes)
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.929.705 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.741 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.929.765 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GeluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.929.800 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.929.815 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.845 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.929.859 [buffer_allocator.cc:61] 618646 BufferAllocator: alloc success, Runtime_alloc_size 104(bytes)
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.929.867 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GeluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.929.922 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.929.945 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.929.950 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.930.033 [raw_device.cc:109] 618646 Init: ObjAllocator alloc success, Runtime_alloc_size 160000(bytes)
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.930.038 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.930.042 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IsNegInf] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.930.068 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [][][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.930.091 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.930.112 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [][][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.930.133 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.930.146 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Col2ImV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.930.160 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IsPosInf] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.930.241 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.930.258 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.930.260 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.930.284 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.930.330 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.930.345 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [][][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.930.387 [raw_device.cc:121] 618646 Init: ObjAllocator alloc success, Runtime_alloc_size 960000(bytes)
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.930.388 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.930.402 [raw_device.cc:425] 618646 Init: Runtime_alloc_size=64000(bytes)
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.930.432 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.930.451 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.930.458 [npu_driver.cc:404] 618646 StreamIdAlloc: stream id alloc begin, device_id=0, priority=0, ts_id=0, remote_stream_id=0
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.930.453 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNormGradV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.930.495 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.930.530 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.930.539 [stream.cc:2246] 618646 AllocExecutedTimesSvm: stream_id=0.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.930.554 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : []
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.930.572 [stream_sqcq_manage.cc:147] 618646 Alloc: deviceId=0, tsId=0, drvFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.930.585 [npu_driver.cc:882] 618646 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.930.623 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.930.626 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.930.661 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.930.719 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.930.728 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.930.776 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.930.825 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReluV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.930.831 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.930.883 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Quantize] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.930.905 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.930.924 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AscendDequant] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.930.928 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.930.941 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.930.942 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2d] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.931.033 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.931.040 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.931.057 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.931.135 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Cummax] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.931.160 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.931.152 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.931.161 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.931.187 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.931.149 [npu_driver.cc:6125] 618646 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.931.207 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.931.225 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.931.243 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.931.254 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.931.261 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BasicLSTMInplaceFillWindowCache] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.931.256 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.931.283 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BasicGRUInplaceFillWindowCache] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.931.276 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.931.251 [npu_driver.cc:6137] 618646 LogicCqAllocateV2: success: deviceId=0, tsId=0, cqId=488, streamId=0, logicCq=488, cqeDepth=4096
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.931.314 [npu_driver.cc:6189] 618646 StreamBindLogicCq: success: deviceId=0, tsId=0, streamId=0, logicCq=488.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.931.336 [npu_driver.cc:5916] 618646 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=c8c30000, addr=dfffc8c30000size=4096
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.931.355 [stream.cc:653] 618646 Setup: Success to get sq=0 sq reg virtual addr length=4096.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.931.353 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.931.387 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.931.383 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [InferShape][InputsDependency]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.931.435 [stream.cc:276] 618646 CreateStreamTaskRes: Normal STREAM Setup stream_id=0 flags_=0xc0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.931.456 [stream.cc:688] 618646 Setup: stream setup end, stream_id=0, IsTaskSink=0, sqId=0, cqId=0, deviceId=0, streamResId=0
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.931.461 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:41.931.478 [stream_state_callback_manager.cc:45] 618646 Notify: not reg stream state callback func!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.931.489 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.931.495 [raw_device.cc:593] 618646 Start: new primary Stream ok, Runtime_alloc_size 3872, stream_id=0.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.931.497 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.931.525 [npu_driver.cc:404] 618646 StreamIdAlloc: stream id alloc begin, device_id=0, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.931.553 [stream_sqcq_manage.cc:147] 618646 Alloc: deviceId=0, tsId=0, drvFlag=16
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.931.561 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Col2ImV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.931.570 [npu_driver.cc:882] 618646 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.931.575 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.931.603 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.931.611 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaskedSelect] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.931.663 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.931.680 [tsch_stream.cc:45] 618646 Setup: stream setup end, stream_id=1, type=1, IsTaskSink=0, sqId=1, cqId=1, deviceId=0 streamResId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.931.701 [raw_device.cc:1219] 618646 TschStreamSetup: Tsch setup ffts dsa stream ok, stream_id=1
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.931.688 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.931.704 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.931.718 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.931.730 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.931.743 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.931.785 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.931.831 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdaCast] register OP_IMPL : [][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.931.832 [osal.cc:309] 618646 CreateThread: Runtime_alloc_size 56
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.931.849 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.931.880 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.931.933 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.931.956 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.931.965 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.931.974 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.931.979 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.931.994 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : []
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.931.988 [osal.cc:182] 618646 Start: mmCreateTaskWithThreadAttr, retCode=0, name_=MONITOR_0, i=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.031 [osal.cc:309] 618646 CreateThread: Runtime_alloc_size 56
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.932.029 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.932.075 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.932.079 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.932.098 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.097 [stars_engine.cc:1785] 618834 MonitoringRun: Starts Monitor thread has entered, ts_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.118 [osal.cc:182] 618646 Start: mmCreateTaskWithThreadAttr, retCode=0, name_=RT_RECYCLE, i=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.136 [stars_engine.cc:201] 618835 RecycleThreadRun: RecycleThreadRun thread enter.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.141 [runtime.cc:5239] 618834 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.932.186 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618834] [TsdClient] g_userDeviceInfo is empty.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.932.187 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [InferShape][InferDataType]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.932.213 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618834] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.932.233 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618834] [TsdClient] g_userDeviceInfo is empty.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.932.213 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.932.235 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.263 [runtime.cc:3077] 618834 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=0, devId=0, tdt status=0
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.932.311 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2d] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.330 [npu_driver.cc:6306] 618834 GetDeviceStatus: GetDeviceStatus status=1.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.932.328 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.932.342 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : []
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.355 [stars_engine.cc:1855] 618834 ReportHBMRasProc: g_hbmRasCheckDeviceId init, dev_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.374 [npu_driver.cc:551] 618834 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.932.423 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.932.443 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.932.444 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.932.465 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : []
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.499 [engine.cc:188] 618646 SubmitTaskNormal: stream_id=0,task_id=0,task_type=97 (STARS_VERSION).
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.932.521 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.526 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=0, head=0.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.932.561 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.932.558 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.566 [task_info.cc:1596] 618646 ConstructSqeForStarsVersionTask: Send GetStarsVersionTask succ,sqe_type=3,pre_p=1,sqe->rt_streamID=32768,stream_id=0,task_id=0,task_type=97.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.932.553 [operator_factory_impl.cc:368]618670 RegisterInferAxisTypeInfoFunc:axis type info derivation funcs init
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.589 [stream.cc:1400] 618646 AddTaskToList: public task, stream_id=0, task_id=0, task_type=97 (STARS_VERSION), head=0, tail=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.607 [stream.cc:2595] 618646 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=0, type=97(STARS_VERSION), head=0, tail=1, sqe_num=1, lastTail=0, device_id=0
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.932.623 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.644 [npu_driver.cc:751] 618646 SqTaskSend: device_id=0, ts_id=0, sq_id=0, sqe_num=1.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.932.661 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.932.645 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.661 [stars_engine.cc:893] 618646 SendTask: Sq task send finished, device_id=0, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=0, task_type=97(STARS_VERSION).
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.932.670 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.682 [stars_engine.cc:1122] 618646 SyncTask: Task Wait: device_id=0, stream_id=0, task_id=0, logicCqId=488.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.932.685 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : []
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.716 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=0, head=0.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.932.728 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [InferShape][InputsDependency]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.734 [stars_engine.cc:1071] 618646 IsSyncTaskFinish: Sync task finished, sqHead=0 finishedTaskId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.754 [stars_engine.cc:1017] 618646 ProcReport: Get logic report: cnt=1, idx=0, stream_id=0, report task_id=0, sync task_id=0, sqeType=3, sqeHead=0, retCode=0x23, errType=0x20.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.932.775 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.932.788 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.932.780 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.773 [task.cc:185] 618646 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.797 [stars_engine.cc:1027] 618646 ProcReport: taskType=97.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.822 [task.cc:185] 618646 GetTask: this stream no taskRes, stream_id=0
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.932.800 [operator_factory_impl.cc:284]618670 RegisterInferDataSliceFunc:operator_infer_data_slice_funcs_ init
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.932.826 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : [InferShape][InferDataType]
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.837 [stars_engine.cc:1570] 618646 ProcLogicCqReport: CQE warning, device_id=0, stream_id=0, task_id=0, sqe_type=3(place holder), errType=0x20(sq sw status error), sqSwStatus=0x23
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.867 [task.cc:185] 618646 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.887 [logger.cc:152] 618646 TaskFinished: device_id=0, stream_id=0, task_id=0, task_type=97 (STARS_VERSION), task_finish_num=1
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.932.893 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.904 [task_info.cc:1614] 618646 DoCompleteSuccessForStarsVersionTask: Complete StarsVersionTask succ, retCode=35,tschVersion=35.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.922 [raw_device.cc:1305] 618646 SetTschVersion: Set tsch version=35.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.932.902 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.932.896 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RNNTLoss] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.932.928 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaskedSelect] register OP_IMPL : [InferShape][InferShapeRange]
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.953 [stars_engine.cc:1351] 618646 StarsResumeRtsq: Begin to query sq status, stream_id=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.974 [npu_driver.cc:5618] 618646 GetSqEnable: deviceId=0, tsId=0, sqId=0, enable=0.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:41.932.990 [stars_engine.cc:1365] 618646 StarsResumeRtsq: sq already disable, stream_id=0, queryCnt=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.933.004 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=0, head=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.933.021 [npu_driver.cc:5595] 618646 GetSqTail: deviceId=0, tsId=0, sqId=0, tail=1.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.933.012 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.933.006 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [MatrixBandPart] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.933.018 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MultinomialWithReplacement] register OP_IMPL : [InferShape]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.933.030 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [CheckNumerics] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.933.033 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : [InferShape]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.933.045 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [UnravelIndex] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.933.060 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [UpperBound] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.933.043 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.933.036 [npu_driver.cc:5406] 618646 SetSqHead: deviceId=0, tsId=0, sqId=0, head=1.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.933.059 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.933.071 [npu_driver.cc:5357] 618646 EnableSq: deviceId=0, tsId=0, sqId=0.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:41.933.088 [stars_engine.cc:1430] 618646 StarsResumeRtsq: Resume stream_id=0, sq_id=0, sq_head=0, task_id=0, taskType=97, head=1.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.933.075 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [ListDiff] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.933.115 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.933.110 [npu_driver.cc:5618] 618646 GetSqEnable: deviceId=0, tsId=0, sqId=0, enable=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.933.127 [stream.cc:1494] 618646 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.933.116 [operator_factory_impl.cc:254]618670 RegisterInferFormatFunc:operator_inferformat_funcs_ init
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.933.127 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.933.136 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.933.143 [raw_device.cc:1331] 618646 GetStarsVersion: send alloc get stars version task, stream_id=0, retCode:0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.933.160 [raw_device.cc:610] 618646 Start: Get TschVersion, tschVersion=35.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.933.148 [operator_factory_impl.cc:340]618670 RegisterInferAxisSliceFunc:axis slice derivation funcs init
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.933.154 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.933.158 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.933.166 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.933.176 [operator_factory_impl.cc:307]618670 RegisterInferValueRangeFunc:operator_infervalue_paras_ init
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.933.212 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [IdentityN] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.933.232 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[L2Loss] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.933.234 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [LowerBound] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.933.256 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Expand] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.933.258 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.933.267 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StatelessBernoulli] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.933.336 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.933.361 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.933.373 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : [InferShape]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.933.382 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [LeftShift] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.933.444 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.933.449 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPool3DWithArgmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.933.472 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.933.482 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.933.553 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.933.571 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.933.585 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.933.659 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.933.675 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.933.695 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UniqueConsecutive] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.933.756 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.933.778 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceAny] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.933.781 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.933.797 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceAll] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.933.816 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceMax] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.933.809 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UniqueWithCountsAndSorting] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.933.838 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.933.855 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceMeanWithCast] register OP_IMPL : [][][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.933.873 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceMin] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.933.881 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.933.891 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceProd] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.933.910 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceSum] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.933.927 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[EuclideanNorm] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.933.944 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceLogSum] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.933.961 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceLogSumExp] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.933.975 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[WarpAffine] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.933.979 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.934.063 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceNansum] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.934.082 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RNNTLoss] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.934.095 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Histogram] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.934.163 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.934.184 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.934.181 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MultinomialWithReplacement] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.934.205 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.934.201 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.934.226 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.934.245 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.934.270 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.934.281 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : [InferShape]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.934.284 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Reciprocal] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.934.306 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.934.315 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : [InferShape]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.934.316 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Sign] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.934.338 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Div] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.934.365 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Exp] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.934.376 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [][]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.934.387 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [LessEqual] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.934.408 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Log1p] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.934.432 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [DivNoNan] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.934.432 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Unique] register OP_IMPL : [InferShapeRange]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.934.412 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StatelessBernoulli] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.934.473 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Mul] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.934.482 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.934.459 [engine.cc:188] 618646 SubmitTaskNormal: stream_id=0,task_id=1,task_type=83 (DEVICE_RINGBUFFER_CONTROL).
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.934.494 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [SqrtGrad] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.934.513 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Log] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.934.532 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [AddN] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.934.530 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.934.539 [ringbuffer_maintain_task.cc:98] 618646 ConstructSqeForRingBufferMaintainTask: RingBufferMaintainTask stream_id=0, task_id=1, offset=0x2280
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.934.547 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UniqueWithCounts] register OP_IMPL : [InferShapeRange]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.934.561 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [AcosGrad] has registered infer func
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.934.561 [stream.cc:1400] 618646 AddTaskToList: public task, stream_id=0, task_id=1, task_type=83 (DEVICE_RINGBUFFER_CONTROL), head=1, tail=2
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.934.580 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [AcoshGrad] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.934.584 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.934.581 [stream.cc:2595] 618646 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=1, type=83(DEVICE_RINGBUFFER_CONTROL), head=1, tail=2, sqe_num=1, lastTail=1, device_id=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.934.608 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.934.609 [npu_driver.cc:751] 618646 SqTaskSend: device_id=0, ts_id=0, sq_id=0, sqe_num=1.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.934.614 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [BiasAdd] has registered infer func
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.934.626 [stars_engine.cc:893] 618646 SendTask: Sq task send finished, device_id=0, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=1, task_type=83(DEVICE_RINGBUFFER_CONTROL).
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.934.631 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [InferShape][InputsDependency]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.934.645 [stream.cc:1494] 618646 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=1.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.934.646 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [FloorDiv] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.934.660 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Dot] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.934.667 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=0, head=1.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.934.671 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [ArgMin] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.934.708 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.934.707 [stars_engine.cc:622] 618646 ProcLogicCqUntilEmpty: Task Wait: stream_id=0, logicCqId=488, retCode=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.934.727 [stream.cc:2886] 618646 StarsWaitForTask: No.0 stream_id=0, taskId=1, currentId=0
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.934.728 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : [InferShape]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.934.741 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [MulNoNan] has registered infer func
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.934.743 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.934.760 [stream.cc:2886] 618646 StarsWaitForTask: No.1 stream_id=0, taskId=1, currentId=0
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.934.768 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.934.775 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=0, head=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.934.791 [stream.cc:2886] 618646 StarsWaitForTask: No.2 stream_id=0, taskId=1, currentId=0
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.934.785 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [AsinGrad] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.934.809 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [][][][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.934.808 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=0, head=2.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.934.806 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Cos] has registered infer func
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.934.827 [task.cc:185] 618646 GetTask: this stream no taskRes, stream_id=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.934.832 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SplitD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.934.832 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UniqueConsecutive] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.934.837 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Sin] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.934.853 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.934.841 [task.cc:185] 618646 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.934.857 [logger.cc:152] 618646 TaskFinished: device_id=0, stream_id=0, task_id=1, task_type=83 (DEVICE_RINGBUFFER_CONTROL), task_finish_num=2
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.934.871 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [AsinhGrad] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.934.875 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.934.877 [stars_engine.cc:437] 618646 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=1, sqHead=2, endTaskId=1, recycleTaskId=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.934.89[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.934.896 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Expm1] has registered infer func
6 [stream.cc:2886] 618646 StarsWaitForTask: No.3 stream_id=0, taskId=1, currentId=1
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.934.934 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UniqueWithCountsAndSorting] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.934.954 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.934.970 [engine.cc:188] 618646 SubmitTaskNormal: stream_id=0,task_id=2,task_type=29 (ALLOC_DSA_ADDR).
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.934.987 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.934.989 [task_info.cc:111] 618646 ConstructSqeForAllocDsaAddrTask: Send AllocDsaAddrTask succ, sqe_type=3, pre_p=1, stream_id=0, task_id=2, task_type=29, dsa_sq_id=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.935.008 [stream.cc:1400] 618646 AddTaskToList: public task, stream_id=0, task_id=2, task_type=29 (ALLOC_DSA_ADDR), head=2, tail=3
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.935.012 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.935.022 [stream.cc:2595] 618646 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=2, type=29(ALLOC_DSA_ADDR), head=2, tail=3, sqe_num=1, lastTail=2, device_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.935.041 [npu_driver.cc:751] 618646 SqTaskSend: device_id=0, ts_id=0, sq_id=0, sqe_num=1.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.935.059 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : []
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.935.056 [stars_engine.cc:893] 618646 SendTask: Sq task send finished, device_id=0, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=2, task_type=29(ALLOC_DSA_ADDR).
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.935.074 [stars_engine.cc:1122] 618646 SyncTask: Task Wait: device_id=0, stream_id=0, task_id=2, logicCqId=488.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.935.093 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[WarpAffine] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.935.125 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardReduce] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.935.170 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.935.203 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Histogram] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.935.234 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStatsWithCounts] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.935.215 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=0, head=3.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.935.260 [stars_engine.cc:1071] 618646 IsSyncTaskFinish: Sync task finished, sqHead=3 finishedTaskId=2
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.935.269 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : []
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.935.280 [stars_engine.cc:1017] 618646 ProcReport: Get logic report: cnt=1, idx=0, stream_id=0, report task_id=2, sync task_id=2, sqeType=3, sqeHead=2, retCode=0, errType=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.935.303 [task.cc:185] 618646 GetTask: this stream no taskRes, stream_id=0
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.935.308 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.935.321 [stars_engine.cc:1027] 618646 ProcReport: taskType=29.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.935.338 [task.cc:185] 618646 GetTask: this stream no taskRes, stream_id=0
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.935.343 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.935.358 [task.cc:185] 618646 GetTask: this stream no taskRes, stream_id=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.935.373 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : []
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.935.377 [logger.cc:152] 618646 TaskFinished: device_id=0, stream_id=0, task_id=2, task_type=29 (ALLOC_DSA_ADDR), task_finish_num=3
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.935.369 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.935.406 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.935.406 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.935.407 [npu_driver.cc:5618] 618646 GetSqEnable: deviceId=0, tsId=0, sqId=0, enable=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.935.427 [stream.cc:1494] 618646 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=2.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.935.431 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.935.444 [raw_device.cc:1232] 618646 TschStreamAllocDsaAddr: send alloc dsa sq task, stream_id=1, retCode:0
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.935.457 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.935.472 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [][]
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:41.935.475 [atrace_api.c:40](tid:618646) AtraceCreate start.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.935.479 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.935.502 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.935.513 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Unique] register OP_IMPL : [InferShapeRange]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.935.522 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.935.543 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.935.583 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.935.615 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UniqueWithCounts] register OP_IMPL : [InferShapeRange]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.935.644 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.935.652 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPool3DGradWithArgmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.935.669 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.935.685 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.935.692 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.935.723 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Dot] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.935.784 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.935.797 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.935.821 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.935.884 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.935.914 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.935.917 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.935.994 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.936.015 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.936.018 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.936.020 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.936.034 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.936.043 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.936.126 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.936.134 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.936.145 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardReduce] register OP_IMPL : [InferShape]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.936.228 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [AdjustHue] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.936.258 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [AdjustSaturation] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.936.252 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.936.253 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.936.260 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStatsWithCounts] register OP_IMPL : [InferShape]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.936.279 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [ExtractGlimpse] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.936.283 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.936.284 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.936.300 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [ResizeArea] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.936.310 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.936.317 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [ResizeBicubic] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.936.336 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [RGBToHSV] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.936.359 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [NonMaxSuppressionWithOverlaps] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.936.370 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.936.390 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.936.396 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.936.400 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [ScaleAndTranslate] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.936.419 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [ScaleAndTranslateGrad] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.936.412 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.936.419 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.936.435 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [CombinedNonMaxSuppression] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.936.442 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.936.466 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.936.487 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.936.498 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.936.495 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.936.518 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.936.522 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.936.538 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [CholeskyGrad] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.936.543 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.936.542 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.936.559 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Cholesky] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.936.564 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.936.579 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [MatrixDeterminant] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.936.588 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.936.596 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [MatrixSolve] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.936.614 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [MatrixTriangularSolve] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.936.630 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Qr] has registered infer func
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:41.936.615 [trace_rb_log.c:45](tid:618646) init ring buffer time finished, realTime 1743643661935548517, monotonicTime 4163114619667, freq 99974 kHz, minutesWest 480 minutes
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:41.936.640 [trace_rb_log.c:137](tid:618646) [RUNTIME_ATRACE_DEV0_TS0] create ring buffer success, msgSize 128 bytes, msgTxtSize 112 bytes, bufferSize 1024 bytes, msg space 128 bytes, total space 131568 bytes
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.936.657 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.936.657 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:41.936.662 [tracer_mgr_operate.c:66](tid:618646) create object RUNTIME_ATRACE_DEV0_TS0 success, exitSave(false), noLock(false).
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:41.936.680 [atrace_api.c:44](tid:618646) AtraceCreate end.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.936.661 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.936.684 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.936.694 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.936.705 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [InferShape][InferDataType]
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:41.936.736 [trace_event.c:70](tid:618646) limitedNum 1, processType 0 
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:41.936.754 [trace_event.c:372](tid:618646) set trace event attr limitedNum: 1, processType: 0
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.936.761 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.936.799 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.936.793 [runtime.cc:3159] 618646 SetTsdProfCallback: set tsd prof callback
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.936.803 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [InferShape][InferDataType]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:41.936.813 [client_manager.cpp:196][SetProfilingCallback][tid:618646] [TsdClient] set profiling callback success
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.936.822 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.936.821 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CTCLossV3Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.936.851 [runtime.cc:3364] 618646 PrimaryContextRetain: new Context ok, Runtime_alloc_size 424
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.936.880 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.936.891 [context.cc:109] 618646 Init: ObjAllocator alloc success, Runtime_alloc_size 160000(bytes)
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.936.906 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.936.929 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.936.973 [context.cc:121] 618646 Init: ObjAllocator alloc success, Runtime_alloc_size 960000(bytes)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.936.990 [context.cc:276] 618646 Init: Runtime_alloc_size is 16000.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.936.989 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Digamma] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.936.990 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.937.006 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.937.010 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Igamma] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.937.028 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Igammac] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.937.017 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.937.031 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [][]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.937.043 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Bincount] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.937.040 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.937.048 [raw_device.cc:803] 618646 UpdateTimeoutConfig: No need to update timeout config.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.937.059 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Betainc] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.937.065 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [InferShape][InferDataType]
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:41.937.068 [npu_driver_dcache_lock.cpp:39] 618646 AllocAddrForDcache: halMemCtl failed, drvRet=65534, outSize=0
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.937.076 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Bucketize] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.937.100 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.937.108 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [IgammaGradA] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.937.128 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [][]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.937.135 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [NextAfter] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.937.156 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [IsInf] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.937.170 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.937.173 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [IsNan] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.937.191 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Conj] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.937.198 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.937.198 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.937.214 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Complex] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.937.221 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.937.223 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.937.230 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.937.220 [raw_device.cc:528] 618646 AllocStackPhyBase: AllocStackPhyBase device_id=0, stackPhyBase32k_=0x12c140000000, stackPhySize=2457600.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.937.232 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Angle] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.937.245 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.937.254 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.937.277 [raw_device.cc:232] 618646 LaunchDcacheLockOp: dcache lock has been set or stack addr is not for dcache, dCacheLockFlag_=0, stackAddrIsDcache_=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.937.307 [runtime.cc:3393] 618646 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.937.325 [runtime.cc:3560] 618646 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=0
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.937.327 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.937.341 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.937.341 [api_impl.cc:2987] 618646 NewDevice: SetCurRef = 0xaaab06c88220,userDeviceId=0,deviceId=0
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.937.351 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.937.357 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.937.361 [runtime.cc:5239] 618646 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.937.373 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.937.376 [api_impl.cc:2992] 618646 NewDevice: New device success, user_device_id=0, die_num=1.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:41.937.404 [awatchdog_core.c:175](tid:618646) create watchdog for id : 65543, tid : 618646, timeout : 300s
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.937.421 [api_impl.cc:3025] 618646 SetDevice: SetDevice success, curCtx=0xaaab06c88220, user_device_id=0.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.937.437 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.937.458 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.937.462 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [InferShape][InferDataType]
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.937.462 [acl.cpp:115]618646 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.937.483 [acl.cpp:121]618646 GetSocVersion: socVersion is Ascend910B3
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.937.470 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [ScatterNdUpdate] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.937.481 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.937.492 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [TensorScatterUpdate] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.937.508 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.937.531 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.937.557 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [][]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.937.553 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Tril] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.937.553 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.937.561 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.937.572 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [IndexPut] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.937.587 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Eye] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.937.604 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [FillDiagonal] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.937.620 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Trace] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.937.658 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.937.654 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.937.661 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.937.754 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.937.763 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.937.765 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.937.807 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CTCLossV3] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.937.849 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.937.873 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.937.872 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.937.895 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.937.873 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.937.898 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.937.911 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.937.917 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.937.921 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.937.935 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.937.962 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.938.022 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.938.025 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.938.031 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.938.049 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.938.057 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.938.068 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.938.051 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.938.078 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.938.088 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.938.107 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.938.124 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.938.119 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3DGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.938.143 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.938.169 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.938.170 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.938.175 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.938.187 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.938.198 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.938.205 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.938.224 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.938.221 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.938.244 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.938.261 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.938.278 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.938.277 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.938.296 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.938.316 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.938.323 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.938.334 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.938.349 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.938.373 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.938.388 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.938.396 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.938.410 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.938.436 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SegmentSum] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.938.432 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.938.487 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.938.538 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.938.533 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.938.558 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.938.581 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.938.584 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.938.587 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [DecodeBbox] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.938.592 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.938.616 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [ClipBoxes] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.938.633 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [ClipBoxesD] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.938.639 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [][]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.938.657 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [DecodeBoundariesTarget] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.938.676 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [DecodeCornerpointsTargetBG] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.938.681 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.938.685 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.938.697 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [DecodeCornerpointsTargetWrtCenterV1] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.938.706 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.938.714 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [DecodeWheelsTarget] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.938.711 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.938.728 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.938.745 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.938.794 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.938.826 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.938.833 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.938.844 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [SparseSoftmaxCrossEntropyWithLogits] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.938.852 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.938.850 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.938.903 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.938.935 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [KlDivLossGrad] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.938.948 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.938.957 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.938.952 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.939.009 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.939.046 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.939.058 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UnsortedSegmentMax] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.939.085 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UnsortedSegmentMin] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.939.075 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.939.108 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UnsortedSegmentProd] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.939.127 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.939.122 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.939.143 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.939.176 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.939.198 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.939.210 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.939.224 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdamApplyOne] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.939.232 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.939.245 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdamApplyOneAssign] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.939.264 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecay] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.939.282 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecayAssign] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.939.291 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.939.317 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.939.328 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.939.328 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [FractionalMaxPoolGrad] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.939.339 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.939.340 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.939.352 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [FractionalAvgPool] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.939.379 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BN3DTrainingReduce] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.939.381 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [FractionalMaxPool] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.939.396 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [DataFormatVecPermute] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.939.401 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.939.412 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [FractionalAvgPoolGrad] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.939.428 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.939.426 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [NthElement] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.939.437 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.939.448 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.939.443 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.939.452 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.939.535 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.939.548 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNTrainingReduce] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.939.558 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.939.561 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2dAssistMatrix] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.939.636 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.939.660 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.939.669 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.939.679 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.939.733 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.939.760 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.939.787 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.939.807 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.939.837 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.939.862 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.939.896 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.939.934 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.939.931 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Tanh] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.939.962 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.939.966 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PadV3GradReplication] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.940.008 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.940.033 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.940.062 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.940.087 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.940.120 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Cdist] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.940.137 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.940.125 [api_impl.cc:3476] 618646 GetDeviceInfo: get device info, deviceId=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.940.173 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : []
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.940.186 [api_impl.cc:3476] 618646 GetDeviceInfo: get device info, deviceId=0
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.940.226 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.940.248 [device.cpp:133]618646 UpdatePlatformInfoWithDevice: Successfully to UpdatePlatformInfoWithDevice, deviceId = 0, aicCnt = 20, vecCoreCnt = 40, cubeCoreCnt = 20
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.940.248 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CdistGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.940.250 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2dAssistMatrix] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.940.275 [device.cpp:154]618646 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.940.285 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [][][]
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.940.298 [context.cpp:87]618646 aclrtGetCurrentContext: start to execute aclrtGetCurrentContext
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.940.308 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Pad] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.940.337 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [PadV3] has registered infer func
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.940.329 [context.cpp:98]618646 aclrtGetCurrentContext: successfully execute aclrtGetCurrentContext
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.940.354 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [PadV3Grad] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.940.361 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.940.365 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : [InferShape]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.940.374 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [BroadcastTo] has registered infer func
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.940.357 [stream.cpp:48]618646 aclrtCreateStreamWithConfig: start to execute aclrtCreateStreamWithConfig with priority:0, flag:3
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.940.386 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.940.389 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.940.408 [api_impl.cc:1120] 618646 StreamCreate: priority=0, flags=1536.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.940.414 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.940.423 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.940.463 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.940.467 [npu_driver.cc:404] 618646 StreamIdAlloc: stream id alloc begin, device_id=0, priority=0, ts_id=0, remote_stream_id=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.940.486 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : []
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.940.508 [stream.cc:2246] 618646 AllocExecutedTimesSvm: stream_id=2.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.940.517 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.940.541 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.940.543 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.940.556 [stream_sqcq_manage.cc:147] 618646 Alloc: deviceId=0, tsId=0, drvFlag=0
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.940.558 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.940.563 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : [InferShape]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.940.562 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [RaggedRange] has registered infer func
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.940.577 [npu_driver.cc:882] 618646 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.940.584 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.940.656 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.940.659 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.940.684 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[INTrainingReduceV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.940.679 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.940.717 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [ShuffleChannel] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.940.761 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Cdist] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.940.772 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.940.792 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.940.791 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.940.813 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[INTrainingUpdateGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.940.836 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[INTrainingUpdateGradGammaBeta] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.940.855 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[INTrainingUpdateV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.940.860 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CdistGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.940.899 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.940.928 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.940.951 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.940.962 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.940.988 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.941.009 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GlobalLpPool] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.941.013 [npu_driver.cc:6125] 618646 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.941.012 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : [InferShape]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.941.030 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [ReduceSum] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.941.050 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.941.058 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [ReduceProd] has registered infer func
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.941.071 [npu_driver.cc:6137] 618646 LogicCqAllocateV2: success: deviceId=0, tsId=0, cqId=489, streamId=2, logicCq=489, cqeDepth=4096
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.941.096 [npu_driver.cc:6189] 618646 StreamBindLogicCq: success: deviceId=0, tsId=0, streamId=2, logicCq=489.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.941.101 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [INInferV2] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.941.118 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [INInferV2] has registered infer func
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.941.115 [npu_driver.cc:5916] 618646 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=c014e000, addr=dfffc014e000size=4096
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.941.112 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.941.121 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GLU] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.941.124 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.941.133 [stream.cc:653] 618646 Setup: Success to get sq=2 sq reg virtual addr length=4096.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.941.151 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.941.148 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.941.173 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : [InferShape]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.941.197 [devmm_svm.c:1972][ascend][curpid:618646,618646][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.941.218 [npu_driver.cc:6080] 618646 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.941.226 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GLUGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.941.233 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.941.252 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.941.273 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.941.347 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.941.355 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.941.350 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.941.371 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.941.379 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.941.394 [stream.cc:291] 618646 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=2, flags_=0x600.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.941.453 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.941.466 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.941.472 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.941.562 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LpLoss] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.941.566 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.941.572 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GlobalLpPool] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.941.570 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.941.676 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPool] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.941.673 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LpNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.941.674 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GLU] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.941.688 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.941.701 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.941.724 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.941.746 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.941.739 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [UnsortedSegmentSum] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.941.777 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GLUGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.941.783 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPool3D] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.941.782 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [ReverseV2] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.941.803 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Select] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.941.815 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.941.828 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [SegmentSum] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.941.850 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Slice] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.941.869 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [OneHot] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.941.886 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.941.881 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : [InferShape]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.941.894 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [ScatterNd] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.941.919 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Cumprod] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.941.972 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [CumulativeLogsumexp] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.941.977 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.941.999 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPoolV3] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.941.995 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MinAreaPolygons] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.941.995 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.942.014 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [MaskedSelect] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.942.078 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LpLoss] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.942.101 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.942.110 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.942.113 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.942.180 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LpNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.942.203 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaximumGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.942.206 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.942.225 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MinimumGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.942.230 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.942.228 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.942.251 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.942.294 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.942.324 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.942.335 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.942.410 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.942.422 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LogSoftmaxGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.942.449 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.942.454 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.942.467 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.942.447 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Concat] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.942.479 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MinAreaPolygons] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.942.489 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftMarginLoss] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.942.511 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.942.528 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftmaxFocalLoss] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.942.530 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.942.545 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.942.565 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.942.565 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.942.581 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.942.632 [stream.cc:688] 618646 Setup: stream setup end, stream_id=2, IsTaskSink=0, sqId=2, cqId=2, deviceId=0, streamResId=65535
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.942.657 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.942.650 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : [Tiling][TilingParse]
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:41.942.663 [stream_state_callback_manager.cc:45] 618646 Notify: not reg stream state callback func!
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.942.669 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [NonDeterministicInts] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.942.685 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Mish] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.942.676 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.942.680 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.942.682 [api_impl.cc:1162] 618646 StreamCreate: Succ, flags=1536, stream_id=2, context=aaab06c88220
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.942.687 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [InferShape][InferDataType]
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.942.705 [stream.cpp:189]618646 aclrtSetStreamFailureMode: start to execute aclrtSetStreamFailureMode, mode is 1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.942.730 [stream.cc:3161] 618646 SetFailMode: stream_id=2 is updated from CONTINUE to STOP.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.942.746 [stream.cpp:195]618646 aclrtSetStreamFailureMode: successfully execute aclrtSetStreamFailureMode, mode is 1
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.942.779 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.942.783 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.942.787 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.942.800 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.942.804 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:105] RegCallback] Register callback thread, stream : 0xaaab07cd7cf0.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.942.829 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : [Tiling][TilingParse]
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.942.843 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:377] CreateDefaultStream] Create ascend default stream, stream id: 0
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.942.860 [stream.cpp:48]618646 aclrtCreateStreamWithConfig: start to execute aclrtCreateStreamWithConfig with priority:0, flag:3
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.942.880 [api_impl.cc:1120] 618646 StreamCreate: priority=0, flags=1536.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.942.886 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.942.879 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.942.889 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.942.917 [npu_driver.cc:404] 618646 StreamIdAlloc: stream id alloc begin, device_id=0, priority=0, ts_id=0, remote_stream_id=0
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.942.945 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.942.953 [stream.cc:2246] 618646 AllocExecutedTimesSvm: stream_id=3.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.942.975 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.942.986 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.942.979 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [Flatten] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.942.991 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.942.993 [stream_sqcq_manage.cc:147] 618646 Alloc: deviceId=0, tsId=0, drvFlag=0
[WARNING] GE(618670,python3.9):2025-04-03-09:27:41.943.009 [operator_factory_impl.cc:222]618670 RegisterInferShapeFunc:op [DepthToSpace] has registered infer func
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.943.026 [npu_driver.cc:882] 618646 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.943.058 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.943.088 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.943.095 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.943.083 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.943.101 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.943.197 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.943.193 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.943.211 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.943.209 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.943.267 [npu_driver.cc:6125] 618646 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.943.291 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.943.310 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftmaxCrossEntropyWithLogits] register OP_IMPL : []
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.943.318 [npu_driver.cc:6137] 618646 LogicCqAllocateV2: success: deviceId=0, tsId=0, cqId=490, streamId=3, logicCq=490, cqeDepth=4096
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.943.320 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.943.326 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.943.344 [npu_driver.cc:6189] 618646 StreamBindLogicCq: success: deviceId=0, tsId=0, streamId=3, logicCq=490.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.943.365 [npu_driver.cc:5916] 618646 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=c012d000, addr=dfffc012d000size=4096
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.943.382 [stream.cc:653] 618646 Setup: Success to get sq=3 sq reg virtual addr length=4096.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.943.391 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.943.409 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.943.428 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.943.434 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [][]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:41.943.430 [devmm_svm.c:1972][ascend][curpid:618646,618646][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.943.452 [npu_driver.cc:6080] 618646 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.943.453 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.943.490 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.943.533 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.943.540 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.943.590 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.943.646 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.943.642 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.943.657 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.943.653 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.943.690 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.943.697 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[EluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.943.724 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.943.746 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.943.748 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.943.764 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.943.764 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.943.776 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SyncBNTrainingUpdate] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.943.783 [stream.cc:291] 618646 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=3, flags_=0x600.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.943.789 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.943.804 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Abs] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.943.833 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Real] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.943.848 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.943.857 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Acos] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.943.872 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.943.882 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Acosh] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.943.890 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.943.907 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddMatMatElements] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.943.933 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Adds] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.943.956 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.943.959 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Asin] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.943.970 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GridSampler2DGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.943.984 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Asinh] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.943.987 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.943.993 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.008 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AssignAdd] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.036 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AssignSub] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.944.056 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.060 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Atan] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.084 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Atanh] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.944.087 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.944.091 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.106 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.944.127 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GridSampler3DGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.132 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BesselI0e] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.944.171 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyAdadeltaD] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.944.192 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyAdagradD] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.944.211 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyAdagradV2D] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.202 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BesselI1e] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.944.206 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.944.210 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.944.231 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyAdaMaxD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.231 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.944.249 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyAdamD] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.944.267 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.259 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.944.286 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.293 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.944.304 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyAddSignD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.944.308 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.315 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.944.322 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyCenteredRMSPropD] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.944.321 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.944.341 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyFtrlD] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.944.323 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.343 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Bucketize] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.944.359 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyFtrlV2D] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.369 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Cast] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.944.380 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyGradientDescent] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.393 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Ceil] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.944.404 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyKerasMomentumD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.944.407 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.944.423 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyMomentumD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.418 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CeluV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.944.442 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyPowerSignD] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.944.439 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.449 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ComplexAbs] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.944.462 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyProximalAdagradD] register OP_IMPL : []
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.944.448 [stream.cc:688] 618646 Setup: stream setup end, stream_id=3, IsTaskSink=0, sqId=3, cqId=3, deviceId=0, streamResId=0
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:41.944.475 [stream_state_callback_manager.cc:45] 618646 Notify: not reg stream state callback func!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.944.480 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyProximalGradientDescent] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.477 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Cos] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.944.492 [api_impl.cc:1162] 618646 StreamCreate: Succ, flags=1536, stream_id=3, context=aaab06c88220
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.944.499 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyRMSPropD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.503 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Cosh] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.944.506 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [InferShape][InferDataType]
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.944.511 [stream.cpp:189]618646 aclrtSetStreamFailureMode: start to execute aclrtSetStreamFailureMode, mode is 1
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.944.511 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.944.520 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyAdagradDAD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.525 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.944.535 [stream.cc:3161] 618646 SetFailMode: stream_id=3 is updated from CONTINUE to STOP.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.944.551 [stream.cpp:195]618646 aclrtSetStreamFailureMode: successfully execute aclrtSetStreamFailureMode, mode is 1
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.944.545 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.552 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DataFormatDimMap] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.578 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Dequantize] register OP_IMPL : [InferShape]
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.944.589 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:105] RegCallback] Register callback thread, stream : 0xaaab07e09880.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.602 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Elu] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.944.607 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.944.631 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.627 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Erf] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.944.651 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.654 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Erfc] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.680 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Exp] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.705 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Expm1] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.944.707 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.944.702 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PadV4Grad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.944.719 [callback.cpp:25]618646 aclrtSubscribeReport: start to execute aclrtSubscribeReport, threadId is 281471050575776.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.731 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FakeQuantWithMinMaxVars] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.944.736 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FusedMulApplyMomentum] register OP_IMPL : []
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.944.748 [npu_driver.cc:462] 618646 EventIdAlloc: event id alloc begin, device_id=0, ts_id=0, remote_event_id=0
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.944.756 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.944.758 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FusedMulApplyKerasMomentum] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.755 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FastGelu] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.944.758 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.780 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FastGeluV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.944.798 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : [InferShape]
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:41.944.796 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.944.802 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.806 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Floor] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.944.814 [npu_driver.cc:483] 618646 EventIdAlloc: Event id alloc success, device_id=0, ts_id=0, event_id=0, eventFlag=0
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:41.944.815 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.835 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FusedMulAddN] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.944.831 [event.cc:347] 618646 GenEventId: Event id alloc success, device_id=0, tsId=0, eventFlag=1, event_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.944.853 [subscribe.cc:54] 618646 AssignGroupId: give groupId=6[INFO] GE(618666,python3.9):2025-04-03-09:27:41.944.861 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.864 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HardSigmoid] register OP_IMPL : [InferShape]
4
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.944.885 [npu_driver.cc:3775] 618646 SqCqAllocate: deviceId=0, tsId=0, groupId=64.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.889 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HardShrink] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.944.897 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.944.896 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PadV3GradReplicate] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.944.903 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.944.910 [npu_driver.cc:3785] 618646 SqCqAllocate: alloc success, deviceId=0 sqId=133, cqId=133.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.944.910 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotatedNMS] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.915 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HardShrinkGrad] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.944.935 [subscribe.cc:131] 618646 Insert: callback subscribe: groupId=64, threadId=281471050575776, devId=0, tsId=0, streamId=2, sqId=133, cqId=133
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.944.944 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.944.953 [callback.cpp:31]618646 aclrtSubscribeReport: successfully execute aclrtSubscribeReport, threadId is 281471050575776.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.944.962 [npu_driver.cc:3828] 618836 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=64.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.953 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HardSwish] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.944.960 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GeluGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.944.977 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HardSwishGrad] register OP_IMPL : [InferShape]
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.944.984 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:125] RegCallback] Register callback thread success, stream : 0xaaab07cd7cf0.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.001 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HardtanhGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.944.998 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.945.018 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.945.025 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.027 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IndexFillD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.945.014 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.051 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.945.060 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GeluGradV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.070 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : [InferShape]
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.945.068 [callback.cpp:25]618646 aclrtSubscribeReport: start to execute aclrtSubscribeReport, threadId is 281471042121632.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.945.092 [npu_driver.cc:462] 618646 EventIdAlloc: event id alloc begin, device_id=0, ts_id=0, remote_event_id=0
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.097 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Inv] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.945.113 [npu_driver.cc:483] 618646 EventIdAlloc: Event id alloc success, device_id=0, ts_id=0, event_id=1, eventFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.945.130 [event.cc:347] 618646 GenEventId: Event id alloc success, device_id=0, tsId=0, eventFlag=1, event_id=1
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.122 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Invert] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.945.128 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotatedNMS] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.945.137 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.945.138 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.148 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Log] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.945.150 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : [Tiling][TilingParse]
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.945.123 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.945.147 [subscribe.cc:54] 618646 AssignGroupId: give groupId=65
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.945.176 [npu_driver.cc:3775] 618646 SqCqAllocate: deviceId=0, tsId=0, groupId=65.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.174 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Log1p] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.945.195 [npu_driver.cc:3785] 618646 SqCqAllocate: alloc success, deviceId=0 sqId=134, cqId=134.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.205 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LogicalNot] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.945.213 [subscribe.cc:131] 618646 Insert: callback subscribe: groupId=65, threadId=281471042121632, devId=0, tsId=0, streamId=3, sqId=134, cqId=134
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.229 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LogAddExp] register OP_IMPL : [InferShape]
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.945.233 [callback.cpp:31]618646 aclrtSubscribeReport: successfully execute aclrtSubscribeReport, threadId is 281471042121632.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.945.241 [npu_driver.cc:3828] 618837 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=65.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.945.240 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IsNegInf] register OP_IMPL : [][]
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.945.258 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:125] RegCallback] Register callback thread success, stream : 0xaaab07e09880.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.945.225 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.254 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LpNormUpdate] register OP_IMPL : [InferShape]
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.945.279 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:386] CreateDefaultStream] Create ascend communication stream, stream id: 1
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.945.273 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.280 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LpNormUpdateV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.308 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Dawsn] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.333 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Expint] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.945.340 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IsPosInf] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.945.346 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.358 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Erfinv] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.945.363 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SilentCheck] register OP_IMPL : [InferShape][InferDataType]
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.945.367 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:110] Initialize] Config huge_page_reserve_size : 0, device_hbm_huge_page_reserved_size_ : 0
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.382 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FresnelCos] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.945.387 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.407 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FresnelSin] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.945.421 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.433 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Ndtri] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.945.445 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.458 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Spence] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.483 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Fills] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.945.482 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.507 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LeakyRelu] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.945.521 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.532 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[OnesLike] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.945.552 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SilentCheck] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.560 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Reciprocal] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.592 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Sign] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.945.594 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.616 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Sqrt] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.945.621 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.945.613 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.641 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Tanh] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.945.658 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.667 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ZerosLike] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.692 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Gelu] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.945.697 [npu_driver.cc:2616] 618646 MemGetInfoEx: memory info type=1, type=2, free=8860270592, hug_free=56245616640
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.945.707 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3d] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.945.721 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.720 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GeluV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.945.730 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.748 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Relu] register OP_IMPL : [InferShape]
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.945.743 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:60] AscendVmmAdapter] VMM align size is 2097152
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.945.758 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.772 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Neg] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.803 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LogSoftmaxV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.945.818 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.825 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.945.830 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [][]
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.945.846 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:158] CheckVmmDriverVersion] Driver path is /usr/local/Ascend
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.850 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftmaxV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.945.850 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.945.866 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3d] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.872 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : [InferShape]
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.945.896 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:187] CheckVmmDriverVersion] Driver version is 25.0.rc1.b070, major version is 25
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.897 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftplusV2] register OP_IMPL : [InferShape]
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.945.925 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h:113] IsVmmEnabled] VMM is enabled.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.945.929 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.928 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Muls] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.945.928 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.945.948 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:180] Initialize] Device MOC Size:62420M, Device free MOC Size:62089M, Reserved MOC size for Other Components(HCCL/rts/etc.):3891M, Recommend Reserved MOC size for Other Components:3880M, User define MindSpore MOC Size:0G, MindSpore Used MOC Size:58198M.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.957 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Power] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.945.968 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.945.973 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_dynamic_mem_adapter.cc:57] Initialize] Ascend Memory Adapter initialize success, Memory Statistics:
Device MOC memory size: 62420M
MindSpore Used memory size: 58198M
Used peak memory usage (without fragments): 0M
Actual peak memory usage (with fragments): 0M

[INFO] GE(618654,python3.9):2025-04-03-09:27:41.945.974 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.945.982 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Relu6] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.007 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Relu6D] register OP_IMPL : [InferShape]
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.946.007 [event.cpp:260]618646 aclrtSetOpWaitTimeout: start to execute aclrtSetOpWaitTimeout, timeout = 1980s
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.946.030 [api_impl.cc:5713] 618646 SetOpWaitTimeOut: set OP wait timeout:1980.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.946.032 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReluV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.032 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Relu6Grad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.946.038 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ActiveRotatedFilter] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.056 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.946.066 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.082 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Rint] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.946.097 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.107 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Round] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.946.132 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.133 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Rsqrt] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.946.148 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ActiveRotatedFilterGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.159 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RsqrtGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.946.165 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ActiveRotatedFilter] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.184 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Selu] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.946.212 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.209 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Shrink] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.946.231 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.240 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Sigmoid] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.946.262 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.946.266 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ActiveRotatedFilterGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.268 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.294 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SigmoidGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.316 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Sin] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.946.322 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.946.337 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Cummax] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.340 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Sinh] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.946.360 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.946.354 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.365 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SmoothL1Loss] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.946.366 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.946.367 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.389 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SmoothL1LossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.414 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LogSigmoid] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.437 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LogSigmoidGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.946.458 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.461 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LogSpaceD] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.946.471 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.946.479 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.946.479 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.488 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Softplus] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.513 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Softsign] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.538 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SqrtGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.946.561 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.562 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Square] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.946.569 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.588 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Swish] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.946.592 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.615 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwishGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.639 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SiluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.664 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardElemt] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.946.669 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.946.669 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.689 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Tan] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.946.697 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.713 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftShrink] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.946.723 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.740 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftShrinkGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.765 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Threshold] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.946.768 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Col2ImV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.946.768 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.788 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ThresholdV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.946.807 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.815 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ThresholdV2D] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.839 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Trunc] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.865 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.946.865 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.946.873 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.887 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.946.898 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.913 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MishGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.946.926 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.941 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HardSigmoidGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.961 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.946.970 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.946.982 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.003 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.947.011 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.025 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.947.034 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PSAMask] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.053 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FillDiagonal] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.947.069 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PSAMask] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.079 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IndexPut] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.104 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReadVariableOp] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.947.110 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.110 [engine.cc:188] 618646 SubmitTaskNormal: stream_id=0,task_id=3,task_type=86 (TASK_TIMEOUT_SET).
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.130 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CastLike] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.137 [timeout_set_task.cc:115] 618646 ConstructSqeForTimeoutSetTask: TaskTimeoutSetTask ConstructSqe finish,topic_type=0,cmd_type=13
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.947.144 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PSAMaskGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.154 [stream.cc:1400] 618646 AddTaskToList: public task, stream_id=0, task_id=3, task_type=86 (TASK_TIMEOUT_SET), head=3, tail=4
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.156 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FusedBiasLeakyRelu] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.173 [stream.cc:2595] 618646 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=3, type=86(TASK_TIMEOUT_SET), head=3, tail=4, sqe_num=1, lastTail=3, device_id=0
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.947.176 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PSAMaskGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.183 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StatelessBernoulliV2] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.196 [npu_driver.cc:751] 618646 SqTaskSend: device_id=0, ts_id=0, sq_id=0, sqe_num=1.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.204 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.947.215 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.214 [stars_engine.cc:893] 618646 SendTask: Sq task send finished, device_id=0, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=3, task_type=86(TASK_TIMEOUT_SET).
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.233 [stream.cc:1494] 618646 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=3.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.226 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InvertPermutation] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.247 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.251 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=0, head=3.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.271 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SearchSorted] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.947.256 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.947.273 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.292 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.295 [stars_engine.cc:622] 618646 ProcLogicCqUntilEmpty: Task Wait: stream_id=0, logicCqId=488, retCode=0
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.314 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.947.316 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : []
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.315 [stream.cc:2886] 618646 StarsWaitForTask: No.0 stream_id=0, taskId=3, currentId=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.334 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=0, head=3.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.336 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.350 [stream.cc:2886] 618646 StarsWaitForTask: No.1 stream_id=0, taskId=3, currentId=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.367 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=0, head=3.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.359 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.382 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.947.382 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.947.380 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.381 [stream.cc:2886] 618646 StarsWaitForTask: No.2 stream_id=0, taskId=3, currentId=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.410 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=0, head=4.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.947.416 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.426 [task.cc:185] 618646 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.443 [task.cc:185] 618646 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.460 [logger.cc:152] 618646 TaskFinished: device_id=0, stream_id=0, task_id=3, task_type=86 (TASK_TIMEOUT_SET), task_finish_num=4
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.481 [stars_engine.cc:437] 618646 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=3, sqHead=4, endTaskId=3, recycleTaskId=3.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.498 [stream.cc:2886] 618646 StarsWaitForTask: No.3 stream_id=0, taskId=3, currentId=3
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.947.494 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.947.494 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [InferShape][InferDataType]
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.947.516 [event.cpp:262]618646 aclrtSetOpWaitTimeout: successfully execute aclrtSetOpWaitTimeout, timeout = 1980s
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.947.519 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2d] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.516 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaskedScale] register OP_IMPL : [InferShape]
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.947.534 [event.cpp:269]618646 aclrtSetOpExecuteTimeOut: start to execute aclrtSetOpExecuteTimeOut, timeout = 900s
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.554 [engine.cc:188] 618646 SubmitTaskNormal: stream_id=0,task_id=4,task_type=86 (TASK_TIMEOUT_SET).
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.561 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AbsGrad] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.570 [timeout_set_task.cc:115] 618646 ConstructSqeForTimeoutSetTask: TaskTimeoutSetTask ConstructSqe finish,topic_type=0,cmd_type=13
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.588 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AccumulateNV2] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.588 [stream.cc:1400] 618646 AddTaskToList: public task, stream_id=0, task_id=4, task_type=86 (TASK_TIMEOUT_SET), head=4, tail=5
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.606 [stream.cc:2595] 618646 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=4, type=86(TASK_TIMEOUT_SET), head=4, tail=5, sqe_num=1, lastTail=4, device_id=0
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.615 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddN] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.947.622 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.622 [npu_driver.cc:751] 618646 SqTaskSend: device_id=0, ts_id=0, sq_id=0, sqe_num=1.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.640 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Eltwise] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.640 [stars_engine.cc:893] 618646 SendTask: Sq task send finished, device_id=0, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=4, task_type=86(TASK_TIMEOUT_SET).
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.660 [stream.cc:1494] 618646 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=4.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.674 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=0, head=4.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.666 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddV2] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.687 [stream.cc:2886] 618646 StarsWaitForTask: No.0 stream_id=0, taskId=4, currentId=3
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.693 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AcosGrad] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.702 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.718 [stream.cc:2886] 618646 StarsWaitForTask: No.1 stream_id=0, taskId=4, currentId=3
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.947.713 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.719 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AcoshGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.947.728 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.947.713 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.733 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=0, head=4.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.749 [stream.cc:2886] 618646 StarsWaitForTask: No.2 stream_id=0, taskId=4, currentId=3
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.745 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AsinGrad] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.765 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=0, head=5.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.780 [task.cc:185] 618646 GetTask: this stream no taskRes, stream_id=0
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.770 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AsinhGrad] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.794 [task.cc:185] 618646 GetTask: this stream no taskRes, stream_id=0
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.795 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Atan2] register OP_IMPL : [InferShape]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.810 [logger.cc:152] 618646 TaskFinished: device_id=0, stream_id=0, task_id=4, task_type=86 (TASK_TIMEOUT_SET), task_finish_num=5
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.820 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AtanGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.947.832 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [][]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.828 [stars_engine.cc:437] 618646 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=4, sqHead=5, endTaskId=4, recycleTaskId=4.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.947.854 [stream.cc:2886] 618646 StarsWaitForTask: No.3 stream_id=0, taskId=4, currentId=4
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.845 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Axpy] register OP_IMPL : [InferShape]
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.947.869 [event.cpp:277]618646 aclrtSetOpExecuteTimeOut: successfully execute aclrtSetOpExecuteTimeOut, timeout = 900s
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.871 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BitwiseAnd] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.898 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BitwiseOr] register OP_IMPL : [InferShape]
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.947.900 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:285] Init] End inititializing kernel runtime.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.922 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BitwiseXor] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.947.926 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.947.932 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.947.928 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [InferShape][InferDataType]
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.947.940 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:48] InitDevice] Enter SetRtDevice, current initialize device number:1
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.947 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Div] register OP_IMPL : [InferShape]
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.947.962 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:50] InitDevice] Device 0 has been set
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.974 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DivNoNan] register OP_IMPL : [InferShape]
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.947.981 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:381] CreateDefaultStream] The default compute stream is already created, skip.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.948.000 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:390] CreateDefaultStream] The default communication stream is already created, skip.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.947.999 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[EluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.947.990 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.026 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FastGeluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.948.040 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.052 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FloorDiv] register OP_IMPL : [InferShape]
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.948.054 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_pool.cc:165] DefaultEnhancedAscendMemoryPool] DefaultEnhancedAscendMemoryPool constructed.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.077 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FloorMod] register OP_IMPL : [InferShape]
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.948.088 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:397] Initialize] Skip initialization of memory pool since init size is not configured.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.101 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InvGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.126 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LeakyReluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.948.129 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ThreeNN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.948.140 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaskedSelect] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.948.129 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ThreeNN] register OP_IMPL : [InferShape][InferDataType]
[INFO] UTILS(618646,ffff85d12de0,python3.9):2025-04-03-09:27:41.948.152 [mindspore/ccsrc/utils/offload_context.cc:86] enable_aio] On ascend devices, enable aio and enable pinned mem cannot be turned on at the same time.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.150 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TanhGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.215 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Add] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.251 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Addcdiv] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.948.258 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.948.267 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Voxelization] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.948.270 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Voxelization] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.948.282 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.280 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Addcmul] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.306 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AxpyV2] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.948.302 [context.cpp:72]618646 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.948.328 [api_impl.cc:3717] 618646 ContextSetCurrent: set context=aaab06c88220, flag=0.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.333 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LogicalAnd] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.358 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LogicalOr] register OP_IMPL : [InferShape]
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.948.365 [context.cpp:80]618646 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.948.386 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.383 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Mul] register OP_IMPL : [InferShape]
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.948.390 [context.cpp:72]618646 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.948.408 [api_impl.cc:3717] 618646 ContextSetCurrent: set context=aaab06c88220, flag=0.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.411 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Pow] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.948.416 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.948.416 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.948.421 [context.cpp:80]618646 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.437 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RealDiv] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.948.450 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.948.453 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.463 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ClipByNormNoDivSum] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.948.485 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.948.485 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.487 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ClipByValue] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.948.488 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.513 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ClipByValueV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.948.523 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.948.524 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.537 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FusedMulAdd] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.948.555 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [InferShape][InferDataType][IsPrivateAtrrReg]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.948.554 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [InferShape][InferDataType][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.564 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftmaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.948.586 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.948.591 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.948.586 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.591 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Sub] register OP_IMPL : [InferShape]
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.948.589 [acl.cpp:288]618646 aclInit: start to execute aclInit
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.948.615 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [InferShape][InferDataType][IsPrivateAtrrReg]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.948.616 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [InferShape][InferDataType][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.621 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Gcd] register OP_IMPL : [InferShape]
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.948.632 [acl.cpp:298]618646 aclInit: call ErrorManager.Initialize
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.948.646 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.948.645 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.646 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LarsV2Update] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.948.674 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.948.674 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.674 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaskedFill] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.948.697 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.948.698 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.948.699 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.702 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.948.721 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.948.723 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.728 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Xlog1py] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.948.743 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.948.744 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.755 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApproximateEqual] register OP_IMPL : [InferShape]
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.948.754 [acl.cpp:242]618646 HandleErrorManagerConfig: err_msg mode is set ["1"].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.948.766 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.948.766 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.779 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Equal] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.948.799 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CompressFcOp] register OP_IMPL : [InferShape][InferDataType][IsPrivateAtrrReg]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.948.800 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CompressFcOp] register OP_IMPL : [InferShape][InferDataType][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.806 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NotEqual] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.948.809 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.948.825 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.948.825 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.831 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Greater] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.855 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GreaterEqual] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.880 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Less] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.948.907 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.910 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LessEqual] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.948.932 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.937 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Maximum] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.948.931 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.968 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Minimum] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.948.993 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Mod] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.949.010 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.949.014 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.949.043 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MulNoNan] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.949.045 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.949.051 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.949.067 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReciprocalGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.949.093 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SeluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.949.114 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.949.118 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogits] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.949.143 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftplusGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.949.154 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.949.156 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.949.167 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftplusV2Grad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.949.191 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftsignGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.949.217 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.949.215 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SquaredDifference] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.949.237 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.949.261 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ThresholdGradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.949.259 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.949.258 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.949.286 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TruncateDiv] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.949.310 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TruncateMod] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.949.316 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RNNTLoss] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.949.334 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Xdivy] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.949.361 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IsClose] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.949.368 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.949.367 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.949.388 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Xlogy] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.949.410 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.949.423 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MultinomialWithReplacement] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.949.433 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SelectV2] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.949.458 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaskedSelectV2] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.949.481 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Lerp] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.949.484 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMatMulV4] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.949.484 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMatMulV4] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.949.506 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FusedBiasLeakyReluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.949.527 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.949.558 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.949.587 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.949.587 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.949.635 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.949.657 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StatelessBernoulli] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.949.676 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.949.678 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.949.709 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.949.708 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.949.749 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.949.765 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.949.815 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.949.815 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.949.863 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.949.860 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.949.921 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.949.926 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.949.968 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.949.969 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.950.030 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.950.031 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.950.072 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UniqueConsecutive] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.950.104 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.950.132 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.950.146 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ResizeTrilinear] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.950.148 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ResizeTrilinear] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.950.164 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.950.176 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UniqueWithCountsAndSorting] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.950.190 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.950.250 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.950.250 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.950.279 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[WarpAffine] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.950.320 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.950.356 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.950.355 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.950.378 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Histogram] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.950.383 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.950.385 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.950.407 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.950.406 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.950.429 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.950.428 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.950.428 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.950.448 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.950.450 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.950.479 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.950.481 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.950.542 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.950.575 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.950.595 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.950.593 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.950.628 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.950.629 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.950.660 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.950.668 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.950.680 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Unique] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.950.660 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.950.682 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.950.694 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.950.708 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.950.726 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.950.739 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.950.759 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.950.772 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.950.772 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.950.784 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UniqueWithCounts] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.950.800 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.950.803 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.950.831 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.950.833 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.950.860 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.950.862 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.950.888 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Dot] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.950.891 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.950.890 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.950.889 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.950.906 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.950.920 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.950.922 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.950.948 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.950.949 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.950.972 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.950.971 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.950.986 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.951.006 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.951.006 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.951.026 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Quantize] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.951.042 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.951.043 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.951.054 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.951.071 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.951.076 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.951.081 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AscendDequant] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.951.094 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.951.102 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.951.105 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.951.106 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.951.129 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.951.132 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.951.195 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.951.208 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.951.210 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.951.216 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.951.204 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.951.210 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.951.319 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardReduce] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.951.322 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ActULQClampMaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.951.322 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ActULQClampMaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.951.324 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.951.351 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.951.352 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ActULQClampMinGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.951.352 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ActULQClampMinGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.951.372 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.951.376 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.951.401 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.951.422 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStatsWithCounts] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.951.430 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.951.457 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BasicLSTMInplaceFillWindowCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.951.464 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ActsULQ] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.951.466 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ActsULQ] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.951.483 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BasicGRUInplaceFillWindowCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.951.524 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.951.545 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.951.533 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.951.565 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.951.569 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ActsULQInputGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.951.569 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ActsULQInputGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.951.584 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.951.600 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.951.603 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.951.630 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.951.648 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.951.668 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.951.685 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.951.680 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.951.676 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.951.708 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.951.782 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.951.792 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.951.803 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.951.800 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.951.824 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.951.839 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.951.903 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdaptiveAvgPoolAssistMatrix] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.951.903 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdaptiveAvgPoolAssistMatrix] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.951.921 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.951.947 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.951.973 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.952.016 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.952.027 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.952.013 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.952.042 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.952.049 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.952.096 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdaCast] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.952.133 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.952.151 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.952.151 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.952.256 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.952.265 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.952.277 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.952.278 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.952.295 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.952.318 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.952.339 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.952.355 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.952.377 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.952.386 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.952.395 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.952.388 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.952.384 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.952.449 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.952.495 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.952.490 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.952.489 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.952.516 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.952.515 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.952.566 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.952.550 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.952.594 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.952.615 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.952.616 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.952.617 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.952.677 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.952.694 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.952.715 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.952.726 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.952.726 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.952.712 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.952.783 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.952.808 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.952.816 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.952.833 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.952.833 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.952.850 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyAdamWV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.952.849 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.952.915 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.952.913 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.952.937 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.952.940 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.953.007 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.953.013 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.953.016 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.953.014 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.953.021 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.953.040 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.953.049 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.953.059 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.953.045 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.953.086 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.953.096 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.953.099 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.953.135 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.953.147 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.953.161 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.953.178 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.953.211 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.953.206 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AvgPoolUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.953.209 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AvgPoolUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.953.233 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.953.280 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.953.279 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.953.313 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.953.319 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.953.317 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.953.329 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.953.351 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.953.369 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.953.400 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.953.429 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.953.437 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.953.441 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.953.467 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.953.474 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.953.487 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.953.509 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.953.509 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.953.527 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.953.533 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.953.544 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Bitcast] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.953.545 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Bitcast] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.953.629 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.953.628 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.953.643 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[L2Loss] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.953.651 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.953.652 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.953.729 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.953.734 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.953.735 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.953.752 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.953.775 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.953.828 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.953.826 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.953.825 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.953.853 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.953.872 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.953.868 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.953.895 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.953.920 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.953.928 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.953.974 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.953.982 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.953.995 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.953.997 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.954.036 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CTCLoss] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.954.036 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CTCLoss] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.954.097 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.954.086 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.954.094 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.954.139 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.954.139 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.954.180 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.954.197 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.954.201 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.954.232 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceAny] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.954.248 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.954.251 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.954.257 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceAll] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.954.287 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceMax] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.954.306 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.954.310 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.954.313 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.954.328 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.954.336 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceMeanWithCast] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.954.348 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.954.343 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.954.344 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.954.349 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.954.362 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceMin] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.954.376 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.954.386 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceProd] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.954.405 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.954.412 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.954.432 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.954.442 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[EuclideanNorm] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.954.447 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.954.443 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.954.457 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DropOutGenMask] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.954.456 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DropOutGenMask] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.954.460 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.954.466 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceLogSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.954.472 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.954.485 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.954.491 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.954.488 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StatelessDropOutGenMask] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.954.491 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceLogSumExp] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.954.489 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StatelessDropOutGenMask] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.954.514 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.954.533 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MlaAttentionScore] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.954.543 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.954.569 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.954.593 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.954.595 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.954.595 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceNansum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.954.597 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.954.596 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.954.626 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.954.657 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.954.691 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.954.694 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.954.694 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.954.705 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.954.706 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.954.707 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.954.721 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.954.732 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.954.748 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.954.767 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.954.776 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.954.790 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.954.801 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.954.811 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.954.809 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.954.809 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.954.812 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.954.828 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.954.833 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.954.854 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.954.881 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.954.907 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.954.912 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.954.919 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.954.922 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.954.933 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.954.944 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.954.955 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.954.960 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.954.986 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.955.015 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.014 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.955.031 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ExpandDims] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.955.031 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ExpandDims] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.040 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.065 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.955.064 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.091 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.955.119 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.116 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.955.116 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.955.139 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.955.141 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.142 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.955.170 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.172 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.955.196 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.200 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.955.221 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.226 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.252 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.955.286 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FillWindowCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.278 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.955.286 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FillWindowCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.955.307 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.311 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.955.330 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.339 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.370 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.955.394 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.955.393 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.401 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.955.414 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [InferShape][InferShapeRange][InferDataType][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.426 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.955.434 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2dAssistMatrix] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.955.445 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SplitD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.453 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.955.468 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.479 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.955.501 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FlattenV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.955.501 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FlattenV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.507 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.530 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.955.540 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.955.530 [op_tiling_manager.cc:79]618650 LoadSo:dlopen file /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so successfully!
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.557 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.583 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.955.587 [op_tiling_manager.cc:58]618650 LoadSo:[FindSo][Check] Get path with op_master [/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_master/] failed
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.955.597 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.955.608 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GatherShapes] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.608 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.955.609 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GatherShapes] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.634 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.955.641 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.665 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.692 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.955.707 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.719 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.955.719 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GaussianBlur] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.955.720 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GaussianBlur] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.955.739 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.745 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.773 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.799 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.955.813 [op_tiling_manager.cc:67]618650 LoadSo:Failed to dlopen /usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.825 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.955.826 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.955.839 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : []
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.955.861 [op_tiling_manager.cc:73]618650 LoadSo:Failed to dlopen /usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.955.864 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FileConstant] register OP_IMPL : [IsPrivateAtrrReg]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.955.864 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FileConstant] register OP_IMPL : [IsPrivateAtrrReg]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.955.898 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StatelessIf] register OP_IMPL : [InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.955.897 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StatelessIf] register OP_IMPL : [InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.955.926 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[If] register OP_IMPL : [InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.955.926 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[If] register OP_IMPL : [InputsDependency]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.955.926 [op_tiling_manager.cc:58]618650 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.955.932 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.955.949 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Cdist] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.955.954 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[_If] register OP_IMPL : [InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.955.953 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[_If] register OP_IMPL : [InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.955.983 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Case] register OP_IMPL : [InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.955.983 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Case] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.955.995 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachACosInplace] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.955.996 [op_tiling_manager.cc:67]618650 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.956.038 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ConstPlaceHolder] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.956.040 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.956.052 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CdistGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.956.051 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ConstPlaceHolder] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.956.042 [op_tiling_manager.cc:73]618650 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.956.109 [op_tiling_manager.cc:58]618650 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.956.144 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.956.146 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.956.173 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.956.170 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.956.147 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.956.202 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : []
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.956.196 [op_tiling_manager.cc:67]618650 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.956.223 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.956.267 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.956.267 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.956.303 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.956.315 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.956.337 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.956.356 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.956.355 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Identity] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.956.360 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Identity] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.956.349 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMulScalarInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.956.385 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MemcpyAsync] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.956.389 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MemcpyAsync] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.956.389 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachLogInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.956.414 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IdentityN] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.956.414 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.956.417 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSubListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.956.415 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IdentityN] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.956.442 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMulListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.956.458 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.956.470 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachDivListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.956.516 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.956.518 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.956.524 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.956.564 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.956.618 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.956.619 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.956.628 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSubScalarInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.956.630 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.956.664 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.956.729 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.956.729 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.956.742 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.956.762 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GlobalLpPool] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.956.760 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.956.788 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.956.813 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.956.833 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.956.833 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.956.863 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GLU] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.956.862 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.956.928 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.956.941 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.956.940 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.956.967 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GLUGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.956.986 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.957.036 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.957.046 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.957.048 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.957.061 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.957.066 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.957.072 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.957.072 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.957.099 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.957.100 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.957.108 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.957.173 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.957.180 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.957.179 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:AllFinite, funcPointer:(nil), registered count:2
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.957.214 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:AllFinite, funcPointer:(nil), registered count:4
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.957.226 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.957.239 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:AllFinite, funcPointer:(nil), registered count:1
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.957.240 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.957.243 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.957.262 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:AllFinite, funcPointer:(nil), registered count:1
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.957.269 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.957.270 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.957.284 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LpLoss] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.957.283 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.957.288 [op_check.cc:71]618650 RegisterParamGeneralize:RegisterParamGeneralize: op_type:AllFinite, funcPointer:(nil), registered count:1
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.957.348 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.957.348 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.957.385 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LpNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.957.388 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.957.395 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.957.409 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.957.432 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.957.452 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.957.469 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.957.469 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.957.493 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.957.518 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.957.546 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MinAreaPolygons] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.957.575 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.957.575 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.957.608 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.957.625 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff5c2519b0, registered count:3
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.957.633 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.957.653 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.957.652 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:5
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.957.675 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:2
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.957.684 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.957.688 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.957.689 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.957.695 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:2
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.957.713 [op_check.cc:71]618650 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:2
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.957.747 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.957.759 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.957.793 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.957.793 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.957.779 [error_manager.cc:673]618646 ParseJsonFile:Parse json file:/usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/../conf/error_manager/error_code.json success
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.957.821 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.957.853 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.957.859 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.957.899 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.957.899 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.957.945 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.957.957 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.957.961 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.957.975 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.958.004 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.958.007 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.958.005 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.958.033 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff5c254da0, registered count:4
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.958.062 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.958.059 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.958.070 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.958.084 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.958.096 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.958.105 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.958.124 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RandomChoiceWithMask] register OP_IMPL : [InferShapeRange]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.958.126 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RandomChoiceWithMask] register OP_IMPL : [InferShapeRange]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.958.126 [op_check.cc:71]618650 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.958.135 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.958.165 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.958.166 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.958.195 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.958.202 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.958.233 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RandomUniform] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.958.238 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RandomUniform] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.958.269 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.958.312 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.958.317 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.958.318 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Rank] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.958.319 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Rank] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.958.348 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Size] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.958.359 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Size] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.958.373 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.958.422 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.958.430 [op_tiling_manager.cc:75]618650 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.958.452 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.958.456 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.958.473 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.958.475 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.958.499 [op_tiling_manager.cc:58]618650 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.958.530 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : [InferShape]
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.958.551 [acl.cpp:315]618646 aclInit: call ge interface executor.Initialize
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.958.565 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Reshape] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.958.564 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Reshape] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.958.573 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : []
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.958.586 [op_tiling_manager.cc:67]618650 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] PROFILING(618646,python3.9):2025-04-03-09:27:41.958.630 [prof_atls_plugin.cpp:210] (tid:618646) Module[45] register callback of ctrl handle.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.958.641 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.958.673 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RgbToGrayscale] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.958.679 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.958.672 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RgbToGrayscale] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.958.656 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.958.680 [ge_executor.cc:273]618646 Initialize:Init GeExecutor begin.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.958.753 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.958.751 [op_lib_register.cc:117]618646 GetAllCustomOpApiSoPaths:value of env ASCEND_CUSTOM_OPP_PATH is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/ho
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.958.784 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.958.782 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.958.783 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.958.790 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.958.815 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.958.826 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.958.841 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.958.884 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [][][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.958.880 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.958.889 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.958.889 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.958.914 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.958.945 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.958.947 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.958.950 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.958.971 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : [InferShape]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.958.980 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.958.992 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.958.991 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.958.994 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.958.993 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : [InferShape]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.959.011 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.959.019 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.959.041 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : [InferShape]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.959.042 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.959.062 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : [InferShape]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.959.074 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.959.082 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.959.094 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.959.103 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.959.100 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Rotate] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.959.100 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Rotate] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.959.105 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.959.124 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : [InferShape]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.959.138 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.959.145 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.959.147 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IndexPutWithSort] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.959.163 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [InferShape]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.959.167 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.959.185 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.959.185 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Shape] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.959.192 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.959.188 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Shape] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.959.205 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.959.206 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.959.215 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ShapeN] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.959.213 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ShapeN] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.959.227 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : [InferShape]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.959.240 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.959.250 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.959.272 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.959.271 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.959.276 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.959.296 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.959.293 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [InferShape]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.959.304 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.959.335 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.959.366 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.959.365 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff5c20b2c0, registered count:4
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.959.396 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.959.396 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.959.396 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.959.404 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SegmentSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.959.419 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.959.427 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.959.441 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.959.443 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SilentCheckV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.959.444 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SilentCheckV2] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.959.458 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/libcust_opapi.so, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.959.461 [op_check.cc:71]618650 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.959.491 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InplaceIndexAddWithSorted] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.959.497 [op_lib_register.cc:165]618646 CallInitFunc:CallInitFunc 0 successfully, op_lib_paths_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/je
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.959.513 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.959.511 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.959.538 [plugin_manager.cc:616]618646 GetOpTilingForwardOrderPath:Enter GetOpTilingPath schedule
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.959.557 [plugin_manager.cc:108]618646 GetOppPath:Enter get opp path schedule
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.959.591 [plugin_manager.cc:117]618646 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.959.615 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.959.617 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.959.622 [plugin_manager.cc:624]618646 GetOpTilingForwardOrderPath:Opp plugin path structure is new version!
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.959.623 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.959.641 [plugin_manager.cc:206]618646 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.959.667 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SilentCheckV3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.959.671 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SilentCheckV3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.959.716 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.959.729 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.959.739 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.959.769 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.959.790 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff5c20f978, registered count:4
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.959.795 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.959.795 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.959.797 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.959.821 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.959.816 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.959.838 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.959.833 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.959.857 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.959.876 [op_check.cc:71]618650 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.959.904 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.959.905 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.959.920 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.959.981 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.959.979 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.960.017 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.960.021 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyAdadelta] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.960.021 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyAdadelta] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.960.050 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyAdadeltaD] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.960.051 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyAdadeltaD] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.960.078 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.960.077 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.960.092 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UnsortedSegmentMax] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.960.103 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyAdagrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.960.104 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyAdagrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.960.122 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.960.122 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UnsortedSegmentMin] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.960.129 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.960.130 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.960.144 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.960.175 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.960.175 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.960.149 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UnsortedSegmentProd] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.960.155 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.960.213 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.960.204 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.960.195 [op_tiling_manager.cc:75]618650 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.960.231 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.960.241 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.960.253 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotatedNMS] register OP_IMPL : [][][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.960.252 [op_tiling_manager.cc:58]618650 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.960.262 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.960.253 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.960.284 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.960.287 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.960.308 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.960.310 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.960.332 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2D] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.960.334 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2D] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.960.339 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.960.334 [op_tiling_manager.cc:67]618650 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.960.357 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyRMSProp] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.960.357 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyRMSProp] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.960.365 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.960.382 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyRMSPropD] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.960.387 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyRMSPropD] register OP_IMPL : [InferShape]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.960.404 [op_tiling_manager.cc:73]618650 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.960.448 [op_tiling_manager.cc:58]618650 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.960.470 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.960.473 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.960.492 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseFillEmptyRows] register OP_IMPL : [InferShapeRange][InputsDependency]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.960.495 [op_tiling_manager.cc:67]618650 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.960.497 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseFillEmptyRows] register OP_IMPL : [InferShapeRange][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.960.498 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.960.524 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.960.534 [op_tiling_manager.cc:75]618650 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.960.546 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.960.563 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.960.569 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SilentCheck] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.960.575 [op_tiling_manager.cc:58]618650 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.960.614 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.960.619 [op_tiling_manager.cc:67]618650 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.960.652 [op_tiling_manager.cc:75]618650 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.960.674 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.960.694 [op_tiling_manager.cc:58]618650 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.960.700 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.960.703 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.960.704 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : [InferShape]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.960.740 [op_tiling_manager.cc:67]618650 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.960.774 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : []
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.960.781 [op_tiling_manager.cc:73]618650 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.960.822 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Squeeze] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.960.826 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Squeeze] register OP_IMPL : [InferShape]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.960.821 [op_tiling_manager.cc:58]618650 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.960.851 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SqueezeV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.960.854 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SqueezeV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.960.857 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.960.873 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3d] register OP_IMPL : []
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.960.877 [op_tiling_manager.cc:67]618650 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.960.881 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SqueezeV3] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.960.879 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SqueezeV3] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.960.916 [op_tiling_manager.cc:75]618650 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.960.957 [op_tiling_manager.cc:58]618650 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.960.966 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.960.983 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.960.985 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.960.988 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.960.993 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.961.002 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.961.002 [op_tiling_manager.cc:67]618650 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.961.022 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.961.039 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.961.041 [op_tiling_manager.cc:75]618650 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.961.077 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.961.084 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.961.081 [op_tiling_manager.cc:58]618650 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.961.097 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StatelessRandomNormalV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.961.098 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StatelessRandomNormalV2] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.961.118 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.961.122 [op_tiling_manager.cc:67]618650 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.961.137 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.961.154 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not ver[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.961.165 [op_tiling_manager.cc:73]618650 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
ify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.961.162 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.961.186 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ActiveRotatedFilter] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.961.187 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.961.206 [op_tiling_manager.cc:58]618650 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.961.203 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.961.210 [plugin_manager.cc:215]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.961.208 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.961.250 [op_tiling_manager.cc:67]618650 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.961.292 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ActiveRotatedFilterGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.961.294 [op_tiling_manager.cc:75]618650 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.961.319 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.961.319 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.961.337 [op_tiling_manager.cc:58]618650 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.961.337 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.961.380 [op_tiling_manager.cc:67]618650 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.961.391 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.961.414 [op_tiling_manager.cc:75]618650 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.961.436 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TopK] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.961.438 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TopK] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.961.456 [op_tiling_manager.cc:58]618650 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.961.461 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.961.463 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.961.485 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.961.486 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.961.498 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.961.497 [op_tiling_manager.cc:67]618650 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.961.508 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.961.507 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.961.533 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.961.532 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.961.533 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.961.539 [op_tiling_manager.cc:73]618650 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.961.559 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.961.579 [op_tiling_manager.cc:58]618650 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.961.599 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.961.595 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.961.612 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.961.622 [op_tiling_manager.cc:67]618650 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.961.629 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.961.638 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TopKPQDistanceV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.961.640 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TopKPQDistanceV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.961.659 [op_tiling_manager.cc:75]618650 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.961.669 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.961.676 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.961.703 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.961.700 [op_tiling_manager.cc:58]618650 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.961.742 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.961.751 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.961.753 [op_tiling_manager.cc:67]618650 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.961.790 [op_tiling_manager.cc:75]618650 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.961.809 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.961.801 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.961.812 [op_tiling_manager.cc:109]618650 ~FuncPerfScope:[GEPERFTRACE] The time cost of OpTilingManager::LoadSo is [196846] micro seconds.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.961.859 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TransArgb] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.961.859 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TransArgb] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.961.908 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.961.925 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.961.941 [plugin_manager.cc:639]618650 GetConstantFoldingOpsPath:Enter GetConstantFoldingOpsPath schedule
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.961.961 [plugin_manager.cc:108]618650 GetOppPath:Enter get opp path schedule
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.961.976 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Unsqueeze] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.961.977 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Unsqueeze] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.961.992 [plugin_manager.cc:117]618650 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.962.007 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UnsqueezeV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.962.017 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.962.014 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.962.016 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UnsqueezeV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.962.037 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UnsqueezeV3] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.962.051 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.962.052 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UnsqueezeV3] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.962.070 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.962.060 [host_cpu_engine.cc:254]618650 LoadLib:To invoke dlopen on lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libconstant_folding_ops.so
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.962.058 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.962.084 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.962.129 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PSAMask] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.962.125 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.962.154 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.962.156 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : [InferShape]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.962.164 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.962.183 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dGrad] register OP_IMPL : [InferShape]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.962.182 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.962.187 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dGrad] register OP_IMPL : [InferShape]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.962.203 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.962.200 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.962.219 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.962.238 [plugin_manager.cc:215]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.962.296 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Where] register OP_IMPL : [InferShapeRange]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.962.297 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Where] register OP_IMPL : [InferShapeRange]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.962.368 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.962.404 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[WtsARQ] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.962.403 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[WtsARQ] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.962.378 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PSAMaskGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.962.513 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.962.513 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.962.498 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.962.533 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.962.600 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.962.580 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.962.618 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.962.622 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.962.634 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.962.653 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.962.658 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Resize] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.962.666 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.962.670 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.962.705 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.962.706 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.962.726 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.962.730 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.962.757 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.962.754 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.962.780 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.962.807 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.962.809 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdamApplyOne] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.962.841 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdamApplyOneAssign] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.962.866 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecay] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.962.864 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.962.864 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.962.892 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.962.892 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.962.891 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecayAssign] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.962.906 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.962.904 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.963.007 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ThreeNN] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.963.005 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdjustContrast] register OP_IMPL : [InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.963.000 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdjustContrast] register OP_IMPL : [InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.963.029 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdjustHue] register OP_IMPL : [InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.963.032 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdjustHue] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.963.038 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.963.048 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.963.056 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdjustSaturation] register OP_IMPL : [InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.963.058 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdjustSaturation] register OP_IMPL : [InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.963.086 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CropAndResize] register OP_IMPL : [InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.963.086 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CropAndResize] register OP_IMPL : [InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.963.112 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CropAndResizeV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.963.117 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Voxelization] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.963.113 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CropAndResizeV2] register OP_IMPL : [InputsDependency]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.963.084 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.963.100 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.963.114 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.963.140 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DecodeAndCropJpeg] register OP_IMPL : [InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.963.146 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.963.142 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DecodeAndCropJpeg] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.963.157 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.963.159 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BN3DTrainingReduce] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.963.166 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DecodeJpeg] register OP_IMPL : [InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.963.168 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DecodeJpeg] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.963.188 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.963.198 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NormalizeV2] register OP_IMPL : [InputsDependency]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.963.180 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.963.198 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.963.213 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.963.210 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.963.197 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NormalizeV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.963.226 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdjustContrastWithMean] register OP_IMPL : [InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.963.227 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.963.232 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.963.234 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.963.235 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdjustContrastWithMean] register OP_IMPL : [InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.963.248 [plugin_manager.cc:215]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.963.252 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdjustBrightness] register OP_IMPL : [InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.963.262 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.963.263 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdjustBrightness] register OP_IMPL : [InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.963.283 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.963.278 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdjustBrightnessV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.963.287 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdjustBrightnessV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.963.309 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.963.306 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdjustSaturationV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.963.315 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdjustSaturationV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.963.337 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.963.339 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[WarpAffineV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.963.341 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[WarpAffineV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.963.343 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNTrainingReduce] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.963.361 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [][][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.963.367 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ImgCrop] register OP_IMPL : [InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.963.366 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ImgCrop] register OP_IMPL : [InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.963.382 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.963.394 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[WarpPerspective] register OP_IMPL : [InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.963.394 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[WarpPerspective] register OP_IMPL : [InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.963.403 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [][][][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.963.425 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : [][][][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.963.445 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.963.462 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.963.457 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.963.482 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.963.499 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.963.498 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.963.501 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.963.520 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CompressFcOp] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.963.523 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.963.526 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.963.540 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.963.547 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.963.548 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.963.567 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.963.628 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.963.645 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.963.639 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.963.669 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HcomAllReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.963.667 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HcomAllReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.963.675 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : [InferShape]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.963.676 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.963.695 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.963.696 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HcomAllGather] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.963.712 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.963.698 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HcomAllGather] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.963.749 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.963.749 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.963.779 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.963.850 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.963.729 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HcomBroadcast] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.963.877 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HcomBroadcast] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.963.883 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.963.894 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HcomReduceScatter] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.963.905 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HcomReduceScatter] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.963.922 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HcomSend] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.963.936 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HcomSend] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.963.947 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HcomReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.963.957 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.963.962 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HcomReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.963.972 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HcomReceive] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.963.990 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HcomReceive] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.963.989 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.963.998 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HcomAllToAllV] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.964.015 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HcomAllToAllV] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.964.023 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HcomAllToAllVC] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.964.041 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HcomAllToAllVC] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.964.047 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HcomGatherAllToAllV] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.964.060 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.964.068 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HcomGatherAllToAllV] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.964.103 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.964.131 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.964.138 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.964.163 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.964.180 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.964.176 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMatMulV4] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.964.217 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.964.239 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.964.254 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.964.272 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.964.291 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.964.281 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.964.277 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.964.306 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.964.323 [plugin_manager.cc:215]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.964.366 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.964.367 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.964.390 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.964.417 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.964.498 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.964.494 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.964.520 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.964.524 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.964.599 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.964.631 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[INTrainingReduceV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.964.660 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.964.665 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.964.703 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.964.699 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.964.717 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.964.732 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.964.753 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.964.769 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.964.782 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[INTrainingUpdateGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.964.786 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.964.803 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ResizeTrilinear] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.964.810 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[INTrainingUpdateGradGammaBeta] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.964.836 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[INTrainingUpdateV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.964.902 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.964.914 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.964.940 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.965.011 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.965.033 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.965.051 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.965.042 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.965.046 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.965.071 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.965.089 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.965.110 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.965.144 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.965.158 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.965.165 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.965.161 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.965.201 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.965.189 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.965.192 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.965.219 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [][][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.965.244 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.965.243 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.965.267 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.965.267 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.965.289 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [][][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.965.282 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.965.300 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.965.284 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.965.285 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.965.294 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.965.314 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [][][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.965.315 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.965.333 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.965.337 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.965.349 [plugin_manager.cc:215]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.965.368 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.965.365 [plugin_manager.cc:218]618646 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-pack
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.965.373 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.965.374 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.965.388 [plugin_manager.cc:422]618646 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.965.390 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [][][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.965.374 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.965.405 [plugin_manager.cc:155]618646 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.965.415 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [][][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.965.436 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.965.426 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.965.430 [plugin_manager.cc:158]618646 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.965.447 [plugin_manager.cc:426]618646 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.965.457 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [][][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.965.459 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.965.465 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.965.489 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.965.488 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.965.508 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.965.535 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.965.546 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.965.549 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.965.545 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.965.560 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [][][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.965.585 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [][][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.965.605 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [][][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.965.598 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.965.626 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.965.622 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.965.623 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.965.706 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.965.709 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPool] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.965.713 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.965.746 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.965.746 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.965.781 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.965.810 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ActULQClampMaxGrad] register OP_IMPL : []
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.965.815 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.965.832 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ActULQClampMinGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.965.833 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPool3D] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.965.849 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.965.849 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.965.833 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.965.864 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.965.850 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.965.901 [plugin_manager.cc:439]618646 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.965.922 [plugin_manager.cc:175]618646 ReversePathString:Enter ReversePathString schedule
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.965.928 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ActsULQ] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.965.946 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.965.945 [plugin_manager.cc:187]618646 ReversePathString:path_str is '/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/:/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.965.952 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.965.957 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.965.980 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.966.027 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ActsULQInputGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.966.032 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.966.037 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.966.071 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPoolV3] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.966.108 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.966.112 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.966.132 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.966.181 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.966.185 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.966.189 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.966.186 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.966.211 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.966.213 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.966.233 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.966.270 [plugin_manager.cc:996]618646 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.966.297 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaximumGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.966.302 [plugin_manager.cc:1011]618646 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.966.308 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.966.326 [plugin_manager.cc:1015]618646 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.966.327 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MinimumGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.966.336 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdaptiveAvgPoolAssistMatrix] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.966.354 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.966.356 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [InputsDependency]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:41.966.372 [op_tiling_manager.cc:58]618646 LoadSo:[FindSo][Check] Get path with op_master [/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.966.435 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.966.434 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.966.434 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.966.438 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.966.445 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.966.460 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.966.563 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.966.562 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LogSoftmaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.966.565 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.966.564 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.966.567 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.966.591 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.966.625 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.966.647 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.966.650 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.966.654 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftMarginLoss] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.966.666 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.966.678 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.966.705 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftmaxFocalLoss] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.966.727 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.966.730 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.966.728 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.966.748 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.966.774 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.966.776 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.966.807 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.966.807 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.966.859 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.966.883 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.966.893 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Mish] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.966.904 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.966.966 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.967.008 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.967.008 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.967.092 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RoiPoolingGradWithArgMax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.967.109 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.967.118 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.967.144 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.967.146 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.967.171 [opsproto_manager.cc:162]618662 LoadOpsProtoPluginSo:OpsProtoManager plugin load /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto.so success.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.967.177 [opsproto_manager.cc:162]618674 LoadOpsProtoPluginSo:OpsProtoManager plugin load /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto.so success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.967.211 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.967.212 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.967.222 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.967.226 [plugin_manager.cc:108]618674 GetOppPath:Enter get opp path schedule
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.967.226 [plugin_manager.cc:108]618662 GetOppPath:Enter get opp path schedule
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.967.288 [plugin_manager.cc:117]618674 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.967.287 [plugin_manager.cc:117]618662 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.967.313 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.967.330 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.967.345 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.967.385 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.967.437 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.967.461 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.967.486 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.967.559 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftmaxCrossEntropyWithLogits] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.967.566 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AvgPoolUpdate] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.967.617 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.967.673 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.967.674 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.967.700 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.967.743 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.967.785 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.967.807 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.967.861 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.967.891 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Bitcast] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.967.925 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.967.991 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.968.028 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.968.029 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StackBallQuery] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.968.068 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.968.088 [plugin_manager.cc:996]618674 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.968.088 [plugin_manager.cc:996]618662 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.968.136 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.968.150 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.968.150 [plugin_manager.cc:1011]618674 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.968.150 [plugin_manager.cc:1011]618662 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.968.155 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.968.196 [plugin_manager.cc:1015]618674 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.968.204 [plugin_manager.cc:1015]618662 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.968.248 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.968.289 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.968.300 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.968.319 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.968.300 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.968.320 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.968.347 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CTCLoss] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.968.351 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.968.383 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.968.386 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.968.402 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.968.400 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.968.397 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.968.416 [opp_so_manager.cc:56]618662 LoadOpsProtoPackage:Start load ops proto package, is_split:[1].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.968.417 [opp_so_manager.cc:56]618674 LoadOpsProtoPackage:Start load ops proto package, is_split:[1].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.968.434 [plugin_manager.cc:540]618674 GetOpsProtoPath:Enter GetOpsProtoPath schedule
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.968.434 [plugin_manager.cc:540]618662 GetOpsProtoPath:Enter GetOpsProtoPath schedule
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.968.450 [plugin_manager.cc:108]618662 GetOppPath:Enter get opp path schedule
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.968.451 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.968.449 [plugin_manager.cc:108]618674 GetOppPath:Enter get opp path schedule
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.968.477 [plugin_manager.cc:117]618662 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.968.476 [plugin_manager.cc:117]618674 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.968.497 [plugin_manager.cc:547]618674 GetOpsProtoPath:Opp plugin path structure is new version!
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.968.497 [plugin_manager.cc:547]618662 GetOpsProtoPath:Opp plugin path structure is new version!
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.968.514 [plugin_manager.cc:206]618662 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.968.515 [plugin_manager.cc:206]618674 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.968.514 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyAdadeltaD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.968.555 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.968.560 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.968.586 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyAdagradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.968.614 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyAdaMaxD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.968.631 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScoreGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.968.639 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.968.639 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyAdamD] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.968.665 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradD] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.968.690 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradV2] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.968.714 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyAddSignD] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.968.739 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyCenteredRMSPropD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.968.749 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DropOutGenMask] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.968.764 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyFtrlD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.968.772 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StatelessDropOutGenMask] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.968.789 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyFtrlV2D] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.968.815 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyGradientDescent] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.968.839 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyKerasMomentumD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.968.839 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.968.864 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyMomentumD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.968.877 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.968.888 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyPowerSignD] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.968.913 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyProximalAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.968.937 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyProximalGradientDescent] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.968.963 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyRMSPropD] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.968.966 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.968.967 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.968.981 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.968.987 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyAdagradDAD] register OP_IMPL : [InferShape]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.969.007 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.969.007 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.969.025 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.969.026 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.969.024 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.969.039 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.969.042 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.969.083 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.969.087 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.969.087 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.969.099 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.969.196 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.969.206 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.969.211 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FusedMulApplyMomentum] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.969.241 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FusedMulApplyKerasMomentum] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.969.301 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ExpandDims] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.969.364 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.969.404 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.969.441 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.969.471 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GeluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.969.495 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.969.495 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.969.505 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FillWindowCache] register OP_IMPL : [][]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.969.529 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.969.529 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.969.556 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.969.546 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.969.563 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.969.572 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.969.578 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GeluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.969.612 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.969.610 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.969.600 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.969.653 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.969.653 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.969.671 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.969.672 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.969.686 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.969.672 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [InferShape]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.969.685 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.969.682 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.969.702 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.969.701 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.969.711 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FlattenV2] register OP_IMPL : []
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.969.738 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.969.754 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.969.738 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.969.754 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.969.767 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.969.780 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.969.767 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.969.783 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.969.783 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IsNegInf] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.969.819 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GatherShapes] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.969.899 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IsPosInf] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.969.922 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GaussianBlur] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.969.929 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.969.960 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.969.986 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.970.010 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.970.017 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.970.041 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FileConstant] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.970.052 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.970.064 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StatelessIf] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.970.086 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[If] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.970.080 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.970.097 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.970.107 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[_If] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.970.109 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.970.126 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Case] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.970.136 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.970.166 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ConstPlaceHolder] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.970.173 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.970.174 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.970.209 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.970.209 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.970.212 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.970.227 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.970.226 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.970.243 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.970.242 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.970.267 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.970.279 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.970.279 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.970.318 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.970.365 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.970.428 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.970.437 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Identity] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.970.461 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MemcpyAsync] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.970.479 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IdentityN] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.970.534 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.970.573 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.970.657 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReluV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.970.681 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.970.676 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.970.676 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.970.709 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.970.726 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.970.709 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.970.737 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.970.739 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.970.752 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.970.768 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.970.786 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.970.775 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.970.788 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.970.823 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.970.827 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.970.843 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.970.840 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.970.857 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.970.872 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.970.857 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.970.874 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.970.890 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.970.884 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.970.902 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.970.905 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.970.922 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.970.920 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.970.918 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.970.934 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.970.950 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.970.937 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.970.952 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.970.991 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.970.995 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Cummax] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.971.021 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.971.091 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.971.112 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.971.123 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.971.138 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.971.236 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.971.288 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.971.311 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.971.341 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.971.341 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.971.359 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.971.358 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.971.376 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.971.376 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.971.389 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [][]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.971.393 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.971.393 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.971.410 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.971.410 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.971.447 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.971.447 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.971.467 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Col2ImV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.971.490 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.971.579 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.971.587 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.971.605 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.971.687 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.971.709 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.971.698 [host_cpu_engine.cc:273]618650 LoadLib:Lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libconstant_folding_ops.so has been opened
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.971.775 [host_cpu_engine.cc:254]618650 LoadLib:To invoke dlopen on lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libops_host_cpu.so
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.971.790 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.971.795 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.971.818 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.971.846 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.971.847 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.971.879 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.971.898 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [][]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.971.879 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.971.907 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.971.896 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.971.913 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_ab[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.971.923 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
i_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.971.937 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.971.957 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.971.958 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.971.995 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.971.995 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.971.997 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.972.008 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [][]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.972.013 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.972.012 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.972.029 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.972.031 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.972.046 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.972.043 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.972.057 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : [InferShape]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.972.075 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.972.076 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.972.092 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.972.093 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.972.106 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.972.109 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RandomChoiceWithMask] register OP_IMPL : []
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.972.108 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.972.122 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.972.122 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.972.202 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.972.222 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RandomUniform] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.972.233 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.972.298 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Rank] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.972.321 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Size] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.972.321 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2d] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.972.419 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.972.439 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.972.525 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Reshape] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.972.531 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.972.541 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.972.531 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.972.567 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.972.570 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.972.588 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.972.585 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.972.602 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.972.602 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.972.636 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RgbToGrayscale] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.972.639 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.972.639 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.972.660 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.972.669 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.972.738 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.972.768 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.972.809 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.972.842 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.972.876 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.972.942 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.972.990 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaskedSelect] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.972.998 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.973.033 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.973.046 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Rotate] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.973.033 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.973.064 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.973.082 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.973.081 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.973.098 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.973.097 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : [InferShape]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.973.096 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.973.117 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.973.123 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Shape] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.973.124 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.973.145 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ShapeN] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.973.147 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.973.151 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.973.185 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.973.187 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.973.203 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.973.201 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.973.217 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.973.234 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.973.217 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.973.236 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.973.228 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.973.252 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SilentCheckV2] register OP_IMPL : [][]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.973.265 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.973.266 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.973.282 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.973.282 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.973.294 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.973.296 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.973.308 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.973.311 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.973.353 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SilentCheckV3] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.973.351 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.973.456 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.973.459 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.973.568 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.973.581 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.973.669 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyAdadelta] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.973.691 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyAdadeltaD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.973.689 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.973.700 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.973.700 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.973.710 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyAdagradD] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.973.729 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyAdagrad] register OP_IMPL : []
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.973.734 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.973.734 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.973.751 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.973.747 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagrad] register OP_IMPL : []
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.973.752 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.973.768 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagradD] register OP_IMPL : []
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.973.767 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.973.766 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.973.789 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.973.807 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2D] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.973.803 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.973.809 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.973.812 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.973.828 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.973.845 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.973.863 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.973.879 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2D] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.973.895 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyRMSProp] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.973.916 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyRMSPropD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.973.921 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.974.020 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseFillEmptyRows] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.974.028 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.974.122 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.974.135 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.974.207 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.974.221 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Squeeze] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.974.207 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.974.246 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SqueezeV2] register OP_IMPL : []
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.974.241 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.974.245 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RNNTLoss] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.974.257 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.974.255 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.974.268 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SqueezeV3] register OP_IMPL : [][]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.974.274 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.974.273 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.974.289 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.974.322 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.974.325 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.974.358 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.974.359 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MultinomialWithReplacement] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.974.366 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [][]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.974.359 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.974.375 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.974.375 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.974.393 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.974.391 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.974.404 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.974.408 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.974.435 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.974.450 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.974.440 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.974.455 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.974.464 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.974.480 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.974.472 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StatelessRandomNormalV2] register OP_IMPL : [][]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.974.470 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.974.487 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.974.464 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.974.494 [plugin_manager.cc:218]618662 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.974.501 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.974.500 [plugin_manager.cc:218]618674 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.974.522 [plugin_manager.cc:422]618674 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.974.535 [plugin_manager.cc:155]618674 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.974.517 [plugin_manager.cc:422]618662 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.974.542 [plugin_manager.cc:155]618662 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.974.561 [plugin_manager.cc:158]618662 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.974.576 [plugin_manager.cc:426]618662 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.974.558 [plugin_manager.cc:158]618674 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.974.579 [plugin_manager.cc:426]618674 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.974.577 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.974.620 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StatelessBernoulli] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.974.685 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.974.732 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.974.783 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TopK] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.974.813 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.974.832 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.974.841 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.974.850 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.974.873 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.974.946 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.974.969 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TopKPQDistanceV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.974.968 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.974.968 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.975.005 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.975.005 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.975.021 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.975.022 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.975.037 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.975.034 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.975.060 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UniqueConsecutive] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.975.076 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.975.072 [plugin_manager.cc:439]618674 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspo
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.975.072 [plugin_manager.cc:439]618662 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspo
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.975.179 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TransArgb] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.975.180 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UniqueWithCountsAndSorting] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.975.286 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Unsqueeze] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.975.307 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UnsqueezeV2] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.975.327 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UnsqueezeV3] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.975.351 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[WarpAffine] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.975.423 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.975.444 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.975.453 [plugin_manager.cc:996]618674 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.975.453 [plugin_manager.cc:996]618662 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.975.472 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Histogram] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.975.484 [plugin_manager.cc:1011]618674 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.975.484 [plugin_manager.cc:1011]618662 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.975.507 [plugin_manager.cc:1015]618674 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.975.507 [plugin_manager.cc:1015]618662 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.975.545 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Where] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.975.580 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.975.623 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.975.623 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.975.641 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.975.645 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[WtsARQ] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.975.642 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.975.655 [opp_so_manager.cc:45]618662 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.975.655 [opp_so_manager.cc:45]618674 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.975.690 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.975.750 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.975.801 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.975.816 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Unique] register OP_IMPL : [InferShapeRange]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.975.858 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.975.934 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UniqueWithCounts] register OP_IMPL : [InferShapeRange]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.975.963 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.975.985 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.976.046 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Dot] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.084 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.106 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.976.191 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.218 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdjustContrast] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.243 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdjustHue] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.261 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdjustSaturation] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.280 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CropAndResize] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.298 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CropAndResizeV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.976.300 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.316 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DecodeAndCropJpeg] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.345 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DecodeJpeg] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.362 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NormalizeV2] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.382 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdjustContrastWithMean] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.399 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdjustBrightness] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.415 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdjustBrightnessV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.976.411 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.435 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdjustSaturationV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.976.435 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.453 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[WarpAffineV2] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.471 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ImgCrop] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.488 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[WarpPerspective] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.976.554 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardReduce] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.583 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.605 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.627 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.976.662 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStatsWithCounts] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.727 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HcomAllReduce] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.748 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HcomAllGather] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.766 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HcomBroadcast] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.976.769 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.784 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HcomReduceScatter] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.976.795 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.803 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HcomSend] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.823 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HcomReduce] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.976.817 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.842 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HcomReceive] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.976.849 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.860 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HcomAllToAllV] register OP_IMPL : [][][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.878 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HcomAllToAllVC] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.976.875 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.976.903 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HcomGatherAllToAllV] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.976.898 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.976.919 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.976.939 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.976.959 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.977.027 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.977.060 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.977.086 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.977.100 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.977.107 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.977.211 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.977.231 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.977.315 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.977.323 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.977.385 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.977.434 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.977.458 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.977.539 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.977.644 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.977.670 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.977.691 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.977.690 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.977.790 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.977.797 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.977.853 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.977.866 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.977.904 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.977.928 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.977.943 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.977.984 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.978.023 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.978.044 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.978.104 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.978.108 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.978.148 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.978.173 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.978.161 [host_cpu_engine.cc:267]618650 LoadLib:Invoke function Initialize in lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libops_host_cpu.so
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.978.246 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.978.232 [op_impl_registry_holder_manager.cc:208]618674 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.978.232 [op_impl_registry_holder_manager.cc:208]618662 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.978.257 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.978.280 [op_impl_registry_holder_manager.cc:216]618674 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.978.300 [op_impl_registry_holder_manager.cc:208]618674 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.978.275 [op_impl_registry_holder_manager.cc:216]618662 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.978.308 [op_impl_registry_holder_manager.cc:208]618662 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.978.349 [op_impl_registry_holder_manager.cc:208]618674 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.978.349 [op_impl_registry_holder_manager.cc:208]618662 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.978.363 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.978.380 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.978.405 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.978.419 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CircularPad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.978.427 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.978.451 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.978.467 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.978.557 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.978.571 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.978.584 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.978.593 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CircularPadGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.978.607 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.978.646 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.978.719 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.978.718 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.978.742 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.978.764 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.978.796 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.978.788 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.978.815 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.978.840 [op_impl_space_registry.cc:273]618662 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so] success!
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.978.840 [op_impl_space_registry.cc:273]618674 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so] success!
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.978.870 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.978.895 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.978.917 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.978.938 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.978.960 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.978.960 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.978.981 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] OP(618650,python3.9):2025-04-03-09:27:41.978.953 [host_cpu_kernel_wrapper.cpp:88][OP_PROTO][Initialize][618650] OpName:[HostCpuKernelWrapperOp] "Host cpu dlopen so[/usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libaicpu_const_folding.so] success"
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.978.982 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.978.987 [folding.cc:404][InitCpuConstantFoldingNew][tid:618650]:"Init cpu constant folding begin."
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.978.996 [opp_so_manager.cc:45]618674 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.978.996 [opp_so_manager.cc:45]618662 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.025 [folding.cc:408][InitCpuConstantFoldingNew][tid:618650]:"Number of registered ops: 234"
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.043 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Acos]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.979.039 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.064 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Acosh]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.979.087 [op_impl_registry_holder_manager.cc:208]618666 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 894
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.082 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[ActiveRotatedFilter]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.100 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[ActiveRotatedFilterGrad]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.116 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[AdaptiveAvgPool2dAssistMatrix]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.130 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[AdaptiveAvgPoolAssistMatrix]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.146 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[AdaptiveMaxPool2d]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.979.148 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.979.142 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.162 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Add]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.979.179 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.180 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Addcdiv]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.979.208 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.214 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Addcmul]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.234 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[AffineGrid]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.252 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[ApplyAdamV2]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.979.236 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.979.256 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.979.264 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.267 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Asin]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.979.280 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.285 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Asinh]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.979.302 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.300 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Assert]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.314 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Atan]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.326 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Atan2]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.341 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Atanh]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.355 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[AvgPoolV2]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.372 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Betainc]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.385 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Bucketize]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.402 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[CTCLossV2]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.979.407 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.415 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[CTCLossV2Grad]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.431 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[CacheSwapTable]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.979.432 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.448 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[CalcBucketsLimitAndOffset]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.464 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[CaseCondition]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.979.474 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleLinear1d] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.482 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Cast]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.502 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Ceil]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.979.505 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleBilinear2d] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.517 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[CheckNumerics]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.534 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[ClipByValue]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.552 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[ClipByValueV2]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.979.550 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.572 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Combinations]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.590 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[CompareAndBitpack]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.608 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[ComputeAccidentalHits]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.622 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[ConcatV2]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.638 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Conj]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.653 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[ConjugateTranspose]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.678 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Coordinates1DTo2D]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.979.669 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.979.685 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleBicubic2d] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.693 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Cosh]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.711 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[CropAndResize]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.726 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Cross]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.742 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Cummax]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.757 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Cummin]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.773 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Cumsum]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.979.773 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.786 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Div]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.803 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[DynamicStitch]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.979.799 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.818 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[EditDistance]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.979.821 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.835 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Elu]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.854 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[EluGrad]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.979.867 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAA] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.872 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[EmbeddingApplyAdaGrad]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.891 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[EmbeddingApplyAdam]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.906 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[EmbeddingApplyAdamW]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.923 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[EmbeddingApplyFtrl]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.979.924 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.936 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[EmbeddingApplyRmsprop]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.979.950 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.952 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[EmbeddingApplySgd]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.971 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[EmbeddingComputeVarExport]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.979.986 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[EmbeddingComputeVarImport]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.979.972 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.000 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[EmbeddingFeatureMappingExport]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.016 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[EmbeddingFeatureMappingFileSize]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.030 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[EmbeddingFeatureMappingImport]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.047 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[EmbeddingHashmapExport]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.980.043 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAAGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.063 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[EmbeddingHashmapFileSize]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.079 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[EmbeddingHashmapImport]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.980.085 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.097 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[EmbeddingLookup]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.115 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[EmbeddingTableEvict]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.139 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[EmbeddingTableExport]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.153 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[EmbeddingTableFind]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.186 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[EmbeddingTableFindAndInit]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.205 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[EmbeddingTableImport]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.219 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Equal]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.235 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Expand]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.980.235 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.250 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[ExpandDims]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.980.239 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.267 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Exponential]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.282 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[ExponentialDecayLR]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.299 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Fill]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.312 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[FillDiagonal]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.325 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Fills]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.340 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Floor]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.356 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[FloorDiv]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.980.349 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.371 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[FloorMod]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.388 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[GEMM]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.401 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[GatherElements]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.417 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[GatherV2]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.430 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Geometric]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.446 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[GetDynamicDims]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.980.458 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.459 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Greater]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.980.454 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.478 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[GreaterEqual]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.492 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[GridSampler2D]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.980.493 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.505 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[GridSampler2DGrad]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.522 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[GridSampler3D]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.537 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[GridSampler3DGrad]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.554 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Histogram]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.980.569 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.567 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[IMGWarpOffsets]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.584 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Identity]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.606 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[IndexToAddr]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.622 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[InitEmbeddingHashmap]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.636 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[InitPartitionMap]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.653 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[InplaceIndexAdd]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.667 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[InplaceTopKDistance]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.980.667 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.980.674 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.680 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[InvGrad]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.697 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[InvertPermutation]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.712 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[IsClose]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.728 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[IsInf]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.741 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[IsNan]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.757 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Less]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.771 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[LinSpace]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.980.782 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.787 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[LinearSumAssignment]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.806 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Log]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.821 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Log1p]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.837 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[LogMatrixDeterminant]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.980.845 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAABackward] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.851 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[LogSoftmaxV2]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.869 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[LogUniformCandidateSampler]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.885 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[MaskedFill]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.901 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[MaskedScatter]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.980.903 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.916 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[MaskedSelect]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.932 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[MaskedSelectGrad]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.951 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[MatMul]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.969 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[MatrixDiagPartV3]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.980.988 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[MatrixDiagV3]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.002 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[MinAreaPolygons]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.981.015 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2dAssistMatrix] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.015 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Mul]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.032 [folding.cc:413[INFO] GE(618654,python3.9):2025-04-03-09:27:41.981.024 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dGrad] register OP_IMPL : [Tiling][TilingParse]
][InitCpuConstantFoldingNew][tid:618650]:"Register op[MultinomialAliasDraw]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.058 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[MultinomialAliasSetup]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.077 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[MultinomialWithReplacement]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.096 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[NLLLoss]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.111 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[NLLLossGrad]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.127 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[NMSWithMask]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.981.127 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : [InferShape]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.141 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Neg]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.158 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[NonMaxSuppressionV3]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.177 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[NonZero]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.190 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[NonZeroWithValueShape]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.207 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[NonZeroWithValueShapeV2]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.981.218 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ResizeUpsampleTrilinear] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.226 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[NotEqual]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.245 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[OnesLike]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.981.251 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.265 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[PSAMask]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.285 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[PSAMaskGrad]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.304 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Pad]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.323 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[PadD]."
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.981.324 [op_impl_registry_holder_manager.cc:208]618662 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.981.325 [op_impl_registry_holder_manager.cc:208]618674 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.342 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[PadV3]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.981.357 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : [InferShape]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.981.361 [op_impl_registry_holder_manager.cc:216]618674 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.981.381 [op_impl_registry_holder_manager.cc:208]618674 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.981.361 [op_impl_registry_holder_manager.cc:216]618662 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.981.384 [op_impl_registry_holder_manager.cc:208]618662 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.361 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[PadV3Grad]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.379 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Pinverse]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.392 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Poisson]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.407 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Pow]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.981.394 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dBackward] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.421 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[ProdEnvMatACalcRij]."
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.981.421 [op_impl_registry_holder_manager.cc:208]618674 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.981.421 [op_impl_registry_holder_manager.cc:208]618662 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.438 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[RNNTLoss]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.457 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[RandomStandardNormal]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.981.471 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : [InferShape]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.475 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[RandomUniform]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.494 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[RealDiv]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.511 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[ReduceAll]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.525 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[ReduceMean]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.541 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[ReduceSum]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.563 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Reshape]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.576 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Resize]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.590 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[ResizeBilinear]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.981.563 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.981.585 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Cdist] register OP_IMPL : [InferShape]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.605 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[ResizeBilinearGrad]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.981.616 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3d] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.622 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[ResizeBilinearV2Grad]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.642 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[ResizeGrad]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.657 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[ResizeTrilinear]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.673 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[ReverseSequence]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.687 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[RightShift]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.703 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[RoiPoolingWithArgMax]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.981.695 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CdistGrad] register OP_IMPL : [InferShape]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.718 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[RotatedNMS]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.734 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Round]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.747 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Rsqrt]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.764 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[STFT]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.981.770 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleNearest] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.777 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[ScatterAddWithAxis]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.794 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[ScatterElements]."
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.981.795 [op_impl_space_registry.cc:80]618674 MergeFunctions:op type DecoderKvCache infer_shape func has been registered
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.981.795 [op_impl_space_registry.cc:80]618662 MergeFunctions:op type DecoderKvCache infer_shape func has been registered
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.981.817 [op_impl_space_registry.cc:83]618662 MergeFunctions:op type DecoderKvCache infer_datatype func has been registered
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.809 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[ScatterNdAdd]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.826 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[ScatterNdMax]."
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.981.817 [op_impl_space_registry.cc:83]618674 MergeFunctions:op type DecoderKvCache infer_datatype func has been registered
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.981.804 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : [InferShape]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.981.842 [op_impl_space_registry.cc:80]618674 MergeFunctions:op type PromptKvCache infer_shape func has been registered
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.981.843 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : [InferShape]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.841 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[ScatterNdMin]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.859 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[SearchSorted]."
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.981.842 [op_impl_space_registry.cc:80]618662 MergeFunctions:op type PromptKvCache infer_shape func has been registered
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.981.860 [op_impl_space_registry.cc:83]618662 MergeFunctions:op type PromptKvCache infer_datatype func has been registered
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.981.857 [op_impl_space_registry.cc:83]618674 MergeFunctions:op type PromptKvCache infer_datatype func has been registered
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.981.877 [op_impl_space_registry.cc:273]618662 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so] success!
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.981.866 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.981.874 [op_impl_space_registry.cc:273]618674 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so] success!
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.875 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[SelectV2]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.892 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Sigmoid]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.908 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[SigmoidGrad]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.924 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Sign]."
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.981.924 [opp_so_manager.cc:97]618674 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.981.924 [opp_so_manager.cc:97]618662 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.937 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[SilentCheck]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.954 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[SilentCheckV2]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.972 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[SilentCheckV3]."
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.981.965 [opp_so_manager.cc:97]618674 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.981.965 [opp_so_manager.cc:97]618662 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.981.968 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.981.977 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleNearestExact2dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.981.994 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : [InferShape]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.981.987 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[SliceWrite]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.013 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[SoftmaxV2]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.982.009 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleNearest2dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.982.014 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : [InferShape]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.030 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Sort]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.048 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[SparseFillEmptyRows]."
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.982.060 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.069 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[SparseSegmentMean]."
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.982.078 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.982.060 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.982.092 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.088 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[SparseSegmentMeanGrad]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.106 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[SparseSegmentSum]."
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.982.107 [opp_so_manager.cc:45]618662 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.982.095 [opp_so_manager.cc:45]618674 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.982.123 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.126 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[SparseToDense]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.144 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[SpatialTransformer]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.982.127 [op_tiling_registry.cc:134]618654 OpTilingFuncRegistry:Register op tiling function V2 for op_type:AvgPoolGrad
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.159 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[SplitD]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.176 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[SplitV]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.982.163 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.191 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Sqrt]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.205 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[SqrtGrad]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.221 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Square]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.234 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[SquaredDifference]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.982.242 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.250 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[StatelessBernoulli]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.269 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[StatelessRandomUniformV2]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.283 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[StatelessRandperm]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.300 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[StridedSlice]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.982.292 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.315 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[StridedSliceV2]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.332 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Sub]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.982.323 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.348 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[TableToResource]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.365 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Tan]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.982.354 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.380 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[TanhGrad]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.397 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[TensorEqual]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.410 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[TensorScatterUpdate]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.426 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[ThreeNN]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.440 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Tile]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.456 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[TileWithAxis]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.982.461 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.982.465 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GlobalLpPool] register OP_IMPL : [InferShape]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.468 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[TopK]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.492 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[TopKPQDistance]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.982.491 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.508 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[TopKPQDistanceV2]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.521 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[TopKV2D]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.536 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Trace]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.550 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[TransData]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.566 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[TransDataRNN]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.580 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Tril]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.596 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Triu]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.982.581 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GLU] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.611 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[UniformCandidateSampler]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.628 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[UninitEmbeddingHashmap]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.982.626 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.644 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[UninitPartitionMap]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.662 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[UniqueConsecutive]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.677 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[UniqueWithCountsAndSorting]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.982.689 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GLUGrad] register OP_IMPL : [InferShape]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.694 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[UniqueWithCountsExt2]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.712 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[UpsampleNearest3d]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.727 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[UpsampleNearest3dGrad]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.744 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[UpsampleTrilinear3d]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.757 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[UpsampleTrilinear3dGrad]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.982.755 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.773 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[ViewCopy]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.791 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Voxelization]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.809 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[WarpAffine]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.982.810 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : [InferShape]
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.823 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[ZerosLike]."
[INFO] AICPU(618650,python3.9):2025-04-03-09:27:41.982.839 [folding.cc:413][InitCpuConstantFoldingNew][tid:618650]:"Register op[Zeta]."
[INFO] OP(618650,python3.9):2025-04-03-09:27:41.982.862 [host_cpu_kernel_wrapper.cpp:118][OP_PROTO][Initialize][618650] OpName:[HostCpuKernelWrapperOp] "Host cpu init success"
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.982.879 [host_cpu_engine.cc:273]618650 LoadLib:Lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libops_host_cpu.so has been opened
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.982.877 [op_impl_space_registry.cc:240]618662 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.982.902 [opp_so_manager.cc:48]618662 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.982.874 [op_impl_space_registry.cc:240]618674 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.982.913 [opp_so_manager.cc:48]618674 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.982.897 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.982.919 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.983.001 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.982.996 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.983.016 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.983.018 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.983.029 [opp_so_manager.cc:45]618662 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.983.030 [opp_so_manager.cc:45]618674 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.983.025 [plugin_manager.cc:872]618650 LoadWithFlags:Dlopen path: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/plugin/engines/runtime/libdvpp_rtkernel.so. flags is 4354
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.983.033 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LpLoss] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.983.034 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.983.151 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LpNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.983.154 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.983.177 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.983.200 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.983.223 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.983.274 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.983.474 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MinAreaPolygons] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.983.485 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.983.595 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.983.678 [op_impl_space_registry.cc:240]618662 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.983.678 [op_impl_space_registry.cc:240]618674 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.983.702 [opp_so_manager.cc:48]618674 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.983.701 [opp_so_manager.cc:48]618662 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.983.706 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.983.709 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.983.743 [opp_so_manager.cc:97]618674 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.983.743 [opp_so_manager.cc:97]618662 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.983.779 [opp_so_manager.cc:97]618674 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.983.779 [opp_so_manager.cc:97]618662 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.983.815 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.983.865 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.983.865 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.983.883 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.983.882 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.983.895 [opp_so_manager.cc:45]618674 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.983.895 [opp_so_manager.cc:45]618662 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.983.925 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.984.033 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.984.102 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.984.204 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.984.312 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.984.422 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.984.526 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.984.543 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.984.546 [op_impl_space_registry.cc:240]618674 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.984.572 [opp_so_manager.cc:48]618674 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.984.551 [op_impl_space_registry.cc:240]618662 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.984.574 [opp_so_manager.cc:48]618662 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.984.637 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.984.667 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.984.685 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.984.679 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.984.697 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.984.697 [opp_so_manager.cc:45]618674 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.984.712 [opp_so_manager.cc:45]618662 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.984.752 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.984.763 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.984.863 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.984.970 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.985.075 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.985.112 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.985.191 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.985.296 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.985.330 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.985.335 [op_impl_space_registry.cc:240]618662 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.985.342 [op_impl_space_registry.cc:240]618674 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.985.363 [opp_so_manager.cc:48]618674 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.985.357 [opp_so_manager.cc:48]618662 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.985.398 [opp_so_manager.cc:97]618662 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.985.400 [opp_so_manager.cc:97]618674 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.985.414 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : [InferShape]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.985.433 [opp_so_manager.cc:97]618674 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.985.432 [opp_so_manager.cc:97]618662 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.985.442 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DefaultImpl] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.985.519 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.985.518 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.985.536 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.985.524 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.985.526 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReflectionPad3dGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.985.537 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.985.549 [opp_so_manager.cc:45]618674 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.985.550 [opp_so_manager.cc:45]618662 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.985.634 [op_tiling_registry.cc:134]618654 OpTilingFuncRegistry:Register op tiling function V2 for op_type:AvgPool
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.985.643 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.985.670 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.985.748 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.985.785 [op_tiling_registry.cc:134]618654 OpTilingFuncRegistry:Register op tiling function V2 for op_type:AvgPoolV2
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.985.821 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.985.858 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.985.972 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.985.979 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.986.013 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.986.044 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.986.071 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantConv2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.986.074 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.986.155 [op_impl_space_registry.cc:240]618674 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.986.154 [op_impl_space_registry.cc:240]618662 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.986.176 [opp_so_manager.cc:48]618662 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.986.176 [opp_so_manager.cc:48]618674 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.986.183 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.986.266 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.986.266 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.986.284 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.986.284 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.986.296 [opp_so_manager.cc:45]618674 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.986.292 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.986.298 [opp_so_manager.cc:45]618662 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.986.318 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.986.313 [op_tiling_registry.cc:162]618646 OpTilingFuncRegistry:Register op tiling and parse function V4 for op_type:Aipp
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.986.436 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotatedNMS] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.986.469 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:AvgPool1DD
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.986.455 [plugin_manager.cc:883]618650 LoadWithFlags:The shared library will not be checked. Please ensure that the source of the shared library is trusted.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.986.553 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.986.550 [ops_kernel_executor_manager.cc:37]618650 Initialize:No library to load
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.986.574 [plugin_manager.cc:540]618650 GetOpsProtoPath:Enter GetOpsProtoPath schedule
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.986.590 [plugin_manager.cc:108]618650 GetOppPath:Enter get opp path schedule
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.986.597 [op_tiling_registry.cc:162]618646 OpTilingFuncRegistry:Register op tiling and parse function V4 for op_type:AutoTiling
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.986.624 [plugin_manager.cc:117]618650 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.986.649 [plugin_manager.cc:547]618650 GetOpsProtoPath:Opp plugin path structure is new version!
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.986.671 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.986.681 [plugin_manager.cc:206]618650 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.986.734 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Bias
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.986.865 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:INTrainingUpdateV2
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.986.896 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SilentCheck] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.986.899 [op_impl_space_registry.cc:240]618674 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.986.904 [op_impl_space_registry.cc:240]618662 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.986.923 [opp_so_manager.cc:48]618674 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.986.925 [opp_so_manager.cc:48]618662 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.986.971 [opp_so_manager.cc:97]618674 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.986.976 [opp_so_manager.cc:97]618662 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.987.006 [op_tiling_registry.cc:134]618646 OpTilingFuncRegistry:Register op tiling function V2 for op_type:CheckValid
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.987.009 [opp_so_manager.cc:97]618662 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.987.005 [opp_so_manager.cc:97]618674 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.987.020 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.987.095 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.987.113 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.987.095 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.987.114 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.987.125 [opp_so_manager.cc:45]618662 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.987.126 [opp_so_manager.cc:45]618674 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.987.139 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.987.149 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ConcatD
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.987.167 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ConcatV2D
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.987.185 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Pack
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.987.175 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.987.222 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.987.241 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.987.241 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3d] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.987.255 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.987.257 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3d] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.987.311 [op_tiling_registry.cc:134]618646 OpTilingFuncRegistry:Register op tiling function V2 for op_type:ConcatOffset
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.987.320 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.987.370 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.987.428 [op_tiling_registry.cc:134]618646 OpTilingFuncRegistry:Register op tiling function V2 for op_type:Diag
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.987.478 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.987.546 [op_tiling_registry.cc:134]618646 OpTilingFuncRegistry:Register op tiling function V2 for op_type:DiagPart
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.987.588 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ActiveRotatedFilter] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.987.670 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:DynSeqOuter
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.987.662 [op_impl_registry_holder_manager.cc:208]618666 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 894
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.987.681 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.987.701 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ActiveRotatedFilterGrad] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.987.719 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.987.711 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.987.739 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.987.758 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.987.742 [op_impl_space_registry.cc:240]618674 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.987.741 [op_impl_space_registry.cc:240]618662 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.987.765 [opp_so_manager.cc:48]618674 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.987.766 [opp_so_manager.cc:48]618662 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.987.793 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Expand
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.987.796 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.987.819 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.987.849 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.987.880 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.987.870 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.987.889 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.987.870 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.987.889 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.987.903 [opp_so_manager.cc:45]618674 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.987.886 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.987.896 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.987.916 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.987.904 [opp_so_manager.cc:45]618662 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.987.929 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.987.955 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.987.972 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.987.984 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.988.001 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.988.038 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.988.043 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.988.146 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.988.208 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.988.241 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Ger
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.988.248 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.988.296 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.988.354 [op_tiling_registry.cc:122]618646 OpTilingFuncRegistry:Register op tiling function V1 for op_type:IFMR
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.988.359 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.988.398 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.988.398 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.988.407 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.988.419 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.988.438 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.988.477 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.988.488 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:InTopKD
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.988.502 [op_impl_space_registry.cc:240]618674 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.988.526 [opp_so_manager.cc:48]618674 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.988.503 [op_impl_space_registry.cc:240]618662 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.988.526 [opp_so_manager.cc:48]618662 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.988.529 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.988.553 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.988.578 [opp_so_manager.cc:97]618674 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.988.578 [opp_so_manager.cc:97]618662 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.988.613 [opp_so_manager.cc:97]618674 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.988.614 [opp_so_manager.cc:97]618662 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.988.618 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:KlDivLossGrad
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.988.644 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PSAMask] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:41.988.654 [opp_so_manager.cc:97]618674 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/usr/local/Ascend/ascend-toolkit/latest/opp/op_proto/custom/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:41.988.654 [opp_so_manager.cc:97]618662 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/usr/local/Ascend/ascend-toolkit/latest/opp/op_proto/custom/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.988.708 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.988.731 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 0 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.988.736 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:L1LossGrad
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.988.739 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.988.731 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 0 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.988.752 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PSAMaskGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.988.779 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.988.795 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.988.791 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.988.807 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:41.988.808 [opp_so_manager.cc:45]618674 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618662,python3.9):2025-04-03-09:27:41.988.822 [opp_so_manager.cc:45]618662 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.988.823 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.988.840 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNorm
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.988.863 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.988.860 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.988.879 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.988.894 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.988.909 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.988.928 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.988.951 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNormBetaGammaBackpropV2
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.988.971 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.988.975 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.989.006 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.989.022 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.989.039 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.989.070 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.989.087 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.989.074 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.989.085 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.989.103 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.989.120 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.989.141 [op_tiling_registry.cc:122]618646 OpTilingFuncRegistry:Register op tiling function V1 for op_type:LayerNormXBackprop
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.989.230 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.989.251 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNormXBackpropV2
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.989.324 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.989.361 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LayerNormXBackpropV3
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.989.418 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.989.463 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LpNormReduce
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.989.458 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.989.481 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:LpNormReduceV2
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.989.493 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.989.512 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.989.526 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.989.556 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.989.564 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.989.572 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AGLU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.989.587 [op_tiling_registry.cc:134]618646 OpTilingFuncRegistry:Register op tiling function V2 for op_type:LRUCacheV2
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.989.698 [op_tiling_registry.cc:134]618646 OpTilingFuncRegistry:Register op tiling function V2 for op_type:MaxPoolGradWithArgmaxV2
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.989.716 [op_tiling_registry.cc:134]618646 OpTilingFuncRegistry:Register op tiling function V2 for op_type:MaxPoolGradWithArgmaxV1
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.989.773 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ThreeNN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.989.820 [op_tiling_registry.cc:122]618646 OpTilingFuncRegistry:Register op tiling function V1 for op_type:MaxPoolWithArgmaxV2
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.989.903 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Voxelization] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.989.903 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.989.921 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:MovingSumWithSigmoid
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.989.939 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.989.957 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.989.971 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.990.010 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.990.023 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:MseLossGrad
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.990.008 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.990.058 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.990.059 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.990.079 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.990.094 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.990.107 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.990.093 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.990.129 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.990.139 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.990.155 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.990.165 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.990.170 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.990.187 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.990.196 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [InferShape][InferDataType][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.990.229 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:NMSWithMask
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.990.227 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.990.257 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [InferShape][InferDataType][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.990.284 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.990.311 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.990.334 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.990.355 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.990.374 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.990.379 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.990.395 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.990.402 [op_tiling_registry.cc:122]618646 OpTilingFuncRegistry:Register op tiling function V1 for op_type:PadD
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.990.427 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CompressFcOp] register OP_IMPL : [InferShape][InferDataType][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.990.454 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.990.503 [op_tiling_registry.cc:122]618646 OpTilingFuncRegistry:Register op tiling function V1 for op_type:PadV3Grad
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.990.523 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.990.557 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.990.565 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.990.574 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.990.593 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.990.611 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ReduceStdWithMean
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.990.624 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.990.632 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.990.686 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.990.720 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Resize
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.990.810 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.990.824 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.990.916 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.990.970 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.991.003 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.991.020 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.991.026 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.991.034 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.991.070 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.991.122 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.991.140 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.991.153 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.991.170 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.991.152 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMatMulV4] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.991.168 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ResizeBilinearV2
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.991.206 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.991.223 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.991.235 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.991.250 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.991.266 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.991.280 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:ReverseV2
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.991.361 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.991.395 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Scale
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.991.393 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.991.500 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.991.587 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SigmoidFocalLoss
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.991.587 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.991.607 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.991.623 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.991.640 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.991.655 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.991.699 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SigmoidFocalLossGrad
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.991.698 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.991.716 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.991.827 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SignBitsPack
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.991.840 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ResizeTrilinear] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.991.931 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SignBitsUnpack
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.991.916 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.991.953 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.992.035 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SmoothL1LossGradV2
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.992.040 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.992.060 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:41.992.059 [op_impl_registry_holder_manager.cc:208]618666 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.992.073 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.992.092 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.992.087 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.992.108 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.992.112 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.992.133 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SmoothL1LossV2
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.992.134 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.992.145 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.992.203 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.992.212 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.992.233 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.992.247 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SoftMarginLossGrad
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.992.247 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.992.267 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.992.299 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.992.315 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.992.328 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.992.345 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.992.357 [plugin_manager.cc:218]618650 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.992.365 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.992.375 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SoftmaxFocalLossGrad
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.992.380 [plugin_manager.cc:422]618650 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.992.395 [plugin_manager.cc:155]618650 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.992.401 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.992.389 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.992.423 [plugin_manager.cc:158]618650 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.992.442 [plugin_manager.cc:426]618650 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.992.434 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.992.468 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.992.475 [op_tiling_registry.cc:134]618646 OpTilingFuncRegistry:Register op tiling function V2 for op_type:Sort
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.992.492 [op_tiling_registry.cc:134]618646 OpTilingFuncRegistry:Register op tiling function V2 for op_type:SortV2
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.992.499 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.992.544 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.992.577 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.992.593 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SparseApplyFtrlD
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.992.607 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.992.640 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.992.674 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.992.703 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.992.704 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SparseReshape
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.992.731 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.992.755 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.992.773 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.992.791 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.992.816 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SplitV
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.992.819 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.992.831 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Split
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.992.828 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.992.837 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.992.856 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.992.858 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.992.888 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.992.895 [plugin_manager.cc:439]618650 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspo
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.992.914 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.992.917 [ge_executor.cc:259]618650 InitOpsProtoManager:Get opsproto path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/minds
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.992.937 [op_tiling_registry.cc:122]618646 OpTilingFuncRegistry:Register op tiling function V1 for op_type:SquareSumAll
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.992.973 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NLLLossGrad310p] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.992.995 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.993.044 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SyncBatchNormGatherStats
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.993.118 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ActULQClampMaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.993.146 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Tile
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.993.148 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ActULQClampMinGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.993.143 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.993.249 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:TileD
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.993.268 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ActsULQ] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.993.276 [plugin_manager.cc:996]618650 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.993.310 [plugin_manager.cc:1011]618650 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.993.311 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.993.332 [plugin_manager.cc:1015]618650 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.993.364 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:TileWithAxis
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.993.379 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ActsULQInputGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.993.436 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.993.456 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.993.442 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DropoutWithMulsAndSoftmaxGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.993.491 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.993.537 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.993.554 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.993.570 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:Unpack
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.993.586 [opsproto_manager.cc:123]618650 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.993.599 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.993.622 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.993.647 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.993.665 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.993.672 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [OpExecuteFunc]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.993.695 [opsproto_manager.cc:123]618650 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.993.719 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdaptiveAvgPoolAssistMatrix] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.993.745 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.993.763 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 2 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.993.766 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.993.780 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.993.814 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.993.828 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.993.846 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.993.844 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.993.842 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.993.871 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.993.913 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.993.930 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.993.922 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AscendAntiQuantV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.993.939 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.993.961 [opsproto_manager.cc:123]618650 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.993.971 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.993.983 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.994.005 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.994.007 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.994.025 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 3 libs.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.994.055 [opsproto_manager.cc:123]618650 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.994.086 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.994.099 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.994.117 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 4 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.994.112 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.994.105 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.994.183 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.994.200 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.994.202 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Concat] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.994.212 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.994.228 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ConcatV2] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.994.252 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.994.273 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.994.273 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.994.291 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.994.319 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.994.322 [opsproto_manager.cc:123]618650 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.994.330 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.994.345 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.994.368 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.994.385 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 5 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.994.398 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [OpExecuteFunc]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.994.412 [opsproto_manager.cc:123]618650 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.994.451 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.994.453 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.994.457 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.994.475 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 6 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.994.473 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.994.543 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.994.559 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.994.553 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.994.567 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.994.625 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.994.642 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.994.627 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachBinaryOp] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.994.630 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.994.675 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.994.676 [opsproto_manager.cc:123]618650 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.994.721 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.994.722 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.994.741 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 7 libs.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.994.770 [opsproto_manager.cc:123]618650 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.994.781 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.994.796 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.994.807 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.994.814 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.994.839 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 8 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.994.833 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.994.866 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.994.911 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.994.907 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.994.925 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.994.937 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.994.933 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.994.947 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.994.961 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.994.991 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.995.008 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.995.039 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [OpExecuteFunc]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.995.035 [opsproto_manager.cc:123]618650 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.995.058 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AvgPoolUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.995.080 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.995.096 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 9 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.995.126 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [OpExecuteFunc]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.995.124 [opsproto_manager.cc:123]618650 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.995.169 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.995.186 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 10 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.995.175 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.995.207 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [OpExecuteFunc]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.995.216 [opsproto_manager.cc:123]618650 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/usr/local/Ascend/ascend-toolkit/latest/opp/op_proto/custom/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.995.260 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 10 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.995.283 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.995.261 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.995.292 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.995.329 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.995.347 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt2.0.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.995.361 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.995.360 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.995.376 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 3 libs.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:41.995.392 [opsproto_manager.cc:147]618650 LoadOpsProtoPluginSo:[LoadSo][Check] Shared library will not be checked. Please make sure that the source of shared library is trusted.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.995.409 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Bitcast] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.995.440 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.995.474 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.995.518 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.995.520 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.995.593 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.995.602 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.995.632 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.995.671 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.995.699 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.995.716 [operator_factory_impl.cc:215]618650 RegisterInferShapeFunc:operator_infershape_funcs_ init
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.995.750 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.995.752 [operator_factory_impl.cc:269]618650 RegisterVerifyFunc:operator_verify_funcs_ init
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.995.757 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:41.995.791 [opsproto_manager.cc:162]618650 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.995.801 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.995.856 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.995.881 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.995.938 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.995.920 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CTCLoss] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.996.020 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.996.041 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.996.058 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InstanceNormV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.996.096 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.996.186 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.996.149 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.996.260 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.996.261 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IouV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.996.289 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:41.996.339 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.996.406 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DropOutGenMask] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.996.438 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StatelessDropOutGenMask] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.996.452 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BidirectionLSTM] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.996.485 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BidirectionLSTMV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.996.546 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.996.660 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.996.663 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.996.692 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.996.767 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.996.867 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaskedSelectV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.996.886 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.996.998 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ExpandDims] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.997.063 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.997.108 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.997.262 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FillWindowCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.997.372 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.997.488 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FlattenV2] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.997.599 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GatherShapes] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.997.709 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GaussianBlur] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.997.866 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FileConstant] register OP_IMPL : [IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.997.899 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StatelessIf] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.997.928 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[If] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.997.953 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[_If] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.997.981 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Case] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.998.043 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ConstPlaceHolder] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.998.151 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.998.269 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.998.350 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Identity] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.998.379 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MemcpyAsync] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.998.408 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IdentityN] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.998.509 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.998.620 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:41.998.647 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.998.737 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.998.847 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.998.954 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.999.061 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.999.087 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.999.110 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.999.252 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.999.278 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.999.362 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.999.495 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.999.600 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.999.714 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.999.823 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:41.999.930 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.000.039 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.000.209 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RandomChoiceWithMask] register OP_IMPL : [InferShapeRange]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.000.337 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RandomUniform] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.000.418 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Rank] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.000.447 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Size] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.000.506 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:DepthToSpace
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.000.556 [op_tiling_registry.cc:148]618646 OpTilingFuncRegistry:Register op tiling and parse function V3 for op_type:SpaceToDepth
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.000.551 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.000.664 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Reshape] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.000.781 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RgbToGrayscale] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.000.899 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.001.012 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.001.119 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.001.229 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Rotate] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.001.313 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Shape] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.001.340 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ShapeN] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.001.576 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SilentCheckV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.001.812 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SilentCheckV3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.001.951 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.002.062 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.002.066 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.002.185 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyAdadelta] register OP_IMPL : [InferShape]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.002.169 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Igammac] has registered infer func
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.002.204 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.002.215 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyAdadeltaD] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.002.241 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.002.267 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyAdagrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.002.293 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.002.319 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.002.325 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.002.347 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.002.378 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.002.411 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.002.433 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.002.458 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.002.483 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2D] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.002.510 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyRMSProp] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.002.536 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyRMSPropD] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.002.609 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.002.647 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseFillEmptyRows] register OP_IMPL : [InferShapeRange][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.002.742 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.002.859 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.002.866 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DeformableOffsetsGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.002.983 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.002.984 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Squeeze] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.003.014 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SqueezeV2] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.003.042 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SqueezeV3] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.003.039 [opsproto_manager.cc:162]618650 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.003.125 [opsproto_manager.cc:162]618650 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.003.136 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.003.146 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.003.172 [opsproto_manager.cc:162]618650 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.003.207 [opsproto_manager.cc:162]618650 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.003.241 [opsproto_manager.cc:162]618650 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.003.254 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.003.260 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StatelessRandomNormalV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.003.272 [opsproto_manager.cc:162]618650 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.003.302 [opsproto_manager.cc:162]618650 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.003.332 [opsproto_manager.cc:162]618650 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.003.363 [opsproto_manager.cc:162]618650 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.003.365 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.003.418 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.003.470 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.003.570 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.003.594 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TopK] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.003.618 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.003.641 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.003.662 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.003.684 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.003.688 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.003.788 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TopKPQDistanceV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.003.805 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.003.891 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.003.936 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachNonFiniteCheckAndUnscale] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.004.012 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TransArgb] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.004.063 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.004.142 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Unsqueeze] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.004.199 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.004.216 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UnsqueezeV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.004.229 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.004.248 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UnsqueezeV3] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.004.365 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.004.389 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GatherV3] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.004.396 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.004.504 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.004.502 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Where] register OP_IMPL : [InferShapeRange]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.004.611 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[WtsARQ] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.004.646 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.004.724 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.004.772 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.004.829 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.004.900 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.004.861 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.004.927 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.004.923 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.004.935 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.004.962 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.005.044 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.005.076 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.005.100 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.005.163 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.005.211 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdjustContrast] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.005.239 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdjustHue] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.005.265 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdjustSaturation] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.005.292 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CropAndResize] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.005.317 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CropAndResizeV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.005.319 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LinSpace] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.005.343 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DecodeAndCropJpeg] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.005.371 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DecodeJpeg] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.005.403 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NormalizeV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.005.432 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdjustContrastWithMean] register OP_IMPL : [InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.005.451 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MemSet] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.005.458 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdjustBrightness] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.005.494 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdjustBrightnessV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.005.522 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdjustSaturationV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.005.549 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[WarpAffineV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.005.568 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.005.575 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ImgCrop] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.005.601 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[WarpPerspective] register OP_IMPL : [InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.005.689 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.005.709 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.005.736 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.005.758 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.005.824 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.005.874 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HcomAllReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.005.904 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HcomAllGather] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.005.930 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HcomBroadcast] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.005.941 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.005.956 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HcomReduceScatter] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.005.981 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HcomSend] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.006.008 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HcomReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.006.034 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HcomReceive] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.006.060 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HcomAllToAllV] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.006.066 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.006.087 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HcomAllToAllVC] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.006.114 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HcomGatherAllToAllV] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.006.187 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NPUClearFloatStatus] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.006.302 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NPUGetFloatStatus] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.006.425 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.006.451 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.006.681 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.006.802 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.006.952 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.007.163 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.007.245 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.007.284 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.007.338 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.007.424 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.007.497 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.007.506 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.007.610 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.007.659 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.007.691 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.007.772 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.007.808 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.007.813 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.007.918 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.007.938 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.007.963 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.007.972 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.008.025 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.008.075 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.008.102 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.008.222 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.008.304 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.008.285 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.008.330 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.008.474 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.008.558 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.008.607 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MedianDim] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.008.699 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.008.783 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.008.869 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.008.950 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.008.959 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.009.180 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.009.305 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.009.336 [opsproto_manager.cc:162]618670 LoadOpsProtoPluginSo:OpsProtoManager plugin load /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto.so success.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.009.377 [plugin_manager.cc:108]618670 GetOppPath:Enter get opp path schedule
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.009.393 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.009.421 [plugin_manager.cc:117]618670 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.009.566 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.009.739 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeTutelCombineGates] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.009.880 [plugin_manager.cc:996]618670 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.009.936 [plugin_manager.cc:1011]618670 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.009.959 [plugin_manager.cc:1015]618670 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.009.952 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeTutelCombineX] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.010.039 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.010.065 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.010.105 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeTutelDispatch] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.010.122 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.010.139 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.010.153 [opp_so_manager.cc:56]618670 LoadOpsProtoPackage:Start load ops proto package, is_split:[1].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.010.170 [plugin_manager.cc:540]618670 GetOpsProtoPath:Enter GetOpsProtoPath schedule
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.010.181 [plugin_manager.cc:108]618670 GetOppPath:Enter get opp path schedule
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.010.197 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.010.207 [plugin_manager.cc:117]618670 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.010.227 [plugin_manager.cc:547]618670 GetOpsProtoPath:Opp plugin path structure is new version!
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.010.244 [plugin_manager.cc:206]618670 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.010.465 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScore] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.010.597 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.010.623 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.010.662 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.010.679 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.010.692 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.010.737 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.010.754 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.011.090 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.011.124 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.011.141 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.011.154 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.011.202 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.011.243 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.011.250 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Rfft1D] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.011.260 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.011.278 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.011.291 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.011.323 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.011.338 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.011.350 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.011.364 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.011.416 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.011.584 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.011.620 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GemmaRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.011.704 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.011.737 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.011.735 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.011.754 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.011.772 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.011.811 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.011.876 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.012.069 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LinearIndex] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.012.147 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.012.227 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.012.246 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.012.271 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.012.309 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.012.297 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LinearIndexV2] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.012.346 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.012.363 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.012.375 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.012.392 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.012.420 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.012.436 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.012.448 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.012.461 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.012.466 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.012.507 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterAddWithSorted] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.012.527 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.012.689 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Sinkhorn] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.012.798 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.012.816 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.012.831 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.012.848 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.012.863 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.012.901 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.012.928 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.012.937 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.012.972 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.013.050 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.013.168 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.013.242 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.013.274 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.013.294 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.013.291 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.013.316 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.013.353 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.013.389 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.013.405 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.013.417 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.013.431 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.013.463 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.013.479 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.013.490 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.013.503 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.013.512 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.013.539 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.013.650 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.013.763 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.013.756 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.013.837 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.013.868 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.013.885 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.013.897 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.013.931 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.013.970 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.013.987 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StackGroupPoints] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.014.087 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.014.155 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.014.210 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.014.269 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.014.284 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.014.301 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618670,py[INFO] GE(618646,python3.9):2025-04-03-09:27:42.014.321 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : [Tiling][TilingParse]
thon3.9):2025-04-03-09:27:42.014.318 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.014.348 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.014.383 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.014.419 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.014.436 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.014.449 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.014.462 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.014.465 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.014.461 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.014.496 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.014.500 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.014.516 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.014.532 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.014.547 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.014.580 [op_impl_space_registry.cc:273]618666 ConvertSoToRegistry:Save so symbol and handle in path[/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so] success!
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.014.636 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.014.759 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.014.757 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.014.789 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.014.820 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.014.884 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.014.905 [plugin_manager.cc:554]618666 GetUpgradedOpsProtoPath:Start to get upgraded ops proto path
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.014.915 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.014.924 [plugin_manager.cc:134]618666 GetUpgradedOppPath:Enter get upgraded opp path schedule
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.014.927 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.014.932 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.014.950 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.014.980 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /usr/local/Ascend/ascend-toolkit/latest/opp_latest/, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.014.983 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.014.993 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.014.996 [plugin_manager.cc:145]618666 GetUpgradedOppPath:[Call][RealPath] Opp path /usr/local/Ascend/ascend-toolkit/latest/opp_latest/ is invalid.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.015.018 [plugin_manager.cc:557]618666 GetUpgradedOpsProtoPath:Failed to get upgraded opp path!
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.015.031 [plugin_manager.cc:108]618666 GetOppPath:Enter get opp path schedule
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.015.060 [plugin_manager.cc:117]618666 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.015.083 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.015.192 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.015.253 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.015.290 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.015.340 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.015.373 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.015.397 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.015.393 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.015.411 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.015.448 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.015.484 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.015.500 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.015.511 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.015.512 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.015.529 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.015.543 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.015.559 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.015.572 [plugin_manager.cc:996]618666 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.015.574 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.015.592 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.015.606 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.015.620 [plugin_manager.cc:218]618670 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.015.630 [plugin_manager.cc:1011]618666 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.015.652 [plugin_manager.cc:1015]618666 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.015.642 [plugin_manager.cc:422]618670 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.015.656 [plugin_manager.cc:155]618670 GetOppPluginVendors:Enter get opp plugin config file sche[INFO] GE(618646,python3.9):2025-04-03-09:27:42.015.651 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BlendFaceBgPartOne] register OP_IMPL : [Tiling][TilingParse]
dule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.015.689 [plugin_manager.cc:158]618670 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.015.705 [plugin_manager.cc:426]618670 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.015.739 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.015.754 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.015.754 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.015.768 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.015.788 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.015.817 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.015.819 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.015.831 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.015.845 [opp_so_manager.cc:66]618666 LoadOpMasterPackage:Start load op master package, is_split:[1].
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.015.858 [plugin_manager.cc:616]618666 GetOpTilingForwardOrderPath:Enter GetOpTilingPath schedule
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.015.868 [plugin_manager.cc:108]618666 GetOppPath:Enter get opp path schedule
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.015.889 [plugin_manager.cc:117]618666 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.015.891 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.015.906 [plugin_manager.cc:624]618666 GetOpTilingForwardOrderPath:Opp plugin path structure is new version!
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.015.919 [plugin_manager.cc:206]618666 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.016.025 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.016.046 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.016.059 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.016.080 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.016.098 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.016.110 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.016.181 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.016.148 [plugin_manager.cc:439]618670 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspo
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.016.361 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.016.372 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.016.403 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.016.413 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNN, funcPointer:0xfffef5345d70, registered count:1
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.016.417 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.016.436 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.016.480 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.016.518 [plugin_manager.cc:996]618670 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.016.550 [plugin_manager.cc:1011]618670 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.016.572 [plugin_manager.cc:1015]618670 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.016.591 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.016.612 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNNV2, funcPointer:0xfffef534e248, registered count:2
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.016.686 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.016.703 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.016.717 [opp_so_manager.cc:45]618670 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.016.741 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.016.817 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.016.848 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.016.861 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.016.864 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.016.874 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.016.908 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.016.953 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.016.967 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.016.977 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.016.990 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.017.005 [plugin_manager.cc:215]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.017.020 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.017.133 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GridSampler2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.017.258 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GridSampler3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.017.323 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.017.354 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.017.367 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.017.380 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.017.399 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandle] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.017.417 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.017.513 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandleV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.017.629 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.017.736 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.017.754 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PasteSubImg] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.017.775 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.017.789 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.017.801 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.017.835 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.017.868 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.017.871 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.017.884 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.017.894 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.017.894 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.017.906 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.017.918 [plugin_manager.cc:215]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.018.010 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.018.126 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.175 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.223 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[EluGradV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.172 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.223 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[EluGradV2] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.018.233 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.245 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.246 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.018.265 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.268 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.267 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.018.280 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.018.277 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.018.293 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.289 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SyncBNTrainingUpdate] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.290 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SyncBNTrainingUpdate] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.311 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Abs] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.311 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Abs] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.018.326 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.332 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Real] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.333 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Real] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.353 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Acos] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.354 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Acos] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.372 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Acosh] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.375 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Acosh] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.392 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddMatMatElements] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.394 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddMatMatElements] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.018.406 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.413 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Adds] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.411 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Adds] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.432 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Asin] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.432 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Asin] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.450 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Asinh] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.451 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Asinh] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.470 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AssignAdd] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.469 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AssignAdd] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.487 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AssignSub] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.488 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AssignSub] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.507 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Atan] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.507 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Atan] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.525 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Atanh] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.018.522 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.527 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Atanh] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.542 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.547 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.561 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BesselI0e] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.566 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BesselI0e] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.580 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BesselI1e] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.586 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BesselI1e] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.599 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.605 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.617 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.624 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.636 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.018.642 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.018.645 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.643 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.655 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.018.675 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.675 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Bucketize] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.664 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.018.689 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.695 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Cast] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.018.703 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.699 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Bucketize] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.720 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Cast] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.715 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Ceil] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.738 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Ceil] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.018.737 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.749 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CeluV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.018.761 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TabulateFusionGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.759 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CeluV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.769 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ComplexAbs] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.778 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ComplexAbs] register OP_IMPL : [][]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.018.781 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.789 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Cos] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.018.796 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.796 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Cos] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.018.813 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.809 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Cosh] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.817 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Cosh] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.018.829 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.830 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.837 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.018.845 [plugin_manager.cc:215]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.850 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DataFormatDimMap] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.856 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DataFormatDimMap] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.870 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Dequantize] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.877 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Dequantize] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.018.879 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[YUV4442YUV422] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.888 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Elu] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.894 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Elu] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.909 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Erf] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.914 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Erf] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.929 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Erfc] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.934 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Erfc] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.949 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Exp] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.953 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Exp] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.968 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Expm1] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.973 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Expm1] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.018.988 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FakeQuantWithMinMaxVars] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.018.992 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FakeQuantWithMinMaxVars] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.018.988 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: Conv2DBackpropFilter, registered count: 1
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.009 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FastGelu] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.012 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FastGelu] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.028 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FastGeluV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.032 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FastGeluV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.019.037 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.048 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Floor] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.052 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Floor] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.019.065 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.068 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FusedMulAddN] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.071 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FusedMulAddN] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.089 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HardSigmoid] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.019.089 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.019.084 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: Conv2DBackpropInput, registered count: 2
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.090 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HardSigmoid] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.105 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HardShrink] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.109 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HardShrink] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.019.115 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.019.099 [op_impl_registry_holder_manager.cc:208]618670 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.019.113 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: Conv2DTranspose, registered count: 3
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.126 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HardShrinkGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.125 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HardShrinkGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.143 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HardSwish] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.019.139 [op_impl_registry_holder_manager.cc:216]618670 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.145 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HardSwish] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.019.158 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.162 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HardSwishGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.161 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HardSwishGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.019.159 [op_impl_registry_holder_manager.cc:208]618670 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.180 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HardtanhGrad] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.019.188 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.183 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HardtanhGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.019.188 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: Conv2D, registered count: 4
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.019.204 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.200 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IndexFillD] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.210 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IndexFillD] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.019.219 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.219 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.238 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.019.226 [op_impl_registry_holder_manager.cc:208]618670 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.231 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.248 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.019.251 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.254 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Inv] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.266 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Inv] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.019.272 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.019.268 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: Conv3DBackpropInput, registered count: 5
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.284 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Invert] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.287 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Invert] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.019.291 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: Conv3DTranspose, registered count: 6
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.305 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Log] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.307 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Log] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.325 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Log1p] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.327 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Log1p] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.346 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LogicalNot] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.344 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LogicalNot] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.363 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LogAddExp] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.363 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LogAddExp] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.019.368 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: Conv3D, registered count: 7
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.382 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LpNormUpdate] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.383 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LpNormUpdate] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.400 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LpNormUpdateV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.402 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LpNormUpdateV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.019.417 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.417 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Dawsn] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.421 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Dawsn] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.438 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Expint] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.442 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Expint] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.456 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Erfinv] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.461 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Erfinv] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.475 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FresnelCos] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.480 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FresnelCos] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.494 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FresnelSin] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.500 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FresnelSin] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.513 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Ndtri] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.519 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Ndtri] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.531 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Spence] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.019.533 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.019.528 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: FFN, registered count: 8
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.538 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Spence] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.551 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Fills] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.558 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Fills] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.019.568 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.019.550 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: MatmulTunnerTiling, registered count: 9
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.570 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LeakyRelu] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.576 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LeakyRelu] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.592 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[OnesLike] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.019.599 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.595 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[OnesLike] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.611 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Reciprocal] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.019.613 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.609 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Reciprocal] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.019.628 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.630 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Sign] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.630 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Sign] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.652 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Sqrt] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.651 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Sqrt] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.019.658 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.019.659 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.670 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Tanh] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.669 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Tanh] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.690 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ZerosLike] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.689 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ZerosLike] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.019.693 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.019.684 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: MatMulV2, registered count: 10
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.019.707 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: BatchMatmulFixpipe, registered count: 11
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.707 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Gelu] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.019.707 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.706 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Gelu] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.727 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GeluV2] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.019.733 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.019.746 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.019.728 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: MatMulV3, registered count: 12
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.735 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GeluV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.753 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Relu] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.019.735 [op_impl_space_registry.cc:273]618670 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so] success!
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.747 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Relu] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.019.759 [plugin_manager.cc:215]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.019.757 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: QuantBatchMatmulV3, registered count: 13
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.768 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Neg] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.019.772 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.771 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Neg] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.791 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LogSoftmaxV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.785 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LogSoftmaxV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.813 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.811 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.831 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.830 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.850 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.851 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.019.858 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.872 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftplusV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.870 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftplusV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.019.878 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.019.892 [opp_so_manager.cc:45]618670 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.889 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Muls] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.891 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Muls] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.908 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Power] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.019.901 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.906 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Power] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.924 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Relu6] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.926 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Relu6] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.019.934 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: DynamicRNN, registered count: 14
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.944 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Relu6D] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.944 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Relu6D] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.019.955 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: MatMulTunnerTiling, registered count: 15
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.962 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Relu6Grad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.964 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Relu6Grad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.019.969 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.019.983 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReluGradV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.019.980 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReluGradV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.019.995 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.001 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Rint] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.000 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Rint] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.020 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Round] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.021 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Round] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.039 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Rsqrt] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.041 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Rsqrt] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.058 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RsqrtGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.060 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RsqrtGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.075 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Selu] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.020.080 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.078 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Selu] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.094 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Shrink] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.098 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Shrink] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.020.113 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.114 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Sigmoid] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.115 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Sigmoid] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.020.121 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.020.127 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.020.139 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.135 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.134 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.172 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SigmoidGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.020.180 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.155 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SigmoidGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.197 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Sin] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.203 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Sin] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.218 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Sinh] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.223 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Sinh] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.239 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SmoothL1Loss] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.243 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SmoothL1Loss] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.020.247 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.262 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SmoothL1LossGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.259 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SmoothL1LossGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.280 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LogSigmoid] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.290 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LogSigmoid] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.299 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LogSigmoidGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.311 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LogSigmoidGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.317 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LogSpaceD] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.330 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LogSpaceD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.342 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Softplus] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.349 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Softplus] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.361 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Softsign] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.020.370 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.368 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Softsign] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.380 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SqrtGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.388 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SqrtGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.400 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Square] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.406 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Square] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.419 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Swish] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.425 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Swish] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.438 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwishGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.444 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwishGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.461 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SiluGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.467 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SiluGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.487 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardElemt] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.489 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardElemt] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.508 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Tan] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.510 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Tan] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.020.510 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.529 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftShrink] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.531 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftShrink] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.020.543 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.551 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftShrinkGrad] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.020.557 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.555 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftShrinkGrad] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.020.572 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.020.569 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicAtomicAddrClean] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.572 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Threshold] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.576 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Threshold] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.597 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ThresholdV2] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.020.602 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.601 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ThresholdV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.618 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ThresholdV2D] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.622 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ThresholdV2D] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.020.638 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.639 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Trunc] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.643 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Trunc] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.020.654 [plugin_manager.cc:1026]618666 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.663 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.020.668 [plugin_manager.cc:322]618666 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.669 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.020.683 [plugin_manager.cc:212]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.020.696 [plugin_manager.cc:215]618666 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspo[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.684 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.692 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.020.691 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [Tiling][TilingParse]
re/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.707 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MishGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.020.715 [plugin_manager.cc:218]618666 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-pack
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.717 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MishGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.020.734 [plugin_manager.cc:422]618666 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.728 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HardSigmoidGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.739 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HardSigmoidGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.020.747 [plugin_manager.cc:155]618666 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.750 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.760 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.020.768 [plugin_manager.cc:158]618666 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.771 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.020.782 [plugin_manager.cc:426]618666 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.782 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.793 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.805 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.020.812 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.814 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.837 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FillDiagonal] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.826 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.855 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FillDiagonal] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.856 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IndexPut] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.877 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IndexPut] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.882 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReadVariableOp] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.903 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReadVariableOp] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.902 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CastLike] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.924 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CastLike] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.929 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FusedBiasLeakyRelu] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.020.933 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.947 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FusedBiasLeakyRelu] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.950 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StatelessBernoulliV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.969 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StatelessBernoulliV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.975 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.020.990 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.020.995 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InvertPermutation] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.013 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InvertPermutation] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.016 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.035 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.036 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SearchSorted] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.057 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.021.061 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.057 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SearchSorted] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.079 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.076 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.021.091 [plugin_manager.cc:250]618666 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.096 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.101 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.021.123 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.121 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.122 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.021.140 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.144 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [][][]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.021.152 [plugin_manager.cc:1063]618666 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.144 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.168 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.021.174 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.021.187 [plugin_manager.cc:439]618666 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.021.200 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:MatMulV2, funcPointer:0xfffefdc98a10, registered count:3
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.021.238 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:MatMulV2, funcPointer:0xfffefdc98c70, registered count:1
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.250 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaskedScale] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.273 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AbsGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.276 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaskedScale] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.021.295 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.296 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AccumulateNV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.300 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AbsGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.320 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddN] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.021.324 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceMeanD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.322 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AccumulateNV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.341 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Eltwise] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.343 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddN] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.365 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.365 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Eltwise] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.386 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.385 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AcosGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.407 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AcosGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.408 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AcoshGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.430 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AsinGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.429 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AcoshGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.021.440 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.450 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AsinhGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.451 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AsinGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.472 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Atan2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.471 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AsinhGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.021.486 [plugin_manager.cc:996]618666 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.492 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AtanGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.494 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Atan2] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.021.513 [plugin_manager.cc:1011]618666 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.514 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Axpy] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.522 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AtanGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.021.533 [plugin_manager.cc:1015]618666 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.537 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BitwiseAnd] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.543 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Axpy] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.021.553 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.566 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BitwiseAnd] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.559 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BitwiseOr] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.021.581 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.587 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BitwiseOr] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.588 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BitwiseXor] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.021.586 [opp_so_manager.cc:123]618666 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.608 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BitwiseXor] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.614 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Div] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.631 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Div] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.634 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DivNoNan] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.653 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DivNoNan] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.654 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[EluGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.674 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[EluGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.675 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FastGeluGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.021.694 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.021.683 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.697 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FloorDiv] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.696 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FastGeluGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.021.709 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.021.721 [opp_so_manager.cc:45]618666 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.720 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FloorDiv] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.726 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FloorMod] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.746 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FloorMod] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.751 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InvGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.769 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InvGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.774 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LeakyReluGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.795 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TanhGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.793 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LeakyReluGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.816 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Add] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.819 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TanhGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.837 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Addcdiv] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.840 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Add] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.861 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Addcmul] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.860 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Addcdiv] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.021.879 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.881 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Addcmul] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.881 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AxpyV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.906 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LogicalAnd] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.910 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AxpyV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.927 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LogicalOr] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.931 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LogicalAnd] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.952 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LogicalOr] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.953 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Mul] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.971 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Mul] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.975 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Pow] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.021.993 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Pow] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.021.993 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.021.995 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RealDiv] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.013 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RealDiv] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.018 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ClipByNormNoDivSum] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.036 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ClipByNormNoDivSum] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.041 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ClipByValue] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.058 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ClipByValue] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.062 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ClipByValueV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.082 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FusedMulAdd] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.082 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ClipByValueV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.103 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftmaxGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.022.109 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.104 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FusedMulAdd] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.124 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Sub] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.135 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftmaxGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.146 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Gcd] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.157 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Sub] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.166 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LarsV2Update] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.178 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Gcd] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.022.179 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.197 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaskedFill] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.198 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LarsV2Update] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.022.182 [op_impl_registry_holder_manager.cc:208]618670 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.218 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReluGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.220 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaskedFill] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.022.221 [op_impl_registry_holder_manager.cc:216]618670 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.022.237 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.022.241 [op_impl_registry_holder_manager.cc:208]618670 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.240 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReluGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.243 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Xlog1py] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.265 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApproximateEqual] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.263 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Xlog1py] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.022.279 [op_impl_registry_holder_manager.cc:208]618670 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.284 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Equal] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.286 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApproximateEqual] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.305 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NotEqual] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.306 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Equal] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.326 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Greater] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.328 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NotEqual] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.022.347 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.350 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GreaterEqual] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.348 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Greater] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.372 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Less] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.375 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GreaterEqual] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.394 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LessEqual] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.395 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Less] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.415 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Maximum] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.414 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LessEqual] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.436 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Maximum] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.439 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Minimum] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.464 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Minimum] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.460 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Mod] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.022.466 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.482 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.485 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Mod] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.505 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MulNoNan] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.506 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.526 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MulNoNan] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.525 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReciprocalGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.544 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReciprocalGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.547 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SeluGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.567 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogits] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.566 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SeluGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.022.584 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.588 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftplusGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.587 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogits] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.609 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftplusGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.612 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftplusV2Grad] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.022.617 [op_impl_space_registry.cc:80]618670 MergeFunctions:op type DecoderKvCache infer_shape func has been registered
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.633 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftplusV2Grad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.632 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftsignGrad] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.022.639 [op_impl_space_registry.cc:83]618670 MergeFunctions:op type DecoderKvCache infer_datatype func has been registered
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.654 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SquaredDifference] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.654 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftsignGrad] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.022.660 [op_impl_space_registry.cc:80]618670 MergeFunctions:op type PromptKvCache infer_shape func has been registered
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.022.674 [op_impl_space_registry.cc:83]618670 MergeFunctions:op type PromptKvCache infer_datatype func has been registered
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.674 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.677 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SquaredDifference] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.022.689 [op_impl_space_registry.cc:273]618670 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so] success!
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.022.697 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.696 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ThresholdGradV2D] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.699 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.718 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TruncateDiv] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.730 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ThresholdGradV2D] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.022.699 [operator_factory_impl.cc:368]618650 RegisterInferAxisTypeInfoFunc:axis type info derivation funcs init
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.022.740 [opp_so_manager.cc:97]618670 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.740 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TruncateMod] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.752 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TruncateDiv] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.768 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Xdivy] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.773 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TruncateMod] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.022.780 [opp_so_manager.cc:97]618670 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.790 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IsClose] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.793 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Xdivy] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.814 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IsClose] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.813 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Xlogy] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.832 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Xlogy] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.838 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.853 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.857 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SelectV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.022.867 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.875 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SelectV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.877 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaskedSelectV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.898 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaskedSelectV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.900 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Lerp] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.022.885 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.022.913 [opp_so_manager.cc:45]618670 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.022.907 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.922 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Lerp] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.022.926 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FusedBiasLeakyReluGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.022.943 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FusedBiasLeakyReluGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.022.945 [operator_factory_impl.cc:284]618650 RegisterInferDataSliceFunc:operator_infer_data_slice_funcs_ init
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.023.033 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.023.029 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.023.048 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.023.133 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.023.152 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.023.153 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [MatrixBandPart] has registered infer func
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.023.163 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.023.179 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [CheckNumerics] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.023.195 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [UnravelIndex] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.023.194 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff1c9732c0, registered count:4
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.023.229 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:6
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.023.213 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [UpperBound] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.023.247 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [ListDiff] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.023.243 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.023.251 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.023.249 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.023.271 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.023.271 [operator_factory_impl.cc:254]618650 RegisterInferFormatFunc:operator_inferformat_funcs_ init
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.023.291 [op_check.cc:71]618666 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.023.301 [operator_factory_impl.cc:340]618650 RegisterInferAxisSliceFunc:axis slice derivation funcs init
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.023.335 [operator_factory_impl.cc:307]618650 RegisterInferValueRangeFunc:operator_infervalue_paras_ init
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.023.342 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.023.349 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.023.366 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [IdentityN] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.023.395 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [LowerBound] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.023.418 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Expand] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.023.454 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.023.454 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.023.480 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.023.484 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.023.506 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.023.509 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.023.529 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.023.533 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : []
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.023.547 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [LeftShift] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.023.585 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff1c977978, registered count:4
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.023.607 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.023.623 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.023.609 [op_impl_space_registry.cc:240]618670 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.023.627 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.023.630 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.023.637 [opp_so_manager.cc:48]618670 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.023.640 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.023.656 [op_check.cc:71]618666 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.023.725 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.023.743 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.023.730 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.023.729 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.023.756 [opp_so_manager.cc:45]618670 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.023.828 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.023.829 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.023.922 [op_impl_registry_holder_manager.cc:208]618666 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.023.925 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.023.929 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.023.917 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.023.956 [op_impl_registry_holder_manager.cc:216]618666 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.023.972 [op_impl_registry_holder_manager.cc:208]618666 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.024.009 [op_impl_registry_holder_manager.cc:208]618666 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.024.026 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.024.029 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.024.088 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.024.135 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.024.134 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.024.191 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.024.252 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Quantize] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.024.257 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Quantize] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.024.283 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.024.297 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.024.281 [op_impl_space_registry.cc:273]618666 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so] success!
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.024.308 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AscendDequant] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.024.322 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AscendDequant] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.024.344 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.024.332 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.024.357 [opp_so_manager.cc:123]618666 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.024.378 [op_impl_space_registry.cc:240]618670 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.024.405 [opp_so_manager.cc:48]618670 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.024.437 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.024.438 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.024.453 [opp_so_manager.cc:97]618670 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.024.467 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.024.482 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.024.489 [opp_so_manager.cc:97]618670 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.024.496 [opp_so_manager.cc:45]618666 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.024.475 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Reciprocal] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.024.515 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Sign] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.024.536 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : []
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.024.539 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Div] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.024.539 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.024.563 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.024.562 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Exp] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.024.566 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.024.576 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.024.593 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.024.586 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.024.594 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.024.590 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [LessEqual] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.024.609 [opp_so_manager.cc:45]618670 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.024.608 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : []
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.024.615 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Log1p] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.024.617 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.024.609 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.024.633 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.024.640 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.024.640 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [DivNoNan] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.024.655 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BasicLSTMInplaceFillWindowCache] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.024.660 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BasicLSTMInplaceFillWindowCache] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.024.677 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BasicGRUInplaceFillWindowCache] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.024.681 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BasicGRUInplaceFillWindowCache] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.024.686 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Mul] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.024.708 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [SqrtGrad] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.024.726 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Log] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.024.743 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [AddN] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.024.771 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [AcosGrad] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.024.776 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.024.778 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : []
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.024.790 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [AcoshGrad] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.024.824 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [BiasAdd] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.024.859 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [FloorDiv] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.024.872 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.024.877 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.024.883 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [ArgMin] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.024.954 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [MulNoNan] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.024.977 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.024.976 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.024.999 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [AsinGrad] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.025.035 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Cos] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.025.054 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Sin] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.025.077 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.025.080 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.025.078 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.025.089 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [AsinhGrad] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.025.102 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.025.103 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : []
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.025.115 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Expm1] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.025.180 [op_impl_space_registry.cc:240]618670 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.025.195 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdaCast] register OP_IMPL : [][]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.025.203 [opp_so_manager.cc:48]618670 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.025.207 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdaCast] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.025.297 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.025.291 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.025.319 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.025.307 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.025.330 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.025.333 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.025.334 [opp_so_manager.cc:45]618670 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.025.353 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.025.353 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.025.376 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.025.375 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.025.468 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.025.473 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.025.561 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.025.570 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.025.663 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.025.669 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.025.696 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DepthToSpace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.025.747 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.025.763 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.025.770 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SpaceToDepth] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.025.763 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.025.787 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.025.803 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.025.886 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.025.893 [op_impl_space_registry.cc:240]618670 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.025.899 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.025.916 [opp_so_manager.cc:48]618670 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.025.924 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.025.931 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:AllFinite, funcPointer:(nil), registered count:4
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.025.961 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:AllFinite, funcPointer:(nil), registered count:6
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.025.959 [opp_so_manager.cc:97]618670 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.025.980 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:AllFinite, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.025.981 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.025.996 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:AllFinite, funcPointer:(nil), registered count:3
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.025.994 [opp_so_manager.cc:97]618670 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.025.993 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.026.015 [op_check.cc:71]618666 RegisterParamGeneralize:RegisterParamGeneralize: op_type:AllFinite, funcPointer:(nil), registered count:3
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.026.019 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.026.008 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.026.049 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.026.076 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.026.093 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.026.104 [opp_so_manager.cc:45]618670 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.026.122 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.026.118 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.026.166 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.026.217 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.026.216 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.026.284 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.026.295 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff1c9249b0, registered count:4
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.026.315 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.026.312 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.026.316 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.026.334 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.026.350 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.026.365 [op_check.cc:71]618666 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.026.401 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.026.416 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.026.409 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [AdjustHue] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.026.424 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.026.441 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.026.440 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [AdjustSaturation] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.026.450 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.026.467 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [ExtractGlimpse] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.026.489 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [ResizeArea] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.026.507 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [ResizeBicubic] has registered infer func
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.026.514 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.026.527 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [RGBToHSV] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.026.540 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[L2Loss] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.026.544 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[L2Loss] register OP_IMPL : []
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.026.551 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [NonMaxSuppressionWithOverlaps] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.026.594 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [ScaleAndTranslate] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.026.612 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [ScaleAndTranslateGrad] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.026.627 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [CombinedNonMaxSuppression] has registered infer func
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.026.638 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.026.638 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.026.641 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff1c927da0, registered count:4
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.026.640 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.026.664 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.026.658 [op_impl_space_registry.cc:240]618670 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.026.682 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.026.681 [opp_so_manager.cc:48]618670 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.026.700 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.026.722 [op_check.cc:71]618666 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.026.729 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [CholeskyGrad] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.026.734 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.026.739 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.026.750 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.026.751 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Cholesky] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.026.767 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.026.784 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.026.774 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [MatrixDeterminant] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.026.792 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [MatrixSolve] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.026.797 [opp_so_manager.cc:45]618670 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.026.811 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [MatrixTriangularSolve] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.026.826 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Qr] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.026.834 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.026.833 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.026.876 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.026.902 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.026.930 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.026.936 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [][][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.026.985 [op_impl_registry_holder_manager.cc:208]618666 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.027.011 [op_impl_registry_holder_manager.cc:216]618666 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.027.025 [op_impl_registry_holder_manager.cc:208]618666 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.027.031 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.027.037 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.027.033 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.027.056 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceAny] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.027.062 [op_impl_registry_holder_manager.cc:208]618666 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.027.065 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.027.059 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceAny] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.027.084 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceAll] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.027.079 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceAll] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.027.104 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceMax] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.027.104 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceMax] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.027.127 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.027.126 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.027.151 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceMeanWithCast] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.027.150 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceMeanWithCast] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.027.171 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceMin] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.027.172 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceMin] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.027.189 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.027.181 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Digamma] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.027.194 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceProd] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.027.195 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceProd] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.027.204 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Igamma] has registered infer func
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.027.215 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.027.215 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceSum] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.027.217 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceSum] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.027.223 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Igammac] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.027.238 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[EuclideanNorm] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.027.238 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[EuclideanNorm] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.027.243 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Bincount] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.027.259 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceLogSum] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.027.261 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceLogSum] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.027.261 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Betainc] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.027.285 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceLogSumExp] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.027.282 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceLogSumExp] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.027.296 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Bucketize] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.027.319 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [IgammaGradA] has registered infer func
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.027.324 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.027.347 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [NextAfter] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.027.349 [op_impl_space_registry.cc:240]618670 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.027.368 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [IsInf] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.027.372 [opp_so_manager.cc:48]618670 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.027.384 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceNansum] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.027.387 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceNansum] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.027.386 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [IsNan] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.027.396 [op_impl_space_registry.cc:84]618666 MergeFunctions:op type DecoderKvCache tiling_parse func has been registered
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.027.406 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Conj] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.027.413 [op_impl_space_registry.cc:85]618666 MergeFunctions:op type DecoderKvCache compile_info_creator func has been registered
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.027.425 [op_impl_space_registry.cc:86]618666 MergeFunctions:op type DecoderKvCache compile_info_deleter func has been registered
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.027.436 [op_impl_space_registry.cc:87]618666 MergeFunctions:op type DecoderKvCache tiling func has been registered
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.027.413 [opp_so_manager.cc:97]618670 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.027.437 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.027.433 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Complex] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.027.450 [op_impl_space_registry.cc:93]618666 MergeFunctions:op type DecoderKvCache max_tiling_data_size has been registered
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.027.452 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Angle] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.027.467 [op_impl_space_registry.cc:84]618666 MergeFunctions:op type PromptKvCache tiling_parse func has been registered
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.027.463 [opp_so_manager.cc:97]618670 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.027.482 [op_impl_space_registry.cc:85]618666 MergeFunctions:op type PromptKvCache compile_info_creator func has been registered
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.027.493 [op_impl_space_registry.cc:86]618666 MergeFunctions:op type PromptKvCache compile_info_deleter func has been registered
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.027.487 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.027.492 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [][]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.027.505 [op_impl_space_registry.cc:87]618666 MergeFunctions:op type PromptKvCache tiling func has been registered
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.027.517 [op_impl_space_registry.cc:93]618666 MergeFunctions:op type PromptKvCache max_tiling_data_size has been registered
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.027.513 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.027.522 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.027.532 [op_impl_space_registry.cc:273]618666 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so] success!
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.027.543 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.027.560 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.027.548 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.027.536 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.027.559 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.027.570 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.027.570 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.027.574 [opp_so_manager.cc:45]618670 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.027.587 [opp_so_manager.cc:123]618666 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.027.594 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.027.595 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.027.617 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.027.619 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [][]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.027.629 [opp_so_manager.cc:126]618666 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.027.666 [opp_so_manager.cc:123]618666 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.027.674 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.027.692 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [ScatterNdUpdate] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.027.711 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.027.714 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.027.716 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [TensorScatterUpdate] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.027.772 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.027.786 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.027.780 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Tril] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.027.800 [opp_so_manager.cc:45]618666 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.027.799 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [IndexPut] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.027.808 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.027.808 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.027.818 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Eye] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.027.836 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [FillDiagonal] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.027.851 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Trace] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.027.903 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.027.903 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.027.907 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.027.928 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.027.928 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.028.025 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.028.031 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.028.125 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [][][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.028.125 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [][][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.028.149 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SplitD] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.028.151 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SplitD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.028.139 [op_impl_space_registry.cc:240]618670 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.028.190 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.028.190 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [][]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.028.201 [opp_so_manager.cc:48]618670 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.028.213 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.028.296 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.028.297 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.028.301 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.028.319 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.028.333 [opp_so_manager.cc:45]618670 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.028.377 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.028.393 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.028.398 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.028.428 [op_impl_space_registry.cc:240]618666 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.028.451 [opp_so_manager.cc:48]618666 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.028.495 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.028.498 [opp_so_manager.cc:123]618666 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.028.503 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.028.503 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [][][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.028.591 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.028.605 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.028.601 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.028.610 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.028.620 [opp_so_manager.cc:45]618666 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.028.622 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.028.711 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.028.711 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.028.747 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.028.809 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.028.813 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.028.848 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [DecodeBbox] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.028.879 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [ClipBoxes] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.028.894 [op_impl_space_registry.cc:240]618670 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.028.899 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [ClipBoxesD] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.028.906 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.028.907 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [][]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.028.917 [opp_so_manager.cc:48]618670 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.028.923 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [DecodeBoundariesTarget] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.028.941 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [DecodeCornerpointsTargetBG] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.028.961 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [DecodeCornerpointsTargetWrtCenterV1] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.028.964 [opp_so_manager.cc:97]618670 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.028.977 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [DecodeWheelsTarget] has registered infer func
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.028.999 [opp_so_manager.cc:97]618670 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.029.004 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.029.003 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [][]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.029.034 [opp_so_manager.cc:97]618670 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/usr/local/Ascend/ascend-toolkit/latest/opp/op_proto/custom/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.029.100 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.029.103 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.029.105 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 0 libs.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.029.109 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [SparseSoftmaxCrossEntropyWithLogits] has registered infer func
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.029.151 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.029.176 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.029.187 [opp_so_manager.cc:45]618670 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.029.196 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.029.200 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.029.200 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [KlDivLossGrad] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.029.267 [op_impl_space_registry.cc:240]618666 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.029.289 [opp_so_manager.cc:48]618666 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.029.298 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.029.302 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.029.324 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [][]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.029.336 [opp_so_manager.cc:123]618666 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.029.339 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.029.346 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [][]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.029.370 [opp_so_manager.cc:126]618666 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.029.366 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [][]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.029.405 [opp_so_manager.cc:123]618666 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.029.447 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNormGradV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.029.438 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.029.459 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.029.502 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.029.516 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.029.527 [opp_so_manager.cc:45]618666 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.029.553 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.029.556 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.029.580 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.029.582 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : []
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.029.594 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [FractionalMaxPoolGrad] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.029.631 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [FractionalAvgPool] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.029.645 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [FractionalMaxPool] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.029.661 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [DataFormatVecPermute] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.029.674 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [FractionalAvgPoolGrad] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.029.687 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [NthElement] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.029.673 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.029.676 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.029.773 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.029.778 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.029.873 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.029.875 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.029.969 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.029.971 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.029.975 [op_impl_space_registry.cc:240]618666 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.029.999 [opp_so_manager.cc:48]618666 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.030.038 [opp_so_manager.cc:123]618666 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.030.066 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.030.074 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.030.092 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.030.099 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.030.127 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.030.140 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.030.152 [opp_so_manager.cc:45]618666 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.030.190 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.030.192 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.030.195 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Tanh] has registered infer func
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.030.278 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.030.287 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.030.290 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.030.384 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.030.387 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.030.482 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.030.482 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.030.506 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.030.507 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.030.524 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Pad] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.030.551 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [PadV3] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.030.569 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [PadV3Grad] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.030.590 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [BroadcastTo] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.030.604 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.030.607 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.030.608 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.030.705 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.030.704 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.030.719 [op_impl_space_registry.cc:240]618666 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.030.740 [opp_so_manager.cc:48]618666 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.030.779 [opp_so_manager.cc:123]618666 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.030.772 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [RaggedRange] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.030.800 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.030.806 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [][]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.030.815 [opp_so_manager.cc:126]618666 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.030.849 [opp_so_manager.cc:123]618666 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.030.900 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.030.904 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : []
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.030.930 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [ShuffleChannel] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.030.937 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.030.961 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.030.973 [opp_so_manager.cc:45]618666 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.030.997 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.030.996 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.031.097 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.031.096 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.031.102 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.031.122 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.031.123 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.031.148 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.031.149 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.031.240 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.031.244 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.031.243 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [ReduceSum] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.031.269 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : []
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.031.271 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [ReduceProd] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.031.291 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.031.274 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.031.315 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : []
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.031.313 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [INInferV2] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.031.317 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : []
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.031.334 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [INInferV2] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.031.340 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.031.337 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.031.361 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.031.360 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.031.383 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.031.391 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.031.402 [op_impl_space_registry.cc:240]618666 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.031.405 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.031.413 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.031.425 [opp_so_manager.cc:48]618666 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.031.428 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.031.434 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.031.455 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.031.454 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.031.464 [opp_so_manager.cc:123]618666 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.031.477 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.031.475 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.031.497 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.031.498 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.031.519 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.031.519 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.031.540 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.031.541 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.031.556 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.031.562 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.031.563 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.031.571 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.031.584 [opp_so_manager.cc:45]618666 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.031.585 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.031.585 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.031.609 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.031.610 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.031.631 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.031.711 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SegmentSum] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.031.727 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.031.728 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SegmentSum] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.031.810 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.031.823 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.031.860 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.031.914 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.031.918 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.031.958 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [UnsortedSegmentSum] has registered infer func
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.031.978 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.032.000 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [ReverseV2] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.032.013 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.032.024 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.032.026 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Select] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.032.052 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [SegmentSum] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.032.074 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Slice] has registered infer func
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.032.095 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [OneHot] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.032.108 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.032.121 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [ScatterNd] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.032.124 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.032.130 [op_impl_space_registry.cc:240]618666 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.032.133 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.032.148 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Cumprod] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.032.152 [opp_so_manager.cc:48]618666 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.032.212 [opp_so_manager.cc:123]618666 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.032.217 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.032.210 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [CumulativeLogsumexp] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.032.252 [opp_so_manager.cc:126]618666 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.032.235 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.032.272 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [MaskedSelect] has registered infer func
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.032.286 [opp_so_manager.cc:123]618666 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.032.295 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.032.319 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UnsortedSegmentMax] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.032.339 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UnsortedSegmentMax] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.032.346 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UnsortedSegmentMin] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.032.368 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UnsortedSegmentProd] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.032.366 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UnsortedSegmentMin] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.032.378 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.032.395 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.032.390 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UnsortedSegmentProd] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.032.392 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.032.409 [opp_so_manager.cc:45]618666 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.032.416 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.032.493 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdamApplyOne] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.032.518 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdamApplyOneAssign] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.032.510 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdamApplyOne] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.032.540 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecay] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.032.549 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdamApplyOneAssign] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.032.571 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecay] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.032.563 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecayAssign] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.032.595 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecayAssign] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.032.621 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPool3DWithArgmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.032.673 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BN3DTrainingReduce] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.032.688 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BN3DTrainingReduce] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.032.698 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.032.712 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.032.720 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : []
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.032.717 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Concat] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.032.734 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.032.741 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.032.759 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.032.834 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNTrainingReduce] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.032.852 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNTrainingReduce] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.032.853 [op_impl_space_registry.cc:240]618666 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.032.875 [opp_so_manager.cc:48]618666 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.032.911 [opp_so_manager.cc:123]618666 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.032.923 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [NonDeterministicInts] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.032.937 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.032.956 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.033.000 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.033.014 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.033.026 [opp_so_manager.cc:45]618666 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.033.035 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.033.054 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.033.132 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.033.150 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.033.237 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : []
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.033.237 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [Flatten] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.033.247 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : []
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.033.269 [operator_factory_impl.cc:222]618650 RegisterInferShapeFunc:op [DepthToSpace] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.033.334 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.033.342 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.033.431 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.033.441 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.033.544 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.033.543 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [][][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.033.578 [op_impl_space_registry.cc:240]618666 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.033.599 [opp_so_manager.cc:48]618666 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.033.638 [opp_so_manager.cc:123]618666 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.033.642 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.033.640 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [][]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.033.670 [opp_so_manager.cc:126]618666 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.033.708 [opp_so_manager.cc:123]618666 LoadOpMasterSo:Get path with op_master path [/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.033.731 [opp_so_manager.cc:126]618666 LoadOpMasterSo:Get path with op_tiling path [/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.033.741 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.033.742 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : []
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.033.759 [opp_so_manager.cc:123]618666 LoadOpMasterSo:Get path with op_master path [/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.033.840 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_ct.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.033.838 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.033.838 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.033.854 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.033.909 [plugin_manager.cc:1126]618666 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.033.922 [plugin_manager.cc:1130]618666 GetFileListWithSuffix:Found 2 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.033.934 [opp_so_manager.cc:45]618666 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.033.935 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[INTrainingReduceV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.033.937 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[INTrainingReduceV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.033.981 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.031 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[EluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.034.036 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.034.037 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.034.061 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[INTrainingUpdateGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.034.062 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[INTrainingUpdateGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.067 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.034.085 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[INTrainingUpdateGradGammaBeta] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.034.084 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[INTrainingUpdateGradGammaBeta] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.034.107 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[INTrainingUpdateV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.034.107 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[INTrainingUpdateV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.121 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.161 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SyncBNTrainingUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.034.207 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.034.204 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.211 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Abs] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.245 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Real] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.274 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Acos] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.301 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Acosh] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.034.303 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.034.306 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.332 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddMatMatElements] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.376 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Adds] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.404 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Asin] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.034.404 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.034.412 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.433 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Asinh] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.460 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AssignAdd] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.488 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AssignSub] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.034.503 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.034.510 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.516 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Atan] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.543 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Atanh] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.574 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.604 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BesselI0e] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.034.608 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.034.597 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.633 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BesselI1e] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.667 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.694 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.034.702 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.034.709 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.720 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.747 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.779 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Bucketize] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.034.801 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.034.805 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.809 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Cast] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.835 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Ceil] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.862 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CeluV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.034.872 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPool3DGradWithArgmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.034.903 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPool] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.034.902 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPool] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.907 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ComplexAbs] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.944 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Cos] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.975 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Cosh] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.034.998 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.035.000 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPool3D] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.035.005 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPool3D] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.027 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DataFormatDimMap] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.060 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Dequantize] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.087 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Elu] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.035.097 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.035.109 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.120 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Erf] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.146 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Erfc] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.171 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Exp] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.196 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Expm1] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.035.206 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPoolV3] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.035.207 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPoolV3] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.228 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FakeQuantWithMinMaxVars] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.256 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FastGelu] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.284 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FastGeluV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.035.306 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.035.311 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.315 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Floor] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.351 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FusedMulAddN] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.035.402 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaximumGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.405 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HardSigmoid] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.035.405 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaximumGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.035.427 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MinimumGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.035.433 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MinimumGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.433 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HardShrink] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.471 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HardShrinkGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.497 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HardSwish] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.526 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HardSwishGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.035.530 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.035.530 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.554 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HardtanhGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.584 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IndexFillD] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.610 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.035.627 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LogSoftmaxGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.035.626 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LogSoftmaxGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.634 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.035.653 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.035.652 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.664 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Inv] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.035.677 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.035.677 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.693 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Invert] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.035.701 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftMarginLoss] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.035.700 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftMarginLoss] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.035.723 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.035.728 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.732 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Log] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.035.744 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftmaxFocalLoss] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.035.748 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftmaxFocalLoss] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.758 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Log1p] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.035.754 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.035.769 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.035.771 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.785 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LogicalNot] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.035.795 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.035.793 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.813 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LogAddExp] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.842 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LpNormUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.871 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LpNormUpdateV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.035.889 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.035.893 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.904 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Dawsn] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.035.919 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Mish] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.035.919 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Mish] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.035.928 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.935 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Expint] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.965 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Erfinv] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.035.992 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FresnelCos] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.036.013 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.036.014 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.019 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FresnelSin] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.051 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Ndtri] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.080 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Spence] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.036.095 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CTCLossV3Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.107 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Fills] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.036.110 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.036.110 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.137 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LeakyRelu] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.177 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[OnesLike] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.214 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Reciprocal] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.036.227 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.036.228 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.264 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Sign] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.294 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Sqrt] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.321 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Tanh] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.036.332 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.036.348 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.370 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ZerosLike] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.403 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Gelu] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.036.431 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.433 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GeluV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.036.449 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.465 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Relu] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.491 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Neg] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.518 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LogSoftmaxV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.545 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.036.530 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftmaxCrossEntropyWithLogits] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.036.549 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftmaxCrossEntropyWithLogits] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.576 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftmaxV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.600 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.626 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftplusV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.036.641 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.036.647 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.661 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Muls] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.036.668 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.036.671 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.695 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Power] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.720 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Relu6] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.746 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Relu6D] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.036.761 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.036.766 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.774 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Relu6Grad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.801 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.836 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Rint] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.036.860 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.865 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Round] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.036.871 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.894 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Rsqrt] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.923 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RsqrtGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.947 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Selu] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.036.957 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.036.965 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.036.981 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Shrink] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.009 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Sigmoid] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.036 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.037.057 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.062 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SigmoidGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.037.063 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.093 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Sin] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.121 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Sinh] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.037.120 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CTCLossV3] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.150 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SmoothL1Loss] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.037.158 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.037.164 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.177 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SmoothL1LossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.205 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LogSigmoid] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.231 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LogSigmoidGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.256 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LogSpaceD] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.037.258 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.037.263 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.281 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Softplus] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.037.286 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.308 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Softsign] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.334 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SqrtGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.037.358 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyAdadeltaD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.037.362 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyAdadeltaD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.363 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Square] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.037.388 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyAdagradD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.037.387 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyAdagradD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.395 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Swish] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.037.410 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyAdagradV2D] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.037.414 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyAdagradV2D] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.421 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwishGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.037.435 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyAdaMaxD] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.037.433 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyAdaMaxD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.447 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SiluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.037.457 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyAdamD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.037.456 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyAdamD] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.037.468 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3DGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.473 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardElemt] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.037.480 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.037.480 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.037.503 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.501 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Tan] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.037.504 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.037.524 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyAddSignD] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.037.527 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyAddSignD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.532 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftShrink] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.037.546 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyCenteredRMSPropD] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.037.551 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyCenteredRMSPropD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.565 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftShrinkGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.037.569 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyFtrlD] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.037.572 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyFtrlD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.037.592 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyFtrlV2D] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.593 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Threshold] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.037.595 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyFtrlV2D] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.037.616 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyGradientDescent] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.037.622 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyGradientDescent] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.623 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ThresholdV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.037.644 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyKerasMomentumD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.037.640 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyKerasMomentumD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.037.663 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyMomentumD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.661 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ThresholdV2D] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.037.662 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyMomentumD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.037.686 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyPowerSignD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.691 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Trunc] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.037.699 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyPowerSignD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.037.707 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyProximalAdagradD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.715 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.037.722 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyProximalAdagradD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.037.729 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyProximalGradientDescent] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.743 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.037.746 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyProximalGradientDescent] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.037.760 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyRMSPropD] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.037.768 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyRMSPropD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.037.783 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyAdagradDAD] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.037.791 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyAdagradDAD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.816 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MishGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.847 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HardSigmoidGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.869 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.037.881 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.037.890 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.894 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.923 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.951 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.037.964 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.037.979 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FusedMulApplyMomentum] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.037.978 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FillDiagonal] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.037.989 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FusedMulApplyMomentum] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.038.006 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FusedMulApplyKerasMomentum] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.010 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IndexPut] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.038.014 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FusedMulApplyKerasMomentum] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.038 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReadVariableOp] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.065 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CastLike] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.038.082 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.090 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FusedBiasLeakyRelu] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.038.099 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.038.113 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.119 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StatelessBernoulliV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.146 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.172 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InvertPermutation] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.195 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.038.201 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.038.196 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GeluGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.038.213 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GeluGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.222 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SearchSorted] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.245 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.268 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.291 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.038.295 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GeluGradV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.038.313 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.038.309 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GeluGradV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.315 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.343 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.038.384 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.038.382 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.038.440 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.038.484 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IsNegInf] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.482 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaskedScale] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.038.484 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IsNegInf] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.514 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AbsGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.547 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AccumulateNV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.038.567 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.573 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddN] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.038.588 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IsPosInf] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.038.587 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IsPosInf] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.600 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Eltwise] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.629 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.657 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AcosGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.683 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AcoshGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.038.688 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.038.687 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.038.692 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.709 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AsinGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.739 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AsinhGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.764 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Atan2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.038.765 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.038.766 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.789 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AtanGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.038.807 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.818 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Axpy] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.844 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BitwiseAnd] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.038.863 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.038.863 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.870 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BitwiseOr] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.899 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BitwiseXor] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.038.920 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.926 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Div] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.955 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DivNoNan] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.038.962 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.038.967 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.038.981 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[EluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.009 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FastGeluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.039.037 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.035 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FloorDiv] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.060 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FloorMod] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.039.063 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.039.065 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.086 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InvGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.113 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LeakyReluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.140 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TanhGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.039.165 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.039.164 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.039.163 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.175 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Add] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.202 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Addcdiv] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.227 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Addcmul] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.256 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AxpyV2] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.039.265 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReluV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.039.265 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReluV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.282 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LogicalAnd] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.310 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LogicalOr] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.039.325 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PadV3GradReplication] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.342 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Mul] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.039.362 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.039.365 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.371 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Pow] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.401 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RealDiv] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.433 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ClipByNormNoDivSum] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.039.445 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.459 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ClipByValue] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.039.463 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.039.466 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.485 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ClipByValueV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.512 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FusedMulAdd] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.543 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftmaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.039.565 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.039.568 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Cummax] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.039.566 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Cummax] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.572 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Sub] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.039.592 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.039.592 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.600 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Gcd] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.630 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LarsV2Update] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.655 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaskedFill] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.681 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.039.688 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.039.690 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.706 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Xlog1py] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.737 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApproximateEqual] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.039.761 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.762 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Equal] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.039.787 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.795 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NotEqual] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.039.803 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.825 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Greater] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.852 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GreaterEqual] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.039.886 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.884 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Less] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.039.888 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.039.902 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.910 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LessEqual] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.941 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Maximum] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.039.968 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Minimum] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.039.989 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Col2ImV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.040.005 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.040.001 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Col2ImV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.040.016 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Mod] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.040.041 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.040.068 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MulNoNan] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.040.094 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReciprocalGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.040.098 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.040.098 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.040.120 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SeluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.040.124 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.040.124 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.040.123 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.040.148 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogits] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.040.194 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftplusGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.040.223 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftplusV2Grad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.040.248 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftsignGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.040.244 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.040.243 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.040.277 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SquaredDifference] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.040.290 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.040.301 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.040.330 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ThresholdGradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.040.346 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.040.349 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.040.356 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TruncateDiv] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.040.381 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TruncateMod] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.040.410 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Xdivy] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.040.441 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IsClose] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.040.451 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.040.450 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.040.470 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.040.471 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Xlogy] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.040.498 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.040.524 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SelectV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.040.549 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.040.556 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.040.568 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaskedSelectV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.040.592 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.040.596 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Lerp] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.040.635 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FusedBiasLeakyReluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.040.648 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.040.652 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.040.711 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.040.738 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.040.755 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2d] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.040.753 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2d] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.040.767 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.040.853 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.040.853 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.040.886 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.040.927 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.040.957 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.040.957 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.040.997 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.041.048 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.041.054 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.041.056 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.041.111 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.041.153 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.041.152 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.041.172 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.041.249 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.041.253 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.041.253 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.041.277 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.041.314 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.041.340 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.041.353 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.041.354 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaskedSelect] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.041.357 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaskedSelect] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.041.456 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.041.459 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.041.471 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.041.481 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.041.473 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.041.483 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.041.580 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.041.582 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.041.580 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.041.648 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.041.681 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.041.683 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.041.717 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.041.768 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.041.783 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.041.781 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.041.843 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.041.888 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.041.890 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.041.890 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.041.952 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.041.992 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.041.993 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.042.008 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.042.035 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.042.088 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.042.092 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.042.091 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.042.148 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.042.174 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.042.191 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.042.204 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.042.211 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Quantize] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.042.239 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.042.268 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AscendDequant] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.042.293 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.042.296 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.042.302 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.042.310 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.042.394 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.042.394 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.042.402 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.042.430 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.042.457 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.042.492 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RNNTLoss] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.042.493 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RNNTLoss] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.042.522 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.042.553 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.042.580 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.042.581 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.042.599 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MultinomialWithReplacement] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.042.602 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MultinomialWithReplacement] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.042.620 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.042.644 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.042.695 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.042.697 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BasicLSTMInplaceFillWindowCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.042.704 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.042.704 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.042.725 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BasicGRUInplaceFillWindowCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.042.731 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.042.730 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.042.817 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.042.828 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StatelessBernoulli] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.042.833 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StatelessBernoulli] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.042.851 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.042.928 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.042.929 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.042.965 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.043.000 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.043.032 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.043.031 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.043.095 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.043.123 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.043.129 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.043.129 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.043.209 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.043.230 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UniqueConsecutive] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.043.230 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UniqueConsecutive] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.043.238 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.043.324 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GridSampler2DGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.043.331 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UniqueWithCountsAndSorting] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.043.331 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UniqueWithCountsAndSorting] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.043.363 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdaCast] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.043.427 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[WarpAffine] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.043.431 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[WarpAffine] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.043.475 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GridSampler3DGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.043.470 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.043.497 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.043.522 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.043.528 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Histogram] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.043.527 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Histogram] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.043.545 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.043.628 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.043.630 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.043.651 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.043.654 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.043.726 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.043.727 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.043.776 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.043.831 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Unique] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.043.831 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Unique] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.043.842 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.043.887 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.043.930 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UniqueWithCounts] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.043.935 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UniqueWithCounts] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.044.002 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.044.027 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PadV4Grad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.044.029 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Dot] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.044.029 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.044.032 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Dot] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.044.132 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.044.136 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.044.144 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.044.229 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PadV3GradReplicate] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.044.246 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.044.250 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.044.284 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.044.332 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.044.350 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.044.350 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.044.351 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.044.376 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.044.378 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.044.446 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.044.477 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardReduce] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.044.478 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardReduce] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.044.481 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.044.574 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStatsWithCounts] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.044.583 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.044.575 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStatsWithCounts] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.044.606 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.044.681 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.044.688 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.044.694 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.044.707 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.044.713 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.044.720 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.044.735 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.044.746 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.044.731 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.044.760 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.044.766 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.044.787 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.044.784 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.044.806 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.044.806 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.044.804 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.044.828 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.044.828 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.044.831 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.044.851 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.044.850 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.044.875 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.044.876 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.044.940 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.044.946 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[L2Loss] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.044.969 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.044.975 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.044.995 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.044.998 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.045.018 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.045.019 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.045.056 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.045.057 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.045.115 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.045.118 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.045.178 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.045.178 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.045.219 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.045.218 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.045.290 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.045.298 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.045.314 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.045.315 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.045.400 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.045.416 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.045.414 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.045.415 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.045.507 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.045.515 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.045.515 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.045.534 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.045.540 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.045.539 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.045.540 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceAny] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.045.563 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.045.564 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.045.571 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceAll] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.045.605 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceMax] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.045.628 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.045.646 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.045.656 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceMeanWithCast] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.045.663 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.045.673 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.045.667 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.045.682 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceMin] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.045.708 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceProd] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.045.734 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.045.764 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[EuclideanNorm] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.045.763 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.045.765 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.045.790 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.045.790 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.045.796 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.045.792 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceLogSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.045.821 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceLogSumExp] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.045.885 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.045.886 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.045.928 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceNansum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.045.986 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.045.989 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.046.029 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.046.049 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.046.083 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.046.089 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.046.083 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.046.116 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.046.141 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.046.165 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.046.188 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.046.187 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.046.199 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.046.215 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.046.222 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.046.238 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.046.245 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.046.269 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.046.262 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.046.313 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.046.367 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.046.370 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.046.392 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.046.393 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.046.415 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.046.417 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.046.423 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.046.514 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.046.515 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.046.534 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.046.539 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.046.537 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.046.562 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.046.563 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.046.562 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.046.654 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.046.655 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.046.677 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.046.678 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.046.678 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.046.699 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.046.702 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.046.725 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.046.724 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.046.786 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [InferShape][InferShapeRange][InferDataType][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.046.819 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SplitD] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.046.819 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.046.819 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.046.843 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.046.926 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.046.926 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.046.969 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.047.026 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.047.027 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.047.051 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.047.051 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.047.073 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.047.071 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.047.080 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.047.169 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.047.168 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.047.192 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.047.194 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.047.200 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.047.289 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.047.295 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.047.307 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.047.338 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.047.341 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.047.389 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.047.387 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.047.420 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.047.490 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.047.488 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.047.516 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.047.517 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.047.532 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.047.538 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.047.549 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.047.639 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.047.644 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.047.652 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.047.665 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.047.667 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.047.689 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.047.687 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.047.765 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.047.787 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.047.789 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.047.887 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.047.887 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.047.876 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.047.988 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.047.984 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.047.999 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.048.084 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.048.086 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.048.118 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.048.132 [op_impl_registry_holder_manager.cc:208]618666 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 1
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.048.149 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.048.197 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.048.204 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.048.207 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.048.205 [op_impl_registry_holder_manager.cc:208]618666 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 1
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.048.242 [op_impl_registry_holder_manager.cc:208]618666 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 11
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.048.312 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.048.313 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.048.363 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.048.414 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.048.416 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.048.477 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.048.506 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.048.517 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.048.517 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.048.611 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.048.618 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2dAssistMatrix] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.048.619 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2dAssistMatrix] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.048.719 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.048.719 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.048.720 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.048.821 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.048.823 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.048.830 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.048.919 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.048.919 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.048.936 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.049.019 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.049.019 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.049.056 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.049.083 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.049.122 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Cdist] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.049.121 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Cdist] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.049.198 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.049.216 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CdistGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.049.218 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CdistGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.049.318 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.049.316 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.049.325 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.049.349 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.049.350 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.049.371 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.049.372 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.049.430 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.049.466 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.049.470 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.049.491 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.049.495 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.049.514 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.049.516 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.049.541 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.049.568 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.049.611 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.049.613 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.049.674 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.049.712 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.049.723 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.049.788 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.049.810 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.049.819 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.049.826 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.049.903 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.049.917 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GlobalLpPool] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.049.918 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GlobalLpPool] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.050.012 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.050.018 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GLU] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.050.018 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GLU] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.050.033 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.050.122 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GLUGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.050.120 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GLUGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.050.117 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.050.217 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.050.221 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.050.246 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.050.276 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.050.278 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.050.303 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.050.317 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.050.317 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.050.419 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LpLoss] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.050.424 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LpLoss] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.050.427 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.050.454 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.050.479 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.050.503 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.050.523 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LpNorm] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.050.524 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LpNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.050.528 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.050.550 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.050.550 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.050.553 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.050.576 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.050.576 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.050.577 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.050.601 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.050.602 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.050.603 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.050.609 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.050.626 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.050.648 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.050.669 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.050.690 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.050.701 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MinAreaPolygons] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.050.701 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MinAreaPolygons] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.050.712 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.050.735 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.050.760 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.050.781 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.050.784 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.050.798 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.050.800 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.050.806 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.050.896 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.050.899 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.050.912 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SegmentSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.050.940 [op_impl_space_registry.cc:273]618666 ConvertSoToRegistry:Save so symbol and handle in path[/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_ct.so] success!
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.050.950 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.050.995 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.050.995 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.051.029 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.051.093 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.051.095 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.051.139 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.051.199 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.051.197 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.051.259 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.051.294 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.051.294 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.051.370 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.051.393 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.051.394 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.051.497 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.051.500 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.051.502 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.051.596 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.051.596 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.051.617 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UnsortedSegmentMax] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.051.648 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UnsortedSegmentMin] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.051.677 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UnsortedSegmentProd] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.051.694 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.051.696 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.051.701 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.051.782 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.051.798 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.051.796 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.051.815 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdamApplyOne] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.051.845 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdamApplyOneAssign] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.051.873 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecay] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.051.894 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.051.897 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.051.900 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecayAssign] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.051.944 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.051.995 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.051.994 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.052.012 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BN3DTrainingReduce] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.052.039 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.052.063 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.052.074 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.052.086 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.052.091 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.052.106 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.052.203 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNTrainingReduce] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.052.208 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.052.221 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.052.256 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyAdamWV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.052.315 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.052.326 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.052.320 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.052.420 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.052.418 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.052.429 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.052.437 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.052.519 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.052.529 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.052.549 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.052.557 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.052.622 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.052.624 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.052.654 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.052.702 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.052.720 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.052.724 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.052.765 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.052.817 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.052.817 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.052.850 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.052.872 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.052.916 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.052.915 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.053.009 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.053.018 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.053.019 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.053.019 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.053.117 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.053.121 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.053.138 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.053.145 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.053.217 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.053.219 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.053.241 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.053.242 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.053.247 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.053.267 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.053.334 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotatedNMS] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.053.335 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotatedNMS] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.053.341 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.053.373 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.053.438 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.053.438 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.053.487 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[INTrainingReduceV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.053.539 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.053.544 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.053.603 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.053.634 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.053.633 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[INTrainingUpdateGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.053.639 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SilentCheck] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.053.639 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SilentCheck] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.053.664 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.053.662 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[INTrainingUpdateGradGammaBeta] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.053.692 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.053.692 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[INTrainingUpdateV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.053.714 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.053.736 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.053.746 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.053.746 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.053.757 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.053.785 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.053.797 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.053.807 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.053.830 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.053.851 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.053.846 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.053.847 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.053.880 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.053.901 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.053.906 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.053.922 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.053.944 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.053.943 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3d] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.053.943 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3d] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.053.971 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.053.992 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.013 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.054.020 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.034 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.054.045 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.054.045 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.057 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.081 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.103 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.123 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.054.128 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.144 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.054.144 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.054.151 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.166 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.189 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.209 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.231 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.054.239 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.251 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.054.249 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ActiveRotatedFilter] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.054.254 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ActiveRotatedFilter] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.275 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.296 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.316 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.336 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.054.349 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ActiveRotatedFilterGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.054.351 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ActiveRotatedFilterGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.359 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.054.353 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.383 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.403 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.424 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.451 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.054.447 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.054.446 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.054.462 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.477 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.499 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.524 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.545 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.054.551 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.565 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.054.563 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.054.578 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPool] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.588 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.610 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.631 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.651 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.054.659 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.054.660 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.671 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.694 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.714 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.054.703 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPool3D] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.736 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.758 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.054.762 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.778 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.054.763 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.800 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.821 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.054.818 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.841 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.054.862 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.054.876 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.054.876 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.054.939 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPoolV3] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.054.973 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.054.973 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.055.015 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachACosInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.055.045 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.055.072 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.055.074 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.055.159 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.055.158 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaximumGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.055.175 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PSAMask] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.055.173 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PSAMask] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.055.191 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MinimumGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.055.270 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PSAMaskGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.055.276 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PSAMaskGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.055.321 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMulScalarInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.055.338 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.055.354 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachLogInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.055.379 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSubListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.055.372 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.055.374 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.055.403 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMulListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.055.425 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachDivListInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.055.472 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.055.475 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.055.464 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LogSoftmaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.055.508 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.055.533 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.055.563 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSubScalarInplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.055.562 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftMarginLoss] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.055.572 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.055.573 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.055.587 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.055.614 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftmaxFocalLoss] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.055.637 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.055.660 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.055.670 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.055.671 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.055.671 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.055.770 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.055.778 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.055.772 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.055.773 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.055.804 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Mish] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.055.875 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ThreeNN] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.055.874 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ThreeNN] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.055.886 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.055.923 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.055.977 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Voxelization] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.055.984 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Voxelization] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.056.001 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.056.029 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.056.095 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.056.095 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.056.109 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.056.124 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.056.125 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.056.135 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.056.152 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.056.151 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.056.200 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.056.203 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.056.230 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.056.231 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.056.256 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [][][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.056.259 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.056.258 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.056.271 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.056.283 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.056.283 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.056.309 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [][][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.056.310 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [][][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.056.335 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : [][][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.056.335 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : [][][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.056.361 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.056.359 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.056.376 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsV2] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.056.383 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.056.387 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.056.397 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.056.405 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.056.420 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.056.442 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.056.432 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.056.469 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CompressFcOp] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.056.469 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CompressFcOp] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.056.493 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.056.491 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.056.498 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftmaxCrossEntropyWithLogits] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.056.543 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.056.593 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.056.595 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.056.569 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.056.612 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.056.642 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.056.659 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.056.699 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.056.695 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.056.697 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.056.748 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.056.778 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.056.793 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.056.799 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.056.805 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.056.833 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.056.865 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.056.894 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.056.895 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.056.893 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.056.941 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.056.966 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.056.976 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.056.989 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.056.982 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.056.997 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.057.000 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.057.092 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.057.086 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.057.095 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMatMulV4] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.057.098 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMatMulV4] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.057.129 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.057.196 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.057.200 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.057.208 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.057.243 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.057.281 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.057.280 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.057.275 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.057.306 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.057.309 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.057.315 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.057.403 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.057.403 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.057.406 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.057.453 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyAdadeltaD] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.057.484 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.057.506 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.057.506 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.057.513 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyAdagradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.057.540 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyAdaMaxD] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.057.556 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.057.566 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyAdamD] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.057.594 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradD] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.057.604 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.057.609 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.057.621 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.057.649 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyAddSignD] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.057.677 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyCenteredRMSPropD] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.057.691 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.057.703 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ResizeTrilinear] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.057.704 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyFtrlD] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.057.706 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ResizeTrilinear] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.057.732 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyFtrlV2D] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.057.760 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyGradientDescent] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.057.785 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyKerasMomentumD] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.057.805 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.057.811 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.057.813 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyMomentumD] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.057.840 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyPowerSignD] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.057.866 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyProximalAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.057.872 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IndexPutWithSort] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.057.892 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyProximalGradientDescent] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.057.908 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.057.910 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.057.918 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyRMSPropD] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.057.937 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.057.936 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.057.944 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyAdagradDAD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.057.939 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.057.961 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.057.961 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.057.983 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.057.984 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.057.995 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.058.005 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.058.009 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.058.035 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.058.056 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.062 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.115 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[EluGradV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.058.129 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.136 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.157 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.058.159 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.058.134 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.058.168 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FusedMulApplyMomentum] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.058.177 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InplaceIndexAddWithSorted] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.179 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SyncBNTrainingUpdate] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.058.187 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.058.186 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.200 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Abs] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.058.203 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FusedMulApplyKerasMomentum] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.058.214 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.220 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Real] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.058.214 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.239 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Acos] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.058.245 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.058.251 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.260 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Acosh] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.058.272 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.058.277 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [][][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.279 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddMatMatElements] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.058.287 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.300 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Adds] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.058.299 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [][][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.058.304 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.058.296 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.320 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Asin] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.336 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Asinh] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.058.321 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.058.329 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.058.328 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [][][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.353 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AssignAdd] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.058.351 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.058.352 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [][][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.372 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AssignSub] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.058.374 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.058.381 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.392 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Atan] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.058.387 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MlaAttentionScore] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.058.399 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.058.401 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [][][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.058.406 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.411 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Atanh] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.058.425 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.058.427 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.430 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.058.431 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.058.447 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.450 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BesselI0e] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.058.449 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.058.431 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GeluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.058.458 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.470 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BesselI1e] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.058.481 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.058.486 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.489 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.510 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.058.508 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.058.515 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.528 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.058.538 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.058.542 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.547 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.058.551 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.058.567 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.058.563 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GeluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.058.569 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.567 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Bucketize] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.058.592 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.058.597 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.058.605 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.606 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Cast] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.058.622 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.627 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Ceil] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.646 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CeluV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.058.654 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.663 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ComplexAbs] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.058.665 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.682 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Cos] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.058.698 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.704 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Cosh] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.723 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.743 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DataFormatDimMap] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.762 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Dequantize] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.058.762 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IsNegInf] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.058.767 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.058.770 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ActULQClampMaxGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.781 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Elu] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.058.795 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ActULQClampMinGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.800 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Erf] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.058.802 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ActULQClampMaxGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.058.802 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.820 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Erfc] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.058.827 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ActULQClampMinGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.838 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Exp] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.857 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Expm1] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.876 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FakeQuantWithMinMaxVars] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.058.873 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IsPosInf] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.058.891 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ActsULQ] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.895 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FastGelu] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.058.914 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.918 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FastGeluV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.058.920 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ActsULQ] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.935 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Floor] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.955 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FusedMulAddN] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.973 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HardSigmoid] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.058.967 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.058.993 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HardShrink] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.058.998 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.059.000 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ActsULQInputGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.012 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HardShrinkGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.059.015 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ActsULQInputGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.032 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HardSwish] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.051 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HardSwishGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.059.060 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.069 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HardtanhGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.088 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IndexFillD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.059.102 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.059.107 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.107 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.059.116 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.135 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.155 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Inv] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.175 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Invert] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.194 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Log] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.210 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Log1p] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.059.211 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.059.211 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.059.222 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.229 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LogicalNot] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.059.241 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.248 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LogAddExp] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.267 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LpNormUpdate] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.285 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LpNormUpdateV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.304 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Dawsn] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.059.313 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdaptiveAvgPoolAssistMatrix] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.323 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Expint] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.059.332 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.059.321 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdaptiveAvgPoolAssistMatrix] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.342 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Erfinv] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.361 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FresnelCos] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.377 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FresnelSin] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.059.384 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.395 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Ndtri] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.059.397 [op_tiling_manager.cc:79]618654 LoadSo:dlopen file /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so successfully!
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.059.413 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.414 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Spence] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.435 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Fills] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.059.430 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.059.439 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.453 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LeakyRelu] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.059.457 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.059.461 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.473 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[OnesLike] register OP_IMPL : []
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.059.468 [op_tiling_manager.cc:58]618654 LoadSo:[FindSo][Check] Get path with op_master [/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_master/] failed
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.492 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Reciprocal] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.059.496 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.511 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Sign] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.531 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Sqrt] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.059.535 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.549 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Tanh] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.059.551 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.569 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ZerosLike] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.059.570 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.585 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Gelu] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.604 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GeluV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.622 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Relu] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.646 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Neg] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.059.651 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.059.651 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.059.651 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.665 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LogSoftmaxV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.684 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.059.694 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReluV2] register OP_IMPL : [InferShape]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.059.694 [op_tiling_manager.cc:67]618654 LoadSo:Failed to dlopen /usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.702 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.723 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.741 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftplusV2] register OP_IMPL : []
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.059.745 [op_tiling_manager.cc:73]618654 LoadSo:Failed to dlopen /usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.059.751 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.757 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Muls] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.059.753 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.776 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Power] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.795 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Relu6] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.059.809 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.814 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Relu6D] register OP_IMPL : []
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.059.810 [op_tiling_manager.cc:58]618654 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.059.812 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.834 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Relu6Grad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.853 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReluGradV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.059.852 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.059.855 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.871 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Rint] register OP_IMPL : []
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.059.871 [op_tiling_manager.cc:67]618654 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.059.879 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.059.881 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.891 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Round] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.910 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Rsqrt] register OP_IMPL : []
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.059.916 [op_tiling_manager.cc:73]618654 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.926 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RsqrtGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.059.930 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.945 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Selu] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.963 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Shrink] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.059.974 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.059.974 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.059.961 [op_tiling_manager.cc:58]618654 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.059.982 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Sigmoid] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.059.991 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.001 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.019 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SigmoidGrad] register OP_IMPL : []
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.060.026 [op_tiling_manager.cc:67]618654 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.039 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Sin] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.060.051 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Cummax] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.057 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Sinh] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.060.070 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.060.071 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.077 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SmoothL1Loss] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.094 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SmoothL1LossGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.060.077 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.060.114 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.110 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LogSigmoid] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.136 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LogSigmoidGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.060.188 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.060.190 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.206 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LogSpaceD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.233 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Softplus] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.060.223 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.060.240 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.253 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Softsign] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.274 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SqrtGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.293 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Square] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.060.290 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.060.297 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.312 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Swish] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.331 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwishGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.060.337 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.060.353 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.354 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SiluGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.060.370 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.376 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardElemt] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.060.374 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.397 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Tan] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.416 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftShrink] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.437 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftShrinkGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.060.452 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.060.453 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.457 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Threshold] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.060.457 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.060.472 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.482 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ThresholdV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.505 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ThresholdV2D] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.525 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Trunc] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.546 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.060.553 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AvgPoolUpdate] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.060.554 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AvgPoolUpdate] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.567 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.060.565 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Col2ImV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.588 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MishGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.060.593 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.608 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HardSigmoidGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.630 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.653 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.060.652 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.060.652 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.674 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.060.677 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.694 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.060.706 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.713 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FillDiagonal] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.060.742 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.733 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IndexPut] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.060.758 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.060.756 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.764 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReadVariableOp] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.785 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CastLike] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.808 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FusedBiasLeakyRelu] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.060.817 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.833 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StatelessBernoulliV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.854 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.060.863 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Bitcast] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.060.863 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Bitcast] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.875 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InvertPermutation] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.060.896 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.895 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.915 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SearchSorted] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.938 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.060.923 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.958 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.060.968 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.060.967 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.060.983 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.061.005 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Resize] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.004 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.025 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.061.042 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.061.042 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.061.053 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.061.047 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:AllFinite, funcPointer:(nil), registered count:2
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.061.084 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:AllFinite, funcPointer:(nil), registered count:4
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.061.112 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:AllFinite, funcPointer:(nil), registered count:1
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.061.120 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.061.121 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.061.122 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.129 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaskedScale] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.061.134 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:AllFinite, funcPointer:(nil), registered count:1
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.156 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AbsGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.061.161 [op_check.cc:71]618654 RegisterParamGeneralize:RegisterParamGeneralize: op_type:AllFinite, funcPointer:(nil), registered count:1
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.061.167 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.179 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AccumulateNV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.200 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddN] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.061.200 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.061.206 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.221 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Eltwise] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.061.232 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.243 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.268 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AcosGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.061.277 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.289 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AcoshGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.061.302 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CTCLoss] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.061.307 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CTCLoss] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.310 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AsinGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.332 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AsinhGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.061.347 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.354 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Atan2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.376 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AtanGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.061.390 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2d] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.396 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Axpy] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.061.411 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.061.412 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.422 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BitwiseAnd] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.443 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BitwiseOr] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.061.454 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.465 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BitwiseXor] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.486 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Div] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.506 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DivNoNan] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.061.499 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff2c2339b0, registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.061.511 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.061.511 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.526 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[EluGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.061.523 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.061.529 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:5
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.548 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FastGeluGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.061.552 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:2
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.570 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FloorDiv] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.061.572 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:2
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.061.589 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.594 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FloorMod] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.061.593 [op_check.cc:71]618654 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:2
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.061.589 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.617 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InvGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.061.630 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.642 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LeakyReluGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.663 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TanhGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.685 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Add] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.061.689 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DropOutGenMask] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.705 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Addcdiv] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.061.705 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DropOutGenMask] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.061.717 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StatelessDropOutGenMask] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.726 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Addcmul] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.061.731 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StatelessDropOutGenMask] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.749 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AxpyV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.061.748 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.770 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LogicalAnd] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.792 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LogicalOr] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.814 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Mul] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.061.822 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.061.817 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.834 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Pow] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.855 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RealDiv] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.061.862 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.061.872 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.879 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ClipByNormNoDivSum] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.900 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ClipByValue] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.922 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ClipByValueV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.061.916 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff2c236da0, registered count:4
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.061.924 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.061.928 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.943 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FusedMulAdd] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.061.944 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.965 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftmaxGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.061.966 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.061.969 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.061.988 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.061.986 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Sub] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.062.011 [op_check.cc:71]618654 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.016 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Gcd] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.062.031 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.062.034 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.038 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LarsV2Update] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.064 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaskedFill] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.086 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReluGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.062.083 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaskedSelect] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.106 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Xlog1py] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.127 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApproximateEqual] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.062.128 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.062.128 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.147 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Equal] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.169 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NotEqual] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.189 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Greater] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.062.197 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.212 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GreaterEqual] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.062.223 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.062.226 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ExpandDims] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.062.227 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ExpandDims] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.232 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Less] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.253 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LessEqual] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.271 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Maximum] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.296 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Minimum] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.062.309 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.316 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Mod] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.062.326 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.062.324 [op_tiling_manager.cc:75]618654 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.062.333 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.062.334 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.340 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.361 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MulNoNan] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.379 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReciprocalGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.396 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SeluGrad] register OP_IMPL : []
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.062.385 [op_tiling_manager.cc:58]618654 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.417 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogits] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.062.420 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.062.428 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FillWindowCache] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.062.434 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FillWindowCache] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.437 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftplusGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.062.450 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.464 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftplusV2Grad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.485 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftsignGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.505 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SquaredDifference] register OP_IMPL : []
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.062.501 [op_tiling_manager.cc:67]618654 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.526 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.062.530 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.062.528 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.062.532 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.062.559 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.548 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ThresholdGradV2D] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.062.561 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.577 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TruncateDiv] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.596 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TruncateMod] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.617 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Xdivy] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.062.631 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FlattenV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.062.631 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FlattenV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.638 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IsClose] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.659 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Xlogy] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.062.672 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.680 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.062.685 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.700 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SelectV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.720 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaskedSelectV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.062.733 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GatherShapes] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.062.733 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GatherShapes] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.743 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Lerp] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.764 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FusedBiasLeakyReluGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.062.784 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.062.796 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.062.829 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GaussianBlur] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.062.832 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GaussianBlur] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.865 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.062.890 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.062.913 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.062.937 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FileConstant] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.062.938 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FileConstant] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.062.965 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StatelessIf] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.062.965 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.062.970 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StatelessIf] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.062.991 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[If] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.062.993 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[If] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.063.006 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.063.014 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[_If] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.063.015 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[_If] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.063.038 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Case] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.063.039 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Case] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.063.038 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.063.076 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.063.083 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ConstPlaceHolder] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.063.082 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ConstPlaceHolder] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.063.118 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.063.150 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.063.172 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.063.183 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.063.186 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.063.229 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.063.259 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.063.281 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.063.287 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.063.287 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.063.315 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.063.307 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff2c1ed2c0, registered count:4
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.063.341 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.063.347 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.063.340 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.063.360 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Identity] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.063.364 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.063.361 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Identity] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.063.365 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.063.370 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RNNTLoss] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.063.383 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.063.386 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MemcpyAsync] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.063.391 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MemcpyAsync] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.063.403 [op_check.cc:71]618654 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.063.409 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IdentityN] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.063.414 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IdentityN] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.063.454 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.063.467 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.063.480 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MultinomialWithReplacement] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.063.508 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.063.509 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.063.571 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.063.605 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.063.603 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.063.608 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.063.613 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.063.630 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.063.674 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.063.708 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.063.715 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.063.719 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.063.740 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff2c1f1978, registered count:4
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.063.751 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StatelessBernoulli] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.063.767 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.063.777 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.063.788 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.063.809 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.063.809 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.063.813 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.063.829 [op_check.cc:71]618654 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.063.837 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.063.861 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.063.878 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.063.912 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.063.909 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.063.973 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.063.983 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.064.010 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.064.020 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.064.018 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.064.041 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.064.038 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.064.063 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.064.062 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.064.083 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Quantize] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.064.082 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.064.111 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.064.134 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.064.134 [op_tiling_manager.cc:75]618654 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.064.145 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AscendDequant] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.064.207 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : []
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.064.207 [op_tiling_manager.cc:58]618654 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.064.209 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UniqueConsecutive] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.064.216 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.064.216 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.064.245 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.064.246 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.064.268 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.064.298 [op_tiling_manager.cc:67]618654 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.064.317 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.064.326 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.064.324 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.064.335 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UniqueWithCountsAndSorting] register OP_IMPL : [InferShape][InferShapeRange]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.064.353 [op_tiling_manager.cc:73]618654 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.064.376 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.064.408 [op_tiling_manager.cc:58]618654 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.064.426 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.064.427 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.064.431 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.064.452 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.064.461 [op_tiling_manager.cc:67]618654 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.064.475 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.064.497 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.064.498 [op_tiling_manager.cc:75]618654 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.064.510 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[WarpAffine] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.064.517 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.064.526 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.064.529 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.064.540 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BasicLSTMInplaceFillWindowCache] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.064.539 [op_tiling_manager.cc:58]618654 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.064.560 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BasicGRUInplaceFillWindowCache] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.064.565 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.064.584 [op_tiling_manager.cc:67]618654 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.064.619 [op_tiling_manager.cc:75]618654 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.064.629 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.064.629 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.064.635 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Histogram] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.064.658 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : []
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.064.659 [op_tiling_manager.cc:58]618654 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.064.702 [op_tiling_manager.cc:67]618654 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.064.727 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.064.735 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.064.727 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : []
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.064.741 [op_tiling_manager.cc:73]618654 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.064.744 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.064.756 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.064.781 [op_tiling_manager.cc:58]618654 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.064.826 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.064.827 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.064.831 [op_tiling_manager.cc:67]618654 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.064.849 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RoiPoolingGradWithArgMax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.064.857 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.064.864 [op_tiling_manager.cc:75]618654 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.064.864 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.064.905 [op_tiling_manager.cc:58]618654 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.064.930 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.064.929 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.064.946 [op_tiling_manager.cc:67]618654 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.064.956 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.064.969 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.064.979 [op_tiling_manager.cc:75]618654 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.064.982 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Unique] register OP_IMPL : [InferShapeRange]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.064.994 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : []
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.065.018 [op_tiling_manager.cc:58]618654 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.065.025 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RandomChoiceWithMask] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.065.027 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RandomChoiceWithMask] register OP_IMPL : []
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.065.058 [op_tiling_manager.cc:67]618654 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.065.069 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.065.094 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdaCast] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.065.097 [op_tiling_manager.cc:73]618654 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.065.101 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UniqueWithCounts] register OP_IMPL : [InferShapeRange]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.065.121 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RandomUniform] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.065.121 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RandomUniform] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.065.137 [op_tiling_manager.cc:58]618654 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.065.176 [op_tiling_manager.cc:67]618654 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.065.189 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.065.195 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Rank] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.065.199 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.065.200 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Rank] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.065.208 [op_tiling_manager.cc:75]618654 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.065.221 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Size] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.065.219 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Dot] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.065.227 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Size] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.065.229 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.065.252 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : []
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.065.257 [op_tiling_manager.cc:58]618654 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.065.273 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.065.297 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.065.300 [op_tiling_manager.cc:67]618654 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.065.321 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.065.322 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.065.329 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.065.333 [op_tiling_manager.cc:75]618654 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.065.365 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.065.373 [op_tiling_manager.cc:58]618654 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.065.406 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.065.412 [op_tiling_manager.cc:67]618654 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.065.421 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Reshape] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.065.427 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Reshape] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.065.435 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : [InferShape]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.065.452 [op_tiling_manager.cc:73]618654 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.065.462 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.065.490 [op_tiling_manager.cc:58]618654 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.065.520 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.065.525 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RgbToGrayscale] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.065.530 [op_tiling_manager.cc:67]618654 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.065.532 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RgbToGrayscale] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.065.545 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.065.562 [op_tiling_manager.cc:75]618654 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.065.570 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.065.572 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : [InferShape]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.065.601 [op_tiling_manager.cc:58]618654 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.065.625 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.065.630 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.065.646 [op_tiling_manager.cc:67]618654 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.065.664 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StackBallQuery] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.065.665 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.065.690 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.065.689 [op_tiling_manager.cc:75]618654 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.065.690 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardReduce] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.065.711 [op_tiling_manager.cc:109]618654 ~FuncPerfScope:[GEPERFTRACE] The time cost of OpTilingManager::LoadSo is [195772] micro seconds.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.065.724 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.065.725 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.065.776 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.065.788 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.065.806 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStatsWithCounts] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.065.823 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.065.823 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.065.852 [plugin_manager.cc:639]618654 GetConstantFoldingOpsPath:Enter GetConstantFoldingOpsPath schedule
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.065.874 [plugin_manager.cc:108]618654 GetOppPath:Enter get opp path schedule
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.065.891 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.065.903 [plugin_manager.cc:117]618654 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.065.916 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.065.921 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.065.929 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.065.929 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Rotate] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.065.932 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Rotate] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.065.952 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.065.978 [host_cpu_engine.cc:254]618654 LoadLib:To invoke dlopen on lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libconstant_folding_ops.so
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.065.990 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.066.008 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Shape] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.066.007 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Shape] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.066.017 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.066.020 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.066.033 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ShapeN] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.066.034 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ShapeN] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.066.043 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.066.068 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.066.093 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.066.116 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.066.121 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.066.136 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SilentCheckV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.066.139 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.066.133 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SilentCheckV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.066.174 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScoreGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.066.217 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.066.236 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SilentCheckV3] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.066.243 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SilentCheckV3] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.066.243 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.066.273 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.066.296 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.066.316 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.066.336 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.066.338 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.066.341 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.066.355 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.066.398 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.066.437 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.066.441 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[L2Loss] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.066.444 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.066.515 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.066.538 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyAdadelta] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.066.542 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.066.551 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.066.553 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyAdadelta] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.066.571 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyAdadeltaD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.066.579 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyAdadeltaD] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.066.596 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyAdagradD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.066.600 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyAdagradD] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.066.619 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyAdagrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.066.620 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyAdagrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.066.625 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.066.642 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.066.641 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.066.642 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.066.665 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagradD] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.066.669 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagradD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.066.686 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.066.690 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.066.710 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2D] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.066.710 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2D] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.066.721 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.066.732 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.066.731 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.066.732 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.066.742 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.066.753 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.066.754 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.066.776 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.066.776 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.066.798 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2D] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.066.798 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2D] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.066.818 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyRMSProp] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.066.818 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyRMSProp] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.066.838 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.066.840 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyRMSPropD] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.066.841 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyRMSPropD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.066.845 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.066.873 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.066.896 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.066.934 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.066.940 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseFillEmptyRows] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.066.939 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.066.940 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseFillEmptyRows] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.066.965 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceAny] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.066.985 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceAll] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.067.007 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceMax] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.067.005 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.067.028 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.067.042 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.067.042 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.067.051 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceMeanWithCast] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.067.075 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceMin] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.067.096 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceProd] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.067.117 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceSum] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.067.114 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.067.138 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[EuclideanNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.067.142 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.067.147 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.067.143 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Squeeze] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.067.142 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Squeeze] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.067.161 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceLogSum] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.067.168 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SqueezeV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.067.173 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SqueezeV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.067.183 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceLogSumExp] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.067.196 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SqueezeV3] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.067.190 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SqueezeV3] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.067.258 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.067.277 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceNansum] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.067.299 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.067.311 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.067.367 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.067.364 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.067.393 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.067.378 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.067.397 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StatelessRandomNormalV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.067.405 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StatelessRandomNormalV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.067.416 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.067.413 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.067.436 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.067.441 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.067.457 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.067.472 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.067.479 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.067.485 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.067.495 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.067.500 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.067.503 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.067.519 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.067.497 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.067.542 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.067.594 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.067.603 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.067.610 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.067.611 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.067.629 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.067.655 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.067.681 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.067.696 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.067.712 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TopK] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.067.714 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TopK] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.067.738 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.067.737 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.067.762 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.067.763 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.067.785 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.067.786 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.067.794 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.067.795 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.067.811 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.067.811 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.067.819 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.067.824 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.067.849 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.067.907 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TopKPQDistanceV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.067.907 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TopKPQDistanceV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.067.924 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.067.964 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.067.991 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.068.006 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.068.006 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.068.014 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.068.024 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [][][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.068.049 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SplitD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.068.071 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.068.107 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TransArgb] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.068.107 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TransArgb] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.068.123 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.068.151 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.068.186 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.068.212 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.068.208 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.068.219 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Unsqueeze] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.068.219 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Unsqueeze] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.068.247 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UnsqueezeV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.068.249 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UnsqueezeV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.068.261 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.068.273 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UnsqueezeV3] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.068.271 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UnsqueezeV3] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.068.313 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.068.320 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.068.372 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.068.374 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.068.399 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.068.401 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.068.417 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.068.429 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.068.499 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Where] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.068.502 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Where] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.068.517 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.068.537 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.068.562 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.068.586 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.068.600 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[WtsARQ] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.068.599 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[WtsARQ] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.068.619 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.068.667 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.068.695 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.068.698 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.068.704 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.068.718 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.068.722 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.068.800 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.068.804 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.068.818 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.068.853 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.068.905 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.068.908 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.068.920 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.068.931 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.068.933 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.068.961 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.069.016 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.028 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.028 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.053 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.054 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.069.069 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.069.071 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.069.098 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.069.116 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.069.122 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.153 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdjustContrast] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.153 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdjustContrast] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.178 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdjustHue] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.191 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdjustHue] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.201 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdjustSaturation] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.214 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdjustSaturation] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.069.218 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.069.225 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.235 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CropAndResize] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.223 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CropAndResize] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.069.242 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.069.253 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.069.254 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.257 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CropAndResizeV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.258 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CropAndResizeV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.069.264 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.069.278 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.285 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DecodeAndCropJpeg] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.283 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DecodeAndCropJpeg] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.304 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DecodeJpeg] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.306 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DecodeJpeg] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.325 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NormalizeV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.328 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NormalizeV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.347 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdjustContrastWithMean] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.349 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdjustContrastWithMean] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.368 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdjustBrightness] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.069.370 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.371 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdjustBrightness] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.069.384 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.396 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdjustBrightnessV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.395 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdjustBrightnessV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.419 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdjustSaturationV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.419 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdjustSaturationV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.441 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[WarpAffineV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.441 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[WarpAffineV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.069.452 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.463 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ImgCrop] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.464 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ImgCrop] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.069.473 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.484 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[WarpPerspective] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.485 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[WarpPerspective] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.069.497 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.069.505 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.580 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.583 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.069.588 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.606 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.608 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.069.619 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.629 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.630 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.069.688 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.728 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HcomAllReduce] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.729 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HcomAllReduce] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.069.729 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.755 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HcomAllGather] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.755 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HcomAllGather] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.778 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HcomBroadcast] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.777 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HcomBroadcast] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.069.784 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.801 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HcomReduceScatter] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.799 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HcomReduceScatter] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.821 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HcomSend] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.822 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HcomSend] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.842 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HcomReduce] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.843 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HcomReduce] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.069.843 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.864 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HcomReceive] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.864 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HcomReceive] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.069.870 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.069.882 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.890 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HcomAllToAllV] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.887 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HcomAllToAllV] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.912 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HcomAllToAllVC] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.920 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HcomAllToAllVC] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.069.935 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HcomGatherAllToAllV] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.069.942 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HcomGatherAllToAllV] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.069.951 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.069.986 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.069.994 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.070.012 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.070.057 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.070.065 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.070.065 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.070.108 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.070.139 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.070.135 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.070.157 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.070.179 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.070.211 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.070.260 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.070.263 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.070.292 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2dAssistMatrix] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.070.314 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.070.334 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.070.333 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.070.407 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.070.408 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.070.412 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.070.412 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.070.440 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.070.484 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.070.487 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.070.526 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.070.536 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.070.633 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.070.633 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.070.729 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.070.750 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.070.790 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.070.790 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.070.830 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.070.863 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.070.864 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.070.865 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Cdist] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.070.924 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.070.933 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.070.936 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.070.981 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CdistGrad] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.071.012 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.071.012 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.071.030 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.071.056 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.071.081 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.071.093 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.071.092 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.071.104 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.071.131 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.071.156 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.071.162 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.071.165 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.071.172 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.071.198 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.071.221 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.071.231 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.071.235 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.071.244 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.071.264 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.071.276 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.071.290 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.071.298 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.071.313 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.071.319 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.071.341 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.071.347 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.071.346 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.071.362 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.071.383 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.071.403 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.071.423 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.071.422 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.071.444 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.071.447 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.071.451 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.071.466 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.071.487 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.071.508 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.071.530 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.071.537 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.071.548 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.071.552 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.071.625 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.071.626 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.071.635 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SegmentSum] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.071.646 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.071.698 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.071.703 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.071.733 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.071.761 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GlobalLpPool] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.071.768 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.071.770 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.071.790 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.071.791 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.071.833 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.071.876 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GLU] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.071.930 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.071.984 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GLUGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.072.029 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.072.056 [op_impl_registry_holder_manager.cc:208]618674 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 894
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.072.056 [op_impl_registry_holder_manager.cc:208]618662 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 894
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.072.104 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.072.132 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.072.223 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.072.241 [host_cpu_engine.cc:273]618654 LoadLib:Lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libconstant_folding_ops.so has been opened
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.072.274 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UnsortedSegmentMax] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.072.304 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UnsortedSegmentMin] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.072.316 [host_cpu_engine.cc:254]618654 LoadLib:To invoke dlopen on lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libops_host_cpu.so
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.072.327 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UnsortedSegmentProd] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.072.338 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LpLoss] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.072.350 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.072.445 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdamApplyOne] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.072.464 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LpNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.072.469 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdamApplyOneAssign] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.072.491 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.072.499 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecay] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.072.514 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.072.521 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecayAssign] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.072.537 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.072.620 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BN3DTrainingReduce] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.072.644 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.072.665 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.072.686 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.072.783 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNTrainingReduce] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.072.792 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MinAreaPolygons] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.072.857 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.072.881 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.072.916 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.072.976 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.073.027 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.073.072 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.073.138 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.073.174 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.073.259 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.073.275 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.073.365 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.073.370 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.073.473 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.073.485 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.073.569 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.073.591 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.073.668 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.073.698 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.073.763 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.073.806 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.073.862 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[INTrainingReduceV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.073.918 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.073.956 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.073.981 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[INTrainingUpdateGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.074.002 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[INTrainingUpdateGradGammaBeta] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.074.026 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[INTrainingUpdateV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.074.036 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.074.125 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.074.149 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.074.222 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.074.264 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.074.325 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.074.372 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.074.425 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.074.490 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.074.531 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.074.596 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.074.629 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.074.624 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.074.719 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.074.721 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.074.762 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.074.822 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPool] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.074.830 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.074.875 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.074.925 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPool3D] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.074.936 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.074.984 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.075.022 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.075.048 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.075.118 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPoolV3] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.075.155 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.075.218 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.075.258 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CircularPad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.075.273 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.075.313 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaximumGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.075.337 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MinimumGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.075.379 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.075.417 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CircularPadGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.075.443 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.075.487 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.075.539 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LogSoftmaxGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.075.563 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.075.585 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.075.599 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.075.608 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftMarginLoss] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.075.604 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.075.628 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.075.643 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.075.650 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftmaxFocalLoss] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.075.672 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.075.693 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.075.764 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotatedNMS] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.075.786 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.075.814 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Mish] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.075.871 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.075.906 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.075.926 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.075.957 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.075.981 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.075.993 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.076.003 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.076.004 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.076.026 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.076.101 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.076.225 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleLinear1d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.076.256 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleBilinear2d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.076.235 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SilentCheck] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.076.235 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.076.347 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.076.367 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.076.415 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleBicubic2d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.076.443 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftmaxCrossEntropyWithLogits] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.076.488 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.076.548 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.076.573 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.076.581 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.076.606 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3d] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.076.670 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.076.717 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.076.740 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAAGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.076.771 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.076.825 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.076.866 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.076.902 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.076.936 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ActiveRotatedFilter] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.076.958 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.077.052 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ActiveRotatedFilterGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.077.057 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.077.085 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.077.114 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.077.156 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.077.169 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.077.256 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyAdadeltaD] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.077.276 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAA] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.077.281 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyAdagradD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.077.281 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.077.303 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyAdagradV2D] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.077.325 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyAdaMaxD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.077.345 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyAdamD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.077.367 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.077.387 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.077.395 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.077.407 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyAddSignD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.077.428 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyCenteredRMSPropD] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.077.437 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAABackward] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.077.448 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyFtrlD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.077.469 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyFtrlV2D] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.077.494 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyGradientDescent] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.077.502 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.077.515 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyKerasMomentumD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.077.536 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyMomentumD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.077.556 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyPowerSignD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.077.580 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyProximalAdagradD] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.077.602 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.077.611 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyProximalGradientDescent] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.077.611 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.077.634 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyRMSPropD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.077.661 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyAdagradDAD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.077.720 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.077.757 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.077.774 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ResizeUpsampleTrilinear] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.077.848 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.077.853 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FusedMulApplyMomentum] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.077.877 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FusedMulApplyKerasMomentum] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.077.936 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dBackward] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.077.957 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PSAMask] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.077.969 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.078.067 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GeluGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.078.075 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PSAMaskGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.078.090 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.078.127 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.078.162 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GeluGradV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.078.186 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.078.247 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.078.270 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleNearest] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.078.292 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.078.341 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IsNegInf] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.078.424 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.078.437 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IsPosInf] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.078.460 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleNearestExact2dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.078.486 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleNearest2dGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.078.533 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.078.593 [op_tiling_registry.cc:134]618646 OpTilingFuncRegistry:Register op tiling function V2 for op_type:AvgPoolGrad
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.078.609 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.078.625 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.078.652 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.078.708 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.078.742 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.078.769 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.078.812 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.078.872 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.078.890 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.078.908 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.078.917 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.079.006 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.079.034 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.079.087 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ThreeNN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.079.101 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReluV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.079.145 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.079.096 [host_cpu_engine.cc:267]618654 LoadLib:Invoke function Initialize in lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libops_host_cpu.so
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.079.200 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.079.218 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Voxelization] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.079.263 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.079.300 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.079.366 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.079.381 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.079.406 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Cummax] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.079.431 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.079.430 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.079.469 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.079.491 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.079.524 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.079.522 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.079.561 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [InferShape][InferDataType][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.079.597 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.079.594 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.079.624 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [InferShape][InferDataType][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.079.617 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.079.653 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.079.681 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.079.707 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.079.730 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.079.730 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.079.753 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.079.780 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.079.777 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.079.812 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CompressFcOp] register OP_IMPL : [InferShape][InferDataType][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.079.829 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Col2ImV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.079.837 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.079.931 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.079.956 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.079.947 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.079.982 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.080.055 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [][]
[INFO] OP(618654,python3.9):2025-04-03-09:27:42.080.060 [host_cpu_kernel_wrapper.cpp:88][OP_PROTO][Initialize][618654] OpName:[HostCpuKernelWrapperOp] "Host cpu dlopen so[/usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libaicpu_const_folding.so] success"
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.080.083 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.103 [folding.cc:404][InitCpuConstantFoldingNew][tid:618654]:"Init cpu constant folding begin."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.172 [folding.cc:408][InitCpuConstantFoldingNew][tid:618654]:"Number of registered ops: 234"
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.194 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Acos]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.080.148 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [][]
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:42.080.197 [trs_cb_event.c:119][ascend][curpid:618666,618808][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =64; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:42.080.200 [trs_cb_event.c:119][ascend][curpid:618666,618809][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =65; ret=16)
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.080.210 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [InferShape][InferDataType]
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:42.080.235 [trs_sqcq.c:1491][ascend][curpid:618666,618808][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:42.080.243 [trs_sqcq.c:1491][ascend][curpid:618666,618809][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:42.080.249 [npu_driver.cc:3833] 618808 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:42.080.259 [npu_driver.cc:3833] 618809 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=65, drvRetCode=16.
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.218 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Acosh]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.239 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[ActiveRotatedFilter]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.254 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[ActiveRotatedFilterGrad]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.269 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[AdaptiveAvgPool2dAssistMatrix]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.281 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[AdaptiveAvgPoolAssistMatrix]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.293 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[AdaptiveMaxPool2d]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.303 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Add]."
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:42.080.297 [api_impl.cc:5058] 618809 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:42.080.298 [api_impl.cc:5058] 618808 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.080.295 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [][]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.320 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Addcdiv]."
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.080.325 [callback.cpp:132]618808 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.335 [[INFO] GE(618650,python3.9):2025-04-03-09:27:42.080.327 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [InferShape][InferDataType]
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.080.342 [callback.cpp:132]618809 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.080.346 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.080.360 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Addcmul]."
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.080.363 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.080.373 [npu_driver.cc:3828] 618808 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=64.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.080.378 [npu_driver.cc:3828] 618809 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=65.
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.369 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[AffineGrid]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.389 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[ApplyAdamV2]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.409 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Asin]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.080.400 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : []
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.425 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Asinh]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.442 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Assert]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.080.437 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.458 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Atan]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.477 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Atan2]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.491 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Atanh]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.080.495 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [][]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.508 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[AvgPoolV2]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.524 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Betainc]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.541 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Bucketize]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.554 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[CTCLossV2]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.080.563 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMatMulV4] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.569 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[CTCLossV2Grad]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.587 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[CacheSwapTable]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.080.597 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2d] register OP_IMPL : [][]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.602 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[CalcBucketsLimitAndOffset]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.620 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[CaseCondition]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.635 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Cast]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.652 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Ceil]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.666 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[CheckNumerics]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.080.677 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.683 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[ClipByValue]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.702 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[ClipByValueV2]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.080.695 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [][]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.717 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Combinations]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.734 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[CompareAndBitpack]."
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.080.741 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.748 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[ComputeAccidentalHits]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.766 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[ConcatV2]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.080.777 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.784 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Conj]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.804 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[ConjugateTranspose]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.080.798 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.080.810 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.820 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Coordinates1DTo2D]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.838 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Cosh]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.866 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[CropAndResize]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.880 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Cross]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.894 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Cummax]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.080.894 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [][]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.909 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Cummin]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.926 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Cumsum]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.080.923 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [InferShape][InputsDependency]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.941 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Div]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.958 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[DynamicStitch]."
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.080.947 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.975 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[EditDistance]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.080.992 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Elu]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.080.994 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [][]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.006 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[EluGrad]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.023 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[EmbeddingApplyAdaGrad]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.038 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[EmbeddingApplyAdam]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.054 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[EmbeddingApplyAdamW]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.081.037 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [InferShape][InputsDependency]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.070 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[EmbeddingApplyFtrl]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.087 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[EmbeddingApplyRmsprop]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.081.091 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : [][]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.099 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[EmbeddingApplySgd]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.117 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[EmbeddingComputeVarExport]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.132 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[EmbeddingComputeVarImport]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.148 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[EmbeddingFeatureMappingExport]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.081.149 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [InferShape][InputsDependency]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.162 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[EmbeddingFeatureMappingFileSize]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.179 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[EmbeddingFeatureMappingImport]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.194 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[EmbeddingHashmapExport]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.081.193 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaskedSelect] register OP_IMPL : [][]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.210 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[EmbeddingHashmapFileSize]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.227 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[EmbeddingHashmapImport]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.242 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[EmbeddingLookup]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.258 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[EmbeddingTableEvict]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.081.273 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ResizeTrilinear] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.081.282 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.272 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[EmbeddingTableExport]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.296 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[EmbeddingTableFind]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.081.296 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : []
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.312 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[EmbeddingTableFindAndInit]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.327 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[EmbeddingTableImport]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.081.321 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : []
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.342 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Equal]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.358 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Expand]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.371 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[ExpandDims]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.081.384 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : [InferShape]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.386 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Exponential]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.403 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[ExponentialDecayLR]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.418 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Fill]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.081.419 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : []
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.433 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[FillDiagonal]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.449 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Fills]."
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.081.440 [op_impl_registry_holder_manager.cc:208]618662 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 894
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.464 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Floor]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.481 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[FloorDiv]."
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.081.446 [op_impl_registry_holder_manager.cc:208]618674 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 894
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.497 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[FloorMod]."
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.081.488 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.081.493 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.511 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[GEMM]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.529 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[GatherElements]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.081.520 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.081.526 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.550 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[GatherV2]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.566 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Geometric]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.081.553 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.581 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[GetDynamicDims]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.081.579 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.598 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Greater]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.081.605 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.614 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[GreaterEqual]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.631 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[GridSampler2D]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.081.617 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [][]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.646 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[GridSampler2DGrad]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.663 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[GridSampler3D]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.675 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[GridSampler3DGrad]."
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.081.692 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReflectionPad3dGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.690 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Histogram]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.707 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[IMGWarpOffsets]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.723 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Identity]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.081.724 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [][][]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.737 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[IndexToAddr]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.765 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[InitEmbeddingHashmap]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.081.767 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.779 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[InitPartitionMap]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.797 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[InplaceIndexAdd]."
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.081.805 [op_tiling_registry.cc:134]618646 OpTilingFuncRegistry:Register op tiling function V2 for op_type:AvgPool
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.081.804 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.813 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[InplaceTopKDistance]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.830 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[InvGrad]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.081.826 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.081.842 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.081.839 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.846 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[InvertPermutation]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.864 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[IsClose]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.879 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[IsInf]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.081.877 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.896 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[IsNan]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.916 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Less]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.081.924 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.081.927 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : []
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.931 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[LinSpace]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.950 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[LinearSumAssignment]."
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.081.954 [op_tiling_registry.cc:134]618646 OpTilingFuncRegistry:Register op tiling function V2 for op_type:AvgPoolV2
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.081.963 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.965 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Log]."
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.081.983 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.081.986 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Log1p]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.081.999 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.003 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[LogMatrixDeterminant]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.021 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[LogSoftmaxV2]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.082.024 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.082.033 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.036 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[LogUniformCandidateSampler]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.055 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[MaskedFill]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.082.066 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.070 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[MaskedScatter]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.089 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[MaskedSelect]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.082.099 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.105 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[MaskedSelectGrad]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.123 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[MatMul]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.082.131 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.082.123 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [][]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.139 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[MatrixDiagPartV3]."
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.082.145 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.156 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[MatrixDiagV3]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.082.164 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.082.176 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.173 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[MinAreaPolygons]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.190 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Mul]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.207 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[MultinomialAliasDraw]."
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.082.202 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.082.191 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.082.225 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantConv2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.082.230 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : []
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.221 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[MultinomialAliasSetup]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.246 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[MultinomialWithReplacement]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.082.231 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.262 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[NLLLoss]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.082.269 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.276 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[NLLLossGrad]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.293 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[NMSWithMask]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.082.306 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.309 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Neg]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.326 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[NonMaxSuppressionV3]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.082.331 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RNNTLoss] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.082.340 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.343 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[NonZero]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.361 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[NonZeroWithValueShape]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.082.368 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.376 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[NonZeroWithValueShapeV2]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.394 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[NotEqual]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.409 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[OnesLike]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.426 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[PSAMask]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.441 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[PSAMaskGrad]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.082.433 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MultinomialWithReplacement] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.082.450 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : [InferShape]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.454 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Pad]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.472 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[PadD]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.486 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[PadV3]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.500 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[PadV3Grad]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.517 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Pinverse]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.082.530 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : []
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.530 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Poisson]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.548 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Pow]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.565 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[ProdEnvMatACalcRij]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.082.558 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.082.574 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ActULQClampMaxGrad] register OP_IMPL : [InferShape]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.580 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[RNNTLoss]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.599 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[RandomStandardNormal]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.082.609 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ActULQClampMinGrad] register OP_IMPL : [InferShape]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.615 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[RandomUniform]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.632 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[RealDiv]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.647 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[ReduceAll]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.663 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[ReduceMean]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.082.654 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StatelessBernoulli] register OP_IMPL : [][]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.679 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[ReduceSum]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.695 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Reshape]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.716 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Resize]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.082.726 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ActsULQ] register OP_IMPL : [InferShape]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.731 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[ResizeBilinear]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.749 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[ResizeBilinearGrad]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.082.751 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : []
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.765 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[ResizeBilinearV2Grad]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.779 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[ResizeGrad]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.793 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[ResizeTrilinear]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.808 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[ReverseSequence]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.825 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[RightShift]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.839 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[RoiPoolingWithArgMax]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.856 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[RotatedNMS]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.082.838 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ActsULQInputGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.082.856 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [][]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.873 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Round]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.894 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Rsqrt]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.912 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[STFT]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.926 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[ScatterAddWithAxis]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.943 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[ScatterElements]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.082.957 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : []
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.956 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[ScatterNdAdd]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.974 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[ScatterNdMax]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.082.952 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool] register OP_IMPL : [InferShape]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.082.990 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[ScatterNdMin]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.005 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[SearchSorted]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.021 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[SelectV2]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.034 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Sigmoid]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.050 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[SigmoidGrad]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.066 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Sign]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.083.057 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UniqueConsecutive] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.083.074 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.082 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[SilentCheck]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.099 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[SilentCheckV2]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.114 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[SilentCheckV3]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.128 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[SliceWrite]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.145 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[SoftmaxV2]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.083.157 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UniqueWithCountsAndSorting] register OP_IMPL : [][]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.159 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Sort]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.183 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[SparseFillEmptyRows]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.083.186 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdaptiveAvgPoolAssistMatrix] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.198 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[SparseSegmentMean]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.215 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[SparseSegmentMeanGrad]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.230 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[SparseSegmentSum]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.247 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[SparseToDense]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.260 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[SpatialTransformer]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.083.259 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[WarpAffine] register OP_IMPL : [][]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.277 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[SplitD]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.297 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[SplitV]."
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.083.300 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3d] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.083.304 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.312 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Sqrt]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.329 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[SqrtGrad]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.083.333 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.344 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Square]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.083.356 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Histogram] register OP_IMPL : [][]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.361 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[SquaredDifference]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.377 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[StatelessBernoulli]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.392 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[StatelessRandomUniformV2]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.406 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[StatelessRandperm]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.423 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[StridedSlice]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.437 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[StridedSliceV2]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.083.443 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.452 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Sub]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.083.461 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [][]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.469 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[TableToResource]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.487 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Tan]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.504 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[TanhGrad]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.518 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[TensorEqual]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.535 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[TensorScatterUpdate]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.548 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[ThreeNN]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.083.557 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.083.558 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.564 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Tile]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.581 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[TileWithAxis]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.597 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[TopK]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.614 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[TopKPQDistance]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.637 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[TopKPQDistanceV2]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.652 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[TopKV2D]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.083.661 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Unique] register OP_IMPL : []
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.667 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Trace]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.684 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[TransData]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.083.670 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.700 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[TransDataRNN]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.717 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Tril]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.731 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Triu]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.746 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[UniformCandidateSampler]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.083.758 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UniqueWithCounts] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.083.756 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.760 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[UninitEmbeddingHashmap]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.083.777 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.780 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[UninitPartitionMap]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.798 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[UniqueConsecutive]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.083.804 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.813 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[UniqueWithCountsAndSorting]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.831 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[UniqueWithCountsExt2]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.846 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[UpsampleNearest3d]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.862 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[UpsampleNearest3dGrad]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.083.854 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Dot] register OP_IMPL : []
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.878 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[UpsampleTrilinear3d]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.894 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[UpsampleTrilinear3dGrad]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.908 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[ViewCopy]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.083.912 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.083.921 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.923 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Voxelization]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.942 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[WarpAffine]."
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.083.956 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : []
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.958 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[ZerosLike]."
[INFO] AICPU(618654,python3.9):2025-04-03-09:27:42.083.976 [folding.cc:413][InitCpuConstantFoldingNew][tid:618654]:"Register op[Zeta]."
[INFO] OP(618654,python3.9):2025-04-03-09:27:42.083.998 [host_cpu_kernel_wrapper.cpp:118][OP_PROTO][Initialize][618654] OpName:[HostCpuKernelWrapperOp] "Host cpu init success"
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.084.017 [host_cpu_engine.cc:273]618654 LoadLib:Lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libops_host_cpu.so has been opened
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.084.032 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.084.058 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.084.084 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.084.142 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.084.155 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.084.191 [plugin_manager.cc:872]618654 LoadWithFlags:Dlopen path: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/plugin/engines/runtime/libdvpp_rtkernel.so. flags is 4354
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.084.226 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.084.255 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.084.262 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.084.288 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.084.330 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardReduce] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.084.349 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.084.423 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStatsWithCounts] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.084.439 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.084.439 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.084.520 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.084.551 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AvgPoolUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.084.544 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.084.578 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.084.594 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.084.600 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.084.622 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.084.643 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.084.664 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.084.667 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.084.686 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.084.710 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.084.750 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.084.778 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.084.784 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.084.809 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.084.834 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.084.856 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.084.901 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Bitcast] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.084.944 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.084.950 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.085.014 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.085.050 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.085.101 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.085.098 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.085.148 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.085.194 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.085.247 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.085.255 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.085.306 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.085.351 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.085.377 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.085.399 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.085.421 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.085.428 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CTCLoss] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.085.502 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.085.543 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.085.574 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AGLU] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.085.597 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.085.622 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.085.652 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.085.713 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.085.756 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.085.811 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.085.869 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DropOutGenMask] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.085.903 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StatelessDropOutGenMask] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.085.907 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.085.978 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.086.009 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.086.013 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.086.034 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.086.065 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.086.089 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.086.125 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.086.182 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.086.206 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.086.179 [op_impl_registry_holder_manager.cc:208]618674 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.086.179 [op_impl_registry_holder_manager.cc:208]618662 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.086.231 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.086.233 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.086.324 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.086.332 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.086.348 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.086.349 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.086.370 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.086.466 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.086.464 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ExpandDims] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.086.490 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.086.513 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.086.537 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.086.574 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.086.576 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.086.629 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.086.726 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FillWindowCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.086.734 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.086.758 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.086.830 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.086.842 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.086.855 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.086.878 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.086.954 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FlattenV2] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.086.969 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.086.993 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.087.068 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GatherShapes] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.087.092 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.087.182 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GaussianBlur] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.087.185 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.087.282 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.087.308 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.087.333 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.087.336 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FileConstant] register OP_IMPL : [IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.087.370 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StatelessIf] register OP_IMPL : [InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.087.401 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[If] register OP_IMPL : [InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.087.429 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[_If] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.087.431 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.087.464 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.087.457 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Case] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.087.486 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.087.532 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ConstPlaceHolder] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.087.582 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.087.640 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.087.675 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.087.756 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.087.769 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.087.824 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.087.842 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Identity] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.087.868 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.087.876 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MemcpyAsync] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.087.903 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IdentityN] register OP_IMPL : [InferShape]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.087.945 [plugin_manager.cc:883]618654 LoadWithFlags:The shared library will not be checked. Please ensure that the source of the shared library is trusted.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.087.969 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.088.014 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.088.027 [ops_kernel_executor_manager.cc:37]618654 Initialize:No library to load
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.088.062 [plugin_manager.cc:540]618654 GetOpsProtoPath:Enter GetOpsProtoPath schedule
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.088.076 [plugin_manager.cc:108]618654 GetOppPath:Enter get opp path schedule
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.088.067 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.088.114 [plugin_manager.cc:117]618654 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.088.124 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.088.140 [plugin_manager.cc:547]618654 GetOpsProtoPath:Opp plugin path structure is new version!
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.088.178 [plugin_manager.cc:206]618654 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.088.206 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.088.252 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.088.260 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.088.314 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.088.388 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.088.413 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2dAssistMatrix] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.088.501 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.088.515 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.088.609 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.088.620 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.088.637 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.088.664 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.088.717 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.088.809 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NLLLossGrad310p] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.088.814 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.088.812 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.088.842 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.088.913 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Cdist] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.088.925 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.088.968 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.089.009 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CdistGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.089.055 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.089.093 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.089.111 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.089.126 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.089.136 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : []
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.089.142 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.089.162 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.089.159 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.089.164 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : [InferShape]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.089.178 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.089.232 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.089.240 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DropoutWithMulsAndSoftmaxGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.089.260 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.089.285 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.089.286 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.089.308 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.089.402 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.089.397 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.089.400 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.089.494 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.089.510 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.089.547 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.089.577 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.089.590 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.089.594 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.089.629 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.089.648 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.089.619 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.089.665 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.089.688 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.089.707 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.089.709 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GlobalLpPool] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.089.717 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.089.752 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.089.755 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RandomChoiceWithMask] register OP_IMPL : [InferShapeRange]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.089.773 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.089.807 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.089.823 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.089.814 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GLU] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.089.860 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.089.878 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.089.865 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RandomUniform] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.089.893 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.089.911 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.089.912 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GLUGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.089.956 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Rank] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.089.986 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Size] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.090.004 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.090.040 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.090.091 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.090.099 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.090.151 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.090.198 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LpLoss] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.090.206 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Reshape] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.090.257 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.090.295 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LpNorm] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.090.294 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.090.313 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.090.304 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachBinaryOp] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.090.330 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.090.318 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RgbToGrayscale] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.090.324 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.090.350 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.090.372 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.090.370 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.090.433 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.090.463 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.090.470 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MinAreaPolygons] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.090.545 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.090.566 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.090.584 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.090.657 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.090.667 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.090.721 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.090.756 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.090.775 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.090.763 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.090.767 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Rotate] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.090.791 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.090.831 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.090.858 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.090.860 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Shape] register OP_IMPL : [InferShape]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.090.869 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.090.902 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.090.891 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ShapeN] register OP_IMPL : [InferShape]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.090.918 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.090.935 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.090.926 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.090.967 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.090.984 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.090.968 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.090.999 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.091.016 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.091.064 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.091.116 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.091.125 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SilentCheckV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.091.159 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.091.255 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.091.272 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.091.350 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.091.358 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.091.363 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SilentCheckV3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.091.383 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.091.395 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.091.415 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.091.428 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.091.450 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.091.474 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.091.495 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.091.506 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.091.557 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.091.624 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.091.656 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InstanceNormV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.091.657 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.091.750 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyAdadelta] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.091.754 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.091.781 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyAdadeltaD] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.091.810 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.091.826 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IouV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.091.824 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.091.838 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyAdagrad] register OP_IMPL : [InferShape]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.091.861 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.091.879 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.091.849 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.091.865 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagrad] register OP_IMPL : [InferShape]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.091.895 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.091.893 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.091.933 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.091.934 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.091.961 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.091.965 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.091.985 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : [InferShape]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.091.973 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.092.005 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.091.997 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BidirectionLSTM] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.092.010 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.092.026 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BidirectionLSTMV2] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.092.021 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.092.039 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.092.038 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.092.066 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2D] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.092.072 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.092.073 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.092.092 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.092.095 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyRMSProp] register OP_IMPL : [InferShape]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.092.107 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.092.124 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.092.122 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyRMSPropD] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.092.200 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.092.210 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.092.229 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.092.249 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseFillEmptyRows] register OP_IMPL : [InferShapeRange][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.092.314 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.092.391 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaskedSelectV3] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.092.411 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.092.472 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.092.484 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.092.509 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.092.523 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.092.543 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.092.558 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.092.574 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.092.597 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.092.602 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Squeeze] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.092.609 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.092.634 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SqueezeV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.092.663 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SqueezeV3] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.092.710 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.092.768 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.092.813 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.092.883 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StatelessRandomNormalV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.092.908 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.092.944 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.092.979 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.092.997 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.092.994 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.093.007 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : []
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.093.014 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.093.033 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.093.053 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.093.104 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.093.092 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.093.131 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.093.129 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotatedNMS] register OP_IMPL : [][][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.093.147 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.093.165 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.093.196 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.093.213 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.093.226 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.093.232 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.093.232 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TopK] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.093.240 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.093.259 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.093.287 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.093.312 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.093.333 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.093.338 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.093.430 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SilentCheck] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.093.446 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TopKPQDistanceV2] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.093.529 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.093.553 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.093.584 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.093.621 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.093.639 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.093.628 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : []
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.093.655 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.093.681 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TransArgb] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.093.696 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.093.724 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3d] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.093.803 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Unsqueeze] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.093.827 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.093.837 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UnsqueezeV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.093.865 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UnsqueezeV3] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.093.935 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.093.987 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.094.018 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.094.033 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ActiveRotatedFilter] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.094.056 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.094.091 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.094.109 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.094.125 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.094.103 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.094.128 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ActiveRotatedFilterGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.094.133 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Where] register OP_IMPL : [InferShapeRange]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.094.163 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.094.201 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.094.230 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.094.227 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.094.244 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[WtsARQ] register OP_IMPL : [InferShape]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.094.247 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.094.266 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.094.299 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.094.315 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.094.328 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.094.324 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.094.344 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.094.354 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.094.359 [plugin_manager.cc:218]618654 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.094.384 [plugin_manager.cc:422]618654 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.094.400 [plugin_manager.cc:155]618654 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.094.426 [plugin_manager.cc:158]618654 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.094.442 [plugin_manager.cc:426]618654 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.094.425 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.094.462 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.094.528 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.094.574 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.094.602 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.094.628 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.094.725 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.094.726 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.094.752 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.094.783 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.094.824 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.094.819 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.094.851 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.094.866 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.094.866 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdjustContrast] register OP_IMPL : [InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.094.897 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdjustHue] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.094.907 [plugin_manager.cc:439]618654 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspo
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.094.925 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdjustSaturation] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.094.930 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PSAMask] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.094.930 [ge_executor.cc:259]618654 InitOpsProtoManager:Get opsproto path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/minds
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.094.955 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CropAndResize] register OP_IMPL : [InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.094.984 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CropAndResizeV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.095.012 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DecodeAndCropJpeg] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.095.027 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PSAMaskGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.095.040 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DecodeJpeg] register OP_IMPL : [InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.095.068 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NormalizeV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.095.094 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdjustContrastWithMean] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.095.125 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.095.132 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdjustBrightness] register OP_IMPL : [InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.095.158 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdjustBrightnessV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.095.186 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdjustSaturationV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.095.212 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[WarpAffineV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.095.220 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.095.239 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ImgCrop] register OP_IMPL : [InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.095.266 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[WarpPerspective] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.095.319 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.095.319 [plugin_manager.cc:996]618654 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.095.355 [plugin_manager.cc:1011]618654 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.095.379 [plugin_manager.cc:1015]618654 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.095.379 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.095.407 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.095.414 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.095.431 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.095.493 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.095.513 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.095.516 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.095.557 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HcomAllReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.095.586 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HcomAllGather] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.095.592 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.095.611 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.095.614 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ThreeNN] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.095.619 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HcomBroadcast] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.095.649 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HcomReduceScatter] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.095.645 [opsproto_manager.cc:123]618654 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.095.676 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HcomSend] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.095.703 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HcomReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.095.710 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.095.728 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.095.713 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Voxelization] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.095.730 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HcomReceive] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.095.759 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HcomAllToAllV] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.095.760 [opsproto_manager.cc:123]618654 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.095.787 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HcomAllToAllVC] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.095.810 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.095.827 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 2 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.095.814 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HcomGatherAllToAllV] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.095.828 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.095.858 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.095.884 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.095.894 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.095.912 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.095.912 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.095.939 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.095.964 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.095.977 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.095.994 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.095.989 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.096.019 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [][][][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.096.024 [opsproto_manager.cc:123]618654 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.096.044 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : [][][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.096.068 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.096.069 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.096.087 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 3 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.096.090 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : []
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.096.117 [opsproto_manager.cc:123]618654 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.096.115 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.096.172 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.096.191 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 4 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.096.150 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.096.223 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CompressFcOp] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.096.248 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.096.256 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.096.274 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.096.339 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.096.362 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.096.351 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.096.392 [opsproto_manager.cc:123]618654 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.096.436 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.096.452 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 5 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.096.456 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.096.480 [opsproto_manager.cc:123]618654 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.096.524 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.096.540 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 6 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.096.554 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.096.603 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.096.620 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.096.649 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.096.683 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.096.700 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.096.728 [opsproto_manager.cc:123]618654 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.096.745 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.096.772 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.096.788 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 7 libs.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.096.816 [opsproto_manager.cc:123]618654 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.096.840 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMatMulV4] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.096.859 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.096.877 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 8 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.096.938 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.096.948 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.096.965 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.096.971 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.097.030 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.097.029 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.097.047 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.097.058 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.097.077 [opsproto_manager.cc:123]618654 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.097.074 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.097.123 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.097.139 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 9 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.097.157 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.097.166 [opsproto_manager.cc:123]618654 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.097.166 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.097.209 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.097.227 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 10 libs.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.097.255 [opsproto_manager.cc:123]618654 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/usr/local/Ascend/ascend-toolkit/latest/opp/op_proto/custom/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.097.255 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.097.266 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.097.301 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 10 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.097.352 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.097.359 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.097.369 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.097.387 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.097.402 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.097.418 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 3 libs.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.097.431 [opsproto_manager.cc:147]618654 LoadOpsProtoPluginSo:[LoadSo][Check] Shared library will not be checked. Please make sure that the source of shared library is trusted.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.097.440 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.097.452 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ResizeTrilinear] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.097.556 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.097.568 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.097.660 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.097.686 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.097.686 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.097.709 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.097.732 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.097.755 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.097.803 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.097.858 [operator_factory_impl.cc:215]618654 RegisterInferShapeFunc:operator_infershape_funcs_ init
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.097.876 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.097.884 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.097.887 [operator_factory_impl.cc:269]618654 RegisterVerifyFunc:operator_verify_funcs_ init
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.097.906 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.097.941 [opsproto_manager.cc:162]618654 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.097.935 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.097.969 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.097.974 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.098.000 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.098.027 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [][][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.098.054 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.098.053 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.098.083 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.098.082 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.098.108 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.098.133 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.098.157 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [][][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.098.183 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.098.205 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.098.232 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.098.238 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.098.265 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.098.289 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.098.315 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.098.321 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.098.340 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.098.412 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.098.457 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.098.513 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ActULQClampMaxGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.098.538 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ActULQClampMinGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.098.544 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.098.628 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.098.633 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ActsULQ] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.098.711 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.098.742 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ActsULQInputGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.098.840 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.098.935 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.099.033 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdaptiveAvgPoolAssistMatrix] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.099.080 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.099.108 [opsproto_manager.cc:162]618650 LoadOpsProtoPluginSo:OpsProtoManager plugin load /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto.so success.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.099.130 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.099.157 [plugin_manager.cc:108]618650 GetOppPath:Enter get opp path schedule
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.099.166 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.099.205 [plugin_manager.cc:117]618650 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.099.262 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.099.370 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.099.469 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.099.565 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.099.589 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.099.683 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.099.745 [plugin_manager.cc:996]618650 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.099.784 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.099.801 [plugin_manager.cc:1011]618650 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.099.826 [plugin_manager.cc:1015]618650 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.099.854 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.099.888 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.099.909 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.099.925 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.099.945 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.099.985 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.100.007 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.100.025 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.100.038 [opp_so_manager.cc:56]618650 LoadOpsProtoPackage:Start load ops proto package, is_split:[1].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.100.056 [plugin_manager.cc:540]618650 GetOpsProtoPath:Enter GetOpsProtoPath schedule
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.100.060 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.100.069 [plugin_manager.cc:108]618650 GetOppPath:Enter get opp path schedule
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.100.096 [plugin_manager.cc:117]618650 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.100.116 [plugin_manager.cc:547]618650 GetOpsProtoPath:Opp plugin path structure is new version!
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.100.134 [plugin_manager.cc:206]618650 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.100.144 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.100.289 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AvgPoolUpdate] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.100.396 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.100.493 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.100.526 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.100.571 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.100.590 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.100.603 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.100.605 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Bitcast] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.100.649 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.100.707 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.100.782 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.100.861 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.100.937 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.101.001 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.101.033 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CTCLoss] register OP_IMPL : []
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.101.037 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.101.055 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.101.093 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.101.136 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.101.137 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.101.177 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.101.196 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.101.209 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.101.228 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.101.241 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.101.262 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.101.279 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.101.292 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.101.309 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.101.323 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.101.426 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DropOutGenMask] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.101.453 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StatelessDropOutGenMask] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.101.555 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.101.645 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.101.650 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.101.680 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.101.698 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.101.712 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.101.747 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.101.759 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.101.856 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.101.952 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ExpandDims] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.102.048 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.102.088 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.102.122 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.102.156 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.102.146 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FillWindowCache] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.102.171 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.102.209 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.102.246 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.102.247 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.102.264 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.102.282 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.102.297 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.102.330 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.102.347 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.102.347 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FlattenV2] register OP_IMPL : []
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.102.360 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.102.374 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.102.455 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GatherShapes] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.102.549 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GaussianBlur] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.102.656 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FileConstant] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.102.683 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StatelessIf] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.102.708 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[If] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.102.710 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.102.730 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[_If] register OP_IMPL : []
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.102.745 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.102.753 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Case] register OP_IMPL : []
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.102.763 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.102.782 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.102.800 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ConstPlaceHolder] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.102.821 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.102.805 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.102.908 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.103.004 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.103.077 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.103.082 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Identity] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.103.107 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MemcpyAsync] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.103.128 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IdentityN] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.103.161 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.103.195 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.103.225 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.103.223 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : []
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.103.241 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.103.280 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.103.316 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.103.333 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.103.321 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : []
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.103.348 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.103.365 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.103.375 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MedianDim] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.103.394 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.103.413 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.103.421 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.103.425 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.103.443 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.103.516 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.103.625 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.103.707 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.103.726 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.103.751 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.103.773 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.103.779 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.103.814 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.103.832 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.103.846 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.103.882 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.103.908 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.103.918 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.103.933 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.104.004 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.104.110 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.104.122 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.104.246 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.104.241 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.104.294 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.104.313 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.104.312 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.104.330 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.104.353 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.104.368 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.104.405 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.104.422 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.104.435 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.104.452 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.104.458 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : []
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.104.482 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.104.498 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.104.489 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeTutelCombineGates] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.104.513 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.104.531 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.104.557 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.104.654 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.104.636 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Igammac] has registered infer func
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.104.698 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeTutelCombineX] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.104.751 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RandomChoiceWithMask] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.104.847 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeTutelDispatch] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.104.845 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RandomUniform] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.104.866 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.104.900 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.104.918 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.104.922 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Rank] register OP_IMPL : []
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.104.930 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.104.944 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.104.950 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Size] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.104.978 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.105.044 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.105.144 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Reshape] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.105.203 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScore] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.105.239 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RgbToGrayscale] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.105.320 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.105.338 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.105.336 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.105.366 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.105.384 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.105.398 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.105.431 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.105.435 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.105.471 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.105.489 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.105.499 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.105.502 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.105.518 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.105.538 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.105.523 [opsproto_manager.cc:162]618654 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.105.551 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.105.568 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.105.582 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.105.599 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.105.611 [plugin_manager.cc:218]618650 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.105.637 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Rotate] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.105.633 [plugin_manager.cc:422]618650 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.105.654 [opsproto_manager.cc:162]618654 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.105.659 [plugin_manager.cc:155]618650 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.105.687 [plugin_manager.cc:158]618650 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.105.704 [plugin_manager.cc:426]618650 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.105.709 [opsproto_manager.cc:162]618654 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.105.709 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Shape] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.105.743 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ShapeN] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.105.749 [opsproto_manager.cc:162]618654 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.105.785 [opsproto_manager.cc:162]618654 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.105.818 [opsproto_manager.cc:162]618654 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.105.836 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SilentCheckV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.105.851 [opsproto_manager.cc:162]618654 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.105.883 [opsproto_manager.cc:162]618654 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.105.916 [opsproto_manager.cc:162]618654 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.105.933 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SilentCheckV3] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.106.001 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Rfft1D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.106.029 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.106.035 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.106.070 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.106.087 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.106.100 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.106.133 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.106.138 [plugin_manager.cc:439]618650 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspo
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.106.173 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.106.237 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyAdadelta] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.106.263 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyAdadeltaD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.106.286 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyAdagradD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.106.307 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyAdagrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.106.327 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.106.344 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.106.348 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagradD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.106.369 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.106.376 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GemmaRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.106.391 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2D] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.106.412 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.106.433 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.106.453 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.106.458 [plugin_manager.cc:996]618650 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.106.474 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2D] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.106.491 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.106.488 [plugin_manager.cc:1011]618650 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.106.494 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyRMSProp] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.106.512 [plugin_manager.cc:1015]618650 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.106.515 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyRMSPropD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.106.613 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseFillEmptyRows] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.106.624 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.106.619 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.106.638 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.106.655 [opp_so_manager.cc:45]618650 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.106.708 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.106.802 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Squeeze] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.106.813 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LinearIndex] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.106.830 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SqueezeV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.106.853 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SqueezeV3] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.106.952 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.107.008 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LinearIndexV2] register OP_IMPL : [Tiling][InputsDependency][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.107.056 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StatelessRandomNormalV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.107.156 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.107.192 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterAddWithSorted] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.107.250 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.107.343 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TopK] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.107.346 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Sinkhorn] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.107.367 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.107.393 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.107.415 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.107.439 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.107.465 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.107.529 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TopKPQDistanceV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.107.578 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.107.610 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.107.634 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.107.735 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TransArgb] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.107.830 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Unsqueeze] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.107.854 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UnsqueezeV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.107.876 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UnsqueezeV3] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.107.976 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.108.000 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.108.096 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Where] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.108.244 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[WtsARQ] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.108.341 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.108.379 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.108.439 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.108.536 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.108.560 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.108.599 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StackGroupPoints] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.108.651 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.108.678 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.108.763 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.108.781 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdjustContrast] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.108.805 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdjustHue] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.108.836 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdjustSaturation] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.108.858 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CropAndResize] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.108.877 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CropAndResizeV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.108.899 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DecodeAndCropJpeg] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.108.889 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.108.921 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DecodeJpeg] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.108.942 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NormalizeV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.108.962 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdjustContrastWithMean] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.108.983 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdjustBrightness] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.109.005 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdjustBrightnessV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.109.026 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdjustSaturationV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.109.046 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[WarpAffineV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.109.066 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.109.069 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ImgCrop] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.109.095 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.109.091 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[WarpPerspective] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.109.131 [op_impl_registry_holder_manager.cc:208]618650 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.109.189 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.109.175 [op_impl_registry_holder_manager.cc:216]618650 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.109.211 [op_impl_registry_holder_manager.cc:208]618650 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.109.214 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.109.233 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.109.236 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.109.262 [op_impl_registry_holder_manager.cc:208]618650 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.109.334 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HcomAllReduce] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.109.355 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.109.358 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HcomAllGather] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.109.382 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.109.383 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HcomBroadcast] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.109.405 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.109.405 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HcomReduceScatter] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.109.427 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HcomSend] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.109.448 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HcomReduce] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.109.469 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HcomReceive] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.109.490 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HcomAllToAllV] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.109.510 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HcomAllToAllVC] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.109.532 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HcomGatherAllToAllV] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.109.562 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.109.663 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.109.732 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.109.767 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.109.823 [op_impl_space_registry.cc:273]618650 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so] success!
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.109.858 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.109.858 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.109.933 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.109.955 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.109.976 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.109.989 [opp_so_manager.cc:45]618650 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.110.010 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.110.080 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.110.098 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.110.287 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.110.315 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.110.343 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.110.294 [op_impl_space_registry.cc:273]618662 ConvertSoToRegistry:Save so symbol and handle in path[/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so] success!
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.110.331 [op_impl_space_registry.cc:273]618674 ConvertSoToRegistry:Save so symbol and handle in path[/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so] success!
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.110.376 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.110.448 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.110.476 [plugin_manager.cc:554]618662 GetUpgradedOpsProtoPath:Start to get upgraded ops proto path
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.110.500 [plugin_manager.cc:134]618662 GetUpgradedOppPath:Enter get upgraded opp path schedule
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.110.520 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.110.528 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.110.560 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.110.556 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /usr/local/Ascend/ascend-toolkit/latest/opp_latest/, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.110.578 [plugin_manager.cc:145]618662 GetUpgradedOppPath:[Call][RealPath] Opp path /usr/local/Ascend/ascend-toolkit/latest/opp_latest/ is invalid.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.110.592 [plugin_manager.cc:557]618662 GetUpgradedOpsProtoPath:Failed to get upgraded opp path!
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.110.604 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.110.608 [plugin_manager.cc:108]618662 GetOppPath:Enter get opp path schedule
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.110.639 [plugin_manager.cc:117]618662 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.110.654 [plugin_manager.cc:554]618674 GetUpgradedOpsProtoPath:Start to get upgraded ops proto path
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.110.677 [plugin_manager.cc:134]618674 GetUpg[INFO] GE(618670,python3.9):2025-04-03-09:27:42.110.679 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [][]
radedOppPath:Enter get upgraded opp path schedule
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.110.742 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /usr/local/Ascend/ascend-toolkit/latest/opp_latest/, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.110.745 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [][]
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.110.760 [plugin_manager.cc:145]618674 GetUpgradedOppPath:[Call][RealPath] Opp path /usr/local/Ascend/ascend-toolkit/latest/opp_latest/ is invalid.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.110.778 [plugin_manager.cc:557]618674 GetUpgradedOpsProtoPath:Failed to get upgraded opp path!
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.110.793 [plugin_manager.cc:108]618674 GetOppPath:Enter get opp path schedule
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.110.812 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.110.818 [plugin_manager.cc:117]618674 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.110.921 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.111.028 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.111.124 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.111.192 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.111.264 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.111.330 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.111.351 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.111.378 [plugin_manager.cc:996]618674 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.111.379 [plugin_manager.cc:996]618662 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.111.439 [plugin_manager.cc:1011]618662 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.111.440 [plugin_manager.cc:1011]618674 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.111.465 [plugin_manager.cc:1015]618674 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.111.464 [plugin_manager.cc:1015]618662 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.111.551 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.111.551 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.111.570 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.111.570 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.111.604 [op_impl_registry_holder_manager.cc:208]618670 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 894
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.111.633 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.111.633 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.111.651 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.111.651 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.111.664 [opp_so_manager.cc:66]618674 LoadOpMasterPackage:Start load op master package, is_split:[1].
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.111.664 [opp_so_manager.cc:66]618662 LoadOpMasterPackage:Start load op master package, is_split:[1].
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.111.681 [plugin_manager.cc:616]618662 GetOpTilingForwardOrderPath:Enter GetOpTilingPath schedule
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.111.681 [plugin_manager.cc:616]618674 GetOpTilingForwardOrderPath:Enter GetOpTilingPath schedule
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.111.697 [plugin_manager.cc:108]618674 GetOppPath:Enter get opp path schedule
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.111.696 [plugin_manager.cc:108]618662 GetOppPath:Enter get opp path schedule
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.111.720 [plugin_manager.cc:117]618674 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.111.722 [plugin_manager.cc:117]618662 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.111.740 [plugin_manager.cc:624]618662 GetOpTilingForwardOrderPath:Opp plugin path structure is new version!
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.111.739 [plugin_manager.cc:624]618674 GetOpTilingForwardOrderPath:Opp plugin path structure is new version!
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.111.757 [plugin_manager.cc:206]618674 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.111.755 [plugin_manager.cc:206]618662 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.112.214 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.112.211 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:42.112.201 [trs_cb_event.c:119][ascend][curpid:618658,618775][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =65; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:42.112.239 [trs_sqcq.c:1491][ascend][curpid:618658,618775][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:42.112.261 [npu_driver.cc:3833] 618775 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=65, drvRetCode=16.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.112.254 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.112.277 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.112.292 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.112.254 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.112.291 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.112.256 [op_impl_registry_holder_manager.cc:208]618650 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.112.298 [op_impl_registry_holder_manager.cc:216]618650 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:42.112.287 [api_impl.cc:5058] 618775 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.112.307 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.112.318 [op_impl_registry_holder_manager.cc:208]618650 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.112.318 [callback.cpp:132]618775 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.112.338 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.112.344 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.112.350 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.112.360 [op_impl_registry_holder_manager.cc:208]618650 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:42.112.373 [npu_driver.cc:3828] 618775 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=65.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.112.707 [op_impl_space_registry.cc:80]618650 MergeFunctions:op type DecoderKvCache infer_shape func has been registered
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.112.731 [op_impl_space_registry.cc:83]618650 MergeFunctions:op type DecoderKvCache infer_datatype func has been registered
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.112.749 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.112.749 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.112.753 [op_impl_space_registry.cc:80]618650 MergeFunctions:op type PromptKvCache infer_shape func has been registered
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.112.772 [op_impl_space_registry.cc:83]618650 MergeFunctions:op type PromptKvCache infer_datatype func has been registered
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.112.785 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.112.784 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.112.801 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.112.787 [op_impl_space_registry.cc:273]618650 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so] success!
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.112.802 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.112.817 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.112.816 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.112.841 [opp_so_manager.cc:97]618650 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.112.855 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.112.855 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.112.879 [opp_so_manager.cc:97]618650 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.112.906 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.112.906 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.112.924 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.112.924 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.112.936 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.112.938 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.112.953 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.112.952 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.112.973 [plugin_manager.cc:215]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.112.973 [plugin_manager.cc:215]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.112.981 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.113.014 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.113.027 [opp_so_manager.cc:45]618650 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.113.357 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: Conv2DBackpropFilter, registered count: 1
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.113.381 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.113.380 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.113.416 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.113.434 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.113.416 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.113.446 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.113.448 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.113.455 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: Conv2DBackpropInput, registered count: 2
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.113.462 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.113.480 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: Conv2DTranspose, registered count: 3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.113.487 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.113.499 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.113.550 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: Conv2D, registered count: 4
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.113.630 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: Conv3DBackpropInput, registered count: 5
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.113.650 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: Conv3DTranspose, registered count: 6
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.113.721 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: Conv3D, registered count: 7
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.113.738 [op_impl_space_registry.cc:240]618650 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.113.766 [opp_so_manager.cc:48]618650 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.113.865 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.113.884 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.113.883 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: FFN, registered count: 8
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.113.897 [opp_so_manager.cc:45]618650 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.113.897 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.113.897 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.113.903 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: MatmulTunnerTiling, registered count: 9
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.113.933 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.113.934 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.113.951 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.113.952 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.113.964 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.113.966 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.114.001 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.114.002 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.114.030 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: MatMulV2, registered count: 10
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.114.050 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: BatchMatmulFixpipe, registered count: 11
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.114.048 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.114.048 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.114.067 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.114.072 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: MatMulV3, registered count: 12
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.114.067 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.114.083 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.114.091 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: QuantBatchMatmulV3, registered count: 13
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.114.083 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.114.101 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.114.100 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.114.118 [plugin_manager.cc:215]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.114.118 [plugin_manager.cc:215]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.114.267 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: DynamicRNN, registered count: 14
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.114.284 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: MatMulTunnerTiling, registered count: 15
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.114.486 [op_impl_space_registry.cc:240]618650 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.114.513 [opp_so_manager.cc:48]618650 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.114.511 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.114.511 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.114.546 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.114.547 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.114.565 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.114.563 [opp_so_manager.cc:97]618650 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.114.564 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.114.582 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.114.582 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.114.600 [opp_so_manager.cc:97]618650 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.114.619 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.114.620 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.114.693 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.114.711 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.114.723 [opp_so_manager.cc:45]618650 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.115.026 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.115.026 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.115.059 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.115.077 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_v[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.115.072 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.115.089 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
ersion=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.115.104 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.115.109 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.115.141 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.115.142 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.115.182 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.115.182 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.115.199 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.115.199 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.115.211 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.115.213 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.115.230 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.115.227 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.115.246 [plugin_manager.cc:215]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.115.246 [plugin_manager.cc:215]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.115.277 [op_impl_space_registry.cc:240]618650 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.115.302 [opp_so_manager.cc:48]618650 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.115.395 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.115.425 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.115.438 [opp_so_manager.cc:45]618650 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.115.455 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:MatMulV2, funcPointer:0xfffef5c98a10, registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.115.490 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:MatMulV2, funcPointer:0xfffef5c98c70, registered count:1
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.115.642 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.115.642 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.115.676 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.115.676 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.115.694 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.115.707 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.115.693 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.115.706 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.115.740 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.115.740 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.115.944 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.115.994 [op_impl_space_registry.cc:240]618650 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.116.020 [opp_so_manager.cc:48]618650 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.116.065 [opp_so_manager.cc:97]618650 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.116.100 [opp_so_manager.cc:97]618650 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.116.139 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.116.139 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.116.189 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.116.188 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.116.209 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.116.209 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.116.198 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.116.222 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.116.226 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:42.116.191 [trs_cb_event.c:119][ascend][curpid:618658,618774][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =64; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:42.116.230 [trs_sqcq.c:1491][ascend][curpid:618658,618774][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.116.237 [opp_so_manager.cc:45]618650 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:42.116.249 [npu_driver.cc:3833] 618774 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=64, drvRetCode=16.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.116.226 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:42.116.263 [api_impl.cc:5058] 618774 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.116.264 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.116.279 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.116.280 [callback.cpp:132]618774 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.116.299 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:42.116.317 [npu_driver.cc:3828] 618774 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=64.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.116.317 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.116.335 [plugin_manager.cc:1026]618662 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.116.311 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.116.341 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.116.350 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.116.367 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.116.356 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.116.381 [plugin_manager.cc:215]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.116.371 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.116.389 [plugin_manager.cc:215]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.116.456 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.116.771 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.116.771 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.116.791 [op_impl_space_registry.cc:240]618650 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.116.817 [opp_so_manager.cc:48]618650 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.116.806 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.116.806 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.116.823 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.116.824 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.116.840 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.116.839 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.116.875 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.116.875 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.116.912 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.116.931 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.116.944 [opp_so_manager.cc:45]618650 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.117.275 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.117.275 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.117.308 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.117.308 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.117.325 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.117.324 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.117.338 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.117.337 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.117.372 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.117.372 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.117.412 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.117.411 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.117.428 [plugin_manager.cc:1026]618662 GetVersionFro[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.117.428 [plugin_manager.cc:1026]618674 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.117.441 [plugin_manager.cc:322]618674 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
mPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.117.460 [plugin_manager.cc:322]618662 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.117.477 [plugin_manager.cc:212]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.117.455 [plugin_manager.cc:212]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.117.484 [plugin_manager.cc:215]618674 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.117.491 [plugin_manager.cc:215]618662 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.117.499 [plugin_manager.cc:218]618674 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-pack
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.117.494 [op_impl_space_registry.cc:240]618650 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.117.521 [opp_so_manager.cc:48]618650 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aa[INFO] GE(618662,python3.9):2025-04-03-09:27:42.117.506 [plugin_manager.cc:218]618662 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-pack
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.117.522 [plugin_manager.cc:422]618674 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.117.528 [plugin_manager.cc:422]618662 GetOppPluginPathNew:Enter get opp plugin path new schedule
rch64//libcust_opsproto_rt2.0.so
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.117.540 [plugin_manager.cc:155]618674 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.117.544 [plugin_manager.cc:155]618662 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.117.564 [plugin_manager.cc:158]618662 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.117.564 [plugin_manager.cc:158]618674 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.117.580 [plugin_manager.cc:426]618674 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.117.580 [plugin_manager.cc:426]618662 GetOppPluginPathNew:Can not get opp plugin vendors!
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.117.585 [opp_so_manager.cc:97]618650 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.117.622 [opp_so_manager.cc:97]618650 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.117.704 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.117.722 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.117.734 [opp_so_manager.cc:45]618650 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.117.964 [plugin_manager.cc:250]618674 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.117.964 [plugin_manager.cc:250]618662 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.117.999 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.117.999 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.118.016 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.118.017 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.118.032 [plugin_manager.cc:1063]618662 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.118.030 [plugin_manager.cc:1063]618674 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.118.069 [plugin_manager.cc:439]618674 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.118.069 [plugin_manager.cc:439]618662 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.118.195 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : [Tiling][GenSimplifiedKey][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.118.284 [op_impl_space_registry.cc:240]618650 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.118.309 [opp_so_manager.cc:48]618650 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.118.379 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.118.393 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.118.412 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.118.426 [opp_so_manager.cc:45]618650 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.118.444 [plugin_manager.cc:996]618662 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.118.456 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.118.443 [plugin_manager.cc:996]618674 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.118.475 [plugin_manager.cc:1011]618662 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.118.488 [plugin_manager.cc:1011]618674 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.118.497 [plugin_manager.cc:1015]618662 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.118.512 [plugin_manager.cc:1015]618674 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.118.562 [opp_so_manager.cc:123]618662 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.118.562 [opp_so_manager.cc:123]618674 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.118.665 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.118.681 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.118.663 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.118.681 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.118.693 [opp_so_manager.cc:45]618674 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.118.693 [opp_so_manager.cc:45]618662 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.118.848 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.118.977 [op_impl_space_registry.cc:240]618650 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.119.002 [opp_so_manager.cc:48]618650 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.119.047 [opp_so_manager.cc:97]618650 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.119.081 [opp_so_manager.cc:97]618650 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.119.120 [opp_so_manager.cc:97]618650 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/usr/local/Ascend/ascend-toolkit/latest/opp/op_proto/custom/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.119.195 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 0 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.119.242 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.119.274 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.119.286 [opp_so_manager.cc:45]618650 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.119.302 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.119.921 [op_impl_registry_holder_manager.cc:208]618670 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 894
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.120.361 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff283e22c0, registered count:4
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.120.361 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff3d2292c0, registered count:4
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.120.397 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.120.397 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.120.420 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.120.426 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.120.441 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.120.445 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.120.465 [op_check.cc:71]618674 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.120.463 [op_check.cc:71]618662 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.120.760 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff3d22d978, registered count:4
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.120.760 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff283e6978, registered count:4
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.120.784 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.120.785 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.120.805 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.120.802 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.120.822 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.120.820 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.120.836 [op_check.cc:71]618662 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.120.838 [op_check.cc:71]618674 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.121.110 [op_impl_registry_holder_manager.cc:208]618674 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.121.110 [op_impl_registry_holder_manager.cc:208]618662 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.121.138 [op_impl_registry_holder_manager.cc:216]618662 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.121.170 [op_impl_registry_holder_manager.cc:208]618662 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.121.138 [op_impl_registry_holder_manager.cc:216]618674 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.121.156 [op_impl_registry_holder_manager.cc:208]618674 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.121.216 [op_impl_registry_holder_manager.cc:208]618674 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.121.216 [op_impl_registry_holder_manager.cc:208]618662 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.121.456 [op_impl_space_registry.cc:273]618674 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so] success!
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.121.456 [op_impl_space_registry.cc:273]618662 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so] success!
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.121.516 [opp_so_manager.cc:123]618674 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.121.516 [opp_so_manager.cc:123]618662 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.121.624 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.121.642 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.121.625 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.121.642 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.121.654 [opp_so_manager.cc:45]618674 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.121.654 [opp_so_manager.cc:45]618662 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.123.151 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:AllFinite, funcPointer:(nil), registered count:4
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.123.182 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:AllFinite, funcPointer:(nil), registered count:6
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.123.151 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:AllFinite, funcPointer:(nil), registered count:4
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.123.182 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:AllFinite, funcPointer:(nil), registered count:6
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.123.199 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:AllFinite, funcPointer:(nil), registered count:3
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.123.199 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:AllFinite, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.123.217 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:AllFinite, funcPointer:(nil), registered count:3
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.123.216 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:AllFinite, funcPointer:(nil), registered count:3
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.123.236 [op_check.cc:71]618662 RegisterParamGeneralize:RegisterParamGeneralize: op_type:AllFinite, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.123.236 [op_check.cc:71]618674 RegisterParamGeneralize:RegisterParamGeneralize: op_type:AllFinite, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.123.514 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff283939b0, registered count:4
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.123.514 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff3d1da9b0, registered count:4
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.123.537 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.123.538 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.123.556 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.123.555 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.123.571 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.123.573 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.123.590 [op_check.cc:71]618674 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.123.591 [op_check.cc:71]618662 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.123.866 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff28396da0, registered count:4
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.123.879 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff3d1ddda0, registered count:4
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.123.888 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.123.902 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.123.907 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.123.921 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.123.941 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.123.939 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.123.957 [op_check.cc:71]618662 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.123.958 [op_check.cc:71]618674 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.124.221 [op_impl_registry_holder_manager.cc:208]618674 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.124.214 [op_impl_registry_holder_manager.cc:208]618662 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.124.241 [op_impl_registry_holder_manager.cc:216]618662 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.124.246 [op_impl_registry_holder_manager.cc:216]618674 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.124.264 [op_impl_registry_holder_manager.cc:208]618674 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.124.261 [op_impl_registry_holder_manager.cc:208]618662 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.124.299 [op_impl_registry_holder_manager.cc:208]618674 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.124.300 [op_impl_registry_holder_manager.cc:208]618662 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.124.447 [op_impl_registry_holder_manager.cc:208]618670 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.124.623 [op_impl_space_registry.cc:84]618662 MergeFunctions:op type DecoderKvCache tiling_parse func has been registered
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.124.643 [op_impl_space_registry.cc:85]618662 MergeFunctions:op type DecoderKvCache compile_info_creator func has been registered
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.124.623 [op_impl_space_registry.cc:84]618674 MergeFunctions:op type DecoderKvCache tiling_parse func has been registered
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.124.643 [op_impl_space_registry.cc:85]618674 MergeFunctions:op type DecoderKvCache compile_info_creator func has been registered
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.124.655 [op_impl_space_registry.cc:86]618662 MergeFunctions:op type DecoderKvCache compile_info_deleter func has been registered
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.124.655 [op_impl_space_registry.cc:86]618674 MergeFunctions:op type DecoderKvCache compile_info_deleter func has been registered
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.124.669 [op_impl_space_registry.cc:87]618662 MergeFunctions:op type DecoderKvCache tiling func has been registered
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.124.669 [op_impl_space_registry.cc:87]618674 MergeFunctions:op type DecoderKvCache tiling func has been registered
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.124.684 [op_impl_space_registry.cc:93]618674 MergeFunctions:op type DecoderKvCache max_tiling_data_size has been registered
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.124.682 [op_impl_space_registry.cc:93]618662 MergeFunctions:op type DecoderKvCache max_tiling_data_size has been registered
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.124.703 [op_impl_space_registry.cc:84]618674 MergeFunctions:op type PromptKvCache tiling_parse func has been registered
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.124.718 [op_impl_space_registry.cc:85]618674 MergeFunctions:op type PromptKvCache compile_info_creator func has been registered
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.124.703 [op_impl_space_registry.cc:84]618662 MergeFunctions:op type PromptKvCache tiling_parse func has been registered
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.124.719 [op_impl_space_registry.cc:85]618662 MergeFunctions:op type PromptKvCache compile_info_creator func has been registered
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.124.730 [op_impl_space_registry.cc:86]618674 MergeFunctions:op type PromptKvCache compile_info_deleter func has been registered
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.124.731 [op_impl_space_registry.cc:86]618662 MergeFunctions:op type PromptKvCache compile_info_deleter func has been registered
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.124.744 [op_impl_space_registry.cc:87]618662 MergeFunctions:op type PromptKvCache tiling func has been registered
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.124.743 [op_impl_space_registry.cc:87]618674 MergeFunctions:op type PromptKvCache tiling func has been registered
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.124.756 [op_impl_space_registry.cc:93]618674 MergeFunctions:op type PromptKvCache max_tiling_data_size has been registered
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.124.756 [op_impl_space_registry.cc:93]618662 MergeFunctions:op type PromptKvCache max_tiling_data_size has been registered
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.124.771 [op_impl_space_registry.cc:273]618674 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so] success!
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.124.774 [op_impl_space_registry.cc:273]618662 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so] success!
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.124.823 [opp_so_manager.cc:123]618674 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.124.833 [opp_so_manager.cc:123]618662 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.124.872 [opp_so_manager.cc:126]618662 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.124.863 [opp_so_manager.cc:126]618674 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.124.909 [opp_so_manager.cc:123]618662 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.124.912 [opp_so_manager.cc:123]618674 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.125.009 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.125.026 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.125.009 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.125.027 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.125.040 [opp_so_manager.cc:45]618662 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.125.038 [opp_so_manager.cc:45]618674 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.125.602 [op_impl_space_registry.cc:240]618674 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.125.626 [opp_so_manager.cc:48]618674 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.125.602 [op_impl_space_registry.cc:240]618662 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.125.625 [opp_so_manager.cc:48]618662 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.125.667 [opp_so_manager.cc:123]618674 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.125.667 [opp_so_manager.cc:123]618662 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.125.764 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.125.781 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.125.764 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.125.782 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.125.792 [opp_so_manager.cc:45]618674 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.125.795 [opp_so_manager.cc:45]618662 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.126.438 [op_impl_space_registry.cc:240]618662 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.126.463 [opp_so_manager.cc:48]618662 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.126.445 [op_impl_space_registry.cc:240]618674 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.126.467 [opp_so_manager.cc:48]618674 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.126.506 [opp_so_manager.cc:123]618674 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.126.506 [opp_so_manager.cc:123]618662 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.126.542 [opp_so_manager.cc:126]618674 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.126.555 [opp_so_manager.cc:126]618662 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.126.579 [opp_so_manager.cc:123]618674 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.126.591 [opp_so_manager.cc:123]618662 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.126.681 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.126.698 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.126.681 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.126.699 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.126.709 [opp_so_manager.cc:45]618674 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.126.711 [opp_so_manager.cc:45]618662 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.126.719 [operator_factory_impl.cc:368]618654 RegisterInferAxisTypeInfoFunc:axis type info derivation funcs init
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.126.985 [operator_factory_impl.cc:284]618654 RegisterInferDataSliceFunc:operator_infer_data_slice_funcs_ init
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.127.173 [op_impl_space_registry.cc:240]618674 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.127.195 [opp_so_manager.cc:48]618674 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.127.174 [op_impl_space_registry.cc:240]618662 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.127.194 [opp_so_manager.cc:48]618662 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.127.214 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [MatrixBandPart] has registered infer func
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.127.236 [opp_so_manager.cc:123]618674 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.127.236 [opp_so_manager.cc:123]618662 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.127.241 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [CheckNumerics] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.127.259 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [UnravelIndex] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.127.275 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [UpperBound] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.127.292 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [ListDiff] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.127.332 [operator_factory_impl.cc:254]618654 RegisterInferFormatFunc:operator_inferformat_funcs_ init
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.127.330 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.127.348 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.127.330 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.127.347 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.127.360 [opp_so_manager.cc:45]618674 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.127.360 [opp_so_manager.cc:45]618662 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.127.359 [operator_factory_impl.cc:340]618654 RegisterInferAxisSliceFunc:axis slice derivation funcs init
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.127.389 [operator_factory_impl.cc:307]618654 RegisterInferValueRangeFunc:operator_infervalue_paras_ init
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.127.422 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [IdentityN] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.127.445 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [LowerBound] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.127.466 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Expand] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.127.616 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [LeftShift] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.127.948 [op_impl_space_registry.cc:240]618674 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.127.970 [opp_so_manager.cc:48]618674 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.127.949 [op_impl_space_registry.cc:240]618662 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.127.970 [opp_so_manager.cc:48]618662 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.128.011 [opp_so_manager.cc:123]618674 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.128.011 [opp_so_manager.cc:123]618662 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.128.047 [opp_so_manager.cc:126]618674 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.128.048 [opp_so_manager.cc:126]618662 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.128.084 [opp_so_manager.cc:123]618674 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.128.095 [opp_so_manager.cc:123]618662 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.128.196 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.128.214 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.128.196 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.128.215 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.128.225 [opp_so_manager.cc:45]618674 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.128.227 [opp_so_manager.cc:45]618662 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.128.584 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Reciprocal] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.128.616 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Sign] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.128.637 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Div] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.128.660 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Exp] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.128.682 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [LessEqual] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.128.684 [op_impl_space_registry.cc:240]618662 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.128.704 [opp_so_manager.cc:48]618662 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.128.684 [op_impl_space_registry.cc:240]618674 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.128.706 [opp_so_manager.cc:48]618674 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.128.701 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Log1p] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.128.725 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [DivNoNan] has registered infer func
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.128.747 [opp_so_manager.cc:123]618662 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.128.748 [opp_so_manager.cc:123]618674 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.128.769 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Mul] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.128.793 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [SqrtGrad] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.128.812 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Log] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.128.828 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [AddN] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.128.842 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.128.859 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.128.842 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.128.859 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.128.854 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [AcosGrad] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.128.872 [opp_so_manager.cc:45]618662 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.128.872 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [AcoshGrad] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.128.872 [opp_so_manager.cc:45]618674 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.128.904 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [BiasAdd] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.128.937 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [FloorDiv] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.128.960 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [ArgMin] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.129.030 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [MulNoNan] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.129.076 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [AsinGrad] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.129.098 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Cos] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.129.130 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Sin] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.129.163 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [AsinhGrad] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.129.189 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Expm1] has registered infer func
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.129.451 [op_impl_space_registry.cc:240]618662 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.129.474 [opp_so_manager.cc:48]618662 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.129.455 [op_impl_space_registry.cc:240]618674 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.129.475 [opp_so_manager.cc:48]618674 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.129.517 [opp_so_manager.cc:123]618674 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.129.517 [opp_so_manager.cc:123]618662 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.129.554 [opp_so_manager.cc:126]618674 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.129.554 [opp_so_manager.cc:126]618662 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.129.590 [opp_so_manager.cc:123]618674 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.129.602 [opp_so_manager.cc:123]618662 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.129.689 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.129.705 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.129.685 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.129.710 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.129.716 [opp_so_manager.cc:45]618662 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.129.724 [opp_so_manager.cc:45]618674 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.130.162 [op_impl_space_registry.cc:240]618662 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.130.183 [opp_so_manager.cc:48]618662 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.130.165 [op_impl_space_registry.cc:240]618674 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.130.184 [opp_so_manager.cc:48]618674 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.130.224 [opp_so_manager.cc:123]618674 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.130.224 [opp_so_manager.cc:123]618662 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.130.317 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.130.333 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.130.317 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.130.334 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.130.344 [opp_so_manager.cc:45]618674 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.130.346 [opp_so_manager.cc:45]618662 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.130.504 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [AdjustHue] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.130.531 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [AdjustSaturation] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.130.550 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [ExtractGlimpse] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.130.574 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [ResizeArea] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.130.592 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [ResizeBicubic] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.130.609 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [RGBToHSV] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.130.631 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [NonMaxSuppressionWithOverlaps] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.130.671 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [ScaleAndTranslate] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.130.689 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [ScaleAndTranslateGrad] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.130.705 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [CombinedNonMaxSuppression] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.130.813 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [CholeskyGrad] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.130.834 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Cholesky] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.130.850 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [MatrixDeterminant] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.130.867 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [MatrixSolve] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.130.881 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [MatrixTriangularSolve] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.130.897 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Qr] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.130.918 [op_impl_space_registry.cc:240]618674 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.130.914 [op_impl_space_registry.cc:240]618662 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.130.936 [opp_so_manager.cc:48]618662 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.130.938 [opp_so_manager.cc:48]618674 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.130.978 [opp_so_manager.cc:123]618674 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.130.978 [opp_so_manager.cc:123]618662 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.131.014 [opp_so_manager.cc:126]618674 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.131.015 [opp_so_manager.cc:126]618662 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.131.054 [opp_so_manager.cc:123]618674 LoadOpMasterSo:Get path with op_master path [/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.131.054 [opp_so_manager.cc:123]618662 LoadOpMasterSo:Get path with op_master path [/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.131.081 [opp_so_manager.cc:126]618674 LoadOpMasterSo:Get path with op_tiling path [/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.131.092 [opp_so_manager.cc:126]618662 LoadOpMasterSo:Get path with op_tiling path [/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.131.122 [opp_so_manager.cc:123]618662 LoadOpMasterSo:Get path with op_master path [/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.131.114 [opp_so_manager.cc:123]618674 LoadOpMasterSo:Get path with op_master path [/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.131.205 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_ct.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.131.221 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.131.205 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_ct.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.131.222 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 1 libs.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.131.242 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Digamma] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.131.264 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Igamma] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.131.267 [plugin_manager.cc:1126]618674 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.131.283 [plugin_manager.cc:1130]618674 GetFileListWithSuffix:Found 2 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.131.267 [plugin_manager.cc:1126]618662 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.131.284 [plugin_manager.cc:1130]618662 GetFileListWithSuffix:Found 2 libs.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.131.278 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Igammac] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.131.294 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Bincount] has registered infer func
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.131.295 [opp_so_manager.cc:45]618674 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.131.298 [opp_so_manager.cc:45]618662 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.131.309 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Betainc] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.131.325 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Bucketize] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.131.352 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [IgammaGradA] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.131.380 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [NextAfter] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.131.400 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [IsInf] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.131.418 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [IsNan] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.131.432 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Conj] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.131.457 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Complex] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.131.475 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Angle] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.131.717 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [ScatterNdUpdate] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.131.740 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [TensorScatterUpdate] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.131.800 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Tril] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.131.820 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [IndexPut] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.131.834 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Eye] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.131.851 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [FillDiagonal] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.131.864 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Trace] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.132.852 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [DecodeBbox] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.132.882 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [ClipBoxes] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.132.903 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [ClipBoxesD] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.132.925 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [DecodeBoundariesTarget] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.132.945 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [DecodeCornerpointsTargetBG] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.132.959 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [DecodeCornerpointsTargetWrtCenterV1] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.132.977 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [DecodeWheelsTarget] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.133.116 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [SparseSoftmaxCrossEntropyWithLogits] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.133.211 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [KlDivLossGrad] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.133.634 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [FractionalMaxPoolGrad] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.133.657 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [FractionalAvgPool] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.133.688 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [FractionalMaxPool] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.133.703 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [DataFormatVecPermute] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.133.717 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [FractionalAvgPoolGrad] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.133.734 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [NthElement] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.134.255 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Tanh] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.134.617 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Pad] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.134.642 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [PadV3] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.134.661 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [PadV3Grad] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.134.677 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [BroadcastTo] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.134.870 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [RaggedRange] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.135.034 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [ShuffleChannel] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.135.356 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [ReduceSum] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.135.382 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [ReduceProd] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.135.427 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [INInferV2] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.135.445 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [INInferV2] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.136.092 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [UnsortedSegmentSum] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.136.134 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [ReverseV2] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.136.154 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Select] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.136.200 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [SegmentSum] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.136.222 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Slice] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.136.248 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [OneHot] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.136.273 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [ScatterNd] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.136.298 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Cumprod] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.136.354 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [CumulativeLogsumexp] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.136.398 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [MaskedSelect] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.136.849 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Concat] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.137.071 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [NonDeterministicInts] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.137.387 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [Flatten] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.137.420 [operator_factory_impl.cc:222]618654 RegisterInferShapeFunc:op [DepthToSpace] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.093 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.137 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[EluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.164 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.190 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.218 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SyncBNTrainingUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.247 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Abs] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.275 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Real] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.300 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Acos] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.326 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Acosh] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.353 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddMatMatElements] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.381 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Adds] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.409 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Asin] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.435 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Asinh] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.460 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AssignAdd] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.486 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AssignSub] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.512 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Atan] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.538 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Atanh] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.562 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.587 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BesselI0e] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.613 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BesselI1e] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.634 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.658 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.692 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.715 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.742 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Bucketize] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.769 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Cast] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.796 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Ceil] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.824 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CeluV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.854 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ComplexAbs] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.884 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Cos] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.910 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Cosh] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.931 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.957 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DataFormatDimMap] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.138.986 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Dequantize] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.011 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Elu] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.038 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Erf] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.063 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Erfc] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.088 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Exp] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.115 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Expm1] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.142 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FakeQuantWithMinMaxVars] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.167 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FastGelu] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.194 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FastGeluV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.221 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Floor] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.250 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FusedMulAddN] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.278 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HardSigmoid] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.304 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HardShrink] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.330 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HardShrinkGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.363 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HardSwish] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.389 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HardSwishGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.414 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HardtanhGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.440 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IndexFillD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.463 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.485 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.515 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Inv] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.541 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Invert] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.568 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Log] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.594 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Log1p] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.620 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LogicalNot] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.657 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LogAddExp] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.682 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LpNormUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.710 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LpNormUpdateV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.736 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Dawsn] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.762 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Expint] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.787 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Erfinv] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.812 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FresnelCos] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.838 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FresnelSin] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.865 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Ndtri] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.891 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Spence] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.917 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Fills] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.944 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LeakyRelu] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.969 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[OnesLike] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.139.995 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Reciprocal] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.031 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Sign] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.059 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Sqrt] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.085 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Tanh] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.112 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ZerosLike] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.139 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Gelu] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.182 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GeluV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.214 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Relu] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.240 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Neg] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.266 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LogSoftmaxV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.289 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.315 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftmaxV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.337 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.362 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftplusV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.392 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Muls] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.420 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Power] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.446 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Relu6] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.474 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Relu6D] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.502 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Relu6Grad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.527 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.553 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Rint] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.580 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Round] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.605 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Rsqrt] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.631 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RsqrtGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.656 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Selu] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.681 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Shrink] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.713 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Sigmoid] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.738 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.767 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SigmoidGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.794 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Sin] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.820 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Sinh] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.846 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SmoothL1Loss] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.871 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SmoothL1LossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.897 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LogSigmoid] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.922 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LogSigmoidGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.947 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LogSpaceD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.972 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Softplus] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.140.997 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Softsign] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.023 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SqrtGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.049 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Square] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.076 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Swish] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.101 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwishGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.128 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SiluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.154 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardElemt] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.180 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Tan] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.210 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftShrink] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.241 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftShrinkGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.266 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Threshold] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.291 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ThresholdV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.317 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ThresholdV2D] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.342 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Trunc] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.371 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.394 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.425 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MishGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.452 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HardSigmoidGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.474 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.495 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.519 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.542 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.567 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FillDiagonal] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.594 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IndexPut] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.620 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReadVariableOp] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.646 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CastLike] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.673 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FusedBiasLeakyRelu] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.699 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StatelessBernoulliV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.722 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.749 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InvertPermutation] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.772 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.796 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SearchSorted] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.818 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.841 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.863 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.885 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.141.910 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.052 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaskedScale] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.093 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AbsGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.121 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AccumulateNV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.148 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddN] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.174 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Eltwise] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.199 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.230 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AcosGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.257 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AcoshGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.284 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AsinGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.309 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AsinhGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.335 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Atan2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.361 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AtanGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.387 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Axpy] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.413 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BitwiseAnd] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.439 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BitwiseOr] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.464 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BitwiseXor] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.492 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Div] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.517 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DivNoNan] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.543 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[EluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.568 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FastGeluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.596 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FloorDiv] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.621 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FloorMod] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.647 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InvGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.674 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LeakyReluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.700 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TanhGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.726 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Add] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.759 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Addcdiv] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.786 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Addcmul] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.814 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AxpyV2] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.839 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LogicalAnd] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.866 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LogicalOr] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.892 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Mul] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.918 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Pow] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.949 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RealDiv] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.142.975 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ClipByNormNoDivSum] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.004 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ClipByValue] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.029 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ClipByValueV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.055 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FusedMulAdd] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.084 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftmaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.111 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Sub] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.138 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Gcd] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.164 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LarsV2Update] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.191 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaskedFill] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.217 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.243 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Xlog1py] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.270 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApproximateEqual] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.297 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Equal] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.323 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NotEqual] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.350 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Greater] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.375 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GreaterEqual] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.400 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Less] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.431 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LessEqual] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.459 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Maximum] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.484 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Minimum] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.514 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Mod] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.538 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.564 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MulNoNan] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.589 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReciprocalGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.614 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SeluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.639 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogits] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.665 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftplusGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.689 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftplusV2Grad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.714 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftsignGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.740 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SquaredDifference] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.762 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.790 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ThresholdGradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.815 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TruncateDiv] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.840 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TruncateMod] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.866 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Xdivy] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.893 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IsClose] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.923 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Xlogy] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.946 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.971 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SelectV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.143.997 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaskedSelectV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.144.022 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Lerp] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.144.048 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FusedBiasLeakyReluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.144.058 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.144.059 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [][]
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:42.144.190 [trs_cb_event.c:119][ascend][curpid:618662,618816][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =832; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:42.144.190 [trs_cb_event.c:119][ascend][curpid:618662,618817][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =833; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:42.144.229 [trs_sqcq.c:1491][ascend][curpid:618662,618816][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.144.214 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [InferShape][InferDataType]
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:42.144.237 [trs_sqcq.c:1491][ascend][curpid:618662,618817][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:42.144.250 [npu_driver.cc:3833] 618816 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=832, drvRetCode=16.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:42.144.259 [npu_driver.cc:3833] 618817 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=833, drvRetCode=16.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:42.144.279 [api_impl.cc:5058] 618816 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:42.144.311 [api_impl.cc:5058] 618817 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.144.322 [callback.cpp:132]618816 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.144.330 [callback.cpp:132]618817 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.144.332 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [InferShape][InferDataType]
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.144.346 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.144.348 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.144.368 [npu_driver.cc:3828] 618817 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=833.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.144.368 [npu_driver.cc:3828] 618816 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=832.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.144.446 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.144.560 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.144.704 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.144.733 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.144.767 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.144.792 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.144.858 [op_impl_registry_holder_manager.cc:208]618662 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 1
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.144.915 [op_impl_registry_holder_manager.cc:208]618662 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 1
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.144.917 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.144.946 [op_impl_registry_holder_manager.cc:208]618662 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 11
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.145.026 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.145.136 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.145.260 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.145.369 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.145.507 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.145.628 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Quantize] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.145.656 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.145.683 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AscendDequant] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.145.709 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.145.817 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.145.785 [op_impl_space_registry.cc:273]618670 ConvertSoToRegistry:Save so symbol and handle in path[/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so] success!
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.145.938 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.145.898 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.145.947 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[EluGradV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.145.945 [op_impl_registry_holder_manager.cc:208]618674 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 1
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.145.972 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.145.967 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.145.990 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.145.994 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.145.994 [op_impl_registry_holder_manager.cc:208]618674 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 1
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.013 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SyncBNTrainingUpdate] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.146.022 [op_impl_registry_holder_manager.cc:208]618674 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 11
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.146.017 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.035 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Abs] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.146.052 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.056 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Real] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.078 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Acos] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.146.082 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BasicLSTMInplaceFillWindowCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.098 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Acosh] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.146.109 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BasicGRUInplaceFillWindowCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.119 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddMatMatElements] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.139 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Adds] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.159 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Asin] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.146.154 [plugin_manager.cc:554]618670 GetUpgradedOpsProtoPath:Start to get upgraded ops proto path
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.146.179 [plugin_manager.cc:134]618670 GetUpgradedOppPath:Enter get upgraded opp path schedule
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.179 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Asinh] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.200 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AssignAdd] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.220 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AssignSub] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.146.229 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : [InferShape]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.146.233 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /usr/local/Ascend/ascend-toolkit/latest/opp_latest/, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.240 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Atan] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.146.252 [plugin_manager.cc:145]618670 GetUpgradedOppPath:[Call][RealPath] Opp path /usr/local/Ascend/ascend-toolkit/latest/opp_latest/ is invalid.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.146.267 [plugin_manager.cc:557]618670 GetUpgradedOpsProtoPath:Failed to get upgraded opp path!
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.261 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Atanh] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.146.281 [plugin_manager.cc:108]618670 GetOppPath:Enter get opp path schedule
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.282 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.303 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BesselI0e] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.146.310 [plugin_manager.cc:117]618670 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.323 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BesselI1e] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.343 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.146.347 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.364 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.386 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.407 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.446 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Bucketize] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.467 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Cast] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.146.482 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.487 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Ceil] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.508 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CeluV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.529 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ComplexAbs] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.547 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Cos] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.569 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Cosh] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.589 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.146.597 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.609 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DataFormatDimMap] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.146.626 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.630 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Dequantize] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.652 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Elu] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.673 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Erf] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.694 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Erfc] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.714 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Exp] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.734 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Expm1] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.754 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FakeQuantWithMinMaxVars] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.146.755 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdaCast] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.774 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FastGelu] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.794 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FastGeluV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.813 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Floor] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.833 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FusedMulAddN] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.853 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HardSigmoid] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.146.867 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.873 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HardShrink] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.894 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HardShrinkGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.146.895 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.915 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HardSwish] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.146.920 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.937 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HardSwishGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.146.943 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.958 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HardtanhGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.146.979 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IndexFillD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.006 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.027 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.047 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Inv] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.147.047 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.067 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Invert] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.088 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Log] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.109 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Log1p] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.147.116 [plugin_manager.cc:996]618670 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.131 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LogicalNot] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.151 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LogAddExp] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.171 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LpNormUpdate] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.147.172 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.147.182 [plugin_manager.cc:1011]618670 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.191 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LpNormUpdateV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.147.207 [plugin_manager.cc:1015]618670 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.211 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Dawsn] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.231 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Expint] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.250 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Erfinv] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.270 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FresnelCos] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.290 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FresnelSin] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.147.289 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.147.294 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.147.312 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.311 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Ndtri] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.331 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Spence] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.352 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Fills] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.147.368 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.147.384 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.374 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LeakyRelu] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.394 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[OnesLike] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.147.398 [opp_so_manager.cc:66]618670 LoadOpMasterPackage:Start load op master package, is_split:[1].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.147.403 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.147.416 [plugin_manager.cc:616]618670 GetOpTilingForwardOrderPath:Enter GetOpTilingPath schedule
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.415 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Reciprocal] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.147.429 [plugin_manager.cc:108]618670 GetOppPath:Enter get opp path schedule
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.147.430 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.438 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Sign] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.147.455 [plugin_manager.cc:117]618670 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.458 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Sqrt] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.147.475 [plugin_manager.cc:624]618670 GetOpTilingForwardOrderPath:Opp plugin path structure is new version!
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.478 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Tanh] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.499 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ZerosLike] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.147.493 [plugin_manager.cc:206]618670 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.521 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Gelu] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.147.540 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.540 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GeluV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.568 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Relu] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.589 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Neg] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.609 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LogSoftmaxV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.628 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.648 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.147.652 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.668 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.147.671 [op_impl_space_registry.cc:273]618662 ConvertSoToRegistry:Save so symbol and handle in path[/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_ct.so] success!
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.147.681 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.688 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftplusV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.709 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Muls] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.728 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Power] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.748 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Relu6] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.767 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Relu6D] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.787 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Relu6Grad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.147.795 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.807 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReluGradV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.827 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Rint] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.847 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Round] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.866 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Rsqrt] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.885 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RsqrtGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.147.895 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.905 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Selu] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.924 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Shrink] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.147.914 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.147.935 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.942 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Sigmoid] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.147.953 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.147.967 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.962 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.147.982 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SigmoidGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.004 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Sin] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.148.017 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.024 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Sinh] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.044 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SmoothL1Loss] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.148.047 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.064 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SmoothL1LossGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.092 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LogSigmoid] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.112 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LogSigmoidGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.132 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LogSpaceD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.152 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Softplus] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.148.179 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.148.209 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.204 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Softsign] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.224 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SqrtGrad] register OP_IMPL : []
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:42.148.203 [trs_cb_event.c:119][ascend][curpid:618674,618818][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =64; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:42.148.233 [trs_cb_event.c:119][ascend][curpid:618674,618819][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =65; ret=16)
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.244 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Square] register OP_IMPL : []
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:42.148.236 [trs_sqcq.c:1491][ascend][curpid:618674,618818][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:42.148.257 [trs_sqcq.c:1491][ascend][curpid:618674,618819][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:42.148.265 [npu_driver.cc:3833] 618818 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:42.148.270 [npu_driver.cc:3833] 618819 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=65, drvRetCode=16.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.265 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Swish] register OP_IMPL : []
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:42.148.286 [api_impl.cc:5058] 618819 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:42.148.286 [api_impl.cc:5058] 618818 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.287 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwishGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.313 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SiluGrad] register OP_IMPL : []
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.148.320 [callback.cpp:132]618818 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.148.322 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[L2Loss] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.336 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardElemt] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.360 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Tan] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.382 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftShrink] register OP_IMPL : []
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.148.344 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.148.365 [npu_driver.cc:3828] 618818 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=64.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.148.379 [callback.cpp:132]618819 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.404 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftShrinkGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.425 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Threshold] register OP_IMPL : []
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.148.423 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.148.420 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.148.435 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.451 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ThresholdV2] register OP_IMPL : []
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.148.456 [npu_driver.cc:3828] 618819 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=65.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.148.462 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.474 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ThresholdV2D] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.148.480 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.148.495 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.493 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Trunc] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.516 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.148.532 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.538 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.148.557 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.560 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MishGrad] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.148.577 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.582 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HardSigmoidGrad] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.148.595 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.148.612 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.605 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.148.627 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.626 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.148.647 [plugin_manager.cc:215]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.649 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.148.665 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.672 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.693 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FillDiagonal] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.723 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IndexPut] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.750 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReadVariableOp] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.772 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CastLike] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.148.781 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.795 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FusedBiasLeakyRelu] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.148.766 [op_impl_space_registry.cc:273]618674 ConvertSoToRegistry:Save so symbol and handle in path[/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_ct.so] success!
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.819 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StatelessBernoulliV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.842 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.864 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InvertPermutation] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.890 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.148.892 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.911 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SearchSorted] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.148.923 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceAny] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.932 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.954 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.148.954 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceAll] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.148.981 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.148.982 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceMax] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.148.992 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.003 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.149.006 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.149.026 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.026 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.149.034 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceMeanWithCast] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.149.043 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.149.058 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.149.061 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceMin] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.149.087 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceProd] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.149.105 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.149.116 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.133 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaskedScale] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.149.146 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[EuclideanNorm] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.160 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AbsGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.149.173 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceLogSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.183 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AccumulateNV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.149.200 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceLogSumExp] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.205 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddN] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.232 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Eltwise] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.254 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.276 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AcosGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.298 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AcoshGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.149.312 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceNansum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.319 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AsinGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.341 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AsinhGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.364 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Atan2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.385 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AtanGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.413 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Axpy] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.149.426 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.437 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BitwiseAnd] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.149.450 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.459 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BitwiseOr] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.149.451 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.481 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BitwiseXor] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.149.483 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.149.488 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.149.500 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.503 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Div] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.149.514 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.149.511 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.530 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DivNoNan] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.149.534 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.149.551 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.553 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[EluGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.149.557 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.574 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FastGeluGrad] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.149.588 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.597 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FloorDiv] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.149.605 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.149.618 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.149.632 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.620 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FloorMod] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.645 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InvGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.149.647 [plugin_manager.cc:215]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.669 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LeakyReluGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.692 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TanhGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.149.692 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.715 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Add] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.737 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Addcdiv] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.758 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Addcmul] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.780 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AxpyV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.802 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LogicalAnd] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.149.809 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.824 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LogicalOr] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.847 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Mul] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.868 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Pow] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.889 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RealDiv] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.911 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ClipByNormNoDivSum] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.149.924 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.935 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ClipByValue] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.149.950 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.960 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ClipByValueV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.149.984 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FusedMulAdd] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.149.987 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.006 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftmaxGrad] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.150.019 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.150.036 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.036 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Sub] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.150.050 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.060 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Gcd] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.150.059 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.083 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LarsV2Update] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.150.088 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.105 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaskedFill] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.128 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReluGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.150 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Xlog1py] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.150.173 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [InferShape][InferShapeRange][InferDataType][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.176 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApproximateEqual] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.200 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Equal] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.150.203 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SplitD] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.222 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NotEqual] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.150.228 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.243 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Greater] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.268 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GreaterEqual] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.290 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Less] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.311 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LessEqual] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.333 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Maximum] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.150.350 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.358 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Minimum] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.382 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Mod] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.404 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.426 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MulNoNan] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.150.429 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.449 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReciprocalGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.150.465 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : [InferShape]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.150.461 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.475 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SeluGrad] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.150.488 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.497 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogits] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.150.503 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.520 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftplusGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.150.542 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.547 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftplusV2Grad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.570 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftsignGrad] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.150.579 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.150.585 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.591 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SquaredDifference] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.150.595 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.150.612 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.613 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.150.628 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.642 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ThresholdGradV2D] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.150.644 [plugin_manager.cc:215]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.665 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TruncateDiv] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.688 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TruncateMod] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.150.701 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.710 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Xdivy] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.732 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IsClose] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.753 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Xlogy] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.775 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.150.747 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.802 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SelectV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.150.814 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.823 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaskedSelectV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.847 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Lerp] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.869 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FusedBiasLeakyReluGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.150.896 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.150.926 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.150.970 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.150.980 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.151.012 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.151.029 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.151.041 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.151.044 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.151.076 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.151.073 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.151.090 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.151.155 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.151.172 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.151.178 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.151.270 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.151.286 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.151.321 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.151.379 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.151.396 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.151.416 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.151.430 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [][]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.151.447 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.151.456 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.151.461 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.151.465 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.151.483 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.151.481 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.151.514 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.151.518 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.151.540 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.151.563 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.151.564 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.151.580 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.151.582 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.151.594 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.151.611 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.151.626 [plugin_manager.cc:215]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.151.683 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.151.688 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.151.792 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.151.798 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.151.825 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.151.896 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.151.933 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.151.963 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.151.994 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.152.011 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.152.004 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.152.026 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.152.042 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.152.063 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.152.111 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.152.101 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.152.151 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.152.218 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.152.220 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Quantize] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.152.264 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.152.281 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.152.289 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AscendDequant] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.152.314 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.152.401 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.152.412 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.152.429 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.152.440 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.152.476 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.152.493 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.152.492 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [Tiling][TilingParse]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.152.506 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.152.514 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.152.539 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.152.544 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.152.547 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.152.562 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.152.575 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MlaAttentionScore] register OP_IMPL : [OpExecuteFunc]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.152.581 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.152.589 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.152.599 [plugin_manager.cc:1026]618670 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.152.612 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [][]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.152.617 [plugin_manager.cc:322]618670 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.152.646 [plugin_manager.cc:212]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.152.634 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BasicLSTMInplaceFillWindowCache] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.152.656 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BasicGRUInplaceFillWindowCache] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.152.662 [plugin_manager.cc:215]618670 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.152.661 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.152.678 [plugin_manager.cc:218]618670 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-pack
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.152.702 [plugin_manager.cc:422]618670 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.152.719 [plugin_manager.cc:155]618670 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.152.738 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [Tiling][TilingParse]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.152.743 [plugin_manager.cc:158]618670 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.152.759 [plugin_manager.cc:426]618670 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.152.759 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.152.772 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.152.864 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.152.888 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.152.915 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.152.971 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.152.981 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [HostInputs][OpExecuteFunc]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.153.023 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.153.076 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.153.090 [plugin_manager.cc:250]618670 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.153.102 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.153.123 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.153.140 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.153.151 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [Tiling][TilingDependency][TilingDependencyPlacement][TilingParse]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.153.145 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.153.153 [plugin_manager.cc:1063]618670 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.153.194 [plugin_manager.cc:439]618670 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.153.208 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdaCast] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.153.252 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.153.308 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.153.336 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.153.360 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.153.363 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.153.382 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.153.473 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.153.481 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.153.520 [plugin_manager.cc:996]618670 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.153.549 [plugin_manager.cc:1011]618670 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.153.570 [plugin_manager.cc:1015]618670 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.153.579 [op_tiling_manager.cc:79]618646 LoadSo:dlopen file /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so successfully!
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.153.579 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.153.589 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.153.625 [opp_so_manager.cc:123]618670 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.153.628 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.153.654 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.153.685 [op_tiling_manager.cc:58]618646 LoadSo:[FindSo][Check] Get path with op_master [/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_master/] failed
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.153.685 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.153.736 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.153.753 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.153.764 [opp_so_manager.cc:45]618670 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.153.781 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.153.788 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.153.806 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.153.815 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.153.831 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.153.854 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.153.877 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.153.899 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.153.921 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.153.924 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : []
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.153.939 [op_tiling_manager.cc:67]618646 LoadSo:Failed to dlopen /usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.153.943 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.153.965 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : [InferShape]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.153.986 [op_tiling_manager.cc:73]618646 LoadSo:Failed to dlopen /usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.153.987 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.154.011 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.154.033 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.154.030 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : []
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.154.047 [op_tiling_manager.cc:58]618646 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.154.055 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.154.058 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.154.078 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : [InferShape]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.154.105 [op_tiling_manager.cc:67]618646 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.154.103 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.154.125 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.154.145 [op_tiling_manager.cc:73]618646 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.154.148 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.154.164 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.154.186 [op_tiling_manager.cc:58]618646 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.154.241 [op_tiling_manager.cc:67]618646 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.154.265 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.154.269 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SegmentSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.154.365 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.154.380 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.154.466 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.154.493 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.154.493 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.154.590 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[L2Loss] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.154.603 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.154.694 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.154.720 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.154.794 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.154.860 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.154.898 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.154.976 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UnsortedSegmentMax] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.154.998 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.155.007 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UnsortedSegmentMin] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.155.035 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UnsortedSegmentProd] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.155.059 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.155.101 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.155.128 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceAny] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.155.153 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceAll] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.155.167 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdamApplyOne] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.155.176 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceMax] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.155.198 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.155.200 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdamApplyOneAssign] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.155.225 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceMeanWithCast] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.155.228 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecay] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.155.236 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:AllFinite, funcPointer:(nil), registered count:2
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.155.249 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceMin] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.155.258 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecayAssign] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.155.269 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:AllFinite, funcPointer:(nil), registered count:4
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.155.275 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceProd] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.155.290 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:AllFinite, funcPointer:(nil), registered count:1
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.155.297 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceSum] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.155.309 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:AllFinite, funcPointer:(nil), registered count:1
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.155.327 [op_check.cc:71]618646 RegisterParamGeneralize:RegisterParamGeneralize: op_type:AllFinite, funcPointer:(nil), registered count:1
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.155.320 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[EuclideanNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.155.344 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceLogSum] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.155.366 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceLogSumExp] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.155.372 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BN3DTrainingReduce] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.155.397 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.155.421 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.155.442 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.155.469 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceNansum] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.155.502 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff31b622c0, registered count:4
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.155.540 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.155.552 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNTrainingReduce] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.155.568 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.155.588 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.155.587 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.155.614 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.155.611 [op_check.cc:71]618670 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.155.637 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.155.641 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff242319b0, registered count:3
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.155.660 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.155.665 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:5
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.155.670 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.155.684 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:2
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.155.683 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.155.702 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:2
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.155.707 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.155.717 [op_check.cc:71]618646 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:2
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.155.782 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.155.803 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.155.890 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.155.902 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.155.917 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff31b66978, registered count:4
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.155.942 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.155.962 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.155.982 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.155.999 [op_check.cc:71]618670 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.156.000 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.156.000 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.156.013 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff24234da0, registered count:4
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.156.027 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.156.036 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.156.055 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.156.075 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.156.090 [op_check.cc:71]618646 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.156.109 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.156.129 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.156.237 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.156.256 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.156.288 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SplitD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.156.297 [op_impl_registry_holder_manager.cc:208]618670 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.156.311 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [][]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.156.330 [op_impl_registry_holder_manager.cc:216]618670 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.156.360 [op_impl_registry_holder_manager.cc:208]618670 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.156.377 [op_tiling_manager.cc:75]618646 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.156.398 [op_impl_registry_holder_manager.cc:208]618670 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.156.397 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.156.415 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.156.434 [op_tiling_manager.cc:58]618646 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.156.513 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.156.512 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.156.548 [op_tiling_manager.cc:67]618646 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.156.620 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.156.631 [op_impl_space_registry.cc:273]618670 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so] success!
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.156.652 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : [InferShape]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.156.692 [opp_so_manager.cc:123]618670 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.156.722 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.156.761 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.156.802 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.156.819 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.156.831 [opp_so_manager.cc:45]618670 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.156.828 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.156.875 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[INTrainingReduceV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.156.927 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.156.991 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.157.025 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[INTrainingUpdateGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.157.025 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.157.052 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[INTrainingUpdateGradGammaBeta] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.157.080 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[INTrainingUpdateV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.157.129 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.157.185 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.157.230 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.157.297 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.157.297 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff241eb2c0, registered count:4
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.157.328 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.157.327 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.157.348 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.157.363 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.157.377 [op_check.cc:71]618646 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.157.412 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.157.439 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.157.475 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.157.499 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.157.522 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.157.593 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.157.628 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.157.685 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff241ef978, registered count:4
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.157.696 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.157.707 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.157.724 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.157.721 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.157.741 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.157.755 [op_check.cc:71]618646 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.157.749 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.157.821 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.157.864 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.157.920 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.157.978 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPool] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.158.025 [op_tiling_manager.cc:75]618646 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.158.029 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : []
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.158.103 [op_tiling_manager.cc:58]618646 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.158.107 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPool3D] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.158.128 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : []
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.158.184 [op_tiling_manager.cc:67]618646 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.158.222 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.158.228 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.158.232 [op_tiling_manager.cc:73]618646 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.158.254 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : []
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.158.282 [op_tiling_manager.cc:58]618646 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.158.329 [op_tiling_manager.cc:67]618646 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.158.345 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPoolV3] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.158.353 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.158.360 [op_tiling_manager.cc:75]618646 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.158.354 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:AllFinite, funcPointer:(nil), registered count:4
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.158.388 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:AllFinite, funcPointer:(nil), registered count:6
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.158.399 [op_tiling_manager.cc:58]618646 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.158.409 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:AllFinite, funcPointer:(nil), registered count:3
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.158.429 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:AllFinite, funcPointer:(nil), registered count:3
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.158.440 [op_tiling_manager.cc:67]618646 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.158.448 [op_check.cc:71]618670 RegisterParamGeneralize:RegisterParamGeneralize: op_type:AllFinite, funcPointer:(nil), registered count:3
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.158.451 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.158.457 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.158.471 [op_tiling_manager.cc:75]618646 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.158.507 [op_tiling_manager.cc:58]618646 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.158.542 [op_tiling_manager.cc:67]618646 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.158.559 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.158.576 [op_tiling_manager.cc:73]618646 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.158.569 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaximumGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.158.599 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MinimumGrad] register OP_IMPL : [InferShape]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.158.612 [op_tiling_manager.cc:58]618646 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.158.650 [op_tiling_manager.cc:67]618646 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.158.664 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.158.683 [op_tiling_manager.cc:75]618646 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.158.690 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.158.721 [op_tiling_manager.cc:58]618646 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.158.711 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.158.730 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff31b139b0, registered count:4
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.158.759 [op_tiling_manager.cc:67]618646 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.158.755 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.158.775 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.158.791 [op_tiling_manager.cc:75]618646 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.158.794 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.158.790 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.158.810 [op_check.cc:71]618670 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.158.826 [op_tiling_manager.cc:58]618646 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.158.835 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LogSoftmaxGrad] register OP_IMPL : [InferShape]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.158.867 [op_tiling_manager.cc:67]618646 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.158.864 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.158.889 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.158.905 [op_tiling_manager.cc:73]618646 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.158.900 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.158.931 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftMarginLoss] register OP_IMPL : [InferShape]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.158.942 [op_tiling_manager.cc:58]618646 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.158.956 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : [InferShape]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.158.979 [op_tiling_manager.cc:67]618646 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.158.983 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftmaxFocalLoss] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.158.991 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.159.008 [op_tiling_manager.cc:75]618646 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.159.007 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.159.032 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : [InferShape]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.159.051 [op_tiling_manager.cc:58]618646 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.159.090 [op_tiling_manager.cc:67]618646 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.159.089 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.159.086 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff31b16da0, registered count:4
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.159.119 [op_tiling_manager.cc:75]618646 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.159.122 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.159.142 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.159.141 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : [InferShape]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.159.154 [op_tiling_manager.cc:58]618646 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.159.162 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.159.171 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Mish] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.159.180 [op_check.cc:71]618670 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.159.189 [op_tiling_manager.cc:67]618646 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.159.190 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.159.225 [op_tiling_manager.cc:73]618646 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/liboptiling.so: cannot open shared object file: No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.159.259 [op_tiling_manager.cc:58]618646 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/] failed
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.159.293 [op_tiling_manager.cc:67]618646 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.159.293 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.159.293 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.159.321 [op_tiling_manager.cc:75]618646 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.159.322 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.159.355 [op_tiling_manager.cc:58]618646 LoadSo:[FindSo][Check] Get path with op_master [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/] failed
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.159.348 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.159.391 [op_tiling_manager.cc:67]618646 LoadSo:Failed to dlopen /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so! errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/liboptiling.so: cannot open shared object file: No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.159.406 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.159.425 [op_tiling_manager.cc:75]618646 LoadSo:dlopen file /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so successfully!
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.159.431 [op_impl_registry_holder_manager.cc:208]618670 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.159.442 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [][]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.159.458 [op_impl_registry_holder_manager.cc:216]618670 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.159.477 [op_impl_registry_holder_manager.cc:208]618670 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.159.476 [op_tiling_manager.cc:109]618646 ~FuncPerfScope:[GEPERFTRACE] The time cost of OpTilingManager::LoadSo is [199939] micro seconds.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.159.472 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.159.511 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.159.516 [op_impl_registry_holder_manager.cc:208]618670 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.159.515 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.159.535 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.159.558 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.159.582 [plugin_manager.cc:639]618646 GetConstantFoldingOpsPath:Enter GetConstantFoldingOpsPath schedule
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.159.581 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.159.599 [plugin_manager.cc:108]618646 GetOppPath:Enter get opp path schedule
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.159.605 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.159.624 [plugin_manager.cc:117]618646 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.159.632 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.159.631 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.159.657 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.159.684 [host_cpu_engine.cc:254]618646 LoadLib:To invoke dlopen on lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libconstant_folding_ops.so
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.159.680 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.159.701 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.159.723 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.159.744 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.159.745 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.159.766 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.159.789 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.159.812 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [][]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.159.810 [op_impl_space_registry.cc:84]618670 MergeFunctions:op type DecoderKvCache tiling_parse func has been registered
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.159.831 [op_impl_space_registry.cc:85]618670 MergeFunctions:op type DecoderKvCache compile_info_creator func has been registered
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.159.837 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.159.844 [op_impl_space_registry.cc:86]618670 MergeFunctions:op type DecoderKvCache compile_info_deleter func has been registered
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.159.859 [op_impl_space_registry.cc:87]618670 MergeFunctions:op type DecoderKvCache tiling func has been registered
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.159.872 [op_impl_space_registry.cc:93]618670 MergeFunctions:op type DecoderKvCache max_tiling_data_size has been registered
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.159.871 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftmaxCrossEntropyWithLogits] register OP_IMPL : [InferShape]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.159.892 [op_impl_space_registry.cc:84]618670 MergeFunctions:op type PromptKvCache tiling_parse func has been registered
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.159.909 [op_impl_space_registry.cc:85]618670 MergeFunctions:op type PromptKvCache compile_info_creator func has been registered
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.159.920 [op_impl_space_registry.cc:86]618670 MergeFunctions:op type PromptKvCache compile_info_deleter func has been registered
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.159.932 [op_impl_space_registry.cc:87]618670 MergeFunctions:op type PromptKvCache tiling func has been registered
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.159.946 [op_impl_space_registry.cc:93]618670 MergeFunctions:op type PromptKvCache max_tiling_data_size has been registered
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.159.937 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SegmentSum] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.159.961 [op_impl_space_registry.cc:273]618670 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so] success!
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.159.983 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.160.010 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.160.016 [opp_so_manager.cc:123]618670 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.160.035 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [][]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.160.066 [opp_so_manager.cc:126]618670 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.160.105 [opp_so_manager.cc:123]618670 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.160.115 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.160.142 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.160.237 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.160.257 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.160.256 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.160.268 [opp_so_manager.cc:45]618670 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.160.358 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.160.458 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.160.559 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UnsortedSegmentMax] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.160.585 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UnsortedSegmentMin] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.160.609 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UnsortedSegmentProd] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.160.633 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.160.734 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdamApplyOne] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.160.776 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdamApplyOneAssign] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.160.799 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecay] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.160.821 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecayAssign] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.160.821 [op_impl_space_registry.cc:240]618670 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.160.846 [opp_so_manager.cc:48]618670 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.160.893 [opp_so_manager.cc:123]618670 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.160.924 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BN3DTrainingReduce] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.160.949 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.160.971 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.160.990 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.161.007 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.160.995 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.161.022 [opp_so_manager.cc:45]618670 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.161.096 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNTrainingReduce] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.161.200 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.161.300 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.161.399 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.161.499 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.161.600 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.161.651 [op_impl_space_registry.cc:240]618670 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.161.676 [opp_so_manager.cc:48]618670 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.161.699 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.161.719 [opp_so_manager.cc:123]618670 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.161.756 [opp_so_manager.cc:126]618670 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.161.802 [opp_so_manager.cc:123]618670 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.161.808 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.161.894 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.161.910 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.161.921 [opp_so_manager.cc:45]618670 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.161.915 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.162.015 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.162.118 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.162.216 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[INTrainingReduceV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.162.316 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.162.342 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[INTrainingUpdateGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.162.365 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[INTrainingUpdateGradGammaBeta] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.162.363 [op_impl_space_registry.cc:240]618670 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.162.387 [opp_so_manager.cc:48]618670 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.162.392 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[INTrainingUpdateV2] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.162.427 [opp_so_manager.cc:123]618670 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.162.490 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.162.520 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.162.536 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.162.547 [opp_so_manager.cc:45]618670 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.162.590 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.162.702 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.162.722 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.162.812 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.162.849 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.162.909 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.162.967 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.163.016 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.163.088 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.163.110 [op_impl_space_registry.cc:240]618670 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.163.118 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [][]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.163.134 [opp_so_manager.cc:48]618670 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.163.173 [opp_so_manager.cc:123]618670 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.163.202 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.163.209 [opp_so_manager.cc:126]618670 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.163.218 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPool] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.163.245 [opp_so_manager.cc:123]618670 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.163.323 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPool3D] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.163.345 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.163.362 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.163.335 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyAdadeltaD] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.163.376 [opp_so_manager.cc:45]618670 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.163.379 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.163.408 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyAdagradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.163.425 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.163.435 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyAdaMaxD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.163.463 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyAdamD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.163.489 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.163.516 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.163.528 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPoolV3] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.163.541 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyAddSignD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.163.567 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyCenteredRMSPropD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.163.593 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyFtrlD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.163.621 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyFtrlV2D] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.163.631 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.163.647 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyGradientDescent] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.163.672 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyKerasMomentumD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.163.698 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyMomentumD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.163.722 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyPowerSignD] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.163.729 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaximumGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.163.748 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyProximalAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.163.756 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MinimumGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.163.776 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyProximalGradientDescent] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.163.805 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyRMSPropD] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.163.807 [op_impl_space_registry.cc:240]618670 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.163.829 [opp_so_manager.cc:48]618670 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.163.830 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyAdagradDAD] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.163.854 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [][]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.163.869 [opp_so_manager.cc:123]618670 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.163.940 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.163.959 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LogSoftmaxGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.163.961 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.163.978 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.163.991 [opp_so_manager.cc:45]618670 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.163.986 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.164.011 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.164.034 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftMarginLoss] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.164.057 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.164.056 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FusedMulApplyMomentum] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.164.084 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftmaxFocalLoss] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.164.088 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FusedMulApplyKerasMomentum] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.164.108 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.164.138 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.164.230 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.164.267 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.164.301 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Mish] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.164.344 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GeluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.164.397 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.164.460 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GeluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.164.498 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.164.556 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [InferShape]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.164.588 [op_impl_space_registry.cc:240]618670 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.164.613 [opp_so_manager.cc:48]618670 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.164.600 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.164.656 [opp_so_manager.cc:123]618670 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.164.668 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IsNegInf] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.164.692 [opp_so_manager.cc:126]618670 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.164.722 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.164.729 [opp_so_manager.cc:123]618670 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.164.790 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IsPosInf] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.164.800 [host_cpu_engine.cc:273]618646 LoadLib:Lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libconstant_folding_ops.so has been opened
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.164.822 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.164.829 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.164.846 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.164.860 [opp_so_manager.cc:45]618670 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.164.877 [host_cpu_engine.cc:254]618646 LoadLib:To invoke dlopen on lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libops_host_cpu.so
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.164.908 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.164.920 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftmaxCrossEntropyWithLogits] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.164.994 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.165.024 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.165.050 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.165.115 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.165.145 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.165.222 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.165.248 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.165.289 [op_impl_space_registry.cc:240]618670 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.165.311 [opp_so_manager.cc:48]618670 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.165.333 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.165.348 [opp_so_manager.cc:123]618670 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.165.359 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.165.439 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.165.455 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.165.443 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.165.456 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.165.469 [opp_so_manager.cc:45]618670 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.165.561 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.165.566 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReluV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.165.660 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.165.682 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.165.760 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyAdadeltaD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.165.786 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyAdagradD] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.165.801 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.165.809 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyAdagradV2D] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.165.836 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyAdaMaxD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.165.858 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyAdamD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.165.881 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.165.904 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.165.916 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Cummax] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.165.925 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyAddSignD] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.165.941 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.165.947 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyCenteredRMSPropD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.165.969 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyFtrlD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.165.991 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyFtrlV2D] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.166.017 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyGradientDescent] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.166.029 [op_impl_space_registry.cc:240]618670 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.166.039 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyKerasMomentumD] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.166.048 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.166.053 [opp_so_manager.cc:48]618670 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.166.062 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyMomentumD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.166.084 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyPowerSignD] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.166.098 [opp_so_manager.cc:123]618670 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.166.117 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyProximalAdagradD] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.166.134 [opp_so_manager.cc:126]618670 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.166.140 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyProximalGradientDescent] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.166.162 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyRMSPropD] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.166.166 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.166.171 [opp_so_manager.cc:123]618670 LoadOpMasterSo:Get path with op_master path [/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.166.187 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyAdagradDAD] register OP_IMPL : []
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.166.198 [opp_so_manager.cc:126]618670 LoadOpMasterSo:Get path with op_tiling path [/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.166.230 [opp_so_manager.cc:123]618670 LoadOpMasterSo:Get path with op_master path [/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.166.284 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.166.288 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.166.317 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_ct.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.166.334 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.166.376 [plugin_manager.cc:1126]618670 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.166.393 [plugin_manager.cc:1130]618670 GetFileListWithSuffix:Found 2 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.166.405 [opp_so_manager.cc:45]618670 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.166.391 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FusedMulApplyMomentum] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.166.400 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Col2ImV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.166.416 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FusedMulApplyKerasMomentum] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.166.517 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.166.523 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.166.544 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.166.624 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GeluGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.166.651 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.166.722 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GeluGradV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.166.759 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.166.799 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.166.879 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.166.904 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IsNegInf] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.166.998 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.167.008 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IsPosInf] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.167.105 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.167.107 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.167.180 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.167.227 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2d] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.167.283 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.167.344 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.167.383 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.167.454 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.167.484 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.167.573 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.167.594 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.167.692 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReluV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.167.690 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.167.790 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.167.799 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.167.890 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.167.916 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaskedSelect] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.167.995 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Cummax] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.168.021 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.168.031 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.168.057 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.168.125 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.168.177 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.168.241 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.168.298 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.168.347 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.168.410 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.168.444 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Col2ImV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.168.535 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.168.540 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.168.566 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.168.650 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.168.682 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.168.769 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.168.782 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.168.882 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.168.892 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.168.980 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.169.004 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.169.077 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.169.115 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.169.180 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2d] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.169.232 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RNNTLoss] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.169.290 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.169.346 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MultinomialWithReplacement] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.169.387 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.169.456 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.169.488 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.169.492 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.169.585 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.169.621 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StatelessBernoulli] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.169.690 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.169.733 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.169.791 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaskedSelect] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.169.849 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.169.898 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.169.924 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.169.958 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.170.022 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.170.076 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UniqueConsecutive] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.170.118 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.170.195 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UniqueWithCountsAndSorting] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.170.217 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.170.323 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.170.382 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[WarpAffine] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.170.429 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.170.440 [host_cpu_engine.cc:267]618646 LoadLib:Invoke function Initialize in lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libops_host_cpu.so
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.170.508 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Histogram] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.170.533 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.170.625 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.170.631 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.170.733 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.170.746 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.170.852 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.170.856 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Unique] register OP_IMPL : [InferShapeRange]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.170.947 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RNNTLoss] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.170.977 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UniqueWithCounts] register OP_IMPL : [InferShapeRange]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.171.055 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MultinomialWithReplacement] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.171.096 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Dot] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.171.151 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.171.177 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.171.208 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : [InferShape]
[INFO] OP(618646,python3.9):2025-04-03-09:27:42.171.250 [host_cpu_kernel_wrapper.cpp:88][OP_PROTO][Initialize][618646] OpName:[HostCpuKernelWrapperOp] "Host cpu dlopen so[/usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libaicpu_const_folding.so] success"
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.279 [folding.cc:404][InitCpuConstantFoldingNew][tid:618646]:"Init cpu constant folding begin."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.171.274 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StatelessBernoulli] register OP_IMPL : [][]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.324 [folding.cc:408][InitCpuConstantFoldingNew][tid:618646]:"Number of registered ops: 234"
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.171.318 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : [InferShape]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.340 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Acos]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.358 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Acosh]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.371 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[ActiveRotatedFilter]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.171.369 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.384 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[ActiveRotatedFilterGrad]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.398 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[AdaptiveAvgPool2dAssistMatrix]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.410 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[AdaptiveAvgPoolAssistMatrix]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.422 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[AdaptiveMaxPool2d]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.433 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Add]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.171.433 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : [InferShape]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.446 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Addcdiv]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.459 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Addcmul]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.171.459 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : [InferShape]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.470 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[AffineGrid]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.171.471 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [][]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.494 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[ApplyAdamV2]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.507 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Asin]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.519 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Asinh]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.531 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Assert]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.543 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Atan]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.555 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Atan2]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.567 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Atanh]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.580 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[AvgPoolV2]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.171.573 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.171.581 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardReduce] register OP_IMPL : [InferShape]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.595 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Betainc]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.606 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Bucketize]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.617 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[CTCLossV2]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.628 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[CTCLossV2Grad]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.640 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[CacheSwapTable]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.652 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[CalcBucketsLimitAndOffset]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.664 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[CaseCondition]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.676 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Cast]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.171.675 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UniqueConsecutive] register OP_IMPL : [][][]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.688 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Ceil]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.701 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[CheckNumerics]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.171.692 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStatsWithCounts] register OP_IMPL : [InferShape]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.714 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[ClipByValue]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.726 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[ClipByValueV2]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.737 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Combinations]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.749 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[CompareAndBitpack]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.761 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[ComputeAccidentalHits]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.773 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[ConcatV2]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.785 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Conj]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.171.775 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UniqueWithCountsAndSorting] register OP_IMPL : [][]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.798 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[ConjugateTranspose]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.810 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Coordinates1DTo2D]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.171.809 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.822 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Cosh]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.843 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[CropAndResize]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.171.836 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.857 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Cross]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.867 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Cummax]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.880 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Cummin]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.171.860 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.171.876 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[WarpAffine] register OP_IMPL : [][]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.894 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Cumsum]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.906 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Div]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.171.899 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.920 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[DynamicStitch]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.932 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[EditDistance]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.171.925 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.946 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Elu]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.958 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[EluGrad]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.171.949 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.971 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[EmbeddingApplyAdaGrad]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.171.972 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.983 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[EmbeddingApplyAdam]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.171.975 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Histogram] register OP_IMPL : [][]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.171.997 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[EmbeddingApplyAdamW]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.171.994 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.011 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[EmbeddingApplyFtrl]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.023 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[EmbeddingApplyRmsprop]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.172.019 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.039 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[EmbeddingApplySgd]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.051 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[EmbeddingComputeVarExport]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.062 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[EmbeddingComputeVarImport]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.073 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[EmbeddingFeatureMappingExport]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.084 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[EmbeddingFeatureMappingFileSize]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.172.075 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [][]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.098 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[EmbeddingFeatureMappingImport]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.110 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[EmbeddingHashmapExport]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.122 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[EmbeddingHashmapFileSize]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.134 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[EmbeddingHashmapImport]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.172.125 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.148 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[EmbeddingLookup]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.173 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[EmbeddingTableEvict]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.172.152 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.188 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[EmbeddingTableExport]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.172.145 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DefaultImpl] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.172.192 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.201 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[EmbeddingTableFind]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.172.191 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.221 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[EmbeddingTableFindAndInit]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.234 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[EmbeddingTableImport]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.246 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Equal]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.258 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Expand]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.270 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[ExpandDims]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.282 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Exponential]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.293 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[ExponentialDecayLR]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.305 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Fill]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.172.304 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.172.302 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Unique] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.318 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[FillDiagonal]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.331 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Fills]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.341 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Floor]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.352 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[FloorDiv]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.363 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[FloorMod]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.375 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[GEMM]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.387 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[GatherElements]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.399 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[GatherV2]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.410 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Geometric]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.172.405 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UniqueWithCounts] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.425 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[GetDynamicDims]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.437 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Greater]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.172.423 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.449 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[GreaterEqual]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.461 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[GridSampler2D]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.473 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[GridSampler2DGrad]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.485 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[GridSampler3D]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.496 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[GridSampler3DGrad]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.508 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Histogram]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.172.503 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Dot] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.524 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[IMGWarpOffsets]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.536 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Identity]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.548 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[IndexToAddr]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.172.539 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.561 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[InitEmbeddingHashmap]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.576 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[InitPartitionMap]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.589 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[InplaceIndexAdd]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.600 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[InplaceTopKDistance]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.611 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[InvGrad]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.172.605 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.625 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[InvertPermutation]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.637 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[IsClose]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.649 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[IsInf]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.661 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[IsNan]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.172.649 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.675 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Less]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.172.655 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.687 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[LinSpace]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.698 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[LinearSumAssignment]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.710 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Log]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.172.709 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.722 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Log1p]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.736 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[LogMatrixDeterminant]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.748 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[LogSoftmaxV2]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.172.750 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.759 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[LogUniformCandidateSampler]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.772 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[MaskedFill]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.172.766 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.787 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[MaskedScatter]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.800 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[MaskedSelect]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.172.794 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.814 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[MaskedSelectGrad]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.172.808 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.172.818 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.830 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[MatMul]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.172.826 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.843 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[MatrixDiagPartV3]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.172.836 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.855 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[MatrixDiagV3]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.867 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[MinAreaPolygons]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.879 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Mul]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.891 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[MultinomialAliasDraw]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.903 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[MultinomialAliasSetup]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.172.904 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AscendAntiQuantV2] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.915 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[MultinomialWithReplacement]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.931 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[NLLLoss]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.172.922 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.945 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[NLLLossGrad]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.172.936 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardReduce] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.958 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[NMSWithMask]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.971 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Neg]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.172.974 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.983 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[NonMaxSuppressionV3]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.172.995 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[NonZero]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.007 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[NonZeroWithValueShape]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.019 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[NonZeroWithValueShapeV2]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.031 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[NotEqual]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.043 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[OnesLike]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.173.033 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.173.052 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.057 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[PSAMask]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.173.038 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStatsWithCounts] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.173.058 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.173.074 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.073 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[PSAMaskGrad]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.084 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Pad]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.094 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[PadD]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.104 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[PadV3]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.116 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[PadV3Grad]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.128 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Pinverse]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.140 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Poisson]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.173.142 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Concat] register OP_IMPL : [][]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.152 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Pow]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.173.161 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ConcatV2] register OP_IMPL : [][]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.164 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[ProdEnvMatACalcRij]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.173.159 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [][]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.178 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[RNNTLoss]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.173.180 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.173.174 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.192 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[RandomStandardNormal]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.173.189 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.173.201 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.206 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[RandomUniform]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.218 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[RealDiv]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.173.215 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [][]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.232 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[ReduceAll]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.245 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[ReduceMean]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.173.240 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [][]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.260 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[ReduceSum]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.272 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Reshape]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.173.265 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [][]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.285 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Resize]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.173.283 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.173.287 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [][]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.304 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[ResizeBilinear]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.317 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[ResizeBilinearGrad]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.173.312 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.173.319 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.332 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[ResizeBilinearV2Grad]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.173.335 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [][]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.344 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[ResizeGrad]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.357 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[ResizeTrilinear]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.369 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[ReverseSequence]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.173.362 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [][]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.383 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[RightShift]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.395 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[RoiPoolingWithArgMax]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.173.395 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.407 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[RotatedNMS]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.420 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Round]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.173.398 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.433 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Rsqrt]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.445 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[STFT]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.457 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[ScatterAddWithAxis]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.173.457 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [][]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.469 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[ScatterElements]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.173.466 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [][]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.483 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[ScatterNdAdd]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.493 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[ScatterNdMax]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.173.483 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [][]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.505 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[ScatterNdMin]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.517 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[SearchSorted]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.173.508 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [][]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.530 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[SelectV2]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.173.521 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.543 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Sigmoid]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.173.542 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.554 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[SigmoidGrad]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.173.546 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.567 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Sign]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.579 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[SilentCheck]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.173.570 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.592 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[SilentCheckV2]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.604 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[SilentCheckV3]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.173.599 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.173.610 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.619 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[SliceWrite]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.173.611 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [][]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.632 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[SoftmaxV2]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.644 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Sort]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.659 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[SparseFillEmptyRows]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.671 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[SparseSegmentMean]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.173.679 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.686 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[SparseSegmentMeanGrad]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.699 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[SparseSegmentSum]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.173.699 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.711 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[SparseToDense]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.722 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[SpatialTransformer]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.173.711 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.173.712 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [][]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.736 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[SplitD]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.748 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[SplitV]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.173.739 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.762 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Sqrt]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.173.765 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.773 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[SqrtGrad]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.173.763 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.784 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Square]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.173.787 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.794 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[SquaredDifference]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.806 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[StatelessBernoulli]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.173.805 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.818 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[StatelessRandomUniformV2]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.173.813 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [][]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.833 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[StatelessRandperm]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.845 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[StridedSlice]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.857 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[StridedSliceV2]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.869 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Sub]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.881 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[TableToResource]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.173.879 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.173.877 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.895 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Tan]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.906 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[TanhGrad]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.173.907 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.916 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[TensorEqual]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.173.910 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [][]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.930 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[TensorScatterUpdate]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.173.930 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.942 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[ThreeNN]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.955 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Tile]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.173.952 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.965 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[TileWithAxis]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.977 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[TopK]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.173.989 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[TopKPQDistance]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.174.001 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[TopKPQDistanceV2]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.174.016 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[TopKV2D]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.174.010 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.174.020 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.174.032 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Trace]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.174.044 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[TransData]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.174.037 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [][]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.174.058 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[TransDataRNN]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.174.046 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.174.062 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [][]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.174.072 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Tril]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.174.072 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.174.085 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Triu]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.174.097 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[UniformCandidateSampler]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.174.095 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.174.096 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.174.107 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[UninitEmbeddingHashmap]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.174.121 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[UninitPartitionMap]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.174.120 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [InferShape][InferDataType]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.174.135 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[UniqueConsecutive]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.174.149 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[UniqueWithCountsAndSorting]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.174.161 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[UniqueWithCountsExt2]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.174.173 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[UpsampleNearest3d]."
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.174.165 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.174.170 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [][]
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.174.186 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[UpsampleNearest3dGrad]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.174.198 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[UpsampleTrilinear3d]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.174.210 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[UpsampleTrilinear3dGrad]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.174.222 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[ViewCopy]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.174.234 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Voxelization]."
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.174.226 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.174.240 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : []
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.174.248 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[WarpAffine]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.174.260 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[ZerosLike]."
[INFO] AICPU(618646,python3.9):2025-04-03-09:27:42.174.272 [folding.cc:413][InitCpuConstantFoldingNew][tid:618646]:"Register op[Zeta]."
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.174.271 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [][]
[INFO] OP(618646,python3.9):2025-04-03-09:27:42.174.288 [host_cpu_kernel_wrapper.cpp:118][OP_PROTO][Initialize][618646] OpName:[HostCpuKernelWrapperOp] "Host cpu init success"
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.174.302 [host_cpu_engine.cc:273]618646 LoadLib:Lib: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/libops_host_cpu.so has been opened
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.174.297 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.174.312 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.174.337 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.174.383 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.174.391 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.174.434 [plugin_manager.cc:872]618646 LoadWithFlags:Dlopen path: /usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/plugin/engines/runtime/libdvpp_rtkernel.so. flags is 4354
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.174.449 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.174.460 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.174.475 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.174.493 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.174.499 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.174.533 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.174.601 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.174.597 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.174.612 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.174.639 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.174.675 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.174.697 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.174.733 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.174.742 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.174.756 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.174.753 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.174.784 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.174.811 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.174.883 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.174.880 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.174.891 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.174.916 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.174.940 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.174.960 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.174.988 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.175.014 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.175.036 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.175.037 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.175.037 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.175.064 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.175.088 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.175.144 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.175.170 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.175.180 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.175.193 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.175.205 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.175.229 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.175.251 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.175.300 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.175.354 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.175.418 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.175.457 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.175.533 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.175.566 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.175.593 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.175.616 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.175.643 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.175.709 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.175.734 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.175.760 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.175.832 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.175.866 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.175.932 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.175.974 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.176.036 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.176.064 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.176.094 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.176.087 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.176.205 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.176.232 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.176.225 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2dAssistMatrix] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.176.257 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.176.342 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.176.358 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.176.462 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.176.465 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.176.564 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.176.573 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.176.664 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.176.689 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.176.767 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.176.804 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Cdist] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.176.871 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.176.921 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CdistGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.176.968 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.177.036 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.177.066 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.177.074 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.177.098 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.177.169 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2dAssistMatrix] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.177.217 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.177.244 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.177.266 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.177.268 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.177.374 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.177.375 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.177.435 [plugin_manager.cc:883]618646 LoadWithFlags:The shared library will not be checked. Please ensure that the source of the shared library is trusted.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.177.480 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.177.496 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.177.503 [ops_kernel_executor_manager.cc:37]618646 Initialize:No library to load
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.177.526 [plugin_manager.cc:540]618646 GetOpsProtoPath:Enter GetOpsProtoPath schedule
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.177.537 [plugin_manager.cc:108]618646 GetOppPath:Enter get opp path schedule
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.177.568 [plugin_manager.cc:117]618646 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.177.586 [plugin_manager.cc:547]618646 GetOpsProtoPath:Opp plugin path structure is new version!
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.177.585 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.177.604 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.177.613 [plugin_manager.cc:206]618646 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.177.687 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Cdist] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.177.718 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GlobalLpPool] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.177.786 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CdistGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.177.835 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GLU] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.177.886 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.177.918 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.177.942 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.177.946 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GLUGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.178.038 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.178.063 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.178.070 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.178.087 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.178.181 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.178.187 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.178.212 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.178.257 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.178.271 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.178.284 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.178.293 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LpLoss] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.178.300 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.178.326 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.178.399 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.178.413 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LpNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.178.440 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.178.463 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.178.485 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.178.499 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GlobalLpPool] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.178.601 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GLU] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.178.642 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.178.674 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.178.687 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.178.699 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.178.712 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GLUGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.178.733 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.178.747 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MinAreaPolygons] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.178.773 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.178.788 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.178.807 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.178.820 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.178.813 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : []
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.178.854 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.178.866 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.178.877 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.178.874 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.178.892 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.178.913 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.178.991 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.179.014 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LpLoss] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.179.102 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.179.112 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LpNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.179.138 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.179.166 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.179.191 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.179.213 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.179.213 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.179.247 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.179.262 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.179.274 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.179.289 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MinAreaPolygons] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.179.311 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.179.341 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.179.397 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.179.427 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.179.461 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.179.497 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.179.574 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.179.595 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.179.629 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.179.661 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.179.674 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.179.686 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.179.688 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.179.694 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.179.717 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.179.750 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.179.763 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.179.782 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.179.793 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.179.798 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.179.803 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.179.821 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.179.835 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.179.846 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.179.858 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.179.905 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.179.911 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.180.006 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.180.028 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.180.108 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.180.146 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.180.186 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.180.221 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:42.180.195 [trs_cb_event.c:119][ascend][curpid:618670,618823][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =65; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:42.180.195 [trs_cb_event.c:119][ascend][curpid:618670,618822][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =64; ret=16)
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.180.236 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.180.221 [op_impl_registry_holder_manager.cc:208]618670 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 1
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.180.222 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.180.248 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:42.180.229 [trs_sqcq.c:1491][ascend][curpid:618670,618823][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:42.180.246 [trs_sqcq.c:1491][ascend][curpid:618670,618822][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:42.180.267 [npu_driver.cc:3833] 618823 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:42.180.274 [npu_driver.cc:3833] 618822 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=64, drvRetCode=16.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.180.280 [op_impl_registry_holder_manager.cc:208]618670 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 1
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.180.282 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.180.268 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:42.180.298 [api_impl.cc:5058] 618823 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:42.180.298 [api_impl.cc:5058] 618822 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.180.311 [op_impl_registry_holder_manager.cc:208]618670 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 11
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.180.327 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : []
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.180.326 [callback.cpp:132]618823 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.180.327 [callback.cpp:132]618822 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.180.359 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.180.364 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.180.388 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [InferShape][InferDataType]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.180.382 [npu_driver.cc:3828] 618823 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=65.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.180.384 [npu_driver.cc:3828] 618822 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=64.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.180.430 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.180.509 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.180.534 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.180.601 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.180.617 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.180.632 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.180.646 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.180.658 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.180.634 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.180.691 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.180.723 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.180.743 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.180.736 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.180.746 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.180.757 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.180.771 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.180.800 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.180.811 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.180.822 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.180.834 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.180.832 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.180.849 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.180.852 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.180.952 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.180.961 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.180.964 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.181.055 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.181.070 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.181.085 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.181.147 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.181.157 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.181.177 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.181.192 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.181.181 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.181.205 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.181.236 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.181.256 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.181.302 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.181.356 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.181.384 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.181.410 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.181.461 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.181.508 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.181.518 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.181.552 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.181.559 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.181.581 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.181.594 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.181.606 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.181.621 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DeformableOffsetsGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.181.637 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.181.635 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.181.670 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.181.669 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.181.662 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : [InferShape]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.181.693 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.181.705 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.181.717 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.181.739 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.181.745 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.181.756 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.181.768 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.181.780 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.181.769 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.181.797 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotatedNMS] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.181.869 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.181.895 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.181.906 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.181.914 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.181.995 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotatedNMS] register OP_IMPL : [][][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.182.020 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.182.033 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.182.094 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.182.092 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : []
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.182.125 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.182.138 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.182.150 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.182.180 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.182.185 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.182.201 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.182.262 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SilentCheck] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.182.301 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SilentCheck] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.182.328 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.182.386 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.182.401 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.182.444 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.182.503 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.182.499 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.182.509 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : [InferShape]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.182.535 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.182.548 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.182.560 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.182.568 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.182.591 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.182.598 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3d] register OP_IMPL : []
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.182.622 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.182.625 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3d] register OP_IMPL : [InferShape]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.182.645 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.182.657 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.182.669 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.182.697 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.182.709 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.182.699 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.182.701 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachNonFiniteCheckAndUnscale] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.182.722 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.182.734 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.182.737 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.182.744 [plugin_manager.cc:218]618646 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.182.764 [plugin_manager.cc:422]618646 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.182.776 [plugin_manager.cc:155]618646 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.182.795 [plugin_manager.cc:158]618646 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.182.807 [plugin_manager.cc:426]618646 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.182.804 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.182.827 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.182.842 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.182.909 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ActiveRotatedFilter] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.182.915 [op_impl_space_registry.cc:273]618670 ConvertSoToRegistry:Save so symbol and handle in path[/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_ct.so] success!
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.182.953 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.182.953 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ActiveRotatedFilter] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.182.978 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.183.006 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ActiveRotatedFilterGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.183.067 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ActiveRotatedFilterGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.183.115 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.183.107 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.183.135 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GatherV3] register OP_IMPL : [][][][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.183.147 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.183.167 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.183.179 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.183.186 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.183.211 [plugin_manager.cc:439]618646 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspo
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.183.221 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.183.230 [ge_executor.cc:259]618646 InitOpsProtoManager:Get opsproto path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/minds
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.183.252 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.183.301 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.183.326 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.183.396 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.183.417 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.183.430 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.183.514 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.183.527 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.183.534 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.183.572 [plugin_manager.cc:996]618646 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.183.602 [plugin_manager.cc:1011]618646 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.183.620 [plugin_manager.cc:1015]618646 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.183.632 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.183.632 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.183.638 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.183.655 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.183.716 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.183.730 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.183.732 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.183.749 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.183.772 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.183.801 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.183.814 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.183.833 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PSAMask] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.183.844 [opsproto_manager.cc:123]618646 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.183.879 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.183.888 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.183.896 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.183.909 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.183.936 [opsproto_manager.cc:123]618646 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.183.938 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PSAMaskGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.183.977 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.183.990 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 2 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.183.993 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PSAMask] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.184.035 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.184.053 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.184.047 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LinSpace] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.184.066 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.184.112 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PSAMaskGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.184.128 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.184.143 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.184.140 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.184.187 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MemSet] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.184.234 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.184.258 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.184.305 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.184.347 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.184.361 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.184.423 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.184.464 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.184.465 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.184.526 [opsproto_manager.cc:123]618646 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.184.557 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.184.575 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.184.568 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ThreeNN] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.184.590 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 3 libs.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.184.616 [opsproto_manager.cc:123]618646 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.184.654 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.184.666 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 4 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.184.670 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.184.668 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Voxelization] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.184.695 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.184.730 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.184.742 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.184.792 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.184.786 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.184.804 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.184.822 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.184.817 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.184.854 [opsproto_manager.cc:123]618646 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.184.846 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.184.877 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.184.895 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.184.908 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 5 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.184.908 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NPUClearFloatStatus] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.184.904 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.184.923 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.184.937 [opsproto_manager.cc:123]618646 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.184.934 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.184.960 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.184.978 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.184.992 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 6 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.184.986 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.185.011 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : [][][][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.185.019 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NPUGetFloatStatus] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.185.056 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.185.038 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.185.069 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.185.074 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.185.098 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.185.121 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.185.130 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.185.144 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.185.145 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.185.141 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ThreeNN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.185.148 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CompressFcOp] register OP_IMPL : [][][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.185.170 [opsproto_manager.cc:123]618646 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.185.175 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.185.173 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.185.208 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.185.220 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 7 libs.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.185.246 [opsproto_manager.cc:123]618646 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.185.277 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.185.282 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.185.279 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Voxelization] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.185.300 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 8 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.185.359 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.185.374 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.185.385 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.185.400 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.185.436 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.185.448 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.185.438 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.185.475 [opsproto_manager.cc:123]618646 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.185.474 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.185.486 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.185.512 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.185.511 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.185.525 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 9 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.185.529 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.185.553 [opsproto_manager.cc:123]618646 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.185.551 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.185.592 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.185.585 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.185.587 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [InferShape][InferDataType][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.185.607 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 10 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.185.621 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.185.636 [opsproto_manager.cc:123]618646 GetOpsProtoSoFileList:[FindSo][Check] Get path with os&cpu type [/usr/local/Ascend/ascend-toolkit/latest/opp/op_proto/custom/lib/linux/aarch64/] unsuccessful, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.185.652 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [InferShape][InferDataType][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.185.677 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 10 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.185.674 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.185.683 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.185.688 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.185.715 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.185.739 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.185.739 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.185.752 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt2.0.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.185.765 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.185.762 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.185.778 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 3 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.185.784 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMatMulV4] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.185.792 [opsproto_manager.cc:147]618646 LoadOpsProtoPluginSo:[LoadSo][Check] Shared library will not be checked. Please make sure that the source of shared library is trusted.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.185.787 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.185.813 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.185.847 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CompressFcOp] register OP_IMPL : [InferShape][InferDataType][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.185.873 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.185.884 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.185.927 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:ReverseSequence, funcPointer:0xfffee690d360, registered count:5
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.185.952 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:ReverseSequence, funcPointer:(nil), registered count:7
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.185.971 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:ReverseSequence, funcPointer:(nil), registered count:4
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.185.967 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.185.991 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:ReverseSequence, funcPointer:(nil), registered count:4
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.185.984 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.185.996 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.186.010 [op_check.cc:71]618666 RegisterParamGeneralize:RegisterParamGeneralize: op_type:ReverseSequence, funcPointer:(nil), registered count:4
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.186.028 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.186.099 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.186.111 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.186.157 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.186.173 [operator_factory_impl.cc:215]618646 RegisterInferShapeFunc:operator_infershape_funcs_ init
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.186.193 [operator_factory_impl.cc:269]618646 RegisterVerifyFunc:operator_verify_funcs_ init
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.186.201 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.186.224 [opsproto_manager.cc:162]618646 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.186.243 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.186.275 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.186.299 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.186.355 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.186.402 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ResizeTrilinear] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.186.468 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.186.485 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.186.499 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.186.599 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMatMulV4] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.186.607 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.186.635 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.186.659 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.186.662 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.186.682 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.186.705 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.186.711 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.186.777 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.186.800 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.186.813 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.186.847 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.186.833 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.186.879 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [][][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.186.909 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.186.907 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [][][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.186.934 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.186.935 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.186.961 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.186.965 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.186.987 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.187.015 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.187.041 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [][][][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.187.047 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.187.066 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.187.084 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.187.092 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.187.118 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.187.142 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [][][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.187.164 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.187.170 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.187.186 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.187.199 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.187.201 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.187.229 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.187.257 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.187.287 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [][][][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.187.300 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.187.314 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.187.333 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ResizeTrilinear] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.187.388 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.187.409 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.187.445 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.187.490 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ActULQClampMaxGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.187.518 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.187.520 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ActULQClampMinGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.187.558 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.187.589 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.187.613 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.187.617 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ActsULQ] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.187.639 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.187.636 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.187.660 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.187.717 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ActsULQInputGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.187.821 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.187.827 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.187.848 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.187.858 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.187.872 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.187.892 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.187.925 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.187.930 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.187.962 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.187.980 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.188.006 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.188.040 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.188.030 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdaptiveAvgPoolAssistMatrix] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.188.074 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.188.104 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.188.106 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.188.137 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.188.143 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.188.180 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.188.191 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.188.214 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.188.241 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.188.282 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.188.294 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.188.318 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.188.318 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.188.352 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.188.383 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.188.391 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.188.410 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.188.446 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.188.498 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.188.504 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.188.553 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.188.603 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.188.627 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ActULQClampMaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.188.629 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.188.663 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.188.663 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ActULQClampMinGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.188.730 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.188.786 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.188.781 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ActsULQ] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.188.830 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.188.896 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ActsULQInputGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.188.929 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.188.996 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.189.022 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.189.040 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.189.117 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.189.137 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.189.171 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.189.194 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.189.265 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdaptiveAvgPoolAssistMatrix] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.189.299 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AvgPoolUpdate] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.189.320 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.189.391 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.189.399 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.189.419 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.189.477 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.189.503 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.189.533 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.189.600 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.189.608 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Bitcast] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.189.655 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.189.719 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.189.715 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.189.769 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.189.793 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.189.840 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BlendFaceBgPartOne] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.189.873 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.189.882 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.189.909 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.189.949 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.189.956 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.190.019 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.190.062 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.190.056 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CTCLoss] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.190.140 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.190.158 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.190.254 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.190.259 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.190.337 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.190.343 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.190.371 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.190.458 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.190.449 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DropOutGenMask] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.190.486 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StatelessDropOutGenMask] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.190.512 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.190.537 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNN, funcPointer:0xfffee6997e08, registered count:7
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.190.555 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.190.585 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.190.671 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AvgPoolUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.190.683 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.190.699 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.190.719 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNNV2, funcPointer:0xfffee69a0298, registered count:7
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.190.792 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.190.792 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.190.839 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.190.888 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.190.917 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.190.952 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.190.993 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ExpandDims] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.191.039 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Bitcast] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.191.096 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.191.112 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.191.156 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.191.196 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FillWindowCache] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.191.230 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GridSampler2D] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.191.244 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.191.294 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.191.344 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GridSampler3D] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.191.347 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.191.375 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Igammac] has registered infer func
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.191.394 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FlattenV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.191.452 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.191.469 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandle] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.191.501 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GatherShapes] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.191.580 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandleV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.191.580 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CTCLoss] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.191.599 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GaussianBlur] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.191.696 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.191.708 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.191.711 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FileConstant] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.191.739 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StatelessIf] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.191.764 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[If] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.191.789 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[_If] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.191.816 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Case] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.191.822 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PasteSubImg] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.191.821 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.191.862 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ConstPlaceHolder] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.191.933 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.191.938 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.191.957 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.191.964 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.192.059 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DropOutGenMask] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.192.069 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.192.067 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.192.080 [opsproto_manager.cc:162]618646 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.192.091 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StatelessDropOutGenMask] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.192.144 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Identity] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.192.183 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MemcpyAsync] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.192.204 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.192.198 [opsproto_manager.cc:162]618646 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.192.210 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IdentityN] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.192.222 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.192.251 [opsproto_manager.cc:162]618646 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.192.283 [opsproto_manager.cc:162]618646 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.192.313 [opsproto_manager.cc:162]618646 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.192.316 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.192.312 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.192.340 [opsproto_manager.cc:162]618646 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.192.345 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.192.367 [opsproto_manager.cc:162]618646 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.192.395 [opsproto_manager.cc:162]618646 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto//libop_proto.so success.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.192.421 [opsproto_manager.cc:162]618646 LoadOpsProtoPluginSo:OpsProtoManager plugin load /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto//libcust_op_proto.so success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.192.434 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.192.412 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.192.458 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.192.527 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.192.557 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.192.581 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.192.628 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.192.672 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.192.700 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ExpandDims] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.192.729 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.192.784 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TabulateFusionGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.192.817 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.192.832 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.192.859 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.192.882 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.192.908 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[YUV4442YUV422] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.192.977 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FillWindowCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.193.022 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.193.049 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.193.061 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.193.088 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.193.094 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.193.109 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.193.130 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.193.125 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.193.208 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FlattenV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.193.227 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.193.289 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.193.326 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.193.325 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GatherShapes] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.193.405 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.193.429 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.193.452 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GaussianBlur] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.193.516 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.193.532 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.193.619 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FileConstant] register OP_IMPL : [IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.193.634 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.193.639 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.193.655 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StatelessIf] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.193.686 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[If] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.193.715 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[_If] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.193.744 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Case] register OP_IMPL : [InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.193.748 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.193.745 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.193.803 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ConstPlaceHolder] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.193.845 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RandomChoiceWithMask] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.193.874 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.193.894 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.193.921 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.193.913 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.193.947 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RandomUniform] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.194.022 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Rank] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.194.042 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.194.049 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Size] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.194.048 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.194.141 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Identity] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.194.152 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.194.160 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.194.171 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MemcpyAsync] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.194.201 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IdentityN] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.194.255 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Reshape] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.194.272 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.194.309 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.194.356 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RgbToGrayscale] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.194.421 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.194.456 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.194.475 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicAtomicAddrClean] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.194.543 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.194.556 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.194.586 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.194.656 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.194.665 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.194.700 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.194.762 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Rotate] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.194.777 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.194.826 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.194.854 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Shape] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.194.881 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ShapeN] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.194.886 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.194.913 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.194.937 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.194.944 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.194.983 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SilentCheckV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.195.059 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.195.085 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SilentCheckV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.195.097 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.195.124 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.195.176 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.195.183 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.195.198 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceMeanD] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.195.208 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.195.283 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.195.315 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.195.344 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.195.388 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyAdadelta] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.195.416 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyAdadeltaD] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.195.423 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.195.440 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyAdagradD] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.195.447 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.195.456 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.195.463 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyAdagrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.195.487 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.195.509 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagradD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.195.530 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.195.554 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2D] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.195.577 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.195.578 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.195.599 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.195.622 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.195.643 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2D] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.195.665 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyRMSProp] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.195.687 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyRMSPropD] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.195.689 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.195.749 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.195.786 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseFillEmptyRows] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.195.802 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.195.864 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.195.887 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.195.919 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.195.974 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.195.988 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Squeeze] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.196.013 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SqueezeV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.196.037 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SqueezeV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.196.043 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RandomChoiceWithMask] register OP_IMPL : [InferShapeRange]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.196.091 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.196.170 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.196.197 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RandomUniform] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.196.212 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.196.279 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StatelessRandomNormalV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.196.292 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Rank] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.196.324 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Size] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.196.331 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.196.383 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.196.431 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.196.443 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.196.483 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.196.549 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Reshape] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.196.561 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.196.584 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TopK] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.196.610 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.196.634 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.196.661 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.196.668 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RgbToGrayscale] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.196.683 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [][][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.196.772 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.196.781 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TopKPQDistanceV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.196.787 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.196.885 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.196.882 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.196.901 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.196.989 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TransArgb] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.197.012 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.197.014 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.197.088 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Unsqueeze] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.197.114 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UnsqueezeV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.197.126 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Rotate] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.197.140 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UnsqueezeV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.197.219 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Shape] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.197.243 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.197.248 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ShapeN] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.197.268 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.197.373 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Where] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.197.473 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[WtsARQ] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.197.507 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SilentCheckV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.197.574 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.197.675 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.197.755 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SilentCheckV3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.197.778 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.197.805 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.197.902 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.197.903 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.197.928 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.198.023 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.031 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdjustContrast] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.069 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdjustHue] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.094 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdjustSaturation] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.117 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CropAndResize] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.140 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CropAndResizeV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.198.150 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyAdadelta] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.164 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DecodeAndCropJpeg] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.198.182 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyAdadeltaD] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.187 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DecodeJpeg] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.211 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NormalizeV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.198.212 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.233 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdjustContrastWithMean] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.198.240 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyAdagrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.256 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdjustBrightness] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.198.266 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.282 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdjustBrightnessV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.198.292 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.307 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdjustSaturationV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.198.318 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.330 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[WarpAffineV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.353 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ImgCrop] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.198.345 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.376 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[WarpPerspective] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.198.383 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.198.406 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.198.433 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.198.458 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2D] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.474 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.198.484 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyRMSProp] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.502 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.198.509 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyRMSPropD] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.526 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.632 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HcomAllReduce] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.198.634 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseFillEmptyRows] register OP_IMPL : [InferShapeRange][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.656 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HcomAllGather] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.680 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HcomBroadcast] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.703 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HcomReduceScatter] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.726 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HcomSend] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.749 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HcomReduce] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.771 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HcomReceive] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.793 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HcomAllToAllV] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.816 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HcomAllToAllVC] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.846 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HcomGatherAllToAllV] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.198.867 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.198.976 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.198.996 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Squeeze] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.199.029 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SqueezeV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.199.052 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.199.057 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SqueezeV3] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.199.169 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.199.175 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.199.251 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.199.283 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StatelessRandomNormalV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.199.327 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.199.404 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.199.403 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.199.521 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.199.579 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DepthToSpace] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.199.621 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.199.644 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SpaceToDepth] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.199.647 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TopK] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.199.673 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.199.697 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.199.719 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.199.721 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.199.742 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.199.779 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.199.798 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.199.855 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TopKPQDistanceV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.199.869 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.199.906 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.199.950 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.199.965 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.200.016 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.200.034 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.200.084 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TransArgb] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.200.109 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.200.136 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.200.196 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.200.242 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Unsqueeze] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.200.258 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.200.277 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UnsqueezeV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.200.306 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UnsqueezeV3] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.200.309 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.200.374 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.200.416 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.200.431 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.200.462 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.200.490 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.200.519 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.200.576 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Where] register OP_IMPL : [InferShapeRange]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.200.601 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.200.616 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.200.678 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.200.690 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[WtsARQ] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.200.746 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.200.749 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.200.774 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.200.772 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.200.806 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.200.889 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.200.913 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.200.925 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.201.031 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.201.037 [op_impl_registry_holder_manager.cc:208]618650 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 894
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.201.043 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.201.054 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.201.074 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.201.162 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.201.197 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.201.224 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.201.269 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.201.338 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdjustContrast] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.201.368 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdjustHue] register OP_IMPL : [InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.201.393 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.201.396 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdjustSaturation] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.201.425 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CropAndResize] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.201.453 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CropAndResizeV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.201.480 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DecodeAndCropJpeg] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.201.506 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DecodeJpeg] register OP_IMPL : [InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.201.518 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.201.535 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NormalizeV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.201.562 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdjustContrastWithMean] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.201.588 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdjustBrightness] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.201.627 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdjustBrightnessV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.201.655 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdjustSaturationV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.201.682 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[WarpAffineV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.201.710 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ImgCrop] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.201.736 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[WarpPerspective] register OP_IMPL : [InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.201.772 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.201.849 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.201.877 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.201.900 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.202.028 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HcomAllReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.202.059 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HcomAllGather] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.202.073 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.202.089 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HcomBroadcast] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.202.119 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HcomReduceScatter] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.202.145 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HcomSend] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.202.171 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HcomReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.202.198 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HcomReceive] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.202.224 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HcomAllToAllV] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.202.230 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.202.251 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HcomAllToAllVC] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.202.281 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HcomGatherAllToAllV] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.202.351 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.202.467 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.202.590 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.203.282 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNormGradV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.203.566 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.203.680 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.203.774 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.203.864 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.203.971 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.204.054 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.204.135 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.204.207 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.204.330 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.204.444 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.204.487 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.204.536 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.204.620 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.204.711 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.204.738 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.204.895 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.204.969 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.204.980 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.205.121 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.205.213 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.205.301 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.205.387 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.205.594 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.205.718 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.205.764 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.205.802 [opsproto_manager.cc:162]618654 LoadOpsProtoPluginSo:OpsProtoManager plugin load /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto.so success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.205.854 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.205.874 [plugin_manager.cc:108]618654 GetOppPath:Enter get opp path schedule
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.205.937 [plugin_manager.cc:117]618654 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.205.998 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.206.110 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.206.404 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPool3DWithArgmaxV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.206.794 [plugin_manager.cc:996]618654 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.206.870 [plugin_manager.cc:1011]618654 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.206.895 [plugin_manager.cc:1015]618654 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.206.996 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.207.034 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.207.097 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.207.115 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.207.129 [opp_so_manager.cc:56]618654 LoadOpsProtoPackage:Start load ops proto package, is_split:[1].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.207.148 [plugin_manager.cc:540]618654 GetOpsProtoPath:Enter GetOpsProtoPath schedule
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.207.161 [plugin_manager.cc:108]618654 GetOppPath:Enter get opp path schedule
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.207.192 [plugin_manager.cc:117]618654 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.207.213 [plugin_manager.cc:547]618654 GetOpsProtoPath:Opp plugin path structure is new version!
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.207.234 [plugin_manager.cc:206]618654 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.207.693 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.207.742 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.207.761 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.207.775 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.207.827 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.208.213 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.208.254 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.208.275 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.208.289 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.208.346 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.208.392 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.208.412 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.208.427 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.208.445 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.208.478 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.208.495 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.208.508 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.208.526 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.208.681 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPool3DGradWithArgmax] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.208.890 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.208.930 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.208.948 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.208.962 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.209.004 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.209.372 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.209.409 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.209.428 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.209.462 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.209.501 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.209.543 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.209.561 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.209.554 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.209.578 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.209.595 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.209.626 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.209.643 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.209.602 [op_impl_registry_holder_manager.cc:208]618650 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 894
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.209.660 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.209.674 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.209.724 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.209.889 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CTCLossV3Grad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.209.878 [operator_factory_impl.cc:368]618646 RegisterInferAxisTypeInfoFunc:axis type info derivation funcs init
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.210.035 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.210.073 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.210.093 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.210.078 [operator_factory_impl.cc:284]618646 RegisterInferDataSliceFunc:operator_infer_data_slice_funcs_ init
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.210.109 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.210.160 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.210.247 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [MatrixBandPart] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.210.272 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [CheckNumerics] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.210.285 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [UnravelIndex] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.210.297 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [UpperBound] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.210.310 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [ListDiff] has registered infer func
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.210.328 [operator_factory_impl.cc:254]618646 RegisterInferFormatFunc:operator_inferformat_funcs_ init
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.210.355 [operator_factory_impl.cc:340]618646 RegisterInferAxisSliceFunc:axis slice derivation funcs init
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.210.378 [operator_factory_impl.cc:307]618646 RegisterInferValueRangeFunc:operator_infervalue_paras_ init
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.210.403 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [IdentityN] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.210.420 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [LowerBound] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.210.441 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Expand] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.210.524 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.210.537 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [LeftShift] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.210.562 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.210.580 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.210.619 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.210.657 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.210.697 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.210.714 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.210.729 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.210.746 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.210.776 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.210.793 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.210.806 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.210.821 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.210.927 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CTCLossV3] register OP_IMPL : [][][][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.211.090 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.211.185 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.211.223 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.211.241 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.211.249 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3DGrad] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.211.255 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.211.289 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Reciprocal] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.211.296 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.211.316 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Sign] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.211.333 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Div] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.211.350 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Exp] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.211.366 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [LessEqual] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.211.379 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Log1p] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.211.400 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [DivNoNan] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.211.434 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Mul] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.211.448 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [SqrtGrad] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.211.461 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Log] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.211.475 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [AddN] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.211.495 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [AcosGrad] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.211.508 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [AcoshGrad] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.211.536 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [BiasAdd] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.211.563 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [FloorDiv] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.211.581 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [ArgMin] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.211.642 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [MulNoNan] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.211.658 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.211.680 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [AsinGrad] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.211.698 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Cos] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.211.694 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.211.715 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Sin] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.211.736 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.211.714 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.211.752 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.211.752 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [AsinhGrad] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.211.771 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Expm1] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.211.793 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.211.832 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.211.849 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.211.863 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.211.857 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.211.880 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.211.913 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.211.929 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.211.943 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.211.959 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.211.975 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.212.107 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.212.225 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.212.349 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.212.340 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.212.379 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.212.398 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.212.412 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.212.454 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.212.464 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.212.584 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.212.703 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.212.821 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.212.816 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.212.861 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [AdjustHue] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.212.889 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [AdjustSaturation] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.212.852 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.212.894 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.212.910 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.212.907 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [ExtractGlimpse] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.212.923 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [ResizeArea] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.212.936 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [ResizeBicubic] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.212.942 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.212.951 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [RGBToHSV] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.212.949 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.212.968 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [NonMaxSuppressionWithOverlaps] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.213.005 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [ScaleAndTranslate] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.212.991 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.213.010 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.213.019 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [ScaleAndTranslateGrad] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.213.025 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.213.034 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [CombinedNonMaxSuppression] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.213.041 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.213.075 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.213.091 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.213.104 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PadV3GradReplication] register OP_IMPL : [][][][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.213.104 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.213.123 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.213.122 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [CholeskyGrad] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.213.139 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Cholesky] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.213.140 [plugin_manager.cc:218]618654 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.213.155 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [MatrixDeterminant] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.213.165 [plugin_manager.cc:422]618654 GetOppPluginPathNew:Enter get opp plugin path new schedule
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.213.168 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [MatrixSolve] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.213.181 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [MatrixTriangularSolve] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.213.192 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Qr] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.213.183 [plugin_manager.cc:155]618654 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.213.220 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.213.221 [plugin_manager.cc:158]618654 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.213.240 [plugin_manager.cc:426]618654 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.213.343 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.213.483 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Digamma] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.213.500 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Igamma] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.213.513 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Igammac] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.213.526 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Bincount] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.213.537 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Betainc] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.213.540 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.213.549 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Bucketize] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.213.563 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [IgammaGradA] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.213.594 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [NextAfter] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.213.607 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [IsInf] has registered infer func
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.213.598 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.213.623 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [IsNan] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.213.635 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Conj] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.213.640 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.213.660 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.213.657 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Complex] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.213.659 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.213.671 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Angle] has registered infer func
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.213.677 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.213.719 [plugin_manager.cc:439]618654 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspo
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.213.767 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.213.884 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [ScatterNdUpdate] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.213.887 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.213.902 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [TensorScatterUpdate] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.213.954 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Tril] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.213.967 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [IndexPut] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.213.979 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Eye] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.213.991 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [FillDiagonal] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.214.003 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Trace] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.214.049 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.214.064 [plugin_manager.cc:996]618654 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.214.064 [op_impl_registry_holder_manager.cc:208]618650 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.214.100 [plugin_manager.cc:1011]618654 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.214.126 [plugin_manager.cc:1015]618654 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.214.232 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.214.255 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.214.277 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.214.292 [opp_so_manager.cc:45]618654 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.214.346 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.214.458 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.214.480 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.214.673 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.214.792 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.214.828 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [DecodeBbox] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.214.853 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [ClipBoxes] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.214.867 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [ClipBoxesD] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.214.886 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [DecodeBoundariesTarget] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.214.899 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [DecodeCornerpointsTargetBG] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.214.905 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.214.912 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [DecodeCornerpointsTargetWrtCenterV1] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.214.925 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [DecodeWheelsTarget] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.215.033 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [SparseSoftmaxCrossEntropyWithLogits] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.215.087 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.215.123 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [KlDivLossGrad] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.215.206 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.215.378 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.215.455 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [FractionalMaxPoolGrad] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.215.472 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [FractionalAvgPool] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.215.486 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [FractionalMaxPool] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.215.492 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.215.505 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [DataFormatVecPermute] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.215.517 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [FractionalAvgPoolGrad] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.215.528 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [NthElement] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.215.615 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.215.731 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.215.754 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.215.879 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.215.901 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.215.964 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Tanh] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.216.033 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.216.153 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.216.191 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.216.267 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Pad] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.216.289 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [PadV3] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.216.303 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [PadV3Grad] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.216.307 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.216.318 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [BroadcastTo] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.216.432 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.216.459 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [RaggedRange] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.216.553 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.216.592 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [ShuffleChannel] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.216.757 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.216.856 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [ReduceSum] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.216.878 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [ReduceProd] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.216.878 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.216.910 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [INInferV2] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.216.922 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [INInferV2] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.217.076 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GridSampler2DGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.217.204 [op_impl_registry_holder_manager.cc:208]618654 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.217.245 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GridSampler3DGrad] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.217.263 [op_impl_registry_holder_manager.cc:216]618654 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.217.286 [op_impl_registry_holder_manager.cc:208]618654 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.217.372 [op_impl_registry_holder_manager.cc:208]618654 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.217.447 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.217.460 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [UnsortedSegmentSum] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.217.495 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [ReverseV2] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.217.510 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Select] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.217.533 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [SegmentSum] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.217.549 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Slice] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.217.566 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [OneHot] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.217.585 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [ScatterNd] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.217.603 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Cumprod] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.217.634 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.217.650 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [CumulativeLogsumexp] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.217.686 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [MaskedSelect] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.217.827 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PadV4Grad] register OP_IMPL : [][][][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.218.037 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PadV3GradReplicate] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.218.034 [op_impl_space_registry.cc:273]618654 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so] success!
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.218.047 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Concat] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.218.160 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.218.174 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.218.197 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.218.211 [opp_so_manager.cc:45]618654 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.218.234 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [NonDeterministicInts] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.218.277 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.218.394 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.218.481 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [Flatten] has registered infer func
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.218.507 [operator_factory_impl.cc:222]618646 RegisterInferShapeFunc:op [DepthToSpace] has registered infer func
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.218.517 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.218.538 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.218.748 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.218.872 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.218.989 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.064 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.102 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[EluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.219.105 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.124 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.145 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.168 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SyncBNTrainingUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.192 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Abs] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.215 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Real] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.219.219 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.236 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Acos] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.256 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Acosh] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.278 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddMatMatElements] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.298 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Adds] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.321 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Asin] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.341 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Asinh] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.219.358 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.361 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AssignAdd] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.381 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AssignSub] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.402 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Atan] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.422 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Atanh] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.441 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.462 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BesselI0e] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.483 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BesselI1e] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.219.481 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.500 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.219.503 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.518 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.543 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.560 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.582 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Bucketize] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.605 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Cast] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.625 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Ceil] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.219.624 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.646 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CeluV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.672 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ComplexAbs] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.696 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Cos] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.716 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Cosh] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.733 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.754 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DataFormatDimMap] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.776 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Dequantize] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.796 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Elu] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.817 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Erf] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.837 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Erfc] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.857 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Exp] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.219.871 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.878 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Expm1] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.899 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FakeQuantWithMinMaxVars] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.918 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FastGelu] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.938 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FastGeluV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.959 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Floor] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.219.983 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FusedMulAddN] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.007 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HardSigmoid] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.027 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HardShrink] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.047 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HardShrinkGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.073 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HardSwish] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.094 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HardSwishGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.114 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HardtanhGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.135 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IndexFillD] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.152 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.186 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.209 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Inv] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.236 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Invert] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.261 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Log] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.284 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Log1p] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.306 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LogicalNot] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.326 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LogAddExp] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.347 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LpNormUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.367 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LpNormUpdateV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.390 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Dawsn] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.410 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Expint] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.430 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Erfinv] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.451 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FresnelCos] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.471 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FresnelSin] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.493 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Ndtri] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.514 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Spence] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.533 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Fills] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.555 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LeakyRelu] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.576 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[OnesLike] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.598 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Reciprocal] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.626 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Sign] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.647 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Sqrt] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.668 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Tanh] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.690 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ZerosLike] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.712 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Gelu] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.733 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GeluV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.220.715 [op_impl_registry_holder_manager.cc:208]618654 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.757 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Relu] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.778 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Neg] register OP_IMPL : [InferShape]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.220.766 [op_impl_registry_holder_manager.cc:216]618654 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.220.788 [op_impl_registry_holder_manager.cc:208]618654 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.801 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LogSoftmaxV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.820 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.841 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftmaxV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.220.836 [op_impl_registry_holder_manager.cc:208]618654 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.861 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.881 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftplusV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.908 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Muls] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.930 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Power] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.951 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Relu6] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.971 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Relu6D] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.220.992 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Relu6Grad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.011 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.032 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Rint] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.221.018 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.053 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Round] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.075 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Rsqrt] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.096 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RsqrtGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.116 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Selu] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.136 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Shrink] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.160 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Sigmoid] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.181 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.203 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SigmoidGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.225 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Sin] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.246 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Sinh] register OP_IMPL : [InferShape]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.221.245 [op_impl_space_registry.cc:80]618654 MergeFunctions:op type DecoderKvCache infer_shape func has been registered
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.266 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SmoothL1Loss] register OP_IMPL : [InferShape]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.221.272 [op_impl_space_registry.cc:83]618654 MergeFunctions:op type DecoderKvCache infer_datatype func has been registered
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.288 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SmoothL1LossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.309 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LogSigmoid] register OP_IMPL : [InferShape]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.221.300 [op_impl_space_registry.cc:80]618654 MergeFunctions:op type PromptKvCache infer_shape func has been registered
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.221.318 [op_impl_space_registry.cc:83]618654 MergeFunctions:op type PromptKvCache infer_datatype func has been registered
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.332 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LogSigmoidGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.221.336 [op_impl_space_registry.cc:273]618654 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so] success!
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.353 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LogSpaceD] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.374 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Softplus] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.394 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Softsign] register OP_IMPL : [InferShape]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.221.392 [opp_so_manager.cc:97]618654 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.414 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SqrtGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.435 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Square] register OP_IMPL : [InferShape]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.221.432 [opp_so_manager.cc:97]618654 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.459 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Swish] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.483 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwishGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.505 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SiluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.526 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardElemt] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.221.534 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:4[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.550 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Tan] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.572 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftShrink] register OP_IMPL : [InferShape]
2.221.555 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.221.586 [opp_so_manager.cc:45]618654 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.596 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftShrinkGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.617 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Threshold] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.638 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ThresholdV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.658 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ThresholdV2D] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.678 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Trunc] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.699 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.717 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.740 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MishGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.762 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HardSigmoidGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.779 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.795 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.813 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.830 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.852 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FillDiagonal] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.874 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IndexPut] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.894 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReadVariableOp] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.915 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CastLike] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.936 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FusedBiasLeakyRelu] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.958 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StatelessBernoulliV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.976 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.221.996 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InvertPermutation] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.014 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.034 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SearchSorted] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.051 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.068 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.085 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.102 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.121 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.227 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaskedScale] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.259 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AbsGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.282 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AccumulateNV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.303 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddN] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.324 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Eltwise] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.345 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.369 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AcosGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.390 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AcoshGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.412 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AsinGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.432 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AsinhGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.452 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Atan2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.222.436 [op_impl_space_registry.cc:240]618654 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.475 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AtanGrad] register OP_IMPL : [InferShape]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.222.469 [opp_so_manager.cc:48]618654 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.498 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Axpy] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.518 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BitwiseAnd] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.539 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BitwiseOr] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.559 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BitwiseXor] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.581 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Div] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.222.570 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.222.592 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.605 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DivNoNan] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.222.609 [opp_so_manager.cc:45]618654 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.627 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[EluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.650 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FastGeluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.671 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FloorDiv] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.690 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FloorMod] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.710 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InvGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.732 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LeakyReluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.752 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TanhGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.773 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Add] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.793 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Addcdiv] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.820 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Addcmul] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.841 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AxpyV2] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.865 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LogicalAnd] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.885 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LogicalOr] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.907 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Mul] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.928 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Pow] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.949 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RealDiv] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.971 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ClipByNormNoDivSum] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.222.992 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ClipByValue] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.012 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ClipByValueV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.034 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FusedMulAdd] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.056 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftmaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.077 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Sub] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.100 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Gcd] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.120 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LarsV2Update] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.140 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaskedFill] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.161 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.182 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Xlog1py] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.203 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApproximateEqual] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.223 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Equal] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.246 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NotEqual] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.268 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Greater] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.288 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GreaterEqual] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.309 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Less] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.328 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LessEqual] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.356 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Maximum] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.223.339 [op_impl_space_registry.cc:240]618654 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.223.369 [opp_so_manager.cc:48]618654 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.380 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Minimum] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.403 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Mod] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.420 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : [InferShape]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.223.415 [opp_so_manager.cc:97]618654 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.444 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MulNoNan] register OP_IMPL : [InferShape]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.223.454 [opp_so_manager.cc:97]618654 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.464 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReciprocalGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.487 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SeluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.507 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogits] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.528 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftplusGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.548 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftplusV2Grad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.223.543 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.223.563 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.571 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftsignGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.223.578 [opp_so_manager.cc:45]618654 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.593 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SquaredDifference] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.612 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.632 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ThresholdGradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.652 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TruncateDiv] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.672 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TruncateMod] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.693 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Xdivy] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.716 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IsClose] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.738 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Xlogy] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.755 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.775 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SelectV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.223.778 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.796 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaskedSelectV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.816 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Lerp] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.836 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FusedBiasLeakyReluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.223.945 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.223.994 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.224.044 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.224.145 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.224.221 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.224.249 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.224.281 [op_impl_space_registry.cc:240]618654 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.224.313 [opp_so_manager.cc:48]618654 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.224.366 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.224.390 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.224.418 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.224.440 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.224.409 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.224.453 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.224.469 [opp_so_manager.cc:45]618654 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.224.540 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.224.585 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.224.634 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.224.727 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.224.767 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.224.832 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.224.924 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.224.927 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.225.037 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.225.139 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Quantize] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.225.125 [op_impl_space_registry.cc:240]618654 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.225.155 [opp_so_manager.cc:48]618654 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.225.163 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.225.188 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AscendDequant] register OP_IMPL : [InferShape]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.225.195 [opp_so_manager.cc:97]618654 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.225.210 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : [InferShape]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.225.234 [opp_so_manager.cc:97]618654 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.225.298 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.225.321 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.225.340 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.225.352 [opp_so_manager.cc:45]618654 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.225.400 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.225.424 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.225.447 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.225.465 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.225.489 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.225.512 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BasicLSTMInplaceFillWindowCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.225.533 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BasicGRUInplaceFillWindowCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.225.632 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.225.727 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.225.815 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.225.835 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.225.928 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.225.950 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.225.988 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.226.006 [op_impl_space_registry.cc:240]618654 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.226.035 [opp_so_manager.cc:48]618654 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.226.054 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdaCast] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.226.123 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.226.143 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.226.131 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.226.146 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.226.158 [opp_so_manager.cc:45]618654 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.226.169 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.226.189 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.226.206 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.226.295 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.226.297 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyAdamWV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.226.394 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.226.453 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.226.487 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.226.579 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.226.591 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.226.599 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.226.688 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.226.766 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.226.780 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.226.783 [op_impl_space_registry.cc:240]618654 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.226.804 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [InferShape]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.226.813 [opp_so_manager.cc:48]618654 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.226.857 [opp_so_manager.cc:97]618654 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.226.896 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.226.907 [opp_so_manager.cc:97]618654 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.226.929 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.226.993 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.227.011 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.226.998 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.227.026 [opp_so_manager.cc:45]618654 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.227.091 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.227.102 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.227.199 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.227.219 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.227.228 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.227.313 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[L2Loss] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.227.348 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.227.408 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.227.443 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.227.505 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.227.595 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.227.691 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.227.682 [op_impl_space_registry.cc:240]618654 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.227.710 [opp_so_manager.cc:48]618654 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.227.786 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.227.785 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.227.800 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.227.819 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.227.814 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceAny] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.227.824 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.227.834 [opp_so_manager.cc:45]618654 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.227.843 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceAll] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.227.846 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.227.864 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.227.865 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceMax] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.227.883 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.227.883 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.227.906 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceMeanWithCast] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.227.906 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.227.924 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.227.926 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceMin] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.227.943 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.227.946 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceProd] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.227.960 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.227.969 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.227.978 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.227.993 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[EuclideanNorm] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.227.996 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.013 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.228.015 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceLogSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.031 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.228.035 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceLogSumExp] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.049 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.067 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.084 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.102 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.120 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.228.127 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceNansum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.141 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.168 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.187 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.206 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.224 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.242 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.228.245 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.260 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.228.268 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.278 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.228.296 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.303 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.228.314 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.321 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.228.332 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.340 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.228.348 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.357 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.376 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.393 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.410 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.427 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.446 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.228.446 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.464 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.482 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.500 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.228.480 [op_impl_space_registry.cc:240]618654 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.228.514 [opp_so_manager.cc:48]618654 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.520 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.540 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.228.540 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.558 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.228.559 [opp_so_manager.cc:97]618654 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.575 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.594 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.228.594 [opp_so_manager.cc:97]618654 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.612 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.632 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.228.632 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.228.634 [opp_so_manager.cc:97]618654 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/usr/local/Ascend/ascend-toolkit/latest/opp/op_proto/custom/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.650 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.228.652 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.668 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.686 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.703 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.722 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.228.715 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 0 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.741 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.228.746 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.764 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.782 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.228.763 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.228.803 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.801 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.821 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.228.818 [opp_so_manager.cc:45]618654 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.228.837 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [InferShape][InferShapeRange][InferDataType][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.228.841 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.228.861 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SplitD] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.228.880 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.228.976 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.229.005 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachACosInplace] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.229.069 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.229.159 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachAddListInplace] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.229.171 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.229.267 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.229.331 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMulScalarInplace] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.229.355 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachLogInplace] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.229.360 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.229.375 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSubListInplace] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.229.394 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachMulListInplace] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.229.412 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachDivListInplace] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.229.458 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.229.555 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.229.569 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachSubScalarInplace] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.229.656 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.229.694 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.229.749 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.229.808 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.229.842 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.229.924 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.229.946 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.229.967 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.229.986 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.230.031 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.230.079 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.230.144 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.230.171 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.230.192 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.230.281 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.230.311 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3dGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.230.373 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.230.443 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.230.463 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.230.558 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.230.613 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.230.652 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.230.672 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.230.731 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.230.765 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.230.856 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.230.859 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.230.881 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.230.902 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.230.954 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.231.016 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.231.044 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.231.047 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.231.065 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.231.069 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.231.155 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.231.196 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.231.252 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.231.343 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.231.371 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.231.435 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.231.527 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.231.531 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.231.626 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.231.655 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.231.675 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.231.688 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.231.774 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.231.794 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.231.803 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.231.812 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.231.831 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.231.849 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.231.867 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.231.883 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.231.900 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.231.916 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.231.933 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.231.949 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.231.965 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.231.981 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.231.998 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.232.016 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.232.016 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IndexPutWithSort] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.232.033 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.232.050 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.232.132 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.232.146 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SegmentSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.232.258 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.232.338 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InplaceIndexAddWithSorted] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.232.355 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.232.446 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.232.458 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.232.542 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.232.593 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.232.615 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.232.638 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.232.654 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.232.754 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UnsortedSegmentMax] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.232.778 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UnsortedSegmentMin] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.232.799 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UnsortedSegmentProd] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.232.801 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.232.818 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.232.909 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdamApplyOne] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.232.936 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdamApplyOneAssign] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.232.957 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecay] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.232.963 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.232.978 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecayAssign] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.233.071 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BN3DTrainingReduce] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.233.090 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.233.107 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.233.123 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.233.124 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.233.216 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNTrainingReduce] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.233.287 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.233.312 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.233.405 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.233.486 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.233.496 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.233.588 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.233.635 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.233.679 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.233.768 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.233.776 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.233.895 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.233.941 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.233.991 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.234.096 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.234.115 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.234.196 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.234.293 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[INTrainingReduceV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.234.303 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.234.392 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.234.416 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[INTrainingUpdateGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.234.438 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[INTrainingUpdateGradGammaBeta] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.234.447 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.234.459 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[INTrainingUpdateV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.234.547 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.234.573 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.234.642 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.234.687 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.234.737 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.234.813 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.234.829 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.234.921 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.234.929 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.235.021 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.235.091 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.235.111 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.235.062 [op_impl_space_registry.cc:273]618650 ConvertSoToRegistry:Save so symbol and handle in path[/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so] success!
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.235.207 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPool] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.235.262 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.235.311 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPool3D] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.235.377 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Resize] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.235.407 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.235.425 [plugin_manager.cc:554]618650 GetUpgradedOpsProtoPath:Start to get upgraded ops proto path
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.235.451 [plugin_manager.cc:134]618650 GetUpgradedOppPath:Enter get upgraded opp path schedule
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.235.504 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPoolV3] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.235.506 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.235.505 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /usr/local/Ascend/ascend-toolkit/latest/opp_latest/, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.235.526 [plugin_manager.cc:145]618650 GetUpgradedOppPath:[Call][RealPath] Opp path /usr/local/Ascend/ascend-toolkit/latest/opp_latest/ is invalid.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.235.542 [plugin_manager.cc:557]618650 GetUpgradedOpsProtoPath:Failed to get upgraded opp path!
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.235.560 [plugin_manager.cc:108]618650 GetOppPath:Enter get opp path schedule
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.235.591 [plugin_manager.cc:117]618650 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.235.599 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.235.621 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.235.698 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaximumGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.235.721 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MinimumGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.235.753 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.235.814 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.235.868 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.235.913 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LogSoftmaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.235.935 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.235.953 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.235.985 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftMarginLoss] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.236.004 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.236.025 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftmaxFocalLoss] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.236.043 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.236.060 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.236.151 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.236.201 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Mish] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.236.302 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.236.380 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.236.392 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.236.382 [plugin_manager.cc:996]618650 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.236.452 [plugin_manager.cc:1011]618650 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.236.478 [plugin_manager.cc:1015]618650 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.236.486 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.236.573 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.236.592 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.236.585 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.236.652 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.236.669 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.236.682 [opp_so_manager.cc:66]618650 LoadOpMasterPackage:Start load op master package, is_split:[1].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.236.680 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsV2] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.236.698 [plugin_manager.cc:616]618650 GetOpTilingForwardOrderPath:Enter GetOpTilingPath schedule
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.236.714 [plugin_manager.cc:108]618650 GetOppPath:Enter get opp path schedule
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.236.736 [plugin_manager.cc:117]618650 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.236.757 [plugin_manager.cc:624]618650 GetOpTilingForwardOrderPath:Opp plugin path structure is new version!
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.236.782 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftmaxCrossEntropyWithLogits] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.236.775 [plugin_manager.cc:206]618650 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.236.854 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.236.880 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.236.900 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.236.987 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.236.993 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.237.083 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.237.113 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.237.137 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.237.177 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.237.176 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.237.219 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.237.237 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.237.251 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.237.251 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.237.268 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.237.300 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.237.364 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.237.373 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.237.460 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.237.486 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.237.563 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyAdadeltaD] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.237.587 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.237.617 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyAdagradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.237.620 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.237.641 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyAdaMaxD] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.237.662 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyAdamD] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.237.653 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.237.685 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradD] register OP_IMPL : [InferShape]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.237.689 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.237.707 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.237.706 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.237.728 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyAddSignD] register OP_IMPL : [InferShape]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.237.723 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.237.732 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.237.750 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyCenteredRMSPropD] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.237.762 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.237.771 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyFtrlD] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.237.793 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyFtrlV2D] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.237.813 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyGradientDescent] register OP_IMPL : [InferShape]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.237.805 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.237.823 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.237.835 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyKerasMomentumD] register OP_IMPL : [InferShape]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.237.840 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.237.857 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyMomentumD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.237.857 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.237.858 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.237.879 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyPowerSignD] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.237.881 [plugin_manager.cc:215]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.237.900 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyProximalAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.237.921 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyProximalGradientDescent] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.237.943 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyRMSPropD] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.237.963 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyAdagradDAD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.237.971 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.238.050 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.238.084 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.238.146 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FusedMulApplyMomentum] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.238.171 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FusedMulApplyKerasMomentum] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.238.222 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.238.250 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.238.257 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.238.268 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.238.276 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.238.310 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.238.346 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.238.362 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GeluGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.238.389 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.238.459 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GeluGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.238.512 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.238.529 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.238.635 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IsNegInf] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.238.690 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.238.700 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.238.724 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.238.731 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IsPosInf] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.238.743 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.238.762 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.238.801 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.238.816 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.238.835 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [InferShape]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.238.838 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.238.856 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.238.875 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.238.894 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.238.904 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.238.909 [plugin_manager.cc:215]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.238.944 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.239.003 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.239.063 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.239.094 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.239.186 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.239.247 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.239.257 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.239.278 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.239.282 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.239.301 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.239.319 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.239.355 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.239.380 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReluV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.239.455 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.239.479 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.239.578 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.239.578 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RoiPoolingGradWithArgMax] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.239.674 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Cummax] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.239.694 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.239.703 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.239.696 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.239.747 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.239.765 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.239.778 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.239.789 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.239.818 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.239.816 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.239.854 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.239.872 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.239.887 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.239.885 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.239.903 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.239.922 [plugin_manager.cc:215]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.239.937 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.239.987 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.240.050 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.240.081 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Col2ImV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.240.195 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.240.203 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.240.219 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.240.282 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.240.310 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.240.319 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.240.321 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.240.341 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.240.357 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.240.396 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.240.402 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.240.482 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StackBallQuery] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.240.503 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.240.597 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.240.593 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.240.692 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.240.738 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.240.766 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.240.772 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.240.792 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2d] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.240.790 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.240.808 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.240.844 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.240.895 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.240.895 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.240.915 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.240.930 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.240.947 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.240.961 [plugin_manager.cc:215]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.240.987 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.241.066 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScoreGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.241.089 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.241.181 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.241.272 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.241.271 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.241.298 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.241.333 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.241.351 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.241.364 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.241.369 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaskedSelect] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.241.402 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.241.449 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.241.469 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.241.490 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.241.581 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.241.648 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.241.679 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.241.742 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.241.773 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [InferShape][InputsDependency]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.241.776 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.241.794 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.241.813 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.241.846 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.241.880 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.241.883 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.241.884 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.241.902 [plugin_manager.cc:1026]618650 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.241.935 [plugin_manager.cc:322]618650 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.241.948 [plugin_manager.cc:212]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.241.965 [plugin_manager.cc:215]618650 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.241.980 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.241.981 [plugin_manager.cc:218]618650 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-pack
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.242.005 [plugin_manager.cc:422]618650 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.242.022 [plugin_manager.cc:155]618650 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.242.044 [plugin_manager.cc:158]618650 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.242.061 [plugin_manager.cc:426]618650 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.242.078 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.242.098 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.242.179 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.242.273 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.242.323 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.242.354 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.242.368 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.242.375 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.242.392 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.242.389 [plugin_manager.cc:250]618650 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.242.414 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.242.433 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.242.426 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.242.444 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.242.454 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.242.463 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RNNTLoss] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.242.461 [plugin_manager.cc:1063]618650 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.242.473 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.242.501 [plugin_manager.cc:439]618650 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.242.562 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MultinomialWithReplacement] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.242.657 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.242.677 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.242.783 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StatelessBernoulli] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.242.836 [plugin_manager.cc:996]618650 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.242.866 [plugin_manager.cc:1011]618650 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.242.873 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.242.889 [plugin_manager.cc:1015]618650 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.242.947 [opp_so_manager.cc:123]618650 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.242.970 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.243.061 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.243.053 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.243.072 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.243.088 [opp_so_manager.cc:45]618650 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.243.164 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UniqueConsecutive] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.243.267 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UniqueWithCountsAndSorting] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.243.308 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.243.421 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[WarpAffine] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.243.525 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Histogram] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.243.618 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.243.711 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.243.728 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.243.809 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Unique] register OP_IMPL : [InferShapeRange]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.243.909 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UniqueWithCounts] register OP_IMPL : [InferShapeRange]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.244.007 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Dot] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.244.102 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.244.149 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.244.202 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.244.301 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.244.322 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.244.352 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.244.422 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardReduce] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.244.518 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStatsWithCounts] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.244.552 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.244.612 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.244.633 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.244.651 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.244.669 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.244.695 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.244.713 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.244.731 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.244.748 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.244.764 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.244.854 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.244.827 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff45b0f2c0, registered count:4
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.244.876 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.244.894 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.244.895 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.244.924 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.244.946 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.244.971 [op_check.cc:71]618650 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.244.980 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.244.996 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.245.078 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.245.118 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.245.172 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.245.264 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.245.276 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff45b13978, registered count:4
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.245.291 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.245.302 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.245.326 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.245.347 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.245.361 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.245.366 [op_check.cc:71]618650 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.245.384 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.245.403 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.245.489 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.245.582 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.245.602 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.245.636 [op_impl_registry_holder_manager.cc:208]618650 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.245.666 [op_impl_registry_holder_manager.cc:216]618650 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.245.698 [op_impl_registry_holder_manager.cc:208]618650 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.245.696 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.245.739 [op_impl_registry_holder_manager.cc:208]618650 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.245.786 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.245.881 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.245.976 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.245.976 [op_impl_space_registry.cc:273]618650 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so] success!
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.246.006 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.246.024 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.246.030 [opp_so_manager.cc:123]618650 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.246.043 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.246.134 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.246.157 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.246.143 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.246.164 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.246.177 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.246.180 [opp_so_manager.cc:45]618650 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.246.273 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.246.293 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.246.310 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.246.400 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.246.420 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.246.437 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.246.454 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.246.541 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.246.630 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.246.722 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.246.743 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.246.761 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.246.854 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.246.874 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.246.964 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.247.054 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.247.152 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.247.172 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.247.190 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.247.279 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.247.299 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.247.317 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.247.406 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.247.501 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.247.592 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.247.623 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:AllFinite, funcPointer:(nil), registered count:4
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.247.661 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:AllFinite, funcPointer:(nil), registered count:6
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.247.688 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.247.683 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:AllFinite, funcPointer:(nil), registered count:3
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.247.703 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:AllFinite, funcPointer:(nil), registered count:3
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.247.724 [op_check.cc:71]618650 RegisterParamGeneralize:RegisterParamGeneralize: op_type:AllFinite, funcPointer:(nil), registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.247.785 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.247.875 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.247.918 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.247.968 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.248.005 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff45ac09b0, registered count:4
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.248.031 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.248.051 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.248.066 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.248.070 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.248.090 [op_check.cc:71]618650 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.248.179 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2dAssistMatrix] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.248.278 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.248.379 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.248.410 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff45ac3da0, registered count:4
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.248.436 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.248.457 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.248.470 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.248.473 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.248.492 [op_check.cc:71]618650 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.248.566 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.248.663 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Cdist] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.248.742 [op_impl_registry_holder_manager.cc:208]618650 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.248.759 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CdistGrad] register OP_IMPL : [InferShape]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.248.769 [op_impl_registry_holder_manager.cc:216]618650 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.248.789 [op_impl_registry_holder_manager.cc:208]618650 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.248.826 [op_impl_registry_holder_manager.cc:208]618650 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.248.854 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.248.884 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.248.903 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.248.998 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.249.017 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.249.035 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.249.125 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.249.125 [op_impl_space_registry.cc:84]618650 MergeFunctions:op type DecoderKvCache tiling_parse func has been registered
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.249.147 [op_impl_space_registry.cc:85]618650 MergeFunctions:op type DecoderKvCache compile_info_creator func has been registered
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.249.161 [op_impl_space_registry.cc:86]618650 MergeFunctions:op type DecoderKvCache compile_info_deleter func has been registered
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.249.176 [op_impl_space_registry.cc:87]618650 MergeFunctions:op type DecoderKvCache tiling func has been registered
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.249.189 [op_impl_space_registry.cc:93]618650 MergeFunctions:op type DecoderKvCache max_tiling_data_size has been registered
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.249.206 [op_impl_space_registry.cc:84]618650 MergeFunctions:op type PromptKvCache tiling_parse func has been registered
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.249.222 [op_impl_space_registry.cc:85]618650 MergeFunctions:op type PromptKvCache compile_info_creator func has been registered
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.249.220 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.249.236 [op_impl_space_registry.cc:86]618650 MergeFunctions:op type PromptKvCache compile_info_deleter func has been registered
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.249.252 [op_impl_space_registry.cc:87]618650 MergeFunctions:op type PromptKvCache tiling func has been registered
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.249.264 [op_impl_space_registry.cc:93]618650 MergeFunctions:op type PromptKvCache max_tiling_data_size has been registered
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.249.278 [op_impl_space_registry.cc:273]618650 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so] success!
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.249.313 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.249.340 [opp_so_manager.cc:123]618650 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.249.380 [opp_so_manager.cc:126]618650 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.249.412 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GlobalLpPool] register OP_IMPL : [InferShape]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.249.418 [opp_so_manager.cc:123]618650 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.249.511 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GLU] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.249.517 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.249.536 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.249.550 [opp_so_manager.cc:45]618650 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.249.608 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GLUGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.249.713 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.249.781 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.249.806 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.249.901 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LpLoss] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.249.910 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.250.001 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LpNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.250.022 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.250.026 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.250.041 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.250.058 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.250.088 [op_impl_space_registry.cc:240]618650 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.250.115 [opp_so_manager.cc:48]618650 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.250.140 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.250.162 [opp_so_manager.cc:123]618650 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.250.261 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.250.280 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.250.290 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MinAreaPolygons] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.250.292 [opp_so_manager.cc:45]618650 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.250.390 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.250.443 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CircularPad] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.250.491 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.250.582 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.250.596 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[CircularPadGrad] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.250.674 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.250.770 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.250.796 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.250.877 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.250.916 [op_impl_space_registry.cc:240]618650 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.250.945 [opp_so_manager.cc:48]618650 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.250.968 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.250.990 [opp_so_manager.cc:123]618650 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.251.041 [opp_so_manager.cc:126]618650 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.251.064 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.251.078 [opp_so_manager.cc:123]618650 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.251.156 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.251.150 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.251.174 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.251.193 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.251.179 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.251.209 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.251.208 [opp_so_manager.cc:45]618650 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.251.232 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.251.251 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.251.255 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.251.346 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.251.440 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleLinear1d] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.251.442 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.251.467 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleBilinear2d] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.251.538 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.251.628 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.251.632 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleBicubic2d] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.251.648 [op_impl_space_registry.cc:240]618650 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.251.674 [opp_so_manager.cc:48]618650 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.251.718 [opp_so_manager.cc:123]618650 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.251.725 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.251.794 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAA] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.251.817 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.251.813 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.251.831 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.251.846 [opp_so_manager.cc:45]618650 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.251.915 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.251.974 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAAGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.252.010 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.252.103 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.252.146 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.252.206 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.252.300 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.252.341 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.252.370 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3dGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.252.396 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.252.410 [op_impl_space_registry.cc:240]618650 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.252.440 [opp_so_manager.cc:48]618650 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.252.487 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.252.486 [opp_so_manager.cc:123]618650 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.252.534 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAA] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.252.526 [opp_so_manager.cc:126]618650 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.252.584 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.252.579 [opp_so_manager.cc:123]618650 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.252.681 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : [InferShape]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.252.674 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.252.692 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.252.707 [opp_so_manager.cc:45]618650 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.252.704 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.252.718 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAABackward] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.252.806 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotatedNMS] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.252.885 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.252.906 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.253.003 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.253.055 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ResizeUpsampleTrilinear] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.253.140 [op_impl_space_registry.cc:240]618650 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.253.166 [opp_so_manager.cc:48]618650 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.253.209 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SilentCheck] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.253.210 [opp_so_manager.cc:123]618650 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.253.226 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dBackward] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.253.306 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.253.324 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.253.315 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.253.339 [opp_so_manager.cc:45]618650 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.253.383 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.253.406 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3d] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.253.416 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.253.516 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3d] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.253.561 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleNearest] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.253.609 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.253.700 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.253.747 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleNearestExact2dGrad] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.253.771 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[UpsampleNearest2dGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.253.794 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ActiveRotatedFilter] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.253.876 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.253.891 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ActiveRotatedFilterGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.253.889 [op_impl_space_registry.cc:240]618650 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.253.917 [opp_so_manager.cc:48]618650 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.253.961 [opp_so_manager.cc:123]618650 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.253.988 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.254.003 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.253.999 [opp_so_manager.cc:126]618650 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.254.028 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.254.038 [opp_so_manager.cc:123]618650 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.254.096 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.254.147 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.254.165 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.254.178 [opp_so_manager.cc:45]618650 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.254.191 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.254.284 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.254.376 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.254.387 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.254.411 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.254.469 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.254.529 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.254.570 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.254.610 [op_impl_space_registry.cc:240]618650 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.254.635 [opp_so_manager.cc:48]618650 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.254.646 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.254.666 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PSAMask] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.254.675 [opp_so_manager.cc:123]618650 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.254.766 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PSAMaskGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.254.771 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.254.771 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.254.790 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.254.804 [opp_so_manager.cc:45]618650 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.254.859 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.254.895 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.254.956 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.255.011 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.255.052 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.255.127 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.255.258 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.255.319 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.255.353 [op_impl_space_registry.cc:240]618650 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.255.380 [opp_so_manager.cc:48]618650 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.255.420 [opp_so_manager.cc:123]618650 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.255.454 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [InferShape][InferDataType]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.255.457 [opp_so_manager.cc:126]618650 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.255.494 [opp_so_manager.cc:123]618650 LoadOpMasterSo:Get path with op_master path [/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.255.524 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.255.522 [opp_so_manager.cc:126]618650 LoadOpMasterSo:Get path with op_tiling path [/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.255.570 [opp_so_manager.cc:123]618650 LoadOpMasterSo:Get path with op_master path [/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.255.644 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ThreeNN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.255.655 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_ct.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.255.674 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.255.720 [plugin_manager.cc:1126]618650 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.255.737 [plugin_manager.cc:1130]618650 GetFileListWithSuffix:Found 2 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.255.749 [opp_so_manager.cc:45]618650 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.255.754 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Voxelization] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.255.890 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.255.920 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.255.928 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.255.951 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.255.982 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.256.009 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [InferShape][InferDataType][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.256.038 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.255.990 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.256.065 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [InferShape][InferDataType][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.057 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[EluGradV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.256.090 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.083 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.105 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.256.114 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.256.134 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.128 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SyncBNTrainingUpdate] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.256.152 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.256.181 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.256.204 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.256.235 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CompressFcOp] register OP_IMPL : [InferShape][InferDataType][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.150 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Abs] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.201 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Real] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.218 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Acos] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.234 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Acosh] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.248 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddMatMatElements] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.256.257 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.266 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Adds] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.287 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Asin] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.306 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Asinh] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.327 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AssignAdd] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.256.327 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.256.352 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.347 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AssignSub] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.367 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Atan] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.389 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Atanh] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.408 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.428 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BesselI0e] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.256.451 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.449 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BesselI1e] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.468 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.487 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.509 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.256.530 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.529 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.256.551 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.550 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Bucketize] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.594 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Cast] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.615 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Ceil] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.635 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CeluV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.256.652 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.656 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ComplexAbs] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.677 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Cos] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.697 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Cosh] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.718 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.738 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DataFormatDimMap] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.256.748 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.758 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Dequantize] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.779 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Elu] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.799 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Erf] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.256.775 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DefaultImpl] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.819 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Erfc] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.839 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Exp] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.256.855 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMatMulV4] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.861 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Expm1] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.256.874 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.882 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FakeQuantWithMinMaxVars] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.900 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FastGelu] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.920 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FastGeluV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.940 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Floor] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.256.949 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.961 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FusedMulAddN] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.256.981 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HardSigmoid] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.001 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HardShrink] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.021 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HardShrinkGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.257.035 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.041 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HardSwish] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.257.064 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.061 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HardSwishGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.257.068 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.081 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HardtanhGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.102 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IndexFillD] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.121 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.148 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.165 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Inv] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.257.169 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.186 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Invert] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.207 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Log] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.228 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Log1p] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.257.234 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.248 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LogicalNot] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.257.265 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.268 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LogAddExp] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.257.277 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ReflectionPad3dGrad] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.287 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LpNormUpdate] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.307 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LpNormUpdateV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.257.315 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.327 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Dawsn] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.348 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Expint] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.257.363 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.367 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Erfinv] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.388 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FresnelCos] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.257.385 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.257.405 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.407 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FresnelSin] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.428 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Ndtri] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.448 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Spence] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.257.457 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AscendAntiQuantV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.257.466 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ResizeTrilinear] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.468 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Fills] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.490 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LeakyRelu] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.509 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[OnesLike] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.257.524 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.257.531 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.529 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Reciprocal] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.550 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Sign] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.257.564 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.571 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Sqrt] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.591 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Tanh] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.257.595 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.611 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ZerosLike] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.257.618 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.631 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Gelu] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.652 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GeluV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.257.658 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.257.684 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.671 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Relu] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.257.687 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.257.682 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Concat] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.257.705 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.699 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Neg] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.257.713 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.257.707 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ConcatV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.257.726 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.721 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LogSoftmaxV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.257.730 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.257.737 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.257.746 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.743 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.257.752 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.257.759 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantConv2D] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.766 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.787 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.805 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftplusV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.825 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Muls] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.845 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Power] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.865 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Relu6] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.257.866 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.257.872 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.884 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Relu6D] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.257.905 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.905 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Relu6Grad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.925 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReluGradV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.257.938 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.257.932 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.945 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Rint] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.257.970 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.965 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Round] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.257.985 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Rsqrt] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.257.998 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.258.001 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.004 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RsqrtGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.023 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Selu] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.258.037 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.041 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Shrink] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.061 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Sigmoid] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.258.069 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.258.071 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.081 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.258.096 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.099 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SigmoidGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.258.121 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.120 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Sin] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.258.137 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.141 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Sinh] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.258.149 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.160 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SmoothL1Loss] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.258.175 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.178 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SmoothL1LossGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.258.199 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.258.206 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.199 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LogSigmoid] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.258.222 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.228 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LogSigmoidGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.258.229 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.245 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LogSpaceD] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.258.260 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.265 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Softplus] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.258.291 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.286 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Softsign] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.258.295 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.306 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SqrtGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.323 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Square] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.258.319 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.258.319 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.258.347 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [InferShape][InferDataType][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.341 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Swish] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.258.341 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.362 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwishGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.258.371 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [InferShape][InputsDependency][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.382 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SiluGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.405 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardElemt] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.258.420 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.432 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Tan] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.258.439 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.455 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftShrink] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.479 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftShrinkGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.258.487 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.505 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Threshold] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.526 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ThresholdV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.258.543 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ActULQClampMaxGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.548 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ThresholdV2D] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.258.549 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.258.570 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ActULQClampMinGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.570 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Trunc] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.594 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.614 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.258.619 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.635 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MishGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.656 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HardSigmoidGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.258.670 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ActsULQ] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.678 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.258.685 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.700 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.721 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.742 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.258.747 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.764 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FillDiagonal] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.258.772 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ActsULQInputGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.787 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IndexPut] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.258.814 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.821 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReadVariableOp] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.842 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CastLike] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.864 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FusedBiasLeakyRelu] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.258.869 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.258.881 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.886 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StatelessBernoulliV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.911 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.258.919 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3d] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.933 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InvertPermutation] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.258.952 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.955 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.258.968 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.976 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SearchSorted] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.258.998 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.259.017 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.020 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.046 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.069 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.259.065 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdaptiveAvgPoolAssistMatrix] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.259.081 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.091 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.259.148 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.259.176 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.259.199 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.207 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaskedScale] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.259.212 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.236 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AbsGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.258 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AccumulateNV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.259.274 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.280 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddN] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.259.293 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.301 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Eltwise] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.323 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.345 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AcosGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.259.346 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.366 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AcoshGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.259.380 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.385 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AsinGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.259.394 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.410 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AsinhGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.259.415 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.434 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Atan2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.457 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AtanGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.259.479 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.259.488 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.481 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Axpy] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.513 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BitwiseAnd] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.536 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BitwiseOr] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.259.555 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.557 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BitwiseXor] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.259.580 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.584 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Div] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.259.602 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.607 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DivNoNan] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.630 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[EluGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.652 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FastGeluGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.672 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FloorDiv] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.259.635 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DefaultImpl] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.259.693 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.700 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FloorMod] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.259.714 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.730 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InvGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.753 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LeakyReluGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.775 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TanhGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.259.789 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.797 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Add] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.819 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Addcdiv] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.841 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Addcmul] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.863 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AxpyV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.259.876 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.259.881 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.884 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LogicalAnd] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.259.904 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.906 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LogicalOr] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.929 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Mul] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.950 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Pow] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.259.975 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.972 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RealDiv] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.259.994 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ClipByNormNoDivSum] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.017 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ClipByValue] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.041 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ClipByValueV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.260.049 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.260.060 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.063 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FusedMulAdd] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.086 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftmaxGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.260.078 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.105 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Sub] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.260.125 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.133 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Gcd] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.171 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LarsV2Update] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.260.154 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.196 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaskedFill] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.220 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReluGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.260.236 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AvgPoolUpdate] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.260.238 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.245 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Xlog1py] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.260.239 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.267 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApproximateEqual] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.289 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Equal] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.260.308 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AscendAntiQuantV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.311 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NotEqual] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.333 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Greater] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.260.342 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.357 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GreaterEqual] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.260.372 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.381 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Less] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.260.399 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.404 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LessEqual] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.260.424 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.426 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Maximum] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.260.441 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.260.441 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.452 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Minimum] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.260.464 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.472 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Mod] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.493 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.515 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MulNoNan] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.260.534 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Concat] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.536 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReciprocalGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.260.546 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Bitcast] register OP_IMPL : [InferShape][InferShapeRange][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.260.557 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ConcatV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.558 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SeluGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.260.579 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.260.584 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.581 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogits] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.603 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftplusGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.260.600 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.624 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftplusV2Grad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.646 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftsignGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.260.650 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.667 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SquaredDifference] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.691 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.260.707 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.260.721 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.715 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ThresholdGradV2D] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.260.744 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.745 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TruncateDiv] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.768 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TruncateMod] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.260.773 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.787 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Xdivy] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.260.808 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.810 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IsClose] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.833 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Xlogy] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.260.840 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.858 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.881 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SelectV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.260.894 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.260.902 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.902 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaskedSelectV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.260.901 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.926 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Lerp] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.260.950 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FusedBiasLeakyReluGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.260.968 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.260.997 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CTCLoss] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.261.036 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.261.060 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.261.067 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.261.078 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.261.098 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.261.122 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.261.146 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.261.166 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.261.172 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.261.204 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.261.231 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AGLU] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.261.230 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.261.276 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.261.295 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [InferShape][IsPrivateAtrrReg]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.261.302 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.261.378 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.261.368 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.261.394 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DropOutGenMask] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.261.423 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StatelessDropOutGenMask] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.261.444 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.261.497 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.261.511 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.261.518 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.261.523 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.261.550 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.261.574 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.261.578 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.261.616 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.261.633 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.261.643 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.261.675 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.261.709 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.261.711 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.261.777 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.261.786 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.261.810 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.261.842 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.261.884 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.261.909 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ExpandDims] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.261.912 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.261.983 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.261.988 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.261.999 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.262.004 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.262.053 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.262.090 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.262.119 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.262.135 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FillWindowCache] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.262.186 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.262.208 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.262.231 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.262.248 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.262.251 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.262.318 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.262.313 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Quantize] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.262.330 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FlattenV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.262.339 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.262.376 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AscendDequant] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.262.398 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.262.434 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GatherShapes] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.262.438 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.262.497 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.262.533 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GaussianBlur] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.262.600 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.262.626 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.262.652 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.262.661 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FileConstant] register OP_IMPL : [IsPrivateAtrrReg]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.262.675 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.262.692 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StatelessIf] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.262.701 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.262.719 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[If] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.262.724 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BasicLSTMInplaceFillWindowCache] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.262.743 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[_If] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.262.747 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BasicGRUInplaceFillWindowCache] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.262.767 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Case] register OP_IMPL : [InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.262.818 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ConstPlaceHolder] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.262.847 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.262.912 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.262.954 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.263.018 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.263.065 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.263.089 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Identity] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.263.120 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MemcpyAsync] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.263.142 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IdentityN] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.263.168 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.263.194 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.263.230 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.263.298 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdaCast] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.263.324 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.263.398 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.263.426 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.263.427 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.263.453 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.263.476 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.263.526 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.263.523 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.263.577 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.263.620 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.263.679 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.263.712 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.263.733 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.263.752 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.263.785 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.263.877 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.263.888 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.263.900 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.263.914 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.263.971 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.263.979 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.264.015 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.264.071 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.264.127 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.264.175 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.264.154 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.264.281 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.264.293 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.264.375 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.264.395 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.264.467 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.264.503 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.264.544 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NLLLossGrad310p] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.264.565 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.264.613 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.264.640 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.264.669 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RandomChoiceWithMask] register OP_IMPL : [InferShapeRange]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.264.707 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.264.738 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[L2Loss] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.264.774 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RandomUniform] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.264.847 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Rank] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.264.840 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.264.868 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.264.873 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Size] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.264.851 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.264.944 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.264.961 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.264.985 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DropoutWithMulsAndSoftmaxGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.264.980 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.265.049 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.265.059 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Reshape] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.265.090 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.265.153 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.265.159 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RgbToGrayscale] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.265.156 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.265.258 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.265.256 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.265.284 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceAny] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.265.307 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.265.308 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceAll] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.265.334 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.265.331 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceMax] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.265.354 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.265.361 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.265.360 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.265.379 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceMeanWithCast] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.265.402 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceMin] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.265.426 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceProd] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.265.449 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceSum] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.265.459 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.265.460 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.265.472 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[EuclideanNorm] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.265.474 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.265.493 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.265.495 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceLogSum] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.265.518 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceLogSumExp] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.265.559 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Rotate] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.265.580 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DeformableOffsetsGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.265.616 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceNansum] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.265.634 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Shape] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.265.660 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ShapeN] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.265.686 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.265.728 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.265.764 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.265.787 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.265.809 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.265.832 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.265.838 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.265.855 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.265.846 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.265.877 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SilentCheckV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.265.960 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.265.958 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.265.970 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.266.057 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.266.082 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SilentCheckV3] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.266.118 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ForeachBinaryOp] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.266.123 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.266.155 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.266.181 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.266.189 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.266.264 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.266.282 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.266.288 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [InferShape][InferShapeRange]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.266.285 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.266.369 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.266.385 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.266.391 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyAdadelta] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.266.401 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.266.417 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyAdadeltaD] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.266.409 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SplitD] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.266.433 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.266.441 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.266.465 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyAdagrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.266.485 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagrad] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.266.488 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.266.506 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagradD] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.266.528 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.266.534 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.266.548 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2D] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.266.575 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.266.592 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.266.612 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.266.612 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachNonFiniteCheckAndUnscale] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.266.634 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2D] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.266.639 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.266.657 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyRMSProp] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.266.679 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyRMSPropD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.266.708 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.266.725 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.266.747 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.266.777 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseFillEmptyRows] register OP_IMPL : [InferShapeRange][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.266.834 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.266.853 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.266.861 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.266.901 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.266.955 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.266.966 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.267.012 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GatherV3] register OP_IMPL : [][][][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.267.068 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.267.062 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.267.071 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Squeeze] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.267.096 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SqueezeV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.267.119 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SqueezeV3] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.267.119 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.267.161 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.267.180 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.267.210 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.267.238 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.267.260 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.267.261 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.267.295 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.267.312 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StatelessRandomNormalV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.267.360 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.267.360 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.267.373 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.267.404 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.267.453 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InstanceNormV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.267.458 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.267.472 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.267.475 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.267.499 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.267.504 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.267.565 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.267.592 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.267.610 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TopK] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.267.613 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.267.632 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.267.634 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IouV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.267.616 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.267.652 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.267.670 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.267.688 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.267.720 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.267.726 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.267.729 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.267.780 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TopKPQDistanceV2] register OP_IMPL : [InferShape]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.267.820 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BidirectionLSTM] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.267.831 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.267.835 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.267.844 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BidirectionLSTMV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.267.858 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.267.870 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.267.871 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LinSpace] register OP_IMPL : [][][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.267.945 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DeformableOffsetsGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.267.963 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.267.971 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TransArgb] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.267.978 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MemSet] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.268.016 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.268.040 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.268.050 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.268.064 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.268.082 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Unsqueeze] register OP_IMPL : [InferShape]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.268.084 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.268.108 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UnsqueezeV2] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.268.131 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UnsqueezeV3] register OP_IMPL : [InferShape][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.268.179 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.268.210 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaskedSelectV3] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.268.209 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.268.211 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.268.245 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : [InferShape]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.268.272 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dGrad] register OP_IMPL : [InferShape]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.268.281 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.268.319 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.268.346 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.268.367 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Where] register OP_IMPL : [InferShapeRange]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.268.391 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.268.413 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.268.418 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.268.457 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.268.465 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[WtsARQ] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.268.462 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.268.518 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.268.567 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.268.563 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.268.617 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.268.620 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.268.664 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.268.670 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NPUClearFloatStatus] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.268.716 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.268.722 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.268.762 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.268.786 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.268.774 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NPUGetFloatStatus] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.268.818 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.268.840 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.268.844 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.268.885 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.268.907 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.268.908 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.268.936 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.268.946 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.268.954 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachNonFiniteCheckAndUnscale] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.269.004 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdjustContrast] register OP_IMPL : [InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.269.030 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdjustHue] register OP_IMPL : [InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.269.053 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdjustSaturation] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.269.057 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.269.064 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.269.076 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CropAndResize] register OP_IMPL : [InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.269.099 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CropAndResizeV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.269.121 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DecodeAndCropJpeg] register OP_IMPL : [InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.269.143 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DecodeJpeg] register OP_IMPL : [InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.269.142 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.269.165 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NormalizeV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.269.157 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.269.174 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.269.188 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdjustContrastWithMean] register OP_IMPL : [InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.269.201 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.269.209 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdjustBrightness] register OP_IMPL : [InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.269.239 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdjustBrightnessV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.269.263 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdjustSaturationV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.269.256 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.269.258 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.269.286 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[WarpAffineV2] register OP_IMPL : [InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.269.307 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ImgCrop] register OP_IMPL : [InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.269.328 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[WarpPerspective] register OP_IMPL : [InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.269.349 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GatherV3] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.269.354 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.269.397 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.269.422 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.269.445 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.269.453 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.269.463 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.269.456 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.269.481 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.269.504 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.269.568 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HcomAllReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.269.594 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HcomAllGather] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.269.588 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.269.605 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.269.619 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HcomBroadcast] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.269.644 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HcomReduceScatter] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.269.637 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.269.667 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HcomSend] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.269.663 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.269.691 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HcomReduce] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.269.691 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:ReverseSequence, funcPointer:0xffff0f16e360, registered count:5
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.269.686 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.269.714 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HcomReceive] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.269.708 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.269.720 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.269.722 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:ReverseSequence, funcPointer:(nil), registered count:7
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.269.737 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HcomAllToAllV] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.269.745 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:ReverseSequence, funcPointer:(nil), registered count:4
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.269.746 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.269.760 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HcomAllToAllVC] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.269.767 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:ReverseSequence, funcPointer:(nil), registered count:4
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.269.770 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.269.782 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HcomGatherAllToAllV] register OP_IMPL : [InferShape][InferDataType][InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.269.794 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.269.794 [op_check.cc:71]618662 RegisterParamGeneralize:RegisterParamGeneralize: op_type:ReverseSequence, funcPointer:(nil), registered count:4
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.269.814 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.269.815 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.269.818 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.269.837 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.269.841 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.269.859 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.269.882 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.269.904 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.269.926 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.269.923 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.269.942 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.269.948 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.269.945 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.269.971 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.269.996 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.269.987 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.270.043 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.270.058 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.270.098 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SegmentSum] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.270.188 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LinSpace] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.270.202 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.270.253 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.270.303 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MemSet] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.270.305 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.270.406 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.270.407 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.270.408 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.270.512 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.270.512 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.270.513 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.270.537 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.270.611 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.270.626 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.270.638 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.270.666 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.270.715 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UnsortedSegmentMax] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.270.727 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.270.740 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UnsortedSegmentMin] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.270.763 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UnsortedSegmentProd] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.270.770 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.270.776 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.270.787 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.270.785 [op_impl_registry_holder_manager.cc:208]618650 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 1
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.270.838 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.270.843 [op_impl_registry_holder_manager.cc:208]618650 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 1
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.270.862 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.270.873 [op_impl_registry_holder_manager.cc:208]618650 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 11
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.270.876 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.270.886 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdamApplyOne] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.270.902 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.270.911 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdamApplyOneAssign] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.270.940 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : [InferShape]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.270.945 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NPUClearFloatStatus] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.270.947 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecay] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.270.970 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecayAssign] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.271.012 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.271.009 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.271.050 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NPUGetFloatStatus] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.271.070 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BN3DTrainingReduce] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.271.096 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.271.092 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.271.119 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.271.118 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.271.142 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.271.158 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.271.171 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.271.184 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.271.234 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.271.238 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNTrainingReduce] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.271.285 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.271.346 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.271.351 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.271.379 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.271.392 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.271.454 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.271.473 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.271.513 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.271.538 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.271.545 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.271.549 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.271.563 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.271.623 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.271.650 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.271.648 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.271.664 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.271.697 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.271.719 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [InferShape][InferDataType]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.271.744 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.271.771 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.271.841 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.271.845 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:ReverseSequence, funcPointer:0xfffee3a66360, registered count:5
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.271.848 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.271.873 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:ReverseSequence, funcPointer:(nil), registered count:7
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.271.894 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:ReverseSequence, funcPointer:(nil), registered count:4
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.271.912 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [InputsDependency]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.271.914 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:ReverseSequence, funcPointer:(nil), registered count:4
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.271.933 [op_check.cc:71]618674 RegisterParamGeneralize:RegisterParamGeneralize: op_type:ReverseSequence, funcPointer:(nil), registered count:4
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.271.953 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.271.954 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.271.960 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.272.029 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.272.057 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.272.067 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.272.073 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.272.103 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.272.186 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.272.179 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.272.202 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.272.201 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.272.264 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [InputsDependency]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.272.283 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.272.315 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.272.384 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[INTrainingReduceV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.272.399 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.272.421 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.272.492 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.272.520 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[INTrainingUpdateGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.272.542 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[INTrainingUpdateGradGammaBeta] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.272.541 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.272.567 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[INTrainingUpdateV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.272.574 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [InputsDependency]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.272.597 [opsproto_manager.cc:162]618646 LoadOpsProtoPluginSo:OpsProtoManager plugin load /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto.so success.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.272.612 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.272.643 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.272.653 [plugin_manager.cc:108]618646 GetOppPath:Enter get opp path schedule
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.272.663 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.272.668 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.272.704 [plugin_manager.cc:117]618646 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.272.766 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.272.773 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.272.771 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.272.798 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.272.863 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.272.908 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.272.910 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.272.975 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.273.009 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.273.034 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.273.048 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.273.081 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.273.133 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.273.158 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.273.182 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.273.211 [plugin_manager.cc:996]618646 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.273.238 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.273.269 [plugin_manager.cc:1011]618646 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.273.273 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.273.289 [plugin_manager.cc:1015]618646 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.273.280 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.273.347 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.273.377 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.273.384 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPool] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.273.387 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BlendFaceBgPartOne] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.273.403 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.273.454 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.273.467 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.273.483 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.273.485 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPool3D] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.273.495 [opp_so_manager.cc:56]618646 LoadOpsProtoPackage:Start load ops proto package, is_split:[1].
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.273.492 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.273.511 [plugin_manager.cc:540]618646 GetOpsProtoPath:Enter GetOpsProtoPath schedule
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.273.523 [plugin_manager.cc:108]618646 GetOppPath:Enter get opp path schedule
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.273.545 [plugin_manager.cc:117]618646 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.273.561 [plugin_manager.cc:547]618646 GetOpsProtoPath:Opp plugin path structure is new version!
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.273.573 [plugin_manager.cc:206]618646 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.273.585 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.273.576 [op_impl_space_registry.cc:273]618650 ConvertSoToRegistry:Save so symbol and handle in path[/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_ct.so] success!
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.273.604 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.273.633 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.273.670 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.273.701 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPoolV3] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.273.774 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.273.800 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.273.865 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.273.881 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.273.899 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaximumGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.273.918 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.273.924 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MinimumGrad] register OP_IMPL : []
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.273.962 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.273.976 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.273.988 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.274.024 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.274.031 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.274.027 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.274.052 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNN, funcPointer:0xffff0f1f8e08, registered count:7
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.274.065 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.274.121 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LogSoftmaxGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.274.147 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.274.169 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.274.171 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.274.195 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftMarginLoss] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.274.211 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.274.222 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.274.245 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftmaxFocalLoss] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.274.235 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNNV2, funcPointer:0xffff0f201298, registered count:7
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.274.268 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.274.272 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.274.293 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.274.360 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.274.367 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.274.381 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.274.393 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.274.391 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : []
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.274.408 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.274.421 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.274.423 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Mish] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.274.465 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.274.480 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.274.490 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.274.502 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.274.516 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.274.518 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.274.527 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.274.541 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.274.569 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.274.581 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.274.592 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.274.604 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.274.620 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.274.636 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.274.669 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.274.723 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.274.743 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GridSampler2D] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.274.808 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.274.834 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.274.847 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GridSampler3D] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.274.919 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.274.951 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.274.946 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.274.944 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsV2] register OP_IMPL : []
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.274.966 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.274.957 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandle] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.274.980 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.275.012 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.275.047 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftmaxCrossEntropyWithLogits] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.275.063 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandleV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.275.088 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.275.148 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.275.172 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.275.176 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.275.197 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.275.272 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.275.278 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PasteSubImg] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.275.304 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.275.323 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.275.354 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.275.367 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.275.380 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.275.380 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.275.377 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.275.405 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.275.407 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BlendFaceBgPartOne] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.275.423 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.275.458 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.275.470 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.275.483 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.275.479 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.275.498 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.275.517 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.275.519 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.275.525 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.275.539 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.275.550 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.275.560 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.275.585 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.275.621 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.275.626 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.275.688 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.275.684 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.275.724 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.275.735 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.275.793 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.275.838 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.275.859 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.275.875 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.275.893 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyAdadeltaD] register OP_IMPL : []
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.275.907 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.275.922 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.275.922 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyAdagradD] register OP_IMPL : []
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.275.933 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.275.946 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyAdagradV2D] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.275.945 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.275.968 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.275.968 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyAdaMaxD] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.275.993 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyAdamD] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.276.015 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.276.012 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.276.036 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.276.037 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNN, funcPointer:0xfffee3af0e08, registered count:7
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.276.054 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.276.059 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyAddSignD] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.276.081 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyCenteredRMSPropD] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.276.103 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyFtrlD] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.276.125 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyFtrlV2D] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.276.152 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyGradientDescent] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.276.193 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyKerasMomentumD] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.276.182 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TabulateFusionGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.276.213 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyMomentumD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.276.219 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.276.236 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyPowerSignD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.276.244 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNNV2, funcPointer:0xfffee3af9298, registered count:7
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:42.276.213 [trs_cb_event.c:119][ascend][curpid:618650,618828][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =320; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:42.276.252 [trs_cb_event.c:119][ascend][curpid:618650,618829][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =321; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:42.276.255 [trs_sqcq.c:1491][ascend][curpid:618650,618828][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:42.276.279 [trs_sqcq.c:1491][ascend][curpid:618650,618829][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.276.260 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyProximalAdagradD] register OP_IMPL : []
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:42.276.289 [npu_driver.cc:3833] 618828 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=320, drvRetCode=16.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:42.276.293 [npu_driver.cc:3833] 618829 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=321, drvRetCode=16.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.276.296 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyProximalGradientDescent] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.276.296 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[YUV4442YUV422] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.276.303 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:42.276.311 [api_impl.cc:5058] 618828 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:42.276.315 [api_impl.cc:5058] 618829 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.276.320 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyRMSPropD] register OP_IMPL : []
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.276.338 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.276.345 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyAdagradDAD] register OP_IMPL : []
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.276.345 [callback.cpp:132]618828 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.276.355 [callback.cpp:132]618829 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.276.352 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.276.358 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.276.378 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.276.371 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.276.371 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.276.413 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.276.425 [npu_driver.cc:3828] 618828 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=320.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.276.425 [npu_driver.cc:3828] 618829 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=321.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.276.434 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.276.447 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.276.461 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.276.452 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.276.461 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.276.464 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.276.472 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.276.486 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.276.487 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.276.512 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.276.510 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.276.524 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.276.538 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.276.550 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.276.555 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FusedMulApplyMomentum] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.276.582 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FusedMulApplyKerasMomentum] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.276.604 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.276.655 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.276.679 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.276.721 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GridSampler2D] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.276.778 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GeluGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.276.771 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.276.821 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GridSampler3D] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.276.863 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.276.873 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GeluGradV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.276.889 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.276.895 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.276.911 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.276.921 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.276.934 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandle] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.276.954 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.276.958 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.276.997 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.277.040 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandleV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.277.057 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IsNegInf] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.277.111 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.277.143 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.277.158 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IsPosInf] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.277.216 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.277.238 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.277.249 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PasteSubImg] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.277.260 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.277.265 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.277.272 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.277.301 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.277.314 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.277.333 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.277.334 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.277.350 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.277.365 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.277.370 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.277.376 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.277.398 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.277.411 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.277.423 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.277.435 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.277.434 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.277.463 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.277.475 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.277.476 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.277.486 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.277.484 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.277.501 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.277.537 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.277.585 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.277.596 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.277.644 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.277.697 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.277.743 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.277.766 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicAtomicAddrClean] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.277.803 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.277.809 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.277.841 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.277.853 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.277.848 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReluV2] register OP_IMPL : []
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.277.868 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.277.872 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.277.902 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.277.903 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.277.947 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.277.986 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.278.013 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.278.055 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.278.106 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.278.115 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TabulateFusionGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.278.154 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Cummax] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.278.179 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.278.211 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.278.222 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.278.220 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[YUV4442YUV422] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.278.254 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.278.267 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.278.286 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.278.280 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.278.322 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.278.306 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.278.315 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.278.356 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.278.354 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.278.368 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.278.381 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.278.380 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.278.393 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.278.384 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.278.406 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.278.423 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.278.423 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.278.429 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.278.435 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.278.448 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.278.459 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is valid.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.278.452 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceMeanD] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.278.471 [plugin_manager.cc:218]618646 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.278.489 [plugin_manager.cc:422]618646 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.278.497 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.278.501 [plugin_manager.cc:155]618646 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.278.529 [plugin_manager.cc:158]618646 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.278.541 [plugin_manager.cc:426]618646 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.278.560 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.278.570 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.278.582 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.278.599 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Col2ImV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.278.665 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.278.680 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.278.690 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.278.697 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.278.722 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.278.789 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.278.828 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.278.851 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.278.883 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.278.874 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MedianDim] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.278.896 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.278.892 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.278.911 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.278.923 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.278.944 [plugin_manager.cc:439]618646 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspo
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.278.960 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.279.000 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.279.028 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.279.072 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.279.100 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.279.133 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.279.133 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.279.160 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.279.178 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.279.212 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.279.228 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.279.241 [plugin_manager.cc:996]618646 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.279.268 [plugin_manager.cc:1011]618646 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.279.265 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.279.286 [plugin_manager.cc:1015]618646 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.279.289 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.279.334 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2d] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.279.374 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.279.390 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.279.394 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.279.406 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.279.419 [opp_so_manager.cc:45]618646 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.279.424 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.279.436 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.279.477 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.279.504 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.279.542 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.279.624 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.279.633 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.279.639 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.279.657 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicAtomicAddrClean] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.279.730 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.279.738 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.279.764 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.279.802 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.279.845 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.279.876 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.279.921 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.279.948 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaskedSelect] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.279.958 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeTutelCombineGates] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.279.980 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.280.028 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.280.048 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.280.075 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.280.087 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.280.146 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.280.170 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeTutelCombineX] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.280.191 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.280.208 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.280.299 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.280.316 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.280.321 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeTutelDispatch] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.280.343 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceMeanD] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.280.401 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.280.423 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.280.452 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.280.513 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.280.553 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.280.579 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.280.617 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.280.686 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScore] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.280.716 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.280.809 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.280.821 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.280.838 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.280.924 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.280.946 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.280.970 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.281.035 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.281.050 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.281.134 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RNNTLoss] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.281.161 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.281.239 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MultinomialWithReplacement] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.281.264 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.281.353 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.281.376 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.281.378 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.281.477 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StatelessBernoulli] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.281.480 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.281.484 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Rfft1D] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.281.579 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.281.584 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.281.649 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.281.672 [op_impl_registry_holder_manager.cc:208]618646 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.281.682 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.281.711 [op_impl_registry_holder_manager.cc:216]618646 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.281.749 [op_impl_registry_holder_manager.cc:208]618646 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.281.780 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.281.769 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.281.797 [op_impl_registry_holder_manager.cc:208]618646 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.281.817 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.281.845 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GemmaRmsNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.281.878 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UniqueConsecutive] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.281.888 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.281.965 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.281.981 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UniqueWithCountsAndSorting] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.282.002 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.282.079 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[WarpAffine] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.282.088 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.282.180 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Histogram] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.282.277 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LinearIndex] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.282.284 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.282.335 [op_impl_space_registry.cc:273]618646 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so] success!
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.282.384 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.282.441 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.282.457 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.282.469 [opp_so_manager.cc:45]618646 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.282.470 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[LinearIndexV2] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.282.499 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Unique] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.282.601 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UniqueWithCounts] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.282.670 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScatterAddWithSorted] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.282.671 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DepthToSpace] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.282.706 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Dot] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.282.715 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.282.739 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SpaceToDepth] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.282.810 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.282.835 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[Sinkhorn] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.282.864 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.282.915 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.282.953 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.282.983 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.283.017 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.283.043 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.283.070 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.283.094 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.283.091 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.283.146 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardReduce] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.283.207 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.283.244 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStatsWithCounts] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.283.303 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.283.314 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.283.348 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.283.373 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.283.408 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.283.421 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.283.433 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.283.455 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.283.477 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.283.499 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.283.520 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StackGroupPoints] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.283.520 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.283.530 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.283.544 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.283.642 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.283.644 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.283.668 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.283.677 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.283.691 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.283.762 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.283.789 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.283.789 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.283.791 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.283.895 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.283.899 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.283.919 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.283.954 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.283.982 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.283.994 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.284.032 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.284.056 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.284.096 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.284.116 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.284.172 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.284.211 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.284.239 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.284.247 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.284.266 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.284.275 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.284.285 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.284.299 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.284.363 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.284.399 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.284.449 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.284.469 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.284.495 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.284.524 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.284.535 [op_impl_registry_holder_manager.cc:208]618646 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.284.572 [op_impl_registry_holder_manager.cc:216]618646 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.284.588 [op_impl_registry_holder_manager.cc:208]618646 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.284.575 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DepthToSpace] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.284.594 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.284.624 [op_impl_registry_holder_manager.cc:208]618646 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.284.619 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.284.646 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SpaceToDepth] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.284.655 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.284.694 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.284.743 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.284.753 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.284.772 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.284.798 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.284.883 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.284.897 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.284.921 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.284.954 [op_impl_space_registry.cc:80]618646 MergeFunctions:op type DecoderKvCache infer_shape func has been registered
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.284.954 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.284.973 [op_impl_space_registry.cc:83]618646 MergeFunctions:op type DecoderKvCache infer_datatype func has been registered
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.284.977 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.284.992 [op_impl_space_registry.cc:80]618646 MergeFunctions:op type PromptKvCache infer_shape func has been registered
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.284.992 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.284.996 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.285.005 [op_impl_space_registry.cc:83]618646 MergeFunctions:op type PromptKvCache infer_datatype func has been registered
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.285.018 [op_impl_space_registry.cc:273]618646 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so] success!
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.285.027 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.285.057 [opp_so_manager.cc:97]618646 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.285.090 [opp_so_manager.cc:97]618646 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.285.082 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.285.100 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.285.108 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.285.132 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.285.166 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.285.175 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.285.192 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.285.195 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.285.202 [opp_so_manager.cc:45]618646 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.285.219 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.285.214 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.285.242 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.285.236 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.285.261 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.285.279 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.285.284 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.285.316 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.285.378 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.285.392 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.285.403 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.285.421 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.285.424 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.285.440 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.285.448 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.285.468 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.285.501 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.285.522 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.285.544 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.285.634 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.285.650 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.285.662 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.285.753 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.285.769 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.285.777 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.285.794 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.285.800 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.285.899 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.285.912 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.285.923 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.285.933 [op_impl_space_registry.cc:240]618646 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.285.939 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.285.956 [opp_so_manager.cc:48]618646 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.286.027 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.286.042 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.286.040 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.286.060 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.286.071 [opp_so_manager.cc:45]618646 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.286.125 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.286.144 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.286.150 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNormGradV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.286.227 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.286.245 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.286.255 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.286.278 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.286.350 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.286.374 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.286.410 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.286.434 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.286.532 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.286.559 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.286.632 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.286.680 [op_impl_space_registry.cc:240]618646 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.286.703 [opp_so_manager.cc:48]618646 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.286.738 [opp_so_manager.cc:97]618646 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.286.735 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.286.772 [opp_so_manager.cc:97]618646 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.286.828 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.286.835 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.286.849 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.286.865 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.286.876 [opp_so_manager.cc:45]618646 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.286.936 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.286.946 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.286.973 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.287.046 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.287.095 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.287.147 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.287.206 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.287.251 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.287.255 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.287.318 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.287.356 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2dAssistMatrix] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.287.445 [op_impl_space_registry.cc:240]618646 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.287.456 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : []
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.287.466 [opp_so_manager.cc:48]618646 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.287.550 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.287.559 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.287.564 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.287.587 [opp_so_manager.cc:45]618646 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.287.661 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.287.696 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.287.764 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.287.870 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Cdist] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.287.952 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNormGradV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.287.967 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CdistGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.288.073 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.288.100 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.288.124 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.288.173 [op_impl_space_registry.cc:240]618646 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.288.197 [opp_so_manager.cc:48]618646 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.288.232 [opp_so_manager.cc:97]618646 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.288.233 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : []
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.288.263 [opp_so_manager.cc:97]618646 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.288.261 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.288.288 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.288.297 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.288.344 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.288.358 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.288.368 [opp_so_manager.cc:45]618646 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.288.383 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.288.420 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.288.491 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.288.533 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.288.591 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.288.627 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: Conv2DBackpropFilter, registered count: 15
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.288.672 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.288.702 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GlobalLpPool] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.288.715 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: Conv2DBackpropInput, registered count: 15
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.288.738 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: Conv2DTranspose, registered count: 15
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.288.751 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.288.781 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.288.799 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GLU] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.288.809 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: Conv2D, registered count: 15
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.288.895 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: Conv3DBackpropInput, registered count: 15
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.288.899 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GLUGrad] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.288.916 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: Conv3DTranspose, registered count: 15
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.288.988 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: Conv3D, registered count: 15
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.288.999 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.289.019 [op_impl_space_registry.cc:240]618646 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.289.040 [opp_so_manager.cc:48]618646 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.289.044 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.289.054 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPool3DWithArgmaxV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.289.102 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.289.122 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.289.138 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.289.149 [opp_so_manager.cc:45]618646 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.289.167 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: FFN, registered count: 15
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.289.194 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: MatmulTunnerTiling, registered count: 15
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.289.208 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LpLoss] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.289.307 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LpNorm] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.289.318 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: MatMulV2, registered count: 15
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.289.332 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.289.339 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: BatchMatmulFixpipe, registered count: 15
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.289.360 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: MatMulV3, registered count: 15
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.289.361 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.289.376 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: QuantBatchMatmulV3, registered count: 15
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.289.388 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.289.478 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.289.485 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MinAreaPolygons] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.289.541 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: DynamicRNN, registered count: 15
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.289.558 [tuning_tiling_registry.cc:30]618666 RegisterTilingData:optype: MatMulTunnerTiling, registered count: 15
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.289.587 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.289.693 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.289.717 [op_impl_space_registry.cc:240]618646 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.289.737 [opp_so_manager.cc:48]618646 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.289.773 [opp_so_manager.cc:97]618646 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.289.789 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.289.813 [opp_so_manager.cc:97]618646 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.289.889 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.289.902 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.289.893 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.289.914 [opp_so_manager.cc:45]618646 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.290.000 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.290.099 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.290.198 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.290.276 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.290.310 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.290.394 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.290.408 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.290.483 [op_impl_space_registry.cc:240]618646 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.290.503 [opp_so_manager.cc:48]618646 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.290.503 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.290.507 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.290.583 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.290.597 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.290.606 [opp_so_manager.cc:45]618646 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.290.607 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.290.638 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.290.710 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.290.748 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.290.796 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:MatMulV2, funcPointer:0xfffee72dc0b0, registered count:7
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.290.814 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [][][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.290.826 [op_check.cc:24]618666 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:MatMulV2, funcPointer:0xfffee72dc310, registered count:5
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.290.913 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.291.005 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPool3DWithArgmaxV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.291.029 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.291.125 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.291.171 [op_impl_space_registry.cc:240]618646 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.291.192 [opp_so_manager.cc:48]618646 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/aarch64//libcust_opsproto_rt2.0.so
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.291.204 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPool3DGradWithArgmax] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.291.226 [opp_so_manager.cc:97]618646 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.291.227 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.291.247 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [][][][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.291.259 [opp_so_manager.cc:97]618646 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.291.290 [opp_so_manager.cc:97]618646 LoadOpsProtoSo:[FindSo][Check] Get path with os&cpu type [/usr/local/Ascend/ascend-toolkit/latest/opp/op_proto/custom/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.291.329 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.291.357 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 0 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.291.398 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.291.410 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.291.429 [opp_so_manager.cc:45]618646 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.291.436 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.291.538 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.291.635 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.291.732 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.291.733 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.291.838 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.291.941 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.292.013 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.292.043 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.292.069 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.292.181 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.292.184 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotatedNMS] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.292.289 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.292.333 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CTCLossV3Grad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.292.396 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.292.497 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SilentCheck] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.292.607 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.292.710 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.292.809 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3d] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.292.911 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.293.010 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.293.117 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ActiveRotatedFilter] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.293.127 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPool3DGradWithArgmax] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.293.216 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ActiveRotatedFilterGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.293.297 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CTCLossV3] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.293.315 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.293.414 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.293.444 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.293.484 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.293.526 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.293.590 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3DGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.293.630 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.293.664 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.293.743 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.293.736 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.293.836 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.293.920 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.293.937 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.294.039 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PSAMask] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.294.041 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.294.075 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.294.143 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.294.142 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PSAMaskGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.294.149 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.294.218 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CTCLossV3Grad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.294.242 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.294.281 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.294.345 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.294.399 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.294.444 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.294.502 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.294.542 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.294.605 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [][][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.294.616 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.294.641 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.294.719 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.294.747 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ThreeNN] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.294.826 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.294.851 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Voxelization] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.294.939 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.294.969 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.295.000 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.295.029 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.295.056 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.295.058 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.295.086 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.295.112 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.295.137 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.295.161 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [][][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.295.164 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.295.168 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CTCLossV3] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.295.191 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.295.215 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.295.239 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.295.262 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.295.296 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.295.316 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.295.318 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PadV3GradReplication] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.295.322 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CompressFcOp] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.295.346 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.295.429 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.295.449 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.295.461 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3DGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.295.540 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.295.553 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.295.493 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DefaultImpl] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.295.659 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.295.724 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.295.761 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.295.831 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.295.870 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.295.895 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.295.936 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.295.971 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMatMulV4] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.296.002 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.296.040 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.296.058 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.296.073 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.296.107 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.296.124 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.296.172 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.296.202 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.296.228 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.296.227 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.296.246 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.296.307 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.296.321 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AscendAntiQuantV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.296.330 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.296.391 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.296.400 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.296.415 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.296.464 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.296.468 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.296.491 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.296.507 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.296.516 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.296.572 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Concat] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.296.572 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.296.596 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ConcatV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.296.613 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.296.616 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ResizeTrilinear] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.296.619 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.296.641 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.296.642 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.296.675 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.296.716 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.296.755 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.296.782 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.296.816 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.296.826 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.296.828 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.296.845 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.296.870 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.296.888 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.296.896 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.296.897 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.296.917 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.296.937 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.296.967 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.296.998 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.297.043 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.297.044 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.297.050 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.297.082 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.297.118 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.297.121 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.297.142 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.297.141 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PadV3GradReplication] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.297.149 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.297.176 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.297.203 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [][][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.297.210 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.297.211 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.297.230 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.297.237 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.297.246 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.297.258 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.297.257 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.297.286 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.297.311 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.297.333 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.297.337 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [][][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.297.328 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.297.355 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.297.363 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.297.394 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.297.421 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.297.410 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.297.451 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.297.483 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.297.500 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.297.502 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.297.509 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.297.533 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.297.534 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.297.572 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.297.610 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.297.609 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.297.641 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.297.649 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.297.712 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ActULQClampMaxGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.297.717 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.297.726 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.297.737 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ActULQClampMinGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.297.742 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.297.795 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.297.824 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.297.835 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ActsULQ] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.297.849 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.297.848 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.297.867 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.297.934 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ActsULQInputGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.297.936 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.297.963 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.297.988 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.297.985 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.298.006 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.298.040 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.298.082 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.298.088 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.298.144 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.298.165 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.298.164 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.298.193 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.298.221 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.298.236 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.298.248 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdaptiveAvgPoolAssistMatrix] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.298.273 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.298.305 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.298.330 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.298.348 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.298.376 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.298.378 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.298.386 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.298.401 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.298.437 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.298.446 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.298.487 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.298.514 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.298.552 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.298.569 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.298.592 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.298.675 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.298.698 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.298.723 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.298.783 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.298.802 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.298.828 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.298.832 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.298.924 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.298.950 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.299.009 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GridSampler2DGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.299.024 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.299.057 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.299.123 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.299.163 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GridSampler3DGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.299.200 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.299.234 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.299.307 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.299.307 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.299.327 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.299.386 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.299.417 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.299.489 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.299.492 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AvgPoolUpdate] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.299.531 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.299.561 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.299.591 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.299.670 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PadV4Grad] register OP_IMPL : [][][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.299.670 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.299.696 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.299.700 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.299.796 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.299.803 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Bitcast] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.299.849 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PadV3GradReplicate] register OP_IMPL : [][][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.299.904 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.299.902 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.299.927 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.299.960 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.299.979 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.300.030 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.300.062 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.300.067 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.300.135 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.300.149 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.300.190 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.300.257 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.300.269 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CTCLoss] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.300.306 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.300.343 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.300.370 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.300.434 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.300.471 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.300.525 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.300.550 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.300.552 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.300.632 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.300.657 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DropOutGenMask] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.300.684 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StatelessDropOutGenMask] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.300.727 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GridSampler2DGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.300.738 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.300.795 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.300.843 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.300.866 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GridSampler3DGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.300.893 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.300.951 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.301.001 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.301.030 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.301.059 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.301.099 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.301.166 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.301.192 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.301.195 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.301.200 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ExpandDims] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.301.298 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.301.310 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.301.364 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PadV4Grad] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.301.408 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FillWindowCache] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.301.508 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.301.509 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.301.536 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PadV3GradReplicate] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.301.606 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FlattenV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.301.648 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.301.710 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GatherShapes] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.301.753 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.301.816 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GaussianBlur] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.301.861 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.301.927 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FileConstant] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.301.954 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StatelessIf] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.301.963 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.301.979 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[If] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.301.987 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.302.002 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[_If] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.302.026 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Case] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.302.072 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ConstPlaceHolder] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.302.157 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.302.171 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.302.262 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.302.275 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.302.349 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Identity] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.302.376 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MemcpyAsync] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.302.368 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.302.399 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IdentityN] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.302.485 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.302.496 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.302.512 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.302.597 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.302.605 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.302.705 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.302.703 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.302.805 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.302.815 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.302.831 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.302.916 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.302.940 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.303.016 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.303.041 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.303.064 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.303.142 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.303.208 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.303.235 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.303.319 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.303.420 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.303.518 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.303.623 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.303.722 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.303.799 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.303.827 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.303.933 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.303.946 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.304.047 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.304.049 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RandomChoiceWithMask] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.304.130 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.304.173 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RandomUniform] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.304.255 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Rank] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.304.283 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Size] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.304.372 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.304.387 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.304.499 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.304.501 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Reshape] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.304.617 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RgbToGrayscale] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.304.620 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DeformableOffsetsGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.304.722 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.304.735 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.304.823 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.304.898 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.304.926 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.305.007 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.305.032 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Rotate] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.305.116 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Shape] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.305.154 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ShapeN] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.305.150 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.305.167 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.305.267 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SilentCheckV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.305.343 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.305.355 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.305.372 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SilentCheckV3] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.305.453 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.305.476 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.305.547 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.305.564 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.305.584 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.305.690 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachNonFiniteCheckAndUnscale] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.305.692 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyAdadelta] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.305.722 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyAdadeltaD] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.305.745 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyAdagradD] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.305.767 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyAdagrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.305.790 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.305.812 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagradD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.305.812 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.305.836 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.305.860 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2D] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.305.860 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.305.882 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.305.904 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.305.925 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.305.929 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.305.946 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2D] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.305.955 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.305.968 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyRMSProp] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.305.990 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyRMSPropD] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.306.018 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.306.100 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseFillEmptyRows] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.306.131 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GatherV3] register OP_IMPL : [][][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.306.162 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.306.202 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.306.242 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.306.308 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Squeeze] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.306.334 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SqueezeV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.306.358 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SqueezeV3] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.306.391 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.306.471 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.306.516 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.306.530 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.306.584 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StatelessRandomNormalV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.306.626 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.306.652 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.306.689 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.306.731 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.306.760 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.306.803 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.306.866 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.306.909 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TopK] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.306.915 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.306.936 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.306.960 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.306.954 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.306.982 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.307.007 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.307.032 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LinSpace] register OP_IMPL : [][][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.307.109 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.307.111 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TopKPQDistanceV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.307.152 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MemSet] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.307.214 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.307.225 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.307.237 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.307.262 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.307.321 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TransArgb] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.307.377 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.307.381 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyAdamWV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.307.387 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.307.435 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Unsqueeze] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.307.460 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UnsqueezeV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.307.485 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UnsqueezeV3] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.307.513 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.307.521 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.307.525 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.307.586 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.307.611 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.307.629 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.307.646 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.307.723 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Where] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.307.752 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.307.791 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.307.825 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[WtsARQ] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.307.863 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NPUClearFloatStatus] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.307.933 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.307.938 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.307.981 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NPUGetFloatStatus] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.308.042 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.308.093 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.308.098 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.308.136 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.308.154 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.308.202 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.308.224 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.308.306 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.308.306 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.308.331 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.308.333 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.308.404 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.308.431 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.308.438 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdjustContrast] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.308.462 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.308.462 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdjustHue] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.308.497 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdjustSaturation] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.308.522 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CropAndResize] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.308.522 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.308.544 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CropAndResizeV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.308.565 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DecodeAndCropJpeg] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.308.581 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.308.587 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DecodeJpeg] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.308.609 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NormalizeV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.308.631 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdjustContrastWithMean] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.308.658 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdjustBrightness] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.308.676 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.308.680 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdjustBrightnessV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.308.703 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdjustSaturationV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.308.728 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[WarpAffineV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.308.724 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyAdamWV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.308.737 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.308.749 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ImgCrop] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.308.763 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.308.772 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[WarpPerspective] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.308.787 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.308.814 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.308.839 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.308.863 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.308.871 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.308.872 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.308.886 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.308.895 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.308.908 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.308.918 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.308.930 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.308.950 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.308.972 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.308.983 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:ReverseSequence, funcPointer:0xffff03a66360, registered count:5
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.308.994 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.308.993 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.309.014 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:ReverseSequence, funcPointer:(nil), registered count:7
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.016 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.309.024 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HcomAllReduce] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.309.037 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:ReverseSequence, funcPointer:(nil), registered count:4
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.042 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.309.049 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HcomAllGather] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.309.060 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:ReverseSequence, funcPointer:(nil), registered count:4
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.064 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.309.072 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HcomBroadcast] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.309.086 [op_check.cc:71]618670 RegisterParamGeneralize:RegisterParamGeneralize: op_type:ReverseSequence, funcPointer:(nil), registered count:4
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.087 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.309.094 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HcomReduceScatter] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.110 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.309.108 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.309.117 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HcomSend] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.309.125 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.131 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.309.139 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HcomReduce] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.152 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.309.168 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HcomReceive] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.171 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.309.190 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HcomAllToAllV] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.192 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.309.211 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HcomAllToAllVC] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.225 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.309.241 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.247 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.309.233 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HcomGatherAllToAllV] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.269 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.309.271 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.298 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.320 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.343 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.309.362 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.366 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.309.378 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.389 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.309.403 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.411 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.435 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.456 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.309.455 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.477 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.500 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.309.518 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.524 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.546 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.567 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.309.572 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.309.580 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.591 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.612 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.634 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.309.626 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.655 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.309.658 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.676 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.697 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.719 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.309.725 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.309.726 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.740 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.309.738 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.760 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.789 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.811 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.309.815 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.832 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.309.839 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.855 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.309.866 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.877 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.900 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.923 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.944 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.965 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.309.988 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.309.990 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.310.017 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.025 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.054 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.079 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.102 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.125 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.310.138 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachACosInplace] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.310.140 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.310.147 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.151 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.174 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.196 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.218 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.310.227 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.240 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.310.250 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.261 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.310.276 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.285 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.310.282 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachAddListInplace] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.306 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.310.305 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.327 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.350 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.371 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.310.383 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.310.389 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.393 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.414 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.439 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.310.446 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMulScalarInplace] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.461 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.310.468 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.310.472 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachLogInplace] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.485 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.310.495 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSubListInplace] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.310.501 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.508 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.310.517 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachMulListInplace] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.530 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.310.542 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachDivListInplace] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.310.544 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.551 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.584 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.606 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.310.619 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.633 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.310.618 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.656 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.681 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.310.684 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachSubScalarInplace] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.704 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.726 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.310.741 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.310.746 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.749 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.772 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.310.789 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.795 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.819 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.840 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.310.852 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.862 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.884 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.310.898 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.905 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.923 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.310.941 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.945 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.310.957 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.967 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.310.966 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.310.990 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.310.999 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.311.012 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.311.033 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.311.039 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.311.054 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.311.079 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.311.088 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.311.102 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.311.105 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.311.113 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.311.124 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.311.146 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.311.173 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.311.186 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.311.195 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.311.206 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.311.207 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.311.209 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.311.217 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.311.238 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.311.257 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.311.281 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.311.360 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3dGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.311.414 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.311.427 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachACosInplace] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.311.486 [op_impl_registry_holder_manager.cc:208]618654 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 894
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.311.477 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.311.525 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.311.572 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachAddListInplace] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.311.640 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.311.640 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.311.737 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMulScalarInplace] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.311.753 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.311.763 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachLogInplace] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.311.762 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.311.786 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSubListInplace] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.311.809 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachMulListInplace] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.311.832 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachDivListInplace] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.311.863 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.311.882 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.311.889 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.311.916 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.311.968 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachSubScalarInplace] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.312.017 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.312.043 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.312.068 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.312.077 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.312.099 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.312.192 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.312.198 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.312.300 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.312.295 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.312.354 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.312.411 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.312.457 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.312.505 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.312.515 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.312.620 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.312.644 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.312.661 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3dGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.312.747 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.312.754 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.312.770 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.312.867 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.312.915 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.312.945 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IndexPutWithSort] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.312.983 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BlendFaceBgPartOne] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.313.026 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.313.052 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.313.102 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.313.138 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.313.164 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.313.200 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.313.221 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.313.234 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InplaceIndexAddWithSorted] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.313.308 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.313.332 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.313.343 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.313.356 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.313.455 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.313.460 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.313.480 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.313.494 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.313.503 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.313.604 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.313.650 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.313.660 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.313.685 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNN, funcPointer:0xffff03af0e08, registered count:7
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.313.750 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.313.801 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.313.870 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.313.893 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNNV2, funcPointer:0xffff03af9298, registered count:7
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.313.900 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.313.951 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.314.010 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.314.021 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.314.101 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.314.152 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.314.184 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IndexPutWithSort] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.314.271 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.314.290 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.314.300 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.314.414 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GridSampler2D] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.314.409 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.314.470 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InplaceIndexAddWithSorted] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.314.524 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GridSampler3D] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.314.541 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.314.577 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.314.655 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandle] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.314.681 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.314.692 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.314.707 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.314.731 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.314.777 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandleV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.314.839 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.314.869 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.314.889 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.315.006 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PasteSubImg] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.315.013 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.315.030 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.315.114 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.315.136 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.315.140 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.315.178 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.315.242 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.315.261 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.315.319 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.315.352 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.315.385 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.315.464 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.315.489 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.315.498 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.315.575 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.315.615 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.315.632 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.315.726 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.315.726 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.315.748 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.315.849 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.315.869 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.315.898 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.315.959 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TabulateFusionGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.315.980 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Resize] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.316.042 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.316.083 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[YUV4442YUV422] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.316.096 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.316.218 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.316.247 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.316.272 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.316.303 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.316.328 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.316.336 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.316.351 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.316.371 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.316.443 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.316.479 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.316.510 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.316.585 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.316.632 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.316.697 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.316.754 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.316.809 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.316.871 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.316.867 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.316.958 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.316.993 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.317.099 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.317.101 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.317.125 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.317.156 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.317.203 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Resize] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.317.274 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.317.294 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.317.308 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.317.397 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.317.411 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.317.416 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.317.508 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.317.526 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.317.527 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.317.554 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.317.635 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.317.663 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.317.714 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicAtomicAddrClean] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.317.772 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.317.833 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.317.877 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.317.954 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.317.990 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.318.049 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.318.067 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.318.117 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.318.180 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.318.226 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.318.297 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.318.336 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.318.420 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.318.447 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceMeanD] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.318.446 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.318.455 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.318.570 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.318.581 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.318.610 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.318.679 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.318.687 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.318.705 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.318.713 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.318.717 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.318.825 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.318.833 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.318.934 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.319.004 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.319.007 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.319.043 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.319.117 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.319.120 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.319.150 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.319.230 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.319.233 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.319.256 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.319.341 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.319.352 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.319.365 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.319.464 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.319.473 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.319.523 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.319.590 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.319.595 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.319.698 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.319.701 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.319.744 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.319.812 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RoiPoolingGradWithArgMax] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.319.818 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.319.854 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.319.925 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.319.959 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.320.034 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.320.035 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.320.132 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.320.141 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.320.152 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.320.258 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.320.265 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.320.322 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.320.375 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.320.380 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.320.484 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.320.484 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.320.489 [op_impl_registry_holder_manager.cc:208]618654 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 894
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.320.645 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StackBallQuery] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.320.662 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.320.752 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.320.827 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.320.903 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.320.935 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RoiPoolingGradWithArgMax] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.321.041 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.321.146 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.321.158 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScoreGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.321.252 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.321.337 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.321.359 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.321.461 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.321.515 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.321.565 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.321.685 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.321.707 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StackBallQuery] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.321.813 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.321.893 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.321.967 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.322.086 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.322.190 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScoreGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.322.295 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.322.321 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.322.343 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.322.364 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.322.390 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.322.413 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.322.436 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.322.457 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.322.578 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.322.741 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.322.844 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DepthToSpace] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.322.885 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.322.908 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SpaceToDepth] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.322.910 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.322.977 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.026 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[EluGradV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.043 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.323.039 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.063 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.080 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SyncBNTrainingUpdate] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.095 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Abs] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.111 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Real] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.126 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Acos] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.323.113 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.143 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Acosh] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.159 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddMatMatElements] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.323.154 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.175 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Adds] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.190 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Asin] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.323.184 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.205 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Asinh] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.221 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AssignAdd] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.235 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AssignSub] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.250 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Atan] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.265 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Atanh] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.323.268 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.280 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.296 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BesselI0e] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.311 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BesselI1e] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.326 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.323.316 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.342 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.357 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.372 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.387 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Bucketize] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.323.390 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.402 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Cast] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.428 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Ceil] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.443 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CeluV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.458 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ComplexAbs] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.473 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Cos] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.487 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Cosh] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.501 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.516 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DataFormatDimMap] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.323.510 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.323.518 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.533 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Dequantize] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.549 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Elu] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.323.543 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.567 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Erf] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.323.566 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.582 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Erfc] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.323.574 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.323.587 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.599 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Exp] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.616 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Expm1] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.323.612 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.323.621 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.634 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FakeQuantWithMinMaxVars] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.323.635 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.650 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FastGelu] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.665 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FastGeluV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.323.658 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.682 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Floor] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.323.683 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.697 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FusedMulAddN] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.713 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HardSigmoid] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.727 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HardShrink] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.742 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HardShrinkGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.323.740 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.757 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HardSwish] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.772 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HardSwishGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.787 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HardtanhGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.801 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IndexFillD] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.816 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.830 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.847 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Inv] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.323.852 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.862 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Invert] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.879 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Log] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.894 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Log1p] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.908 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LogicalNot] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.923 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LogAddExp] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.938 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LpNormUpdate] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.953 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LpNormUpdateV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.968 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Dawsn] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.323.982 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Expint] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.323.979 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.323.976 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.001 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Erfinv] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.017 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FresnelCos] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.324.009 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.034 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FresnelSin] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.048 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Ndtri] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.063 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Spence] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.078 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Fills] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.093 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LeakyRelu] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.108 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[OnesLike] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.122 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Reciprocal] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.324.123 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.137 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Sign] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.152 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Sqrt] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.182 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Tanh] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.324.176 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.201 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ZerosLike] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.324.148 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.217 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Gelu] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.232 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GeluV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.247 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Relu] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.268 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Neg] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.282 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LogSoftmaxV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.297 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.312 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.327 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.324.328 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.342 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftplusV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.358 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Muls] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.324.355 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.376 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Power] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.390 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Relu6] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.324.379 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.407 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Relu6D] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.324.391 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.423 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Relu6Grad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.438 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReluGradV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.452 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Rint] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.467 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Round] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.324.467 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.481 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Rsqrt] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.497 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RsqrtGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.511 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Selu] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.526 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Shrink] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.540 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Sigmoid] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.555 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.570 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SigmoidGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.585 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Sin] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.324.583 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.600 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Sinh] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.616 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SmoothL1Loss] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.631 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SmoothL1LossGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.647 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LogSigmoid] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.661 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LogSigmoidGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.680 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LogSpaceD] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.696 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Softplus] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.324.696 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.710 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Softsign] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.726 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SqrtGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.738 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Square] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.753 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Swish] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.768 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwishGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.787 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SiluGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.324.777 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.324.776 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.806 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardElemt] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.324.806 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.822 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Tan] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.840 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftShrink] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.856 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftShrinkGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.872 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Threshold] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.892 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ThresholdV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.908 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ThresholdV2D] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.324.899 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.927 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Trunc] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.943 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.959 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.975 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MishGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.324.991 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HardSigmoidGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.007 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.024 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.041 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.057 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.325.044 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.074 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FillDiagonal] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.325.062 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.092 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IndexPut] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.117 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReadVariableOp] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.137 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CastLike] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.154 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FusedBiasLeakyRelu] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.174 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StatelessBernoulliV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.325.145 [op_impl_registry_holder_manager.cc:208]618654 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.325.165 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.193 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.209 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InvertPermutation] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.226 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.243 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SearchSorted] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.259 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.275 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.297 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.314 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.331 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.325.348 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.325.357 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.433 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaskedScale] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.454 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AbsGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.472 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AccumulateNV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.490 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddN] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.507 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Eltwise] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.523 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.325.514 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.542 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AcosGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.325.534 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.562 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AcoshGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.579 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AsinGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.597 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AsinhGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.614 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Atan2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.631 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AtanGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.325.631 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.647 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Axpy] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.325.640 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.665 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BitwiseAnd] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.697 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BitwiseOr] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.714 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BitwiseXor] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.731 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Div] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.748 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DivNoNan] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.325.753 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.765 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[EluGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.325.757 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.783 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FastGeluGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.800 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FloorDiv] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.818 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FloorMod] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.837 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InvGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.858 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LeakyReluGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.875 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TanhGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.892 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Add] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.325.888 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.909 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Addcdiv] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.926 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Addcmul] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.325.916 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.947 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AxpyV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.325.948 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.964 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LogicalAnd] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.980 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LogicalOr] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.325.997 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Mul] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.014 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Pow] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.031 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RealDiv] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.326.029 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.326.034 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.048 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ClipByNormNoDivSum] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.066 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ClipByValue] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.084 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ClipByValueV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.101 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FusedMulAdd] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.118 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftmaxGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.135 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Sub] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.156 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Gcd] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.175 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LarsV2Update] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.326.179 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.191 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaskedFill] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.207 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReluGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.326.197 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.226 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Xlog1py] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.243 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApproximateEqual] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.259 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Equal] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.276 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NotEqual] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.293 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Greater] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.313 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GreaterEqual] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.326.323 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.330 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Less] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.346 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LessEqual] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.363 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Maximum] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.383 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Minimum] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.400 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Mod] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.417 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.434 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MulNoNan] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.450 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReciprocalGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.466 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SeluGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.483 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogits] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.500 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftplusGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.520 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftplusV2Grad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.536 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftsignGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.553 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SquaredDifference] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.570 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.587 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ThresholdGradV2D] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.326.579 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNormGradV3] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.606 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TruncateDiv] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.628 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TruncateMod] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.653 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Xdivy] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.669 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IsClose] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.686 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Xlogy] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.701 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.717 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SelectV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.734 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaskedSelectV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.751 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Lerp] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.769 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FusedBiasLeakyReluGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.882 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.326.982 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.327.004 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.327.084 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.327.086 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.327.181 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.327.287 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.327.310 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.327.333 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.327.352 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.327.365 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.327.422 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.327.455 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : []
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.327.461 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MlaAttentionScore] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.327.557 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.327.559 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.327.615 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.327.655 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.327.756 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.327.754 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.327.853 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.327.859 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.327.962 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.328.037 [op_impl_registry.cc:122]618666 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.328.069 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Quantize] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.328.092 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.328.111 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AscendDequant] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.328.136 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.328.241 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.328.283 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.328.347 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.328.368 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.328.387 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.328.404 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.328.421 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.328.439 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BasicLSTMInplaceFillWindowCache] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.328.455 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BasicGRUInplaceFillWindowCache] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.328.549 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.328.652 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.328.646 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.328.761 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.328.783 [op_impl_registry_holder_manager.cc:208]618666 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 599
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.328.865 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.328.887 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.328.982 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdaCast] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.329.081 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.329.104 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.329.123 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.329.140 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.329.125 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.329.240 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.329.253 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.329.333 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.329.376 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.329.447 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.329.528 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.329.546 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.329.568 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.329.629 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.329.654 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.329.663 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.329.756 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.329.767 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.329.790 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.329.869 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.329.887 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.329.949 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPool3DWithArgmaxV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.330.001 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.329.982 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.330.099 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.330.199 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.330.220 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.330.270 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CircularPad] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.330.309 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[L2Loss] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.330.409 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.330.413 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[CircularPadGrad] register OP_IMPL : [][][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.330.465 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.330.511 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.330.584 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.330.610 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.330.622 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.330.693 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.330.723 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.330.803 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.330.818 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.330.844 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceAny] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.330.861 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceAll] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.330.879 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceMax] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.330.897 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.330.916 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceMeanWithCast] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.330.933 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceMin] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.330.933 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.330.951 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceProd] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.330.969 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceSum] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.330.963 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.330.993 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[EuclideanNorm] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.330.992 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.331.010 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceLogSum] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.331.015 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.331.028 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceLogSumExp] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.331.038 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.331.070 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CircularPad] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.331.122 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceNansum] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.331.214 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleLinear1d] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.331.224 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.331.225 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[CircularPadGrad] register OP_IMPL : [][][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.331.241 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleBilinear2d] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.331.246 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.331.274 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.331.293 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.331.311 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.331.327 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.331.395 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleBicubic2d] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.331.399 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.331.430 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.331.529 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.331.557 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAA] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.331.625 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.331.647 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.331.721 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAAGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.331.746 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.331.740 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.331.770 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.331.801 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.331.826 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.331.847 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [][][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.331.849 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.331.869 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SplitD] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.331.888 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.331.880 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.331.986 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.332.016 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleLinear1d] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.332.044 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleBilinear2d] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.332.053 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.332.079 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3dGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.332.099 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.332.223 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.332.215 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleBicubic2d] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.332.240 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPool3DGradWithArgmax] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.332.252 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAA] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.332.324 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.332.378 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAA] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.332.428 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.332.420 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAABackward] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.332.528 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.332.540 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAAGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.332.582 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.332.632 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.332.690 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.332.730 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.332.749 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ResizeUpsampleTrilinear] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.332.834 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.332.871 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.332.899 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3dGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.332.935 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.332.945 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dBackward] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.333.044 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.333.051 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAA] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.333.066 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.333.086 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.333.094 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.333.103 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.333.121 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3d] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.333.192 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.333.205 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAABackward] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.333.276 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.333.267 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleNearest] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.333.299 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.333.321 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.333.372 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.333.414 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.333.434 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CTCLossV3Grad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.333.461 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleNearestExact2dGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.333.489 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[UpsampleNearest2dGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.333.512 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.333.539 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ResizeUpsampleTrilinear] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.333.595 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.333.612 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.333.696 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dBackward] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.333.713 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.333.711 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.333.739 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.333.818 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.333.840 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.333.845 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.333.868 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.333.874 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3d] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.333.894 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.333.942 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.334.001 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.334.020 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleNearest] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.334.043 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.334.113 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.334.140 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.334.192 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleNearestExact2dGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.334.219 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[UpsampleNearest2dGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.334.231 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.334.240 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.334.262 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.334.325 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.334.345 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.334.364 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.334.436 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.334.457 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.334.468 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.334.475 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.334.467 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CTCLossV3] register OP_IMPL : [][][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.334.558 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.334.569 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.334.555 [op_impl_registry_holder_manager.cc:208]618666 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 599
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.334.592 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.334.622 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.334.628 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.334.667 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.334.732 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.334.742 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.334.763 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.334.797 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3DGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.334.844 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.334.865 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.334.887 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.334.907 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.334.938 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.334.957 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.335.013 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.335.035 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.335.053 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.335.066 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.335.072 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.335.101 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.335.119 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.335.136 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.335.153 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.335.170 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.335.170 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.335.187 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.335.204 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.335.221 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.335.238 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.335.255 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.335.271 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.335.272 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.335.289 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.335.282 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.335.296 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.335.311 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.335.402 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.335.417 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SegmentSum] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.335.451 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.335.518 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.335.518 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.335.617 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.335.635 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.335.649 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.335.638 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.335.721 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.335.768 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.335.818 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.335.843 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.335.898 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.335.921 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.335.988 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.336.023 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UnsortedSegmentMax] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.336.029 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.336.048 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UnsortedSegmentMin] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.336.068 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UnsortedSegmentProd] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.336.087 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.336.145 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.336.192 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdamApplyOne] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.336.184 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.336.219 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdamApplyOneAssign] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.336.238 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecay] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.336.263 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdamApplyOneWithDecayAssign] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.336.308 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.336.357 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BN3DTrainingReduce] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.336.355 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.336.378 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.336.380 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.336.397 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.336.415 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.336.426 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.336.511 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNTrainingReduce] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.336.548 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.336.550 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.336.581 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ReflectionPad3dGrad] register OP_IMPL : [][][][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.336.599 [op_impl_registry_holder_manager.cc:208]618666 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.336.620 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.336.698 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.336.717 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.336.713 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PadV3GradReplication] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.336.812 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.336.809 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.336.828 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.336.879 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.336.912 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.336.954 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.336.959 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.336.987 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.337.011 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.337.023 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.337.052 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantConv2D] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.337.066 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.337.106 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.337.147 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.337.224 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.337.245 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ReflectionPad3dGrad] register OP_IMPL : [][][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.337.275 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.337.322 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.337.362 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.337.392 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.337.423 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.337.476 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.337.508 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.337.523 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.337.618 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[INTrainingReduceV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.337.622 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.337.650 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.337.662 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.337.676 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.337.703 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantConv2D] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.337.725 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.337.746 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[INTrainingUpdateGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.337.764 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[INTrainingUpdateGradGammaBeta] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.337.785 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[INTrainingUpdateV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.337.852 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.337.877 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.337.974 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.337.974 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.338.068 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.338.089 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.338.115 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.338.113 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3d] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.338.165 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.338.273 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.338.305 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.338.376 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.338.421 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.338.475 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.338.543 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.338.536 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.338.575 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPool] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.338.678 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPool3D] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.338.694 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.338.730 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.338.733 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3d] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.338.776 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.338.842 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.338.851 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.338.884 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPoolV3] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.338.983 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.338.986 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.339.004 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.339.016 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.339.080 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaximumGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.339.101 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MinimumGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.339.119 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.339.146 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.339.166 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.339.195 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.339.257 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.339.290 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LogSoftmaxGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.339.314 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.339.306 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.339.310 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.339.337 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.339.355 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftMarginLoss] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.339.373 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.339.368 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.339.393 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftmaxFocalLoss] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.339.401 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.339.411 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.339.432 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.339.455 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.339.456 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.339.484 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.339.523 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.339.527 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.339.549 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Mish] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.339.553 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.339.604 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.339.630 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.339.633 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.339.648 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.339.664 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.339.750 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.339.773 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.339.779 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.339.782 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.339.807 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.339.845 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.339.915 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.339.922 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.339.923 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.339.953 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.340.039 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.340.051 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsV2] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.340.063 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.340.080 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.340.092 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.340.175 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftmaxCrossEntropyWithLogits] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.340.193 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.340.233 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AGLU] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.340.253 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.340.283 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.340.305 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.340.386 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.340.398 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.340.407 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.340.505 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.340.519 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.340.552 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.340.600 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.340.620 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.340.696 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.340.704 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.340.719 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GridSampler2DGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.340.808 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.340.847 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AGLU] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.340.874 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GridSampler3DGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.340.905 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.340.967 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.341.011 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyAdadeltaD] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.341.032 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyAdagradD] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.341.050 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyAdagradV2D] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.341.053 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.341.068 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyAdaMaxD] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.341.086 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyAdamD] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.341.103 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradD] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.341.120 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyAdamWithAmsgradV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.341.137 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyAddSignD] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.341.154 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyCenteredRMSPropD] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.341.171 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyFtrlD] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.341.188 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyFtrlV2D] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.341.189 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.341.208 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyGradientDescent] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.341.228 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyKerasMomentumD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.341.219 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.341.247 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyMomentumD] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.341.241 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.341.267 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyPowerSignD] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.341.284 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyProximalAdagradD] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.341.309 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyProximalGradientDescent] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.341.326 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyRMSPropD] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.341.346 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyAdagradDAD] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.341.371 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.341.431 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PadV4Grad] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.341.444 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.341.547 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FusedMulApplyMomentum] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.341.567 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FusedMulApplyKerasMomentum] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.341.559 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.341.616 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PadV3GradReplicate] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.341.670 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.341.732 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.341.768 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GeluGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.341.775 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.341.852 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.341.870 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GeluGradV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.341.945 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.341.958 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.341.976 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.342.044 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IsNegInf] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.342.091 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.342.118 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.342.142 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IsPosInf] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.342.247 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.342.316 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.342.307 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.342.413 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.342.415 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.342.432 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.342.511 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.342.550 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.342.612 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.342.670 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.342.715 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.342.789 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.342.815 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReluV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.342.831 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.342.903 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.342.915 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.342.994 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.343.015 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.343.014 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.343.039 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.343.122 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Cummax] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.343.144 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.343.156 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.343.242 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.343.340 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.343.372 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NLLLossGrad310p] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.343.370 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.343.387 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.343.443 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.343.537 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.343.549 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Col2ImV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.343.654 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.343.674 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.343.684 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.343.774 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.343.808 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DropoutWithMulsAndSoftmaxGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.343.872 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.343.918 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NLLLossGrad310p] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.343.975 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.343.969 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.344.082 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.344.076 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.344.111 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.344.142 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.344.194 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.344.242 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.344.265 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.344.300 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2d] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.344.298 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.344.357 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DropoutWithMulsAndSoftmaxGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.344.403 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.344.476 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.344.501 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.344.515 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.344.608 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.344.605 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.344.663 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.344.710 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.344.706 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.344.715 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.344.817 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.344.812 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.344.839 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.344.868 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ForeachBinaryOp] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.344.914 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaskedSelect] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.345.016 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.345.018 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.345.041 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.345.137 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.345.135 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.345.144 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.345.245 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.345.250 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.345.349 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.345.391 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ForeachBinaryOp] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.345.443 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.345.454 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.345.536 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.345.557 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.345.622 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.345.645 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.345.658 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.345.764 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.345.769 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.345.863 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.345.881 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.345.950 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.345.974 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.345.986 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.346.070 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RNNTLoss] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.346.123 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.346.135 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InstanceNormV3] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.346.178 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MultinomialWithReplacement] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.346.276 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.346.296 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.346.314 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IouV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.346.397 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StatelessBernoulli] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.346.497 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.346.489 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BidirectionLSTM] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.346.510 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.346.518 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BidirectionLSTMV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.346.601 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.346.619 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.346.672 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.346.699 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.346.699 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.346.723 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.346.801 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UniqueConsecutive] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.346.839 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaskedSelectV3] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.346.872 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InstanceNormV3] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.346.910 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UniqueWithCountsAndSorting] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.346.930 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.347.011 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[WarpAffine] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.347.020 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.347.050 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IouV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.347.109 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Histogram] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.347.152 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.347.212 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.347.212 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BidirectionLSTM] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.347.241 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BidirectionLSTMV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.347.310 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.347.360 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.347.335 [op_impl_space_registry.cc:273]618654 ConvertSoToRegistry:Save so symbol and handle in path[/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so] success!
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.347.388 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.347.412 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Unique] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.347.416 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.347.517 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UniqueWithCounts] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.347.567 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaskedSelectV3] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.347.617 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Dot] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.347.698 [plugin_manager.cc:554]618654 GetUpgradedOpsProtoPath:Start to get upgraded ops proto path
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.347.724 [plugin_manager.cc:134]618654 GetUpgradedOppPath:Enter get upgraded opp path schedule
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.347.718 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.347.708 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.347.733 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.347.789 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /usr/local/Ascend/ascend-toolkit/latest/opp_latest/, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.347.809 [plugin_manager.cc:145]618654 GetUpgradedOppPath:[Call][RealPath] Opp path /usr/local/Ascend/ascend-toolkit/latest/opp_latest/ is invalid.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.347.822 [plugin_manager.cc:557]618654 GetUpgradedOpsProtoPath:Failed to get upgraded opp path!
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.347.816 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.347.838 [plugin_manager.cc:108]618654 GetOppPath:Enter get opp path schedule
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.347.870 [plugin_manager.cc:117]618654 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.347.882 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.347.921 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.347.943 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.348.043 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SyncBatchNormBackwardReduce] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.348.050 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.348.142 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStatsWithCounts] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.348.252 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.348.275 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.348.304 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.348.322 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.348.340 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.348.357 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.348.374 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.348.391 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.348.407 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.348.504 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.348.524 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.348.542 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.348.527 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.348.646 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.348.726 [plugin_manager.cc:996]618654 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.348.746 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.348.797 [plugin_manager.cc:1011]618654 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.348.824 [plugin_manager.cc:1015]618654 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.348.851 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.348.923 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.348.944 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.348.950 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.348.933 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.349.007 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.349.025 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.349.038 [opp_so_manager.cc:66]618654 LoadOpMasterPackage:Start load op master package, is_split:[1].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.349.048 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.349.055 [plugin_manager.cc:616]618654 GetOpTilingForwardOrderPath:Enter GetOpTilingPath schedule
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.349.071 [plugin_manager.cc:108]618654 GetOppPath:Enter get opp path schedule
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.349.070 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.349.091 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.349.096 [plugin_manager.cc:117]618654 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.349.112 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.349.118 [plugin_manager.cc:624]618654 GetOpTilingForwardOrderPath:Opp plugin path structure is new version!
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.349.138 [plugin_manager.cc:206]618654 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.349.194 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.349.206 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.349.241 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.349.291 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.349.312 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.349.398 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyAdamWV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.349.416 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.349.521 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.349.550 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.349.556 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.349.594 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.349.614 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.349.627 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.349.619 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.349.679 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.349.692 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.349.718 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.349.741 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.349.773 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.349.791 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.349.843 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.349.887 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.349.908 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.349.926 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.350.006 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.350.022 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.350.044 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.350.045 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.350.062 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.350.083 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.350.103 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.350.115 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.350.154 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.350.162 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.350.184 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.350.164 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.350.205 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.350.199 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.350.218 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.350.225 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.350.235 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.350.254 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.350.271 [plugin_manager.cc:215]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.350.313 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.350.326 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.350.429 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.350.430 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.350.530 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.350.523 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.350.552 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.350.570 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.350.620 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.350.666 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.350.657 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.350.675 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.350.688 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.350.691 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.350.758 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.350.797 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.350.833 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.350.862 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.350.888 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.350.898 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.350.914 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.350.937 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.350.963 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.350.986 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.350.999 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.008 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.351.022 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.034 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.351.042 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.061 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.085 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.108 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.351.111 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.130 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.351.140 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.351.147 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.153 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.351.171 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.351.168 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.176 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.351.188 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.351.191 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.198 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.223 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.351.227 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.245 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.268 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.351.268 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.351.289 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.289 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.351.288 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.314 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.351.307 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.351.323 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.351.340 [plugin_manager.cc:215]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.337 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.361 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.351.388 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.393 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.415 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.438 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.462 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.484 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.351.496 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.508 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.532 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.555 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.576 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.598 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.351.603 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.620 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.646 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.669 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.690 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.351.684 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.351.703 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.712 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.351.721 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.351.740 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.736 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.351.755 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.759 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.781 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.351.794 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.351.805 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.803 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.827 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.851 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.873 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.895 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.351.905 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.915 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.937 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.966 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.351.989 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.352.008 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.352.011 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.352.034 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.352.055 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.352.076 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.352.096 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.352.113 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool2dAssistMatrix] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.352.119 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.352.140 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.352.189 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.352.222 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.352.226 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : []
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.352.236 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.352.276 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.352.314 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.352.332 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.352.327 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.352.321 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachACosInplace] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.352.348 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.352.367 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.352.383 [plugin_manager.cc:215]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.352.429 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.352.490 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachAddListInplace] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.352.533 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.352.639 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Cdist] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.352.657 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMulScalarInplace] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.352.683 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachLogInplace] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.352.707 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSubListInplace] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.352.729 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachMulListInplace] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.352.739 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CdistGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.352.728 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.352.753 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachDivListInplace] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.352.765 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.352.784 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.352.799 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.352.837 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.352.849 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.352.874 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.352.892 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.352.902 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachSubScalarInplace] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.352.986 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.353.008 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.353.015 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.353.026 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.353.128 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.353.125 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.353.186 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.353.226 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.353.221 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.353.238 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.353.234 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.353.256 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.353.293 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.353.331 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.353.342 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.353.360 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.353.355 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.353.375 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.353.393 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.353.408 [plugin_manager.cc:215]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.353.442 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GlobalLpPool] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.353.477 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.353.539 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GLU] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.353.635 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3dGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.353.642 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GLUGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.353.740 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.353.752 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.353.752 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.353.788 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.353.807 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.353.819 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.353.849 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.353.854 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.353.902 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.353.949 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LpLoss] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.354.051 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LpNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.354.027 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.354.074 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.354.094 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.354.112 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.354.165 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.354.192 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.354.210 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MinAreaPolygons] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.354.206 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.354.215 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.354.245 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.354.263 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.354.277 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.354.309 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.354.285 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.354.313 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.354.327 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.354.325 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.354.352 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.354.352 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.354.371 [plugin_manager.cc:1026]618654 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.354.376 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.354.386 [plugin_manager.cc:322]618654 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.354.416 [plugin_manager.cc:212]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.354.407 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.354.433 [plugin_manager.cc:215]618654 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.354.449 [plugin_manager.cc:218]618654 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-pack
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.354.473 [plugin_manager.cc:422]618654 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.354.491 [plugin_manager.cc:155]618654 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.354.494 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.354.515 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.354.515 [plugin_manager.cc:158]618654 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.354.533 [plugin_manager.cc:426]618654 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.354.614 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.354.659 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.354.720 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.354.823 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.354.825 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.354.873 [plugin_manager.cc:250]618654 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.354.882 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.354.909 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.354.927 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.354.923 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.354.920 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.354.942 [plugin_manager.cc:1063]618654 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.354.986 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.354.982 [plugin_manager.cc:439]618654 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.355.037 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.355.100 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.355.135 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.355.236 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.355.289 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IndexPutWithSort] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.355.322 [plugin_manager.cc:996]618654 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.355.342 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.355.354 [plugin_manager.cc:1011]618654 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.355.379 [plugin_manager.cc:1015]618654 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.355.406 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.355.440 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [][][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.355.438 [opp_so_manager.cc:123]618654 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.355.542 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.355.552 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.355.574 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.355.588 [opp_so_manager.cc:45]618654 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.355.603 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InplaceIndexAddWithSorted] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.355.647 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.355.718 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.355.745 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.355.833 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.355.848 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.355.859 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.355.884 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.355.952 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.356.040 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.356.056 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.356.172 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.356.251 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.356.273 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.356.372 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.356.405 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.356.474 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.356.559 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.356.574 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.356.673 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.356.750 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.356.778 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.356.800 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.356.895 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotatedNMS] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.356.897 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.357.002 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.357.017 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.357.110 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.357.156 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.357.177 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.357.209 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SilentCheck] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.357.305 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.357.353 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.357.408 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.357.421 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.357.415 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff152ff2c0, registered count:4
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.357.455 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.357.485 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.357.506 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3d] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.357.506 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.357.489 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.357.527 [op_check.cc:71]618654 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.357.533 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.357.610 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.357.665 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.357.709 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.357.699 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MedianDim] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.357.756 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.357.781 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.357.809 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ActiveRotatedFilter] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.357.830 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff15303978, registered count:4
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.357.855 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.357.875 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.357.895 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.357.895 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.357.915 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ActiveRotatedFilterGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.357.914 [op_check.cc:71]618654 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.358.016 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.358.016 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.358.024 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.358.037 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MedianDim] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.358.120 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.358.147 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.358.202 [op_impl_registry_holder_manager.cc:208]618654 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.358.218 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.358.221 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.358.234 [op_impl_registry_holder_manager.cc:216]618654 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.358.268 [op_impl_registry_holder_manager.cc:208]618654 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.358.310 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.358.313 [op_impl_registry_holder_manager.cc:208]618654 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.358.334 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.358.348 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.358.422 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.358.434 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.358.467 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.358.538 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.358.545 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.358.578 [op_impl_space_registry.cc:273]618654 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so] success!
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.358.580 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.358.586 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Resize] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.358.639 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.358.635 [opp_so_manager.cc:123]618654 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.358.702 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.358.728 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeTutelCombineGates] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.358.747 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PSAMask] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.358.744 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.358.758 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.358.778 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.358.793 [opp_so_manager.cc:45]618654 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.358.814 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.358.847 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PSAMaskGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.358.898 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.358.909 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeTutelCombineX] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.358.937 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.358.953 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.359.044 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeTutelDispatch] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.359.046 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeTutelCombineGates] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.359.058 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.359.057 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.359.135 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.359.162 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.359.234 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeTutelCombineX] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.359.275 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.359.372 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.359.367 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeTutelDispatch] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.359.376 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScore] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.359.452 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.359.475 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ThreeNN] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.359.492 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.359.510 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.359.577 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Voxelization] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.359.648 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.359.678 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScore] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.359.697 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.359.725 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.359.748 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.359.772 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.359.796 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.359.798 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.359.821 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.359.843 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.359.864 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.359.884 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.359.902 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.359.920 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.359.938 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.359.944 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.359.963 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.359.971 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.359.985 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CompressFcOp] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.360.006 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.360.095 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.360.103 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.360.111 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Rfft1D] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.360.256 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.360.284 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.360.273 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.360.380 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:AllFinite, funcPointer:(nil), registered count:4
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.360.408 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.360.415 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:AllFinite, funcPointer:(nil), registered count:6
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.360.421 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Rfft1D] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.360.437 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.360.442 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:AllFinite, funcPointer:(nil), registered count:3
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.360.462 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:AllFinite, funcPointer:(nil), registered count:3
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.360.466 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GemmaRmsNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.360.484 [op_check.cc:71]618654 RegisterParamGeneralize:RegisterParamGeneralize: op_type:AllFinite, funcPointer:(nil), registered count:3
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.360.529 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.360.576 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.360.573 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.360.644 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.360.692 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.360.726 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.360.756 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GemmaRmsNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.360.760 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.360.775 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff152b09b0, registered count:4
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.360.802 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.360.821 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.360.841 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.360.860 [op_check.cc:71]618654 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.360.867 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.360.870 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LinearIndex] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.360.880 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.360.977 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.361.007 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.361.062 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[LinearIndexV2] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.361.140 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.361.163 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LinearIndex] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.361.148 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff152b3da0, registered count:4
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.361.184 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.361.203 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.361.223 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.361.243 [op_check.cc:71]618654 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.361.254 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.361.244 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScatterAddWithSorted] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.361.336 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[LinearIndexV2] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.361.400 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[Sinkhorn] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.361.414 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.361.508 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.361.506 [op_impl_registry_holder_manager.cc:208]618654 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.361.512 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScatterAddWithSorted] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.361.536 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.361.534 [op_impl_registry_holder_manager.cc:216]618654 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.361.554 [op_impl_registry_holder_manager.cc:208]618654 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.361.594 [op_impl_registry_holder_manager.cc:208]618654 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.361.618 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.361.644 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.361.656 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.361.663 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[Sinkhorn] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.361.771 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.361.841 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.361.848 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.361.883 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.361.912 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.361.964 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.361.960 [op_impl_space_registry.cc:84]618654 MergeFunctions:op type DecoderKvCache tiling_parse func has been registered
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.361.981 [op_impl_space_registry.cc:85]618654 MergeFunctions:op type DecoderKvCache compile_info_creator func has been registered
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.361.996 [op_impl_space_registry.cc:86]618654 MergeFunctions:op type DecoderKvCache compile_info_deleter func has been registered
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.362.009 [op_impl_space_registry.cc:87]618654 MergeFunctions:op type DecoderKvCache tiling func has been registered
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.362.024 [op_impl_space_registry.cc:93]618654 MergeFunctions:op type DecoderKvCache max_tiling_data_size has been registered
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.362.028 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StackGroupPoints] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.362.047 [op_impl_space_registry.cc:84]618654 MergeFunctions:op type PromptKvCache tiling_parse func has been registered
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.362.065 [op_impl_space_registry.cc:85]618654 MergeFunctions:op type PromptKvCache compile_info_creator func has been registered
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.362.078 [op_impl_space_registry.cc:86]618654 MergeFunctions:op type PromptKvCache compile_info_deleter func has been registered
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.362.093 [op_impl_space_registry.cc:87]618654 MergeFunctions:op type PromptKvCache tiling func has been registered
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.362.093 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.362.106 [op_impl_space_registry.cc:93]618654 MergeFunctions:op type PromptKvCache max_tiling_data_size has been registered
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.362.125 [op_impl_space_registry.cc:273]618654 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so] success!
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.362.117 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.362.125 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.362.173 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [][][][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.362.174 [opp_so_manager.cc:123]618654 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.362.207 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.362.227 [opp_so_manager.cc:126]618654 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.362.241 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.362.269 [opp_so_manager.cc:123]618654 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.362.281 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.362.290 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StackGroupPoints] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.362.353 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.362.374 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.362.393 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.362.406 [opp_so_manager.cc:45]618654 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.362.406 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.362.436 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.362.439 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.362.460 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.362.462 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.362.547 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.362.560 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMatMulV4] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.362.582 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.362.583 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.362.668 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.362.694 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.362.697 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.362.698 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RoiPoolingGradWithArgMax] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.362.721 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.362.724 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.362.744 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.362.756 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.362.782 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.362.815 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.362.846 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.362.883 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.362.886 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [][][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.362.934 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.362.956 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.362.982 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.362.981 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.363.007 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.362.999 [op_impl_space_registry.cc:240]618654 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.363.022 [opp_so_manager.cc:48]618654 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.363.059 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.363.067 [opp_so_manager.cc:123]618654 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.363.075 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.363.091 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.363.147 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [][][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.363.160 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.363.167 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.363.186 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.363.175 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.363.190 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ResizeTrilinear] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.363.201 [opp_so_manager.cc:45]618654 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.363.290 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.363.291 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.363.323 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.363.389 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.363.399 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.363.410 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.363.409 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.363.424 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.363.445 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.363.463 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.363.481 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.363.568 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.363.573 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StackBallQuery] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.363.598 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.363.596 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.363.629 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.363.626 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.363.648 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.363.655 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.363.687 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.363.687 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.363.710 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.363.732 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.363.754 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.363.777 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.363.797 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.363.803 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.363.818 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.363.819 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.363.834 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.363.845 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [][][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.363.846 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.363.848 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.363.867 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.363.871 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.363.869 [op_impl_space_registry.cc:240]618654 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.363.892 [opp_so_manager.cc:48]618654 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.363.888 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.363.916 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.363.940 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [][][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.363.936 [opp_so_manager.cc:123]618654 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.363.966 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.363.986 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [][][][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.363.975 [opp_so_manager.cc:126]618654 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.364.009 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [][][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.364.027 [opp_so_manager.cc:123]618654 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.364.050 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.364.078 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.364.085 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.364.115 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScoreGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.364.124 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.364.142 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.364.175 [opp_so_manager.cc:45]618654 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.364.204 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ActULQClampMaxGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.364.227 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ActULQClampMinGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.364.324 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ActsULQ] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.364.422 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ActsULQInputGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.364.532 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.364.575 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.364.629 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.364.655 [op_impl_space_registry.cc:240]618654 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.364.678 [opp_so_manager.cc:48]618654 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.364.719 [opp_so_manager.cc:123]618654 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.364.737 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdaptiveAvgPoolAssistMatrix] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.364.761 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.364.816 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.364.834 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.364.835 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.364.846 [opp_so_manager.cc:45]618654 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.364.859 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.364.955 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.364.968 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.365.073 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.365.179 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.365.177 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.365.276 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.365.299 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.365.383 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.365.398 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.365.452 [op_impl_space_registry.cc:240]618654 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.365.480 [opp_so_manager.cc:48]618654 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.365.498 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.365.521 [opp_so_manager.cc:123]618654 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.365.559 [opp_so_manager.cc:126]618654 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.365.602 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.365.607 [opp_so_manager.cc:123]618654 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.365.612 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.365.639 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.365.662 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.365.681 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.365.707 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.365.702 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.365.721 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.365.706 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.365.736 [opp_so_manager.cc:45]618654 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.365.731 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.365.752 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.365.775 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.365.782 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.365.862 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.365.966 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AvgPoolUpdate] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.366.064 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.366.175 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.366.189 [op_impl_space_registry.cc:240]618654 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.366.215 [opp_so_manager.cc:48]618654 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.366.254 [opp_so_manager.cc:123]618654 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.366.279 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Bitcast] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.366.349 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.366.368 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.366.381 [opp_so_manager.cc:45]618654 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.366.377 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.366.451 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.366.441 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: Conv2DBackpropFilter, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.366.535 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.366.530 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: Conv2DBackpropInput, registered count: 15
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.366.541 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.366.556 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: Conv2DTranspose, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.366.627 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.366.643 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: Conv2D, registered count: 15
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.366.632 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: Conv2DBackpropFilter, registered count: 15
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.366.717 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: Conv3DBackpropInput, registered count: 15
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.366.714 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: Conv2DBackpropInput, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.366.728 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CTCLoss] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.366.739 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: Conv3DTranspose, registered count: 15
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.366.745 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: Conv2DTranspose, registered count: 15
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.366.806 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: Conv3D, registered count: 15
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.366.817 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: Conv2D, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.366.833 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.366.884 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: Conv3DBackpropInput, registered count: 15
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.366.905 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: Conv3DTranspose, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.366.933 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.366.954 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : [][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.366.972 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: FFN, registered count: 15
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.366.992 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: MatmulTunnerTiling, registered count: 15
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.366.976 [op_impl_space_registry.cc:240]618654 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.366.990 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: Conv3D, registered count: 15
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.366.999 [opp_so_manager.cc:48]618654 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.367.014 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.367.041 [opp_so_manager.cc:123]618654 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.367.079 [opp_so_manager.cc:126]618654 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.367.099 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: MatMulV2, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.367.120 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DropOutGenMask] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.367.121 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: BatchMatmulFixpipe, registered count: 15
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.367.117 [opp_so_manager.cc:123]618654 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.367.142 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: MatMulV3, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.367.144 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StatelessDropOutGenMask] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.367.143 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: FFN, registered count: 15
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.367.165 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: MatmulTunnerTiling, registered count: 15
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.367.164 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: QuantBatchMatmulV3, registered count: 15
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.367.220 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.367.237 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.367.249 [opp_so_manager.cc:45]618654 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.367.254 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.367.267 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: MatMulV2, registered count: 15
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.367.288 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: BatchMatmulFixpipe, registered count: 15
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.367.307 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: MatMulV3, registered count: 15
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.367.320 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: DynamicRNN, registered count: 15
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.367.326 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: QuantBatchMatmulV3, registered count: 15
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.367.339 [tuning_tiling_registry.cc:30]618662 RegisterTilingData:optype: MatMulTunnerTiling, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.367.357 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.367.369 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.367.458 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.367.483 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: DynamicRNN, registered count: 15
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.367.504 [tuning_tiling_registry.cc:30]618674 RegisterTilingData:optype: MatMulTunnerTiling, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.367.556 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.367.560 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.367.662 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ExpandDims] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.367.704 [op_impl_space_registry.cc:240]618654 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.367.725 [opp_so_manager.cc:48]618654 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.367.767 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.367.765 [opp_so_manager.cc:123]618654 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.367.770 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.367.858 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.367.876 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.367.874 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FillWindowCache] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.367.888 [opp_so_manager.cc:45]618654 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.367.980 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.368.079 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FlattenV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.368.187 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GatherShapes] register OP_IMPL : []
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:42.368.205 [trs_cb_event.c:119][ascend][curpid:618654,618832][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =320; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:42.368.240 [trs_sqcq.c:1491][ascend][curpid:618654,618832][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.368.232 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : [][]
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:42.368.263 [npu_driver.cc:3833] 618832 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=320, drvRetCode=16.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.368.287 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GaussianBlur] register OP_IMPL : []
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:42.368.301 [api_impl.cc:5058] 618832 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.368.335 [callback.cpp:132]618832 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.368.362 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [][]
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.368.369 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.368.396 [npu_driver.cc:3828] 618832 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=320.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.368.404 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FileConstant] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.368.430 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StatelessIf] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.368.450 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[If] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.368.468 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[_If] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.368.486 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Case] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.368.470 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:MatMulV2, funcPointer:0xffff0fb3d0b0, registered count:7
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.368.503 [op_check.cc:24]618662 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:MatMulV2, funcPointer:0xffff0fb3d310, registered count:5
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.368.528 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ConstPlaceHolder] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.368.522 [op_impl_space_registry.cc:240]618654 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.368.545 [opp_so_manager.cc:48]618654 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.368.548 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.368.588 [opp_so_manager.cc:123]618654 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.368.608 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:MatMulV2, funcPointer:0xfffee44350b0, registered count:7
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.368.642 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [][][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.368.637 [opp_so_manager.cc:126]618654 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.368.639 [op_check.cc:24]618674 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:MatMulV2, funcPointer:0xfffee4435310, registered count:5
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.368.676 [opp_so_manager.cc:123]618654 LoadOpMasterSo:Get path with op_master path [/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.368.704 [opp_so_manager.cc:126]618654 LoadOpMasterSo:Get path with op_tiling path [/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.368.742 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [][]
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.368.738 [opp_so_manager.cc:123]618654 LoadOpMasterSo:Get path with op_master path [/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.368.817 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Identity] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.368.838 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MemcpyAsync] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.368.826 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_ct.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.368.846 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.368.858 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IdentityN] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.368.894 [plugin_manager.cc:1126]618654 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.368.912 [plugin_manager.cc:1130]618654 GetFileListWithSuffix:Found 2 libs.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.368.897 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.368.924 [opp_so_manager.cc:45]618654 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.368.953 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.368.995 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.369.055 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.369.163 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.369.259 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.369.365 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.369.363 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [][][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.369.439 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.369.461 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.369.484 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.369.501 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.369.655 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.369.676 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.369.748 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.369.850 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.369.950 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.370.048 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.370.143 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.370.248 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.370.355 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.370.452 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RandomChoiceWithMask] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.370.550 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RandomUniform] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.370.621 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Rank] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.370.647 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Size] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.370.742 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.370.846 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Reshape] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.370.955 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RgbToGrayscale] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.370.984 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : [][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.370.997 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.371.054 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.371.075 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.371.142 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.371.152 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.371.150 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.371.218 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.371.226 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.371.251 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.371.359 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Rotate] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.371.429 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Shape] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.371.449 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ShapeN] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.371.562 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SilentCheckV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.371.611 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [][][][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.371.609 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.371.661 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SilentCheckV3] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.371.765 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.371.710 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DefaultImpl] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.371.870 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.371.970 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyAdadelta] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.371.990 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyAdadeltaD] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.372.007 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyAdagradD] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.372.025 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyAdagrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.372.042 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagrad] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.372.047 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.372.060 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyProximalAdagradD] register OP_IMPL : []
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.372.046 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.372.080 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.372.096 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyAdagradV2D] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.372.113 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.372.129 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.372.146 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.372.175 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyFtrlV2D] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.372.194 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyRMSProp] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.372.213 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyRMSPropD] register OP_IMPL : []
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:42.372.173 [queue_client_comm.c:114][ascend][curpid:618658,618785][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:42.372.187 [queue_client_comm.c:114][ascend][curpid:618658,618787][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:42.372.187 [queue_client_comm.c:114][ascend][curpid:618658,61[WARNING] DRV(618654,python3.9):2025-04-03-09:27:42.372.176 [trs_cb_event.c:119][ascend][curpid:618654,618833][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =321; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:42.372.226 [trs_sqcq.c:1491][ascend][curpid:618654,618833][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:42.372.243 [npu_driver.cc:3833] 618833 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:42.372.260 [api_impl.cc:5058] 618833 ProcessReport: CqReportIrqWait, retCode=0x711000c
8789][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:42.372.188 [queue_client_comm.c:114][ascend][curpid:618658,618781][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.372.243 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : []
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.372.281 [callback.cpp:132]618833 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:42.372.194 [queue_client_comm.c:114][ascend][curpid:618658,618779][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:42.372.277 [npu_driver.cc:4338] 618785 MemQueuePeek: queue empty
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:42.372.270 [queue_client_comm.c:114][ascend][curpid:618658,618783][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.372.311 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseFillEmptyRows] register OP_IMPL : [][]
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.372.315 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:42.372.319 [npu_driver.cc:4338] 618787 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.372.338 [tensor_data_transfer.cpp:612]618785 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_image_summary
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.372.337 [npu_driver.cc:3828] 618833 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=321.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.372.334 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : []
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:42.372.347 [npu_driver.cc:4338] 618789 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.372.349 [tensor_data_transfer.cpp:612]618787 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_scalar_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.372.389 [tensor_data_transfer.cpp:612]618789 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_histogram_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.372.378 [tensor_data_transfer.cpp:1054]618785 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_image_summary
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.372.406 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.372.423 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : []
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:42.372.381 [npu_driver.cc:4338] 618781 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.372.398 [tensor_data_transfer.cpp:1054]618787 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_scalar_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.372.406 [tensor_data_transfer.cpp:1054]618789 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_histogram_summary
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:42.372.413 [npu_driver.cc:4338] 618779 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.372.435 [tensor_data_transfer.cpp:1056]618785 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.372.470 [tensor_data_transfer.cpp:612]618779 acltdtReceiveTensorV2: queue is empty, device is 3, name is _npu_log
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:42.372.440 [npu_driver.cc:4338] 618783 MemQueuePeek: queue empty
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.372.476 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AscendAntiQuantV2] register OP_IMPL : []
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.372.448 [tensor_data_transfer.cpp:612]618781 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_tensor_dump
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.372.452 [tensor_data_transfer.cpp:1056]618787 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.372.458 [tensor_data_transfer.cpp:1056]618789 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:42.372.479 [api_impl.cc:6121] 618785 MemQueuePeek: Start to peek queue on devId 3, qid is 3.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.372.522 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Squeeze] register OP_IMPL : []
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.372.495 [tensor_data_transfer.cpp:1054]618779 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is _npu_log
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.372.504 [tensor_data_transfer.cpp:612]618783 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_tensor_summary
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.372.547 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SqueezeV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.372.544 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.372.569 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SqueezeV3] register OP_IMPL : [][]
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.372.512 [tensor_data_transfer.cpp:1054]618781 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_tensor_dump
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:42.372.524 [api_impl.cc:6121] 618787 MemQueuePeek: Start to peek queue on devId 3, qid is 4.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:42.372.529 [api_impl.cc:6121] 618789 MemQueuePeek: Start to peek queue on devId 3, qid is 5.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:42.372.539 [npu_driver.cc:4330] 618785 MemQueuePeek: peek mem queue, deviceId=3, qid=3, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.372.550 [tensor_data_transfer.cpp:1056]618779 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.372.560 [tensor_data_transfer.cpp:1054]618783 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_tensor_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.372.587 [tensor_data_transfer.cpp:1056]618781 acltdtReceiveTensor: new process, use queue process
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.372.619 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : []
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:42.372.596 [npu_driver.cc:4330] 618787 MemQueuePeek: peek mem queue, deviceId=3, qid=4, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:42.372.600 [npu_driver.cc:4330] 618789 MemQueuePeek: peek mem queue, deviceId=3, qid=5, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:42.372.626 [api_impl.cc:6121] 618779 MemQueuePeek: Start to peek queue on devId 3, qid is 0.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.372.644 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : []
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.372.631 [tensor_data_transfer.cpp:1056]618783 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:42.372.640 [api_impl.cc:6121] 618781 MemQueuePeek: Start to peek queue on devId 3, qid is 1.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.372.665 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [][]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:42.372.664 [npu_driver.cc:4330] 618779 MemQueuePeek: peek mem queue, deviceId=3, qid=0, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:42.372.672 [api_impl.cc:6121] 618783 MemQueuePeek: Start to peek queue on devId 3, qid is 2.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:42.372.677 [npu_driver.cc:4330] 618781 MemQueuePeek: peek mem queue, deviceId=3, qid=1, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:42.372.693 [npu_driver.cc:4330] 618783 MemQueuePeek: peek mem queue, deviceId=3, qid=2, timeout=800.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.372.722 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Concat] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.372.748 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ConcatV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.372.764 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StatelessRandomNormalV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.372.771 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.372.793 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.372.881 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.372.907 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.372.976 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.372.989 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.372.973 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.373.048 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.373.096 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TopK] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.373.109 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.373.118 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.373.116 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.373.143 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.373.160 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.373.181 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.373.189 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.373.229 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.373.263 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.373.276 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TopKPQDistanceV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.373.288 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.373.349 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.373.357 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.373.375 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.373.381 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.373.405 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.373.477 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TransArgb] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.373.501 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.373.580 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Unsqueeze] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.373.574 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.373.603 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UnsqueezeV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.373.621 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UnsqueezeV3] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.373.640 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.373.643 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CircularPad] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.373.710 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.373.722 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.373.744 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dGrad] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.373.781 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.373.813 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[CircularPadGrad] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.373.843 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Where] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.373.854 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.373.922 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.373.947 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[WtsARQ] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.373.993 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.374.013 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.374.051 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.374.063 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.374.130 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.374.154 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.374.204 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.374.260 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.374.283 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.374.279 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.374.348 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.374.367 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.374.385 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.374.407 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.374.399 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.374.418 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.374.428 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.374.452 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.374.475 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.374.490 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.374.509 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdjustContrast] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.374.530 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdjustHue] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.374.549 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdjustSaturation] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.374.559 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.374.574 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CropAndResize] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.374.593 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CropAndResizeV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.374.610 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DecodeAndCropJpeg] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.374.631 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DecodeJpeg] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.374.627 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.374.650 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NormalizeV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.374.668 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdjustContrastWithMean] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.374.665 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleLinear1d] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.374.685 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdjustBrightness] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.374.693 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleBilinear2d] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.374.705 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdjustBrightnessV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.374.724 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdjustSaturationV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.374.741 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[WarpAffineV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.374.759 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ImgCrop] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.374.775 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[WarpPerspective] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.374.870 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.374.863 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleBicubic2d] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.374.892 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.374.909 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.375.014 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HcomAllReduce] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.375.035 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HcomAllGather] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.375.036 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAA] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.375.053 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HcomBroadcast] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.375.073 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HcomReduceScatter] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.375.090 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HcomSend] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.375.107 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HcomReduce] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.375.123 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HcomReceive] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.375.140 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HcomAllToAllV] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.375.157 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HcomAllToAllVC] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.375.178 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HcomGatherAllToAllV] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.375.209 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAAGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.375.301 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.375.380 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.375.379 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.375.500 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.375.576 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.375.576 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.375.603 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3dGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.375.645 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.375.713 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.375.774 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAA] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.375.949 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAABackward] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.376.041 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.376.114 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.376.128 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.376.190 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.376.273 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.376.354 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.376.349 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ResizeUpsampleTrilinear] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.376.424 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.376.493 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.376.527 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dBackward] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.376.609 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.376.682 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.376.708 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.376.710 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3d] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.376.814 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.376.874 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleNearest] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.376.885 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.376.960 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.377.026 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.377.043 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.377.067 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleNearestExact2dGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.377.094 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[UpsampleNearest2dGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.377.223 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.377.316 [op_impl_registry_holder_manager.cc:208]618646 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 894
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.377.345 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.377.372 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.377.495 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.377.522 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.377.651 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.377.771 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.377.897 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.378.024 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.378.138 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.378.253 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.378.453 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.378.659 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.379.041 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.379.439 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.379.642 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.379.680 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.379.817 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.379.934 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.379.984 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.380.215 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.380.214 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.380.339 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.380.422 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ReflectionPad3dGrad] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.380.454 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DeformableOffsetsGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.380.541 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.380.570 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.380.668 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.380.727 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.380.834 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.380.836 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.380.862 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.380.887 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.380.914 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantConv2D] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.381.008 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.381.170 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.381.278 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.381.388 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.381.511 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachNonFiniteCheckAndUnscale] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.381.633 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.381.750 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.381.778 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.381.935 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GatherV3] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.382.043 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.382.057 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3d] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.382.186 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.382.312 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.382.422 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.382.449 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.382.525 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.382.555 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.382.660 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.382.694 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.382.812 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LinSpace] register OP_IMPL : [][][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.382.865 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.382.931 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MemSet] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.383.023 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.383.045 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.383.052 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.383.158 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.383.201 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.383.278 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.383.357 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.383.390 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.383.507 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.383.516 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.383.544 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.383.619 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NPUClearFloatStatus] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.383.708 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.383.730 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NPUGetFloatStatus] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.383.855 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.383.874 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.383.882 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.384.026 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.384.039 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.384.100 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.384.226 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.384.238 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.384.373 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.384.395 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AGLU] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.384.667 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:ReverseSequence, funcPointer:0xffff17a66360, registered count:5
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.384.697 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:ReverseSequence, funcPointer:(nil), registered count:7
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.384.724 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:ReverseSequence, funcPointer:(nil), registered count:4
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.384.745 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:ReverseSequence, funcPointer:(nil), registered count:4
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.384.770 [op_check.cc:71]618650 RegisterParamGeneralize:RegisterParamGeneralize: op_type:ReverseSequence, funcPointer:(nil), registered count:4
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.384.793 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.384.813 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.384.844 [op_impl_registry_holder_manager.cc:208]618654 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 1
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.384.904 [op_impl_registry_holder_manager.cc:208]618654 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 1
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.384.920 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.384.936 [op_impl_registry_holder_manager.cc:208]618654 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 11
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.385.040 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.385.172 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.385.245 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.385.395 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.385.419 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.385.504 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.385.532 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.385.615 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.385.649 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.385.677 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.385.793 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.385.901 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.385.927 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.386.032 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.386.150 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.386.274 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.386.386 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.386.573 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.386.600 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.386.700 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.386.710 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.386.792 [op_impl_registry_holder_manager.cc:208]618646 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 894
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.386.825 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.387.026 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.387.135 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.387.140 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.387.241 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.387.359 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.387.471 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.387.527 [op_impl_space_registry.cc:273]618654 ConvertSoToRegistry:Save so symbol and handle in path[/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_ct.so] success!
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.387.674 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.387.702 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NLLLossGrad310p] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.387.828 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.387.880 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.387.979 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.388.040 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.388.136 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.388.193 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DropoutWithMulsAndSoftmaxGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.388.265 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.388.373 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.388.383 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.388.498 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BlendFaceBgPartOne] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.388.537 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.388.565 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.388.611 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.388.682 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.388.710 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.388.724 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.388.986 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.389.052 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.389.146 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.389.171 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.389.173 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNN, funcPointer:0xffff17af0e08, registered count:7
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.389.329 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ForeachBinaryOp] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.389.354 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.389.379 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNNV2, funcPointer:0xffff17af9298, registered count:7
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.389.486 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.389.517 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.389.605 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.389.633 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.389.779 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.389.893 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GridSampler2D] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.389.923 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.389.998 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GridSampler3D] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.390.102 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.390.120 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandle] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.390.233 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandleV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.390.340 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.390.451 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PasteSubImg] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.390.493 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.390.554 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.390.581 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.390.616 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.390.697 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.390.732 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.390.813 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.390.901 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InstanceNormV3] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.390.923 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.391.039 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.391.084 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IouV2] register OP_IMPL : [][]
[WARNING] DEVICE(618658,fffec77eefa0,python3.9):2025-04-03-09:27:42.391.087 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:248] QueryUniqueID] Retry to lookup the unique id for group hccl_world_group from the meta server node...Retry time: 394/400, sleep 1
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.391.145 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.391.263 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.391.267 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BidirectionLSTM] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.391.298 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BidirectionLSTMV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.391.308 [op_impl_registry_holder_manager.cc:208]618646 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.391.368 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TabulateFusionGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.391.457 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.391.482 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.391.481 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[YUV4442YUV422] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.391.624 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.391.648 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaskedSelectV3] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.391.652 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.391.679 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.391.703 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.391.829 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.391.852 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.391.975 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.392.102 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.392.223 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.392.335 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.392.439 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.392.463 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.392.495 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.392.610 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.392.725 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.392.831 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.393.025 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicAtomicAddrClean] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.393.137 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.393.254 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.393.339 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.393.361 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.393.473 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.393.585 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.393.701 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.393.727 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceMeanD] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.393.843 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.393.949 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.393.977 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.394.256 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.394.369 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.394.480 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.394.594 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.394.703 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.394.821 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.394.938 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.395.046 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.395.241 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.395.356 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.395.482 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.397.981 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DepthToSpace] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.398.028 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.398.055 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SpaceToDepth] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.398.192 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.398.300 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.398.403 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.398.523 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.398.638 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.398.748 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.398.864 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.398.972 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.399.093 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.399.124 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.399.123 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.399.164 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.399.233 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.399.263 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.399.397 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.399.423 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.399.527 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.399.636 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.399.742 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.399.851 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.400.101 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.400.393 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.400.549 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.400.668 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.400.787 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.400.907 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.401.576 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNormGradV3] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.401.750 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.402.020 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.402.316 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MedianDim] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.402.394 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.402.647 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.402.707 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.402.861 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.403.064 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.403.068 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.403.171 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.403.200 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.403.232 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.403.387 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.403.363 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [][][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.403.399 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeTutelCombineGates] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.403.465 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.403.470 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.403.596 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeTutelCombineX] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.403.626 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.403.631 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.403.725 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.403.737 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeTutelDispatch] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.403.761 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.403.827 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.403.867 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.403.988 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.404.001 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.404.083 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScore] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.404.113 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.404.246 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.404.247 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.404.396 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.404.413 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.404.448 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.404.514 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.404.543 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.404.682 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [][][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.404.764 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.404.802 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.404.803 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPool3DWithArgmaxV2] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.404.884 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MlaAttentionScore] register OP_IMPL : []
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.404.913 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Rfft1D] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.405.017 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.405.037 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.405.071 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.405.095 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MlaAttentionScore] register OP_IMPL : []
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.405.236 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.405.236 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.405.270 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GemmaRmsNorm] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.405.270 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.405.393 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.405.442 [op_impl_registry.cc:122]618674 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [][][][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.405.469 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.405.510 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.405.639 [op_impl_registry.cc:122]618662 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [][][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.405.710 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LinearIndex] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.405.896 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[LinearIndexV2] register OP_IMPL : [][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.406.086 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScatterAddWithSorted] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.406.100 [op_impl_registry_holder_manager.cc:208]618674 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 599
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.406.226 [op_impl_registry_holder_manager.cc:208]618662 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 599
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.406.253 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[Sinkhorn] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.406.371 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.406.503 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.406.536 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.406.735 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.406.925 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StackGroupPoints] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.406.990 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPool3DGradWithArgmax] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.407.088 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [][][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.407.208 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.407.365 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.407.392 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.407.524 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.407.645 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.407.670 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.407.693 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.407.819 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.407.851 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.407.992 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.408.043 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.408.136 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.408.149 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CTCLossV3Grad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.408.433 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.408.627 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.408.654 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.408.679 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.408.872 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.408.900 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.409.145 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CTCLossV3] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.409.298 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.409.462 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3DGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.409.928 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.410.041 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.410.165 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.410.273 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.410.379 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.410.504 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.410.621 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.410.726 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.410.834 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.410.944 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.411.060 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.411.218 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PadV3GradReplication] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.411.328 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.411.445 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.411.633 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.411.752 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.411.809 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: Conv2DBackpropFilter, registered count: 15
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.411.862 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.411.900 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: Conv2DBackpropInput, registered count: 15
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.411.932 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: Conv2DTranspose, registered count: 15
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.411.972 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.412.016 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: Conv2D, registered count: 15
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.412.090 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: Conv3DBackpropInput, registered count: 15
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.412.122 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: Conv3DTranspose, registered count: 15
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.412.122 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.412.242 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: Conv3D, registered count: 15
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.412.319 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.412.417 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: FFN, registered count: 15
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.412.440 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: MatmulTunnerTiling, registered count: 15
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.412.437 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.412.444 [op_impl_registry_holder_manager.cc:208]618674 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 599
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.412.549 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.412.558 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: MatMulV2, registered count: 15
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.412.576 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.412.581 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: BatchMatmulFixpipe, registered count: 15
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.412.601 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: MatMulV3, registered count: 15
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.412.618 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: QuantBatchMatmulV3, registered count: 15
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.412.605 [op_impl_registry_holder_manager.cc:208]618662 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 599
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.412.765 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.412.800 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: DynamicRNN, registered count: 15
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.412.821 [tuning_tiling_registry.cc:30]618670 RegisterTilingData:optype: MatMulTunnerTiling, registered count: 15
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.412.875 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.412.990 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.413.122 [op_impl_space_registry.cc:273]618646 ConvertSoToRegistry:Save so symbol and handle in path[/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so] success!
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.413.171 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.413.285 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.413.455 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.413.478 [plugin_manager.cc:554]618646 GetUpgradedOpsProtoPath:Start to get upgraded ops proto path
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.413.510 [plugin_manager.cc:134]618646 GetUpgradedOppPath:Enter get upgraded opp path schedule
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.413.568 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /usr/local/Ascend/ascend-toolkit/latest/opp_latest/, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.413.569 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.413.583 [plugin_manager.cc:145]618646 GetUpgradedOppPath:[Call][RealPath] Opp path /usr/local/Ascend/ascend-toolkit/latest/opp_latest/ is invalid.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.413.595 [plugin_manager.cc:557]618646 GetUpgradedOpsProtoPath:Failed to get upgraded opp path!
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.413.608 [plugin_manager.cc:108]618646 GetOppPath:Enter get opp path schedule
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.413.636 [plugin_manager.cc:117]618646 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.413.693 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.413.802 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.413.836 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.413.955 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.413.981 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.414.059 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:MatMulV2, funcPointer:0xffff044350b0, registered count:7
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.414.086 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.414.093 [op_check.cc:24]618670 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:MatMulV2, funcPointer:0xffff04435310, registered count:5
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.414.145 [plugin_manager.cc:996]618646 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.414.197 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.414.218 [plugin_manager.cc:1011]618646 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.414.225 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.414.240 [plugin_manager.cc:1015]618646 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.414.330 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_proto/lib/linux/aarch64//libopsproto_rt.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.414.345 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.414.337 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.414.404 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.414.417 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.414.429 [opp_so_manager.cc:66]618646 LoadOpMasterPackage:Start load op master package, is_split:[1].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.414.441 [plugin_manager.cc:616]618646 GetOpTilingForwardOrderPath:Enter GetOpTilingPath schedule
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.414.452 [plugin_manager.cc:108]618646 GetOppPath:Enter get opp path schedule
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.414.453 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.414.472 [plugin_manager.cc:117]618646 GetOppPath:Get opp path from env: /usr/local/Ascend/ascend-toolkit/latest/opp
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.414.489 [plugin_manager.cc:624]618646 GetOpTilingForwardOrderPath:Opp plugin path structure is new version!
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.414.506 [plugin_manager.cc:206]618646 GetPluginPathFromCustomOppPath:value of env custom_op_lib_path_ is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.414.498 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.414.568 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : [][]
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.414.648 [op_impl_registry_holder_manager.cc:208]618674 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.414.749 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [][]
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.414.772 [op_impl_registry_holder_manager.cc:208]618662 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.414.856 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.414.871 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.414.908 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.414.923 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.414.935 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.414.979 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.415.010 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.415.065 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GridSampler2DGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.415.211 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GridSampler3DGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.415.302 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.415.336 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.415.349 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.415.361 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.415.396 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.415.389 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.415.435 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.415.448 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.415.460 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.415.472 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.415.487 [plugin_manager.cc:215]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.415.573 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.415.761 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PadV4Grad] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.415.805 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.415.838 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.415.851 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.415.863 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.415.851 [op_impl_space_registry.cc:109]618666 MergeFunctions:op type AvgPool3DGrad inputs_dependency has been registered
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.415.907 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.415.942 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PadV3GradReplicate] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.416.057 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.416.189 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.416.248 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.416.282 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.416.295 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.416.307 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.416.307 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.416.341 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.416.375 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.416.387 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.416.399 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.416.411 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.416.424 [plugin_manager.cc:215]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.416.416 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.416.443 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.416.638 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.416.739 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.416.748 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.416.771 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.416.785 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.416.798 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.416.795 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.416.830 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.416.867 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.416.962 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.416.984 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.417.046 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.417.095 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.417.144 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.417.165 [op_impl_space_registry.cc:84]618666 MergeFunctions:op type MoeInitRoutingV2 tiling_parse func has been registered
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.417.189 [op_impl_space_registry.cc:85]618666 MergeFunctions:op type MoeInitRoutingV2 compile_info_creator func has been registered
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.417.175 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.417.199 [op_impl_space_registry.cc:86]618666 MergeFunctions:op type MoeInitRoutingV2 compile_info_deleter func has been registered
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.417.200 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.417.211 [op_impl_space_registry.cc:87]618666 MergeFunctions:op type MoeInitRoutingV2 tiling func has been registered
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.417.213 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.417.207 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : [][]
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.417.225 [op_impl_space_registry.cc:93]618666 MergeFunctions:op type MoeInitRoutingV2 max_tiling_data_size has been registered
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.417.248 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.417.280 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.417.293 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.417.305 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.417.317 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.417.331 [plugin_manager.cc:215]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.417.321 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.417.351 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.417.429 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.417.463 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.417.646 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.417.678 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.417.691 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.417.686 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.417.706 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.417.739 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.417.895 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.418.052 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.418.083 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.418.096 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.418.108 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.418.140 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.418.172 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.418.195 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.418.207 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.418.218 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.418.231 [plugin_manager.cc:215]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.418.245 [op_impl_space_registry.cc:273]618666 ConvertSoToRegistry:Save so symbol and handle in path[/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so] success!
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.418.539 [plugin_manager.cc:564]618666 GetUpgradedOpMasterPath:Start to get upgraded op tiling path
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.418.548 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.418.562 [plugin_manager.cc:134]618666 GetUpgradedOppPath:Enter get upgraded opp path schedule
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.418.578 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.418.591 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.418.602 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.418.613 [file_utils.cc:47]618666 RealPath:[Util][realpath] Can not get real_path for /usr/local/Ascend/ascend-toolkit/latest/opp_latest/, reason:No such file or directory
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.418.628 [plugin_manager.cc:145]618666 GetUpgradedOppPath:[Call][RealPath] Opp path /usr/local/Ascend/ascend-toolkit/latest/opp_latest/ is invalid.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.418.634 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910' is valid.
[WARNING] GE(618666,python3.9):2025-04-03-09:27:42.418.640 [plugin_manager.cc:567]618666 GetUpgradedOpMasterPath:Failed to get upgraded opp path!
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.418.662 [mem_manager.cc:31]618666 Initialize:MemManager Initialize.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.418.679 [rts_caching_mem_allocator.cc:131]618666 Initialize:RtsAllocatorManager Initialize.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.418.692 [mem_manager.cc:102]618666 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.418.703 [graph_mem_allocator.cc:17]618666 Initialize:MemoryAllocator::Initialize.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.418.716 [mem_manager.cc:102]618666 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.418.738 [graph_mem_allocator.cc:17]618666 Initialize:MemoryAllocator::Initialize.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.418.752 [mem_manager.cc:102]618666 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.418.726 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [][]
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.418.765 [caching_allocator.cc:391]618666 FreeBlocks:Free blocks.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.418.777 [caching_allocator.cc:358]618666 FreeCachedBlocks:Free cached blocks
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.418.791 [mem_manager.cc:102]618666 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.418.802 [caching_allocator.cc:391]618666 FreeBlocks:Free blocks.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.418.812 [caching_allocator.cc:358]618666 FreeCachedBlocks:Free cached blocks
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.418.824 [mem_manager.cc:102]618666 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.418.836 [mem_manager.cc:102]618666 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.418.848 [mem_manager.cc:102]618666 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.418.858 [mem_manager.cc:102]618666 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.418.868 [mem_manager.cc:102]618666 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.418.879 [session_scope_mem_allocator.cc:73]618666 FreeAllMemory:Free all memory
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.418.891 [mem_manager.cc:102]618666 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.418.902 [session_scope_mem_allocator.cc:73]618666 FreeAllMemory:Free all memory
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.418.923 [dump_manager.cc:152]618666 Init:exception dump is not enabled
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.418.942 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.418.953 [ge_executor.cc:315]618666 Initialize:Init GeExecutor over.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.418.969 [acl.cpp:321]618666 aclInit: set DumpConfig in aclInit
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.418.970 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.418.982 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.418.981 [dump.cpp:841]618666 HandleDumpConfig: start to execute HandleDumpConfig.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.418.993 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.419.025 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b' is valid.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.419.056 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.419.068 [plugin_manager.cc:1026]618646 GetVersionFromPathWithName:Invalid input file path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/version.info], make sure that the file path is correct.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.419.078 [dump.cpp:759]618666 ConvertDumpCfg: start to execute ConvertDumpCfg.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.419.079 [plugin_manager.cc:322]618646 IsVendorVersionValid:[NotVerification] Will not verify version as the opp version and compiler version are not set
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.419.092 [dump.cpp:594]618666 IsValidDumpConfig: start to execute IsValidDumpConfig.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.419.100 [plugin_manager.cc:212]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops' is valid.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.419.103 [dump.cpp:224]618666 CheckDumpSceneSwitch: start to execute CheckDumpSceneSwitch.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.419.113 [plugin_manager.cc:215]618646 GetPluginPathFromCustomOppPath:custom_path '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops' is invalid, which is skipped.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.419.121 [dump.cpp:703]618666 SetUpDumpConfig: convert to ge dump config successfully, enable lite_exception dump, path=
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.419.124 [plugin_manager.cc:218]618646 GetPluginPathFromCustomOppPath:Run GetPluginPathFromCustomOppPath finished, current plugin_path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-pack
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.419.135 [dump.cpp:771]618666 HandleDumpCommand: start to execute HandleDumpCommand.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.419.142 [plugin_manager.cc:422]618646 GetOppPluginPathNew:Enter get opp plugin path new schedule
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.419.147 [dump.cpp:703]618666 SetUpDumpConfig: convert to ge dump config successfully, enable lite_exception dump, path=
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.419.154 [plugin_manager.cc:155]618646 GetOppPluginVendors:Enter get opp plugin config file schedule, config file is '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.419.174 [plugin_manager.cc:158]618646 GetOppPluginVendors:Can not open file '/usr/local/Ascend/ascend-toolkit/latest/opp/vendors/config.ini'!
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.419.186 [plugin_manager.cc:426]618646 GetOppPluginPathNew:Can not get opp plugin vendors!
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.419.198 [adx_datadump_server.cpp:77][tid:618666] start to do dump init
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.419.215 [adx_dump_record.cpp:210][tid:618666] dumpPath prefix is /home/jenkins/mindspore/testcases/testcases/tests/st/lccl
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.419.227 [adx_dump_record.cpp:214][tid:618666] record remote dump temp path : /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.419.452 [adx_dump_record.cpp:627][tid:618839] start dump thread, remote dump record temp path : /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/.
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.419.457 [adx_server_manager.cpp:149][tid:618838] server manager add component (10)
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.419.494 [plugin_manager.cc:250]618646 GetRequiredOppAbiVersion:extract required opp abi version info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/compiler//version.info
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.419.509 [adx_server_manager.cpp:165][tid:618838] server manager components init successfully
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.419.523 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [Version=7.7.T20.0.B210], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.419.536 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [version_dir=8.1.RC1], it must include [required_opp_abi_version=].
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.419.549 [plugin_manager.cc:1063]618646 ParseVersion:Incorrect line [timestamp=20250402_001522762], it must include [required_opp_abi_version=].
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.419.581 [plugin_manager.cc:439]618646 GetOppPluginPathNew:plugin_path is '/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.419.635 [adx_server_manager.cpp:203][tid:618840] Run Server(0) Process
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.419.679 [adx_server_manager.cpp:369][tid:618840] device up 0
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.419.694 [hdc_comm_opt.cpp:59][tid:618840] open device[0] server[13]
[INFO] DRV(618666,python3.9):2025-04-03-09:27:42.419.876 [drv_log_user.c:623][ascend][curpid:618666,618840][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=0; fid=0; service_type="service_dump"; pid=618666)
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.419.884 [plugin_manager.cc:996]618646 GetCurEnvPackageOsAndCpuType:extract os and cpu info from /usr/local/Ascend/ascend-toolkit/8.1.RC1/opp/scene.info
[INFO] DRV(618666,python3.9):2025-04-03-09:27:42.419.891 [hdc_server.c:363][ascend][curpid:618666,618840][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=0)
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.419.905 [hdc_api.cpp:119][tid:618840] logDevId 0 create HDC server successfully
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.419.909 [plugin_manager.cc:1011]618646 GetCurEnvPackageOsAndCpuType:Get os:linux
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.419.927 [plugin_manager.cc:1015]618646 GetCurEnvPackageOsAndCpuType:Get cpu:aarch64
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.419.946 [adx_server_manager.cpp:111][tid:618840] create server info
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.419.959 [adx_server_manager.cpp:369][tid:618840] device up 1
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.419.970 [hdc_comm_opt.cpp:59][tid:618840] open device[1] server[13]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.419.977 [opp_so_manager.cc:123]618646 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.420.079 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.420.094 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] DRV(618666,python3.9):2025-04-03-09:27:42.420.101 [drv_log_user.c:623][ascend][curpid:618666,618840][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=1; fid=0; service_type="service_dump"; pid=618666)
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.420.107 [opp_so_manager.cc:45]618646 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] DRV(618666,python3.9):2025-04-03-09:27:42.420.113 [hdc_server.c:363][ascend][curpid:618666,618840][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=1)
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.420.126 [hdc_api.cpp:119][tid:618840] logDevId 1 create HDC server successfully
[WARNING] IDEDD(618666,python3.9):2025-04-03-09:27:42.420.136 [adx_hdc_epoll.cpp:34][tid:618840] hdc epoll has been created.
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.420.150 [adx_server_manager.cpp:111][tid:618840] create server info
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.420.178 [adx_server_manager.cpp:369][tid:618840] device up 2
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.420.189 [hdc_comm_opt.cpp:59][tid:618840] open device[2] server[13]
[INFO] DRV(618666,python3.9):2025-04-03-09:27:42.420.322 [drv_log_user.c:623][ascend][curpid:618666,618840][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=2; fid=0; service_type="service_dump"; pid=618666)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:42.420.336 [hdc_server.c:363][ascend][curpid:618666,618840][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=2)
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.420.348 [hdc_api.cpp:119][tid:618840] logDevId 2 create HDC server successfully
[WARNING] IDEDD(618666,python3.9):2025-04-03-09:27:42.420.359 [adx_hdc_epoll.cpp:34][tid:618840] hdc epoll has been created.
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.420.371 [adx_server_manager.cpp:111][tid:618840] create server info
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.420.382 [adx_server_manager.cpp:369][tid:618840] device up 3
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.420.393 [hdc_comm_opt.cpp:59][tid:618840] open device[3] server[13]
[INFO] DRV(618666,python3.9):2025-04-03-09:27:42.420.525 [drv_log_user.c:623][ascend][curpid:618666,618840][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=3; fid=0; service_type="service_dump"; pid=618666)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:42.420.538 [hdc_server.c:363][ascend][curpid:618666,618840][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=3)
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.420.549 [hdc_api.cpp:119][tid:618840] logDevId 3 create HDC server successfully
[WARNING] IDEDD(618666,python3.9):2025-04-03-09:27:42.420.560 [adx_hdc_epoll.cpp:34][tid:618840] hdc epoll has been created.
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.420.582 [adx_server_manager.cpp:111][tid:618840] create server info
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.420.593 [adx_server_manager.cpp:369][tid:618840] device up 4
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.420.603 [hdc_comm_opt.cpp:59][tid:618840] open device[4] server[13]
[INFO] DRV(618666,python3.9):2025-04-03-09:27:42.420.740 [drv_log_user.c:623][ascend][curpid:618666,618840][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=4; fid=0; service_type="service_dump"; pid=618666)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:42.420.753 [hdc_server.c:363][ascend][curpid:618666,618840][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=4)
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.420.765 [hdc_api.cpp:119][tid:618840] logDevId 4 create HDC server successfully
[WARNING] IDEDD(618666,python3.9):2025-04-03-09:27:42.420.775 [adx_hdc_epoll.cpp:34][tid:618840] hdc epoll has been created.
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.420.787 [adx_server_manager.cpp:111][tid:618840] create server info
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.420.797 [adx_server_manager.cpp:369][tid:618840] device up 5
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.420.808 [hdc_comm_opt.cpp:59][tid:618840] open device[5] server[13]
[INFO] DRV(618666,python3.9):2025-04-03-09:27:42.420.879 [drv_log_user.c:623][ascend][curpid:618666,618840][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=5; fid=0; service_type="service_dump"; pid=618666)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:42.420.891 [hdc_server.c:363][ascend][curpid:618666,618840][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=5)
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.420.903 [hdc_api.cpp:119][tid:618840] logDevId 5 create HDC server successfully
[WARNING] IDEDD(618666,python3.9):2025-04-03-09:27:42.420.914 [adx_hdc_epoll.cpp:34][tid:618840] hdc epoll has been created.
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.420.926 [adx_server_manager.cpp:111][tid:618840] create server info
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.420.935 [adx_server_manager.cpp:369][tid:618840] device up 6
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.420.945 [hdc_comm_opt.cpp:59][tid:618840] open device[6] server[13]
[INFO] DRV(618666,python3.9):2025-04-03-09:27:42.421.081 [drv_log_user.c:623][ascend][curpid:618666,618840][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=6; fid=0; service_type="service_dump"; pid=618666)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:42.421.093 [hdc_server.c:363][ascend][curpid:618666,618840][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=6)
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.421.105 [hdc_api.cpp:119][tid:618840] logDevId 6 create HDC server successfully
[WARNING] IDEDD(618666,python3.9):2025-04-03-09:27:42.421.115 [adx_hdc_epoll.cpp:34][tid:618840] hdc epoll has been created.
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.421.126 [adx_server_manager.cpp:111][tid:618840] create server info
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.421.137 [adx_server_manager.cpp:369][tid:618840] device up 7
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.421.147 [hdc_comm_opt.cpp:59][tid:618840] open device[7] server[13]
[INFO] DRV(618666,python3.9):2025-04-03-09:27:42.421.219 [drv_log_user.c:623][ascend][curpid:618666,618840][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=7; fid=0; service_type="service_dump"; pid=618666)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:42.421.231 [hdc_server.c:363][ascend][curpid:618666,618840][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=7)
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.421.243 [hdc_api.cpp:119][tid:618840] logDevId 7 create HDC server successfully
[WARNING] IDEDD(618666,python3.9):2025-04-03-09:27:42.421.255 [adx_hdc_epoll.cpp:34][tid:618840] hdc epoll has been created.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.421.232 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [][]
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.421.277 [adx_server_manager.cpp:111][tid:618840] create server info
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.421.464 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.421.626 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff142df2c0, registered count:4
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.421.662 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.421.666 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.421.682 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.421.699 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.421.714 [op_check.cc:71]618646 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.422.002 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff142e3978, registered count:4
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.422.023 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.422.014 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.422.040 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.422.056 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.422.070 [op_check.cc:71]618646 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.422.183 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.422.330 [op_impl_registry_holder_manager.cc:208]618646 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.422.346 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.422.359 [op_impl_registry_holder_manager.cc:216]618646 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.422.385 [op_impl_registry_holder_manager.cc:208]618646 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 2
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.422.421 [op_impl_registry_holder_manager.cc:208]618646 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.422.552 [adx_server_manager.cpp:457][tid:618666] The server is initialized after waiting 3 times.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.422.570 [ge_executor.cc:1349]618666 SetDump:Start to set dump config
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.422.585 [dump_manager.cc:201]618666 NeedDoDump:Dump status: on, Overflow detection dump switch: off.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.422.603 [dump_manager.cc:261]618666 SetExceptionDump:Enable brief exception dump.
[INFO] GE(618666,python3.9):2025-04-03-09:27:42.422.621 [ge_executor.cc:1355]618666 SetDump:Set dump config successfully
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.422.640 [dump_manager.cpp:146][tid:618666] Set 3 dump setting, status: on, dump switch: 3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.422.672 [op_impl_space_registry.cc:273]618646 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so] success!
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.422.719 [opp_so_manager.cc:123]618646 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.422.821 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.422.835 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.422.847 [opp_so_manager.cc:45]618646 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.423.175 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.423.345 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.423.480 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [][]
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:42.423.597 [dump_manager.cpp:301][tid:618666] Register exception callback, registered: 1
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.423.616 [dump.cpp:825]618666 HandleDumpCommand: set dump config for model successfully,adumpType = 3, dump_path = , dump_mode = , dump_op_switch = , dump_data = .
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.423.636 [acl.cpp:327]618666 aclInit: set HandleDumpConfig success in aclInit
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.423.632 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyAdamWV2] register OP_IMPL : [][]
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.423.649 [acl.cpp:329]618666 aclInit: set max_opqueue_num in aclInit
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.423.664 [acl_resource_manager.cpp:248]618666 HandleMaxOpQueueConfig: start to execute HandleMaxOpQueueConfig
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.423.741 [acl_resource_manager.cpp:275]618666 HandleMaxOpQueueConfig: no max_opqueue_num found, set default DEFAULT_MAX_OPQUEUE_NUM[20000].
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.423.757 [acl_resource_manager.cpp:278]618666 HandleMaxOpQueueConfig: HandleMaxOpQueueConfig end in HandleMaxOpQueueConfig
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.423.769 [acl.cpp:335]618666 aclInit: set HandleMaxOpQueueConfig success in aclInit
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.423.780 [acl.cpp:336]618666 aclInit: set HandleDefaultDevice in aclInit
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.423.790 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : [][]
[WARNING] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.423.831 [json_parser.cpp:260]618666 GetDefaultDeviceIdFromFile: no defaultDevice item!
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.423.847 [acl.cpp:343]618666 aclInit: set HandleDefaultDevice success in aclInit
[INFO] PROFILING(618666,python3.9):2025-04-03-09:27:42.423.864 [prof_atls_plugin.cpp:210] (tid:618666) Module[48] register callback of ctrl handle.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.423.876 [acl.cpp:351]618666 aclInit: set ProfilingConfig in aclInit
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.423.888 [profiling.cpp:141]618666 HandleProfilingConfig: start to execute HandleProfilingConfig
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.423.900 [profiling.cpp:135]618666 GetProfilingConfigFile: no profiling config file.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.423.926 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [][]
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.423.948 [profiling.cpp:167]618666 HandleProfilingConfig: can not parse profiling config from file[/home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618666.json], errorCode = 0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.423.963 [profiling.cpp:172]618666 HandleProfilingConfig: profiling config file[/home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618666.json] is empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.423.974 [profiling.cpp:176]618666 HandleProfilingConfig: start to use profiling config by config file mode
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.423.985 [profiling.cpp:179]618666 HandleProfilingConfig: ParseJsonFromFile ok in HandleProfilingConfig
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.423.996 [profiling.cpp:92]618666 HandleProfilingCommand: start to execute HandleProfilingCommand
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.424.069 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.424.209 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:AllFinite, funcPointer:(nil), registered count:4
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.424.241 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:AllFinite, funcPointer:(nil), registered count:6
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.424.259 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:AllFinite, funcPointer:(nil), registered count:3
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.424.241 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.424.276 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:AllFinite, funcPointer:(nil), registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.424.291 [op_check.cc:71]618646 RegisterParamGeneralize:RegisterParamGeneralize: op_type:AllFinite, funcPointer:(nil), registered count:3
[INFO] PROFILING(618666,python3.9):2025-04-03-09:27:42.424.292 [ai_drv_dev_api.cpp:316] >>> (tid:618666) Succeeded to get device 64 frequency=100000
[INFO] PROFILING(618666,python3.9):2025-04-03-09:27:42.424.357 [msprof_callback_impl.cpp:132] >>> (tid:618666) Dynamic profiling environment not really set, so do nothing.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.424.371 [profiling.cpp:122]618666 HandleProfilingCommand: set profiling config successfully
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.424.383 [profiling.cpp:186]618666 HandleProfilingConfig: set HandleProfilingConfig success
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.424.394 [hash_utils.cpp:108]618666 CalculateSimpleHash: Begin to calculate hash for file: /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618666.json
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.424.400 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [][]
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.424.429 [hash_utils.cpp:128]618666 CalculateSimpleHash: file: /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618666.json, hash: 3917491750093904922
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.424.443 [acl.cpp:115]618666 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.424.461 [acl.cpp:280]618666 IsEnableAutoUCMemeory: auto-uc-memory is enabled.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.424.472 [acl.cpp:385]618666 aclInit: register kernel launch fill function in aclInit
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.424.490 [runtime.cc:5394] 618666 RegKernelLaunchFillFunc: registercallback finish, symbol:g_opSystemRunCfg.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.424.503 [api_impl.cc:7407] 618666 RegStreamStateCallback: Reg stream state callback, regName=ACL_MODULE_STREAM.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.424.524 [api_impl.cc:4211] 618666 RegDeviceStateCallback: Reg device state callback, regName=ACL_MODULE_DEVICE.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.424.538 [acl.cpp:420]618666 aclInit: successfully execute aclInit, aclInitRefCount is 1
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.424.531 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.424.564 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:DecoderKvCache, funcPointer:0xffff142909b0, registered count:4
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.424.584 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DecoderKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.424.598 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.424.613 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.424.626 [op_check.cc:71]618646 RegisterParamGeneralize:RegisterParamGeneralize: op_type:DecoderKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.424.647 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : [][]
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.424.719 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:199] InitializeAcl] Call aclInit successfully, json is {"dump":{"dump_scene":"lite_exception"},"err_msg_mode":"1"}
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.424.747 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [][]
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.424.808 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:295] Initialize] End initializing device context.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.424.870 [mindspore/ccsrc/plugin/res_manager/ascend/ascend_res_manager.cc:467] LoadCollectiveCommLib] Loading MACCL collective library successfully.
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.424.891 [mindspore/ccsrc/distributed/collective/collective_manager.cc:621] InitDeviceCommLib] Start initializing communication library on device side...
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.424.900 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:PromptKvCache, funcPointer:0xffff14293da0, registered count:4
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.424.919 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:PromptKvCache, funcPointer:(nil), registered count:6
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.424.944 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.424.959 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.424.972 [op_check.cc:71]618646 RegisterParamGeneralize:RegisterParamGeneralize: op_type:PromptKvCache, funcPointer:(nil), registered count:3
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.070 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.099 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.127 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.152 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.180 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.204 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.425.218 [op_impl_registry_holder_manager.cc:208]618646 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.228 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.425.245 [op_impl_registry_holder_manager.cc:216]618646 GetOpImplFunctionsByHandle:Get op impl functions failed, path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so, errmsg:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so: undefined symbol: GetOpImplFunctionsV2
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.425.260 [op_impl_registry_holder_manager.cc:208]618646 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 3
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.253 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.278 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.425.296 [op_impl_registry_holder_manager.cc:208]618646 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.302 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.326 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.350 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.374 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.399 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.422 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.446 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.470 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.494 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.517 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.540 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.567 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.425.595 [op_impl_space_registry.cc:84]618646 MergeFunctions:op type DecoderKvCache tiling_parse func has been registered
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.601 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.425.613 [op_impl_space_registry.cc:85]618646 MergeFunctions:op type DecoderKvCache compile_info_creator func has been registered
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.425.626 [op_impl_space_registry.cc:86]618646 MergeFunctions:op type DecoderKvCache compile_info_deleter func has been registered
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.425.635 [op_impl_space_registry.cc:87]618646 MergeFunctions:op type DecoderKvCache tiling func has been registered
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.626 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.425.646 [op_impl_space_registry.cc:93]618646 MergeFunctions:op type DecoderKvCache max_tiling_data_size has been registered
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.652 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.425.663 [op_impl_space_registry.cc:84]618646 MergeFunctions:op type PromptKvCache tiling_parse func has been registered
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.425.676 [op_impl_space_registry.cc:85]618646 MergeFunctions:op type PromptKvCache compile_info_creator func has been registered
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.425.686 [op_impl_space_registry.cc:86]618646 MergeFunctions:op type PromptKvCache compile_info_deleter func has been registered
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.681 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.425.700 [op_impl_space_registry.cc:87]618646 MergeFunctions:op type PromptKvCache tiling func has been registered
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.425.711 [op_impl_space_registry.cc:93]618646 MergeFunctions:op type PromptKvCache max_tiling_data_size has been registered
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.707 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.425.723 [op_impl_space_registry.cc:273]618646 ConvertSoToRegistry:Save so symbol and handle in path[/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so] success!
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.736 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.764 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.425.768 [opp_so_manager.cc:123]618646 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.788 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.425.817 [opp_so_manager.cc:126]618646 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.812 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.834 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.425.853 [opp_so_manager.cc:123]618646 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.858 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.882 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.907 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.934 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.425.949 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.425.965 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.959 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.425.978 [opp_so_manager.cc:45]618646 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.425.984 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.426.010 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.426.033 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.426.056 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.426.080 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.426.105 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.426.127 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.426.151 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.426.175 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.426.198 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.426.230 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.426.256 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.426.279 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.426.302 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.426.325 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.426.349 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.426.371 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.426.395 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.426.421 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.426.443 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.426.554 [op_impl_space_registry.cc:240]618646 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.426.579 [opp_so_manager.cc:48]618646 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.426.602 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachACosInplace] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.426.620 [opp_so_manager.cc:123]618646 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.426.712 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.426.727 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.426.737 [opp_so_manager.cc:45]618646 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.426.759 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachAddListInplace] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.426.936 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMulScalarInplace] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.426.963 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachLogInplace] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.426.987 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSubListInplace] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.427.011 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachMulListInplace] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.427.035 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachDivListInplace] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.427.177 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachSubScalarInplace] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.427.284 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.427.358 [op_impl_space_registry.cc:240]618646 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.427.386 [opp_so_manager.cc:48]618646 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.427.397 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.427.429 [opp_so_manager.cc:123]618646 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.427.464 [opp_so_manager.cc:126]618646 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.427.503 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.427.518 [opp_so_manager.cc:123]618646 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.427.609 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.427.622 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.427.620 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.427.633 [opp_so_manager.cc:45]618646 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.427.733 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.427.889 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3dGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.428.009 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.428.078 [op_impl_space_registry.cc:240]618646 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.428.102 [opp_so_manager.cc:48]618646 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.428.141 [opp_so_manager.cc:123]618646 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.428.182 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.428.244 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.428.260 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.428.270 [opp_so_manager.cc:45]618646 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.428.311 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.428.429 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.428.457 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.428.481 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.428.592 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.428.618 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.428.643 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.428.752 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.428.838 [op_impl_space_registry.cc:240]618646 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.428.864 [opp_so_manager.cc:48]618646 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.428.905 [opp_so_manager.cc:123]618646 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.428.905 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.428.937 [opp_so_manager.cc:126]618646 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.428.970 [opp_so_manager.cc:123]618646 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.429.059 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.429.069 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.429.085 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.429.094 [opp_so_manager.cc:45]618646 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] PROFILING(618666,python3.9):2025-04-03-09:27:42.429.211 [prof_atls_plugin.cpp:210] (tid:618666) Module[0] register callback of ctrl handle.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.429.220 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.429.334 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.429.520 [op_impl_space_registry.cc:240]618646 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.429.518 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IndexPutWithSort] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.429.541 [opp_so_manager.cc:48]618646 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.429.580 [opp_so_manager.cc:123]618646 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.429.625 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.429.668 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.429.682 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.429.692 [opp_so_manager.cc:45]618646 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.429.819 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InplaceIndexAddWithSorted] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.429.927 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : [][]
[WARNING] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.429.944 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:76] Initialize] Loading LCCL because env MS_ENABLE_LCCL is set to on. Pay attention that LCCL only supports communication group within single node in KernelByKernel for now.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.429.976 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:80] Initialize] Successfully initialize LCCL.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.430.036 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [][]
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.430.048 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ascend_deprecated_interface.cc:83] OpenTsd] Device id = 5, rank size = 8.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.430.063 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [][]
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.430.070 [device.cpp:143]618666 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 5.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.430.088 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [][]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.430.096 [api_impl.cc:2999] 618666 SetDevice: device_id=5, deviceMode=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.430.121 [device.cc:306] 618666 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.430.136 [runtime.cc:3393] 618666 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.430.151 [runtime.cc:3560] 618666 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.430.165 [api_impl.cc:2987] 618666 NewDevice: SetCurRef = 0xaaaaf6e2dcc0,userDeviceId=5,deviceId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.430.177 [runtime.cc:5239] 618666 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.430.193 [api_impl.cc:2992] 618666 NewDevice: New device success, user_device_id=5, die_num=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.430.211 [api_impl.cc:3025] 618666 SetDevice: SetDevice success, curCtx=0xaaaaf6e2dcc0, user_device_id=5.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.430.225 [acl.cpp:115]618666 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.430.236 [acl.cpp:121]618666 GetSocVersion: socVersion is Ascend910B3
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.430.229 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [][]
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.430.259 [device.cpp:154]618666 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 5
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.430.255 [op_impl_space_registry.cc:240]618646 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.430.274 [opp_so_manager.cc:48]618646 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.430.293 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel _npu_log begins the construction process witch capacity 128
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.430.312 [opp_so_manager.cc:123]618646 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.430.309 [tensor_data_transfer.cpp:898]618666 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 5, name is _npu_log, capacity is 128
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.430.327 [api_impl.cc:6077] 618666 MemQueueInit: Start to init queue on devId 5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.430.340 [npu_driver.cc:4076] 618666 MemQueueInit: init mem queue, device_id=5.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.430.344 [opp_so_manager.cc:126]618646 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.430.353 [npu_driver.cc:4026] 618666 CheckMemQueueSupported: get majorVersion 7
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.430.376 [opp_so_manager.cc:123]618646 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] DRV(618666,python3.9):2025-04-03-09:27:42.430.386 [queue_client.c:151][ascend][curpid:618666,618666][drv][queuemng][QueueGetHostpid]Query tgid. (tgid=618666)
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.430.397 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.430.462 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.430.484 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.430.496 [opp_so_manager.cc:45]618646 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.430.552 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [][]
[INFO] DRV(618666,python3.9):2025-04-03-09:27:42.430.562 [queue_client.c:305][ascend][curpid:618666,618666][drv][queuemng][QueueGetDevPid]Query devpid succ. (devId=5; vfid=0; hostpid=618666; master_pid=618666; proc_type=0; devpid=30062).
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.430.696 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.430.872 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.430.933 [op_impl_space_registry.cc:240]618646 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.430.952 [opp_so_manager.cc:48]618646 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.430.991 [opp_so_manager.cc:123]618646 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.431.018 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.431.078 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.431.091 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.431.102 [opp_so_manager.cc:45]618646 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.431.150 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.431.308 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.431.464 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.431.645 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.431.654 [op_impl_space_registry.cc:240]618646 ConvertSoToRegistry:So already loaded! so path:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.431.676 [opp_so_manager.cc:48]618646 LoadSoAndInitDefault:Save so failed, path is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libcust_opmaster_rt2.0.so
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.431.715 [opp_so_manager.cc:123]618646 LoadOpMasterSo:Get path with op_master path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.431.748 [opp_so_manager.cc:126]618646 LoadOpMasterSo:Get path with op_tiling path [/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.431.779 [opp_so_manager.cc:123]618646 LoadOpMasterSo:Get path with op_master path [/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.431.782 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [][]
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.431.802 [opp_so_manager.cc:126]618646 LoadOpMasterSo:Get path with op_tiling path [/usr/local/Ascend/ascend-toolkit/latest/opp/op_impl/custom/ai_core/tbe/op_tiling/lib/linux/aarch64/] failed, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.431.830 [opp_so_manager.cc:123]618646 LoadOpMasterSo:Get path with op_master path [/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_master/lib/linux/aarch64/] failed, reason:No such file or directory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.431.891 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.431.917 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_ct.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.431.931 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 1 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.431.973 [plugin_manager.cc:1126]618646 GetFileListWithSuffix:PluginManager Parse full name = /usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.431.986 [plugin_manager.cc:1130]618646 GetFileListWithSuffix:Found 2 libs.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.431.997 [opp_so_manager.cc:45]618646 LoadSoAndInitDefault:Start to LoadSoAndInitDefault, opp version:0
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.432.000 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.432.119 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.432.251 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.432.408 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.432.559 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.432.669 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Resize] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.432.775 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.432.879 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.433.004 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.433.116 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.433.547 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.433.976 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.434.106 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.434.217 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.434.244 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.434.360 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.434.472 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : [][]
[INFO] DRV(618666,python3.9):2025-04-03-09:27:42.434.537 [queue_client.c:362][ascend][curpid:618666,618666][drv][queuemng][QueueInit]QueueInit device. (devid=5; mcast_flag=0; mcast_gid=0; proc_sn=0; event_sn_offset=0)
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.434.582 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.434.696 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : [][]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.434.808 [npu_driver.cc:4114] 618666 MemQueueInit: get max queue cnt 4294967294 success.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.434.828 [api_impl.cc:6040] 618666 MemQueueCreate: Start to create queue on devId 5.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.434.825 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [][]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.434.844 [npu_driver.cc:3931] 618666 MemQueueCreate: create mem queue, deviceId=5, name=_npu_log.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.434.938 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.435.052 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : [][]
[INFO] DRV(618666,python3.9):2025-04-03-09:27:42.435.078 [queue_interface.c:182][ascend][curpid:618666,618666][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=0, actualQid=0, deploy_type=0)
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.435.095 [tensor_data_transfer.cpp:940]618666 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 5, name is _npu_log, real name is _npu_log, qid is 0
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.435.166 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : [][]
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.435.242 [tensor_data_transfer.cpp:1054]618841 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is _npu_log
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.435.274 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_tensor_dump begins the construction process witch capacity 128
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.435.289 [tensor_data_transfer.cpp:1056]618841 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.435.299 [tensor_data_transfer.cpp:898]618666 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 5, name is ms_tensor_dump, capacity is 128
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.435.309 [api_impl.cc:6121] 618841 MemQueuePeek: Start to peek queue on devId 5, qid is 0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.435.320 [api_impl.cc:6077] 618666 MemQueueInit: Start to init queue on devId 5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.435.322 [npu_driver.cc:4330] 618841 MemQueuePeek: peek mem queue, deviceId=5, qid=0, timeout=800.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.435.333 [npu_driver.cc:4076] 618666 MemQueueInit: init mem queue, device_id=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.435.343 [npu_driver.cc:4026] 618666 CheckMemQueueSupported: get majorVersion 7
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.435.321 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [][]
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:42.435.395 [npu_driver.cc:4087] 618666 MemQueueInit: repeated init
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.435.409 [api_impl.cc:6040] 618666 MemQueueCreate: Start to create queue on devId 5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.435.421 [npu_driver.cc:3931] 618666 MemQueueCreate: create mem queue, deviceId=5, name=ms_tensor_dump.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.435.435 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.435.548 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [][]
[INFO] DRV(618666,python3.9):2025-04-03-09:27:42.435.620 [queue_interface.c:182][ascend][curpid:618666,618666][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=1, actualQid=1, deploy_type=0)
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.435.637 [tensor_data_transfer.cpp:940]618666 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 5, name is ms_tensor_dump, real name is ms_tensor_dump, qid is 1
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.435.730 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [][]
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.435.754 [tensor_data_transfer.cpp:1054]618843 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_tensor_dump
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.435.791 [tensor_data_transfer.cpp:1056]618843 acltdtReceiveTensor: new process, use queue process
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.435.794 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_tensor_summary begins the construction process witch capacity 128
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.435.813 [api_impl.cc:6121] 618843 MemQueuePeek: Start to peek queue on devId 5, qid is 1.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.435.815 [tensor_data_transfer.cpp:898]618666 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 5, name is ms_tensor_summary, capacity is 128
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.435.827 [npu_driver.cc:4330] 618843 MemQueuePeek: peek mem queue, deviceId=5, qid=1, timeout=800.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.435.833 [api_impl.cc:6077] 618666 MemQueueInit: Start to init queue on devId 5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.435.843 [npu_driver.cc:4076] 618666 MemQueueInit: init mem queue, device_id=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.435.855 [npu_driver.cc:4026] 618666 CheckMemQueueSupported: get majorVersion 7
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.435.846 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [][]
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:42.435.893 [npu_driver.cc:4087] 618666 MemQueueInit: repeated init
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.435.906 [api_impl.cc:6040] 618666 MemQueueCreate: Start to create queue on devId 5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.435.918 [npu_driver.cc:3931] 618666 MemQueueCreate: create mem queue, deviceId=5, name=ms_tensor_summary.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.435.971 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.436.080 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [][]
[INFO] DRV(618666,python3.9):2025-04-03-09:27:42.436.101 [queue_interface.c:182][ascend][curpid:618666,618666][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=2, actualQid=2, deploy_type=0)
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.436.129 [tensor_data_transfer.cpp:940]618666 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 5, name is ms_tensor_summary, real name is ms_tensor_summary, qid is 2
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.436.278 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [][]
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.436.339 [tensor_data_transfer.cpp:1054]618845 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_tensor_summary
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.436.363 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_image_summary begins the construction process witch capacity 128
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.436.377 [tensor_data_transfer.cpp:1056]618845 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.436.386 [tensor_data_transfer.cpp:898]618666 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 5, name is ms_image_summary, capacity is 128
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.436.397 [api_impl.cc:6121] 618845 MemQueuePeek: Start to peek queue on devId 5, qid is 2.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.436.407 [api_impl.cc:6077] 618666 MemQueueInit: Start to init queue on devId 5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.436.409 [npu_driver.cc:4330] 618845 MemQueuePeek: peek mem queue, deviceId=5, qid=2, timeout=800.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.436.420 [npu_driver.cc:4076] 618666 MemQueueInit: init mem queue, device_id=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.436.429 [npu_driver.cc:4026] 618666 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:42.436.463 [npu_driver.cc:4087] 618666 MemQueueInit: repeated init
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.436.456 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [][]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.436.478 [api_impl.cc:6040] 618666 MemQueueCreate: Start to create queue on devId 5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.436.490 [npu_driver.cc:3931] 618666 MemQueueCreate: create mem queue, deviceId=5, name=ms_image_summary.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.436.571 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RoiPoolingGradWithArgMax] register OP_IMPL : [][]
[INFO] DRV(618666,python3.9):2025-04-03-09:27:42.436.644 [queue_interface.c:182][ascend][curpid:618666,618666][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=3, actualQid=3, deploy_type=0)
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.436.660 [tensor_data_transfer.cpp:940]618666 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 5, name is ms_image_summary, real name is ms_image_summary, qid is 3
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.436.680 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [][]
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.436.760 [tensor_data_transfer.cpp:1054]618847 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_image_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.436.788 [tensor_data_transfer.cpp:1056]618847 acltdtReceiveTensor: new process, use queue process
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.436.793 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_scalar_summary begins the construction process witch capacity 128
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.436.793 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [][]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.436.806 [api_impl.cc:6121] 618847 MemQueuePeek: Start to peek queue on devId 5, qid is 3.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.436.810 [tensor_data_transfer.cpp:898]618666 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 5, name is ms_scalar_summary, capacity is 128
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.436.821 [npu_driver.cc:4330] 618847 MemQueuePeek: peek mem queue, deviceId=5, qid=3, timeout=800.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.436.829 [api_impl.cc:6077] 618666 MemQueueInit: Start to init queue on devId 5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.436.839 [npu_driver.cc:4076] 618666 MemQueueInit: init mem queue, device_id=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.436.862 [npu_driver.cc:4026] 618666 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:42.436.897 [npu_driver.cc:4087] 618666 MemQueueInit: repeated init
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.436.909 [api_impl.cc:6040] 618666 MemQueueCreate: Start to create queue on devId 5.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.436.908 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [][]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.436.921 [npu_driver.cc:3931] 618666 MemQueueCreate: create mem queue, deviceId=5, name=ms_scalar_summary.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.437.020 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : [][]
[INFO] DRV(618666,python3.9):2025-04-03-09:27:42.437.069 [queue_interface.c:182][ascend][curpid:618666,618666][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=4, actualQid=4, deploy_type=0)
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.437.085 [tensor_data_transfer.cpp:940]618666 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 5, name is ms_scalar_summary, real name is ms_scalar_summary, qid is 4
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.437.134 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : [][]
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.437.188 [tensor_data_transfer.cpp:1054]618849 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_scalar_summary
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.437.208 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_histogram_summary begins the construction process witch capacity 128
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.437.226 [tensor_data_transfer.cpp:1056]618849 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.437.235 [tensor_data_transfer.cpp:898]618666 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 5, name is ms_histogram_summary, capacity is 128
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.437.246 [api_impl.cc:6121] 618849 MemQueuePeek: Start to peek queue on devId 5, qid is 4.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.437.253 [api_impl.cc:6077] 618666 MemQueueInit: Start to init queue on devId 5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.437.258 [npu_driver.cc:4330] 618849 MemQueuePeek: peek mem queue, deviceId=5, qid=4, timeout=800.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.437.244 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : [][]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.437.266 [npu_driver.cc:4076] 618666 MemQueueInit: init mem queue, device_id=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.437.275 [npu_driver.cc:4026] 618666 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:42.437.307 [npu_driver.cc:4087] 618666 MemQueueInit: repeated init
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.437.319 [api_impl.cc:6040] 618666 MemQueueCreate: Start to create queue on devId 5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.437.330 [npu_driver.cc:3931] 618666 MemQueueCreate: create mem queue, deviceId=5, name=ms_histogram_summary.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.437.402 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StackBallQuery] register OP_IMPL : [][]
[INFO] DRV(618666,python3.9):2025-04-03-09:27:42.437.481 [queue_interface.c:182][ascend][curpid:618666,618666][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=5, actualQid=5, deploy_type=0)
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.437.498 [tensor_data_transfer.cpp:940]618666 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 5, name is ms_histogram_summary, real name is ms_histogram_summary, qid is 5
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.437.512 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [][]
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.437.670 [tensor_data_transfer.cpp:1054]618851 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_histogram_summary
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.437.676 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [][]
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.437.698 [tensor_data_transfer.cpp:1056]618851 acltdtReceiveTensor: new process, use queue process
[INFO] HCCL_ADPT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.437.713 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:273] InitHccl] Start init hccl adapter.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.437.721 [api_impl.cc:6121] 618851 MemQueuePeek: Start to peek queue on devId 5, qid is 5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.437.742 [npu_driver.cc:4330] 618851 MemQueuePeek: peek mem queue, deviceId=5, qid=5, timeout=800.
[INFO] HCCL_ADPT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.437.895 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:569] InitKernelInfoStore] Start init hccl kernel info store.
[INFO] HCCL_ADPT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.437.923 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:586] InitKernelInfoStore] Get builder ops_kernel_info_hccl
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.437.919 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScoreGrad] register OP_IMPL : [][]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:42.437.941 [plugin_manager.cc:25] [618666]hcom ops plugin init start.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:42.437.993 [plugin_manager.cc:38] [618666]input BUILD_MODE is not set, result autoTune is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:42.438.012 [plugin_manager.cc:42] [618666]hcom running normal mode.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:42.438.063 [hcom_plugin.cc:50] [618666]Initialize start.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:42.438.075 [hcom_plugin.cc:52] [618666]initializeCount_ : 1
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:42.438.129 [hcom_plugin.cc:60] [618666]hvdOpsKernelInfoStoreInfoPtr_ is initialized
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:42.438.163 [hcom_plugin.cc:63] [618666]hvdGraphOptimizerPtr_ is initialized
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:42.438.176 [hcom_plugin.cc:329] [618666]ParserHcclAlgoDesc: there is no key named "HCCL_algorithm" in the options.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:42.438.191 [hcom_plugin.cc:281] [618666]ParserHcclExecTimeOut: there is no key named "HCCL_execTimeOut" in the options.
[WARNING] HCCL(618666,python3.9):2025-04-03-09:27:42.438.211 [hcom_plugin.cc:217] [618666]option profiling mode is not found.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:42.438.229 [hcom_plugin.cc:164] [618666][masterInfo]get Master Info:ip or port or deviceId not set.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:42.438.243 [hcom_plugin.cc:180] [618666][masterInfo]get Rank Info: worker size not set.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:42.438.255 [hcom_plugin.cc:244] [618666]InitializePlugin: Init without ranktable and masterInfo, please check your mode.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.438.345 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [][]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:42.438.435 [hcom_plugin.cc:82] [618666]hccl ops plugin init success.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:42.438.451 [plugin_manager.cc:48] [618666]hcom ops plugin init end. ret[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:42.438.464 [hcom_plugin.cc:126] [618666]get hccl kernel info store start.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:42.438.493 [hcom_plugin.cc:132] [618666]get hccl kernel info store finished.
[INFO] HCCL_ADPT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.438.519 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:608] InitKernelInfoStore] Init hccl kernel info store success.
[INFO] HCCL_ADPT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.438.540 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:786] InitHcclExec] Start init hccl exec.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.438.533 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [][]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:42.438.551 [hcom_executor.cc:29] [618666]Hcom Excutor Initialize start.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.438.623 [runtime.cc:5239] 618666 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:42.438.639 [adapter_rts.cc:234] [618666][hrtGetDevice]deviceLogicId[5]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.438.686 [api_c_soc.cc:70] 618666 rtGetSocVersion: soc version is Ascend910B3
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.438.707 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [][]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:42.438.735 [hcom_common.cc:85] [618666][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[5] 
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:42.438.751 [hcom_common.cc:88] [618666][HcomGetCurHcomCtx] is no Used deviceLogicId[5] 
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:42.438.765 [hcom.cc:486] [618666]Get Hcom Init Status: [0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:42.438.785 [hcom_common.cc:85] [618666][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[5] 
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:42.438.797 [hcom_rpc.cc:1019] [618666]Get Hcom Init Status: [0]
[WARNING] HCCL(618666,python3.9):2025-04-03-09:27:42.438.822 [hcom_base_funs.cc:36] [618666][HcomOpsKernelInfoStore][InitHcom]OPTION_EXEC_RANK_TABLE is not found.
[WARNING] HCCL(618666,python3.9):2025-04-03-09:27:42.438.840 [hcom_executor.cc:121] [618666][HcomOpsKernelInfoStore][InitHcom]OPTION_EXEC_HCOM_GROUPLIST is not found.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.438.919 [api_impl.cc:1120] 618666 StreamCreate: priority=0, flags=1536.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.438.924 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [][]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.438.942 [npu_driver.cc:404] 618666 StreamIdAlloc: stream id alloc begin, device_id=5, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.439.016 [stream.cc:2246] 618666 AllocExecutedTimesSvm: stream_id=4.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.439.067 [stream_sqcq_manage.cc:147] 618666 Alloc: deviceId=5, tsId=0, drvFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.439.081 [npu_driver.cc:882] 618666 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.439.127 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.439.343 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.439.370 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.439.393 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.439.415 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.439.441 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.439.466 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [][]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.439.480 [npu_driver.cc:6125] 618666 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.439.491 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.439.516 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [][]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.439.534 [npu_driver.cc:6137] 618666 LogicCqAllocateV2: success: deviceId=5, tsId=0, cqId=361, streamId=4, logicCq=361, cqeDepth=4096
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.439.559 [npu_driver.cc:6189] 618666 StreamBindLogicCq: success: deviceId=5, tsId=0, streamId=4, logicCq=361.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.439.576 [npu_driver.cc:5916] 618666 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=e05dc000, addr=dfffe05dc000size=4096
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.439.590 [stream.cc:653] 618666 Setup: Success to get sq=4 sq reg virtual addr length=4096.
[INFO] DRV(618666,python3.9):2025-04-03-09:27:42.439.648 [devmm_svm.c:1972][ascend][curpid:618666,618666][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.439.665 [npu_driver.cc:6080] 618666 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.439.991 [stream.cc:291] 618666 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=4, flags_=0x600.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.440.279 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : [][][]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.440.603 [stream.cc:688] 618666 Setup: stream setup end, stream_id=4, IsTaskSink=0, sqId=4, cqId=4, deviceId=5, streamResId=65535
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.440.623 [acl_resource_manager.cpp:814]618666 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.440.635 [acl_resource_manager.cpp:816]618666 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.440.647 [api_impl.cc:1162] 618666 StreamCreate: Succ, flags=1536, stream_id=4, context=aaaaf6e2dcc0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:42.440.675 [stream.cc:73] [618666]Construct stream by stream type success, ptr[0xaaab02237a80] ctx[0xaaaaf6e2dcc0], stream id[4], cqId[4], logicCqid[361]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.440.682 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : [][][]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.440.739 [api_impl.cc:1120] 618666 StreamCreate: priority=0, flags=1536.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.440.758 [npu_driver.cc:404] 618666 StreamIdAlloc: stream id alloc begin, device_id=5, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.440.787 [stream.cc:2246] 618666 AllocExecutedTimesSvm: stream_id=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.440.820 [stream_sqcq_manage.cc:147] 618666 Alloc: deviceId=5, tsId=0, drvFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.440.840 [npu_driver.cc:882] 618666 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.441.103 [npu_driver.cc:6125] 618666 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.441.095 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : [][][]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.441.152 [npu_driver.cc:6137] 618666 LogicCqAllocateV2: success: deviceId=5, tsId=0, cqId=362, streamId=5, logicCq=362, cqeDepth=4096
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.441.170 [npu_driver.cc:6189] 618666 StreamBindLogicCq: success: deviceId=5, tsId=0, streamId=5, logicCq=362.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.441.185 [npu_driver.cc:5916] 618666 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=e05bb000, addr=dfffe05bb000size=4096
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.441.197 [stream.cc:653] 618666 Setup: Success to get sq=5 sq reg virtual addr length=4096.
[INFO] DRV(618666,python3.9):2025-04-03-09:27:42.441.242 [devmm_svm.c:1972][ascend][curpid:618666,618666][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.441.257 [npu_driver.cc:6080] 618666 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.441.287 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.441.482 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [][]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.441.556 [stream.cc:291] 618666 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=5, flags_=0x600.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.441.869 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.441.989 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.442.166 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [][]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.179 [stream.cc:688] 618666 Setup: stream setup end, stream_id=5, IsTaskSink=0, sqId=5, cqId=5, deviceId=5, streamResId=65535
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.442.199 [acl_resource_manager.cpp:814]618666 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.442.211 [acl_resource_manager.cpp:816]618666 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.224 [api_impl.cc:1162] 618666 StreamCreate: Succ, flags=1536, stream_id=5, context=aaaaf6e2dcc0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:42.442.243 [stream.cc:73] [618666]Construct stream by stream type success, ptr[0xaaab022b3ae0] ctx[0xaaaaf6e2dcc0], stream id[5], cqId[5], logicCqid[362]
[WARNING] HCCL(618666,python3.9):2025-04-03-09:27:42.442.406 [sal.cc:619] [618853]err[34] link[Hccl_MessageProcess] nameSet failed.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:42.442.436 [hcom_executor.cc:587] [618853]MessageProcessThreadLoop start queType:[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.459 [api_impl.cc:2999] 618853 SetDevice: device_id=5, deviceMode=0.
[WARNING] HCCL(618666,python3.9):2025-04-03-09:27:42.442.459 [sal.cc:619] [618854]err[34] link[Hccl_MessageProcess] nameSet failed.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.473 [device.cc:306] 618853 Init: device mode has been already set, mode=0.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:42.442.489 [hcom_executor.cc:587] [618854]MessageProcessThreadLoop start queType:[1]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.492 [runtime.cc:3393] 618853 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x3
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.499 [api_impl.cc:2999] 618855 SetDevice: device_id=5, deviceMode=0.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:42.442.506 [hcom_executor.cc:34] [618666][Initialize][HcomExecutor]Hcom Excutor Initialize end. ret[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.510 [runtime.cc:3560] 618853 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.513 [api_impl.cc:2999] 618854 SetDevice: device_id=5, deviceMode=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.527 [device.cc:306] 618855 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.539 [api_impl.cc:2987] 618853 NewDevice: SetCurRef = 0xaaaaf6e2dcc0,userDeviceId=5,deviceId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.550 [runtime.cc:3393] 618855 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x4
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.561 [runtime.cc:5239] 618853 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.560 [api_impl.cc:2999] 618856 SetDevice: device_id=5, deviceMode=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.566 [runtime.cc:3560] 618855 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=5
[INFO] HCCL_ADPT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.442.566 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:792] InitHcclExec] Hcom DynamicKernel Initialize success
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.579 [api_impl.cc:2992] 618853 NewDevice: New device success, user_device_id=5, die_num=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.581 [device.cc:306] 618856 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.583 [api_impl.cc:2987] 618855 NewDevice: SetCurRef = 0xaaaaf6e2dcc0,userDeviceId=5,deviceId=5
[INFO] HCCL_ADPT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.442.595 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:798] InitHcclExec] InitHcclExec success
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.594 [runtime.cc:3393] 618856 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.596 [runtime.cc:5239] 618855 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:42.442.603 [awatchdog_core.c:175](tid:618853) create watchdog for id : 65543, tid : 618853, timeout : 300s
[INFO] HCCL_ADPT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.442.608 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:291] InitHccl] Init hccl adapter success.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.607 [runtime.cc:3560] 618856 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.614 [api_impl.cc:2992] 618855 NewDevice: New device success, user_device_id=5, die_num=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.616 [api_impl.cc:3025] 618853 SetDevice: SetDevice success, curCtx=0xaaaaf6e2dcc0, user_device_id=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.622 [api_impl.cc:2987] 618856 NewDevice: SetCurRef = 0xaaaaf6e2dcc0,userDeviceId=5,deviceId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.625 [device.cc:306] 618854 Init: device mode has been already set, mode=0.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.442.631 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:92] Initialize] Successfully initialize HCCL.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:42.442.631 [awatchdog_core.c:175](tid:618855) create watchdog for id : 65543, tid : 618855, timeout : 300s
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.633 [runtime.cc:5239] 618856 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.638 [runtime.cc:3393] 618854 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x6
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.645 [api_impl.cc:3025] 618855 SetDevice: SetDevice success, curCtx=0xaaaaf6e2dcc0, user_device_id=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.650 [api_impl.cc:2992] 618856 NewDevice: New device success, user_device_id=5, die_num=1.
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.442.654 [mindspore/ccsrc/distributed/collective/collective_manager.cc:628] InitDeviceCommLib] Communication library on device side is successfully initialized.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.652 [runtime.cc:3560] 618854 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=5
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:42.442.663 [awatchdog_core.c:175](tid:618856) create watchdog for id : 65543, tid : 618856, timeout : 300s
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.678 [api_impl.cc:2987] 618854 NewDevice: SetCurRef = 0xaaaaf6e2dcc0,userDeviceId=5,deviceId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.681 [api_impl.cc:3025] 618856 SetDevice: SetDevice success, curCtx=0xaaaaf6e2dcc0, user_device_id=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.692 [runtime.cc:5239] 618854 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.442.700 [mindspore/ccsrc/distributed/collective/collective_manager.cc:211] Initialize] [PROF]InitDeviceBackend costs 1123.92 msec.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.709 [api_impl.cc:2992] 618854 NewDevice: New device success, user_device_id=5, die_num=1.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:42.442.724 [awatchdog_core.c:175](tid:618854) create watchdog for id : 65543, tid : 618854, timeout : 300s
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.442.728 [mindspore/ccsrc/distributed/collective/collective_manager.cc:860] IsAsyncInitGlobalComm] Async initialize global comm: 0. async_conf: 1, is_graph: 0, use_rank_table: 0, simulation: 0, use_mpi: 0, is_ascend: 1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.442.738 [api_impl.cc:3025] 618854 SetDevice: SetDevice success, curCtx=0xaaaaf6e2dcc0, user_device_id=5.
[WARNING] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.442.749 [mindspore/ccsrc/distributed/collective/collective_manager.cc:335] CreateCommunicationGroup] Start to create communication group: hccl_world_group [const vector]{0, 1, 2, 3, 4, 5, 6, 7}, async: 0, submit_now: 1
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.442.791 [mindspore/ccsrc/distributed/collective/collective_manager.cc:367] CreateCommunicationGroup] [PROF]CreateCommunicationGroupOnHostSide costs 0.01 msec.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.442.838 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:148] CreateCommunicationGroup] Successfully create LCCL communication group hccl_world_group
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.442.872 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:166] CreateCommunicationGroup] Successfully create HCCL communication group hccl_world_group
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.442.892 [mindspore/ccsrc/distributed/collective/collective_manager.cc:374] CreateCommunicationGroup] [PROF]CreateCommunicationGroupOnDeviceSide costs 0.08 msec.
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.442.974 [mindspore/ccsrc/distributed/collective/collective_manager.cc:919] SubmitCreateDeviceCommTask] Launch init comm thread.
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:42.442.996 [mindspore/ccsrc/distributed/collective/collective_manager.cc:925] SubmitCreateDeviceCommTask] Submit init communicator task for hccl_world_group. Call 'WaitCommInitDone' later to wait initialization to be done.
[INFO] DISTRIBUTED(618666,fffeb17aefa0,python3.9):2025-04-03-09:27:42.443.074 [mindspore/ccsrc/distributed/collective/collective_manager.cc:973] RunInitCommTasks] Create device communicator in thread for group: hccl_world_group
[INFO] DISTRIBUTED(618666,fffeb17aefa0,python3.9):2025-04-03-09:27:42.443.106 [mindspore/ccsrc/distributed/collective/collective_manager.cc:764] CreateDeviceCommunicator] Create device communicator for hccl_world_group
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.443.149 [device.cpp:143]618857 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.443.184 [api_impl.cc:2999] 618857 SetDevice: device_id=5, deviceMode=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.443.199 [device.cc:306] 618857 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.443.213 [runtime.cc:3393] 618857 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x7
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.443.227 [runtime.cc:3560] 618857 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.443.240 [api_impl.cc:2987] 618857 NewDevice: SetCurRef = 0xaaaaf6e2dcc0,userDeviceId=5,deviceId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.443.252 [runtime.cc:5239] 618857 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.443.267 [api_impl.cc:2992] 618857 NewDevice: New device success, user_device_id=5, die_num=1.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:42.443.286 [awatchdog_core.c:175](tid:618857) create watchdog for id : 65543, tid : 618857, timeout : 300s
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.443.299 [api_impl.cc:3025] 618857 SetDevice: SetDevice success, curCtx=0xaaaaf6e2dcc0, user_device_id=5.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.443.312 [acl.cpp:115]618857 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.443.327 [acl.cpp:121]618857 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.443.341 [device.cpp:154]618857 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 5
[INFO] DISTRIBUTED(618666,fffeb17aefa0,python3.9):2025-04-03-09:27:42.443.377 [mindspore/ccsrc/distributed/collective/collective_manager.cc:787] CreateDeviceCommunicator] [PROF]GenerateRootInfo costs 0.216 msec.
[WARNING] DEVICE(618666,fffeb17aefa0,python3.9):2025-04-03-09:27:42.443.784 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:248] QueryUniqueID] Retry to lookup the unique id for group hccl_world_group from the meta server node...Retry time: 399/400, sleep 1
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.444.678 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.445.275 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.446.017 [op_impl_registry_holder_manager.cc:208]618646 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 1
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.446.063 [op_impl_registry_holder_manager.cc:208]618646 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 1
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.446.088 [op_impl_registry_holder_manager.cc:208]618646 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 11
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.446.475 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.446.610 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.446.719 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.446.828 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.447.109 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CircularPad] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.447.263 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[CircularPadGrad] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.447.441 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.447.770 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.447.797 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.447.822 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.447.842 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.447.861 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.448.031 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleLinear1d] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.448.054 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleBilinear2d] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.448.215 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleBicubic2d] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.448.250 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [][][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.448.365 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.448.379 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAA] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.448.545 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAAGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.448.554 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.448.636 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.448.694 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.448.718 [op_impl_space_registry.cc:273]618646 ConvertSoToRegistry:Save so symbol and handle in path[/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_ct.so] success!
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.448.792 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.448.882 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.448.908 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3dGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.448.944 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.449.058 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAA] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.449.216 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAABackward] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.449.381 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.449.546 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ResizeUpsampleTrilinear] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.449.628 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.449.700 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dBackward] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.449.714 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.449.848 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.449.873 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3d] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.449.994 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.450.020 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleNearest] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.450.080 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MlaAttentionScore] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.450.196 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleNearestExact2dGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.450.229 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[UpsampleNearest2dGrad] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.450.239 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.450.337 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.450.451 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.450.477 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.450.480 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.450.594 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.450.620 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.450.661 [op_impl_registry.cc:122]618670 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.450.731 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.450.840 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.450.960 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.451.073 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.451.179 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.451.281 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.451.393 [op_impl_registry_holder_manager.cc:208]618670 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 599
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.451.467 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.451.664 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.452.029 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.452.410 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.452.610 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.452.931 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.453.123 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.453.304 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ReflectionPad3dGrad] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.453.416 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.453.529 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.453.681 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.453.707 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.453.729 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.453.763 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantConv2D] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.454.820 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3d] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.455.254 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.455.408 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.455.560 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.455.707 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.455.734 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.455.878 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.456.021 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.456.187 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.456.214 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.456.365 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.456.512 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.456.651 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.456.702 [op_impl_registry_holder_manager.cc:208]618670 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 599
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.456.798 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.456.945 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AGLU] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.457.337 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.457.670 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.457.895 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.458.080 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.458.629 [op_impl_registry_holder_manager.cc:208]618670 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.459.125 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.459.518 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.460.067 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NLLLossGrad310p] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.460.238 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.460.385 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.460.503 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DropoutWithMulsAndSoftmaxGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.460.659 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.460.807 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.460.832 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.460.932 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.460.956 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.461.270 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.461.377 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.461.520 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ForeachBinaryOp] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.461.670 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.461.786 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.462.082 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.462.257 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.462.618 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.462.726 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.462.832 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.462.983 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InstanceNormV3] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.463.165 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IouV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.463.331 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BidirectionLSTM] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.463.356 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BidirectionLSTMV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.463.504 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.463.529 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.463.686 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaskedSelectV3] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.463.856 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.465.311 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [][]
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:42.468.187 [trs_cb_event.c:119][ascend][curpid:618646,618836][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =64; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:42.468.229 [trs_sqcq.c:1491][ascend][curpid:618646,618836][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:42.468.228 [trs_cb_event.c:119][ascend][curpid:618646,618837][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =65; ret=16)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:42.468.245 [npu_driver.cc:3833] 618836 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=64, drvRetCode=16.
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:42.468.255 [trs_sqcq.c:1491][ascend][curpid:618646,618837][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:42.468.276 [npu_driver.cc:3833] 618837 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:42.468.280 [api_impl.cc:5058] 618836 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:42.468.295 [api_impl.cc:5058] 618837 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.468.335 [callback.cpp:132]618836 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.468.348 [callback.cpp:132]618837 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.468.377 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.468.377 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.468.405 [npu_driver.cc:3828] 618837 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=65.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.468.407 [npu_driver.cc:3828] 618836 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=64.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.470.906 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.470.946 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.473.452 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.473.702 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.473.983 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MedianDim] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.474.295 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.474.496 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.474.695 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.474.850 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.475.005 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeTutelCombineGates] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.475.188 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeTutelCombineX] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.475.324 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeTutelDispatch] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.475.406 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.475.636 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScore] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.475.758 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.475.911 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.476.423 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Rfft1D] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.476.572 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.476.723 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.476.749 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GemmaRmsNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.476.857 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.476.963 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.477.150 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LinearIndex] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.477.330 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[LinearIndexV2] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.477.509 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScatterAddWithSorted] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.477.672 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[Sinkhorn] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.477.779 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.477.885 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.477.906 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.478.090 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.478.275 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StackGroupPoints] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.478.424 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.478.529 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.478.673 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.478.695 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.478.813 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.478.921 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.478.943 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.478.963 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.479.102 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.479.277 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.479.362 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.479.596 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.479.771 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.479.796 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.479.822 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.479.998 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.480.023 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.482.703 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: Conv2DBackpropFilter, registered count: 15
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.482.792 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: Conv2DBackpropInput, registered count: 15
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.482.816 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: Conv2DTranspose, registered count: 15
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.482.891 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: Conv2D, registered count: 15
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.482.963 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: Conv3DBackpropInput, registered count: 15
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.482.983 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: Conv3DTranspose, registered count: 15
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.483.055 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: Conv3D, registered count: 15
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.483.218 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: FFN, registered count: 15
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.483.236 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: MatmulTunnerTiling, registered count: 15
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.483.336 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: MatMulV2, registered count: 15
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.483.354 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: BatchMatmulFixpipe, registered count: 15
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.483.370 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: MatMulV3, registered count: 15
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.483.385 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: QuantBatchMatmulV3, registered count: 15
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.483.550 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: DynamicRNN, registered count: 15
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.483.568 [tuning_tiling_registry.cc:30]618650 RegisterTilingData:optype: MatMulTunnerTiling, registered count: 15
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.484.720 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:MatMulV2, funcPointer:0xffff184350b0, registered count:7
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.484.751 [op_check.cc:24]618650 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:MatMulV2, funcPointer:0xffff18435310, registered count:5
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.485.125 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.485.585 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.487.201 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : [][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.487.363 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.487.439 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : []
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.487.814 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.488.259 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.494.337 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DefaultImpl] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.494.848 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.494.941 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.495.015 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.495.095 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AscendAntiQuantV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.495.167 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.495.245 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.495.269 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.495.339 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Concat] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.495.361 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ConcatV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.495.383 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.495.404 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.495.531 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.495.602 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.495.675 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.495.752 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.495.821 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.495.892 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.495.916 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.495.985 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.496.008 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.496.029 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.496.104 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.496.190 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.496.285 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.496.363 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.496.435 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.496.501 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.496.576 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.496.647 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.496.726 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.496.796 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.496.865 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : []
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.496.888 [op_impl_space_registry.cc:109]618674 MergeFunctions:op type AvgPool3DGrad inputs_dependency has been registered
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.496.894 [op_impl_space_registry.cc:109]618662 MergeFunctions:op type AvgPool3DGrad inputs_dependency has been registered
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.496.936 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.497.007 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.497.076 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.497.153 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.497.230 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.497.299 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : []
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.498.205 [op_impl_space_registry.cc:84]618662 MergeFunctions:op type MoeInitRoutingV2 tiling_parse func has been registered
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.498.233 [op_impl_space_registry.cc:85]618662 MergeFunctions:op type MoeInitRoutingV2 compile_info_creator func has been registered
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.498.244 [op_impl_space_registry.cc:86]618662 MergeFunctions:op type MoeInitRoutingV2 compile_info_deleter func has been registered
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.498.227 [op_impl_space_registry.cc:84]618674 MergeFunctions:op type MoeInitRoutingV2 tiling_parse func has been registered
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.498.251 [op_impl_space_registry.cc:85]618674 MergeFunctions:op type MoeInitRoutingV2 compile_info_creator func has been registered
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.498.258 [op_impl_space_registry.cc:87]618662 MergeFunctions:op type MoeInitRoutingV2 tiling func has been registered
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.498.272 [op_impl_space_registry.cc:93]618662 MergeFunctions:op type MoeInitRoutingV2 max_tiling_data_size has been registered
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.498.266 [op_impl_space_registry.cc:86]618674 MergeFunctions:op type MoeInitRoutingV2 compile_info_deleter func has been registered
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.498.281 [op_impl_space_registry.cc:87]618674 MergeFunctions:op type MoeInitRoutingV2 tiling func has been registered
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.498.293 [op_impl_space_registry.cc:93]618674 MergeFunctions:op type MoeInitRoutingV2 max_tiling_data_size has been registered
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.499.305 [op_impl_space_registry.cc:273]618662 ConvertSoToRegistry:Save so symbol and handle in path[/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so] success!
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.499.352 [op_impl_space_registry.cc:273]618674 ConvertSoToRegistry:Save so symbol and handle in path[/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so] success!
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.499.819 [plugin_manager.cc:564]618662 GetUpgradedOpMasterPath:Start to get upgraded op tiling path
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.499.851 [plugin_manager.cc:134]618662 GetUpgradedOppPath:Enter get upgraded opp path schedule
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.499.856 [plugin_manager.cc:564]618674 GetUpgradedOpMasterPath:Start to get upgraded op tiling path
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.499.880 [plugin_manager.cc:134]618674 GetUpgradedOppPath:Enter get upgraded opp path schedule
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.499.909 [file_utils.cc:47]618662 RealPath:[Util][realpath] Can not get real_path for /usr/local/Ascend/ascend-toolkit/latest/opp_latest/, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.499.916 [file_utils.cc:47]618674 RealPath:[Util][realpath] Can not get real_path for /usr/local/Ascend/ascend-toolkit/latest/opp_latest/, reason:No such file or directory
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.499.933 [plugin_manager.cc:145]618674 GetUpgradedOppPath:[Call][RealPath] Opp path /usr/local/Ascend/ascend-toolkit/latest/opp_latest/ is invalid.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.499.928 [plugin_manager.cc:145]618662 GetUpgradedOppPath:[Call][RealPath] Opp path /usr/local/Ascend/ascend-toolkit/latest/opp_latest/ is invalid.
[WARNING] GE(618662,python3.9):2025-04-03-09:27:42.499.960 [plugin_manager.cc:567]618662 GetUpgradedOpMasterPath:Failed to get upgraded opp path!
[WARNING] GE(618674,python3.9):2025-04-03-09:27:42.499.948 [plugin_manager.cc:567]618674 GetUpgradedOpMasterPath:Failed to get upgraded opp path!
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.500.025 [mem_manager.cc:31]618674 Initialize:MemManager Initialize.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.500.026 [mem_manager.cc:31]618662 Initialize:MemManager Initialize.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.500.064 [rts_caching_mem_allocator.cc:131]618674 Initialize:RtsAllocatorManager Initialize.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.500.064 [rts_caching_mem_allocator.cc:131]618662 Initialize:RtsAllocatorManager Initialize.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.500.082 [mem_manager.cc:102]618662 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.500.096 [graph_mem_allocator.cc:17]618662 Initialize:MemoryAllocator::Initialize.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.500.082 [mem_manager.cc:102]618674 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.500.110 [graph_mem_allocator.cc:17]618674 Initialize:MemoryAllocator::Initialize.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.500.111 [mem_manager.cc:102]618662 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.500.126 [graph_mem_allocator.cc:17]618662 Initialize:MemoryAllocator::Initialize.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.500.124 [mem_manager.cc:102]618674 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.500.139 [graph_mem_allocator.cc:17]618674 Initialize:MemoryAllocator::Initialize.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.500.139 [mem_manager.cc:102]618662 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.500.155 [caching_allocator.cc:391]618662 FreeBlocks:Free blocks.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.500.152 [mem_manager.cc:102]618674 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.500.188 [caching_allocator.cc:391]618674 FreeBlocks:Free blocks.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.500.190 [caching_allocator.cc:358]618662 FreeCachedBlocks:Free cached blocks
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.500.201 [caching_allocator.cc:358]618674 FreeCachedBlocks:Free cached blocks
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.500.205 [mem_manager.cc:102]618662 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.500.219 [caching_allocator.cc:391]618662 FreeBlocks:Free blocks.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.500.219 [mem_manager.cc:102]618674 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.500.234 [caching_allocator.cc:391]618674 FreeBlocks:Free blocks.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.500.232 [caching_allocator.cc:358]618662 FreeCachedBlocks:Free cached blocks
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.500.246 [mem_manager.cc:102]618662 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.500.245 [caching_allocator.cc:358]618674 FreeCachedBlocks:Free cached blocks
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.500.258 [mem_manager.cc:102]618674 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.500.272 [mem_manager.cc:102]618674 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.500.259 [mem_manager.cc:102]618662 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.500.275 [mem_manager.cc:102]618662 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.500.285 [mem_manager.cc:102]618674 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.500.300 [mem_manager.cc:102]618674 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.500.290 [mem_manager.cc:102]618662 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.500.306 [mem_manager.cc:102]618662 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.500.319 [session_scope_mem_allocator.cc:73]618662 FreeAllMemory:Free all memory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.500.313 [mem_manager.cc:102]618674 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.500.327 [session_scope_mem_allocator.cc:73]618674 FreeAllMemory:Free all memory
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.500.334 [mem_manager.cc:102]618662 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.500.349 [session_scope_mem_allocator.cc:73]618662 FreeAllMemory:Free all memory
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.500.341 [mem_manager.cc:102]618674 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.500.354 [session_scope_mem_allocator.cc:73]618674 FreeAllMemory:Free all memory
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.500.395 [dump_manager.cc:152]618662 Init:exception dump is not enabled
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.500.401 [dump_manager.cc:152]618674 Init:exception dump is not enabled
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.500.442 [ge_executor.cc:315]618674 Initialize:Init GeExecutor over.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.500.442 [ge_executor.cc:315]618662 Initialize:Init GeExecutor over.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.500.463 [acl.cpp:321]618674 aclInit: set DumpConfig in aclInit
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.500.463 [acl.cpp:321]618662 aclInit: set DumpConfig in aclInit
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.500.480 [dump.cpp:841]618662 HandleDumpConfig: start to execute HandleDumpConfig.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.500.480 [dump.cpp:841]618674 HandleDumpConfig: start to execute HandleDumpConfig.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.500.631 [dump.cpp:759]618674 ConvertDumpCfg: start to execute ConvertDumpCfg.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.500.646 [dump.cpp:594]618674 IsValidDumpConfig: start to execute IsValidDumpConfig.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.500.635 [dump.cpp:759]618662 ConvertDumpCfg: start to execute ConvertDumpCfg.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.500.650 [dump.cpp:594]618662 IsValidDumpConfig: start to execute IsValidDumpConfig.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.500.658 [dump.cpp:224]618674 CheckDumpSceneSwitch: start to execute CheckDumpSceneSwitch.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.500.665 [dump.cpp:224]618662 CheckDumpSceneSwitch: start to execute CheckDumpSceneSwitch.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.500.691 [dump.cpp:703]618674 SetUpDumpConfig: convert to ge dump config successfully, enable lite_exception dump, path=
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.500.705 [dump.cpp:703]618662 SetUpDumpConfig: convert to ge dump config successfully, enable lite_exception dump, path=
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.500.711 [dump.cpp:771]618674 HandleDumpCommand: start to execute HandleDumpCommand.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.500.726 [dump.cpp:703]618674 SetUpDumpConfig: convert to ge dump config successfully, enable lite_exception dump, path=
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.500.723 [dump.cpp:771]618662 HandleDumpCommand: start to execute HandleDumpCommand.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.500.736 [dump.cpp:703]618662 SetUpDumpConfig: convert to ge dump config successfully, enable lite_exception dump, path=
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.500.807 [adx_datadump_server.cpp:77][tid:618662] start to do dump init
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.500.814 [adx_datadump_server.cpp:77][tid:618674] start to do dump init
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.500.828 [adx_dump_record.cpp:210][tid:618662] dumpPath prefix is /home/jenkins/mindspore/testcases/testcases/tests/st/lccl
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.500.831 [adx_dump_record.cpp:210][tid:618674] dumpPath prefix is /home/jenkins/mindspore/testcases/testcases/tests/st/lccl
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.500.846 [adx_dump_record.cpp:214][tid:618662] record remote dump temp path : /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.500.847 [adx_dump_record.cpp:214][tid:618674] record remote dump temp path : /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.501.076 [adx_server_manager.cpp:149][tid:618859] server manager add component (10)
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.501.076 [adx_dump_record.cpp:627][tid:618860] start dump thread, remote dump record temp path : /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/.
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.501.111 [adx_server_manager.cpp:165][tid:618859] server manager components init successfully
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.501.139 [adx_dump_record.cpp:627][tid:618861] start dump thread, remote dump record temp path : /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/.
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.501.248 [adx_server_manager.cpp:149][tid:618858] server manager add component (10)
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.501.243 [adx_server_manager.cpp:203][tid:618862] Run Server(0) Process
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.501.269 [adx_server_manager.cpp:165][tid:618858] server manager components init successfully
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.501.299 [adx_server_manager.cpp:369][tid:618862] device up 0
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.501.320 [hdc_comm_opt.cpp:59][tid:618862] open device[0] server[13]
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.501.387 [adx_server_manager.cpp:203][tid:618863] Run Server(0) Process
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.501.446 [adx_server_manager.cpp:369][tid:618863] device up 0
[INFO] DRV(618662,python3.9):2025-04-03-09:27:42.501.450 [drv_log_user.c:623][ascend][curpid:618662,618862][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=0; fid=0; service_type="service_dump"; pid=618662)
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.501.464 [hdc_comm_opt.cpp:59][tid:618863] open device[0] server[13]
[INFO] DRV(618662,python3.9):2025-04-03-09:27:42.501.468 [hdc_server.c:363][ascend][curpid:618662,618862][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=0)
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.501.486 [hdc_api.cpp:119][tid:618862] logDevId 0 create HDC server successfully
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.501.601 [adx_server_manager.cpp:111][tid:618862] create server info
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.501.617 [adx_server_manager.cpp:369][tid:618862] device up 1
[INFO] DRV(618674,python3.9):2025-04-03-09:27:42.501.607 [drv_log_user.c:623][ascend][curpid:618674,618863][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=0; fid=0; service_type="service_dump"; pid=618674)
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.501.630 [hdc_comm_opt.cpp:59][tid:618862] open device[1] server[13]
[INFO] DRV(618674,python3.9):2025-04-03-09:27:42.501.625 [hdc_server.c:363][ascend][curpid:618674,618863][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=0)
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.501.643 [hdc_api.cpp:119][tid:618863] logDevId 0 create HDC server successfully
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.501.677 [adx_server_manager.cpp:111][tid:618863] create server info
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.501.692 [adx_server_manager.cpp:369][tid:618863] device up 1
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.501.704 [hdc_comm_opt.cpp:59][tid:618863] open device[1] server[13]
[INFO] DRV(618662,python3.9):2025-04-03-09:27:42.501.767 [drv_log_user.c:623][ascend][curpid:618662,618862][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=1; fid=0; service_type="service_dump"; pid=618662)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:42.501.785 [hdc_server.c:363][ascend][curpid:618662,618862][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=1)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:42.501.798 [drv_log_user.c:623][ascend][curpid:618674,618863][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=1; fid=0; service_type="service_dump"; pid=618674)
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.501.799 [hdc_api.cpp:119][tid:618862] logDevId 1 create HDC server successfully
[WARNING] IDEDD(618662,python3.9):2025-04-03-09:27:42.501.815 [adx_hdc_epoll.cpp:34][tid:618862] hdc epoll has been created.
[INFO] DRV(618674,python3.9):2025-04-03-09:27:42.501.816 [hdc_server.c:363][ascend][curpid:618674,618863][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=1)
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.501.832 [hdc_api.cpp:119][tid:618863] logDevId 1 create HDC server successfully
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.501.830 [adx_server_manager.cpp:111][tid:618862] create server info
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.501.845 [adx_server_manager.cpp:369][tid:618862] device up 2
[WARNING] IDEDD(618674,python3.9):2025-04-03-09:27:42.501.845 [adx_hdc_epoll.cpp:34][tid:618863] hdc epoll has been created.
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.501.859 [adx_server_manager.cpp:111][tid:618863] create server info
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.501.857 [hdc_comm_opt.cpp:59][tid:618862] open device[2] server[13]
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.501.872 [adx_server_manager.cpp:369][tid:618863] device up 2
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.501.886 [hdc_comm_opt.cpp:59][tid:618863] open device[2] server[13]
[INFO] DRV(618662,python3.9):2025-04-03-09:27:42.501.940 [drv_log_user.c:623][ascend][curpid:618662,618862][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=2; fid=0; service_type="service_dump"; pid=618662)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:42.501.957 [hdc_server.c:363][ascend][curpid:618662,618862][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=2)
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.501.971 [hdc_api.cpp:119][tid:618862] logDevId 2 create HDC server successfully
[WARNING] IDEDD(618662,python3.9):2025-04-03-09:27:42.501.983 [adx_hdc_epoll.cpp:34][tid:618862] hdc epoll has been created.
[INFO] DRV(618674,python3.9):2025-04-03-09:27:42.502.035 [drv_log_user.c:623][ascend][curpid:618674,618863][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=2; fid=0; service_type="service_dump"; pid=618674)
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.502.033 [adx_server_manager.cpp:111][tid:618862] create server info
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.502.059 [adx_server_manager.cpp:369][tid:618862] device up 3
[INFO] DRV(618674,python3.9):2025-04-03-09:27:42.502.050 [hdc_server.c:363][ascend][curpid:618674,618863][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=2)
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.502.067 [hdc_api.cpp:119][tid:618863] logDevId 2 create HDC server successfully
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.502.071 [hdc_comm_opt.cpp:59][tid:618862] open device[3] server[13]
[WARNING] IDEDD(618674,python3.9):2025-04-03-09:27:42.502.080 [adx_hdc_epoll.cpp:34][tid:618863] hdc epoll has been created.
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.502.096 [adx_server_manager.cpp:111][tid:618863] create server info
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.502.110 [adx_server_manager.cpp:369][tid:618863] device up 3
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.502.120 [hdc_comm_opt.cpp:59][tid:618863] open device[3] server[13]
[INFO] DRV(618662,python3.9):2025-04-03-09:27:42.502.207 [drv_log_user.c:623][ascend][curpid:618662,618862][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=3; fid=0; service_type="service_dump"; pid=618662)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:42.502.223 [hdc_server.c:363][ascend][curpid:618662,618862][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=3)
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.502.236 [hdc_api.cpp:119][tid:618862] logDevId 3 create HDC server successfully
[INFO] DRV(618674,python3.9):2025-04-03-09:27:42.502.238 [drv_log_user.c:623][ascend][curpid:618674,618863][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=3; fid=0; service_type="service_dump"; pid=618674)
[WARNING] IDEDD(618662,python3.9):2025-04-03-09:27:42.502.249 [adx_hdc_epoll.cpp:34][tid:618862] hdc epoll has been created.
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.502.266 [adx_server_manager.cpp:111][tid:618862] create server info
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.502.282 [adx_server_manager.cpp:369][tid:618862] device up 4
[INFO] DRV(618674,python3.9):2025-04-03-09:27:42.502.254 [hdc_server.c:363][ascend][curpid:618674,618863][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=3)
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.502.283 [hdc_api.cpp:119][tid:618863] logDevId 3 create HDC server successfully
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.502.292 [hdc_comm_opt.cpp:59][tid:618862] open device[4] server[13]
[WARNING] IDEDD(618674,python3.9):2025-04-03-09:27:42.502.297 [adx_hdc_epoll.cpp:34][tid:618863] hdc epoll has been created.
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.502.312 [adx_server_manager.cpp:111][tid:618863] create server info
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.502.326 [adx_server_manager.cpp:369][tid:618863] device up 4
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.502.336 [hdc_comm_opt.cpp:59][tid:618863] open device[4] server[13]
[INFO] DRV(618662,python3.9):2025-04-03-09:27:42.502.429 [drv_log_user.c:623][ascend][curpid:618662,618862][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=4; fid=0; service_type="service_dump"; pid=618662)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:42.502.446 [hdc_server.c:363][ascend][curpid:618662,618862][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=4)
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.502.460 [hdc_api.cpp:119][tid:618862] logDevId 4 create HDC server successfully
[WARNING] IDEDD(618662,python3.9):2025-04-03-09:27:42.502.472 [adx_hdc_epoll.cpp:34][tid:618862] hdc epoll has been created.
[INFO] DRV(618674,python3.9):2025-04-03-09:27:42.502.461 [drv_log_user.c:623][ascend][curpid:618674,618863][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=4; fid=0; service_type="service_dump"; pid=618674)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:42.502.476 [hdc_server.c:363][ascend][curpid:618674,618863][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=4)
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.502.493 [hdc_api.cpp:119][tid:618863] logDevId 4 create HDC server successfully
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.502.486 [adx_server_manager.cpp:111][tid:618862] create server info
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.502.500 [adx_server_manager.cpp:369][tid:618862] device up 5
[WARNING] IDEDD(618674,python3.9):2025-04-03-09:27:42.502.505 [adx_hdc_epoll.cpp:34][tid:618863] hdc epoll has been created.
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.502.512 [hdc_comm_opt.cpp:59][tid:618862] open device[5] server[13]
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.502.520 [adx_server_manager.cpp:111][tid:618863] create server info
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.502.533 [adx_server_manager.cpp:369][tid:618863] device up 5
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.502.545 [hdc_comm_opt.cpp:59][tid:618863] open device[5] server[13]
[INFO] DRV(618662,python3.9):2025-04-03-09:27:42.502.639 [drv_log_user.c:623][ascend][curpid:618662,618862][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=5; fid=0; service_type="service_dump"; pid=618662)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:42.502.655 [hdc_server.c:363][ascend][curpid:618662,618862][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=5)
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.502.668 [hdc_api.cpp:119][tid:618862] logDevId 5 create HDC server successfully
[WARNING] IDEDD(618662,python3.9):2025-04-03-09:27:42.502.680 [adx_hdc_epoll.cpp:34][tid:618862] hdc epoll has been created.
[INFO] DRV(618674,python3.9):2025-04-03-09:27:42.502.671 [drv_log_user.c:623][ascend][curpid:618674,618863][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=5; fid=0; service_type="service_dump"; pid=618674)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:42.502.688 [hdc_server.c:363][ascend][curpid:618674,618863][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=5)
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.502.704 [hdc_api.cpp:119][tid:618863] logDevId 5 create HDC server successfully
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.502.694 [adx_server_manager.cpp:111][tid:618862] create server info
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.502.708 [adx_server_manager.cpp:369][tid:618862] device up 6
[WARNING] IDEDD(618674,python3.9):2025-04-03-09:27:42.502.715 [adx_hdc_epoll.cpp:34][tid:618863] hdc epoll has been created.
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.502.719 [hdc_comm_opt.cpp:59][tid:618862] open device[6] server[13]
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.502.729 [adx_server_manager.cpp:111][tid:618863] create server info
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.502.743 [adx_server_manager.cpp:369][tid:618863] device up 6
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.502.753 [hdc_comm_opt.cpp:59][tid:618863] open device[6] server[13]
[INFO] DRV(618662,python3.9):2025-04-03-09:27:42.502.854 [drv_log_user.c:623][ascend][curpid:618662,618862][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=6; fid=0; service_type="service_dump"; pid=618662)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:42.502.870 [hdc_server.c:363][ascend][curpid:618662,618862][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=6)
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.502.882 [hdc_api.cpp:119][tid:618862] logDevId 6 create HDC server successfully
[WARNING] IDEDD(618662,python3.9):2025-04-03-09:27:42.502.894 [adx_hdc_epoll.cpp:34][tid:618862] hdc epoll has been created.
[INFO] DRV(618674,python3.9):2025-04-03-09:27:42.502.885 [drv_log_user.c:623][ascend][curpid:618674,618863][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=6; fid=0; service_type="service_dump"; pid=618674)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:42.502.900 [hdc_server.c:363][ascend][curpid:618674,618863][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=6)
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.502.913 [hdc_api.cpp:119][tid:618863] logDevId 6 create HDC server successfully
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.502.909 [adx_server_manager.cpp:111][tid:618862] create server info
[INF[WARNING] IDEDD(618674,python3.9):2025-04-03-09:27:42.502.925 [adx_hdc_epoll.cpp:34][tid:618863] hdc epoll has been created.
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.502.940 [adx_server_manager.cpp:111][tid:618863] create server info
O] IDEDD(618662,python3.9):2025-04-03-09:27:42.502.923 [adx_server_manager.cpp:369][tid:618862] device up 7
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.502.956 [hdc_comm_opt.cpp:59][tid:618862] open device[7] server[13]
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.502.952 [adx_server_manager.cpp:369][tid:618863] device up 7
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.502.966 [hdc_comm_opt.cpp:59][tid:618863] open device[7] server[13]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.503.002 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : [][]
[INFO] DRV(618662,python3.9):2025-04-03-09:27:42.503.089 [drv_log_user.c:623][ascend][curpid:618662,618862][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=7; fid=0; service_type="service_dump"; pid=618662)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:42.503.106 [hdc_server.c:363][ascend][curpid:618662,618862][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=7)
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.503.119 [hdc_api.cpp:119][tid:618862] logDevId 7 create HDC server successfully
[WARNING] IDEDD(618662,python3.9):2025-04-03-09:27:42.503.135 [adx_hdc_epoll.cpp:34][tid:618862] hdc epoll has been created.
[INFO] DRV(618674,python3.9):2025-04-03-09:27:42.503.121 [drv_log_user.c:623][ascend][curpid:618674,618863][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=7; fid=0; service_type="service_dump"; pid=618674)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:42.503.136 [hdc_server.c:363][ascend][curpid:618674,61[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.503.148 [adx_server_manager.cpp:111][tid:618862] create server info
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.503.131 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [][]
8863][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=7)
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.503.167 [hdc_api.cpp:119][tid:618863] logDevId 7 create HDC server successfully
[WARNING] IDEDD(618674,python3.9):2025-04-03-09:27:42.503.183 [adx_hdc_epoll.cpp:34][tid:618863] hdc epoll has been created.
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.503.199 [adx_server_manager.cpp:111][tid:618863] create server info
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.503.243 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.503.534 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.503.654 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.503.763 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DeformableOffsetsGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.503.870 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.504.030 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.504.139 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : [][]
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.504.179 [adx_server_manager.cpp:457][tid:618662] The server is initialized after waiting 3 times.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.504.204 [ge_executor.cc:1349]618662 SetDump:Start to set dump config
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.504.184 [adx_server_manager.cpp:457][tid:618674] The server is initialized after waiting 3 times.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.504.205 [ge_executor.cc:1349]618674 SetDump:Start to set dump config
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.504.226 [dump_manager.cc:201]618674 NeedDoDump:Dump status: on, Overflow detection dump switch: off.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.504.226 [dump_manager.cc:201]618662 NeedDoDump:Dump status: on, Overflow detection dump switch: off.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.504.265 [dump_manager.cc:261]618674 SetExceptionDump:Enable brief exception dump.
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.504.265 [dump_manager.cc:261]618662 SetExceptionDump:Enable brief exception dump.
[INFO] GE(618674,python3.9):2025-04-03-09:27:42.504.299 [ge_executor.cc:1355]618674 SetDump:Set dump config successfully
[INFO] GE(618662,python3.9):2025-04-03-09:27:42.504.299 [ge_executor.cc:1355]618662 SetDump:Set dump config successfully
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.504.304 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [][]
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.504.332 [dump_manager.cpp:146][tid:618674] Set 3 dump setting, status: on, dump switch: 3
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.504.332 [dump_manager.cpp:146][tid:618662] Set 3 dump setting, status: on, dump switch: 3
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.504.460 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.504.574 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.504.697 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.504.828 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachNonFiniteCheckAndUnscale] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.504.943 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.505.059 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.505.085 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.505.244 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GatherV3] register OP_IMPL : [][][][]
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:42.505.321 [dump_manager.cpp:301][tid:618674] Register exception callback, registered: 1
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:42.505.328 [dump_manager.cpp:301][tid:618662] Register exception callback, registered: 1
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.505.342 [dump.cpp:825]618674 HandleDumpCommand: set dump config for model successfully,adumpType = 3, dump_path = , dump_mode = , dump_op_switch = , dump_data = .
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.505.349 [dump.cpp:825]618662 HandleDumpCommand: set dump config for model successfully,adumpType = 3, dump_path = , dump_mode = , dump_op_switch = , dump_data = .
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.505.353 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [][]
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.505.366 [acl.cpp:327]618674 aclInit: set HandleDumpConfig success in aclInit
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.505.379 [acl.cpp:329]618674 aclInit: set max_opqueue_num in aclInit
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.505.370 [acl.cpp:327]618662 aclInit: set HandleDumpConfig success in aclInit
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.505.383 [acl.cpp:329]618662 aclInit: set max_opqueue_num in aclInit
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.505.396 [acl_resource_manager.cpp:248]618662 HandleMaxOpQueueConfig: start to execute HandleMaxOpQueueConfig
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.505.396 [acl_resource_manager.cpp:248]618674 HandleMaxOpQueueConfig: start to execute HandleMaxOpQueueConfig
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.505.500 [acl_resource_manager.cpp:275]618674 HandleMaxOpQueueConfig: no max_opqueue_num found, set default DEFAULT_MAX_OPQUEUE_NUM[20000].
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.505.501 [acl_resource_manager.cpp:275]618662 HandleMaxOpQueueConfig: no max_opqueue_num found, set default DEFAULT_MAX_OPQUEUE_NUM[20000].
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.505.502 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [][]
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.505.518 [acl_resource_manager.cpp:278]618674 HandleMaxOpQueueConfig: HandleMaxOpQueueConfig end in HandleMaxOpQueueConfig
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.505.518 [acl_resource_manager.cpp:278]618662 HandleMaxOpQueueConfig: HandleMaxOpQueueConfig end in HandleMaxOpQueueConfig
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.505.532 [acl.cpp:335]618662 aclInit: set HandleMaxOpQueueConfig success in aclInit
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.505.532 [acl.cpp:335]618674 aclInit: set HandleMaxOpQueueConfig success in aclInit
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.505.544 [acl.cpp:336]618662 aclInit: set HandleDefaultDevice in aclInit
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.505.545 [acl.cpp:336]618674 aclInit: set HandleDefaultDevice in aclInit
[WARNING] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.505.607 [json_parser.cpp:260]618674 GetDefaultDeviceIdFromFile: no defaultDevice item!
[WARNING] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.505.611 [json_parser.cpp:260]618662 GetDefaultDeviceIdFromFile: no defaultDevice item!
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.505.616 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [][]
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.505.628 [acl.cpp:343]618662 aclInit: set HandleDefaultDevice success in aclInit
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.505.625 [acl.cpp:343]618674 aclInit: set HandleDefaultDevice success in aclInit
[INFO] PROFILING(618662,python3.9):2025-04-03-09:27:42.505.650 [prof_atls_plugin.cpp:210] (tid:618662) Module[48] register callback of ctrl handle.
[INFO] PROFILING(618674,python3.9):2025-04-03-09:27:42.505.653 [prof_atls_plugin.cpp:210] (tid:618674) Module[48] register callback of ctrl handle.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.505.668 [acl.cpp:351]618674 aclInit: set ProfilingConfig in aclInit
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.505.667 [acl.cpp:351]618662 aclInit: set ProfilingConfig in aclInit
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.505.681 [profiling.cpp:141]618674 HandleProfilingConfig: start to execute HandleProfilingConfig
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.505.680 [profiling.cpp:141]618662 HandleProfilingConfig: start to execute HandleProfilingConfig
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.505.695 [profiling.cpp:135]618674 GetProfilingConfigFile: no profiling config file.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.505.695 [profiling.cpp:135]618662 GetProfilingConfigFile: no profiling config file.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.505.724 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.505.751 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [][]
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.505.756 [profiling.cpp:167]618674 HandleProfilingConfig: can not parse profiling config from file[/home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618674.json], errorCode = 0
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.505.772 [profiling.cpp:172]618674 HandleProfilingConfig: profiling config file[/home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618674.json] is empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.505.760 [profiling.cpp:167]618662 HandleProfilingConfig: can not parse profiling config from file[/home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618662.json], errorCode = 0
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.505.789 [profiling.cpp:172]618662 HandleProfilingConfig: profiling config file[/home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618662.json] is empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.505.802 [profiling.cpp:176]618662 HandleProfilingConfig: start to use profiling config by config file mode
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.505.814 [profiling.cpp:179]618662 HandleProfilingConfig: ParseJsonFromFile ok in HandleProfilingConfig
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.505.786 [profiling.cpp:176]618674 HandleProfilingConfig: start to use profiling config by config file mode
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.505.814 [profiling.cpp:179]618674 HandleProfilingConfig: ParseJsonFromFile ok in HandleProfilingConfig
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.505.828 [profiling.cpp:92]618674 HandleProfilingCommand: start to execute HandleProfilingCommand
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.505.827 [profiling.cpp:92]618662 HandleProfilingCommand: start to execute HandleProfilingCommand
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.505.879 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.505.986 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.506.145 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LinSpace] register OP_IMPL : [][][][]
[INFO] PROFILING(618674,python3.9):2025-04-03-09:27:42.506.212 [ai_drv_dev_api.cpp:316] >>> (tid:618674) Succeeded to get device 64 frequency=100000
[INFO] PROFILING(618662,python3.9):2025-04-03-09:27:42.506.213 [ai_drv_dev_api.cpp:316] >>> (tid:618662) Succeeded to get device 64 frequency=100000
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.506.259 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MemSet] register OP_IMPL : [][]
[INFO] PROFILING(618674,python3.9):2025-04-03-09:27:42.506.319 [msprof_callback_impl.cpp:132] >>> (tid:618674) Dynamic profiling environment not really set, so do nothing.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.506.337 [profiling.cpp:122]618674 HandleProfilingCommand: set profiling config successfully
[INFO] PROFILING(618662,python3.9):2025-04-03-09:27:42.506.329 [msprof_callback_impl.cpp:132] >>> (tid:618662) Dynamic profiling environment not really set, so do nothing.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.506.346 [profiling.cpp:122]618662 HandleProfilingCommand: set profiling config successfully
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.506.349 [profiling.cpp:186]618674 HandleProfilingConfig: set HandleProfilingConfig success
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.506.359 [profiling.cpp:186]618662 HandleProfilingConfig: set HandleProfilingConfig success
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.506.372 [hash_utils.cpp:108]618662 CalculateSimpleHash: Begin to calculate hash for file: /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618662.json
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.506.364 [hash_utils.cpp:108]618674 CalculateSimpleHash: Begin to calculate hash for file: /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618674.json
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.506.368 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [][]
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.506.405 [hash_utils.cpp:128]618674 CalculateSimpleHash: file: /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618674.json, hash: 3917491750093904922
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.506.406 [hash_utils.cpp:128]618662 CalculateSimpleHash: file: /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618662.json, hash: 3917491750093904922
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.506.422 [acl.cpp:115]618662 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.506.423 [acl.cpp:115]618674 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.506.458 [acl.cpp:280]618674 IsEnableAutoUCMemeory: auto-uc-memory is enabled.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.506.472 [acl.cpp:385]618674 aclInit: register kernel launch fill function in aclInit
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.506.458 [acl.cpp:280]618662 IsEnableAutoUCMemeory: auto-uc-memory is enabled.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.506.473 [acl.cpp:385]618662 aclInit: register kernel launch fill function in aclInit
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.506.493 [runtime.cc:5394] 618674 RegKernelLaunchFillFunc: registercallback finish, symbol:g_opSystemRunCfg.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.506.493 [runtime.cc:5394] 618662 RegKernelLaunchFillFunc: registercallback finish, symbol:g_opSystemRunCfg.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.506.490 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : [][]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.506.509 [api_impl.cc:7407] 618662 RegStreamStateCallback: Reg stream state callback, regName=ACL_MODULE_STREAM.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.506.509 [api_impl.cc:7407] 618674 RegStreamStateCallback: Reg stream state callback, regName=ACL_MODULE_STREAM.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.506.533 [api_impl.cc:4211] 618674 RegDeviceStateCallback: Reg device state callback, regName=ACL_MODULE_DEVICE.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.506.540 [api_impl.cc:4211] 618662 RegDeviceStateCallback: Reg device state callback, regName=ACL_MODULE_DEVICE.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.506.553 [acl.cpp:420]618674 aclInit: successfully execute aclInit, aclInitRefCount is 1
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.506.557 [acl.cpp:420]618662 aclInit: successfully execute aclInit, aclInitRefCount is 1
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.506.629 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.506.738 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [][]
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.506.741 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:199] InitializeAcl] Call aclInit successfully, json is {"dump":{"dump_scene":"lite_exception"},"err_msg_mode":"1"}
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.506.741 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:199] InitializeAcl] Call aclInit successfully, json is {"dump":{"dump_scene":"lite_exception"},"err_msg_mode":"1"}
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.506.848 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : [][][]
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.506.866 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:295] Initialize] End initializing device context.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.506.865 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:295] Initialize] End initializing device context.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.506.930 [mindspore/ccsrc/plugin/res_manager/ascend/ascend_res_manager.cc:467] LoadCollectiveCommLib] Loading MACCL collective library successfully.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.506.936 [mindspore/ccsrc/plugin/res_manager/ascend/ascend_res_manager.cc:467] LoadCollectiveCommLib] Loading MACCL collective library successfully.
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.506.959 [mindspore/ccsrc/distributed/collective/collective_manager.cc:621] InitDeviceCommLib] Start initializing communication library on device side...
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.506.959 [mindspore/ccsrc/distributed/collective/collective_manager.cc:621] InitDeviceCommLib] Start initializing communication library on device side...
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.506.957 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NPUClearFloatStatus] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.507.071 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NPUGetFloatStatus] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.507.190 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.507.230 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.507.443 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.507.567 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.507.719 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.508.012 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:ReverseSequence, funcPointer:0xfffee716e360, registered count:5
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.508.042 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:ReverseSequence, funcPointer:(nil), registered count:7
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.508.065 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:ReverseSequence, funcPointer:(nil), registered count:4
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.508.086 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:ReverseSequence, funcPointer:(nil), registered count:4
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.508.110 [op_check.cc:71]618654 RegisterParamGeneralize:RegisterParamGeneralize: op_type:ReverseSequence, funcPointer:(nil), registered count:4
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.508.133 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.508.280 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.508.391 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.508.600 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.508.761 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.508.870 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.508.896 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.509.000 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.509.027 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.509.134 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.509.252 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.509.278 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.509.387 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.509.493 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.509.600 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.509.726 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.509.931 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.509.957 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.510.060 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.510.167 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.510.360 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.510.479 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.510.600 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.510.709 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.510.814 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.511.028 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.511.191 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.511.337 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.511.485 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.511.607 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.511.724 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.511.837 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BlendFaceBgPartOne] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.511.944 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.512.059 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [][]
[INFO] PROFILING(618662,python3.9):2025-04-03-09:27:42.512.228 [prof_atls_plugin.cpp:210] (tid:618662) Module[0] register callback of ctrl handle.
[INFO] PROFILING(618674,python3.9):2025-04-03-09:27:42.512.230 [prof_atls_plugin.cpp:210] (tid:618674) Module[0] register callback of ctrl handle.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.512.345 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.512.513 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.512.541 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNN, funcPointer:0xfffee71f8e08, registered count:7
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.512.706 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.512.729 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNNV2, funcPointer:0xfffee7201298, registered count:7
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.512.849 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.512.970 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : [][]
[WARNING] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.513.044 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:76] Initialize] Loading LCCL because env MS_ENABLE_LCCL is set to on. Pay attention that LCCL only supports communication group within single node in KernelByKernel for now.
[WARNING] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.513.044 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:76] Initialize] Loading LCCL because env MS_ENABLE_LCCL is set to on. Pay attention that LCCL only supports communication group within single node in KernelByKernel for now.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.513.077 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:80] Initialize] Successfully initialize LCCL.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.513.088 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:80] Initialize] Successfully initialize LCCL.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.513.130 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [][]
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.513.160 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ascend_deprecated_interface.cc:83] OpenTsd] Device id = 4, rank size = 8.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.513.160 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ascend_deprecated_interface.cc:83] OpenTsd] Device id = 7, rank size = 8.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.513.182 [device.cpp:143]618662 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 4.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.513.191 [device.cpp:143]618674 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 7.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.513.211 [api_impl.cc:2999] 618662 SetDevice: device_id=4, deviceMode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.513.215 [api_impl.cc:2999] 618674 SetDevice: device_id=7, deviceMode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.513.232 [device.cc:306] 618674 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.513.230 [device.cc:306] 618662 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.513.247 [runtime.cc:3393] 618674 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x2
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.513.244 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GridSampler2D] register OP_IMPL : [][]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.513.250 [runtime.cc:3393] 618662 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.513.265 [runtime.cc:3560] 618674 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=7
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.513.268 [runtime.cc:3560] 618662 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.513.283 [api_impl.cc:2987] 618662 NewDevice: SetCurRef = 0xaaab087d6320,userDeviceId=4,deviceId=4
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.513.282 [api_impl.cc:2987] 618674 NewDevice: SetCurRef = 0xaaab0103b880,userDeviceId=7,deviceId=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.513.299 [runtime.cc:5239] 618674 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.513.297 [runtime.cc:5239] 618662 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.513.320 [api_impl.cc:2992] 618662 NewDevice: New device success, user_device_id=4, die_num=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.513.320 [api_impl.cc:2992] 618674 NewDevice: New device success, user_device_id=7, die_num=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.513.341 [api_impl.cc:3025] 618674 SetDevice: SetDevice success, curCtx=0xaaab0103b880, user_device_id=7.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.513.341 [api_impl.cc:3025] 618662 SetDevice: SetDevice success, curCtx=0xaaab087d6320, user_device_id=4.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.513.357 [acl.cpp:115]618662 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.513.358 [acl.cpp:115]618674 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.513.371 [acl.cpp:121]618662 GetSocVersion: socVersion is Ascend910B3
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.513.355 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GridSampler3D] register OP_IMPL : [][]
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.513.372 [acl.cpp:121]618674 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.513.396 [device.cpp:154]618674 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 7
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.513.395 [device.cpp:154]618662 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 4
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.513.452 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel _npu_log begins the construction process witch capacity 128
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.513.452 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel _npu_log begins the construction process witch capacity 128
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.513.467 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandle] register OP_IMPL : [][]
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.513.472 [tensor_data_transfer.cpp:898]618662 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 4, name is _npu_log, capacity is 128
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.513.472 [tensor_data_transfer.cpp:898]618674 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 7, name is _npu_log, capacity is 128
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.513.495 [api_impl.cc:6077] 618674 MemQueueInit: Start to init queue on devId 7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.513.510 [npu_driver.cc:4076] 618674 MemQueueInit: init mem queue, device_id=7.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.513.495 [api_impl.cc:6077] 618662 MemQueueInit: Start to init queue on devId 4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.513.514 [npu_driver.cc:4076] 618662 MemQueueInit: init mem queue, device_id=4.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.513.526 [npu_driver.cc:4026] 618674 CheckMemQueueSupported: get majorVersion 7
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.513.529 [npu_driver.cc:4026] 618662 CheckMemQueueSupported: get majorVersion 7
[INFO] DRV(618674,python3.9):2025-04-03-09:27:42.513.556 [queue_client.c:151][ascend][curpid:618674,618674][drv][queuemng][QueueGetHostpid]Query tgid. (tgid=618674)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:42.513.561 [queue_client.c:151][ascend][curpid:618662,618662][drv][queuemng][QueueGetHostpid]Query tgid. (tgid=618662)
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.513.577 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandleV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.513.694 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : [][]
[INFO] DRV(618674,python3.9):2025-04-03-09:27:42.513.740 [queue_client.c:305][ascend][curpid:618674,618674][drv][queuemng][QueueGetDevPid]Query devpid succ. (devId=7; vfid=0; hostpid=618674; master_pid=618674; proc_type=0; devpid=29919).
[INFO] DRV(618662,python3.9):2025-04-03-09:27:42.513.743 [queue_client.c:305][ascend][curpid:618662,618662][drv][queuemng][QueueGetDevPid]Query devpid succ. (devId=4; vfid=0; hostpid=618662; master_pid=618662; proc_type=0; devpid=29654).
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.513.803 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PasteSubImg] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.513.909 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.513.934 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.514.051 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.514.156 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.514.270 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.514.380 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.514.492 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.514.604 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.514.720 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TabulateFusionGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.514.830 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[YUV4442YUV422] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.514.971 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.514.998 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.515.023 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.515.046 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.515.199 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.515.310 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.515.417 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.515.529 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.515.662 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.515.773 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.515.795 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.515.827 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.515.933 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.516.041 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.516.152 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.516.357 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicAtomicAddrClean] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.516.466 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.516.575 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.516.699 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.516.813 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.516.922 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.517.035 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.517.060 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceMeanD] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.517.169 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.517.282 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.517.308 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.517.589 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.517.701 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.517.804 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [][]
[INFO] DRV(618662,python3.9):2025-04-03-09:27:42.517.795 [queue_client.c:362][ascend][curpid:618662,618662][drv][queuemng][QueueInit]QueueInit device. (devid=4; mcast_flag=0; mcast_gid=0; proc_sn=0; event_sn_offset=0)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:42.517.894 [queue_client.c:362][ascend][curpid:618674,618674][drv][queuemng][QueueInit]QueueInit device. (devid=7; mcast_flag=0; mcast_gid=0; proc_sn=0; event_sn_offset=0)
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.517.919 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [][]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.517.988 [npu_driver.cc:4114] 618662 MemQueueInit: get max queue cnt 4294967294 success.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.518.012 [api_impl.cc:6040] 618662 MemQueueCreate: Start to create queue on devId 4.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.518.023 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [][]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.518.042 [npu_driver.cc:3931] 618662 MemQueueCreate: create mem queue, deviceId=4, name=_npu_log.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.518.078 [npu_driver.cc:4114] 618674 MemQueueInit: get max queue cnt 4294967294 success.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.518.100 [api_impl.cc:6040] 618674 MemQueueCreate: Start to create queue on devId 7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.518.116 [npu_driver.cc:3931] 618674 MemQueueCreate: create mem queue, deviceId=7, name=_npu_log.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.518.138 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.518.247 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [][]
[INFO] DRV(618662,python3.9):2025-04-03-09:27:42.518.276 [queue_interface.c:182][ascend][curpid:618662,618662][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=0, actualQid=0, deploy_type=0)
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.518.297 [tensor_data_transfer.cpp:940]618662 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 4, name is _npu_log, real name is _npu_log, qid is 0
[INFO] DRV(618674,python3.9):2025-04-03-09:27:42.518.347 [queue_interface.c:182][ascend][curpid:618674,618674][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=0, actualQid=0, deploy_type=0)
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.518.355 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [][]
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.518.365 [tensor_data_transfer.cpp:940]618674 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 7, name is _npu_log, real name is _npu_log, qid is 0
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.518.433 [tensor_data_transfer.cpp:1054]618864 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is _npu_log
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.518.462 [tensor_data_transfer.cpp:1056]618864 acltdtReceiveTensor: new process, use queue process
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.518.504 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_tensor_dump begins the construction process witch capacity 128
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.518.517 [api_impl.cc:6121] 618864 MemQueuePeek: Start to peek queue on devId 4, qid is 0.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.518.496 [tensor_data_transfer.cpp:1054]618866 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is _npu_log
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.518.527 [tensor_data_transfer.cpp:1056]618866 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.518.528 [tensor_data_transfer.cpp:898]618662 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 4, name is ms_tensor_dump, capacity is 128
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.518.531 [npu_driver.cc:4330] 618864 MemQueuePeek: peek mem queue, deviceId=4, qid=0, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.518.551 [api_impl.cc:6077] 618662 MemQueueInit: Start to init queue on devId 4.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.518.545 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_tensor_dump begins the construction process witch capacity 128
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.518.551 [api_impl.cc:6121] 618866 MemQueuePeek: Start to peek queue on devId 7, qid is 0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.518.565 [npu_driver.cc:4076] 618662 MemQueueInit: init mem queue, device_id=4.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.518.568 [tensor_data_transfer.cpp:898]618674 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 7, name is ms_tensor_dump, capacity is 128
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.518.579 [npu_driver.cc:4026] 618662 CheckMemQueueSupported: get majorVersion 7
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.518.568 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : [][]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.518.572 [npu_driver.cc:4330] 618866 MemQueuePeek: peek mem queue, deviceId=7, qid=0, timeout=800.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.518.590 [api_impl.cc:6077] 618674 MemQueueInit: Start to init queue on devId 7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.518.606 [npu_driver.cc:4076] 618674 MemQueueInit: init mem queue, device_id=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.518.621 [npu_driver.cc:4026] 618674 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:42.518.630 [npu_driver.cc:4087] 618662 MemQueueInit: repeated init
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.518.647 [api_impl.cc:6040] 618662 MemQueueCreate: Start to create queue on devId 4.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:42.518.650 [npu_driver.cc:4087] 618674 MemQueueInit: repeated init
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.518.668 [api_impl.cc:6040] 618674 MemQueueCreate: Start to create queue on devId 7.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.518.665 [npu_driver.cc:3931] 618662 MemQueueCreate: create mem queue, deviceId=4, name=ms_tensor_dump.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.518.681 [npu_driver.cc:3931] 618674 MemQueueCreate: create mem queue, deviceId=7, name=ms_tensor_dump.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.518.679 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.518.800 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : [][]
[INFO] DRV(618662,python3.9):2025-04-03-09:27:42.518.837 [queue_interface.c:182][ascend][curpid:618662,618662][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=1, actualQid=1, deploy_type=0)
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.518.857 [tensor_data_transfer.cpp:940]618662 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 4, name is ms_tensor_dump, real name is ms_tensor_dump, qid is 1
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.518.876 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [][][][]
[INFO] DRV(618674,python3.9):2025-04-03-09:27:42.518.907 [queue_interface.c:182][ascend][curpid:618674,618674][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=1, actualQid=1, deploy_type=0)
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.518.926 [tensor_data_transfer.cpp:940]618674 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 7, name is ms_tensor_dump, real name is ms_tensor_dump, qid is 1
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.518.984 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [][]
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.518.969 [tensor_data_transfer.cpp:1054]618868 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_tensor_dump
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.518.991 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_tensor_summary begins the construction process witch capacity 128
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.519.007 [tensor_data_transfer.cpp:1056]618868 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.519.017 [tensor_data_transfer.cpp:898]618662 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 4, name is ms_tensor_summary, capacity is 128
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.519.030 [api_impl.cc:6121] 618868 MemQueuePeek: Start to peek queue on devId 4, qid is 1.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.519.028 [tensor_data_transfer.cpp:1054]618870 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_tensor_dump
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.519.056 [tensor_data_transfer.cpp:1056]618870 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.519.037 [api_impl.cc:6077] 618662 MemQueueInit: Start to init queue on devId 4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.519.045 [npu_driver.cc:4330] 618868 MemQueuePeek: peek mem queue, deviceId=4, qid=1, timeout=800.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.519.063 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_tensor_summary begins the construction process witch capacity 128
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.519.069 [npu_driver.cc:4076] 618662 MemQueueInit: init mem queue, device_id=4.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.519.076 [api_impl.cc:6121] 618870 MemQueuePeek: Start to peek queue on devId 7, qid is 1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.519.084 [npu_driver.cc:4026] 618662 CheckMemQueueSupported: get majorVersion 7
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.519.084 [tensor_data_transfer.cpp:898]618674 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 7, name is ms_tensor_summary, capacity is 128
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.519.092 [npu_driver.cc:4330] 618870 MemQueuePeek: peek mem queue, deviceId=7, qid=1, timeout=800.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.519.104 [api_impl.cc:6077] 618674 MemQueueInit: Start to init queue on devId 7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.519.117 [npu_driver.cc:4076] 618674 MemQueueInit: init mem queue, device_id=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.519.131 [npu_driver.cc:4026] 618674 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:42.519.130 [npu_driver.cc:4087] 618662 MemQueueInit: repeated init
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.519.148 [api_impl.cc:6040] 618662 MemQueueCreate: Start to create queue on devId 4.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.519.161 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [][]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.519.163 [npu_driver.cc:3931] 618662 MemQueueCreate: create mem queue, deviceId=4, name=ms_tensor_summary.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:42.519.164 [npu_driver.cc:4087] 618674 MemQueueInit: repeated init
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.519.193 [api_impl.cc:6040] 618674 MemQueueCreate: Start to create queue on devId 7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.519.208 [npu_driver.cc:3931] 618674 MemQueueCreate: create mem queue, deviceId=7, name=ms_tensor_summary.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.519.240 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : []
[INFO] DRV(618662,python3.9):2025-04-03-09:27:42.519.327 [queue_interface.c:182][ascend][curpid:618662,618662][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=2, actualQid=2, deploy_type=0)
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.519.346 [tensor_data_transfer.cpp:940]618662 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 4, name is ms_tensor_summary, real name is ms_tensor_summary, qid is 2
[INFO] DRV(618674,python3.9):2025-04-03-09:27:42.519.378 [queue_interface.c:182][ascend][curpid:618674,618674][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=2, actualQid=2, deploy_type=0)
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.519.397 [tensor_data_transfer.cpp:940]618674 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 7, name is ms_tensor_summary, real name is ms_tensor_summary, qid is 2
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.519.407 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [][]
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.519.507 [tensor_data_transfer.cpp:1054]618873 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_tensor_summary
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.519.532 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_image_summary begins the construction process witch capacity 128
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.519.544 [tensor_data_transfer.cpp:1056]618873 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.519.525 [tensor_data_transfer.cpp:1054]618872 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_tensor_summary
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.519.552 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_image_summary begins the construction process witch capacity 128
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.519.545 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [][]
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.519.554 [tensor_data_transfer.cpp:898]618674 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 7, name is ms_image_summary, capacity is 128
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.519.553 [tensor_data_transfer.cpp:1056]618872 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.519.566 [api_impl.cc:6121] 618873 MemQueuePeek: Start to peek queue on devId 7, qid is 2.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.519.574 [api_impl.cc:6077] 618674 MemQueueInit: Start to init queue on devId 7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.519.580 [npu_driver.cc:4330] 618873 MemQueuePeek: peek mem queue, deviceId=7, qid=2, timeout=800.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.519.585 [npu_driver.cc:4076] 618674 MemQueueInit: init mem queue, device_id=7.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.519.572 [tensor_data_transfer.cpp:898]618662 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 4, name is ms_image_summary, capacity is 128
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.519.586 [api_impl.cc:6121] 618872 MemQueuePeek: Start to peek queue on devId 4, qid is 2.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.519.591 [api_impl.cc:6077] 618662 MemQueueInit: Start to init queue on devId 4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.519.601 [npu_driver.cc:4330] 618872 MemQueuePeek: peek mem queue, deviceId=4, qid=2, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.519.606 [npu_driver.cc:4076] 618662 MemQueueInit: init mem queue, device_id=4.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.519.598 [npu_driver.cc:4026] 618674 CheckMemQueueSupported: get majorVersion 7
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.519.620 [npu_driver.cc:4026] 618662 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:42.519.655 [npu_driver.cc:4087] 618674 MemQueueInit: repeated init
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:42.519.658 [npu_driver.cc:4087] 618662 MemQueueInit: repeated init
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.519.674 [api_impl.cc:6040] 618662 MemQueueCreate: Start to create queue on devId 4.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.519.672 [api_impl.cc:6040] 618674 MemQueueCreate: Start to create queue on devId 7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.519.688 [npu_driver.cc:3931] 618674 MemQueueCreate: create mem queue, deviceId=7, name=ms_image_summary.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.519.688 [npu_driver.cc:3931] 618662 MemQueueCreate: create mem queue, deviceId=4, name=ms_image_summary.
[INFO] DRV(618662,python3.9):2025-04-03-09:27:42.519.849 [queue_interface.c:182][ascend][curpid:618662,618662][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=3, actualQid=3, deploy_type=0)
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.519.868 [tensor_data_transfer.cpp:940]618662 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 4, name is ms_image_summary, real name is ms_image_summary, qid is 3
[INFO] DRV(618674,python3.9):2025-04-03-09:27:42.519.851 [queue_interface.c:182][ascend][curpid:618674,618674][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=3, actualQid=3, deploy_type=0)
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.519.869 [tensor_data_transfer.cpp:940]618674 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 7, name is ms_image_summary, real name is ms_image_summary, qid is 3
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.519.986 [tensor_data_transfer.cpp:1054]618876 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_image_summary
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.520.016 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_scalar_summary begins the construction process witch capacity 128
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.520.027 [tensor_data_transfer.cpp:1056]618876 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.520.033 [tensor_data_transfer.cpp:1054]618878 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_image_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.520.057 [tensor_data_transfer.cpp:1056]618878 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.520.052 [tensor_data_transfer.cpp:898]618662 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 4, name is ms_scalar_summary, capacity is 128
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.520.062 [api_impl.cc:6121] 618876 MemQueuePeek: Start to peek queue on devId 4, qid is 3.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.520.071 [api_impl.cc:6077] 618662 MemQueueInit: Start to init queue on devId 4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.520.076 [npu_driver.cc:4330] 618876 MemQueuePeek: peek mem queue, deviceId=4, qid=3, timeout=800.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.520.074 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_scalar_summary begins the construction process witch capacity 128
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.520.077 [api_impl.cc:6121] 618878 MemQueuePeek: Start to peek queue on devId 7, qid is 3.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.520.086 [npu_driver.cc:4076] 618662 MemQueueInit: init mem queue, device_id=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.520.100 [npu_driver.cc:4026] 618662 CheckMemQueueSupported: get majorVersion 7
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.520.094 [tensor_data_transfer.cpp:898]618674 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 7, name is ms_scalar_summary, capacity is 128
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.520.096 [npu_driver.cc:4330] 618878 MemQueuePeek: peek mem queue, deviceId=7, qid=3, timeout=800.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.520.115 [api_impl.cc:6077] 618674 MemQueueInit: Start to init queue on devId 7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.520.141 [npu_driver.cc:4076] 618674 MemQueueInit: init mem queue, device_id=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.520.154 [npu_driver.cc:4026] 618674 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:42.520.148 [npu_driver.cc:4087] 618662 MemQueueInit: repeated init
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.520.174 [api_impl.cc:6040] 618662 MemQueueCreate: Start to create queue on devId 4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.520.201 [npu_driver.cc:3931] 618662 MemQueueCreate: create mem queue, deviceId=4, name=ms_scalar_summary.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:42.520.194 [npu_driver.cc:4087] 618674 MemQueueInit: repeated init
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.520.211 [api_impl.cc:6040] 618674 MemQueueCreate: Start to create queue on devId 7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.520.225 [npu_driver.cc:3931] 618674 MemQueueCreate: create mem queue, deviceId=7, name=ms_scalar_summary.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.520.219 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.520.307 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [][]
[INFO] DRV(618662,python3.9):2025-04-03-09:27:42.520.351 [queue_interface.c:182][ascend][curpid:618662,618662][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=4, actualQid=4, deploy_type=0)
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.520.371 [tensor_data_transfer.cpp:940]618662 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 4, name is ms_scalar_summary, real name is ms_scalar_summary, qid is 4
[INFO] DRV(618674,python3.9):2025-04-03-09:27:42.520.388 [queue_interface.c:182][ascend][curpid:618674,618674][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=4, actualQid=4, deploy_type=0)
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.520.407 [tensor_data_transfer.cpp:940]618674 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 7, name is ms_scalar_summary, real name is ms_scalar_summary, qid is 4
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.520.480 [tensor_data_transfer.cpp:1054]618880 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_scalar_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.520.509 [tensor_data_transfer.cpp:1056]618880 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.520.492 [tensor_data_transfer.cpp:1054]618881 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_scalar_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.520.513 [tensor_data_transfer.cpp:1056]618881 acltdtReceiveTensor: new process, use queue process
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.520.511 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_histogram_summary begins the construction process witch capacity 128
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.520.524 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_histogram_summary begins the construction process witch capacity 128
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.520.529 [api_impl.cc:6121] 618880 MemQueuePeek: Start to peek queue on devId 4, qid is 4.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.520.531 [api_impl.cc:6121] 618881 MemQueuePeek: Start to peek queue on devId 7, qid is 4.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.520.533 [tensor_data_transfer.cpp:898]618662 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 4, name is ms_histogram_summary, capacity is 128
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.520.546 [npu_driver.cc:4330] 618881 MemQueuePeek: peek mem queue, deviceId=7, qid=4, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.520.552 [npu_driver.cc:4330] 618880 MemQueuePeek: peek mem queue, deviceId=4, qid=4, timeout=800.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.520.544 [tensor_data_transfer.cpp:898]618674 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 7, name is ms_histogram_summary, capacity is 128
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.520.563 [api_impl.cc:6077] 618662 MemQueueInit: Start to init queue on devId 4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.520.577 [npu_driver.cc:4076] 618662 MemQueueInit: init mem queue, device_id=4.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.520.568 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [][]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.520.567 [api_impl.cc:6077] 618674 MemQueueInit: Start to init queue on devId 7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.520.582 [npu_driver.cc:4076] 618674 MemQueueInit: init mem queue, device_id=7.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.520.590 [npu_driver.cc:4026] 618662 CheckMemQueueSupported: get majorVersion 7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.520.595 [npu_driver.cc:4026] 618674 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:42.520.644 [npu_driver.cc:4087] 618674 MemQueueInit: repeated init
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.520.649 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MlaAttentionScore] register OP_IMPL : []
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:42.520.646 [npu_driver.cc:4087] 618662 MemQueueInit: repeated init
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.520.661 [api_impl.cc:6040] 618662 MemQueueCreate: Start to create queue on devId 4.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.520.660 [api_impl.cc:6040] 618674 MemQueueCreate: Start to create queue on devId 7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.520.676 [npu_driver.cc:3931] 618674 MemQueueCreate: create mem queue, deviceId=7, name=ms_histogram_summary.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.520.675 [npu_driver.cc:3931] 618662 MemQueueCreate: create mem queue, deviceId=4, name=ms_histogram_summary.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.520.797 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [][]
[INFO] DRV(618674,python3.9):2025-04-03-09:27:42.520.828 [queue_interface.c:182][ascend][curpid:618674,618674][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=5, actualQid=5, deploy_type=0)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:42.520.824 [queue_interface.c:182][ascend][curpid:618662,618662][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=5, actualQid=5, deploy_type=0)
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.520.854 [tensor_data_transfer.cpp:940]618662 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 4, name is ms_histogram_summary, real name is ms_histogram_summary, qid is 5
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.520.846 [tensor_data_transfer.cpp:940]618674 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 7, name is ms_histogram_summary, real name is ms_histogram_summary, qid is 5
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.520.935 [tensor_data_transfer.cpp:1054]618884 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_histogram_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.520.956 [tensor_data_transfer.cpp:1056]618884 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.520.986 [api_impl.cc:6121] 618884 MemQueuePeek: Start to peek queue on devId 7, qid is 5.
[INFO] HCCL_ADPT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.520.990 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:273] InitHccl] Start init hccl adapter.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.521.002 [npu_driver.cc:4330] 618884 MemQueuePeek: peek mem queue, deviceId=7, qid=5, timeout=800.
[INFO] HCCL_ADPT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.520.990 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:273] InitHccl] Start init hccl adapter.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.521.031 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [][]
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.521.039 [tensor_data_transfer.cpp:1054]618885 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_histogram_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.521.068 [tensor_data_transfer.cpp:1056]618885 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.521.086 [api_impl.cc:6121] 618885 MemQueuePeek: Start to peek queue on devId 4, qid is 5.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.521.103 [npu_driver.cc:4330] 618885 MemQueuePeek: peek mem queue, deviceId=4, qid=5, timeout=800.
[INFO] HCCL_ADPT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.521.179 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:569] InitKernelInfoStore] Start init hccl kernel info store.
[INFO] HCCL_ADPT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.521.179 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:569] InitKernelInfoStore] Start init hccl kernel info store.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.521.207 [op_impl_registry.cc:122]618650 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [][][][]
[INFO] HCCL_ADPT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.521.214 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:586] InitKernelInfoStore] Get builder ops_kernel_info_hccl
[INFO] HCCL_ADPT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.521.215 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:586] InitKernelInfoStore] Get builder ops_kernel_info_hccl
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:42.521.235 [plugin_manager.cc:25] [618674]hcom ops plugin init start.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:42.521.236 [plugin_manager.cc:25] [618662]hcom ops plugin init start.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:42.521.270 [plugin_manager.cc:38] [618674]input BUILD_MODE is not set, result autoTune is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:42.521.270 [plugin_manager.cc:38] [618662]input BUILD_MODE is not set, result autoTune is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:42.521.291 [plugin_manager.cc:42] [618662]hcom running normal mode.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:42.521.291 [plugin_manager.cc:42] [618674]hcom running normal mode.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:42.521.337 [hcom_plugin.cc:50] [618674]Initialize start.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:42.521.353 [hcom_plugin.cc:52] [618674]initializeCount_ : 1
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:42.521.341 [hcom_plugin.cc:50] [618662]Initialize start.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:42.521.355 [hcom_plugin.cc:52] [618662]initializeCount_ : 1
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:42.521.389 [hcom_plugin.cc:60] [618674]hvdOpsKernelInfoStoreInfoPtr_ is initialized
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:42.521.389 [hcom_plugin.cc:60] [618662]hvdOpsKernelInfoStoreInfoPtr_ is initialized
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:42.521.416 [hcom_plugin.cc:63] [618674]hvdGraphOptimizerPtr_ is initialized
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:42.521.416 [hcom_plugin.cc:63] [618662]hvdGraphOptimizerPtr_ is initialized
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:42.521.433 [hcom_plugin.cc:329] [618662]ParserHcclAlgoDesc: there is no key named "HCCL_algorithm" in the options.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:42.521.433 [hcom_plugin.cc:329] [618674]ParserHcclAlgoDesc: there is no key named "HCCL_algorithm" in the options.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:42.521.449 [hcom_plugin.cc:281] [618674]ParserHcclExecTimeOut: there is no key named "HCCL_execTimeOut" in the options.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:42.521.449 [hcom_plugin.cc:281] [618662]ParserHcclExecTimeOut: there is no key named "HCCL_execTimeOut" in the options.
[WARNING] HCCL(618674,python3.9):2025-04-03-09:27:42.521.471 [hcom_plugin.cc:217] [618674]option profiling mode is not found.
[WARNING] HCCL(618662,python3.9):2025-04-03-09:27:42.521.472 [hcom_plugin.cc:217] [618662]option profiling mode is not found.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:42.521.493 [hcom_plugin.cc:164] [618662][masterInfo]get Master Info:ip or port or deviceId not set.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:42.521.491 [hcom_plugin.cc:164] [618674][masterInfo]get Master Info:ip or port or deviceId not set.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:42.521.507 [hcom_plugin.cc:180] [618674][masterInfo]get Rank Info: worker size not set.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:42.521.507 [hcom_plugin.cc:180] [618662][masterInfo]get Rank Info: worker size not set.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:42.521.523 [hcom_plugin.cc:244] [618662]InitializePlugin: Init without ranktable and masterInfo, please check your mode.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.521.491 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DepthToSpace] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.521.530 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [][]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:42.521.520 [hcom_plugin.cc:244] [618674]InitializePlugin: Init without ranktable and masterInfo, please check your mode.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.521.554 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SpaceToDepth] register OP_IMPL : [][]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:42.521.647 [hcom_plugin.cc:82] [618662]hccl ops plugin init success.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:42.521.664 [plugin_manager.cc:48] [618662]hcom ops plugin init end. ret[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:42.521.647 [hcom_plugin.cc:82] [618674]hccl ops plugin init success.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:42.521.665 [plugin_manager.cc:48] [618674]hcom ops plugin init end. ret[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:42.521.678 [hcom_plugin.cc:126] [618674]get hccl kernel info store start.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:42.521.678 [hcom_plugin.cc:126] [618662]get hccl kernel info store start.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.521.683 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : [][]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:42.521.703 [hcom_plugin.cc:132] [618674]get hccl kernel info store finished.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:42.521.703 [hcom_plugin.cc:132] [618662]get hccl kernel info store finished.
[INFO] HCCL_ADPT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.521.731 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:608] InitKernelInfoStore] Init hccl kernel info store success.
[INFO] HCCL_ADPT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.521.732 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:608] InitKernelInfoStore] Init hccl kernel info store success.
[INFO] HCCL_ADPT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.521.756 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:786] InitHcclExec] Start init hccl exec.
[INFO] HCCL_ADPT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.521.756 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:786] InitHcclExec] Start init hccl exec.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:42.521.770 [hcom_executor.cc:29] [618674]Hcom Excutor Initialize start.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:42.521.781 [hcom_executor.cc:29] [618662]Hcom Excutor Initialize start.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.521.808 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : [][]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.521.829 [runtime.cc:5239] 618674 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.521.829 [runtime.cc:5239] 618662 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:42.521.850 [adapter_rts.cc:234] [618662][hrtGetDevice]deviceLogicId[4]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:42.521.847 [adapter_rts.cc:234] [618674][hrtGetDevice]deviceLogicId[7]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.521.870 [op_impl_registry_holder_manager.cc:208]618650 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 599
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.521.891 [api_c_soc.cc:70] 618662 rtGetSocVersion: soc version is Ascend910B3
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.521.891 [api_c_soc.cc:70] 618674 rtGetSocVersion: soc version is Ascend910B3
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.521.916 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : [][]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:42.521.930 [hcom_common.cc:85] [618662][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[4] 
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:42.521.936 [hcom_common.cc:85] [618674][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[7] 
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:42.521.960 [hcom_common.cc:88] [618662][HcomGetCurHcomCtx] is no Used deviceLogicId[4] 
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:42.521.969 [hcom_common.cc:88] [618674][HcomGetCurHcomCtx] is no Used deviceLogicId[7] 
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:42.521.987 [hcom.cc:486] [618662]Get Hcom Init Status: [0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:42.522.004 [hcom_common.cc:85] [618662][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[4] 
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:42.521.992 [hcom.cc:486] [618674]Get Hcom Init Status: [0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:42.522.008 [hcom_common.cc:85] [618674][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[7] 
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:42.522.017 [hcom_rpc.cc:1019] [618662]Get Hcom Init Status: [0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:42.522.021 [hcom_rpc.cc:1019] [618674]Get Hcom Init Status: [0]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.522.036 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : [][]
[WARNING] HCCL(618662,python3.9):2025-04-03-09:27:42.522.044 [hcom_base_funs.cc:36] [618662][HcomOpsKernelInfoStore][InitHcom]OPTION_EXEC_RANK_TABLE is not found.
[WARNING] HCCL(618674,python3.9):2025-04-03-09:27:42.522.047 [hcom_base_funs.cc:36] [618674][HcomOpsKernelInfoStore][InitHcom]OPTION_EXEC_RANK_TABLE is not found.
[WARNING] HCCL(618674,python3.9):2025-04-03-09:27:42.522.064 [hcom_executor.cc:121] [618674][HcomOpsKernelInfoStore][InitHcom]OPTION_EXEC_HCOM_GROUPLIST is not found.
[WARNING] HCCL(618662,python3.9):2025-04-03-09:27:42.522.071 [hcom_executor.cc:121] [618662][HcomOpsKernelInfoStore][InitHcom]OPTION_EXEC_HCOM_GROUPLIST is not found.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.522.117 [api_impl.cc:1120] 618674 StreamCreate: priority=0, flags=1536.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.522.117 [api_impl.cc:1120] 618662 StreamCreate: priority=0, flags=1536.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.522.146 [npu_driver.cc:404] 618662 StreamIdAlloc: stream id alloc begin, device_id=4, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.522.145 [npu_driver.cc:404] 618674 StreamIdAlloc: stream id alloc begin, device_id=7, priority=0, ts_id=0, remote_stream_id=0
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.522.145 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : [][]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.522.210 [stream.cc:2246] 618674 AllocExecutedTimesSvm: stream_id=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.522.211 [stream.cc:2246] 618662 AllocExecutedTimesSvm: stream_id=4.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.522.253 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : [][]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.522.273 [stream_sqcq_manage.cc:147] 618662 Alloc: deviceId=4, tsId=0, drvFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.522.277 [stream_sqcq_manage.cc:147] 618674 Alloc: deviceId=7, tsId=0, drvFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.522.294 [npu_driver.cc:882] 618674 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.522.292 [npu_driver.cc:882] 618662 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.522.371 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.522.483 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.522.605 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.522.635 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.522.743 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.522.768 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : [][]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.522.831 [npu_driver.cc:6125] 618674 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.522.884 [npu_driver.cc:6137] 618674 LogicCqAllocateV2: success: deviceId=7, tsId=0, cqId=334, streamId=4, logicCq=334, cqeDepth=4096
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.522.885 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : [][]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.522.912 [npu_driver.cc:6189] 618674 StreamBindLogicCq: success: deviceId=7, tsId=0, streamId=4, logicCq=334.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.522.910 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : [][]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.522.932 [npu_driver.cc:5916] 618674 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=c8008000, addr=dfffc8008000size=4096
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.522.950 [stream.cc:653] 618674 Setup: Success to get sq=4 sq reg virtual addr length=4096.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.522.992 [npu_driver.cc:6125] 618662 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.523.015 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : [][]
[INFO] DRV(618674,python3.9):2025-04-03-09:27:42.523.027 [devmm_svm.c:1972][ascend][curpid:618674,618674][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.523.046 [npu_driver.cc:6080] 618674 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.523.039 [npu_driver.cc:6137] 618662 LogicCqAllocateV2: success: deviceId=4, tsId=0, cqId=314, streamId=4, logicCq=314, cqeDepth=4096
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.523.062 [npu_driver.cc:6189] 618662 StreamBindLogicCq: success: deviceId=4, tsId=0, streamId=4, logicCq=314.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.523.080 [npu_driver.cc:5916] 618662 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=e042d000, addr=dfffe042d000size=4096
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.523.096 [stream.cc:653] 618662 Setup: Success to get sq=4 sq reg virtual addr length=4096.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.523.125 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : [][]
[INFO] DRV(618662,python3.9):2025-04-03-09:27:42.523.143 [devmm_svm.c:1972][ascend][curpid:618662,618662][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.523.163 [npu_driver.cc:6080] 618662 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.523.241 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.523.358 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [][]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.523.397 [stream.cc:291] 618674 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=4, flags_=0x600.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.523.481 [stream.cc:291] 618662 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=4, flags_=0x600.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.523.587 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.523.893 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.524.035 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : [][]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.524.039 [stream.cc:688] 618674 Setup: stream setup end, stream_id=4, IsTaskSink=0, sqId=4, cqId=4, deviceId=7, streamResId=65535
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.524.062 [acl_resource_manager.cpp:814]618674 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.524.077 [acl_resource_manager.cpp:816]618674 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.524.091 [api_impl.cc:1162] 618674 StreamCreate: Succ, flags=1536, stream_id=4, context=aaab0103b880
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.524.090 [stream.cc:688] 618662 Setup: stream setup end, stream_id=4, IsTaskSink=0, sqId=4, cqId=4, deviceId=4, streamResId=65535
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.524.109 [acl_resource_manager.cpp:814]618662 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.524.123 [acl_resource_manager.cpp:816]618662 HandleReleaseSourceByStream: it's create strea[INFO] HCCL(618674,python3.9):2025-04-03-09:27:42.524.130 [stream.cc:73] [618674]Construct stream by stream type success, ptr[0xaaab0c447410] ctx[0xaaab0103b880], stream id[4], cqId[4], logicCqid[334]
m callback, currently do nothing.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.524.170 [api_impl.cc:1162] 618662 StreamCreate: Succ, flags=1536, stream_id=4, context=aaab087d6320
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.524.148 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : [][]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.524.192 [api_impl.cc:1120] 618674 StreamCreate: priority=0, flags=1536.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:42.524.211 [stream.cc:73] [618662]Construct stream by stream type success, ptr[0xaaab13a1c130] ctx[0xaaab087d6320], stream id[4], cqId[4], logicCqid[314]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.524.220 [npu_driver.cc:404] 618674 StreamIdAlloc: stream id alloc begin, device_id=7, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.524.253 [api_impl.cc:1120] 618662 StreamCreate: priority=0, flags=1536.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.524.262 [stream.cc:2246] 618674 AllocExecutedTimesSvm: stream_id=5.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.524.275 [npu_driver.cc:404] 618662 StreamIdAlloc: stream id alloc begin, device_id=4, priority=0, ts_id=0, remote_stream_id=0
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.524.283 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : [][]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.524.301 [stream_sqcq_manage.cc:147] 618674 Alloc: deviceId=7, tsId=0, drvFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.524.305 [stream.cc:2246] 618662 AllocExecutedTimesSvm: stream_id=5.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.524.318 [npu_driver.cc:882] 618674 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.524.342 [stream_sqcq_manage.cc:147] 618662 Alloc: deviceId=4, tsId=0, drvFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.524.359 [npu_driver.cc:882] 618662 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.524.401 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : [][]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.524.563 [npu_driver.cc:6125] 618674 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.524.613 [npu_driver.cc:6137] 618674 LogicCqAllocateV2: success: deviceId=7, tsId=0, cqId=335, streamId=5, logicCq=335, cqeDepth=4096
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.524.636 [npu_driver.cc:6189] 618674 StreamBindLogicCq: success: deviceId=7, tsId=0, streamId=5, logicCq=335.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.524.653 [npu_driver.cc:5916] 618674 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=c8007000, addr=dfffc8007000size=4096
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.524.669 [stream.cc:653] 618674 Setup: Success to get sq=5 sq reg virtual addr length=4096.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.524.688 [npu_driver.cc:6125] 618662 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] DRV(618674,python3.9):2025-04-03-09:27:42.524.719 [devmm_svm.c:1972][ascend][curpid:618674,618674][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.524.738 [npu_driver.cc:6080] 618674 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.524.737 [npu_driver.cc:6137] 618662 LogicCqAllocateV2: success: deviceId=4, tsId=0, cqId=315, streamId=5, logicCq=315, cqeDepth=4096
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.524.759 [npu_driver.cc:6189] 618662 StreamBindLogicCq: success: deviceId=4, tsId=0, streamId=5, logicCq=315.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.524.777 [npu_driver.cc:5916] 618662 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=e040c000, addr=dfffe040c000size=4096
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.524.794 [stream.cc:653] 618662 Setup: Success to get sq=5 sq reg virtual addr length=4096.
[INFO] DRV(618662,python3.9):2025-04-03-09:27:42.524.837 [devmm_svm.c:1972][ascend][curpid:618662,618662][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.524.856 [npu_driver.cc:6080] 618662 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.525.045 [stream.cc:291] 618674 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=5, flags_=0x600.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.525.067 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNormGradV3] register OP_IMPL : [][]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.525.166 [stream.cc:291] 618662 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=5, flags_=0x600.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.525.689 [stream.cc:688] 618674 Setup: stream setup end, stream_id=5, IsTaskSink=0, sqId=5, cqId=5, deviceId=7, streamResId=65535
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.525.710 [acl_resource_manager.cpp:814]618674 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.525.723 [acl_resource_manager.cpp:816]618674 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.525.738 [api_impl.cc:1162] 618674 StreamCreate: Succ, flags=1536, stream_id=5, context=aaab0103b880
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:42.525.762 [stream.cc:73] [618674]Construct stream by stream type success, ptr[0xaaab0c4c3470] ctx[0xaaab0103b880], stream id[5], cqId[5], logicCqid[335]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.525.798 [stream.cc:688] 618662 Setup: stream setup end, stream_id=5, IsTaskSink=0, sqId=5, cqId=5, deviceId=4, streamResId=65535
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.525.820 [acl_resource_manager.cpp:814]618662 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.525.836 [acl_resource_manager.cpp:816]618662 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.525.850 [api_impl.cc:1162] 618662 StreamCreate: Succ, flags=1536, stream_id=5, context=aaab087d6320
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:42.525.872 [stream.cc:73] [618662]Construct stream by stream type success, ptr[0xaaab13a98190] ctx[0xaaab087d6320], stream id[5], cqId[5], logicCqid[315]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.525.878 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : [][]
[WARNING] HCCL(618674,python3.9):2025-04-03-09:27:42.526.004 [sal.cc:619] [618888]err[34] link[Hccl_MessageProcess] nameSet failed.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:42.526.031 [hcom_executor.cc:587] [618888]MessageProcessThreadLoop start queType:[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.054 [api_impl.cc:2999] 618888 SetDevice: device_id=7, deviceMode=0.
[WARNING] HCCL(618674,python3.9):2025-04-03-09:27:42.526.062 [sal.cc:619] [618889]err[34] link[Hccl_MessageProcess] nameSet failed.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.071 [device.cc:306] 618888 Init: device mode has been already set, mode=0.
[WARNING] HCCL(618662,python3.9):2025-04-03-09:27:42.526.077 [sal.cc:619] [618890]err[34] link[Hccl_MessageProcess] nameSet failed.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:42.526.100 [hcom_executor.cc:587] [618889]MessageProcessThreadLoop start queType:[1]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.105 [runtime.cc:3393] 618888 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x3
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.107 [api_impl.cc:2999] 618891 SetDevice: device_id=7, deviceMode=0.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:42.526.108 [hcom_executor.cc:587] [618890]MessageProcessThreadLoop start queType:[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:42.526.115 [hcom_executor.cc:34] [618674][Initialize][HcomExecutor]Hcom Excutor Initialize end. ret[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.134 [api_impl.cc:2999] 618890 SetDevice: device_id=4, deviceMode=0.
[WARNING] HCCL(618662,python3.9):2025-04-03-09:27:42.526.134 [sal.cc:619] [618892]err[34] link[Hccl_MessageProcess] nameSet failed.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.125 [runtime.cc:3560] 618888 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.129 [api_impl.cc:2999] 618889 SetDevice: device_id=7, deviceMode=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.151 [device.cc:306] 618890 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.133 [device.cc:306] 618891 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.147 [api_impl.cc:2999] 618893 SetDevice: device_id=7, deviceMode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.164 [api_impl.cc:2987] 618888 NewDevice: SetCurRef = 0xaaab0103b880,userDeviceId=7,deviceId=7
[INFO] HCCL_ADPT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.526.173 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:792] InitHcclExec] Hcom DynamicKernel Initialize success
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:42.526.165 [hcom_executor.cc:587] [618892]MessageProcessThreadLoop start queType:[1]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.170 [runtime.cc:3393] 618890 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x3
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.183 [runtime.cc:3393] 618891 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.179 [api_impl.cc:2999] 618894 SetDevice: device_id=4, deviceMode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.185 [device.cc:306] 618889 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.192 [runtime.cc:5239] 618888 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] HCCL_ADPT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.526.207 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:798] InitHcclExec] InitHcclExec success
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:42.526.185 [hcom_executor.cc:34] [618662][Initialize][HcomExecutor]Hcom Excutor Initialize end. ret[0]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.526.210 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [][]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.207 [runtime.cc:3560] 618891 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.217 [runtime.cc:3393] 618889 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x5
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.219 [device.cc:306] 618893 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.223 [api_impl.cc:2992] 618888 NewDevice: New device success, user_device_id=7, die_num=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.206 [runtime.cc:3560] 618890 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.207 [api_impl.cc:2999] 618892 SetDevice: device_id=4, deviceMode=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.221 [device.cc:306] 618894 Init: device mode has been already set, mode=0.
[INFO] HCCL_ADPT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.526.230 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:291] InitHccl] Init hccl adapter success.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.230 [api_impl.cc:2987] 618891 NewDevice: SetCurRef = 0xaaab0103b880,userDeviceId=7,deviceId=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.235 [runtime.cc:3560] 618889 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=7
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.224 [api_impl.cc:2999] 618895 SetDevice: device_id=4, deviceMode=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.233 [api_impl.cc:2987] 618890 NewDevice: SetCurRef = 0xaaab087d6320,userDeviceId=4,deviceId=4
[INFO] HCCL_ADPT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.526.251 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:792] InitHcclExec] Hcom DynamicKernel Initialize success
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.241 [runtime.cc:3393] 618893 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x6
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:42.526.255 [awatchdog_core.c:175](tid:618888) create watchdog for id : 65543, tid : 618888, timeout : 300s
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.252 [runtime.cc:3393] 618894 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.254 [device.cc:306] 618892 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.259 [runtime.cc:5239] 618891 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.264 [api_impl.cc:2987] 618889 NewDevice: SetCurRef = 0xaaab0103b880,userDeviceId=7,deviceId=7
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.262 [runtime.cc:5239] 618890 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] HCCL_ADPT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.526.278 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:798] InitHcclExec] InitHcclExec success
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.526.270 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:92] Initialize] Successfully initialize HCCL.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.274 [runtime.cc:3560] 618893 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=7
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.278 [runtime.cc:3560] 618894 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=4
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.279 [api_impl.cc:3025] 618888 SetDevice: SetDevice success, curCtx=0xaaab0103b880, user_device_id=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.289 [api_impl.cc:2992] 618891 NewDevice: New device success, user_device_id=7, die_num=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.292 [runtime.cc:5239] 618889 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.289 [runtime.cc:3393] 618892 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x5
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.291 [device.cc:306] 618895 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.293 [api_impl.cc:2992] 618890 NewDevice: New device success, user_device_id=4, die_num=1.
[INFO] HCCL_ADPT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.526.304 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:291] InitHccl] Init hccl adapter success.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.305 [api_impl.cc:2987] 618894 NewDevice: SetCurRef = 0xaaab087d6320,userDeviceId=4,deviceId=4
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.305 [api_impl.cc:2987] 618893 NewDevice: SetCurRef = 0xaaab0103b880,userDeviceId=7,deviceId=7
[INFO] DISTRIBUTED(618674,ffff8b99cd[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.312 [runtime.cc:3560] 618892 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.318 [runtime.cc:3393] 618895 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x6
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:42.526.326 [awatchdog_core.c:175](tid:618890) create watchdog for id : 65543, tid : 618890, timeout : 300s
e0,python3.9):2025-04-03-09:27:42.526.311 [mindspore/ccsrc/distributed/collective/collective_manager.cc:628] InitDeviceCommLib] Communication library on device side is successfully initialized.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:42.526.323 [awatchdog_core.c:175](tid:618891) create watchdog for id : 65543, tid : 618891, timeout : 300s
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.336 [runtime.cc:5239] 618894 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.526.341 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:92] Initialize] Successfully initialize HCCL.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.328 [api_impl.cc:2992] 618889 NewDevice: New device success, user_device_id=7, die_num=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.342 [api_impl.cc:2987] 618892 NewDevice: SetCurRef = 0xaaab087d6320,userDeviceId=4,deviceId=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.347 [runtime.cc:3560] 618895 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=4
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.330 [runtime.cc:5239] 618893 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.361 [api_impl.cc:3025] 618891 SetDevice: SetDevice success, curCtx=0xaaab0103b880, user_device_id=7.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:42.526.372 [awatchdog_core.c:175](tid:618889) create watchdog for id : 65543, tid : 618889, timeout : 300s
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.375 [api_impl.cc:2992] 618893 NewDevice: New device success, user_device_id=7, die_num=1.
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.526.382 [mindspore/ccsrc/distributed/collective/collective_manager.cc:211] Initialize] [PROF]InitDeviceBackend costs 1139.6 msec.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.386 [api_impl.cc:3025] 618889 SetDevice: SetDevice success, curCtx=0xaaab0103b880, user_device_id=7.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.354 [api_impl.cc:3025] 618890 SetDevice: SetDevice success, curCtx=0xaaab087d6320, user_device_id=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.365 [api_impl.cc:2992] 618894 NewDevice: New device success, user_device_id=4, die_num=1.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:42.526.394 [awatchdog_core.c:175](tid:618893) create watchdog for id : 65543, tid : 618893, timeout : 300s
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.526.410 [api_impl.cc:3025] 618893 SetDevice: SetDevice success, curCtx=0xaaab0103b880, user_device_id=7.
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.526.375 [mindspore/ccsrc/distributed/collective/collective_manager.cc:628] InitDeviceCommLib] Communication library on device side is successfully initialized.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.373 [runtime.cc:5239] 618892 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.379 [api_impl.cc:2987] 618895 NewDevice: SetCurRef = 0xaaab087d6320,userDeviceId=4,deviceId=4
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:42.526.415 [awatchdog_core.c:175](tid:618894) create watchdog for id : 65543, tid : 618894, timeout : 300s
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.526.419 [mindspore/ccsrc/distributed/collective/collective_manager.cc:860] IsAsyncInitGlobalComm] Async initialize global comm: 0. async_conf: 1, is_graph: 0, use_rank_table: 0, simulation: 0, use_mpi: 0, is_ascend: 1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.425 [api_impl.cc:2992] 618892 NewDevice: New device success, user_device_id=4, die_num=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.426 [runtime.cc:5239] 618895 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.526.430 [mindspore/ccsrc/distributed/collective/collective_manager.cc:211] Initialize] [PROF]InitDeviceBackend costs 1132.64 msec.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.431 [api_impl.cc:3025] 618894 SetDevice: SetDevice success, curCtx=0xaaab087d6320, user_device_id=4.
[WARNING] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.526.442 [mindspore/ccsrc/distributed/collective/collective_manager.cc:335] CreateCommunicationGroup] Start to create communication group: hccl_world_group [const vector]{0, 1, 2, 3, 4, 5, 6, 7}, async: 0, submit_now: 1
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:42.526.444 [awatchdog_core.c:175](tid:618892) create watchdog for id : 65543, tid : 618892, timeout : 300s
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.449 [api_impl.cc:2992] 618895 NewDevice: New device success, user_device_id=4, die_num=1.
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.526.468 [mindspore/ccsrc/distributed/collective/collective_manager.cc:860] IsAsyncInitGlobalComm] Async initialize global comm: 0. async_conf: 1, is_graph: 0, use_rank_table: 0, simulation: 0, use_mpi: 0, is_ascend: 1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.465 [api_impl.cc:3025] 618892 SetDevice: SetDevice success, curCtx=0xaaab087d6320, user_device_id=4.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:42.526.475 [awatchdog_core.c:175](tid:618895) create watchdog for id : 65543, tid : 618895, timeout : 300s
[WARNING] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.526.487 [mindspore/ccsrc/distributed/collective/collective_manager.cc:335] CreateCommunicationGroup] Start to create communication group: hccl_world_group [const vector]{0, 1, 2, 3, 4, 5, 6, 7}, async: 0, submit_now: 1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.526.491 [api_impl.cc:3025] 618895 SetDevice: SetDevice success, curCtx=0xaaab087d6320, user_device_id=4.
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.526.504 [mindspore/ccsrc/distributed/collective/collective_manager.cc:367] CreateCommunicationGroup] [PROF]CreateCommunicationGroupOnHostSide costs 0.021 msec.
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.526.530 [mindspore/ccsrc/distributed/collective/collective_manager.cc:367] CreateCommunicationGroup] [PROF]CreateCommunicationGroupOnHostSide costs 0.013 msec.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.526.563 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:148] CreateCommunicationGroup] Successfully create LCCL communication group hccl_world_group
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.526.571 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:148] CreateCommunicationGroup] Successfully create LCCL communication group hccl_world_group
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.526.601 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:166] CreateCommunicationGroup] Successfully create HCCL communication group hccl_world_group
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.526.602 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:166] CreateCommunicationGroup] Successfully create HCCL communication group hccl_world_group
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.526.625 [mindspore/ccsrc/distributed/collective/collective_manager.cc:374] CreateCommunicationGroup] [PROF]CreateCommunicationGroupOnDeviceSide costs 0.095 msec.
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.526.625 [mindspore/ccsrc/distributed/collective/collective_manager.cc:374] CreateCommunicationGroup] [PROF]CreateCommunicationGroupOnDeviceSide costs 0.069 msec.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.526.657 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [][]
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.526.751 [mindspore/ccsrc/distributed/collective/collective_manager.cc:919] SubmitCreateDeviceCommTask] Launch init comm thread.
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.526.749 [mindspore/ccsrc/distributed/collective/collective_manager.cc:919] SubmitCreateDeviceCommTask] Launch init comm thread.
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:42.526.777 [mindspore/ccsrc/distributed/collective/collective_manager.cc:925] SubmitCreateDeviceCommTask] Submit init communicator task for hccl_world_group. Call 'WaitCommInitDone' later to wait initialization to be done.
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:42.526.789 [mindspore/ccsrc/distributed/collective/collective_manager.cc:925] SubmitCreateDeviceCommTask] Submit init communicator task for hccl_world_group. Call 'WaitCommInitDone' later to wait initialization to be done.
[INFO] DISTRIBUTED(618674,fffea67cefa0,python3.9):2025-04-03-09:27:42.526.894 [mindspore/ccsrc/distributed/collective/collective_manager.cc:973] RunInitCommTasks] Create device communicator in thread for group: hccl_world_group
[INFO] DISTRIBUTED(618662,fffed1fbefa0,python3.9):2025-04-03-09:27:42.526.907 [mindspore/ccsrc/distributed/collective/collective_manager.cc:973] RunInitCommTasks] Create device communicator in thread for group: hccl_world_group
[INFO] DISTRIBUTED(618662,fffed1fbefa0,python3.9):2025-04-03-09:27:42.526.934 [mindspore/ccsrc/distributed/collective/collective_manager.cc:764] CreateDeviceCommunicator] Create device communicator for hccl_world_group
[INFO] DISTRIBUTED(618674,fffea67cefa0,python3.9):2025-04-03-09:27:42.526.933 [mindspore/ccsrc/distributed/collective/collective_manager.cc:764] CreateDeviceCommunicator] Create device communicator for hccl_world_group
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.526.982 [device.cpp:143]618896 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 4.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.526.987 [device.cpp:143]618897 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 7.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.527.013 [api_impl.cc:2999] 618896 SetDevice: device_id=4, deviceMode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.527.022 [api_impl.cc:2999] 618897 SetDevice: device_id=7, deviceMode=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.527.030 [device.cc:306] 618896 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.527.039 [device.cc:306] 618897 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.527.045 [runtime.cc:3393] 618896 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.527.056 [runtime.cc:3393] 618897 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x7
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.527.062 [runtime.cc:3560] 618896 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=4
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.527.073 [runtime.cc:3560] 618897 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=7
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.527.078 [api_impl.cc:2987] 618896 NewDevice: SetCurRef = 0xaaab087d6320,userDeviceId=4,deviceId=4
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.527.087 [api_impl.cc:2987] 618897 NewDevice: SetCurRef = 0xaaab0103b880,userDeviceId=7,deviceId=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.527.103 [runtime.cc:5239] 618897 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.527.092 [runtime.cc:5239] 618896 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.527.110 [api_impl.cc:2992] 618896 NewDevice: New device success, user_device_id=4, die_num=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.527.118 [api_impl.cc:2992] 618897 NewDevice: New device success, user_device_id=7, die_num=1.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:42.527.132 [awatchdog_core.c:175](tid:618896) create watchdog for id : 65543, tid : 618896, timeout : 300s
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:42.527.137 [awatchdog_core.c:175](tid:618897) create watchdog for id : 65543, tid : 618897, timeout : 300s
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.527.152 [api_impl.cc:3025] 618897 SetDevice: SetDevice success, curCtx=0xaaab0103b880, user_device_id=7.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.527.150 [api_impl.cc:3025] 618896 SetDevice: SetDevice success, curCtx=0xaaab087d6320, user_device_id=4.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.527.164 [acl.cpp:115]618896 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.527.180 [acl.cpp:121]618896 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.527.167 [acl.cpp:115]618897 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.527.181 [acl.cpp:121]618897 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.527.195 [device.cpp:154]618897 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 7
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.527.194 [device.cpp:154]618896 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 4
[INFO] DISTRIBUTED(618662,fffed1fbefa0,python3.9):2025-04-03-09:27:42.527.228 [mindspore/ccsrc/distributed/collective/collective_manager.cc:787] CreateDeviceCommunicator] [PROF]GenerateRootInfo costs 0.241 msec.
[INFO] DISTRIBUTED(618674,fffea67cefa0,python3.9):2025-04-03-09:27:42.527.235 [mindspore/ccsrc/distributed/collective/collective_manager.cc:787] CreateDeviceCommunicator] [PROF]GenerateRootInfo costs 0.235 msec.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.527.259 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.527.381 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.527.496 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : [][]
[WARNING] DEVICE(618662,fffed1fbefa0,python3.9):2025-04-03-09:27:42.527.589 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:248] QueryUniqueID] Retry to lookup the unique id for group hccl_world_group from the meta server node...Retry time: 399/400, sleep 2
[WARNING] DEVICE(618674,fffea67cefa0,python3.9):2025-04-03-09:27:42.527.597 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:248] QueryUniqueID] Retry to lookup the unique id for group hccl_world_group from the meta server node...Retry time: 399/400, sleep 1
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.527.637 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.527.748 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.527.740 [op_impl_registry_holder_manager.cc:208]618650 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 599
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.528.026 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPool3DWithArgmaxV2] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.529.720 [op_impl_registry_holder_manager.cc:208]618650 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.530.201 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPool3DGradWithArgmax] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.531.018 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.531.176 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [][]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.531.283 [op_impl_space_registry.cc:109]618670 MergeFunctions:op type AvgPool3DGrad inputs_dependency has been registered
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.531.332 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CTCLossV3Grad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.532.331 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CTCLossV3] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.532.480 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.532.628 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3DGrad] register OP_IMPL : [][]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.532.638 [op_impl_space_registry.cc:84]618670 MergeFunctions:op type MoeInitRoutingV2 tiling_parse func has been registered
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.532.670 [op_impl_space_registry.cc:85]618670 MergeFunctions:op type MoeInitRoutingV2 compile_info_creator func has been registered
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.532.686 [op_impl_space_registry.cc:86]618670 MergeFunctions:op type MoeInitRoutingV2 compile_info_deleter func has been registered
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.532.699 [op_impl_space_registry.cc:87]618670 MergeFunctions:op type MoeInitRoutingV2 tiling func has been registered
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.532.714 [op_impl_space_registry.cc:93]618670 MergeFunctions:op type MoeInitRoutingV2 max_tiling_data_size has been registered
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.533.076 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.533.193 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.533.311 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.533.430 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.533.546 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.533.659 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.533.722 [op_impl_space_registry.cc:273]618670 ConvertSoToRegistry:Save so symbol and handle in path[/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so] success!
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.533.771 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.533.880 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.533.993 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.534.107 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.534.192 [plugin_manager.cc:564]618670 GetUpgradedOpMasterPath:Start to get upgraded op tiling path
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.534.220 [plugin_manager.cc:134]618670 GetUpgradedOppPath:Enter get upgraded opp path schedule
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.534.219 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [][]
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.534.278 [file_utils.cc:47]618670 RealPath:[Util][realpath] Can not get real_path for /usr/local/Ascend/ascend-toolkit/latest/opp_latest/, reason:No such file or directory
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.534.297 [plugin_manager.cc:145]618670 GetUpgradedOppPath:[Call][RealPath] Opp path /usr/local/Ascend/ascend-toolkit/latest/opp_latest/ is invalid.
[WARNING] GE(618670,python3.9):2025-04-03-09:27:42.534.309 [plugin_manager.cc:567]618670 GetUpgradedOpMasterPath:Failed to get upgraded opp path!
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.534.383 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PadV3GradReplication] register OP_IMPL : [][][][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.534.376 [mem_manager.cc:31]618670 Initialize:MemManager Initialize.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.534.433 [rts_caching_mem_allocator.cc:131]618670 Initialize:RtsAllocatorManager Initialize.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.534.451 [mem_manager.cc:102]618670 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.534.465 [graph_mem_allocator.cc:17]618670 Initialize:MemoryAllocator::Initialize.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.534.481 [mem_manager.cc:102]618670 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.534.496 [graph_mem_allocator.cc:17]618670 Initialize:MemoryAllocator::Initialize.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.534.490 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.534.510 [mem_manager.cc:102]618670 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.534.525 [caching_allocator.cc:391]618670 FreeBlocks:Free blocks.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.534.539 [caching_allocator.cc:358]618670 FreeCachedBlocks:Free cached blocks
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.534.553 [mem_manager.cc:102]618670 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.534.568 [caching_allocator.cc:391]618670 FreeBlocks:Free blocks.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.534.576 [caching_allocator.cc:358]618670 FreeCachedBlocks:Free cached blocks
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.534.590 [mem_manager.cc:102]618670 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.534.606 [mem_manager.cc:102]618670 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.534.605 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : [][]
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.534.618 [mem_manager.cc:102]618670 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.534.633 [mem_manager.cc:102]618670 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.534.648 [mem_manager.cc:102]618670 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.534.662 [session_scope_mem_allocator.cc:73]618670 FreeAllMemory:Free all memory
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.534.675 [mem_manager.cc:102]618670 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.534.689 [session_scope_mem_allocator.cc:73]618670 FreeAllMemory:Free all memory
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.534.734 [dump_manager.cc:152]618670 Init:exception dump is not enabled
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.534.781 [ge_executor.cc:315]618670 Initialize:Init GeExecutor over.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.534.796 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [][]
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.534.803 [acl.cpp:321]618670 aclInit: set DumpConfig in aclInit
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.534.820 [dump.cpp:841]618670 HandleDumpConfig: start to execute HandleDumpConfig.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.534.905 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : [][]
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.534.996 [dump.cpp:759]618670 ConvertDumpCfg: start to execute ConvertDumpCfg.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.535.012 [dump.cpp:594]618670 IsValidDumpConfig: start to execute IsValidDumpConfig.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.535.023 [dump.cpp:224]618670 CheckDumpSceneSwitch: start to execute CheckDumpSceneSwitch.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.535.018 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : [][]
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.535.069 [dump.cpp:703]618670 SetUpDumpConfig: convert to ge dump config successfully, enable lite_exception dump, path=
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.535.089 [dump.cpp:771]618670 HandleDumpCommand: start to execute HandleDumpCommand.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.535.105 [dump.cpp:703]618670 SetUpDumpConfig: convert to ge dump config successfully, enable lite_exception dump, path=
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.535.138 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : [][]
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.535.175 [adx_datadump_server.cpp:77][tid:618670] start to do dump init
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.535.196 [adx_dump_record.cpp:210][tid:618670] dumpPath prefix is /home/jenkins/mindspore/testcases/testcases/tests/st/lccl
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.535.222 [adx_dump_record.cpp:214][tid:618670] record remote dump temp path : /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.535.289 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [][]
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.535.418 [adx_dump_record.cpp:627][tid:618899] start dump thread, remote dump record temp path : /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/.
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.535.424 [adx_server_manager.cpp:149][tid:618898] server manager add component (10)
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.535.457 [adx_server_manager.cpp:165][tid:618898] server manager components init successfully
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.535.466 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [][]
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.535.560 [adx_server_manager.cpp:203][tid:618900] Run Server(0) Process
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.535.583 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [][]
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.535.607 [adx_server_manager.cpp:369][tid:618900] device up 0
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.535.627 [hdc_comm_opt.cpp:59][tid:618900] open device[0] server[13]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.535.692 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.535.718 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [][]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:42.535.804 [drv_log_user.c:623][ascend][curpid:618670,618900][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=0; fid=0; service_type="service_dump"; pid=618670)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:42.535.824 [hdc_server.c:363][ascend][curpid:618670,618900][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=0)
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.535.843 [hdc_api.cpp:119][tid:618900] logDevId 0 create HDC server successfully
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.535.888 [adx_server_manager.cpp:111][tid:618900] create server info
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.535.903 [adx_server_manager.cpp:369][tid:618900] device up 1
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.535.914 [hdc_comm_opt.cpp:59][tid:618900] open device[1] server[13]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.535.910 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.536.025 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [][]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:42.536.087 [drv_log_user.c:623][ascend][curpid:618670,618900][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=1; fid=0; service_type="service_dump"; pid=618670)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:42.536.104 [hdc_server.c:363][ascend][curpid:618670,618900][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=1)
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.536.116 [hdc_api.cpp:119][tid:618900] logDevId 1 create HDC server successfully
[WARNING] IDEDD(618670,python3.9):2025-04-03-09:27:42.536.128 [adx_hdc_epoll.cpp:34][tid:618900] hdc epoll has been created.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.536.134 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : [][]
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.536.145 [adx_server_manager.cpp:111][tid:618900] create server info
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.536.175 [adx_server_manager.cpp:369][tid:618900] device up 2
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.536.193 [hdc_comm_opt.cpp:59][tid:618900] open device[2] server[13]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:42.536.325 [drv_log_user.c:623][ascend][curpid:618670,618900][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=2; fid=0; service_type="service_dump"; pid=618670)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:42.536.342 [hdc_server.c:363][ascend][curpid:618670,618900][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=2)
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.536.321 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [][]
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.536.356 [hdc_api.cpp:119][tid:618900] logDevId 2 create HDC server successfully
[WARNING] IDEDD(618670,python3.9):2025-04-03-09:27:42.536.370 [adx_hdc_epoll.cpp:34][tid:618900] hdc epoll has been created.
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.536.382 [adx_server_manager.cpp:111][tid:618900] create server info
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.536.396 [adx_server_manager.cpp:369][tid:618900] device up 3
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.536.406 [hdc_comm_opt.cpp:59][tid:618900] open device[3] server[13]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.536.445 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [][]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:42.536.576 [drv_log_user.c:623][ascend][curpid:618670,618900][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=3; fid=0; service_type="service_dump"; pid=618670)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:42.536.602 [hdc_server.c:363][ascend][curpid:618670,618900][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=3)
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.536.614 [hdc_api.cpp:119][tid:618900] logDevId 3 create HDC server successfully
[WARNING] IDEDD(618670,python3.9):2025-04-03-09:27:42.536.626 [adx_hdc_epoll.cpp:34][tid:618900] hdc epoll has been created.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.536.607 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [][]
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.536.641 [adx_server_manager.cpp:111][tid:618900] create server info
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.536.655 [adx_server_manager.cpp:369][tid:618900] device up 4
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.536.667 [hdc_comm_opt.cpp:59][tid:618900] open device[4] server[13]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.536.734 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [][]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:42.536.782 [drv_log_user.c:623][ascend][curpid:618670,618900][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=4; fid=0; service_type="service_dump"; pid=618670)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:42.536.798 [hdc_server.c:363][ascend][curpid:618670,618900][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=4)
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.536.810 [hdc_api.cpp:119][tid:618900] logDevId 4 create HDC server successfully
[WARNING] IDEDD(618670,python3.9):2025-04-03-09:27:42.536.821 [adx_hdc_epoll.cpp:34][tid:618900] hdc epoll has been created.
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.536.837 [adx_server_manager.cpp:111][tid:618900] create server info
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.536.848 [adx_server_manager.cpp:369][tid:618900] device up 5
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.536.849 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [][]
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.536.859 [hdc_comm_opt.cpp:59][tid:618900] open device[5] server[13]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.536.955 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.536.981 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : [][]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:42.536.995 [drv_log_user.c:623][ascend][curpid:618670,618900][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=5; fid=0; service_type="service_dump"; pid=618670)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:42.537.012 [hdc_server.c:363][ascend][curpid:618670,618900][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=5)
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.537.024 [hdc_api.cpp:119][tid:618900] logDevId 5 create HDC server successfully
[WARNING] IDEDD(618670,python3.9):2025-04-03-09:27:42.537.036 [adx_hdc_epoll.cpp:34][tid:618900] hdc epoll has been created.
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.537.051 [adx_server_manager.cpp:111][tid:618900] create server info
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.537.062 [adx_server_manager.cpp:369][tid:618900] device up 6
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.537.074 [hdc_comm_opt.cpp:59][tid:618900] open device[6] server[13]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.537.096 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.537.122 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : [][]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:42.537.190 [drv_log_user.c:623][ascend][curpid:618670,618900][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=6; fid=0; service_type="service_dump"; pid=618670)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:42.537.206 [hdc_server.c:363][ascend][curpid:618670,618900][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=6)
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.537.219 [hdc_api.cpp:119][tid:618900] logDevId 6 create HDC server successfully
[WARNING] IDEDD(618670,python3.9):2025-04-03-09:27:42.537.230 [adx_hdc_epoll.cpp:34][tid:618900] hdc epoll has been created.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.537.230 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : [][]
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.537.247 [adx_server_manager.cpp:111][tid:618900] create server info
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.537.262 [adx_server_manager.cpp:369][tid:618900] device up 7
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.537.274 [hdc_comm_opt.cpp:59][tid:618900] open device[7] server[13]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.537.337 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.537.365 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : [][]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:42.537.408 [drv_log_user.c:623][ascend][curpid:618670,618900][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=7; fid=0; service_type="service_dump"; pid=618670)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:42.537.429 [hdc_server.c:363][ascend][curpid:618670,618900][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=7)
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.537.442 [hdc_api.cpp:119][tid:618900] logDevId 7 create HDC server successfully
[WARNING] IDEDD(618670,python3.9):2025-04-03-09:27:42.537.454 [adx_hdc_epoll.cpp:34][tid:618900] hdc epoll has been created.
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.537.470 [adx_server_manager.cpp:111][tid:618900] create server info
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.537.478 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.537.584 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.537.701 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.537.881 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.538.001 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.538.183 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GridSampler2DGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.538.340 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GridSampler3DGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.538.510 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [][]
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.538.519 [adx_server_manager.cpp:457][tid:618670] The server is initialized after waiting 3 times.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.538.540 [ge_executor.cc:1349]618670 SetDump:Start to set dump config
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.538.557 [dump_manager.cc:201]618670 NeedDoDump:Dump status: on, Overflow detection dump switch: off.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.538.594 [dump_manager.cc:261]618670 SetExceptionDump:Enable brief exception dump.
[INFO] GE(618670,python3.9):2025-04-03-09:27:42.538.642 [ge_executor.cc:1355]618670 SetDump:Set dump config successfully
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.538.681 [dump_manager.cpp:146][tid:618670] Set 3 dump setting, status: on, dump switch: 3
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.538.682 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.538.860 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PadV4Grad] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.539.048 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PadV3GradReplicate] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.539.165 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.539.275 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.539.383 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.539.502 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.539.528 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.539.716 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.539.837 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.539.947 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.540.054 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : [][]
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:42.540.119 [dump_manager.cpp:301][tid:618670] Register exception callback, registered: 1
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.540.176 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : [][]
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.540.140 [dump.cpp:825]618670 HandleDumpCommand: set dump config for model successfully,adumpType = 3, dump_path = , dump_mode = , dump_op_switch = , dump_data = .
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.540.209 [acl.cpp:327]618670 aclInit: set HandleDumpConfig success in aclInit
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.540.232 [acl.cpp:329]618670 aclInit: set max_opqueue_num in aclInit
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.540.245 [acl_resource_manager.cpp:248]618670 HandleMaxOpQueueConfig: start to execute HandleMaxOpQueueConfig
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.540.295 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : [][]
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.540.346 [acl_resource_manager.cpp:275]618670 HandleMaxOpQueueConfig: no max_opqueue_num found, set default DEFAULT_MAX_OPQUEUE_NUM[20000].
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.540.364 [acl_resource_manager.cpp:278]618670 HandleMaxOpQueueConfig: HandleMaxOpQueueConfig end in HandleMaxOpQueueConfig
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.540.376 [acl.cpp:335]618670 aclInit: set HandleMaxOpQueueConfig success in aclInit
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.540.389 [acl.cpp:336]618670 aclInit: set HandleDefaultDevice in aclInit
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.540.412 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.540.438 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : [][]
[WARNING] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.540.457 [json_parser.cpp:260]618670 GetDefaultDeviceIdFromFile: no defaultDevice item!
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.540.476 [acl.cpp:343]618670 aclInit: set HandleDefaultDevice success in aclInit
[INFO] PROFILING(618670,python3.9):2025-04-03-09:27:42.540.497 [prof_atls_plugin.cpp:210] (tid:618670) Module[48] register callback of ctrl handle.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.540.513 [acl.cpp:351]618670 aclInit: set ProfilingConfig in aclInit
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.540.525 [profiling.cpp:141]618670 HandleProfilingConfig: start to execute HandleProfilingConfig
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.540.541 [profiling.cpp:135]618670 GetProfilingConfigFile: no profiling config file.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.540.543 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : [][]
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.540.602 [profiling.cpp:167]618670 HandleProfilingConfig: can not parse profiling config from file[/home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618670.json], errorCode = 0
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.540.619 [profiling.cpp:172]618670 HandleProfilingConfig: profiling config file[/home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618670.json] is empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.540.642 [profiling.cpp:176]618670 HandleProfilingConfig: start to use profiling config by config file mode
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.540.654 [profiling.cpp:179]618670 HandleProfilingConfig: ParseJsonFromFile ok in HandleProfilingConfig
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.540.667 [profiling.cpp:92]618670 HandleProfilingCommand: start to execute HandleProfilingCommand
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.540.762 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [][]
[INFO] PROFILING(618670,python3.9):2025-04-03-09:27:42.541.077 [ai_drv_dev_api.cpp:316] >>> (tid:618670) Succeeded to get device 64 frequency=100000
[INFO] PROFILING(618670,python3.9):2025-04-03-09:27:42.541.197 [msprof_callback_impl.cpp:132] >>> (tid:618670) Dynamic profiling environment not really set, so do nothing.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.541.216 [profiling.cpp:122]618670 HandleProfilingCommand: set profiling config successfully
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.541.227 [profiling.cpp:186]618670 HandleProfilingConfig: set HandleProfilingConfig success
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.541.243 [hash_utils.cpp:108]618670 CalculateSimpleHash: Begin to calculate hash for file: /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618670.json
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.541.285 [hash_utils.cpp:128]618670 CalculateSimpleHash: file: /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618670.json, hash: 3917491750093904922
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.541.302 [acl.cpp:115]618670 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.541.339 [acl.cpp:280]618670 IsEnableAutoUCMemeory: auto-uc-memory is enabled.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.541.354 [acl.cpp:385]618670 aclInit: register kernel launch fill function in aclInit
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.541.374 [runtime.cc:5394] 618670 RegKernelLaunchFillFunc: registercallback finish, symbol:g_opSystemRunCfg.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.541.391 [api_impl.cc:7407] 618670 RegStreamStateCallback: Reg stream state callback, regName=ACL_MODULE_STREAM.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.541.421 [api_impl.cc:4211] 618670 RegDeviceStateCallback: Reg device state callback, regName=ACL_MODULE_DEVICE.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.541.441 [acl.cpp:420]618670 aclInit: successfully execute aclInit, aclInitRefCount is 1
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.541.634 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:199] InitializeAcl] Call aclInit successfully, json is {"dump":{"dump_scene":"lite_exception"},"err_msg_mode":"1"}
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.541.774 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:295] Initialize] End initializing device context.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.541.802 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [][]
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.541.841 [mindspore/ccsrc/plugin/res_manager/ascend/ascend_res_manager.cc:467] LoadCollectiveCommLib] Loading MACCL collective library successfully.
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.541.868 [mindspore/ccsrc/distributed/collective/collective_manager.cc:621] InitDeviceCommLib] Start initializing communication library on device side...
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.544.451 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.544.653 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.544.852 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.545.174 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.545.333 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.545.480 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.546.291 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.546.453 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.546.578 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.546.730 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyAdamWV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.546.884 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.547.011 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.547.159 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.547.308 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.547.456 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.547.586 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.547.692 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.547.786 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [][]
[INFO] PROFILING(618670,python3.9):2025-04-03-09:27:42.547.788 [prof_atls_plugin.cpp:210] (tid:618670) Module[0] register callback of ctrl handle.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.098 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.128 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.152 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.185 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.210 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.233 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.258 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.282 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.304 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.325 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.347 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.371 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.393 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.414 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.436 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.455 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.477 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.498 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.521 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.543 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.565 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.587 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.609 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.641 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.668 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.690 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.714 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [][]
[WARNING] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.548.715 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:76] Initialize] Loading LCCL because env MS_ENABLE_LCCL is set to on. Pay attention that LCCL only supports communication group within single node in KernelByKernel for now.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.737 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [][]
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.548.748 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:80] Initialize] Successfully initialize LCCL.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.759 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.785 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.807 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.829 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [][]
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.548.841 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ascend_deprecated_interface.cc:83] OpenTsd] Device id = 6, rank size = 8.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.851 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [][]
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.548.862 [device.cpp:143]618670 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 6.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.873 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.895 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [][]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.548.889 [api_impl.cc:2999] 618670 SetDevice: device_id=6, deviceMode=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.548.909 [device.cc:306] 618670 Init: device mode has been already set, mode=0.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.916 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [][]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.548.930 [runtime.cc:3393] 618670 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x2
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.939 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [][]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.548.949 [runtime.cc:3560] 618670 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.548.967 [api_impl.cc:2987] 618670 NewDevice: SetCurRef = 0xaaaad9a630c0,userDeviceId=6,deviceId=6
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.968 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [][]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.548.984 [runtime.cc:5239] 618670 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.548.992 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [][]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.549.006 [api_impl.cc:2992] 618670 NewDevice: New device success, user_device_id=6, die_num=1.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.549.014 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [][]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.549.029 [api_impl.cc:3025] 618670 SetDevice: SetDevice success, curCtx=0xaaaad9a630c0, user_device_id=6.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.549.037 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [][]
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.549.045 [acl.cpp:115]618670 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.549.061 [acl.cpp:121]618670 GetSocVersion: socVersion is Ascend910B3
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.549.059 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.549.082 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [][]
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.549.086 [device.cpp:154]618670 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 6
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.549.103 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.549.127 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [][]
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.549.141 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel _npu_log begins the construction process witch capacity 128
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.549.148 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.549.170 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [][]
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.549.170 [tensor_data_transfer.cpp:898]618670 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 6, name is _npu_log, capacity is 128
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.549.195 [api_impl.cc:6077] 618670 MemQueueInit: Start to init queue on devId 6.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.549.192 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [][]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.549.210 [npu_driver.cc:4076] 618670 MemQueueInit: init mem queue, device_id=6.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.549.224 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [][]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.549.228 [npu_driver.cc:4026] 618670 CheckMemQueueSupported: get majorVersion 7
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.549.247 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.549.272 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [][]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:42.549.270 [queue_client.c:151][ascend][curpid:618670,618670][drv][queuemng][QueueGetHostpid]Query tgid. (tgid=618670)
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.549.295 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.549.322 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.549.344 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.549.367 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.549.389 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [][]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:42.549.447 [queue_client.c:305][ascend][curpid:618670,618670][drv][queuemng][QueueGetDevPid]Query devpid succ. (devId=6; vfid=0; hostpid=618670; master_pid=618670; proc_type=0; devpid=29743).
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.549.544 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachACosInplace] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.549.692 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachAddListInplace] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.549.864 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMulScalarInplace] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.549.892 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachLogInplace] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.549.916 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSubListInplace] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.549.940 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachMulListInplace] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.549.963 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachDivListInplace] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.550.120 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachSubScalarInplace] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.550.231 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.550.342 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.550.449 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.550.555 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.550.658 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.550.819 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3dGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.550.934 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.551.093 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.551.214 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.551.334 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.551.361 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.551.388 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.551.492 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.551.517 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.551.542 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.551.656 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.551.810 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.551.962 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.552.102 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.552.225 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.552.416 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IndexPutWithSort] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.552.532 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.552.714 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InplaceIndexAddWithSorted] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.552.826 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.552.939 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.552.965 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.552.989 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.553.135 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.553.285 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [][]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:42.553.385 [queue_client.c:362][ascend][curpid:618670,618670][drv][queuemng][QueueInit]QueueInit device. (devid=6; mcast_flag=0; mcast_gid=0; proc_sn=0; event_sn_offset=0)
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.553.434 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [][]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.553.568 [npu_driver.cc:4114] 618670 MemQueueInit: get max queue cnt 4294967294 success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.553.584 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [][]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.553.590 [api_impl.cc:6040] 618670 MemQueueCreate: Start to create queue on devId 6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.553.609 [npu_driver.cc:3931] 618670 MemQueueCreate: create mem queue, deviceId=6, name=_npu_log.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.553.759 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.553.898 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [][]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:42.553.895 [queue_interface.c:182][ascend][curpid:618670,618670][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=0, actualQid=0, deploy_type=0)
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.553.924 [tensor_data_transfer.cpp:940]618670 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 6, name is _npu_log, real name is _npu_log, qid is 0
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.554.017 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [][]
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.554.067 [tensor_data_transfer.cpp:1054]618901 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is _npu_log
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.554.104 [tensor_data_transfer.cpp:1056]618901 acltdtReceiveTensor: new process, use queue process
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.554.113 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_tensor_dump begins the construction process witch capacity 128
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.554.137 [api_impl.cc:6121] 618901 MemQueuePeek: Start to peek queue on devId 6, qid is 0.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.554.135 [tensor_data_transfer.cpp:898]618670 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 6, name is ms_tensor_dump, capacity is 128
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.554.155 [npu_driver.cc:4330] 618901 MemQueuePeek: peek mem queue, deviceId=6, qid=0, timeout=800.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.554.162 [api_impl.cc:6077] 618670 MemQueueInit: Start to init queue on devId 6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.554.177 [npu_driver.cc:4076] 618670 MemQueueInit: init mem queue, device_id=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.554.194 [npu_driver.cc:4026] 618670 CheckMemQueueSupported: get majorVersion 7
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.554.174 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [][]
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:42.554.240 [npu_driver.cc:4087] 618670 MemQueueInit: repeated init
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.554.258 [api_impl.cc:6040] 618670 MemQueueCreate: Start to create queue on devId 6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.554.274 [npu_driver.cc:3931] 618670 MemQueueCreate: create mem queue, deviceId=6, name=ms_tensor_dump.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.554.346 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.554.522 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [][]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:42.554.581 [queue_interface.c:182][ascend][curpid:618670,618670][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=1, actualQid=1, deploy_type=0)
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.554.600 [tensor_data_transfer.cpp:940]618670 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 6, name is ms_tensor_dump, real name is ms_tensor_dump, qid is 1
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.554.645 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [][]
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.554.694 [tensor_data_transfer.cpp:1054]618903 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_tensor_dump
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.554.725 [tensor_data_transfer.cpp:1056]618903 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.554.747 [api_impl.cc:6121] 618903 MemQueuePeek: Start to peek queue on devId 6, qid is 1.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.554.748 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_tensor_summary begins the construction process witch capacity 128
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.554.763 [npu_driver.cc:4330] 618903 MemQueuePeek: peek mem queue, deviceId=6, qid=1, timeout=800.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.554.773 [tensor_data_transfer.cpp:898]618670 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 6, name is ms_tensor_summary, capacity is 128
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.554.759 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : [][]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.554.792 [api_impl.cc:6077] 618670 MemQueueInit: Start to init queue on devId 6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.554.808 [npu_driver.cc:4076] 618670 MemQueueInit: init mem queue, device_id=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.554.827 [npu_driver.cc:4026] 618670 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:42.554.864 [npu_driver.cc:4087] 618670 MemQueueInit: repeated init
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.554.880 [api_impl.cc:6040] 618670 MemQueueCreate: Start to create queue on devId 6.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.554.875 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : [][]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.554.894 [npu_driver.cc:3931] 618670 MemQueueCreate: create mem queue, deviceId=6, name=ms_tensor_summary.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.554.990 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : [][][]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:42.555.067 [queue_interface.c:182][ascend][curpid:618670,618670][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=2, actualQid=2, deploy_type=0)
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.555.087 [tensor_data_transfer.cpp:940]618670 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 6, name is ms_tensor_summary, real name is ms_tensor_summary, qid is 2
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.555.096 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [][]
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.555.207 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_image_summary begins the construction process witch capacity 128
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.555.205 [tensor_data_transfer.cpp:1054]618905 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_tensor_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.555.234 [tensor_data_transfer.cpp:898]618670 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 6, name is ms_image_summary, capacity is 128
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.555.249 [tensor_data_transfer.cpp:1056]618905 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.555.260 [api_impl.cc:6077] 618670 MemQueueInit: Start to init queue on devId 6.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.555.253 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [][]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.555.270 [api_impl.cc:6121] 618905 MemQueuePeek: Start to peek queue on devId 6, qid is 2.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.555.274 [npu_driver.cc:4076] 618670 MemQueueInit: init mem queue, device_id=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.555.288 [npu_driver.cc:4330] 618905 MemQueuePeek: peek mem queue, deviceId=6, qid=2, timeout=800.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.555.294 [npu_driver.cc:4026] 618670 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:42.555.332 [npu_driver.cc:4087] 618670 MemQueueInit: repeated init
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.555.348 [api_impl.cc:6040] 618670 MemQueueCreate: Start to create queue on devId 6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.555.360 [npu_driver.cc:3931] 618670 MemQueueCreate: create mem queue, deviceId=6, name=ms_image_summary.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.555.398 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.555.509 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Resize] register OP_IMPL : [][]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:42.555.524 [queue_interface.c:182][ascend][curpid:618670,618670][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=3, actualQid=3, deploy_type=0)
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.555.542 [tensor_data_transfer.cpp:940]618670 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 6, name is ms_image_summary, real name is ms_image_summary, qid is 3
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.555.624 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [][]
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.555.705 [tensor_data_transfer.cpp:1054]618907 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_image_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.555.729 [tensor_data_transfer.cpp:1056]618907 acltdtReceiveTensor: new process, use queue process
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.555.733 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [][]
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.555.745 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_scalar_summary begins the construction process witch capacity 128
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.555.749 [api_impl.cc:6121] 618907 MemQueuePeek: Start to peek queue on devId 6, qid is 3.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.555.768 [tensor_data_transfer.cpp:898]618670 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 6, name is ms_scalar_summary, capacity is 128
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.555.788 [npu_driver.cc:4330] 618907 MemQueuePeek: peek mem queue, deviceId=6, qid=3, timeout=800.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.555.796 [api_impl.cc:6077] 618670 MemQueueInit: Start to init queue on devId 6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.555.809 [npu_driver.cc:4076] 618670 MemQueueInit: init mem queue, device_id=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.555.824 [npu_driver.cc:4026] 618670 CheckMemQueueSupported: get majorVersion 7
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.555.847 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [][]
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:42.555.857 [npu_driver.cc:4087] 618670 MemQueueInit: repeated init
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.555.874 [api_impl.cc:6040] 618670 MemQueueCreate: Start to create queue on devId 6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.555.890 [npu_driver.cc:3931] 618670 MemQueueCreate: create mem queue, deviceId=6, name=ms_scalar_summary.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.555.955 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [][]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:42.556.045 [queue_interface.c:182][ascend][curpid:618670,618670][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=4, actualQid=4, deploy_type=0)
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.556.064 [tensor_data_transfer.cpp:940]618670 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 6, name is ms_scalar_summary, real name is ms_scalar_summary, qid is 4
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.556.194 [tensor_data_transfer.cpp:1054]618909 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_scalar_summary
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.556.221 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_histogram_summary begins the construction process witch capacity 128
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.556.239 [tensor_data_transfer.cpp:1056]618909 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.556.248 [tensor_data_transfer.cpp:898]618670 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 6, name is ms_histogram_summary, capacity is 128
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.556.264 [api_impl.cc:6121] 618909 MemQueuePeek: Start to peek queue on devId 6, qid is 4.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.556.267 [api_impl.cc:6077] 618670 MemQueueInit: Start to init queue on devId 6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.556.279 [npu_driver.cc:4330] 618909 MemQueuePeek: peek mem queue, deviceId=6, qid=4, timeout=800.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.556.285 [npu_driver.cc:4076] 618670 MemQueueInit: init mem queue, device_id=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.556.298 [npu_driver.cc:4026] 618670 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:42.556.336 [npu_driver.cc:4087] 618670 MemQueueInit: repeated init
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.556.352 [api_impl.cc:6040] 618670 MemQueueCreate: Start to create queue on devId 6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.556.363 [npu_driver.cc:3931] 618670 MemQueueCreate: create mem queue, deviceId=6, name=ms_histogram_summary.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.556.400 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [][]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:42.556.520 [queue_interface.c:182][ascend][curpid:618670,618670][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=5, actualQid=5, deploy_type=0)
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.556.538 [tensor_data_transfer.cpp:940]618670 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 6, name is ms_histogram_summary, real name is ms_histogram_summary, qid is 5
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.556.634 [tensor_data_transfer.cpp:1054]618911 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_histogram_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.556.679 [tensor_data_transfer.cpp:1056]618911 acltdtReceiveTensor: new process, use queue process
[INFO] HCCL_ADPT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.556.678 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:273] InitHccl] Start init hccl adapter.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.556.697 [api_impl.cc:6121] 618911 MemQueuePeek: Start to peek queue on devId 6, qid is 5.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.556.712 [npu_driver.cc:4330] 618911 MemQueuePeek: peek mem queue, deviceId=6, qid=5, timeout=800.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.556.829 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [][]
[INFO] HCCL_ADPT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.556.837 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:569] InitKernelInfoStore] Start init hccl kernel info store.
[INFO] HCCL_ADPT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.556.875 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:586] InitKernelInfoStore] Get builder ops_kernel_info_hccl
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:42.556.897 [plugin_manager.cc:25] [618670]hcom ops plugin init start.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:42.556.939 [plugin_manager.cc:38] [618670]input BUILD_MODE is not set, result autoTune is false.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.556.947 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [][]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:42.556.960 [plugin_manager.cc:42] [618670]hcom running normal mode.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:42.557.004 [hcom_plugin.cc:50] [618670]Initialize start.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:42.557.020 [hcom_plugin.cc:52] [618670]initializeCount_ : 1
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:42.557.061 [hcom_plugin.cc:60] [618670]hvdOpsKernelInfoStoreInfoPtr_ is initialized
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.557.061 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.557.088 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : [][]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:42.557.091 [hcom_plugin.cc:63] [618670]hvdGraphOptimizerPtr_ is initialized
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:42.557.110 [hcom_plugin.cc:329] [618670]ParserHcclAlgoDesc: there is no key named "HCCL_algorithm" in the options.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:42.557.127 [hcom_plugin.cc:281] [618670]ParserHcclExecTimeOut: there is no key named "HCCL_execTimeOut" in the options.
[WARNING] HCCL(618670,python3.9):2025-04-03-09:27:42.557.151 [hcom_plugin.cc:217] [618670]option profiling mode is not found.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:42.557.172 [hcom_plugin.cc:164] [618670][masterInfo]get Master Info:ip or port or deviceId not set.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:42.557.190 [hcom_plugin.cc:180] [618670][masterInfo]get Rank Info: worker size not set.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.557.201 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : [][]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:42.557.207 [hcom_plugin.cc:244] [618670]InitializePlugin: Init without ranktable and masterInfo, please check your mode.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.557.316 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : [][]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:42.557.349 [hcom_plugin.cc:82] [618670]hccl ops plugin init success.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:42.557.367 [plugin_manager.cc:48] [618670]hcom ops plugin init end. ret[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:42.557.380 [hcom_plugin.cc:126] [618670]get hccl kernel info store start.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:42.557.408 [hcom_plugin.cc:132] [618670]get hccl kernel info store finished.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.557.425 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : [][]
[INFO] HCCL_ADPT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.557.437 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:608] InitKernelInfoStore] Init hccl kernel info store success.
[INFO] HCCL_ADPT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.557.464 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:786] InitHcclExec] Start init hccl exec.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:42.557.478 [hcom_executor.cc:29] [618670]Hcom Excutor Initialize start.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.557.523 [runtime.cc:5239] 618670 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.557.537 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : [][]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:42.557.551 [adapter_rts.cc:234] [618670][hrtGetDevice]deviceLogicId[6]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.557.587 [api_c_soc.cc:70] 618670 rtGetSocVersion: soc version is Ascend910B3
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:42.557.640 [hcom_common.cc:85] [618670][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[6] 
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.557.659 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [][]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:42.557.672 [hcom_common.cc:88] [618670][HcomGetCurHcomCtx] is no Used deviceLogicId[6] 
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:42.557.699 [hcom.cc:486] [618670]Get Hcom Init Status: [0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:42.557.722 [hcom_common.cc:85] [618670][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[6] 
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:42.557.737 [hcom_rpc.cc:1019] [618670]Get Hcom Init Status: [0]
[WARNING] HCCL(618670,python3.9):2025-04-03-09:27:42.557.760 [hcom_base_funs.cc:36] [618670][HcomOpsKernelInfoStore][InitHcom]OPTION_EXEC_RANK_TABLE is not found.
[WARNING] HCCL(618670,python3.9):2025-04-03-09:27:42.557.784 [hcom_executor.cc:121] [618670][HcomOpsKernelInfoStore][InitHcom]OPTION_EXEC_HCOM_GROUPLIST is not found.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.557.768 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : [][][]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.557.847 [api_impl.cc:1120] 618670 StreamCreate: priority=0, flags=1536.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.557.874 [npu_driver.cc:404] 618670 StreamIdAlloc: stream id alloc begin, device_id=6, priority=0, ts_id=0, remote_stream_id=0
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.557.890 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : [][]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.557.948 [stream.cc:2246] 618670 AllocExecutedTimesSvm: stream_id=4.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.557.997 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : [][]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.558.016 [stream_sqcq_manage.cc:147] 618670 Alloc: deviceId=6, tsId=0, drvFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.558.035 [npu_driver.cc:882] 618670 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.558.157 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.558.276 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.558.394 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [][]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.558.528 [npu_driver.cc:6125] 618670 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.558.575 [npu_driver.cc:6137] 618670 LogicCqAllocateV2: success: deviceId=6, tsId=0, cqId=300, streamId=4, logicCq=300, cqeDepth=4096
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.558.573 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [][]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.558.604 [npu_driver.cc:6189] 618670 StreamBindLogicCq: success: deviceId=6, tsId=0, streamId=4, logicCq=300.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.558.625 [npu_driver.cc:5916] 618670 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=c80a2000, addr=dfffc80a2000size=4096
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.558.641 [stream.cc:653] 618670 Setup: Success to get sq=4 sq reg virtual addr length=4096.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.558.689 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [][]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:42.558.716 [devmm_svm.c:1972][ascend][curpid:618670,618670][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.558.736 [npu_driver.cc:6080] 618670 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.558.801 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.558.913 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [][]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.559.078 [stream.cc:291] 618670 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=4, flags_=0x600.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.559.096 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.559.274 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.559.394 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RoiPoolingGradWithArgMax] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.559.514 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.559.624 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [][]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.559.651 [stream.cc:688] 618670 Setup: stream setup end, stream_id=4, IsTaskSink=0, sqId=4, cqId=4, deviceId=6, streamResId=65535
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.559.673 [acl_resource_manager.cpp:814]618670 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.559.689 [acl_resource_manager.cpp:816]618670 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.559.702 [api_impl.cc:1162] 618670 StreamCreate: Succ, flags=1536, stream_id=4, context=aaaad9a630c0
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.559.730 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [][]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:42.559.730 [stream.cc:73] [618670]Construct stream by stream type success, ptr[0xaaaae4d883c0] ctx[0xaaaad9a630c0], stream id[4], cqId[4], logicCqid[300]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.559.780 [api_impl.cc:1120] 618670 StreamCreate: priority=0, flags=1536.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.559.802 [npu_driver.cc:404] 618670 StreamIdAlloc: stream id alloc begin, device_id=6, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.559.833 [stream.cc:2246] 618670 AllocExecutedTimesSvm: stream_id=5.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.559.838 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : [][]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.559.869 [stream_sqcq_manage.cc:147] 618670 Alloc: deviceId=6, tsId=0, drvFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.559.886 [npu_driver.cc:882] 618670 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.559.948 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.560.058 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : [][]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.560.097 [npu_driver.cc:6125] 618670 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.560.147 [npu_driver.cc:6137] 618670 LogicCqAllocateV2: success: deviceId=6, tsId=0, cqId=301, streamId=5, logicCq=301, cqeDepth=4096
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.560.208 [npu_driver.cc:6189] 618670 StreamBindLogicCq: success: deviceId=6, tsId=0, streamId=5, logicCq=301.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.560.231 [npu_driver.cc:5916] 618670 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=c8081000, addr=dfffc8081000size=4096
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.560.247 [stream.cc:653] 618670 Setup: Success to get sq=5 sq reg virtual addr length=4096.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.560.236 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StackBallQuery] register OP_IMPL : [][]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:42.560.295 [devmm_svm.c:1972][ascend][curpid:618670,618670][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.560.314 [npu_driver.cc:6080] 618670 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.560.347 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.560.496 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [][]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.560.615 [stream.cc:291] 618670 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=5, flags_=0x600.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.560.754 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScoreGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.560.938 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.561.104 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [][]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.243 [stream.cc:688] 618670 Setup: stream setup end, stream_id=5, IsTaskSink=0, sqId=5, cqId=5, deviceId=6, streamResId=65535
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.561.263 [acl_resource_manager.cpp:814]618670 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.561.277 [acl_resource_manager.cpp:816]618670 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.291 [api_impl.cc:1162] 618670 StreamCreate: Succ, flags=1536, stream_id=5, context=aaaad9a630c0
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.561.290 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [][]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:42.561.313 [stream.cc:73] [618670]Construct stream by stream type success, ptr[0xaaaae4e04420] ctx[0xaaaad9a630c0], stream id[5], cqId[5], logicCqid[301]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.561.439 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DefaultImpl] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.561.498 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [][]
[WARNING] HCCL(618670,python3.9):2025-04-03-09:27:42.561.535 [sal.cc:619] [618913]err[34] link[Hccl_MessageProcess] nameSet failed.
[WARNING] HCCL(618670,python3.9):2025-04-03-09:27:42.561.569 [sal.cc:619] [618914]err[34] link[Hccl_MessageProcess] nameSet failed.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:42.561.579 [hcom_executor.cc:587] [618913]MessageProcessThreadLoop start queType:[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:42.561.593 [hcom_executor.cc:587] [618914]MessageProcessThreadLoop start queType:[1]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.608 [api_impl.cc:2999] 618913 SetDevice: device_id=6, deviceMode=0.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:42.561.609 [hcom_executor.cc:34] [618670][Initialize][HcomExecutor]Hcom Excutor Initialize end. ret[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.615 [api_impl.cc:2999] 618914 SetDevice: device_id=6, deviceMode=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.610 [api_impl.cc:2999] 618915 SetDevice: device_id=6, deviceMode=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.626 [device.cc:306] 618913 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.649 [api_impl.cc:2999] 618916 SetDevice: device_id=6, deviceMode=0.
[INFO] HCCL_ADPT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.561.656 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:792] InitHcclExec] Hcom DynamicKernel Initialize success
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.680 [runtime.cc:3393] 618913 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x3
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.682 [device.cc:306] 618914 Init: device mode has been already set, mode=0.
[INFO] HCCL_ADPT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.561.706 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:798] InitHcclExec] InitHcclExec success
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.705 [runtime.cc:3560] 618913 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=6
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.561.701 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [][]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.713 [runtime.cc:3393] 618914 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x4
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.715 [device.cc:306] 618915 Init: device mode has been already set, mode=0.
[INFO] HCCL_ADPT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.561.725 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:291] InitHccl] Init hccl adapter success.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.726 [api_impl.cc:2987] 618913 NewDevice: SetCurRef = 0xaaaad9a630c0,userDeviceId=6,deviceId=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.732 [runtime.cc:3560] 618914 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.743 [runtime.cc:3393] 618915 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x5
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.746 [device.cc:306] 618916 Init: device mode has been already set, mode=0.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.561.757 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:92] Initialize] Successfully initialize HCCL.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.754 [runtime.cc:5239] 618913 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.759 [api_impl.cc:2987] 618914 NewDevice: SetCurRef = 0xaaaad9a630c0,userDeviceId=6,deviceId=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.765 [runtime.cc:3560] 618915 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.771 [runtime.cc:3393] 618916 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x6
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.561.788 [mindspore/ccsrc/distributed/collective/collective_manager.cc:628] InitDeviceCommLib] Communication library on device side is successfully initialized.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.787 [runtime.cc:5239] 618914 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.788 [api_impl.cc:2992] 618913 NewDevice: New device success, user_device_id=6, die_num=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.793 [api_impl.cc:2987] 618915 NewDevice: SetCurRef = 0xaaaad9a630c0,userDeviceId=6,deviceId=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.799 [runtime.cc:3560] 618916 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.813 [api_impl.cc:2992] 618914 NewDevice: New device success, user_device_id=6, die_num=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.820 [runtime.cc:5239] 618915 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:42.561.822 [awatchdog_core.c:175](tid:618913) create watchdog for id : 65543, tid : 618913, timeout : 300s
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.828 [api_impl.cc:2987] 618916 NewDevice: SetCurRef = 0xaaaad9a630c0,userDeviceId=6,deviceId=6
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.561.833 [mindspore/ccsrc/distributed/collective/collective_manager.cc:211] Initialize] [PROF]InitDeviceBackend costs 1149.02 msec.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:42.561.835 [awatchdog_core.c:175](tid:618914) create watchdog for id : 65543, tid : 618914, timeout : 300s
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.841 [api_impl.cc:2992] 618915 NewDevice: New device success, user_device_id=6, die_num=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.855 [api_impl.cc:3025] 618913 SetDevice: SetDevice success, curCtx=0xaaaad9a630c0, user_device_id=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.860 [runtime.cc:5239] 618916 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.874 [api_impl.cc:3025] 618914 SetDevice: SetDevice success, curCtx=0xaaaad9a630c0, user_device_id=6.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:42.561.884 [awatchdog_core.c:175](tid:618915) create watchdog for id : 65543, tid : 618915, timeout : 300s
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.561.888 [mindspore/ccsrc/distributed/collective/collective_manager.cc:860] IsAsyncInitGlobalComm] Async initialize global comm: 0. async_conf: 1, is_graph: 0, use_rank_table: 0, simulation: 0, use_mpi: 0, is_ascend: 1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.893 [api_impl.cc:2992] 618916 NewDevice: New device success, user_device_id=6, die_num=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.903 [api_impl.cc:3025] 618915 SetDevice: SetDevice success, curCtx=0xaaaad9a630c0, user_device_id=6.
[WARNING] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.561.920 [mindspore/ccsrc/distributed/collective/collective_manager.cc:335] CreateCommunicationGroup] Start to create communication group: hccl_world_group [const vector]{0, 1, 2, 3, 4, 5, 6, 7}, async: 0, submit_now: 1
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:42.561.919 [awatchdog_core.c:175](tid:618916) create watchdog for id : 65543, tid : 618916, timeout : 300s
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.561.911 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [][]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.561.938 [api_impl.cc:3025] 618916 SetDevice: SetDevice success, curCtx=0xaaaad9a630c0, user_device_id=6.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.561.936 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.561.933 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.561.960 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [][]
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.561.980 [mindspore/ccsrc/distributed/collective/collective_manager.cc:367] CreateCommunicationGroup] [PROF]CreateCommunicationGroupOnHostSide costs 0.021 msec.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.561.982 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.562.009 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.562.018 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.562.032 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [][]
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.562.039 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:148] CreateCommunicationGroup] Successfully create LCCL communication group hccl_world_group
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.562.057 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [][]
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.562.080 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:166] CreateCommunicationGroup] Successfully create HCCL communication group hccl_world_group
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.562.080 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.562.094 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : []
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.562.105 [mindspore/ccsrc/distributed/collective/collective_manager.cc:374] CreateCommunicationGroup] [PROF]CreateCommunicationGroupOnDeviceSide costs 0.099 msec.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.562.167 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AscendAntiQuantV2] register OP_IMPL : []
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.562.215 [mindspore/ccsrc/distributed/collective/collective_manager.cc:919] SubmitCreateDeviceCommTask] Launch init comm thread.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.562.233 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : []
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:42.562.243 [mindspore/ccsrc/distributed/collective/collective_manager.cc:925] SubmitCreateDeviceCommTask] Submit init communicator task for hccl_world_group. Call 'WaitCommInitDone' later to wait initialization to be done.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.562.304 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.562.323 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.562.385 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Concat] register OP_IMPL : [][]
[INFO] DISTRIBUTED(618670,fffec67cefa0,python3.9):2025-04-03-09:27:42.562.361 [mindspore/ccsrc/distributed/collective/collective_manager.cc:973] RunInitCommTasks] Create device communicator in thread for group: hccl_world_group
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.562.406 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ConcatV2] register OP_IMPL : [][]
[INFO] DISTRIBUTED(618670,fffec67cefa0,python3.9):2025-04-03-09:27:42.562.409 [mindspore/ccsrc/distributed/collective/collective_manager.cc:764] CreateDeviceCommunicator] Create device communicator for hccl_world_group
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.562.422 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.562.439 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : []
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.562.459 [device.cpp:143]618917 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.562.495 [api_impl.cc:2999] 618917 SetDevice: device_id=6, deviceMode=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.562.512 [device.cc:306] 618917 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.562.530 [runtime.cc:3393] 618917 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x7
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.562.550 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : []
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.562.548 [runtime.cc:3560] 618917 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.562.565 [api_impl.cc:2987] 618917 NewDevice: SetCurRef = 0xaaaad9a630c0,userDeviceId=6,deviceId=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.562.579 [runtime.cc:5239] 618917 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.562.597 [api_impl.cc:2992] 618917 NewDevice: New device success, user_device_id=6, die_num=1.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:42.562.618 [awatchdog_core.c:175](tid:618917) create watchdog for id : 65543, tid : 618917, timeout : 300s
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.562.624 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : []
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.562.634 [api_impl.cc:3025] 618917 SetDevice: SetDevice success, curCtx=0xaaaad9a630c0, user_device_id=6.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.562.651 [acl.cpp:115]618917 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.562.667 [acl.cpp:121]618917 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.562.681 [device.cpp:154]618917 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 6
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.562.692 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [][]
[INFO] DISTRIBUTED(618670,fffec67cefa0,python3.9):2025-04-03-09:27:42.562.718 [mindspore/ccsrc/distributed/collective/collective_manager.cc:787] CreateDeviceCommunicator] [PROF]GenerateRootInfo costs 0.252 msec.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.562.757 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IndexByTensor] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.562.811 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.562.828 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.562.896 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.562.915 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.562.976 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.563.001 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.563.018 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.563.085 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : []
[WARNING] DEVICE(618670,fffec67cefa0,python3.9):2025-04-03-09:27:42.563.122 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:248] QueryUniqueID] Retry to lookup the unique id for group hccl_world_group from the meta server node...Retry time: 399/400, sleep 1
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.563.152 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.563.210 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.563.227 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.563.296 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.563.364 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.563.427 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.563.491 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.563.560 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.563.609 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.563.625 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.563.697 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.563.761 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.563.804 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.563.825 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.563.891 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.563.955 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.563.997 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.564.021 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.564.092 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.564.154 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmulV3] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.564.422 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.564.545 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.564.708 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.567.193 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.569.245 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.569.368 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.569.484 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.569.592 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.569.704 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyRotaryPosEmb] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.569.835 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchToSpace] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.569.870 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CircularPad] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.569.948 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchToSpaceND] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.570.021 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[CircularPadGrad] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.570.222 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.570.255 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Cumsum] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.570.373 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DeformableOffsets] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.570.481 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DeformableOffsetsGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.570.555 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.570.589 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DenseBincount] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.570.585 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.570.610 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.570.639 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.570.670 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.570.756 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DiagV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.570.840 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleLinear1d] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.570.863 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DropOutDoMask] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.570.867 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleBilinear2d] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.571.019 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatter] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.571.024 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleBicubic2d] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.571.177 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicQuantUpdateScatterV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.571.191 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAA] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.571.290 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ExtractGlimpseV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.571.352 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAAGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.571.406 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Flatten] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.571.512 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.571.539 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachNonFiniteCheckAndUnscale] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.571.651 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GatherNd] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.571.690 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.571.718 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3dGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.571.765 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GatherV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.571.788 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Gather] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.571.875 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAA] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.571.942 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GatherV3] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.572.044 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAABackward] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.572.058 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GenerateBoundingBoxProposals] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.572.214 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupNormSilu] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.572.228 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.572.329 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HistogramFixedWidth] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.572.400 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ResizeUpsampleTrilinear] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.572.445 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ImageProjectiveTransform] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.572.467 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ImageProjectiveTransformV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.572.576 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IsNan] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.572.569 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dBackward] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.572.693 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InplaceUpdate] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.572.718 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.572.746 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3d] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.572.846 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LinSpace] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.572.899 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleNearest] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.572.958 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MemSet] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.573.071 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MirrorPad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.573.078 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleNearestExact2dGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.573.108 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[UpsampleNearest2dGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.573.186 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NLLLoss] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.573.224 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.573.318 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NonFiniteCheck] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.573.347 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.573.374 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.573.427 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NonZero] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.573.497 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.573.524 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.573.549 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NonMaxSuppressionV6] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.573.631 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.573.748 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.573.866 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NPUClearFloatStatus] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.573.868 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.573.976 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NPUGetFloatStatus] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.573.990 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.574.099 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Pad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.574.101 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.574.123 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PadV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.574.205 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.574.350 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantUpdateScatter] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.574.387 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.574.474 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RaggedBinCount] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.574.584 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.574.619 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.574.848 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:ReverseSequence, funcPointer:0xfffede0ac360, registered count:5
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.574.873 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:ReverseSequence, funcPointer:(nil), registered count:7
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.574.892 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:get_op_support_info, op_type:ReverseSequence, funcPointer:(nil), registered count:4
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.574.907 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:get_op_specific_info, op_type:ReverseSequence, funcPointer:(nil), registered count:4
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.574.925 [op_check.cc:71]618646 RegisterParamGeneralize:RegisterParamGeneralize: op_type:ReverseSequence, funcPointer:(nil), registered count:4
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.574.944 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReverseSequence] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.574.948 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.575.069 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Scatter] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.575.186 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterAdd] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.575.311 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.575.392 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterMaxWithArgmax] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.575.504 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.575.562 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.575.671 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterMax] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.575.693 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterMin] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.575.799 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterMul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.575.820 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterDiv] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.575.830 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.575.929 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterNd] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.576.012 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.576.038 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterNdAdd] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.576.060 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterNdSub] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.576.192 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterNdUpdate] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.576.238 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ReflectionPad3dGrad] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.576.307 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterNonAliasingAdd] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.576.358 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.576.420 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterSub] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.576.480 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.576.535 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterUpdate] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.576.621 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.576.650 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.576.678 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.576.703 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantConv2D] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.576.747 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Slice] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.576.771 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SliceWithAxes] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.576.881 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SpaceToBatch] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.576.987 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SpaceToBatchND] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.577.180 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseBincount] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.577.292 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseSegmentSumGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.577.405 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StridedSliceGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.577.516 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TensorMove] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.577.630 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UnsortedSegmentSum] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.577.789 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3d] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.577.830 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyCamePart1] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.577.998 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyCamePart2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.578.140 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyCamePart3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.578.227 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.578.294 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyCamePart4] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.578.383 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.578.410 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AscendAntiQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.578.525 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AscendQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.578.532 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.578.640 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BlendFaceBgPartOne] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.578.675 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.578.704 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.578.752 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicGRUCellGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.578.852 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.578.861 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicGRUV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.578.998 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.579.141 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicLSTMGradCell] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.579.152 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.579.180 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.579.311 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicRNN] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.579.334 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNN, funcPointer:0xfffede136e08, registered count:7
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.579.330 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.579.485 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.579.496 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicRNNV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.579.517 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:DynamicRNNV2, funcPointer:0xfffede13f298, registered count:7
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.579.635 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicRNNV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.579.634 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.579.745 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GenADC] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.579.791 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.579.903 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GridSample] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.579.936 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AGLU] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.580.023 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GridSampler2D] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.580.136 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GridSampler3D] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.580.264 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandle] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.580.338 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.580.373 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ImgRawDecodePostHandleV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.580.481 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LUT3D] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.580.600 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PasteSubImg] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.580.693 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.580.712 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ProdEnvMatA] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.580.735 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ProdEnvMatACalcDescrpt] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.580.842 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ProdForceSeA] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.580.918 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.580.959 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ProdVirialSeA] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.581.067 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RGB2YUV422] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.581.100 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.581.179 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScanPQCodes] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.581.291 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScanSQCodes] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.581.408 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TabulateFusion] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.581.513 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TabulateFusionGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.581.625 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[YUV4442YUV422] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.581.769 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ArgMin] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.581.791 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ArgMaxV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.581.814 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ArgMaxWithValue] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.581.832 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ArgMinWithValue] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.581.978 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AscendQuantV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.582.089 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Assign] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.582.166 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.582.201 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AsStrided] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.582.310 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BinaryCrossEntropy] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.582.437 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CheckValid] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.582.547 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ConcatD] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.582.566 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ConcatV2D] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.582.591 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Pack] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.582.582 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.582.705 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ConcatOffset] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.582.809 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Diag] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.582.915 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DiagPart] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.583.112 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicAtomicAddrClean] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.583.129 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NLLLossGrad310p] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.583.220 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[KLDiv] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.583.290 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.583.335 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[KLDivV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.583.437 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.583.449 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NLLLossGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.583.547 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DropoutWithMulsAndSoftmaxGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.583.575 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PReluGradReduce] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.583.689 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Range] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.583.722 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.583.803 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceMean] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.583.826 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceMeanD] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.583.867 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.583.895 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.583.932 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ResizeBilinearV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.584.011 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.584.039 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ResizeBilinearV2Grad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.584.039 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.584.067 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2Grad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.584.364 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.584.365 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.584.484 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ResizeNearestNeighborV2Grad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.584.480 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.584.593 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReverseV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.584.640 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ForeachBinaryOp] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.584.713 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ROIAlign] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.584.794 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.584.824 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ROIAlignGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.584.909 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.584.932 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseReshape] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.585.044 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Split] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.585.156 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SplitV] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.585.213 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.585.369 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SquareSumV1] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.585.393 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.585.479 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StridedSlice] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.585.549 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.585.601 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TransData] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.585.662 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.585.769 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.585.922 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InstanceNormV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.586.097 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IouV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.586.275 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BidirectionLSTM] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.586.302 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BidirectionLSTMV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.586.458 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.586.483 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.586.630 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaskedSelectV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.586.811 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.587.925 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DepthToSpace] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.587.969 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Transpose] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.587.991 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SpaceToDepth] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.588.120 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Unpack] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.588.252 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Bias] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.588.308 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.588.361 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BiasAdd] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.588.472 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BiasAddGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.588.586 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BinaryCrossEntropyGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.588.694 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNInferenceD] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.588.798 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNInfer] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.588.905 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNInferGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.589.030 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNTrainingReduceGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.589.054 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BN3DTrainingReduceGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.589.170 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNTrainingUpdate] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.589.191 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdate] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.589.517 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNTrainingUpdateGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.589.542 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BN3DTrainingUpdateGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.589.646 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.589.753 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BNTrainingUpdateV3] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.589.861 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BroadcastTo] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.589.978 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Fill] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.590.211 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DequantSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.590.503 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GeGluGradV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.590.669 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GeGluV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.590.784 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[INTrainingReduceGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.590.898 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.591.010 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNormBetaGammaBackpropV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.591.677 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNormGradV3] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.592.509 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNormV3] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.592.839 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNormV4] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.593.297 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchNormV3] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.593.908 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PostLayerNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.593.999 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.594.032 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.594.042 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.594.160 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNormXBackpropV3] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.594.303 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.594.412 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPoolGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.594.700 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPool3DWithArgmaxV2] register OP_IMPL : [][]
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:42.596.187 [trs_cb_event.c:119][ascend][curpid:618666,618808][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =64; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:42.596.190 [trs_cb_event.c:119][ascend][curpid:618666,618809][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =65; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:42.596.216 [trs_sqcq.c:1491][ascend][curpid:618666,618808][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:42.596.225 [trs_sqcq.c:1491][ascend][curpid:618666,618809][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:42.596.230 [npu_driver.cc:3833] 618808 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:42.596.239 [npu_driver.cc:3833] 618809 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:42.596.243 [api_impl.cc:5058] 618808 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:42.596.252 [api_impl.cc:5058] 618809 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.596.259 [callback.cpp:132]618808 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.596.267 [callback.cpp:132]618809 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.596.275 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.596.281 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.596.305 [npu_driver.cc:3828] 618809 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=65.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.596.305 [npu_driver.cc:3828] 618808 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=64.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.596.854 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.596.913 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPool3DGradWithArgmax] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.597.109 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.597.391 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MedianDim] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.597.719 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.597.761 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeGatingTopK] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.597.924 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MSELossV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.597.920 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.598.085 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CTCLossV3Grad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.598.127 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.598.287 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.598.440 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeTutelCombineGates] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.598.635 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeTutelCombineX] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.598.780 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeTutelDispatch] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.598.871 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.599.075 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CTCLossV3] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.599.113 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScore] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.599.234 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Pows] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.599.231 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.599.389 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3DGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.599.388 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.599.873 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PRelu] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.599.867 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Rfft1D] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.599.990 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PReluGradUpdate] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.600.019 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.600.103 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Scale] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.600.188 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.600.220 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GemmaRmsNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.600.234 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Select] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.600.335 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.600.360 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SigmoidCrossEntropyWithLogitsGradV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.600.454 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.600.480 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Tile] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.600.587 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TileD] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.600.632 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LinearIndex] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.600.694 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TileWithAxis] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.600.804 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[OneHot] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.600.820 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[LinearIndexV2] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.600.922 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PadV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.601.009 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScatterAddWithSorted] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.601.042 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PadV3Grad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.601.160 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[Sinkhorn] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.601.205 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PadV3GradReplication] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.601.277 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.601.316 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Pdist] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.601.396 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.601.422 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.601.428 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SmoothL1LossGradV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.601.617 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterElementsV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.601.622 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.601.730 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftMarginLossGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.601.806 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StackGroupPoints] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.601.837 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RnnGenMaskV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.601.945 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Cummin] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.601.955 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.602.068 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.602.116 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AngleV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.602.224 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.602.255 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.602.291 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CoalesceSparse] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.602.374 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.602.408 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Col2im] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.602.490 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.602.516 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CTCLossV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.602.517 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.602.538 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CTCLossV2Grad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.602.544 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.602.685 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.602.728 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[EmbeddingBag] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.602.838 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[EmbeddingDenseGrad] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.602.790 [op_impl_space_registry.cc:109]618650 MergeFunctions:op type AvgPool3DGrad inputs_dependency has been registered
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.602.875 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.602.952 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Eye] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.602.966 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.603.122 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FakeQuantAffineCachemask] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.603.197 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.603.238 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupNorm] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.603.389 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.603.401 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupNormGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.603.418 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.603.442 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.603.518 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupNormV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.603.632 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.603.641 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Index] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.603.662 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.603.749 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.603.775 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPoolGradWithArgmaxV1] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.603.879 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.603.900 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaxPoolWithArgmaxV1] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.604.018 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MultilabelMarginLoss] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.604.129 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Sort] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.604.138 [op_impl_space_registry.cc:84]618650 MergeFunctions:op type MoeInitRoutingV2 tiling_parse func has been registered
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.604.151 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SortV2] register OP_IMPL : [][]
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.604.174 [op_impl_space_registry.cc:85]618650 MergeFunctions:op type MoeInitRoutingV2 compile_info_creator func has been registered
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.604.187 [op_impl_space_registry.cc:86]618650 MergeFunctions:op type MoeInitRoutingV2 compile_info_deleter func has been registered
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.604.196 [op_impl_space_registry.cc:87]618650 MergeFunctions:op type MoeInitRoutingV2 tiling func has been registered
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.604.208 [op_impl_space_registry.cc:93]618650 MergeFunctions:op type MoeInitRoutingV2 max_tiling_data_size has been registered
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.604.274 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StrideAdd] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.604.390 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StridedSliceV3] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.604.503 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SyncBatchNormGatherStats] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.604.693 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[HistogramV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.604.804 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GatherElements] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.604.990 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GridSampler2DGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.605.145 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GridSampler3DGrad] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.605.259 [op_impl_space_registry.cc:273]618650 ConvertSoToRegistry:Save so symbol and handle in path[/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so] success!
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.605.327 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GetPaddingOffset] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.605.498 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PadInfer] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.605.680 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PadV4Grad] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.605.734 [plugin_manager.cc:564]618650 GetUpgradedOpMasterPath:Start to get upgraded op tiling path
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.605.761 [plugin_manager.cc:134]618650 GetUpgradedOppPath:Enter get upgraded opp path schedule
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.605.821 [file_utils.cc:47]618650 RealPath:[Util][realpath] Can not get real_path for /usr/local/Ascend/ascend-toolkit/latest/opp_latest/, reason:No such file or directory
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.605.836 [plugin_manager.cc:145]618650 GetUpgradedOppPath:[Call][RealPath] Opp path /usr/local/Ascend/ascend-toolkit/latest/opp_latest/ is invalid.
[WARNING] GE(618650,python3.9):2025-04-03-09:27:42.605.847 [plugin_manager.cc:567]618650 GetUpgradedOpMasterPath:Failed to get upgraded opp path!
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.605.871 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PadV3GradReplicate] register OP_IMPL : [][][][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.605.918 [mem_manager.cc:31]618650 Initialize:MemManager Initialize.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.605.952 [rts_caching_mem_allocator.cc:131]618650 Initialize:RtsAllocatorManager Initialize.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.605.965 [mem_manager.cc:102]618650 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.605.976 [graph_mem_allocator.cc:17]618650 Initialize:MemoryAllocator::Initialize.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.605.988 [mem_manager.cc:102]618650 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.605.987 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaskedScatter] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.605.998 [graph_mem_allocator.cc:17]618650 Initialize:MemoryAllocator::Initialize.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.606.010 [mem_manager.cc:102]618650 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.606.021 [caching_allocator.cc:391]618650 FreeBlocks:Free blocks.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.606.031 [caching_allocator.cc:358]618650 FreeCachedBlocks:Free cached blocks
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.606.045 [mem_manager.cc:102]618650 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.606.055 [caching_allocator.cc:391]618650 FreeBlocks:Free blocks.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.606.064 [caching_allocator.cc:358]618650 FreeCachedBlocks:Free cached blocks
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.606.076 [mem_manager.cc:102]618650 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.606.086 [mem_manager.cc:102]618650 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.606.097 [mem_manager.cc:102]618650 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.606.098 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Roll] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.606.108 [mem_manager.cc:102]618650 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.606.121 [mem_manager.cc:102]618650 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.606.132 [session_scope_mem_allocator.cc:73]618650 FreeAllMemory:Free all memory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.606.143 [mem_manager.cc:102]618650 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.606.153 [session_scope_mem_allocator.cc:73]618650 FreeAllMemory:Free all memory
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.606.198 [dump_manager.cc:152]618650 Init:exception dump is not enabled
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.606.207 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Trace] register OP_IMPL : [][]
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.606.248 [ge_executor.cc:315]618650 Initialize:Init GeExecutor over.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.606.286 [acl.cpp:321]618650 aclInit: set DumpConfig in aclInit
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.606.299 [dump.cpp:841]618650 HandleDumpConfig: start to execute HandleDumpConfig.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.606.322 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Tril] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.606.320 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: Conv2DBackpropFilter, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.606.347 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Triu] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.606.411 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: Conv2DBackpropInput, registered count: 15
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.606.436 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: Conv2DTranspose, registered count: 15
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.606.456 [dump.cpp:759]618650 ConvertDumpCfg: start to execute ConvertDumpCfg.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.606.473 [dump.cpp:594]618650 IsValidDumpConfig: start to execute IsValidDumpConfig.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.606.482 [dump.cpp:224]618650 CheckDumpSceneSwitch: start to execute CheckDumpSceneSwitch.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.606.531 [dump.cpp:703]618650 SetUpDumpConfig: convert to ge dump config successfully, enable lite_exception dump, path=
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.606.512 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: Conv2D, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.606.535 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TopPSample] register OP_IMPL : [][]
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.606.549 [dump.cpp:771]618650 HandleDumpCommand: start to execute HandleDumpCommand.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.606.562 [dump.cpp:703]618650 SetUpDumpConfig: convert to ge dump config successfully, enable lite_exception dump, path=
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.606.596 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: Conv3DBackpropInput, registered count: 15
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.606.620 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: Conv3DTranspose, registered count: 15
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.606.632 [adx_datadump_server.cpp:77][tid:618650] start to do dump init
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.606.651 [adx_dump_record.cpp:210][tid:618650] dumpPath prefix is /home/jenkins/mindspore/testcases/testcases/tests/st/lccl
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.606.664 [adx_dump_record.cpp:214][tid:618650] record remote dump temp path : /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.606.652 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[KlDivLossGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.606.690 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: Conv3D, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.606.774 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[L1LossGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.606.862 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: FFN, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.606.887 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MseLoss] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.606.884 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: MatmulTunnerTiling, registered count: 15
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.606.940 [adx_server_manager.cpp:149][tid:618918] server manager add component (10)
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.606.963 [adx_server_manager.cpp:165][tid:618918] server manager components init successfully
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.606.973 [adx_dump_record.cpp:627][tid:618919] start dump thread, remote dump record temp path : /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.606.998 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MseLossGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.606.999 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: MatMulV2, registered count: 15
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.607.022 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: BatchMatmulFixpipe, registered count: 15
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.607.044 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: MatMulV3, registered count: 15
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.607.064 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: QuantBatchMatmulV3, registered count: 15
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.607.091 [adx_server_manager.cpp:203][tid:618920] Run Server(0) Process
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.607.118 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceMeanWithCount] register OP_IMPL : [][]
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.607.144 [adx_server_manager.cpp:369][tid:618920] device up 0
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.607.162 [hdc_comm_opt.cpp:59][tid:618920] open device[0] server[13]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.607.223 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: DynamicRNN, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.607.230 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceStdWithMean] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.607.244 [tuning_tiling_registry.cc:30]618654 RegisterTilingData:optype: MatMulTunnerTiling, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.607.254 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReduceStdV2Update] register OP_IMPL : [][]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:42.607.268 [drv_log_user.c:623][ascend][curpid:618650,618920][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=0; fid=0; service_type="service_dump"; pid=618650)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:42.607.285 [hdc_server.c:363][ascend][curpid:618650,618920][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=0)
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.607.298 [hdc_api.cpp:119][tid:618920] logDevId 0 create HDC server successfully
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.607.335 [adx_server_manager.cpp:111][tid:618920] create server info
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.607.347 [adx_server_manager.cpp:369][tid:618920] device up 1
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.607.357 [hdc_comm_opt.cpp:59][tid:618920] open device[1] server[13]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.607.367 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SmoothL1LossV2] register OP_IMPL : [][]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:42.607.478 [drv_log_user.c:623][ascend][curpid:618650,618920][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=1; fid=0; service_type="service_dump"; pid=618650)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:42.607.493 [hdc_server.c:363][ascend][curpid:618650,618920][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=1)
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.607.504 [hdc_api.cpp:119][tid:618920] logDevId 1 create HDC server successfully
[WARNING] IDEDD(618650,python3.9):2025-04-03-09:27:42.607.515 [adx_hdc_epoll.cpp:34][tid:618920] hdc epoll has been created.
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.607.528 [adx_server_manager.cpp:111][tid:618920] create server info
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.607.538 [adx_server_manager.cpp:369][tid:618920] device up 2
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.607.548 [hdc_comm_opt.cpp:59][tid:618920] open device[2] server[13]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.607.601 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[EmbeddingDenseGradV2] register OP_IMPL : [][]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:42.607.608 [drv_log_user.c:623][ascend][curpid:618650,618920][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=2; fid=0; service_type="service_dump"; pid=618650)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:42.607.622 [hdc_server.c:363][ascend][curpid:618650,618920][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=2)
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.607.634 [hdc_api.cpp:119][tid:618920] logDevId 2 create HDC server successfully
[WARNING] IDEDD(618650,python3.9):2025-04-03-09:27:42.607.643 [adx_hdc_epoll.cpp:34][tid:618920] hdc epoll has been created.
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.607.656 [adx_server_manager.cpp:111][tid:618920] create server info
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.607.666 [adx_server_manager.cpp:369][tid:618920] device up 3
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.607.688 [hdc_comm_opt.cpp:59][tid:618920] open device[3] server[13]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:42.607.809 [drv_log_user.c:623][ascend][curpid:618650,618920][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=3; fid=0; service_type="service_dump"; pid=618650)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:42.607.821 [hdc_server.c:363][ascend][curpid:618650,618920][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=3)
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.607.832 [hdc_api.cpp:119][tid:618920] logDevId 3 create HDC server successfully
[WARNING] IDEDD(618650,python3.9):2025-04-03-09:27:42.607.843 [adx_hdc_epoll.cpp:34][tid:618920] hdc epoll has been created.
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.607.855 [adx_server_manager.cpp:111][tid:618920] create server info
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.607.866 [adx_server_manager.cpp:369][tid:618920] device up 4
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.607.875 [hdc_comm_opt.cpp:59][tid:618920] open device[4] server[13]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:42.607.993 [drv_log_user.c:623][ascend][curpid:618650,618920][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=4; fid=0; service_type="service_dump"; pid=618650)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:42.608.006 [hdc_server.c:363][ascend][curpid:618650,618920][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=4)
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.608.018 [hdc_api.cpp:119][tid:618920] logDevId 4 create HDC server successfully
[WARNING] IDEDD(618650,python3.9):2025-04-03-09:27:42.608.028 [adx_hdc_epoll.cpp:34][tid:618920] hdc epoll has been created.
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.608.040 [adx_server_manager.cpp:111][tid:618920] create server info
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.608.051 [adx_server_manager.cpp:369][tid:618920] device up 5
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.608.061 [hdc_comm_opt.cpp:59][tid:618920] open device[5] server[13]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:42.608.191 [drv_log_user.c:623][ascend][curpid:618650,618920][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=5; fid=0; service_type="service_dump"; pid=618650)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:42.608.206 [hdc_server.c:363][ascend][curpid:618650,618920][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=5)
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.608.218 [hdc_api.cpp:119][tid:618920] logDevId 5 create HDC server successfully
[WARNING] IDEDD(618650,python3.9):2025-04-03-09:27:42.608.227 [adx_hdc_epoll.cpp:34][tid:618920] hdc epoll has been created.
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.608.239 [adx_server_manager.cpp:111][tid:618920] create server info
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.608.250 [adx_server_manager.cpp:369][tid:618920] device up 6
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.608.259 [hdc_comm_opt.cpp:59][tid:618920] open device[6] server[13]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:42.608.377 [drv_log_user.c:623][ascend][curpid:618650,618920][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=6; fid=0; service_type="service_dump"; pid=618650)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:42.608.390 [hdc_server.c:363][ascend][curpid:618650,618920][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=6)
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.608.401 [hdc_api.cpp:119][tid:618920] logDevId 6 create HDC server successfully
[WARNING] IDEDD(618650,python3.9):2025-04-03-09:27:42.608.414 [adx_hdc_epoll.cpp:34][tid:618920] hdc epoll has been created.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.608.387 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:MatMulV2, funcPointer:0xfffee7b3d0b0, registered count:7
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.608.425 [op_check.cc:24]618654 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:MatMulV2, funcPointer:0xfffee7b3d310, registered count:5
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.608.428 [adx_server_manager.cpp:111][tid:618920] create server info
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.608.441 [adx_server_manager.cpp:369][tid:618920] device up 7
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.608.460 [hdc_comm_opt.cpp:59][tid:618920] open device[7] server[13]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:42.608.578 [drv_log_user.c:623][ascend][curpid:618650,618920][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=7; fid=0; service_type="service_dump"; pid=618650)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:42.608.590 [hdc_server.c:363][ascend][curpid:618650,618920][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=7)
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.608.601 [hdc_api.cpp:119][tid:618920] logDevId 7 create HDC server successfully
[WARNING] IDEDD(618650,python3.9):2025-04-03-09:27:42.608.614 [adx_hdc_epoll.cpp:34][tid:618920] hdc epoll has been created.
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.608.627 [adx_server_manager.cpp:111][tid:618920] create server info
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.608.666 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmax] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.608.807 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.609.296 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [][][][]
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.610.072 [adx_server_manager.cpp:457][tid:618650] The server is initialized after waiting 3 times.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.610.091 [ge_executor.cc:1349]618650 SetDump:Start to set dump config
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.610.107 [dump_manager.cc:201]618650 NeedDoDump:Dump status: on, Overflow detection dump switch: off.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.610.142 [dump_manager.cc:261]618650 SetExceptionDump:Enable brief exception dump.
[INFO] GE(618650,python3.9):2025-04-03-09:27:42.610.170 [ge_executor.cc:1355]618650 SetDump:Set dump config successfully
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.610.201 [dump_manager.cpp:146][tid:618650] Set 3 dump setting, status: on, dump switch: 3
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.610.919 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : [][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.611.078 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.611.119 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeGatingTopKSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.611.157 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.611.326 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.611.520 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.611.535 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeInitRoutingQuantV2] register OP_IMPL : [][]
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:42.611.669 [dump_manager.cpp:301][tid:618650] Register exception callback, registered: 1
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.611.690 [dump.cpp:825]618650 HandleDumpCommand: set dump config for model successfully,adumpType = 3, dump_path = , dump_mode = , dump_op_switch = , dump_data = .
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.611.707 [acl.cpp:327]618650 aclInit: set HandleDumpConfig success in aclInit
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.611.718 [acl.cpp:329]618650 aclInit: set max_opqueue_num in aclInit
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.611.731 [acl_resource_manager.cpp:248]618650 HandleMaxOpQueueConfig: start to execute HandleMaxOpQueueConfig
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.611.823 [acl_resource_manager.cpp:275]618650 HandleMaxOpQueueConfig: no max_opqueue_num found, set default DEFAULT_MAX_OPQUEUE_NUM[20000].
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.611.838 [acl_resource_manager.cpp:278]618650 HandleMaxOpQueueConfig: HandleMaxOpQueueConfig end in HandleMaxOpQueueConfig
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.611.849 [acl.cpp:335]618650 aclInit: set HandleMaxOpQueueConfig success in aclInit
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.611.859 [acl.cpp:336]618650 aclInit: set HandleDefaultDevice in aclInit
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.611.873 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeInitRouting] register OP_IMPL : [][]
[WARNING] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.611.919 [json_parser.cpp:260]618650 GetDefaultDeviceIdFromFile: no defaultDevice item!
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.611.935 [acl.cpp:343]618650 aclInit: set HandleDefaultDevice success in aclInit
[INFO] PROFILING(618650,python3.9):2025-04-03-09:27:42.611.955 [prof_atls_plugin.cpp:210] (tid:618650) Module[48] register callback of ctrl handle.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.611.967 [acl.cpp:351]618650 aclInit: set ProfilingConfig in aclInit
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.611.978 [profiling.cpp:141]618650 HandleProfilingConfig: start to execute HandleProfilingConfig
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.611.964 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [][][][]
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.611.990 [profiling.cpp:135]618650 GetProfilingConfigFile: no profiling config file.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.612.038 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2Grad] register OP_IMPL : [][]
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.612.047 [profiling.cpp:167]618650 HandleProfilingConfig: can not parse profiling config from file[/home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618650.json], errorCode = 0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.612.072 [profiling.cpp:172]618650 HandleProfilingConfig: profiling config file[/home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618650.json] is empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.612.082 [profiling.cpp:176]618650 HandleProfilingConfig: start to use profiling config by config file mode
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.612.092 [profiling.cpp:179]618650 HandleProfilingConfig: ParseJsonFromFile ok in HandleProfilingConfig
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.612.102 [profiling.cpp:92]618650 HandleProfilingCommand: start to execute HandleProfilingCommand
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.612.208 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RopeQuantKvcache] register OP_IMPL : [][]
[INFO] PROFILING(618650,python3.9):2025-04-03-09:27:42.612.614 [ai_drv_dev_api.cpp:316] >>> (tid:618650) Succeeded to get device 64 frequency=100000
[INFO] PROFILING(618650,python3.9):2025-04-03-09:27:42.612.745 [msprof_callback_impl.cpp:132] >>> (tid:618650) Dynamic profiling environment not really set, so do nothing.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.612.759 [profiling.cpp:122]618650 HandleProfilingCommand: set profiling config successfully
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.612.770 [profiling.cpp:186]618650 HandleProfilingConfig: set HandleProfilingConfig success
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.612.780 [hash_utils.cpp:108]618650 CalculateSimpleHash: Begin to calculate hash for file: /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618650.json
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.612.815 [hash_utils.cpp:128]618650 CalculateSimpleHash: file: /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618650.json, hash: 3917491750093904922
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.612.831 [acl.cpp:115]618650 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.612.863 [acl.cpp:280]618650 IsEnableAutoUCMemeory: auto-uc-memory is enabled.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.612.873 [acl.cpp:385]618650 aclInit: register kernel launch fill function in aclInit
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.612.893 [runtime.cc:5394] 618650 RegKernelLaunchFillFunc: registercallback finish, symbol:g_opSystemRunCfg.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.612.906 [api_impl.cc:7407] 618650 RegStreamStateCallback: Reg stream state callback, regName=ACL_MODULE_STREAM.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.612.940 [api_impl.cc:4211] 618650 RegDeviceStateCallback: Reg device state callback, regName=ACL_MODULE_DEVICE.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.612.955 [acl.cpp:420]618650 aclInit: successfully execute aclInit, aclInitRefCount is 1
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.613.044 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[STFT] register OP_IMPL : [][]
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.613.162 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:199] InitializeAcl] Call aclInit successfully, json is {"dump":{"dump_scene":"lite_exception"},"err_msg_mode":"1"}
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.613.207 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TomeMerge] register OP_IMPL : [][]
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.613.328 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:295] Initialize] End initializing device context.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.613.343 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TomeUnmerge] register OP_IMPL : [][]
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.613.397 [mindspore/ccsrc/plugin/res_manager/ascend/ascend_res_manager.cc:467] LoadCollectiveCommLib] Loading MACCL collective library successfully.
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.613.422 [mindspore/ccsrc/distributed/collective/collective_manager.cc:621] InitDeviceCommLib] Start initializing communication library on device side...
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.613.500 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyAdamWV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.613.648 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DiagFlat] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.613.773 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GeluQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.613.921 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedBiasAddGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.614.078 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeComputeExpertTokens] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.614.220 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeFinalizeRouting] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.614.350 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2Grad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.614.472 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NanToNum] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.614.568 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.614.879 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAbs] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.614.903 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachCopy] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.614.922 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSign] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.614.941 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAcos] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.614.959 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.614.981 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddScalar] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.614.999 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddScalarList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.016 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddcdivList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.033 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalar] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.051 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddcdivScalarList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.067 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddcmulList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.084 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalar] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.103 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddcmulScalarList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.120 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAsin] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.137 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAtan] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.155 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachCos] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.172 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachCosh] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.188 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachDivList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.205 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachDivScalar] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.221 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachDivScalarList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.240 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachErf] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.257 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachErfc] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.273 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachExp] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.299 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachExpm1] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.317 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachLerpList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.335 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachLerpScalar] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.360 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachLog] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.377 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachLog1p] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.394 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachLog2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.411 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachLog10] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.428 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMaximumList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.445 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMaximumScalar] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.462 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMaximumScalarList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.478 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMinimumList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.495 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMinimumScalar] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.514 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMinimumScalarList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.531 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMulList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.548 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMulScalar] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.567 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMulScalarList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.584 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachNeg] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.601 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachPowList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.618 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachPowScalar] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.634 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachPowScalarAndTensor] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.651 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachPowScalarList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.667 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachReciprocal] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.684 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachRoundOffNumber] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.700 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSigmoid] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.717 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSin] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.743 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSinh] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.761 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSqrt] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.778 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSubList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.797 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSubScalar] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.814 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSubScalarList] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.832 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachTan] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.848 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachTanh] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.615.866 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachZeroInplace] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.616.009 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachACosInplace] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.616.395 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachAddListInplace] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.616.568 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMulScalarInplace] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.616.592 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachLogInplace] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.616.611 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSubListInplace] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.616.631 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachMulListInplace] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.616.648 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachDivListInplace] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.616.783 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachSubScalarInplace] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.616.902 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdvanceStep] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.617.014 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Logit] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.617.116 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LogitGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.617.221 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FatreluMul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.617.329 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GeluMul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.617.482 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3dGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.617.599 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyAdamV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.617.753 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ApplyFusedEmaAdam] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.617.862 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AxpyWithSoftmaxAndDropOutDoMask] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.617.988 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CIoU] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.618.010 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DIoU] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.618.029 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GIoU] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.618.138 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DIoUGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.618.159 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CIoUGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.618.178 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GIoUGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.618.287 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Cross] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.618.445 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CrossEntropyLoss] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.618.598 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CrossEntropyLossGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.618.744 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FeedsRepeat] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.618.858 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IndexPutV2] register OP_IMPL : [][]
[INFO] PROFILING(618650,python3.9):2025-04-03-09:27:42.618.853 [prof_atls_plugin.cpp:210] (tid:618650) Module[0] register callback of ctrl handle.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.619.056 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IndexPutWithSort] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.619.169 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InplaceIndexAdd] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.619.349 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InplaceIndexAddWithSorted] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.619.458 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Iou] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.619.582 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LpNormReduce] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.619.604 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LpNormReduceV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.619.623 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LpNormV2] register OP_IMPL : [][]
[WARNING] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.619.726 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:76] Initialize] Loading LCCL because env MS_ENABLE_LCCL is set to on. Pay attention that LCCL only supports communication group within single node in KernelByKernel for now.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.619.763 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:80] Initialize] Successfully initialize LCCL.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.619.772 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DequantRopeQuantKvcache] register OP_IMPL : [][]
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.619.839 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ascend_deprecated_interface.cc:83] OpenTsd] Device id = 1, rank size = 8.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.619.858 [device.cpp:143]618650 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.619.882 [api_impl.cc:2999] 618650 SetDevice: device_id=1, deviceMode=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.619.895 [device.cc:306] 618650 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.619.909 [runtime.cc:3393] 618650 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x2
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.619.925 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DequantBias] register OP_IMPL : [][]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.619.940 [runtime.cc:3560] 618650 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.619.958 [api_impl.cc:2987] 618650 NewDevice: SetCurRef = 0xaaab312ab590,userDeviceId=1,deviceId=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.619.970 [runtime.cc:5239] 618650 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.619.986 [api_impl.cc:2992] 618650 NewDevice: New device success, user_device_id=1, die_num=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.620.004 [api_impl.cc:3025] 618650 SetDevice: SetDevice success, curCtx=0xaaab312ab590, user_device_id=1.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.620.016 [acl.cpp:115]618650 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.620.026 [acl.cpp:121]618650 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.620.063 [device.cpp:154]618650 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 1
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.620.080 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeTokenPermuteGrad] register OP_IMPL : [][]
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.620.117 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel _npu_log begins the construction process witch capacity 128
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.620.136 [tensor_data_transfer.cpp:898]618650 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 1, name is _npu_log, capacity is 128
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.620.173 [api_impl.cc:6077] 618650 MemQueueInit: Start to init queue on devId 1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.620.187 [npu_driver.cc:4076] 618650 MemQueueInit: init mem queue, device_id=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.620.200 [npu_driver.cc:4026] 618650 CheckMemQueueSupported: get majorVersion 7
[INFO] DRV(618650,python3.9):2025-04-03-09:27:42.620.235 [queue_client.c:151][ascend][curpid:618650,618650][drv][queuemng][QueueGetHostpid]Query tgid. (tgid=618650)
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.620.251 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeTokenUnpermuteGrad] register OP_IMPL : [][]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:42.620.413 [queue_client.c:305][ascend][curpid:618650,618650][drv][queuemng][QueueGetDevPid]Query devpid succ. (devId=1; vfid=0; hostpid=618650; master_pid=618650; proc_type=0; devpid=30483).
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.620.435 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeTokenPermute] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.620.578 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeTokenUnpermute] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.620.689 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MulAddn] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.620.845 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupNormSwish] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.621.009 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupNormSwishGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.621.191 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttentionGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.621.327 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MultiScaleDeformableAttnFunction] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.621.434 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PSROIPoolingGradV2D] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.621.544 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PSROIPoolingV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.621.659 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Renorm] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.621.766 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RepeatInterleave] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.621.920 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RepeatInterleaveGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.622.072 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RingAttentionUpdate] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.622.181 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Resize] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.622.292 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ResizeD] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.622.407 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ResizeGradD] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.622.530 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotaryMul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.622.635 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotaryMulGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.623.080 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotaryPositionEmbedding] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.623.506 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotaryPositionEmbeddingGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.623.640 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RopeWithSinCosCache] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.623.751 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotatedIou] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.623.773 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotatedOverlaps] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.623.877 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmax] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.623.984 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.624.097 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SignBitsPack] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.624.229 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SignBitsUnpack] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.624.340 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SyncResizeBilinearV2] register OP_IMPL : [][]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:42.624.440 [queue_client.c:362][ascend][curpid:618650,618650][drv][queuemng][QueueInit]QueueInit device. (devid=1; mcast_flag=0; mcast_gid=0; proc_sn=0; event_sn_offset=0)
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.624.459 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ViewCopy] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.624.582 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMultiClassNonMaxSuppression] register OP_IMPL : [][]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.624.649 [npu_driver.cc:4114] 618650 MemQueueInit: get max queue cnt 4294967294 success.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.624.667 [api_impl.cc:6040] 618650 MemQueueCreate: Start to create queue on devId 1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.624.688 [npu_driver.cc:3931] 618650 MemQueueCreate: create mem queue, deviceId=1, name=_npu_log.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.624.690 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BoundingBoxDecode] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.624.853 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AmpUpdateScale] register OP_IMPL : [][]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:42.624.948 [queue_interface.c:182][ascend][curpid:618650,618650][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=0, actualQid=0, deploy_type=0)
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.624.965 [tensor_data_transfer.cpp:940]618650 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 1, name is _npu_log, real name is _npu_log, qid is 0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.624.965 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BallQuery] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.625.080 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ChamferDistance] register OP_IMPL : [][]
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.625.102 [tensor_data_transfer.cpp:1054]618921 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is _npu_log
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.625.130 [tensor_data_transfer.cpp:1056]618921 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.625.163 [api_impl.cc:6121] 618921 MemQueuePeek: Start to peek queue on devId 1, qid is 0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.625.176 [npu_driver.cc:4330] 618921 MemQueuePeek: peek mem queue, deviceId=1, qid=0, timeout=800.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.625.177 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_tensor_dump begins the construction process witch capacity 128
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.625.198 [tensor_data_transfer.cpp:898]618650 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 1, name is ms_tensor_dump, capacity is 128
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.625.217 [api_impl.cc:6077] 618650 MemQueueInit: Start to init queue on devId 1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.625.229 [npu_driver.cc:4076] 618650 MemQueueInit: init mem queue, device_id=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.625.239 [npu_driver.cc:4026] 618650 CheckMemQueueSupported: get majorVersion 7
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.625.262 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ChamferDistanceGrad] register OP_IMPL : [][]
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:42.625.278 [npu_driver.cc:4087] 618650 MemQueueInit: repeated init
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.625.312 [api_impl.cc:6040] 618650 MemQueueCreate: Start to create queue on devId 1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.625.325 [npu_driver.cc:3931] 618650 MemQueueCreate: create mem queue, deviceId=1, name=ms_tensor_dump.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.625.374 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DeformableRoiPool] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.625.493 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DeformableRoiPoolGrad] register OP_IMPL : [][]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:42.625.502 [queue_interface.c:182][ascend][curpid:618650,618650][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=1, actualQid=1, deploy_type=0)
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.625.520 [tensor_data_transfer.cpp:940]618650 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 1, name is ms_tensor_dump, real name is ms_tensor_dump, qid is 1
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.625.600 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PointsInPolygons] register OP_IMPL : [][]
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.625.637 [tensor_data_transfer.cpp:1054]618923 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_tensor_dump
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.625.679 [tensor_data_transfer.cpp:1056]618923 acltdtReceiveTensor: new process, use queue process
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.625.683 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_tensor_summary begins the construction process witch capacity 128
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.625.698 [api_impl.cc:6121] 618923 MemQueuePeek: Start to peek queue on devId 1, qid is 1.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.625.700 [tensor_data_transfer.cpp:898]618650 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 1, name is ms_tensor_summary, capacity is 128
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.625.712 [npu_driver.cc:4330] 618923 MemQueuePeek: peek mem queue, deviceId=1, qid=1, timeout=800.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.625.718 [api_impl.cc:6077] 618650 MemQueueInit: Start to init queue on devId 1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.625.738 [npu_driver.cc:4076] 618650 MemQueueInit: init mem queue, device_id=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.625.749 [npu_driver.cc:4026] 618650 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:42.625.783 [npu_driver.cc:4087] 618650 MemQueueInit: repeated init
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.625.784 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RoiAlignRotated] register OP_IMPL : [][]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.625.795 [api_impl.cc:6040] 618650 MemQueueCreate: Start to create queue on devId 1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.625.806 [npu_driver.cc:3931] 618650 MemQueueCreate: create mem queue, deviceId=1, name=ms_tensor_summary.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.625.964 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RoiAlignRotatedGrad] register OP_IMPL : [][]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:42.625.969 [queue_interface.c:182][ascend][curpid:618650,618650][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=2, actualQid=2, deploy_type=0)
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.625.985 [tensor_data_transfer.cpp:940]618650 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 1, name is ms_tensor_summary, real name is ms_tensor_summary, qid is 2
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.626.088 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RoiPoolingGradWithArgMax] register OP_IMPL : [][]
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.626.109 [tensor_data_transfer.cpp:1054]618925 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_tensor_summary
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.626.133 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_image_summary begins the construction process witch capacity 128
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.626.151 [tensor_data_transfer.cpp:1056]618925 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.626.159 [tensor_data_transfer.cpp:898]618650 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 1, name is ms_image_summary, capacity is 128
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.626.172 [api_impl.cc:6121] 618925 MemQueuePeek: Start to peek queue on devId 1, qid is 2.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.626.177 [api_impl.cc:6077] 618650 MemQueueInit: Start to init queue on devId 1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.626.187 [npu_driver.cc:4330] 618925 MemQueuePeek: peek mem queue, deviceId=1, qid=2, timeout=800.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.626.190 [npu_driver.cc:4076] 618650 MemQueueInit: init mem queue, device_id=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.626.202 [npu_driver.cc:4026] 618650 CheckMemQueueSupported: get majorVersion 7
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.626.209 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RoiPoolingWithArgMax] register OP_IMPL : [][]
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:42.626.233 [npu_driver.cc:4087] 618650 MemQueueInit: repeated init
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.626.247 [api_impl.cc:6040] 618650 MemQueueCreate: Start to create queue on devId 1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.626.257 [npu_driver.cc:3931] 618650 MemQueueCreate: create mem queue, deviceId=1, name=ms_image_summary.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.626.326 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotatedFeatureAlign] register OP_IMPL : [][]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:42.626.420 [queue_interface.c:182][ascend][curpid:618650,618650][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=3, actualQid=3, deploy_type=0)
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.626.437 [tensor_data_transfer.cpp:940]618650 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 1, name is ms_image_summary, real name is ms_image_summary, qid is 3
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.626.434 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotatedFeatureAlignGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.626.547 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SigmoidFocalLoss] register OP_IMPL : [][]
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.626.619 [tensor_data_transfer.cpp:1054]618927 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_image_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.626.647 [tensor_data_transfer.cpp:1056]618927 acltdtReceiveTensor: new process, use queue process
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.626.664 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SigmoidFocalLossGrad] register OP_IMPL : [][]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.626.663 [api_impl.cc:6121] 618927 MemQueuePeek: Start to peek queue on devId 1, qid is 3.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.626.672 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_scalar_summary begins the construction process witch capacity 128
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.626.688 [npu_driver.cc:4330] 618927 MemQueuePeek: peek mem queue, deviceId=1, qid=3, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.626.698 [tensor_data_transfer.cpp:898]618650 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 1, name is ms_scalar_summary, capacity is 128
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.626.715 [api_impl.cc:6077] 618650 MemQueueInit: Start to init queue on devId 1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.626.726 [npu_driver.cc:4076] 618650 MemQueueInit: init mem queue, device_id=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.626.737 [npu_driver.cc:4026] 618650 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:42.626.769 [npu_driver.cc:4087] 618650 MemQueueInit: repeated init
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.626.775 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SoftmaxFocalLossGrad] register OP_IMPL : [][]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.626.781 [api_impl.cc:6040] 618650 MemQueueCreate: Start to create queue on devId 1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.626.794 [npu_driver.cc:3931] 618650 MemQueueCreate: create mem queue, deviceId=1, name=ms_scalar_summary.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.626.927 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StackBallQuery] register OP_IMPL : [][]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:42.626.939 [queue_interface.c:182][ascend][curpid:618650,618650][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=4, actualQid=4, deploy_type=0)
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.626.955 [tensor_data_transfer.cpp:940]618650 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 1, name is ms_scalar_summary, real name is ms_scalar_summary, qid is 4
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.627.039 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ThreeInterpolate] register OP_IMPL : [][]
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.627.075 [tensor_data_transfer.cpp:1054]618929 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_scalar_summary
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.627.102 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_histogram_summary begins the construction process witch capacity 128
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.627.117 [tensor_data_transfer.cpp:1056]618929 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.627.126 [tensor_data_transfer.cpp:898]618650 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 1, name is ms_histogram_summary, capacity is 128
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.627.138 [api_impl.cc:6121] 618929 MemQueuePeek: Start to peek queue on devId 1, qid is 4.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.627.143 [api_impl.cc:6077] 618650 MemQueueInit: Start to init queue on devId 1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.627.152 [npu_driver.cc:4330] 618929 MemQueuePeek: peek mem queue, deviceId=1, qid=4, timeout=800.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.627.154 [npu_driver.cc:4076] 618650 MemQueueInit: init mem queue, device_id=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.627.169 [npu_driver.cc:4026] 618650 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:42.627.200 [npu_driver.cc:4087] 618650 MemQueueInit: repeated init
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.627.212 [api_impl.cc:6040] 618650 MemQueueCreate: Start to create queue on devId 1.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.627.205 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ThreeInterpolateBackward] register OP_IMPL : [][]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.627.225 [npu_driver.cc:3931] 618650 MemQueueCreate: create mem queue, deviceId=1, name=ms_histogram_summary.
[INFO] DRV(618650,python3.9):2025-04-03-09:27:42.627.375 [queue_interface.c:182][ascend][curpid:618650,618650][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=5, actualQid=5, deploy_type=0)
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.627.390 [tensor_data_transfer.cpp:940]618650 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 1, name is ms_histogram_summary, real name is ms_histogram_summary, qid is 5
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.627.464 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScoreGrad] register OP_IMPL : [][]
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.627.509 [tensor_data_transfer.cpp:1054]618931 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_histogram_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.627.539 [tensor_data_transfer.cpp:1056]618931 acltdtReceiveTensor: new process, use queue process
[INFO] HCCL_ADPT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.627.556 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:273] InitHccl] Start init hccl adapter.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.627.557 [api_impl.cc:6121] 618931 MemQueuePeek: Start to peek queue on devId 1, qid is 5.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.627.575 [npu_driver.cc:4330] 618931 MemQueuePeek: peek mem queue, deviceId=1, qid=5, timeout=800.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.627.657 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwinAttentionFFN] register OP_IMPL : [][]
[INFO] HCCL_ADPT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.627.701 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:569] InitKernelInfoStore] Start init hccl kernel info store.
[INFO] HCCL_ADPT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.627.735 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:586] InitKernelInfoStore] Get builder ops_kernel_info_hccl
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:42.627.750 [plugin_manager.cc:25] [618650]hcom ops plugin init start.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:42.627.785 [plugin_manager.cc:38] [618650]input BUILD_MODE is not set, result autoTune is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:42.627.801 [plugin_manager.cc:42] [618650]hcom running normal mode.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.627.820 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwinAttentionScoreQuant] register OP_IMPL : [][]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:42.627.840 [hcom_plugin.cc:50] [618650]Initialize start.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:42.627.854 [hcom_plugin.cc:52] [618650]initializeCount_ : 1
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:42.627.886 [hcom_plugin.cc:60] [618650]hvdOpsKernelInfoStoreInfoPtr_ is initialized
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:42.627.908 [hcom_plugin.cc:63] [618650]hvdGraphOptimizerPtr_ is initialized
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:42.627.920 [hcom_plugin.cc:329] [618650]ParserHcclAlgoDesc: there is no key named "HCCL_algorithm" in the options.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:42.627.934 [hcom_plugin.cc:281] [618650]ParserHcclExecTimeOut: there is no key named "HCCL_execTimeOut" in the options.
[WARNING] HCCL(618650,python3.9):2025-04-03-09:27:42.627.952 [hcom_plugin.cc:217] [618650]option profiling mode is not found.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:42.627.965 [hcom_plugin.cc:164] [618650][masterInfo]get Master Info:ip or port or deviceId not set.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:42.627.976 [hcom_plugin.cc:180] [618650][masterInfo]get Rank Info: worker size not set.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:42.627.986 [hcom_plugin.cc:244] [618650]InitializePlugin: Init without ranktable and masterInfo, please check your mode.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.628.006 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwinAttentionScore] register OP_IMPL : [][]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:42.628.102 [hcom_plugin.cc:82] [618650]hccl ops plugin init success.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:42.628.118 [plugin_manager.cc:48] [618650]hcom ops plugin init end. ret[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:42.628.129 [hcom_plugin.cc:126] [618650]get hccl kernel info store start.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:42.628.149 [hcom_plugin.cc:132] [618650]get hccl kernel info store finished.
[INFO] HCCL_ADPT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.628.189 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:608] InitKernelInfoStore] Init hccl kernel info store success.
[INFO] HCCL_ADPT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.628.212 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:786] InitHcclExec] Start init hccl exec.
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:42.628.178 [trs_cb_event.c:119][ascend][curpid:618658,618774][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =64; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:42.628.185 [trs_cb_event.c:119][ascend][curpid:618658,618775][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =65; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:42.628.207 [trs_sqcq.c:1491][ascend][curpid:618658,618774][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:42.628.235 [hcom_executor.cc:29] [618650]Hcom Excutor Initialize start.
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:42.628.231 [trs_sqcq.c:1491][ascend][curpid:618658,618775][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:42.628.244 [npu_driver.cc:3833] 618774 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:42.628.259 [npu_driver.cc:3833] 618775 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=65, drvRetCode=16.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.628.252 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwinTransformerLnQkvQuant] register OP_IMPL : [][]
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:42.628.266 [api_impl.cc:5058] 618774 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:42.628.281 [api_impl.cc:5058] 618775 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.628.292 [runtime.cc:5239] 618650 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:42.628.310 [adapter_rts.cc:234] [618650][hrtGetDevice]deviceLogicId[1]
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.628.290 [callback.cpp:132]618774 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.628.312 [callback.cpp:132]618775 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.628.331 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.628.342 [api_c_soc.cc:70] 618650 rtGetSocVersion: soc version is Ascend910B3
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.628.349 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:42.628.357 [npu_driver.cc:3828] 618774 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=64.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:42.628.378 [npu_driver.cc:3828] 618775 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=65.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:42.628.395 [hcom_common.cc:85] [618650][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[1] 
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:42.628.422 [hcom_common.cc:88] [618650][HcomGetCurHcomCtx] is no Used deviceLogicId[1] 
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:42.628.444 [hcom.cc:486] [618650]Get Hcom Init Status: [0]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.628.460 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwinTransformerLnQKV] register OP_IMPL : [][]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:42.628.466 [hcom_common.cc:85] [618650][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[1] 
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:42.628.479 [hcom_rpc.cc:1019] [618650]Get Hcom Init Status: [0]
[WARNING] HCCL(618650,python3.9):2025-04-03-09:27:42.628.500 [hcom_base_funs.cc:36] [618650][HcomOpsKernelInfoStore][InitHcom]OPTION_EXEC_RANK_TABLE is not found.
[WARNING] HCCL(618650,python3.9):2025-04-03-09:27:42.628.524 [hcom_executor.cc:121] [618650][HcomOpsKernelInfoStore][InitHcom]OPTION_EXEC_HCOM_GROUPLIST is not found.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.628.582 [api_impl.cc:1120] 618650 StreamCreate: priority=0, flags=1536.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.628.622 [npu_driver.cc:404] 618650 StreamIdAlloc: stream id alloc begin, device_id=1, priority=0, ts_id=0, remote_stream_id=0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.628.673 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMatMul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.628.696 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMatMulV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.628.713 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatMul] register OP_IMPL : [][]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.628.724 [stream.cc:2246] 618650 AllocExecutedTimesSvm: stream_id=4.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.628.728 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatMulV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.628.752 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantBatchMatmul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.628.770 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatMulV2CompressDequant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.628.788 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMatmulFixpipe] register OP_IMPL : [][]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.628.802 [stream_sqcq_manage.cc:147] 618650 Alloc: deviceId=1, tsId=0, drvFlag=0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.628.805 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[WeightQuantBatchmatmul] register OP_IMPL : [][]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.628.818 [npu_driver.cc:882] 618650 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.629.353 [npu_driver.cc:6125] 618650 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.629.399 [npu_driver.cc:6137] 618650 LogicCqAllocateV2: success: deviceId=1, tsId=0, cqId=404, streamId=4, logicCq=404, cqeDepth=4096
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.629.423 [npu_driver.cc:6189] 618650 StreamBindLogicCq: success: deviceId=1, tsId=0, streamId=4, logicCq=404.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.629.439 [npu_driver.cc:5916] 618650 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=d43e8000, addr=dfffd43e8000size=4096
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.629.453 [stream.cc:653] 618650 Setup: Success to get sq=4 sq reg virtual addr length=4096.
[INFO] DRV(618650,python3.9):2025-04-03-09:27:42.629.523 [devmm_svm.c:1972][ascend][curpid:618650,618650][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.629.538 [npu_driver.cc:6080] 618650 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.629.577 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatMulV3] register OP_IMPL : [][][]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.629.930 [stream.cc:291] 618650 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=4, flags_=0x600.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.629.986 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMatMulV3] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.630.394 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TransposeBatchMatMul] register OP_IMPL : [][][]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.630.552 [stream.cc:688] 618650 Setup: stream setup end, stream_id=4, IsTaskSink=0, sqId=4, cqId=4, deviceId=1, streamResId=65535
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.630.572 [acl_resource_manager.cpp:814]618650 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.630.584 [acl_resource_manager.cpp:816]618650 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.630.589 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GemmV2] register OP_IMPL : [][]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.630.597 [api_impl.cc:1162] 618650 StreamCreate: Succ, flags=1536, stream_id=4, context=aaab312ab590
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:42.630.631 [stream.cc:73] [618650]Construct stream by stream type success, ptr[0xaaab3c6b7190] ctx[0xaaab312ab590], stream id[4], cqId[4], logicCqid[404]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.630.667 [api_impl.cc:1120] 618650 StreamCreate: priority=0, flags=1536.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.630.685 [npu_driver.cc:404] 618650 StreamIdAlloc: stream id alloc begin, device_id=1, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.630.712 [stream.cc:2246] 618650 AllocExecutedTimesSvm: stream_id=5.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.630.745 [stream_sqcq_manage.cc:147] 618650 Alloc: deviceId=1, tsId=0, drvFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.630.758 [npu_driver.cc:882] 618650 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.630.790 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantBatchMatmulV3] register OP_IMPL : [][]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.630.974 [npu_driver.cc:6125] 618650 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.631.022 [npu_driver.cc:6137] 618650 LogicCqAllocateV2: success: deviceId=1, tsId=0, cqId=405, streamId=5, logicCq=405, cqeDepth=4096
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.631.039 [npu_driver.cc:6189] 618650 StreamBindLogicCq: success: deviceId=1, tsId=0, streamId=5, logicCq=405.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.631.053 [npu_driver.cc:5916] 618650 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=d43c7000, addr=dfffd43c7000size=4096
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.631.064 [stream.cc:653] 618650 Setup: Success to get sq=5 sq reg virtual addr length=4096.
[INFO] DRV(618650,python3.9):2025-04-03-09:27:42.631.108 [devmm_svm.c:1972][ascend][curpid:618650,618650][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.631.123 [npu_driver.cc:6080] 618650 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.631.199 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TransQuantParamV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.631.319 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3D] register OP_IMPL : [][]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.631.440 [stream.cc:291] 618650 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=5, flags_=0x600.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.631.487 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AvgPool3D] register OP_IMPL : [][]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.087 [stream.cc:688] 618650 Setup: stream setup end, stream_id=5, IsTaskSink=0, sqId=5, cqId=5, deviceId=1, streamResId=65535
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.632.106 [acl_resource_manager.cpp:814]618650 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.632.116 [acl_resource_manager.cpp:816]618650 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.127 [api_impl.cc:1162] 618650 StreamCreate: Succ, flags=1536, stream_id=5, context=aaab312ab590
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:42.632.145 [stream.cc:73] [618650]Construct stream by stream type success, ptr[0xaaab3c7331f0] ctx[0xaaab312ab590], stream id[5], cqId[5], logicCqid[405]
[WARNING] HCCL(618650,python3.9):2025-04-03-09:27:42.632.383 [sal.cc:619] [618933]err[34] link[Hccl_MessageProcess] nameSet failed.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:42.632.416 [hcom_executor.cc:587] [618933]MessageProcessThreadLoop start queType:[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.446 [api_impl.cc:2999] 618933 SetDevice: device_id=1, deviceMode=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.459 [device.cc:306] 618933 Init: device mode has been already set, mode=0.
[WARNING] HCCL(618650,python3.9):2025-04-03-09:27:42.632.454 [sal.cc:619] [618934]err[34] link[Hccl_MessageProcess] nameSet failed.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.472 [runtime.cc:3393] 618933 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x3
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:42.632.496 [hcom_executor.cc:587] [618934]MessageProcessThreadLoop start queType:[1]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.499 [runtime.cc:3560] 618933 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.516 [api_impl.cc:2999] 618935 SetDevice: device_id=1, deviceMode=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.525 [api_impl.cc:2987] 618933 NewDevice: SetCurRef = 0xaaab312ab590,userDeviceId=1,deviceId=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.528 [api_impl.cc:2999] 618934 SetDevice: device_id=1, deviceMode=0.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:42.632.533 [hcom_executor.cc:34] [618650][Initialize][HcomExecutor]Hcom Excutor Initialize end. ret[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.544 [device.cc:306] 618935 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.547 [runtime.cc:5239] 618933 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.563 [runtime.cc:3393] 618935 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x4
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.566 [device.cc:306] 618934 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.569 [api_impl.cc:2992] 618933 NewDevice: New device success, user_device_id=1, die_num=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.578 [runtime.cc:3560] 618935 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=1
[INFO] HCCL_ADPT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.632.578 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:792] InitHcclExec] Hcom DynamicKernel Initialize success
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.580 [runtime.cc:3393] 618934 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x5
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.579 [api_impl.cc:2999] 618936 SetDevice: device_id=1, deviceMode=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.588 [api_impl.cc:2987] 618935 NewDevice: SetCurRef = 0xaaab312ab590,userDeviceId=1,deviceId=1
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:42.632.590 [awatchdog_core.c:175](tid:618933) create watchdog for id : 65543, tid : 618933, timeout : 300s
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.597 [runtime.cc:3560] 618934 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=1
[INFO] HCCL_ADPT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.632.601 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:798] InitHcclExec] InitHcclExec success
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.607 [device.cc:306] 618936 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.610 [runtime.cc:5239] 618935 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.613 [api_impl.cc:3025] 618933 SetDevice: SetDevice success, curCtx=0xaaab312ab590, user_device_id=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.616 [api_impl.cc:2987] 618934 NewDevice: SetCurRef = 0xaaab312ab590,userDeviceId=1,deviceId=1
[INFO] HCCL_ADPT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.632.625 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:291] InitHccl] Init hccl adapter success.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.624 [runtime.cc:3393] 618936 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x6
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.631 [api_impl.cc:2992] 618935 NewDevice: New device success, user_device_id=1, die_num=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.633 [runtime.cc:5239] 618934 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.641 [runtime.cc:3560] 618936 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=1
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.632.651 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:92] Initialize] Successfully initialize HCCL.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.649 [api_impl.cc:2992] 618934 NewDevice: New device success, user_device_id=1, die_num=1.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:42.632.650 [awatchdog_core.c:175](tid:618935) create watchdog for id : 65543, tid : 618935, timeout : 300s
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.664 [api_impl.cc:2987] 618936 NewDevice: SetCurRef = 0xaaab312ab590,userDeviceId=1,deviceId=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.674 [api_impl.cc:3025] 618935 SetDevice: SetDevice success, curCtx=0xaaab312ab590, user_device_id=1.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:42.632.674 [awatchdog_core.c:175](tid:618934) create watchdog for id : 65543, tid : 618934, timeout : 300s
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.632.679 [mindspore/ccsrc/distributed/collective/collective_manager.cc:628] InitDeviceCommLib] Communication library on device side is successfully initialized.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.677 [runtime.cc:5239] 618936 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.690 [api_impl.cc:3025] 618934 SetDevice: SetDevice success, curCtx=0xaaab312ab590, user_device_id=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.699 [api_impl.cc:2992] 618936 NewDevice: New device success, user_device_id=1, die_num=1.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:42.632.715 [awatchdog_core.c:175](tid:618936) create watchdog for id : 65543, tid : 618936, timeout : 300s
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.632.727 [api_impl.cc:3025] 618936 SetDevice: SetDevice success, curCtx=0xaaab312ab590, user_device_id=1.
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.632.717 [mindspore/ccsrc/distributed/collective/collective_manager.cc:211] Initialize] [PROF]InitDeviceBackend costs 1126.49 msec.
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.632.765 [mindspore/ccsrc/distributed/collective/collective_manager.cc:860] IsAsyncInitGlobalComm] Async initialize global comm: 0. async_conf: 1, is_graph: 0, use_rank_table: 0, simulation: 0, use_mpi: 0, is_ascend: 1
[WARNING] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.632.786 [mindspore/ccsrc/distributed/collective/collective_manager.cc:335] CreateCommunicationGroup] Start to create communication group: hccl_world_group [const vector]{0, 1, 2, 3, 4, 5, 6, 7}, async: 0, submit_now: 1
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.632.840 [mindspore/ccsrc/distributed/collective/collective_manager.cc:367] CreateCommunicationGroup] [PROF]CreateCommunicationGroupOnHostSide costs 0.018 msec.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.632.889 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:148] CreateCommunicationGroup] Successfully create LCCL communication group hccl_world_group
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.632.922 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:166] CreateCommunicationGroup] Successfully create HCCL communication group hccl_world_group
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.632.942 [mindspore/ccsrc/distributed/collective/collective_manager.cc:374] CreateCommunicationGroup] [PROF]CreateCommunicationGroupOnDeviceSide costs 0.081 msec.
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.633.070 [mindspore/ccsrc/distributed/collective/collective_manager.cc:919] SubmitCreateDeviceCommTask] Launch init comm thread.
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:42.633.093 [mindspore/ccsrc/distributed/collective/collective_manager.cc:925] SubmitCreateDeviceCommTask] Submit init communicator task for hccl_world_group. Call 'WaitCommInitDone' later to wait initialization to be done.
[INFO] DISTRIBUTED(618650,fffeda7cefa0,python3.9):2025-04-03-09:27:42.633.189 [mindspore/ccsrc/distributed/collective/collective_manager.cc:973] RunInitCommTasks] Create device communicator in thread for group: hccl_world_group
[INFO] DISTRIBUTED(618650,fffeda7cefa0,python3.9):2025-04-03-09:27:42.633.226 [mindspore/ccsrc/distributed/collective/collective_manager.cc:764] CreateDeviceCommunicator] Create device communicator for hccl_world_group
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.633.271 [device.cpp:143]618937 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.633.302 [api_impl.cc:2999] 618937 SetDevice: device_id=1, deviceMode=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.633.316 [device.cc:306] 618937 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.633.329 [runtime.cc:3393] 618937 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x7
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.633.343 [runtime.cc:3560] 618937 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.633.354 [api_impl.cc:2987] 618937 NewDevice: SetCurRef = 0xaaab312ab590,userDeviceId=1,deviceId=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.633.367 [runtime.cc:5239] 618937 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.633.381 [api_impl.cc:2992] 618937 NewDevice: New device success, user_device_id=1, die_num=1.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:42.633.398 [awatchdog_core.c:175](tid:618937) create watchdog for id : 65543, tid : 618937, timeout : 300s
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.633.411 [api_impl.cc:3025] 618937 SetDevice: SetDevice success, curCtx=0xaaab312ab590, user_device_id=1.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.633.423 [acl.cpp:115]618937 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.633.434 [acl.cpp:121]618937 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.633.447 [device.cpp:154]618937 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 1
[INFO] DISTRIBUTED(618650,fffeda7cefa0,python3.9):2025-04-03-09:27:42.633.483 [mindspore/ccsrc/distributed/collective/collective_manager.cc:787] CreateDeviceCommunicator] [PROF]GenerateRootInfo costs 0.203 msec.
[WARNING] DEVICE(618650,fffeda7cefa0,python3.9):2025-04-03-09:27:42.633.751 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:248] QueryUniqueID] Retry to lookup the unique id for group hccl_world_group from the meta server node...Retry time: 399/400, sleep 2
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.634.025 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[WeightQuantBatchMatmulV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.635.863 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynSeqOuter] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.635.983 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Expand] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.636.097 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MovingSumWithSigmoid] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.636.217 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[YoloxBoundingBoxDecode] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.636.503 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CircularPad] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.636.652 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[CircularPadGrad] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.636.852 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RotaryPosEmbInfer] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.637.189 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReshapeAndCache] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.637.214 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNz] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.637.240 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReshapeAndCacheNdSiso] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.637.259 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompress] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.637.276 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReshapeAndCacheCompressRope] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.637.444 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleLinear1d] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.637.466 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleBilinear2d] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.637.626 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleBicubic2d] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.637.792 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAA] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.637.964 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dAAGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.638.128 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleBicubic2dGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.638.309 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleNearest3dGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.638.331 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3dGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.638.485 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAA] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.638.650 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dAABackward] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.638.818 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleBilinear2dGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.638.991 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ResizeUpsampleTrilinear] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.639.157 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleTrilinear3dBackward] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.639.312 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleNearest3d] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.639.334 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleNearestExact3d] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.639.485 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleNearest] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.639.663 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleNearestExact2dGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.639.686 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[UpsampleNearest2dGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.639.799 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AvgPoolGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.639.912 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilter] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.639.936 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropFilter] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.640.064 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2DBackpropInput] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.640.085 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DepthwiseConv2DBackpropInput] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.640.218 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2DTranspose] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.640.330 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilter] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.640.443 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3DBackpropInput] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.640.559 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3DTranspose] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.640.664 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Deconvolution] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.640.773 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Dilation] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.640.963 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.641.155 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2DBackpropFilterV3] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.641.543 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3DBackpropFilterV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.641.918 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3DBackpropInputV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.642.115 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2DBackpropInputV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.642.441 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3DTransposeV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.642.624 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2DTransposeV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.642.709 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.642.813 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ReflectionPad3dGrad] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.642.827 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.642.931 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AvgPool] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.643.005 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.643.052 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AvgPoolV2] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.643.087 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.643.207 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv2D] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.643.230 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DepthwiseConv2D] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.643.250 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Pooling] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.643.235 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.643.270 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantConv2D] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.643.384 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.644.050 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [][][][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.644.139 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.644.408 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdaptiveMaxPool3d] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.644.413 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.644.499 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MlaAttentionScore] register OP_IMPL : []
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.644.650 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.644.850 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AdaptiveAvgPool3d] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.644.886 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.645.017 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddLayerNormGrad] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.645.068 [op_impl_registry.cc:122]618654 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.645.170 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddLayerNormQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.645.321 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.645.345 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InplaceAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.645.498 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddRmsNormDynamicQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.645.644 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.645.731 [op_impl_registry_holder_manager.cc:208]618654 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 599
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.645.793 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.645.817 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InplaceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.645.969 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[KvRmsNormRopeCache] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.646.120 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SingleRope] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.646.262 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddRmsNormCast] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.646.422 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AddLora] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.646.572 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AGLU] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.646.965 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AllGatherMatmul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.647.315 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AlltoAllAllGatherBatchMatMul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.647.558 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[AvgPool3DGrad] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.647.743 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BackgroundReplace] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.649.051 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BlendImagesCustom] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.649.489 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Conv3DV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.650.029 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NLLLossGrad310p] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.650.187 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DeepNormGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.650.339 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DeepNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.650.453 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DropoutWithMulsAndSoftmaxGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.650.613 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DuaQuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.650.771 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.650.794 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DynamicQuantV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.650.899 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ExtractImagePatches] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.650.921 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Im2col] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.651.250 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IsFinite] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.651.359 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IsInf] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.651.501 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ForeachBinaryOp] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.651.540 [op_impl_registry_holder_manager.cc:208]618654 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 599
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.651.662 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FlatQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.651.781 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Ger] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.652.080 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedMatMulAllReduce] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.652.271 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedMatmulAdd] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.652.420 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.652.537 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IFMR] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.652.649 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InTopKD] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.652.799 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InstanceNormV3] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.652.979 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IouV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.653.155 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BidirectionLSTM] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.653.178 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BidirectionLSTMV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.653.336 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.653.357 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantGroupedMatmulDequant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.653.502 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaskedSelectV3] register OP_IMPL : [][]
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.653.525 [op_impl_registry_holder_manager.cc:208]618654 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.653.683 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MaskedSoftmaxWithRelPosBias] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.655.114 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatmulAllReduce] register OP_IMPL : [][]
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:42.660.189 [trs_cb_event.c:119][ascend][curpid:618674,618818][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =64; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:42.660.193 [trs_cb_event.c:119][ascend][curpid:618674,618819][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =65; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:42.660.214 [trs_sqcq.c:1491][ascend][curpid:618674,618818][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:42.660.187 [trs_cb_event.c:119][ascend][curpid:618662,618816][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =832; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:42.660.193 [trs_cb_event.c:119][ascend][curpid:618662,618817][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =833; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:42.660.225 [trs_sqcq.c:1491][ascend][curpid:618662,618816][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:42.660.244 [trs_sqcq.c:1491][ascend][curpid:618662,618817][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:42.660.228 [trs_sqcq.c:1491][ascend][curpid:618674,618819][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:42.660.241 [npu_driver.cc:3833] 618818 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:42.660.253 [npu_driver.cc:3833] 618816 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=832, drvRetCode=16.
[WARNING] RUNTIME(618662,python3.9):20[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:42.660.254 [npu_driver.cc:3833] 618819 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:42.660.262 [api_impl.cc:5058] 618818 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:42.660.278 [api_impl.cc:5058] 618819 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.660.286 [callback.cpp:132]618818 aclrtProcessReport: wait subscribereport timeo25-04-03-09:27:42.660.266 [npu_driver.cc:3833] 618817 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=833, drvRetCode=16.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:42.660.273 [api_impl.cc:5058] 618816 ProcessReport: CqReportIrqWait, retCode=0x711000c
ut, runtime errorCode = 507012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.660.307 [callback.cpp:132]618819 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:42.660.322 [api_impl.cc:5058] 618817 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.660.334 [callback.cpp:132]618816 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.660.327 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.660.345 [callback.cpp:132]618817 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.660.354 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:42.660.342 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.660.348 [npu_driver.cc:3828] 618818 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=64.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:42.660.365 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.660.372 [npu_driver.cc:3828] 618819 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=65.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.660.373 [npu_driver.cc:3828] 618816 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=832.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.660.386 [npu_driver.cc:3828] 618817 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=833.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.660.747 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.660.786 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[InplaceMatmulAllReduceAddRmsNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.663.285 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatmulLayerNormReduce] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.663.550 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MatmulReduceScatter] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.663.837 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MedianDim] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.664.168 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[BatchMatMulReduceScatterAlltoAll] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.664.370 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeDistributeDispatch] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.664.574 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeDistributeCombine] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.664.740 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeFinalizeRoutingV2] register OP_IMPL : [][]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:42.664.817 [runtime.cc:5239] 618772 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:42.664.850 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618772] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:42.664.871 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618772] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:42.664.888 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618772] [TsdClient] g_userDeviceInfo is empty.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.664.896 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeTutelCombineGates] register OP_IMPL : [][]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:42.664.917 [runtime.cc:3077] 618772 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=3, devId=3, tdt status=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:42.665.059 [npu_driver.cc:551] 618772 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.665.079 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeTutelCombineX] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.665.217 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeTutelDispatch] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.665.301 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MrgbaCustom] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.665.558 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MultiHeadAttentionScore] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.665.675 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[NMSWithMask] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.665.829 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantizeAddLayerNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.666.299 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Rfft1D] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.666.454 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RmsNormGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.666.601 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RmsNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.666.626 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GemmaRmsNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.666.751 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RoiExtractor] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.666.867 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterElements] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.667.049 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LinearIndex] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.667.232 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[LinearIndexV2] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.667.423 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScatterAddWithSorted] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.667.574 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[Sinkhorn] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.667.681 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SortedNMS] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.667.798 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyFtrlD] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.667.819 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SparseApplyFtrl] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.668.014 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SquareSumAll] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.668.217 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StackGroupPoints] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.668.373 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[StridedSliceAssignV2] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.668.478 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SubMulConcat] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.668.635 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwiGlu] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.668.659 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwiGluGrad] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.668.781 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[SwiGluQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.668.892 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TopKD] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.668.913 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TopKV2D] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.668.934 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TopKV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.669.073 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[TopKV3] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.669.260 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.669.355 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MseLossGradV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.669.588 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[ScaledMaskedSoftmaxGradV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.669.772 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PreRmsNorm] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.669.796 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PreRmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.669.816 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[RmsNormQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.669.999 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[QuantPerChannel] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.670.024 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DequantPerChannel] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.672.795 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: Conv2DBackpropFilter, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.672.883 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: Conv2DBackpropInput, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.672.903 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: Conv2DTranspose, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.672.969 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: Conv2D, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.673.047 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: Conv3DBackpropInput, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.673.073 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: Conv3DTranspose, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.673.137 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: Conv3D, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.673.299 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: FFN, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.673.315 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: MatmulTunnerTiling, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.673.427 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: MatMulV2, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.673.444 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: BatchMatmulFixpipe, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.673.461 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: MatMulV3, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.673.477 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: QuantBatchMatmulV3, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.673.639 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: DynamicRNN, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.673.655 [tuning_tiling_registry.cc:30]618646 RegisterTilingData:optype: MatMulTunnerTiling, registered count: 15
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.674.823 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:op_select_format, op_type:MatMulV2, funcPointer:0xfffedea7b0b0, registered count:7
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.674.851 [op_check.cc:24]618646 RegisterOpCapability:RegisterOpCapability: check_type:check_supported, op_type:MatMulV2, funcPointer:0xfffedea7b310, registered count:5
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.675.254 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScore] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.675.732 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DetectFlashAttentionScoreGrad] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.677.659 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[DetectMatMul] register OP_IMPL : [][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.677.826 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.677.908 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FFN] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.678.315 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FlashAttentionScore] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.678.763 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FlashAttentionScoreGrad] register OP_IMPL : [][][][]
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:42.692.176 [trs_cb_event.c:119][ascend][curpid:618670,618823][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =65; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:42.692.176 [trs_cb_event.c:119][ascend][curpid:618670,618822][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =64; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:42.692.201 [trs_sqcq.c:1491][ascend][curpid:618670,618823][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:42.692.208 [trs_sqcq.c:1491][ascend][curpid:618670,618822][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:42.692.215 [npu_driver.cc:3833] 618823 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:42.692.220 [npu_driver.cc:3833] 618822 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:42.692.229 [api_impl.cc:5058] 618823 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:42.692.235 [api_impl.cc:5058] 618822 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.692.248 [callback.cpp:132]618823 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.692.263 [callback.cpp:132]618822 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.692.268 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:42.692.279 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.692.288 [npu_driver.cc:3828] 618823 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=65.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.692.296 [npu_driver.cc:3828] 618822 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=64.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.707.955 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.708.082 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[FusedInferAttentionScore] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.708.280 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.708.358 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedMatmul] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.708.497 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedMatmulSwiglu] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.708.632 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[GroupedMatmulSwigluQuant] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.709.307 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.709.390 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[IncreFlashAttention] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.709.646 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MlaProlog] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.709.730 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MlaAttentionScore] register OP_IMPL : []
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.709.876 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[MoeInitRoutingV2] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.710.102 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.710.280 [op_impl_registry.cc:122]618646 RegisterOpImplToRegistry:Op type[PromptFlashAttention] register OP_IMPL : [][][][]
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.710.981 [op_impl_registry_holder_manager.cc:208]618646 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 599
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.716.611 [op_impl_registry_holder_manager.cc:208]618646 GetOpImplFunctionsByHandle:GetRegisteredOpNum: 599
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.718.560 [op_impl_registry_holder_manager.cc:208]618646 GetOpImplFunctionsByHandle:GetRegisteredOpCtNum: 0
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.726.677 [op_impl_space_registry.cc:109]618654 MergeFunctions:op type AvgPool3DGrad inputs_dependency has been registered
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.727.991 [op_impl_space_registry.cc:84]618654 MergeFunctions:op type MoeInitRoutingV2 tiling_parse func has been registered
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.728.023 [op_impl_space_registry.cc:85]618654 MergeFunctions:op type MoeInitRoutingV2 compile_info_creator func has been registered
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.728.035 [op_impl_space_registry.cc:86]618654 MergeFunctions:op type MoeInitRoutingV2 compile_info_deleter func has been registered
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.728.049 [op_impl_space_registry.cc:87]618654 MergeFunctions:op type MoeInitRoutingV2 tiling func has been registered
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.728.063 [op_impl_space_registry.cc:93]618654 MergeFunctions:op type MoeInitRoutingV2 max_tiling_data_size has been registered
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.729.097 [op_impl_space_registry.cc:273]618654 ConvertSoToRegistry:Save so symbol and handle in path[/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so] success!
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.729.590 [plugin_manager.cc:564]618654 GetUpgradedOpMasterPath:Start to get upgraded op tiling path
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.729.622 [plugin_manager.cc:134]618654 GetUpgradedOppPath:Enter get upgraded opp path schedule
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.729.686 [file_utils.cc:47]618654 RealPath:[Util][realpath] Can not get real_path for /usr/local/Ascend/ascend-toolkit/latest/opp_latest/, reason:No such file or directory
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.729.707 [plugin_manager.cc:145]618654 GetUpgradedOppPath:[Call][RealPath] Opp path /usr/local/Ascend/ascend-toolkit/latest/opp_latest/ is invalid.
[WARNING] GE(618654,python3.9):2025-04-03-09:27:42.729.720 [plugin_manager.cc:567]618654 GetUpgradedOpMasterPath:Failed to get upgraded opp path!
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.729.797 [mem_manager.cc:31]618654 Initialize:MemManager Initialize.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.729.868 [rts_caching_mem_allocator.cc:131]618654 Initialize:RtsAllocatorManager Initialize.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.729.888 [mem_manager.cc:102]618654 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.729.900 [graph_mem_allocator.cc:17]618654 Initialize:MemoryAllocator::Initialize.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.729.916 [mem_manager.cc:102]618654 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.729.932 [graph_mem_allocator.cc:17]618654 Initialize:MemoryAllocator::Initialize.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.729.946 [mem_manager.cc:102]618654 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.729.959 [caching_allocator.cc:391]618654 FreeBlocks:Free blocks.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.729.973 [caching_allocator.cc:358]618654 FreeCachedBlocks:Free cached blocks
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.729.992 [mem_manager.cc:102]618654 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.730.009 [caching_allocator.cc:391]618654 FreeBlocks:Free blocks.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.730.018 [caching_allocator.cc:358]618654 FreeCachedBlocks:Free cached blocks
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.730.033 [mem_manager.cc:102]618654 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.730.050 [mem_manager.cc:102]618654 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.730.063 [mem_manager.cc:102]618654 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.730.079 [mem_manager.cc:102]618654 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.730.093 [mem_manager.cc:102]618654 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.730.108 [session_scope_mem_allocator.cc:73]618654 FreeAllMemory:Free all memory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.730.125 [mem_manager.cc:102]618654 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.730.137 [session_scope_mem_allocator.cc:73]618654 FreeAllMemory:Free all memory
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.730.188 [dump_manager.cc:152]618654 Init:exception dump is not enabled
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.730.237 [ge_executor.cc:315]618654 Initialize:Init GeExecutor over.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.730.258 [acl.cpp:321]618654 aclInit: set DumpConfig in aclInit
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.730.276 [dump.cpp:841]618654 HandleDumpConfig: start to execute HandleDumpConfig.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.730.447 [dump.cpp:759]618654 ConvertDumpCfg: start to execute ConvertDumpCfg.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.730.463 [dump.cpp:594]618654 IsValidDumpConfig: start to execute IsValidDumpConfig.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.730.474 [dump.cpp:224]618654 CheckDumpSceneSwitch: start to execute CheckDumpSceneSwitch.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.730.518 [dump.cpp:703]618654 SetUpDumpConfig: convert to ge dump config successfully, enable lite_exception dump, path=
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.730.539 [dump.cpp:771]618654 HandleDumpCommand: start to execute HandleDumpCommand.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.730.557 [dump.cpp:703]618654 SetUpDumpConfig: convert to ge dump config successfully, enable lite_exception dump, path=
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.730.623 [adx_datadump_server.cpp:77][tid:618654] start to do dump init
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.730.645 [adx_dump_record.cpp:210][tid:618654] dumpPath prefix is /home/jenkins/mindspore/testcases/testcases/tests/st/lccl
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.730.673 [adx_dump_record.cpp:214][tid:618654] record remote dump temp path : /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.730.915 [adx_server_manager.cpp:149][tid:618938] server manager add component (10)
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.730.919 [adx_dump_record.cpp:627][tid:618939] start dump thread, remote dump record temp path : /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/.
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.730.954 [adx_server_manager.cpp:165][tid:618938] server manager components init successfully
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.731.111 [adx_server_manager.cpp:203][tid:618940] Run Server(0) Process
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.731.173 [adx_server_manager.cpp:369][tid:618940] device up 0
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.731.194 [hdc_comm_opt.cpp:59][tid:618940] open device[0] server[13]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:42.731.312 [drv_log_user.c:623][ascend][curpid:618654,618940][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=0; fid=0; service_type="service_dump"; pid=618654)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:42.731.332 [hdc_server.c:363][ascend][curpid:618654,618940][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=0)
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.731.352 [hdc_api.cpp:119][tid:618940] logDevId 0 create HDC server successfully
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.731.391 [adx_server_manager.cpp:111][tid:618940] create server info
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.731.408 [adx_server_manager.cpp:369][tid:618940] device up 1
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.731.419 [hdc_comm_opt.cpp:59][tid:618940] open device[1] server[13]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:42.731.552 [drv_log_user.c:623][ascend][curpid:618654,618940][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=1; fid=0; service_type="service_dump"; pid=618654)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:42.731.569 [hdc_server.c:363][ascend][curpid:618654,618940][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=1)
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.731.582 [hdc_api.cpp:119][tid:618940] logDevId 1 create HDC server successfully
[WARNING] IDEDD(618654,python3.9):2025-04-03-09:27:42.731.595 [adx_hdc_epoll.cpp:34][tid:618940] hdc epoll has been created.
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.731.612 [adx_server_manager.cpp:111][tid:618940] create server info
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.731.624 [adx_server_manager.cpp:369][tid:618940] device up 2
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.731.636 [hdc_comm_opt.cpp:59][tid:618940] open device[2] server[13]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:42.731.707 [drv_log_user.c:623][ascend][curpid:618654,618940][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=2; fid=0; service_type="service_dump"; pid=618654)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:42.731.724 [hdc_server.c:363][ascend][curpid:618654,618940][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=2)
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.731.737 [hdc_api.cpp:119][tid:618940] logDevId 2 create HDC server successfully
[WARNING] IDEDD(618654,python3.9):2025-04-03-09:27:42.731.749 [adx_hdc_epoll.cpp:34][tid:618940] hdc epoll has been created.
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.731.765 [adx_server_manager.cpp:111][tid:618940] create server info
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.731.779 [adx_server_manager.cpp:369][tid:618940] device up 3
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.731.789 [hdc_comm_opt.cpp:59][tid:618940] open device[3] server[13]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:42.731.943 [drv_log_user.c:623][ascend][curpid:618654,618940][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=3; fid=0; service_type="service_dump"; pid=618654)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:42.731.961 [hdc_server.c:363][ascend][curpid:618654,618940][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=3)
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.731.975 [hdc_api.cpp:119][tid:618940] logDevId 3 create HDC server successfully
[WARNING] IDEDD(618654,python3.9):2025-04-03-09:27:42.731.988 [adx_hdc_epoll.cpp:34][tid:618940] hdc epoll has been created.
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.732.003 [adx_server_manager.cpp:111][tid:618940] create server info
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.732.016 [adx_server_manager.cpp:369][tid:618940] device up 4
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.732.030 [hdc_comm_opt.cpp:59][tid:618940] open device[4] server[13]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:42.732.181 [drv_log_user.c:623][ascend][curpid:618654,618940][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=4; fid=0; service_type="service_dump"; pid=618654)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:42.732.200 [hdc_server.c:363][ascend][curpid:618654,618940][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=4)
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.732.216 [hdc_api.cpp:119][tid:618940] logDevId 4 create HDC server successfully
[WARNING] IDEDD(618654,python3.9):2025-04-03-09:27:42.732.230 [adx_hdc_epoll.cpp:34][tid:618940] hdc epoll has been created.
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.732.245 [adx_server_manager.cpp:111][tid:618940] create server info
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.732.260 [adx_server_manager.cpp:369][tid:618940] device up 5
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.732.269 [hdc_comm_opt.cpp:59][tid:618940] open device[5] server[13]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:42.732.401 [drv_log_user.c:623][ascend][curpid:618654,618940][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=5; fid=0; service_type="service_dump"; pid=618654)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:42.732.419 [hdc_server.c:363][ascend][curpid:618654,618940][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=5)
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.732.432 [hdc_api.cpp:119][tid:618940] logDevId 5 create HDC server successfully
[WARNING] IDEDD(618654,python3.9):2025-04-03-09:27:42.732.445 [adx_hdc_epoll.cpp:34][tid:618940] hdc epoll has been created.
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.732.462 [adx_server_manager.cpp:111][tid:618940] create server info
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.732.473 [adx_server_manager.cpp:369][tid:618940] device up 6
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.732.486 [hdc_comm_opt.cpp:59][tid:618940] open device[6] server[13]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:42.732.620 [drv_log_user.c:623][ascend][curpid:618654,618940][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=6; fid=0; service_type="service_dump"; pid=618654)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:42.732.637 [hdc_server.c:363][ascend][curpid:618654,618940][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=6)
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.732.650 [hdc_api.cpp:119][tid:618940] logDevId 6 create HDC server successfully
[WARNING] IDEDD(618654,python3.9):2025-04-03-09:27:42.732.663 [adx_hdc_epoll.cpp:34][tid:618940] hdc epoll has been created.
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.732.681 [adx_server_manager.cpp:111][tid:618940] create server info
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.732.692 [adx_server_manager.cpp:369][tid:618940] device up 7
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.732.705 [hdc_comm_opt.cpp:59][tid:618940] open device[7] server[13]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:42.732.840 [drv_log_user.c:623][ascend][curpid:618654,618940][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=7; fid=0; service_type="service_dump"; pid=618654)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:42.732.864 [hdc_server.c:363][ascend][curpid:618654,618940][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=7)
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.732.878 [hdc_api.cpp:119][tid:618940] logDevId 7 create HDC server successfully
[WARNING] IDEDD(618654,python3.9):2025-04-03-09:27:42.732.890 [adx_hdc_epoll.cpp:34][tid:618940] hdc epoll has been created.
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.732.905 [adx_server_manager.cpp:111][tid:618940] create server info
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.734.015 [adx_server_manager.cpp:457][tid:618654] The server is initialized after waiting 3 times.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.734.039 [ge_executor.cc:1349]618654 SetDump:Start to set dump config
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.734.055 [dump_manager.cc:201]618654 NeedDoDump:Dump status: on, Overflow detection dump switch: off.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.734.093 [dump_manager.cc:261]618654 SetExceptionDump:Enable brief exception dump.
[INFO] GE(618654,python3.9):2025-04-03-09:27:42.734.138 [ge_executor.cc:1355]618654 SetDump:Set dump config successfully
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.734.178 [dump_manager.cpp:146][tid:618654] Set 3 dump setting, status: on, dump switch: 3
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:42.735.147 [dump_manager.cpp:301][tid:618654] Register exception callback, registered: 1
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.735.169 [dump.cpp:825]618654 HandleDumpCommand: set dump config for model successfully,adumpType = 3, dump_path = , dump_mode = , dump_op_switch = , dump_data = .
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.735.190 [acl.cpp:327]618654 aclInit: set HandleDumpConfig success in aclInit
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.735.206 [acl.cpp:329]618654 aclInit: set max_opqueue_num in aclInit
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.735.221 [acl_resource_manager.cpp:248]618654 HandleMaxOpQueueConfig: start to execute HandleMaxOpQueueConfig
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.735.318 [acl_resource_manager.cpp:275]618654 HandleMaxOpQueueConfig: no max_opqueue_num found, set default DEFAULT_MAX_OPQUEUE_NUM[20000].
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.735.337 [acl_resource_manager.cpp:278]618654 HandleMaxOpQueueConfig: HandleMaxOpQueueConfig end in HandleMaxOpQueueConfig
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.735.349 [acl.cpp:335]618654 aclInit: set HandleMaxOpQueueConfig success in aclInit
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.735.362 [acl.cpp:336]618654 aclInit: set HandleDefaultDevice in aclInit
[WARNING] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.735.426 [json_parser.cpp:260]618654 GetDefaultDeviceIdFromFile: no defaultDevice item!
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.735.444 [acl.cpp:343]618654 aclInit: set HandleDefaultDevice success in aclInit
[INFO] PROFILING(618654,python3.9):2025-04-03-09:27:42.735.465 [prof_atls_plugin.cpp:210] (tid:618654) Module[48] register callback of ctrl handle.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.735.484 [acl.cpp:351]618654 aclInit: set ProfilingConfig in aclInit
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.735.497 [profiling.cpp:141]618654 HandleProfilingConfig: start to execute HandleProfilingConfig
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.735.514 [profiling.cpp:135]618654 GetProfilingConfigFile: no profiling config file.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.735.575 [profiling.cpp:167]618654 HandleProfilingConfig: can not parse profiling config from file[/home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618654.json], errorCode = 0
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.735.593 [profiling.cpp:172]618654 HandleProfilingConfig: profiling config file[/home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618654.json] is empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.735.615 [profiling.cpp:176]618654 HandleProfilingConfig: start to use profiling config by config file mode
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.735.629 [profiling.cpp:179]618654 HandleProfilingConfig: ParseJsonFromFile ok in HandleProfilingConfig
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.735.645 [profiling.cpp:92]618654 HandleProfilingCommand: start to execute HandleProfilingCommand
[INFO] PROFILING(618654,python3.9):2025-04-03-09:27:42.736.042 [ai_drv_dev_api.cpp:316] >>> (tid:618654) Succeeded to get device 64 frequency=100000
[INFO] PROFILING(618654,python3.9):2025-04-03-09:27:42.736.180 [msprof_callback_impl.cpp:132] >>> (tid:618654) Dynamic profiling environment not really set, so do nothing.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.736.201 [profiling.cpp:122]618654 HandleProfilingCommand: set profiling config successfully
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.736.216 [profiling.cpp:186]618654 HandleProfilingConfig: set HandleProfilingConfig success
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.736.232 [hash_utils.cpp:108]618654 CalculateSimpleHash: Begin to calculate hash for file: /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618654.json
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.736.274 [hash_utils.cpp:128]618654 CalculateSimpleHash: file: /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618654.json, hash: 3917491750093904922
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.736.292 [acl.cpp:115]618654 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.736.324 [acl.cpp:280]618654 IsEnableAutoUCMemeory: auto-uc-memory is enabled.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.736.340 [acl.cpp:385]618654 aclInit: register kernel launch fill function in aclInit
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.736.362 [runtime.cc:5394] 618654 RegKernelLaunchFillFunc: registercallback finish, symbol:g_opSystemRunCfg.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.736.381 [api_impl.cc:7407] 618654 RegStreamStateCallback: Reg stream state callback, regName=ACL_MODULE_STREAM.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.736.426 [api_impl.cc:4211] 618654 RegDeviceStateCallback: Reg device state callback, regName=ACL_MODULE_DEVICE.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.736.448 [acl.cpp:420]618654 aclInit: successfully execute aclInit, aclInitRefCount is 1
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.736.637 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:199] InitializeAcl] Call aclInit successfully, json is {"dump":{"dump_scene":"lite_exception"},"err_msg_mode":"1"}
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.736.766 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:295] Initialize] End initializing device context.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.736.836 [mindspore/ccsrc/plugin/res_manager/ascend/ascend_res_manager.cc:467] LoadCollectiveCommLib] Loading MACCL collective library successfully.
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.736.861 [mindspore/ccsrc/distributed/collective/collective_manager.cc:621] InitDeviceCommLib] Start initializing communication library on device side...
[INFO] PROFILING(618654,python3.9):2025-04-03-09:27:42.742.339 [prof_atls_plugin.cpp:210] (tid:618654) Module[0] register callback of ctrl handle.
[WARNING] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.743.230 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:76] Initialize] Loading LCCL because env MS_ENABLE_LCCL is set to on. Pay attention that LCCL only supports communication group within single node in KernelByKernel for now.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.743.276 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:80] Initialize] Successfully initialize LCCL.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.743.359 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ascend_deprecated_interface.cc:83] OpenTsd] Device id = 2, rank size = 8.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.743.381 [device.cpp:143]618654 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.743.412 [api_impl.cc:2999] 618654 SetDevice: device_id=2, deviceMode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.743.432 [device.cc:306] 618654 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.743.451 [runtime.cc:3393] 618654 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.743.471 [runtime.cc:3560] 618654 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.743.490 [api_impl.cc:2987] 618654 NewDevice: SetCurRef = 0xaaaaf5082ff0,userDeviceId=2,deviceId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.743.508 [runtime.cc:5239] 618654 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.743.530 [api_impl.cc:2992] 618654 NewDevice: New device success, user_device_id=2, die_num=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.743.553 [api_impl.cc:3025] 618654 SetDevice: SetDevice success, curCtx=0xaaaaf5082ff0, user_device_id=2.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.743.572 [acl.cpp:115]618654 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.743.585 [acl.cpp:121]618654 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.743.609 [device.cpp:154]618654 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 2
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.743.667 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel _npu_log begins the construction process witch capacity 128
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.743.701 [tensor_data_transfer.cpp:898]618654 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 2, name is _npu_log, capacity is 128
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.743.730 [api_impl.cc:6077] 618654 MemQueueInit: Start to init queue on devId 2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.743.748 [npu_driver.cc:4076] 618654 MemQueueInit: init mem queue, device_id=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.743.766 [npu_driver.cc:4026] 618654 CheckMemQueueSupported: get majorVersion 7
[INFO] DRV(618654,python3.9):2025-04-03-09:27:42.743.803 [queue_client.c:151][ascend][curpid:618654,618654][drv][queuemng][QueueGetHostpid]Query tgid. (tgid=618654)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:42.743.984 [queue_client.c:305][ascend][curpid:618654,618654][drv][queuemng][QueueGetDevPid]Query devpid succ. (devId=2; vfid=0; hostpid=618654; master_pid=618654; proc_type=0; devpid=5065).
[INFO] DRV(618654,python3.9):2025-04-03-09:27:42.747.911 [queue_client.c:362][ascend][curpid:618654,618654][drv][queuemng][QueueInit]QueueInit device. (devid=2; mcast_flag=0; mcast_gid=0; proc_sn=0; event_sn_offset=0)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.748.114 [npu_driver.cc:4114] 618654 MemQueueInit: get max queue cnt 4294967294 success.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.748.138 [api_impl.cc:6040] 618654 MemQueueCreate: Start to create queue on devId 2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.748.186 [npu_driver.cc:3931] 618654 MemQueueCreate: create mem queue, deviceId=2, name=_npu_log.
[INFO] DRV(618654,python3.9):2025-04-03-09:27:42.748.472 [queue_interface.c:182][ascend][curpid:618654,618654][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=0, actualQid=0, deploy_type=0)
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.748.503 [tensor_data_transfer.cpp:940]618654 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 2, name is _npu_log, real name is _npu_log, qid is 0
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.748.639 [tensor_data_transfer.cpp:1054]618941 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is _npu_log
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.748.669 [tensor_data_transfer.cpp:1056]618941 acltdtReceiveTensor: new process, use queue process
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.748.708 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_tensor_dump begins the construction process witch capacity 128
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.748.728 [api_impl.cc:6121] 618941 MemQueuePeek: Start to peek queue on devId 2, qid is 0.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.748.733 [tensor_data_transfer.cpp:898]618654 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 2, name is ms_tensor_dump, capacity is 128
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.748.746 [npu_driver.cc:4330] 618941 MemQueuePeek: peek mem queue, deviceId=2, qid=0, timeout=800.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.748.756 [api_impl.cc:6077] 618654 MemQueueInit: Start to init queue on devId 2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.748.769 [npu_driver.cc:4076] 618654 MemQueueInit: init mem queue, device_id=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.748.785 [npu_driver.cc:4026] 618654 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:42.748.829 [npu_driver.cc:4087] 618654 MemQueueInit: repeated init
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.748.848 [api_impl.cc:6040] 618654 MemQueueCreate: Start to create queue on devId 2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.748.865 [npu_driver.cc:3931] 618654 MemQueueCreate: create mem queue, deviceId=2, name=ms_tensor_dump.
[INFO] DRV(618654,python3.9):2025-04-03-09:27:42.749.136 [queue_interface.c:182][ascend][curpid:618654,618654][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=1, actualQid=1, deploy_type=0)
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.749.155 [tensor_data_transfer.cpp:940]618654 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 2, name is ms_tensor_dump, real name is ms_tensor_dump, qid is 1
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.749.258 [tensor_data_transfer.cpp:1054]618943 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_tensor_dump
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.749.286 [tensor_data_transfer.cpp:1056]618943 acltdtReceiveTensor: new process, use queue process
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.749.318 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_tensor_summary begins the construction process witch capacity 128
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.749.319 [api_impl.cc:6121] 618943 MemQueuePeek: Start to peek queue on devId 2, qid is 1.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.749.341 [tensor_data_transfer.cpp:898]618654 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 2, name is ms_tensor_summary, capacity is 128
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.749.345 [npu_driver.cc:4330] 618943 MemQueuePeek: peek mem queue, deviceId=2, qid=1, timeout=800.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.749.362 [api_impl.cc:6077] 618654 MemQueueInit: Start to init queue on devId 2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.749.376 [npu_driver.cc:4076] 618654 MemQueueInit: init mem queue, device_id=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.749.403 [npu_driver.cc:4026] 618654 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:42.749.440 [npu_driver.cc:4087] 618654 MemQueueInit: repeated init
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.749.457 [api_impl.cc:6040] 618654 MemQueueCreate: Start to create queue on devId 2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.749.470 [npu_driver.cc:3931] 618654 MemQueueCreate: create mem queue, deviceId=2, name=ms_tensor_summary.
[INFO] DRV(618654,python3.9):2025-04-03-09:27:42.749.641 [queue_interface.c:182][ascend][curpid:618654,618654][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=2, actualQid=2, deploy_type=0)
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.749.660 [tensor_data_transfer.cpp:940]618654 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 2, name is ms_tensor_summary, real name is ms_tensor_summary, qid is 2
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.749.837 [tensor_data_transfer.cpp:1054]618945 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_tensor_summary
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.749.861 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_image_summary begins the construction process witch capacity 128
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.749.867 [tensor_data_transfer.cpp:1056]618945 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.749.879 [tensor_data_transfer.cpp:898]618654 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 2, name is ms_image_summary, capacity is 128
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.749.890 [api_impl.cc:6121] 618945 MemQueuePeek: Start to peek queue on devId 2, qid is 2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.749.902 [api_impl.cc:6077] 618654 MemQueueInit: Start to init queue on devId 2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.749.905 [npu_driver.cc:4330] 618945 MemQueuePeek: peek mem queue, deviceId=2, qid=2, timeout=800.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.749.915 [npu_driver.cc:4076] 618654 MemQueueInit: init mem queue, device_id=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.749.928 [npu_driver.cc:4026] 618654 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:42.749.966 [npu_driver.cc:4087] 618654 MemQueueInit: repeated init
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.749.984 [api_impl.cc:6040] 618654 MemQueueCreate: Start to create queue on devId 2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.749.997 [npu_driver.cc:3931] 618654 MemQueueCreate: create mem queue, deviceId=2, name=ms_image_summary.
[INFO] DRV(618654,python3.9):2025-04-03-09:27:42.750.148 [queue_interface.c:182][ascend][curpid:618654,618654][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=3, actualQid=3, deploy_type=0)
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.750.167 [tensor_data_transfer.cpp:940]618654 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 2, name is ms_image_summary, real name is ms_image_summary, qid is 3
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.750.267 [tensor_data_transfer.cpp:1054]618947 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_image_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.750.294 [tensor_data_transfer.cpp:1056]618947 acltdtReceiveTensor: new process, use queue process
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.750.295 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_scalar_summary begins the construction process witch capacity 128
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.750.313 [api_impl.cc:6121] 618947 MemQueuePeek: Start to peek queue on devId 2, qid is 3.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.750.318 [tensor_data_transfer.cpp:898]618654 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 2, name is ms_scalar_summary, capacity is 128
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.750.346 [npu_driver.cc:4330] 618947 MemQueuePeek: peek mem queue, deviceId=2, qid=3, timeout=800.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.750.352 [api_impl.cc:6077] 618654 MemQueueInit: Start to init queue on devId 2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.750.366 [npu_driver.cc:4076] 618654 MemQueueInit: init mem queue, device_id=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.750.382 [npu_driver.cc:4026] 618654 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:42.750.415 [npu_driver.cc:4087] 618654 MemQueueInit: repeated init
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.750.432 [api_impl.cc:6040] 618654 MemQueueCreate: Start to create queue on devId 2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.750.445 [npu_driver.cc:3931] 618654 MemQueueCreate: create mem queue, deviceId=2, name=ms_scalar_summary.
[INFO] DRV(618654,python3.9):2025-04-03-09:27:42.750.598 [queue_interface.c:182][ascend][curpid:618654,618654][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=4, actualQid=4, deploy_type=0)
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.750.617 [tensor_data_transfer.cpp:940]618654 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 2, name is ms_scalar_summary, real name is ms_scalar_summary, qid is 4
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.750.715 [tensor_data_transfer.cpp:1054]618949 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_scalar_summary
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.750.741 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_histogram_summary begins the construction process witch capacity 128
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.750.761 [tensor_data_transfer.cpp:1056]618949 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.750.770 [tensor_data_transfer.cpp:898]618654 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 2, name is ms_histogram_summary, capacity is 128
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.750.780 [api_impl.cc:6121] 618949 MemQueuePeek: Start to peek queue on devId 2, qid is 4.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.750.790 [api_impl.cc:6077] 618654 MemQueueInit: Start to init queue on devId 2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.750.795 [npu_driver.cc:4330] 618949 MemQueuePeek: peek mem queue, deviceId=2, qid=4, timeout=800.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.750.805 [npu_driver.cc:4076] 618654 MemQueueInit: init mem queue, device_id=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.750.818 [npu_driver.cc:4026] 618654 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:42.750.854 [npu_driver.cc:4087] 618654 MemQueueInit: repeated init
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.750.872 [api_impl.cc:6040] 618654 MemQueueCreate: Start to create queue on devId 2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.750.885 [npu_driver.cc:3931] 618654 MemQueueCreate: create mem queue, deviceId=2, name=ms_histogram_summary.
[INFO] DRV(618654,python3.9):2025-04-03-09:27:42.751.034 [queue_interface.c:182][ascend][curpid:618654,618654][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=5, actualQid=5, deploy_type=0)
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.751.054 [tensor_data_transfer.cpp:940]618654 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 2, name is ms_histogram_summary, real name is ms_histogram_summary, qid is 5
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.751.158 [tensor_data_transfer.cpp:1054]618951 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_histogram_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.751.189 [tensor_data_transfer.cpp:1056]618951 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.751.208 [api_impl.cc:6121] 618951 MemQueuePeek: Start to peek queue on devId 2, qid is 5.
[INFO] HCCL_ADPT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.751.214 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:273] InitHccl] Start init hccl adapter.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.751.225 [npu_driver.cc:4330] 618951 MemQueuePeek: peek mem queue, deviceId=2, qid=5, timeout=800.
[INFO] HCCL_ADPT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.751.362 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:569] InitKernelInfoStore] Start init hccl kernel info store.
[INFO] HCCL_ADPT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.751.397 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:586] InitKernelInfoStore] Get builder ops_kernel_info_hccl
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:42.751.418 [plugin_manager.cc:25] [618654]hcom ops plugin init start.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:42.751.459 [plugin_manager.cc:38] [618654]input BUILD_MODE is not set, result autoTune is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:42.751.482 [plugin_manager.cc:42] [618654]hcom running normal mode.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:42.751.530 [hcom_plugin.cc:50] [618654]Initialize start.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:42.751.547 [hcom_plugin.cc:52] [618654]initializeCount_ : 1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:42.751.581 [hcom_plugin.cc:60] [618654]hvdOpsKernelInfoStoreInfoPtr_ is initialized
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:42.751.608 [hcom_plugin.cc:63] [618654]hvdGraphOptimizerPtr_ is initialized
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:42.751.627 [hcom_plugin.cc:329] [618654]ParserHcclAlgoDesc: there is no key named "HCCL_algorithm" in the options.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:42.751.648 [hcom_plugin.cc:281] [618654]ParserHcclExecTimeOut: there is no key named "HCCL_execTimeOut" in the options.
[WARNING] HCCL(618654,python3.9):2025-04-03-09:27:42.751.674 [hcom_plugin.cc:217] [618654]option profiling mode is not found.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:42.751.693 [hcom_plugin.cc:164] [618654][masterInfo]get Master Info:ip or port or deviceId not set.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:42.751.711 [hcom_plugin.cc:180] [618654][masterInfo]get Rank Info: worker size not set.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:42.751.724 [hcom_plugin.cc:244] [618654]InitializePlugin: Init without ranktable and masterInfo, please check your mode.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:42.751.847 [hcom_plugin.cc:82] [618654]hccl ops plugin init success.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:42.751.864 [plugin_manager.cc:48] [618654]hcom ops plugin init end. ret[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:42.751.878 [hcom_plugin.cc:126] [618654]get hccl kernel info store start.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:42.751.903 [hcom_plugin.cc:132] [618654]get hccl kernel info store finished.
[INFO] HCCL_ADPT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.751.933 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:608] InitKernelInfoStore] Init hccl kernel info store success.
[INFO] HCCL_ADPT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.751.959 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:786] InitHcclExec] Start init hccl exec.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:42.751.975 [hcom_executor.cc:29] [618654]Hcom Excutor Initialize start.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.752.031 [runtime.cc:5239] 618654 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:42.752.059 [adapter_rts.cc:234] [618654][hrtGetDevice]deviceLogicId[2]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.752.091 [api_c_soc.cc:70] 618654 rtGetSocVersion: soc version is Ascend910B3
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:42.752.154 [hcom_common.cc:85] [618654][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[2] 
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:42.752.216 [hcom_common.cc:88] [618654][HcomGetCurHcomCtx] is no Used deviceLogicId[2] 
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:42.752.247 [hcom.cc:486] [618654]Get Hcom Init Status: [0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:42.752.279 [hcom_common.cc:85] [618654][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[2] 
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:42.752.295 [hcom_rpc.cc:1019] [618654]Get Hcom Init Status: [0]
[WARNING] HCCL(618654,python3.9):2025-04-03-09:27:42.752.318 [hcom_base_funs.cc:36] [618654][HcomOpsKernelInfoStore][InitHcom]OPTION_EXEC_RANK_TABLE is not found.
[WARNING] HCCL(618654,python3.9):2025-04-03-09:27:42.752.349 [hcom_executor.cc:121] [618654][HcomOpsKernelInfoStore][InitHcom]OPTION_EXEC_HCOM_GROUPLIST is not found.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.752.417 [api_impl.cc:1120] 618654 StreamCreate: priority=0, flags=1536.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.752.447 [npu_driver.cc:404] 618654 StreamIdAlloc: stream id alloc begin, device_id=2, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.752.511 [stream.cc:2246] 618654 AllocExecutedTimesSvm: stream_id=4.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.752.576 [stream_sqcq_manage.cc:147] 618654 Alloc: deviceId=2, tsId=0, drvFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.752.596 [npu_driver.cc:882] 618654 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.752.856 [npu_driver.cc:6125] 618654 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.752.906 [npu_driver.cc:6137] 618654 LogicCqAllocateV2: success: deviceId=2, tsId=0, cqId=1000, streamId=4, logicCq=1000, cqeDepth=4096
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.752.936 [npu_driver.cc:6189] 618654 StreamBindLogicCq: success: deviceId=2, tsId=0, streamId=4, logicCq=1000.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.752.957 [npu_driver.cc:5916] 618654 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=d00d7000, addr=dfffd00d7000size=4096
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.752.975 [stream.cc:653] 618654 Setup: Success to get sq=4 sq reg virtual addr length=4096.
[INFO] DRV(618654,python3.9):2025-04-03-09:27:42.753.047 [devmm_svm.c:1972][ascend][curpid:618654,618654][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.753.068 [npu_driver.cc:6080] 618654 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.753.405 [stream.cc:291] 618654 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=4, flags_=0x600.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.753.991 [stream.cc:688] 618654 Setup: stream setup end, stream_id=4, IsTaskSink=0, sqId=4, cqId=4, deviceId=2, streamResId=65535
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.754.014 [acl_resource_manager.cpp:814]618654 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.754.032 [acl_resource_manager.cpp:816]618654 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.754.048 [api_impl.cc:1162] 618654 StreamCreate: Succ, flags=1536, stream_id=4, context=aaaaf5082ff0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:42.754.079 [stream.cc:73] [618654]Construct stream by stream type success, ptr[0xaaab0048d980] ctx[0xaaaaf5082ff0], stream id[4], cqId[4], logicCqid[1000]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.754.127 [api_impl.cc:1120] 618654 StreamCreate: priority=0, flags=1536.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.754.151 [npu_driver.cc:404] 618654 StreamIdAlloc: stream id alloc begin, device_id=2, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.754.182 [stream.cc:2246] 618654 AllocExecutedTimesSvm: stream_id=5.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.754.221 [stream_sqcq_manage.cc:147] 618654 Alloc: deviceId=2, tsId=0, drvFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.754.239 [npu_driver.cc:882] 618654 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.754.396 [npu_driver.cc:6125] 618654 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.754.444 [npu_driver.cc:6137] 618654 LogicCqAllocateV2: success: deviceId=2, tsId=0, cqId=1001, streamId=5, logicCq=1001, cqeDepth=4096
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.754.468 [npu_driver.cc:6189] 618654 StreamBindLogicCq: success: deviceId=2, tsId=0, streamId=5, logicCq=1001.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.754.487 [npu_driver.cc:5916] 618654 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=d00b6000, addr=dfffd00b6000size=4096
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.754.505 [stream.cc:653] 618654 Setup: Success to get sq=5 sq reg virtual addr length=4096.
[INFO] DRV(618654,python3.9):2025-04-03-09:27:42.754.552 [devmm_svm.c:1972][ascend][curpid:618654,618654][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.754.571 [npu_driver.cc:6080] 618654 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.754.879 [stream.cc:291] 618654 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=5, flags_=0x600.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.755.502 [stream.cc:688] 618654 Setup: stream setup end, stream_id=5, IsTaskSink=0, sqId=5, cqId=5, deviceId=2, streamResId=65535
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.755.524 [acl_resource_manager.cpp:814]618654 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.755.536 [acl_resource_manager.cpp:816]618654 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.755.551 [api_impl.cc:1162] 618654 StreamCreate: Succ, flags=1536, stream_id=5, context=aaaaf5082ff0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:42.755.575 [stream.cc:73] [618654]Construct stream by stream type success, ptr[0xaaab005099e0] ctx[0xaaaaf5082ff0], stream id[5], cqId[5], logicCqid[1001]
[WARNING] HCCL(618654,python3.9):2025-04-03-09:27:42.755.789 [sal.cc:619] [618953]err[34] link[Hccl_MessageProcess] nameSet failed.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:42.755.824 [hcom_executor.cc:587] [618953]MessageProcessThreadLoop start queType:[0]
[WARNING] HCCL(618654,python3.9):2025-04-03-09:27:42.755.844 [sal.cc:619] [618954]err[34] link[Hccl_MessageProcess] nameSet failed.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.755.859 [api_impl.cc:2999] 618953 SetDevice: device_id=2, deviceMode=0.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:42.755.874 [hcom_executor.cc:587] [618954]MessageProcessThreadLoop start queType:[1]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.755.880 [device.cc:306] 618953 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.755.891 [api_impl.cc:2999] 618955 SetDevice: device_id=2, deviceMode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.755.897 [api_impl.cc:2999] 618954 SetDevice: device_id=2, deviceMode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.755.898 [runtime.cc:3393] 618953 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x3
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:42.755.904 [hcom_executor.cc:34] [618654][Initialize][HcomExecutor]Hcom Excutor Initialize end. ret[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.755.915 [device.cc:306] 618955 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.755.942 [runtime.cc:3560] 618953 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.755.954 [api_impl.cc:2999] 618956 SetDevice: device_id=2, deviceMode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.755.963 [runtime.cc:3393] 618955 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x4
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.755.964 [api_impl.cc:2987] 618953 NewDevice: SetCurRef = 0xaaaaf5082ff0,userDeviceId=2,deviceId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.755.965 [device.cc:306] 618954 Init: device mode has been already set, mode=0.
[INFO] HCCL_ADPT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.755.970 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:792] InitHcclExec] Hcom DynamicKernel Initialize success
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.755.985 [runtime.cc:3560] 618955 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.755.992 [runtime.cc:5239] 618953 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.756.002 [runtime.cc:3393] 618954 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x5
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.756.004 [device.cc:306] 618956 Init: device mode has been already set, mode=0.
[INFO] HCCL_ADPT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.756.015 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:798] InitHcclExec] InitHcclExec success
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.756.013 [api_impl.cc:2987] 618955 NewDevice: SetCurRef = 0xaaaaf5082ff0,userDeviceId=2,deviceId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.756.023 [api_impl.cc:2992] 618953 NewDevice: New device success, user_device_id=2, die_num=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.756.027 [runtime.cc:3560] 618954 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.756.035 [runtime.cc:3393] 618956 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x6
[INFO] HCCL_ADPT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.756.047 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:291] InitHccl] Init hccl adapter success.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.756.047 [runtime.cc:5239] 618955 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.756.059 [api_impl.cc:2987] 618954 NewDevice: SetCurRef = 0xaaaaf5082ff0,userDeviceId=2,deviceId=2
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:42.756.060 [awatchdog_core.c:175](tid:618953) create watchdog for id : 65543, tid : 618953, timeout : 300s
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.756.065 [runtime.cc:3560] 618956 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=2
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.756.081 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:92] Initialize] Successfully initialize HCCL.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.756.078 [api_impl.cc:2992] 618955 NewDevice: New device success, user_device_id=2, die_num=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.756.083 [runtime.cc:5239] 618954 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.756.088 [api_impl.cc:3025] 618953 SetDevice: SetDevice success, curCtx=0xaaaaf5082ff0, user_device_id=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.756.094 [api_impl.cc:2987] 618956 NewDevice: SetCurRef = 0xaaaaf5082ff0,userDeviceId=2,deviceId=2
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.756.110 [mindspore/ccsrc/distributed/collective/collective_manager.cc:628] InitDeviceCommLib] Communication library on device side is successfully initialized.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:42.756.110 [awatchdog_core.c:175](tid:618955) create watchdog for id : 65543, tid : 618955, timeout : 300s
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.756.116 [api_impl.cc:2992] 618954 NewDevice: New device success, user_device_id=2, die_num=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.756.140 [runtime.cc:5239] 618956 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.756.153 [api_impl.cc:3025] 618955 SetDevice: SetDevice success, curCtx=0xaaaaf5082ff0, user_device_id=2.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:42.756.184 [awatchdog_core.c:175](tid:618954) create watchdog for id : 65543, tid : 618954, timeout : 300s
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.756.188 [mindspore/ccsrc/distributed/collective/collective_manager.cc:211] Initialize] [PROF]InitDeviceBackend costs 1148.45 msec.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.756.191 [api_impl.cc:2992] 618956 NewDevice: New device success, user_device_id=2, die_num=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.756.198 [api_impl.cc:3025] 618954 SetDevice: SetDevice success, curCtx=0xaaaaf5082ff0, user_device_id=2.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:42.756.219 [awatchdog_core.c:175](tid:618956) create watchdog for id : 65543, tid : 618956, timeout : 300s
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.756.228 [mindspore/ccsrc/distributed/collective/collective_manager.cc:860] IsAsyncInitGlobalComm] Async initialize global comm: 0. async_conf: 1, is_graph: 0, use_rank_table: 0, simulation: 0, use_mpi: 0, is_ascend: 1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.756.239 [api_impl.cc:3025] 618956 SetDevice: SetDevice success, curCtx=0xaaaaf5082ff0, user_device_id=2.
[WARNING] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.756.255 [mindspore/ccsrc/distributed/collective/collective_manager.cc:335] CreateCommunicationGroup] Start to create communication group: hccl_world_group [const vector]{0, 1, 2, 3, 4, 5, 6, 7}, async: 0, submit_now: 1
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.756.315 [mindspore/ccsrc/distributed/collective/collective_manager.cc:367] CreateCommunicationGroup] [PROF]CreateCommunicationGroupOnHostSide costs 0.02 msec.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.756.368 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:148] CreateCommunicationGroup] Successfully create LCCL communication group hccl_world_group
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.756.412 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:166] CreateCommunicationGroup] Successfully create HCCL communication group hccl_world_group
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.756.437 [mindspore/ccsrc/distributed/collective/collective_manager.cc:374] CreateCommunicationGroup] [PROF]CreateCommunicationGroupOnDeviceSide costs 0.097 msec.
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.756.570 [mindspore/ccsrc/distributed/collective/collective_manager.cc:919] SubmitCreateDeviceCommTask] Launch init comm thread.
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:42.756.598 [mindspore/ccsrc/distributed/collective/collective_manager.cc:925] SubmitCreateDeviceCommTask] Submit init communicator task for hccl_world_group. Call 'WaitCommInitDone' later to wait initialization to be done.
[INFO] DISTRIBUTED(618654,fffea9fbefa0,python3.9):2025-04-03-09:27:42.756.698 [mindspore/ccsrc/distributed/collective/collective_manager.cc:973] RunInitCommTasks] Create device communicator in thread for group: hccl_world_group
[INFO] DISTRIBUTED(618654,fffea9fbefa0,python3.9):2025-04-03-09:27:42.756.742 [mindspore/ccsrc/distributed/collective/collective_manager.cc:764] CreateDeviceCommunicator] Create device communicator for hccl_world_group
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.756.790 [device.cpp:143]618957 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.756.822 [api_impl.cc:2999] 618957 SetDevice: device_id=2, deviceMode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.756.840 [device.cc:306] 618957 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.756.855 [runtime.cc:3393] 618957 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x7
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.756.869 [runtime.cc:3560] 618957 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.756.886 [api_impl.cc:2987] 618957 NewDevice: SetCurRef = 0xaaaaf5082ff0,userDeviceId=2,deviceId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.756.899 [runtime.cc:5239] 618957 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.756.915 [api_impl.cc:2992] 618957 NewDevice: New device success, user_device_id=2, die_num=1.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:42.756.936 [awatchdog_core.c:175](tid:618957) create watchdog for id : 65543, tid : 618957, timeout : 300s
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.756.954 [api_impl.cc:3025] 618957 SetDevice: SetDevice success, curCtx=0xaaaaf5082ff0, user_device_id=2.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.756.967 [acl.cpp:115]618957 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.756.983 [acl.cpp:121]618957 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.756.997 [device.cpp:154]618957 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 2
[INFO] DISTRIBUTED(618654,fffea9fbefa0,python3.9):2025-04-03-09:27:42.757.038 [mindspore/ccsrc/distributed/collective/collective_manager.cc:787] CreateDeviceCommunicator] [PROF]GenerateRootInfo costs 0.237 msec.
[WARNING] DEVICE(618654,fffea9fbefa0,python3.9):2025-04-03-09:27:42.757.385 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.cc:248] QueryUniqueID] Retry to lookup the unique id for group hccl_world_group from the meta server node...Retry time: 399/400, sleep 1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.764.764 [runtime.cc:5239] 618806 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:42.764.806 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618806] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:42.764.822 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618806] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:42.764.834 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618806] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.764.861 [runtime.cc:3077] 618806 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=5, devId=5, tdt status=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.764.975 [npu_driver.cc:551] 618806 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:42.788.185 [trs_cb_event.c:119][ascend][curpid:618650,618828][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =320; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:42.788.200 [trs_cb_event.c:119][ascend][curpid:618650,618829][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =321; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:42.788.213 [trs_sqcq.c:1491][ascend][curpid:618650,618828][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:42.788.219 [trs_sqcq.c:1491][ascend][curpid:618650,618829][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:42.788.226 [npu_driver.cc:3833] 618828 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=320, drvRetCode=16.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:42.788.232 [npu_driver.cc:3833] 618829 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:42.788.238 [api_impl.cc:5058] 618828 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:42.788.258 [api_impl.cc:5058] 618829 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.788.285 [callback.cpp:132]618829 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.788.292 [callback.cpp:132]618828 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.788.301 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:42.788.305 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.788.319 [npu_driver.cc:3828] 618829 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=321.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.788.321 [npu_driver.cc:3828] 618828 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=320.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.794.521 [op_impl_space_registry.cc:109]618646 MergeFunctions:op type AvgPool3DGrad inputs_dependency has been registered
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.795.802 [op_impl_space_registry.cc:84]618646 MergeFunctions:op type MoeInitRoutingV2 tiling_parse func has been registered
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.795.824 [op_impl_space_registry.cc:85]618646 MergeFunctions:op type MoeInitRoutingV2 compile_info_creator func has been registered
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.795.834 [op_impl_space_registry.cc:86]618646 MergeFunctions:op type MoeInitRoutingV2 compile_info_deleter func has been registered
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.795.845 [op_impl_space_registry.cc:87]618646 MergeFunctions:op type MoeInitRoutingV2 tiling func has been registered
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.795.854 [op_impl_space_registry.cc:93]618646 MergeFunctions:op type MoeInitRoutingV2 max_tiling_data_size has been registered
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.796.877 [op_impl_space_registry.cc:273]618646 ConvertSoToRegistry:Save so symbol and handle in path[/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe/op_tiling/lib/linux/aarch64//libopmaster_rt.so] success!
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.797.341 [plugin_manager.cc:564]618646 GetUpgradedOpMasterPath:Start to get upgraded op tiling path
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.797.364 [plugin_manager.cc:134]618646 GetUpgradedOppPath:Enter get upgraded opp path schedule
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.797.419 [file_utils.cc:47]618646 RealPath:[Util][realpath] Can not get real_path for /usr/local/Ascend/ascend-toolkit/latest/opp_latest/, reason:No such file or directory
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.797.433 [plugin_manager.cc:145]618646 GetUpgradedOppPath:[Call][RealPath] Opp path /usr/local/Ascend/ascend-toolkit/latest/opp_latest/ is invalid.
[WARNING] GE(618646,python3.9):2025-04-03-09:27:42.797.444 [plugin_manager.cc:567]618646 GetUpgradedOpMasterPath:Failed to get upgraded opp path!
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.797.511 [mem_manager.cc:31]618646 Initialize:MemManager Initialize.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.797.538 [rts_caching_mem_allocator.cc:131]618646 Initialize:RtsAllocatorManager Initialize.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.797.569 [mem_manager.cc:102]618646 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.797.581 [graph_mem_allocator.cc:17]618646 Initialize:MemoryAllocator::Initialize.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.797.595 [mem_manager.cc:102]618646 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.797.604 [graph_mem_allocator.cc:17]618646 Initialize:MemoryAllocator::Initialize.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.797.614 [mem_manager.cc:102]618646 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.797.626 [caching_allocator.cc:391]618646 FreeBlocks:Free blocks.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.797.637 [caching_allocator.cc:358]618646 FreeCachedBlocks:Free cached blocks
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.797.651 [mem_manager.cc:102]618646 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.797.662 [caching_allocator.cc:391]618646 FreeBlocks:Free blocks.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.797.671 [caching_allocator.cc:358]618646 FreeCachedBlocks:Free cached blocks
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.797.682 [mem_manager.cc:102]618646 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.797.694 [mem_manager.cc:102]618646 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.797.705 [mem_manager.cc:102]618646 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.797.717 [mem_manager.cc:102]618646 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.797.728 [mem_manager.cc:102]618646 InitAllocator:Create Allocator memory type[2] success.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.797.740 [session_scope_mem_allocator.cc:73]618646 FreeAllMemory:Free all memory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.797.752 [mem_manager.cc:102]618646 InitAllocator:Create Allocator memory type[17] success.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.797.763 [session_scope_mem_allocator.cc:73]618646 FreeAllMemory:Free all memory
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.797.802 [dump_manager.cc:152]618646 Init:exception dump is not enabled
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.797.837 [ge_executor.cc:315]618646 Initialize:Init GeExecutor over.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.797.853 [acl.cpp:321]618646 aclInit: set DumpConfig in aclInit
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.797.865 [dump.cpp:841]618646 HandleDumpConfig: start to execute HandleDumpConfig.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.798.017 [dump.cpp:759]618646 ConvertDumpCfg: start to execute ConvertDumpCfg.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.798.030 [dump.cpp:594]618646 IsValidDumpConfig: start to execute IsValidDumpConfig.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.798.041 [dump.cpp:224]618646 CheckDumpSceneSwitch: start to execute CheckDumpSceneSwitch.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.798.068 [dump.cpp:703]618646 SetUpDumpConfig: convert to ge dump config successfully, enable lite_exception dump, path=
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.798.083 [dump.cpp:771]618646 HandleDumpCommand: start to execute HandleDumpCommand.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.798.094 [dump.cpp:703]618646 SetUpDumpConfig: convert to ge dump config successfully, enable lite_exception dump, path=
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.798.148 [adx_datadump_server.cpp:77][tid:618646] start to do dump init
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.798.165 [adx_dump_record.cpp:210][tid:618646] dumpPath prefix is /home/jenkins/mindspore/testcases/testcases/tests/st/lccl
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.798.186 [adx_dump_record.cpp:214][tid:618646] record remote dump temp path : /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.798.397 [adx_server_manager.cpp:149][tid:618958] server manager add component (10)
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.798.410 [adx_dump_record.cpp:627][tid:618959] start dump thread, remote dump record temp path : /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/.
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.798.427 [adx_server_manager.cpp:165][tid:618958] server manager components init successfully
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.798.576 [adx_server_manager.cpp:203][tid:618960] Run Server(0) Process
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.798.633 [adx_server_manager.cpp:369][tid:618960] device up 0
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.798.649 [hdc_comm_opt.cpp:59][tid:618960] open device[0] server[13]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:42.798.821 [drv_log_user.c:623][ascend][curpid:618646,618960][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=0; fid=0; service_type="service_dump"; pid=618646)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:42.798.837 [hdc_server.c:363][ascend][curpid:618646,618960][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=0)
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.798.852 [hdc_api.cpp:119][tid:618960] logDevId 0 create HDC server successfully
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.798.892 [adx_server_manager.cpp:111][tid:618960] create server info
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.798.905 [adx_server_manager.cpp:369][tid:618960] device up 1
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.798.916 [hdc_comm_opt.cpp:59][tid:618960] open device[1] server[13]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:42.799.049 [drv_log_user.c:623][ascend][curpid:618646,618960][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=1; fid=0; service_type="service_dump"; pid=618646)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:42.799.062 [hdc_server.c:363][ascend][curpid:618646,618960][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=1)
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.799.074 [hdc_api.cpp:119][tid:618960] logDevId 1 create HDC server successfully
[WARNING] IDEDD(618646,python3.9):2025-04-03-09:27:42.799.085 [adx_hdc_epoll.cpp:34][tid:618960] hdc epoll has been created.
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.799.098 [adx_server_manager.cpp:111][tid:618960] create server info
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.799.109 [adx_server_manager.cpp:369][tid:618960] device up 2
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.799.119 [hdc_comm_opt.cpp:59][tid:618960] open device[2] server[13]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:42.799.248 [drv_log_user.c:623][ascend][curpid:618646,618960][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=2; fid=0; service_type="service_dump"; pid=618646)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:42.799.260 [hdc_server.c:363][ascend][curpid:618646,618960][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=2)
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.799.272 [hdc_api.cpp:119][tid:618960] logDevId 2 create HDC server successfully
[WARNING] IDEDD(618646,python3.9):2025-04-03-09:27:42.799.282 [adx_hdc_epoll.cpp:34][tid:618960] hdc epoll has been created.
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.799.294 [adx_server_manager.cpp:111][tid:618960] create server info
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.799.304 [adx_server_manager.cpp:369][tid:618960] device up 3
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.799.314 [hdc_comm_opt.cpp:59][tid:618960] open device[3] server[13]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:42.799.447 [drv_log_user.c:623][ascend][curpid:618646,618960][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=3; fid=0; service_type="service_dump"; pid=618646)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:42.799.469 [hdc_server.c:363][ascend][curpid:618646,618960][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=3)
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.799.482 [hdc_api.cpp:119][tid:618960] logDevId 3 create HDC server successfully
[WARNING] IDEDD(618646,python3.9):2025-04-03-09:27:42.799.491 [adx_hdc_epoll.cpp:34][tid:618960] hdc epoll has been created.
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.799.502 [adx_server_manager.cpp:111][tid:618960] create server info
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.799.512 [adx_server_manager.cpp:369][tid:618960] device up 4
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.799.523 [hdc_comm_opt.cpp:59][tid:618960] open device[4] server[13]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:42.799.665 [drv_log_user.c:623][ascend][curpid:618646,618960][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=4; fid=0; service_type="service_dump"; pid=618646)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:42.799.678 [hdc_server.c:363][ascend][curpid:618646,618960][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=4)
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.799.690 [hdc_api.cpp:119][tid:618960] logDevId 4 create HDC server successfully
[WARNING] IDEDD(618646,python3.9):2025-04-03-09:27:42.799.700 [adx_hdc_epoll.cpp:34][tid:618960] hdc epoll has been created.
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.799.712 [adx_server_manager.cpp:111][tid:618960] create server info
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.799.722 [adx_server_manager.cpp:369][tid:618960] device up 5
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.799.733 [hdc_comm_opt.cpp:59][tid:618960] open device[5] server[13]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:42.799.805 [drv_log_user.c:623][ascend][curpid:618646,618960][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=5; fid=0; service_type="service_dump"; pid=618646)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:42.799.817 [hdc_server.c:363][ascend][curpid:618646,618960][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=5)
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.799.828 [hdc_api.cpp:119][tid:618960] logDevId 5 create HDC server successfully
[WARNING] IDEDD(618646,python3.9):2025-04-03-09:27:42.799.839 [adx_hdc_epoll.cpp:34][tid:618960] hdc epoll has been created.
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.799.850 [adx_server_manager.cpp:111][tid:618960] create server info
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.799.860 [adx_server_manager.cpp:369][tid:618960] device up 6
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.799.870 [hdc_comm_opt.cpp:59][tid:618960] open device[6] server[13]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:42.800.006 [drv_log_user.c:623][ascend][curpid:618646,618960][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=6; fid=0; service_type="service_dump"; pid=618646)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:42.800.018 [hdc_server.c:363][ascend][curpid:618646,618960][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=6)
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.800.030 [hdc_api.cpp:119][tid:618960] logDevId 6 create HDC server successfully
[WARNING] IDEDD(618646,python3.9):2025-04-03-09:27:42.800.040 [adx_hdc_epoll.cpp:34][tid:618960] hdc epoll has been created.
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.800.052 [adx_server_manager.cpp:111][tid:618960] create server info
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.800.062 [adx_server_manager.cpp:369][tid:618960] device up 7
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.800.072 [hdc_comm_opt.cpp:59][tid:618960] open device[7] server[13]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:42.800.145 [drv_log_user.c:623][ascend][curpid:618646,618960][drv][hdc][share_log_read_in_single_module]Server create success.(dev_id=7; fid=0; service_type="service_dump"; pid=618646)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:42.800.179 [hdc_server.c:363][ascend][curpid:618646,618960][drv][hdc][drvHdcServerCreate]Create server success. (listen_device=7)
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.800.193 [hdc_api.cpp:119][tid:618960] logDevId 7 create HDC server successfully
[WARNING] IDEDD(618646,python3.9):2025-04-03-09:27:42.800.202 [adx_hdc_epoll.cpp:34][tid:618960] hdc epoll has been created.
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.800.213 [adx_server_manager.cpp:111][tid:618960] create server info
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.801.509 [adx_server_manager.cpp:457][tid:618646] The server is initialized after waiting 3 times.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.801.528 [ge_executor.cc:1349]618646 SetDump:Start to set dump config
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.801.543 [dump_manager.cc:201]618646 NeedDoDump:Dump status: on, Overflow detection dump switch: off.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.801.573 [dump_manager.cc:261]618646 SetExceptionDump:Enable brief exception dump.
[INFO] GE(618646,python3.9):2025-04-03-09:27:42.801.600 [ge_executor.cc:1355]618646 SetDump:Set dump config successfully
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.801.627 [dump_manager.cpp:146][tid:618646] Set 3 dump setting, status: on, dump switch: 3
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:42.802.561 [dump_manager.cpp:301][tid:618646] Register exception callback, registered: 1
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.802.578 [dump.cpp:825]618646 HandleDumpCommand: set dump config for model successfully,adumpType = 3, dump_path = , dump_mode = , dump_op_switch = , dump_data = .
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.802.596 [acl.cpp:327]618646 aclInit: set HandleDumpConfig success in aclInit
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.802.608 [acl.cpp:329]618646 aclInit: set max_opqueue_num in aclInit
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.802.620 [acl_resource_manager.cpp:248]618646 HandleMaxOpQueueConfig: start to execute HandleMaxOpQueueConfig
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.802.709 [acl_resource_manager.cpp:275]618646 HandleMaxOpQueueConfig: no max_opqueue_num found, set default DEFAULT_MAX_OPQUEUE_NUM[20000].
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.802.724 [acl_resource_manager.cpp:278]618646 HandleMaxOpQueueConfig: HandleMaxOpQueueConfig end in HandleMaxOpQueueConfig
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.802.736 [acl.cpp:335]618646 aclInit: set HandleMaxOpQueueConfig success in aclInit
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.802.747 [acl.cpp:336]618646 aclInit: set HandleDefaultDevice in aclInit
[WARNING] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.802.806 [json_parser.cpp:260]618646 GetDefaultDeviceIdFromFile: no defaultDevice item!
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.802.820 [acl.cpp:343]618646 aclInit: set HandleDefaultDevice success in aclInit
[INFO] PROFILING(618646,python3.9):2025-04-03-09:27:42.802.839 [prof_atls_plugin.cpp:210] (tid:618646) Module[48] register callback of ctrl handle.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.802.851 [acl.cpp:351]618646 aclInit: set ProfilingConfig in aclInit
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.802.862 [profiling.cpp:141]618646 HandleProfilingConfig: start to execute HandleProfilingConfig
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.802.874 [profiling.cpp:135]618646 GetProfilingConfigFile: no profiling config file.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.802.932 [profiling.cpp:167]618646 HandleProfilingConfig: can not parse profiling config from file[/home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618646.json], errorCode = 0
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.802.946 [profiling.cpp:172]618646 HandleProfilingConfig: profiling config file[/home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618646.json] is empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.802.966 [profiling.cpp:176]618646 HandleProfilingConfig: start to use profiling config by config file mode
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.802.977 [profiling.cpp:179]618646 HandleProfilingConfig: ParseJsonFromFile ok in HandleProfilingConfig
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.802.988 [profiling.cpp:92]618646 HandleProfilingCommand: start to execute HandleProfilingCommand
[INFO] PROFILING(618646,python3.9):2025-04-03-09:27:42.803.321 [ai_drv_dev_api.cpp:316] >>> (tid:618646) Succeeded to get device 64 frequency=100000
[INFO] PROFILING(618646,python3.9):2025-04-03-09:27:42.803.443 [msprof_callback_impl.cpp:132] >>> (tid:618646) Dynamic profiling environment not really set, so do nothing.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.803.457 [profiling.cpp:122]618646 HandleProfilingCommand: set profiling config successfully
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.803.468 [profiling.cpp:186]618646 HandleProfilingConfig: set HandleProfilingConfig success
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.803.479 [hash_utils.cpp:108]618646 CalculateSimpleHash: Begin to calculate hash for file: /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618646.json
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.803.516 [hash_utils.cpp:128]618646 CalculateSimpleHash: file: /home/jenkins/mindspore/testcases/testcases/tests/st/lccl/aclinit_618646.json, hash: 3917491750093904922
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.803.529 [acl.cpp:115]618646 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.803.554 [acl.cpp:280]618646 IsEnableAutoUCMemeory: auto-uc-memory is enabled.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.803.565 [acl.cpp:385]618646 aclInit: register kernel launch fill function in aclInit
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.803.583 [runtime.cc:5394] 618646 RegKernelLaunchFillFunc: registercallback finish, symbol:g_opSystemRunCfg.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.803.597 [api_impl.cc:7407] 618646 RegStreamStateCallback: Reg stream state callback, regName=ACL_MODULE_STREAM.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.803.629 [api_impl.cc:4211] 618646 RegDeviceStateCallback: Reg device state callback, regName=ACL_MODULE_DEVICE.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.803.644 [acl.cpp:420]618646 aclInit: successfully execute aclInit, aclInitRefCount is 1
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.803.828 [mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.cc:199] InitializeAcl] Call aclInit successfully, json is {"dump":{"dump_scene":"lite_exception"},"err_msg_mode":"1"}
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.803.936 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.cc:295] Initialize] End initializing device context.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.803.985 [mindspore/ccsrc/plugin/res_manager/ascend/ascend_res_manager.cc:467] LoadCollectiveCommLib] Loading MACCL collective library successfully.
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.804.004 [mindspore/ccsrc/distributed/collective/collective_manager.cc:621] InitDeviceCommLib] Start initializing communication library on device side...
[INFO] PROFILING(618646,python3.9):2025-04-03-09:27:42.808.513 [prof_atls_plugin.cpp:210] (tid:618646) Module[0] register callback of ctrl handle.
[WARNING] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.809.247 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:76] Initialize] Loading LCCL because env MS_ENABLE_LCCL is set to on. Pay attention that LCCL only supports communication group within single node in KernelByKernel for now.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.809.278 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:80] Initialize] Successfully initialize LCCL.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.809.351 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ascend_deprecated_interface.cc:83] OpenTsd] Device id = 0, rank size = 8.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.809.366 [device.cpp:143]618646 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.809.389 [api_impl.cc:2999] 618646 SetDevice: device_id=0, deviceMode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.809.403 [device.cc:306] 618646 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.809.418 [runtime.cc:3393] 618646 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.809.444 [runtime.cc:3560] 618646 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.809.458 [api_impl.cc:2987] 618646 NewDevice: SetCurRef = 0xaaab06c88220,userDeviceId=0,deviceId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.809.471 [runtime.cc:5239] 618646 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.809.487 [api_impl.cc:2992] 618646 NewDevice: New device success, user_device_id=0, die_num=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.809.505 [api_impl.cc:3025] 618646 SetDevice: SetDevice success, curCtx=0xaaab06c88220, user_device_id=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.809.518 [acl.cpp:115]618646 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.809.529 [acl.cpp:121]618646 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.809.560 [device.cpp:154]618646 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 0
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.809.603 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel _npu_log begins the construction process witch capacity 128
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.809.619 [tensor_data_transfer.cpp:898]618646 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 0, name is _npu_log, capacity is 128
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.809.636 [api_impl.cc:6077] 618646 MemQueueInit: Start to init queue on devId 0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.809.649 [npu_driver.cc:4076] 618646 MemQueueInit: init mem queue, device_id=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.809.661 [npu_driver.cc:4026] 618646 CheckMemQueueSupported: get majorVersion 7
[INFO] DRV(618646,python3.9):2025-04-03-09:27:42.809.695 [queue_client.c:151][ascend][curpid:618646,618646][drv][queuemng][QueueGetHostpid]Query tgid. (tgid=618646)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:42.809.859 [queue_client.c:305][ascend][curpid:618646,618646][drv][queuemng][QueueGetDevPid]Query devpid succ. (devId=0; vfid=0; hostpid=618646; master_pid=618646; proc_type=0; devpid=31737).
[INFO] DRV(618646,python3.9):2025-04-03-09:27:42.813.758 [queue_client.c:362][ascend][curpid:618646,618646][drv][queuemng][QueueInit]QueueInit device. (devid=0; mcast_flag=0; mcast_gid=0; proc_sn=0; event_sn_offset=0)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.813.943 [npu_driver.cc:4114] 618646 MemQueueInit: get max queue cnt 4294967294 success.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.813.961 [api_impl.cc:6040] 618646 MemQueueCreate: Start to create queue on devId 0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.813.975 [npu_driver.cc:3931] 618646 MemQueueCreate: create mem queue, deviceId=0, name=_npu_log.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:42.814.445 [queue_interface.c:182][ascend][curpid:618646,618646][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=0, actualQid=0, deploy_type=0)
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.814.470 [tensor_data_transfer.cpp:940]618646 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 0, name is _npu_log, real name is _npu_log, qid is 0
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.814.603 [tensor_data_transfer.cpp:1054]618961 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is _npu_log
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.814.630 [tensor_data_transfer.cpp:1056]618961 acltdtReceiveTensor: new process, use queue process
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.814.650 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_tensor_dump begins the construction process witch capacity 128
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.814.668 [api_impl.cc:6121] 618961 MemQueuePeek: Start to peek queue on devId 0, qid is 0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.814.670 [tensor_data_transfer.cpp:898]618646 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 0, name is ms_tensor_dump, capacity is 128
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.814.682 [npu_driver.cc:4330] 618961 MemQueuePeek: peek mem queue, deviceId=0, qid=0, timeout=800.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.814.688 [api_impl.cc:6077] 618646 MemQueueInit: Start to init queue on devId 0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.814.698 [npu_driver.cc:4076] 618646 MemQueueInit: init mem queue, device_id=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.814.709 [npu_driver.cc:4026] 618646 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:42.814.750 [npu_driver.cc:4087] 618646 MemQueueInit: repeated init
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.814.764 [api_impl.cc:6040] 618646 MemQueueCreate: Start to create queue on devId 0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.814.775 [npu_driver.cc:3931] 618646 MemQueueCreate: create mem queue, deviceId=0, name=ms_tensor_dump.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:42.814.970 [queue_interface.c:182][ascend][curpid:618646,618646][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=1, actualQid=1, deploy_type=0)
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.814.986 [tensor_data_transfer.cpp:940]618646 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 0, name is ms_tensor_dump, real name is ms_tensor_dump, qid is 1
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.815.168 [tensor_data_transfer.cpp:1054]618963 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_tensor_dump
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.815.190 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_tensor_summary begins the construction process witch capacity 128
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.815.203 [tensor_data_transfer.cpp:1056]618963 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.815.211 [tensor_data_transfer.cpp:898]618646 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 0, name is ms_tensor_summary, capacity is 128
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.815.222 [api_impl.cc:6121] 618963 MemQueuePeek: Start to peek queue on devId 0, qid is 1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.815.230 [api_impl.cc:6077] 618646 MemQueueInit: Start to init queue on devId 0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.815.234 [npu_driver.cc:4330] 618963 MemQueuePeek: peek mem queue, deviceId=0, qid=1, timeout=800.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.815.240 [npu_driver.cc:4076] 618646 MemQueueInit: init mem queue, device_id=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.815.250 [npu_driver.cc:4026] 618646 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:42.815.293 [npu_driver.cc:4087] 618646 MemQueueInit: repeated init
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.815.306 [api_impl.cc:6040] 618646 MemQueueCreate: Start to create queue on devId 0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.815.317 [npu_driver.cc:3931] 618646 MemQueueCreate: create mem queue, deviceId=0, name=ms_tensor_summary.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:42.815.476 [queue_interface.c:182][ascend][curpid:618646,618646][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=2, actualQid=2, deploy_type=0)
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.815.493 [tensor_data_transfer.cpp:940]618646 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 0, name is ms_tensor_summary, real name is ms_tensor_summary, qid is 2
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.815.593 [tensor_data_transfer.cpp:1054]618965 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_tensor_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.815.617 [tensor_data_transfer.cpp:1056]618965 acltdtReceiveTensor: new process, use queue process
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.815.625 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_image_summary begins the construction process witch capacity 128
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.815.635 [api_impl.cc:6121] 618965 MemQueuePeek: Start to peek queue on devId 0, qid is 2.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.815.640 [tensor_data_transfer.cpp:898]618646 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 0, name is ms_image_summary, capacity is 128
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.815.649 [npu_driver.cc:4330] 618965 MemQueuePeek: peek mem queue, deviceId=0, qid=2, timeout=800.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.815.656 [api_impl.cc:6077] 618646 MemQueueInit: Start to init queue on devId 0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.815.666 [npu_driver.cc:4076] 618646 MemQueueInit: init mem queue, device_id=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.815.678 [npu_driver.cc:4026] 618646 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:42.815.711 [npu_driver.cc:4087] 618646 MemQueueInit: repeated init
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.815.724 [api_impl.cc:6040] 618646 MemQueueCreate: Start to create queue on devId 0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.815.735 [npu_driver.cc:3931] 618646 MemQueueCreate: create mem queue, deviceId=0, name=ms_image_summary.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:42.815.879 [queue_interface.c:182][ascend][curpid:618646,618646][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=3, actualQid=3, deploy_type=0)
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.815.894 [tensor_data_transfer.cpp:940]618646 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 0, name is ms_image_summary, real name is ms_image_summary, qid is 3
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.815.995 [tensor_data_transfer.cpp:1054]618967 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_image_summary
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.816.017 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_scalar_summary begins the construction process witch capacity 128
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.816.024 [tensor_data_transfer.cpp:1056]618967 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.816.033 [tensor_data_transfer.cpp:898]618646 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 0, name is ms_scalar_summary, capacity is 128
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.816.042 [api_impl.cc:6121] 618967 MemQueuePeek: Start to peek queue on devId 0, qid is 3.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.816.060 [api_impl.cc:6077] 618646 MemQueueInit: Start to init queue on devId 0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.816.062 [npu_driver.cc:4330] 618967 MemQueuePeek: peek mem queue, deviceId=0, qid=3, timeout=800.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.816.072 [npu_driver.cc:4076] 618646 MemQueueInit: init mem queue, device_id=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.816.082 [npu_driver.cc:4026] 618646 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:42.816.115 [npu_driver.cc:4087] 618646 MemQueueInit: repeated init
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.816.127 [api_impl.cc:6040] 618646 MemQueueCreate: Start to create queue on devId 0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.816.138 [npu_driver.cc:3931] 618646 MemQueueCreate: create mem queue, deviceId=0, name=ms_scalar_summary.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:42.816.292 [queue_interface.c:182][ascend][curpid:618646,618646][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=4, actualQid=4, deploy_type=0)
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.816.309 [tensor_data_transfer.cpp:940]618646 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 0, name is ms_scalar_summary, real name is ms_scalar_summary, qid is 4
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.816.416 [tensor_data_transfer.cpp:1054]618969 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_scalar_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.816.439 [tensor_data_transfer.cpp:1056]618969 acltdtReceiveTensor: new process, use queue process
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.816.443 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:308] MbufDataHandler] Channel ms_histogram_summary begins the construction process witch capacity 128
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.816.457 [api_impl.cc:6121] 618969 MemQueuePeek: Start to peek queue on devId 0, qid is 4.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.816.458 [tensor_data_transfer.cpp:898]618646 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 0, name is ms_histogram_summary, capacity is 128
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.816.470 [npu_driver.cc:4330] 618969 MemQueuePeek: peek mem queue, deviceId=0, qid=4, timeout=800.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.816.475 [api_impl.cc:6077] 618646 MemQueueInit: Start to init queue on devId 0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.816.485 [npu_driver.cc:4076] 618646 MemQueueInit: init mem queue, device_id=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.816.495 [npu_driver.cc:4026] 618646 CheckMemQueueSupported: get majorVersion 7
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:42.816.528 [npu_driver.cc:4087] 618646 MemQueueInit: repeated init
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.816.539 [api_impl.cc:6040] 618646 MemQueueCreate: Start to create queue on devId 0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.816.550 [npu_driver.cc:3931] 618646 MemQueueCreate: create mem queue, deviceId=0, name=ms_histogram_summary.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:42.816.692 [queue_interface.c:182][ascend][curpid:618646,618646][drv][queuemng][halQueueCreate]Create queue successful. (virtualQid=5, actualQid=5, deploy_type=0)
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.816.708 [tensor_data_transfer.cpp:940]618646 acltdtCreateChannelWithCapacity: acltdtCreateChannelWithCapacity devId is 0, name is ms_histogram_summary, real name is ms_histogram_summary, qid is 5
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.816.871 [tensor_data_transfer.cpp:1054]618971 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_histogram_summary
[INFO] HCCL_ADPT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.816.911 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:273] InitHccl] Start init hccl adapter.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.816.912 [tensor_data_transfer.cpp:1056]618971 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.816.937 [api_impl.cc:6121] 618971 MemQueuePeek: Start to peek queue on devId 0, qid is 5.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.816.949 [npu_driver.cc:4330] 618971 MemQueuePeek: peek mem queue, deviceId=0, qid=5, timeout=800.
[INFO] HCCL_ADPT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.817.061 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:569] InitKernelInfoStore] Start init hccl kernel info store.
[INFO] HCCL_ADPT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.817.089 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:586] InitKernelInfoStore] Get builder ops_kernel_info_hccl
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.817.105 [plugin_manager.cc:25] [618646]hcom ops plugin init start.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.817.134 [plugin_manager.cc:38] [618646]input BUILD_MODE is not set, result autoTune is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.817.153 [plugin_manager.cc:42] [618646]hcom running normal mode.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.817.192 [hcom_plugin.cc:50] [618646]Initialize start.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.817.203 [hcom_plugin.cc:52] [618646]initializeCount_ : 1
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.817.244 [hcom_plugin.cc:60] [618646]hvdOpsKernelInfoStoreInfoPtr_ is initialized
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.817.272 [hcom_plugin.cc:63] [618646]hvdGraphOptimizerPtr_ is initialized
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.817.285 [hcom_plugin.cc:329] [618646]ParserHcclAlgoDesc: there is no key named "HCCL_algorithm" in the options.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.817.300 [hcom_plugin.cc:281] [618646]ParserHcclExecTimeOut: there is no key named "HCCL_execTimeOut" in the options.
[WARNING] HCCL(618646,python3.9):2025-04-03-09:27:42.817.320 [hcom_plugin.cc:217] [618646]option profiling mode is not found.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.817.336 [hcom_plugin.cc:164] [618646][masterInfo]get Master Info:ip or port or deviceId not set.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.817.349 [hcom_plugin.cc:180] [618646][masterInfo]get Rank Info: worker size not set.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.817.360 [hcom_plugin.cc:244] [618646]InitializePlugin: Init without ranktable and masterInfo, please check your mode.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.817.501 [hcom_plugin.cc:82] [618646]hccl ops plugin init success.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.817.516 [plugin_manager.cc:48] [618646]hcom ops plugin init end. ret[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.817.528 [hcom_plugin.cc:126] [618646]get hccl kernel info store start.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.817.553 [hcom_plugin.cc:132] [618646]get hccl kernel info store finished.
[INFO] HCCL_ADPT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.817.577 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:608] InitKernelInfoStore] Init hccl kernel info store success.
[INFO] HCCL_ADPT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.817.596 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:786] InitHcclExec] Start init hccl exec.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.817.619 [hcom_executor.cc:29] [618646]Hcom Excutor Initialize start.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.817.663 [runtime.cc:5239] 618646 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.817.679 [adapter_rts.cc:234] [618646][hrtGetDevice]deviceLogicId[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.817.719 [api_c_soc.cc:70] 618646 rtGetSocVersion: soc version is Ascend910B3
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.817.775 [hcom_common.cc:85] [618646][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[0] 
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.817.800 [hcom_common.cc:88] [618646][HcomGetCurHcomCtx] is no Used deviceLogicId[0] 
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.817.822 [hcom.cc:486] [618646]Get Hcom Init Status: [0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.817.846 [hcom_common.cc:85] [618646][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[0] 
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.817.858 [hcom_rpc.cc:1019] [618646]Get Hcom Init Status: [0]
[WARNING] HCCL(618646,python3.9):2025-04-03-09:27:42.817.879 [hcom_base_funs.cc:36] [618646][HcomOpsKernelInfoStore][InitHcom]OPTION_EXEC_RANK_TABLE is not found.
[WARNING] HCCL(618646,python3.9):2025-04-03-09:27:42.817.905 [hcom_executor.cc:121] [618646][HcomOpsKernelInfoStore][InitHcom]OPTION_EXEC_HCOM_GROUPLIST is not found.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.817.972 [api_impl.cc:1120] 618646 StreamCreate: priority=0, flags=1536.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.817.995 [npu_driver.cc:404] 618646 StreamIdAlloc: stream id alloc begin, device_id=0, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.818.078 [stream.cc:2246] 618646 AllocExecutedTimesSvm: stream_id=4.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.818.140 [stream_sqcq_manage.cc:147] 618646 Alloc: deviceId=0, tsId=0, drvFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.818.155 [npu_driver.cc:882] 618646 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.818.586 [npu_driver.cc:6125] 618646 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.818.633 [npu_driver.cc:6137] 618646 LogicCqAllocateV2: success: deviceId=0, tsId=0, cqId=491, streamId=4, logicCq=491, cqeDepth=4096
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.818.656 [npu_driver.cc:6189] 618646 StreamBindLogicCq: success: deviceId=0, tsId=0, streamId=4, logicCq=491.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.818.672 [npu_driver.cc:5916] 618646 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=c010c000, addr=dfffc010c000size=4096
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.818.686 [stream.cc:653] 618646 Setup: Success to get sq=4 sq reg virtual addr length=4096.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:42.818.739 [devmm_svm.c:1972][ascend][curpid:618646,618646][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.818.755 [npu_driver.cc:6080] 618646 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.819.069 [stream.cc:291] 618646 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=4, flags_=0x600.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.819.653 [stream.cc:688] 618646 Setup: stream setup end, stream_id=4, IsTaskSink=0, sqId=4, cqId=4, deviceId=0, streamResId=65535
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.819.670 [acl_resource_manager.cpp:814]618646 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.819.682 [acl_resource_manager.cpp:816]618646 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.819.695 [api_impl.cc:1162] 618646 StreamCreate: Succ, flags=1536, stream_id=4, context=aaab06c88220
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.819.721 [stream.cc:73] [618646]Construct stream by stream type success, ptr[0xaaab12094d70] ctx[0xaaab06c88220], stream id[4], cqId[4], logicCqid[491]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.819.769 [api_impl.cc:1120] 618646 StreamCreate: priority=0, flags=1536.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.819.785 [npu_driver.cc:404] 618646 StreamIdAlloc: stream id alloc begin, device_id=0, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.819.813 [stream.cc:2246] 618646 AllocExecutedTimesSvm: stream_id=5.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.819.845 [stream_sqcq_manage.cc:147] 618646 Alloc: deviceId=0, tsId=0, drvFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.819.858 [npu_driver.cc:882] 618646 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.820.081 [npu_driver.cc:6125] 618646 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.820.128 [npu_driver.cc:6137] 618646 LogicCqAllocateV2: success: deviceId=0, tsId=0, cqId=492, streamId=5, logicCq=492, cqeDepth=4096
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.820.145 [npu_driver.cc:6189] 618646 StreamBindLogicCq: success: deviceId=0, tsId=0, streamId=5, logicCq=492.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.820.181 [npu_driver.cc:5916] 618646 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=c00eb000, addr=dfffc00eb000size=4096
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.820.195 [stream.cc:653] 618646 Setup: Success to get sq=5 sq reg virtual addr length=4096.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:42.820.236 [devmm_svm.c:1972][ascend][curpid:618646,618646][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0xa; out_feature=0xa)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.820.252 [npu_driver.cc:6080] 618646 CheckSupportPcieBarCopy: chip type=5, drv support pcie bar copy
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.820.542 [stream.cc:291] 618646 CreateStreamTaskRes: STREAM TaskRes Setup stream_id=5, flags_=0x600.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.158 [stream.cc:688] 618646 Setup: stream setup end, stream_id=5, IsTaskSink=0, sqId=5, cqId=5, deviceId=0, streamResId=65535
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.821.176 [acl_resource_manager.cpp:814]618646 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.821.187 [acl_resource_manager.cpp:816]618646 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.200 [api_impl.cc:1162] 618646 StreamCreate: Succ, flags=1536, stream_id=5, context=aaab06c88220
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.821.217 [stream.cc:73] [618646]Construct stream by stream type success, ptr[0xaaab12110dd0] ctx[0xaaab06c88220], stream id[5], cqId[5], logicCqid[492]
[WARNING] HCCL(618646,python3.9):2025-04-03-09:27:42.821.353 [sal.cc:619] [618973]err[34] link[Hccl_MessageProcess] nameSet failed.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.821.387 [hcom_executor.cc:587] [618973]MessageProcessThreadLoop start queType:[0]
[WARNING] HCCL(618646,python3.9):2025-04-03-09:27:42.821.408 [sal.cc:619] [618974]err[34] link[Hccl_MessageProcess] nameSet failed.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.413 [api_impl.cc:2999] 618973 SetDevice: device_id=0, deviceMode=0.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.821.433 [hcom_executor.cc:587] [618974]MessageProcessThreadLoop start queType:[1]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.435 [device.cc:306] 618973 Init: device mode has been already set, mode=0.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.821.440 [hcom_executor.cc:34] [618646][Initialize][HcomExecutor]Hcom Excutor Initialize end. ret[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.444 [api_impl.cc:2999] 618975 SetDevice: device_id=0, deviceMode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.450 [runtime.cc:3393] 618973 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x3
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.458 [api_impl.cc:2999] 618974 SetDevice: device_id=0, deviceMode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.469 [device.cc:306] 618975 Init: device mode has been already set, mode=0.
[INFO] HCCL_ADPT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.821.475 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:792] InitHcclExec] Hcom DynamicKernel Initialize success
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.485 [runtime.cc:3560] 618973 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.488 [api_impl.cc:2999] 618976 SetDevice: device_id=0, deviceMode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.500 [api_impl.cc:2987] 618973 NewDevice: SetCurRef = 0xaaab06c88220,userDeviceId=0,deviceId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.494 [runtime.cc:3393] 618975 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x4
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.496 [device.cc:306] 618974 Init: device mode has been already set, mode=0.
[INFO] HCCL_ADPT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.821.504 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:798] InitHcclExec] InitHcclExec success
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.512 [runtime.cc:5239] 618973 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.522 [runtime.cc:3560] 618975 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.523 [runtime.cc:3393] 618974 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x5
[INFO] HCCL_ADPT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.821.528 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:291] InitHccl] Init hccl adapter success.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.525 [device.cc:306] 618976 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.533 [api_impl.cc:2987] 618975 NewDevice: SetCurRef = 0xaaab06c88220,userDeviceId=0,deviceId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.533 [api_impl.cc:2992] 618973 NewDevice: New device success, user_device_id=0, die_num=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.538 [runtime.cc:3560] 618974 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.546 [runtime.cc:3393] 618976 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x6
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.821.550 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:92] Initialize] Successfully initialize HCCL.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.548 [runtime.cc:5239] 618975 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.555 [api_impl.cc:2987] 618974 NewDevice: SetCurRef = 0xaaab06c88220,userDeviceId=0,deviceId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.559 [runtime.cc:3560] 618976 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=0
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:42.821.558 [awatchdog_core.c:175](tid:618973) create watchdog for id : 65543, tid : 618973, timeout : 300s
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.568 [runtime.cc:5239] 618974 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.568 [api_impl.cc:2992] 618975 NewDevice: New device success, user_device_id=0, die_num=1.
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.821.572 [mindspore/ccsrc/distributed/collective/collective_manager.cc:628] InitDeviceCommLib] Communication library on device side is successfully initialized.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.571 [api_impl.cc:2987] 618976 NewDevice: SetCurRef = 0xaaab06c88220,userDeviceId=0,deviceId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.575 [api_impl.cc:3025] 618973 SetDevice: SetDevice success, curCtx=0xaaab06c88220, user_device_id=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.583 [api_impl.cc:2992] 618974 NewDevice: New device success, user_device_id=0, die_num=1.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:42.821.589 [awatchdog_core.c:175](tid:618975) create watchdog for id : 65543, tid : 618975, timeout : 300s
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.609 [runtime.cc:5239] 618976 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.620 [api_impl.cc:3025] 618975 SetDevice: SetDevice success, curCtx=0xaaab06c88220, user_device_id=0.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:42.821.621 [awatchdog_core.c:175](tid:618974) create watchdog for id : 65543, tid : 618974, timeout : 300s
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.627 [api_impl.cc:2992] 618976 NewDevice: New device success, user_device_id=0, die_num=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.634 [api_impl.cc:3025] 618974 SetDevice: SetDevice success, curCtx=0xaaab06c88220, user_device_id=0.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:42.821.642 [awatchdog_core.c:175](tid:618976) create watchdog for id : 65543, tid : 618976, timeout : 300s
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.821.632 [mindspore/ccsrc/distributed/collective/collective_manager.cc:211] Initialize] [PROF]InitDeviceBackend costs 1116.8 msec.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.821.653 [api_impl.cc:3025] 618976 SetDevice: SetDevice success, curCtx=0xaaab06c88220, user_device_id=0.
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.821.673 [mindspore/ccsrc/distributed/collective/collective_manager.cc:860] IsAsyncInitGlobalComm] Async initialize global comm: 0. async_conf: 1, is_graph: 0, use_rank_table: 0, simulation: 0, use_mpi: 0, is_ascend: 1
[WARNING] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.821.691 [mindspore/ccsrc/distributed/collective/collective_manager.cc:335] CreateCommunicationGroup] Start to create communication group: hccl_world_group [const vector]{0, 1, 2, 3, 4, 5, 6, 7}, async: 0, submit_now: 1
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.821.730 [mindspore/ccsrc/distributed/collective/collective_manager.cc:367] CreateCommunicationGroup] [PROF]CreateCommunicationGroupOnHostSide costs 0.011 msec.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.821.770 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:148] CreateCommunicationGroup] Successfully create LCCL communication group hccl_world_group
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.821.799 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.cc:166] CreateCommunicationGroup] Successfully create HCCL communication group hccl_world_group
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.821.818 [mindspore/ccsrc/distributed/collective/collective_manager.cc:374] CreateCommunicationGroup] [PROF]CreateCommunicationGroupOnDeviceSide costs 0.069 msec.
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.821.918 [mindspore/ccsrc/distributed/collective/collective_manager.cc:919] SubmitCreateDeviceCommTask] Launch init comm thread.
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:42.821.940 [mindspore/ccsrc/distributed/collective/collective_manager.cc:925] SubmitCreateDeviceCommTask] Submit init communicator task for hccl_world_group. Call 'WaitCommInitDone' later to wait initialization to be done.
[INFO] DISTRIBUTED(618646,fffea8f9efa0,python3.9):2025-04-03-09:27:42.822.028 [mindspore/ccsrc/distributed/collective/collective_manager.cc:973] RunInitCommTasks] Create device communicator in thread for group: hccl_world_group
[INFO] DISTRIBUTED(618646,fffea8f9efa0,python3.9):2025-04-03-09:27:42.822.069 [mindspore/ccsrc/distributed/collective/collective_manager.cc:764] CreateDeviceCommunicator] Create device communicator for hccl_world_group
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.822.112 [device.cpp:143]618977 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.822.137 [api_impl.cc:2999] 618977 SetDevice: device_id=0, deviceMode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.822.151 [device.cc:306] 618977 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.822.163 [runtime.cc:3393] 618977 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x7
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.822.176 [runtime.cc:3560] 618977 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.822.188 [api_impl.cc:2987] 618977 NewDevice: SetCurRef = 0xaaab06c88220,userDeviceId=0,deviceId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.822.200 [runtime.cc:5239] 618977 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.822.214 [api_impl.cc:2992] 618977 NewDevice: New device success, user_device_id=0, die_num=1.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:42.822.229 [awatchdog_core.c:175](tid:618977) create watchdog for id : 65543, tid : 618977, timeout : 300s
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.822.242 [api_impl.cc:3025] 618977 SetDevice: SetDevice success, curCtx=0xaaab06c88220, user_device_id=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.822.254 [acl.cpp:115]618977 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.822.267 [acl.cpp:121]618977 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.822.280 [device.cpp:154]618977 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.822.308 [runtime.cc:5239] 618977 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.323 [adapter_rts.cc:198] [618977][hrtGetDeviceRefresh]deviceLogicId[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.337 [op_base.cc:802] [618977]Entry-HcclGetRootInfo:rootInfo[0xaaab1287f2c0], deviceLogicId[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.355 [externalinput.cc:2065] [618977]HCCL_LOG_CONFIG set by default to [0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.374 [externalinput.cc:490] [618977]HCCL_CONNECT_TIMEOUT set by environment to [600]s
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.387 [externalinput.cc:429] [618977]HCCL_EXEC_TIMEOUT set by default to [1836]s
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.401 [externalinput.cc:543] [618977]HCCL_INTRA_PCIE_ENABLE set by default to [1], HCCL_INTRA_ROCE_ENABLE set by default to [0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.417 [externalinput.cc:622] [618977]environmental variable PROFILING_MODE and GE profiling option is not set, default: false
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.432 [externalinput.cc:714] [618977]HCCL_WHITELIST_DISABLE set by environment to [1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.446 [externalinput.cc:821] [618977]HCCL_IF_IP is not set
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.458 [externalinput.cc:877] [618977]HCCL_SOCKET_IFNAME set by default to [EmptyString]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.471 [externalinput.cc:844] [618977]HCCL_SOCKET_FAMILY is not set and is used by default [AF_INET]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.483 [externalinput.cc:728] [618977]HCCL_DEVICE_NIC_DISABLE set by default to [0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.501 [externalinput.cc:758] [618977]HCCL_HOST_RDMA_ENABLE set by default to [0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.514 [externalinput.cc:806] [618977]HCCL_IF_BASE_PORT set by default to [60000]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.526 [externalinput.cc:1508] [618977]HCCL_ALGO is not set
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.538 [externalinput.cc:1671] [618977][CannVersion][Verification]environmental variable LD_LIBRARY_PATH is too long, actual len[1291], maxlen[1024]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.552 [externalinput.cc:462] [618977]HCCL_HIGH_PERF_ENABLE set by default to [0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.565 [externalinput.cc:1519] [618977]HCCL_RDMA_TC set by default to [132]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.577 [externalinput.cc:1554] [618977]HCCL_RDMA_SL set by default to [4]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.822.699 [api_c_soc.cc:70] 618977 rtGetSocVersion: soc version is Ascend910B3
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.715 [externalinput.cc:1599] [618977]HCCL_RDMA_TIMEOUT set by default to [20]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.734 [externalinput.cc:1633] [618977]HCCL_RDMA_RETRY_CNT set by default to [7]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.747 [externalinput.cc:1778] [618977]HCCL_BUFFSIZE set by default to [200]M
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.759 [externalinput.cc:1807] [618977]HCCL_OP_BASE_FFTS_MODE_ENABLE set by default to [true]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.771 [externalinput.cc:515] [618977]HCCL_DETERMINISTIC set by default to [false]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.784 [externalinput.cc:1841] [618977]HCCL_DIAGNOSE_ENABLE set by default to [0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.796 [externalinput.cc:1929] [618977]HCCL_ENTRY_LOG_ENABLE set by default to [0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.808 [externalinput.cc:1949] [618977]HCCL_INTER_HCCS_DISABLE is not set, default value is 0.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.821 [externalinput.cc:1969] [618977]HCCL_INTER_VNIC_DISABLE is not set, default value is 0.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.843 [externalinput.cc:2005] [618977]HCCL_OP_EXPANSION_MODE is not set, aicpuUnfold is [0], aivMode is [0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.857 [externalinput.cc:2036] [618977]environmental variable ASCEND_MC2_DEBUG_MODE is not set
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.872 [externalinput.cc:2209] [618977]HCCL_CONCURRENT_ENABLE is not set, default value is [0].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.885 [externalinput.cc:2178] [618977][ParseRetryEnable] HCCL_OP_RETRY_ENABLE is not set. The retryEnable of all levels is set to false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.898 [externalinput.cc:889] [618977]HCCL_SEND_CQ_DEPTH set by default to [8192]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.910 [externalinput.cc:914] [618977]HCCL_DFT is not set, default value is 1.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.922 [externalinput.cc:2240] [618977]HCCL_OP_COUNTER_ENABLE set by default to [1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.935 [externalinput.cc:2308] [618977]HCCL_OP_RETRY_PARAMS is not set, default value MaxCnt is 1, HoldTime is 5000, IntervalTime is 1000
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.948 [externalinput.cc:2339] [618977]HCCL_LOGIC_SUPERPOD_ID is not set, default value[]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.960 [externalinput.cc:2296] [618977]HCCL_STUCK_DETECT_TIME is set default [612]s.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.822.973 [externalinput.cc:407] [618977]HCCL_RDMA_PCIE_DIRECT_POST_NOSTRICT set by default to [EmptyString], rdmaFastPost is [0]
[WARNING] HCCL(618646,python3.9):2025-04-03-09:27:42.822.989 [externalinput.cc:672] [618977][Parse][MultiQpSrcPortConfigPath]environmental variable HCCL_RDMA_QP_PORT_CONFIG_PATH is empty,but HCCL_RDMA_QP_PORT_CONFIG_PATH is not set
[WARNING] HCCL(618646,python3.9):2025-04-03-09:27:42.823.034 [env_config.cc:127] [618977]HCCL_HOST_SOCKET_PORT_RANGE is not set. Multi-process will not be supported!
[WARNING] HCCL(618646,python3.9):2025-04-03-09:27:42.823.051 [env_config.cc:131] [618977]HCCL_NPU_SOCKET_PORT_RANGE is not set. Multi-process will not be supported!
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.823.065 [env_config.cc:302] [618977]HCCL_RDMA_TC set by default to [132]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.823.078 [env_config.cc:302] [618977]HCCL_RDMA_SL set by default to [4]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.823.107 [api_impl.cc:3100] 618977 GetDevicePhyIdByIndex: get PhyId by Index=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.823.119 [api_impl.cc:3111] 618977 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.823.130 [api_impl.cc:3130] 618977 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.823.144 [topoinfo_detect.cc:142] [618977][Setup][hcclIfBasePort]deviceLogicID_[0], devicePhysicID_[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.823.371 [network_manager.cc:69] [618977]NetworkManager::GetInstance deviceLogicID[0].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.823.386 [network_manager.cc:169] [618977]NetworkManager: devicePhyId[0], devicePhyId_[0] deviceLogicId_[0], hasBackup[0]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.823.410 [ra_host.c:1594]tid:618977,ra_socket_set_white_list_status(1594) : Input parameters: enable[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.823.431 [adapter_hccp.cc:1450] [618977]set host socket whitelist status[0] success.
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.823.468 [ra_host.c:205]tid:618977,ra_init(205) : Input parameters: phy_id[0], nic_position:[0] hdc_type:[6]
[INFO] ROCE(618646,python3.9):2025-04-03-09:27:42.823.522 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.823.535 [ra_peer.c:776]tid:618977,ra_peer_init(776) : [init][ra_peer]ra_peer_init phy_id[0] start
[INFO] ROCE(618646,python3.9):2025-04-03-09:27:42.823.601 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] ROCE(618646,python3.9):2025-04-03-09:27:42.823.664 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.823.686 [rs.c:327]tid:618977,rs_pthread_mutex_init(327) : mutex init ok
[WARNING] ROCE(618646,python3.9):2025-04-03-09:27:42.823.863 [network_comm.c:155]get_saved_tls_config_file_path(155) : conf_path[/home/jenkins/cert] is invalid, reason[-2].
[WARNING] ROCE(618646,python3.9):2025-04-03-09:27:42.823.884 [network_comm.c:166]get_saved_tls_config_file_path(166) : conf_path[/home/HwDmUser/cert] is invalid, reason[-2].
[WARNING] HCCP(618646,python3.9):2025-04-03-09:27:42.823.898 [rs_ssl.c:1513]tid:618977,rs_ssl_init(1513) : can not get manage data, ret(-2). maybe not set tls
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.823.912 [rs_ssl.c:1529]tid:618977,rs_ssl_init(1529) : TLS SWITCH (0)
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.823.947 [rs_epoll.c:692]tid:618977,rs_epoll_connect_handle_init(692) : rs_create_epoll ok
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.824.099 [rs_epoll.c:487]tid:618978,rs_epoll_handle(487) : <EPOLL> thread begin! thread_id:281468668473248, pid:618646, ppid:618638
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.824.136 [rs_epoll.c:713]tid:618977,rs_epoll_connect_handle_init(713) : RS INIT OK!
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.824.144 [rs_epoll.c:623]tid:618979,rs_connect_handle(623) : <SOCKET> thread begin! thread_id:281468660019104, pid:618646, ppid:618638
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.824.152 [rs.c:366]tid:618977,rs_init_rscb_cfg(366) : rs_epoll_connect_handle_init ok cost [0.226000] ms
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.824.174 [rs_epoll.c:415]tid:618978,bind_data_cpu(415) : host not need bind cpu, info[1]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.824.188 [rs_epoll.c:641]tid:618979,rs_connect_handle(641) : pthread[connect_pthread] is alive!
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.824.195 [rs_epoll.c:511]tid:618978,rs_epoll_handle(511) : pthread[epoll_pthread] is alive!
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.825.975 [rs.c:471]tid:618977,rs_init(471) : rs init success, chip_id[0]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.825.995 [ra_peer.c:813]tid:618977,ra_peer_init(813) : [init][ra_peer]ra_peer_init phy_id[0] succ
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.826.010 [adapter_hccp.cc:583] [618977]init ra success.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.826.022 [network_manager.cc:222] [618977]NetworkManager nicDeploy[0] deviceLogicId_[0] devicePhyId_[0] init ra OK, nicSocketMap size[0], isHostUseDevNic[0]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.040 [ra_host.c:1764]tid:618977,ra_get_ifnum(1764) : Input parameters: phy_id[0], nic_position:[0], is_all:[0]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.059 [ra_peer.c:859]tid:618977,ra_peer_get_ifnum(859) : [get][ra_peer_ifnum]ra_peer_get_ifnum phy_id[0] start
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.087 [ra_peer.c:867]tid:618977,ra_peer_get_ifnum(867) : [get][ra_peer_ifnum]ra_peer_get_ifnum phy_id[0] succ
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.826.100 [adapter_hccp.cc:1378] [618977][Get][HostIf]hrtGetIfNum success. ifAddrNum[6].
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.115 [ra_host.c:1814]tid:618977,ra_get_ifaddrs(1814) : Input parameters: phy_id[0], nic_position:[0], is_all[0], interface num[6]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.128 [ra_peer.c:874]tid:618977,ra_peer_get_ifaddrs(874) : [get][ra_peer_ifaddrs] ra_peer_get_ifaddrs phy_id[0] start
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.143 [rs_socket.c:2743]tid:618977,rs_peer_fill_ifaddr_infos(2743) : ifname[lo] addr[0x0100007f]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.157 [rs_socket.c:2743]tid:618977,rs_peer_fill_ifaddr_infos(2743) : ifname[enp67s0f5] addr[0x2c00a8c0]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.167 [rs_socket.c:2743]tid:618977,rs_peer_fill_ifaddr_infos(2743) : ifname[docker0] addr[0x010011ac]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.179 [rs_socket.c:2749]tid:618977,rs_peer_fill_ifaddr_infos(2749) : ifname[lo] scope_id[0] flowinfo[0]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.190 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[0] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.201 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[1] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.212 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[2] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.222 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[3] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.233 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[4] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.243 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[5] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.254 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[6] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.265 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[7] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.275 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[8] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.286 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[9] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.296 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[10] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.315 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[11] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.326 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[12] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.337 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[13] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.346 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[14] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.355 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[15] 0x01
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.366 [rs_socket.c:2749]tid:618977,rs_peer_fill_ifaddr_infos(2749) : ifname[enp67s0f5] scope_id[2] flowinfo[0]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.377 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[0] 0xfe
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.387 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[1] 0x80
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.398 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[2] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.408 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[3] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.419 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[4] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.429 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[5] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.440 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[6] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.450 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[7] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.461 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[8] 0x8b
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.471 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[9] 0x0e
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.482 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[10] 0xc4
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.492 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[11] 0x02
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.503 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[12] 0x33
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.513 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[13] 0x1c
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.524 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[14] 0x33
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.534 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[15] 0x2f
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.544 [rs_socket.c:2749]tid:618977,rs_peer_fill_ifaddr_infos(2749) : ifname[endvnic] scope_id[7] flowinfo[0]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.555 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[0] 0xfe
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.565 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[1] 0x80
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.575 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[2] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.586 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[3] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.596 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[4] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.605 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[5] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.616 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[6] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.630 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[7] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.641 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[8] 0xed
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.651 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[9] 0xaf
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.661 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[10] 0x6d
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.670 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[11] 0xc3
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.680 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[12] 0x6f
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.690 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[13] 0xad
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.699 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[14] 0xb4
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.709 [rs_socket.c:2751]tid:618977,rs_peer_fill_ifaddr_infos(2751) : addr[15] 0xb2
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.719 [ra_peer.c:882]tid:618977,ra_peer_get_ifaddrs(882) : [get][ra_peer_ifaddrs] ra_peer_get_ifaddrs phy_id[0] succ
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.826.743 [adapter_hccp.cc:1407] [618977][Get][HostIf]hrtGetIfAddress: idx[0] ifname[lo] ip[127.0.0.1%lo]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.826.758 [adapter_hccp.cc:1407] [618977][Get][HostIf]hrtGetIfAddress: idx[1] ifname[enp67s0f5] ip[192.168.0.44%enp67s0f5]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.826.772 [adapter_hccp.cc:1407] [618977][Get][HostIf]hrtGetIfAddress: idx[2] ifname[docker0] ip[172.17.0.1%docker0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.826.785 [adapter_hccp.cc:1407] [618977][Get][HostIf]hrtGetIfAddress: idx[3] ifname[lo] ip[::1%lo]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.826.799 [adapter_hccp.cc:1407] [618977][Get][HostIf]hrtGetIfAddress: idx[4] ifname[enp67s0f5] ip[fe80::8b0e:c402:331c:332f%enp67s0f5]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.826.812 [adapter_hccp.cc:1407] [618977][Get][HostIf]hrtGetIfAddress: idx[5] ifname[endvnic] ip[fe80::edaf:6dc3:6fad:b4b2%endvnic]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.826.837 [sal.cc:365] [618977]get host ip success. host ifname[enp67s0f5] ip[192.168.0.44%enp67s0f5]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.826.849 [sal.cc:432] [618977]nic class[normal]: find nic[192.168.0.44%enp67s0f5] success.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.826.874 [network_manager.cc:69] [618977]NetworkManager::GetInstance deviceLogicID[0].
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.826.905 [ra_host.c:340]tid:618977,ra_socket_init_v1(340) : socket init:mode=0 phy_id=0 scope_id=0 family=2 ip=192.168.0.44
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.826.920 [adapter_hccp.cc:818] [618977]socket init v1 success, socketHandle[0xfffe8c08cb40]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.826.932 [network_manager.cc:1218] [618977]ip[192.168.0.44%enp67s0f5] socket init OK
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.826.943 [network_manager.cc:1257] [618977]ip[192.168.0.44%enp67s0f5] socket start success socketHandle[0xfffe8c08cb40]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.826.974 [network_manager.cc:69] [618977]NetworkManager::GetInstance deviceLogicID[0].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.826.991 [network_manager.cc:729] [618977][Start][HostNetAndListen]trying to listen on ip[192.168.0.44%enp67s0f5] port[60008].
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.827.007 [ra_host.c:875]tid:618977,ra_socket_listen_start(875) : Input parameters: [0]th, phy_id[0], local_ip[192.168.0.44], port[60008]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.827.034 [rs_socket.c:975]tid:618977,rs_socket_init_listen(975) : listen [0] IP 0xffff2c00a8c0, ret_vnic -1
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.827.055 [rs_socket.c:98]tid:618977,rs_find_listen_node(98) : listen node for IP(192.168.0.44), server_port(60008) is not listen!
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.827.068 [rs_socket.c:98]tid:618977,rs_find_listen_node(98) : listen node for IP(192.168.0.44), server_port(60008) is not listen!
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.827.082 [rs_socket.c:163]tid:618977,rs_listen_node_alloc(163) : create listen node for IP(192.168.0.44)!
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.827.108 [rs_socket.c:909]tid:618977,rs_socket_listen_bind_listen(909) : listen state:1, then bind for (IP 192.168.0.44 : port 60008)
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.827.121 [rs_socket.c:912]tid:618977,rs_socket_listen_bind_listen(912) : socket bind: family 2, addr 192.168.0.44, port 60008
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.827.133 [rs_socket.c:918]tid:618977,rs_socket_listen_bind_listen(918) : socket bind: family 2, port 26858, addr 0x2c00a8c0
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:42.827.152 [rs_socket.c:949]tid:618977,rs_socket_listen_bind_listen(949) : IP 192.168.0.44 : port 60008 begin listen, fd:51 !
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.827.178 [network_manager.cc:741] [618977][Start][HostNetAndListen]Listen on ip[192.168.0.44%enp67s0f5], port[60008] sucess, devPhyId[0], devLogicId[0], isAutoPort[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.827.192 [network_manager.cc:744] [618977]host ip[192.168.0.44%enp67s0f5] port[60008] refcount is [1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.827.206 [network_manager.cc:749] [618977]HostNet, ip[192.168.0.44%enp67s0f5] port[60008] socket init OK
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.827.217 [network_manager.cc:69] [618977]NetworkManager::GetInstance deviceLogicID[0].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.827.232 [hccl_socket.cc:516] [618977][Get][NicHandleInfo]phyId[0], nicSocketMap[1] localIp[[192.168.0.44%enp67s0f5]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.827.247 [hccl_socket.cc:106] [618977][HcclSocket][Listen] device[0] listens on ip[192.168.0.44%enp67s0f5] port[60008] success, socketType[2].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.827.260 [topoinfo_detect.cc:490] [618977]topo info exchange server start with host ip[192.168.0.44%enp67s0f5] and port[60008]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.827.280 [topoinfo_detect.cc:204] [618977]rootInfo: ip[192.168.0.44] port[60008] identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.827.371 [topoinfo_detect.cc:175] [618977]setup topo exchange server complete, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.827.390 [op_base.cc:128] [618977][HcclGetDeviceId] deviceLogicId[0] 
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.827.403 [op_base.cc:144] [618977][GetHcclOpInfoCtx] Set device, use g_hcclDeviceId[0] 
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.827.410 [api_impl.cc:2999] 618980 SetDevice: device_id=0, deviceMode=0.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.827.416 [op_base.cc:829] [618977][HCCL_TRACE]HcclGetRootInfo success, take time [5110]us, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.827.434 [device.cc:306] 618980 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.827.449 [runtime.cc:3393] 618980 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x8
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.827.464 [runtime.cc:3560] 618980 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=0
[INFO] DISTRIBUTED(618646,fffea8f9efa0,python3.9):2025-04-03-09:27:42.827.468 [mindspore/ccsrc/distributed/collective/collective_manager.cc:787] CreateDeviceCommunicator] [PROF]GenerateRootInfo costs 5.337 msec.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.827.476 [api_impl.cc:2987] 618980 NewDevice: SetCurRef = 0xaaab06c88220,userDeviceId=0,deviceId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.827.495 [runtime.cc:5239] 618980 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.827.514 [api_impl.cc:2992] 618980 NewDevice: New device success, user_device_id=0, die_num=1.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:42.827.531 [awatchdog_core.c:175](tid:618980) create watchdog for id : 65543, tid : 618980, timeout : 300s
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.827.544 [api_impl.cc:3025] 618980 SetDevice: SetDevice success, curCtx=0xaaab06c88220, user_device_id=0.
[INFO] DISTRIBUTED(618646,fffea8f9efa0,python3.9):2025-04-03-09:27:42.827.592 [mindspore/ccsrc/distributed/collective/collective_manager.cc:806] CreateDeviceCommunicator] Successfully send/fetch unqiueid for communication group hccl_world_group
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.827.592 [hccl_socket.cc:342] [618980][Accept]localIp[192.168.0.44%enp67s0f5], remoteIp[0.0.0.0], socket_handle[0xfffe8c08cb40], tag[topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.827.612 [network_manager.cc:69] [618980]NetworkManager::GetInstance deviceLogicID[0].
[INFO] DISTRIBUTED(618646,fffea8f9efa0,python3.9):2025-04-03-09:27:42.827.619 [mindspore/ccsrc/distributed/collective/collective_manager.cc:808] CreateDeviceCommunicator] [PROF]BroadcastUniqueID costs 0.124 msec.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:42.827.626 [hccl_socket.cc:516] [618980][Get][NicHandleInfo]phyId[0], nicSocketMap[1] localIp[[192.168.0.44%enp67s0f5]
[WARNING] DISTRIBUTED(618646,fffea8f9efa0,python3.9):2025-04-03-09:27:42.827.633 [mindspore/ccsrc/distributed/collective/collective_manager.cc:817] CreateDeviceCommunicator] Begin initialize communication group on the device side: hccl_world_group
[INFO] DISTRIBUTED(618646,fffea8f9efa0,python3.9):2025-04-03-09:27:42.827.651 [mindspore/ccsrc/distributed/collective/collective_manager.cc:744] GetCommunicatorInitTimeout] HCCL_CONNECT_TIMEOUT is 600 seconds.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.827.762 [device.cpp:143]618981 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.827.792 [api_impl.cc:2999] 618981 SetDevice: device_id=0, deviceMode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.827.805 [device.cc:306] 618981 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.827.818 [runtime.cc:3393] 618981 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x9
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.827.830 [runtime.cc:3560] 618981 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.827.842 [api_impl.cc:2987] 618981 NewDevice: SetCurRef = 0xaaab06c88220,userDeviceId=0,deviceId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.827.854 [runtime.cc:5239] 618981 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.827.868 [api_impl.cc:2992] 618981 NewDevice: New device success, user_device_id=0, die_num=1.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:42.827.883 [awatchdog_core.c:175](tid:618981) create watchdog for id : 65543, tid : 618981, timeout : 300s
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.827.896 [api_impl.cc:3025] 618981 SetDevice: SetDevice success, curCtx=0xaaab06c88220, user_device_id=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.827.907 [acl.cpp:115]618981 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.827.919 [acl.cpp:121]618981 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.827.931 [device.cpp:154]618981 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.828.744 [runtime.cc:5239] 618812 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:42.828.783 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618812] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.828.747 [runtime.cc:5239] 618814 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:42.828.797 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618812] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:42.828.809 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618812] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:42.828.795 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618814] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:42.828.815 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618814] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:42.828.828 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618814] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.828.831 [runtime.cc:3077] 618812 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=7, devId=7, tdt status=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.828.850 [runtime.cc:3077] 618814 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=4, devId=4, tdt status=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:42.828.903 [npu_driver.cc:551] 618812 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:42.828.945 [npu_driver.cc:551] 618814 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.860.722 [runtime.cc:5239] 618820 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:42.860.755 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618820] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:42.860.774 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618820] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:42.860.787 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618820] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.860.809 [runtime.cc:3077] 618820 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=6, devId=6, tdt status=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:42.860.893 [npu_driver.cc:551] 618820 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:42.884.189 [trs_cb_event.c:119][ascend][curpid:618654,618833][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =321; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:42.884.189 [trs_cb_event.c:119][ascend][curpid:618654,618832][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =320; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:42.884.216 [trs_sqcq.c:1491][ascend][curpid:618654,618833][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:42.884.225 [trs_sqcq.c:1491][ascend][curpid:618654,618832][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:42.884.234 [npu_driver.cc:3833] 618833 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:42.884.239 [npu_driver.cc:3833] 618832 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=320, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:42.884.253 [api_impl.cc:5058] 618833 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:42.884.259 [api_impl.cc:5058] 618832 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.884.289 [callback.cpp:132]618833 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.884.291 [callback.cpp:132]618832 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.884.307 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:42.884.311 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.884.327 [npu_driver.cc:3828] 618833 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=321.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:42.884.330 [npu_driver.cc:3828] 618832 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=320.
[INFO] DISTRIBUTED(618658,fffec77eefa0,python3.9):2025-04-03-09:27:42.891.392 [mindspore/ccsrc/distributed/collective/collective_manager.cc:806] CreateDeviceCommunicator] Successfully send/fetch unqiueid for communication group hccl_world_group
[INFO] DISTRIBUTED(618658,fffec77eefa0,python3.9):2025-04-03-09:27:42.891.448 [mindspore/ccsrc/distributed/collective/collective_manager.cc:808] CreateDeviceCommunicator] [PROF]BroadcastUniqueID costs 3001.72 msec.
[WARNING] DISTRIBUTED(618658,fffec77eefa0,python3.9):2025-04-03-09:27:42.891.471 [mindspore/ccsrc/distributed/collective/collective_manager.cc:817] CreateDeviceCommunicator] Begin initialize communication group on the device side: hccl_world_group
[INFO] DISTRIBUTED(618658,fffec77eefa0,python3.9):2025-04-03-09:27:42.891.500 [mindspore/ccsrc/distributed/collective/collective_manager.cc:744] GetCommunicatorInitTimeout] HCCL_CONNECT_TIMEOUT is 600 seconds.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.891.671 [device.cpp:143]618982 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:42.891.714 [api_impl.cc:2999] 618982 SetDevice: device_id=3, deviceMode=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:42.891.733 [device.cc:306] 618982 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:42.891.747 [runtime.cc:3393] 618982 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x8
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:42.891.773 [runtime.cc:3560] 618982 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:42.891.790 [api_impl.cc:2987] 618982 NewDevice: SetCurRef = 0xaaab0b9e09a0,userDeviceId=3,deviceId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:42.891.803 [runtime.cc:5239] 618982 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:42.891.826 [api_impl.cc:2992] 618982 NewDevice: New device success, user_device_id=3, die_num=1.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:42.891.847 [awatchdog_core.c:175](tid:618982) create watchdog for id : 65543, tid : 618982, timeout : 300s
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:42.891.878 [api_impl.cc:3025] 618982 SetDevice: SetDevice success, curCtx=0xaaab0b9e09a0, user_device_id=3.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.891.892 [acl.cpp:115]618982 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.891.909 [acl.cpp:121]618982 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:42.891.925 [device.cpp:154]618982 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 3
[INFO] DISTRIBUTED(618666,fffeb17aefa0,python3.9):2025-04-03-09:27:42.944.052 [mindspore/ccsrc/distributed/collective/collective_manager.cc:806] CreateDeviceCommunicator] Successfully send/fetch unqiueid for communication group hccl_world_group
[INFO] DISTRIBUTED(618666,fffeb17aefa0,python3.9):2025-04-03-09:27:42.944.097 [mindspore/ccsrc/distributed/collective/collective_manager.cc:808] CreateDeviceCommunicator] [PROF]BroadcastUniqueID costs 500.686 msec.
[WARNING] DISTRIBUTED(618666,fffeb17aefa0,python3.9):2025-04-03-09:27:42.944.113 [mindspore/ccsrc/distributed/collective/collective_manager.cc:817] CreateDeviceCommunicator] Begin initialize communication group on the device side: hccl_world_group
[INFO] DISTRIBUTED(618666,fffeb17aefa0,python3.9):2025-04-03-09:27:42.944.135 [mindspore/ccsrc/distributed/collective/collective_manager.cc:744] GetCommunicatorInitTimeout] HCCL_CONNECT_TIMEOUT is 600 seconds.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.944.299 [device.cpp:143]618983 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.944.329 [api_impl.cc:2999] 618983 SetDevice: device_id=5, deviceMode=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.944.342 [device.cc:306] 618983 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.944.354 [runtime.cc:3393] 618983 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x8
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.944.366 [runtime.cc:3560] 618983 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.944.377 [api_impl.cc:2987] 618983 NewDevice: SetCurRef = 0xaaaaf6e2dcc0,userDeviceId=5,deviceId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.944.388 [runtime.cc:5239] 618983 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.944.403 [api_impl.cc:2992] 618983 NewDevice: New device success, user_device_id=5, die_num=1.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:42.944.419 [awatchdog_core.c:175](tid:618983) create watchdog for id : 65543, tid : 618983, timeout : 300s
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:42.944.431 [api_impl.cc:3025] 618983 SetDevice: SetDevice success, curCtx=0xaaaaf6e2dcc0, user_device_id=5.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.944.443 [acl.cpp:115]618983 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.944.453 [acl.cpp:121]618983 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:42.944.473 [device.cpp:154]618983 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 5
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.956.779 [runtime.cc:5239] 618826 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:42.956.809 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618826] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:42.956.825 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618826] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:42.956.838 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618826] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.956.859 [runtime.cc:3077] 618826 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=1, devId=1, tdt status=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:42.956.936 [npu_driver.cc:551] 618826 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:42.980.183 [trs_cb_event.c:119][ascend][curpid:618646,618837][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =65; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:42.980.183 [trs_cb_event.c:119][ascend][curpid:618646,618836][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =64; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:42.980.218 [trs_sqcq.c:1491][ascend][curpid:618646,618837][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:42.980.232 [trs_sqcq.c:1491][ascend][curpid:618646,618836][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:42.980.238 [npu_driver.cc:3833] 618837 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:42.980.251 [npu_driver.cc:3833] 618836 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:42.980.261 [api_impl.cc:5058] 618837 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:42.980.276 [api_impl.cc:5058] 618836 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.980.287 [callback.cpp:132]618837 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.980.299 [callback.cpp:132]618836 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.980.305 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:42.980.323 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.980.333 [npu_driver.cc:3828] 618837 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=65.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:42.980.347 [npu_driver.cc:3828] 618836 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=64.
[INFO] DISTRIBUTED(618662,fffed1fbefa0,python3.9):2025-04-03-09:27:43.027.835 [mindspore/ccsrc/distributed/collective/collective_manager.cc:806] CreateDeviceCommunicator] Successfully send/fetch unqiueid for communication group hccl_world_group
[INFO] DISTRIBUTED(618662,fffed1fbefa0,python3.9):2025-04-03-09:27:43.027.892 [mindspore/ccsrc/distributed/collective/collective_manager.cc:808] CreateDeviceCommunicator] [PROF]BroadcastUniqueID costs 500.625 msec.
[INFO] DISTRIBUTED(618674,fffea67cefa0,python3.9):2025-04-03-09:27:43.027.867 [mindspore/ccsrc/distributed/collective/collective_manager.cc:806] CreateDeviceCommunicator] Successfully send/fetch unqiueid for communication group hccl_world_group
[WARNING] DISTRIBUTED(618662,fffed1fbefa0,python3.9):2025-04-03-09:27:43.027.915 [mindspore/ccsrc/distributed/collective/collective_manager.cc:817] CreateDeviceCommunicator] Begin initialize communication group on the device side: hccl_world_group
[INFO] DISTRIBUTED(618674,fffea67cefa0,python3.9):2025-04-03-09:27:43.027.926 [mindspore/ccsrc/distributed/collective/collective_manager.cc:808] CreateDeviceCommunicator] [PROF]BroadcastUniqueID costs 500.656 msec.
[INFO] DISTRIBUTED(618662,fffed1fbefa0,python3.9):2025-04-03-09:27:43.027.943 [mindspore/ccsrc/distributed/collective/collective_manager.cc:744] GetCommunicatorInitTimeout] HCCL_CONNECT_TIMEOUT is 600 seconds.
[WARNING] DISTRIBUTED(618674,fffea67cefa0,python3.9):2025-04-03-09:27:43.027.949 [mindspore/ccsrc/distributed/collective/collective_manager.cc:817] CreateDeviceCommunicator] Begin initialize communication group on the device side: hccl_world_group
[INFO] DISTRIBUTED(618674,fffea67cefa0,python3.9):2025-04-03-09:27:43.027.977 [mindspore/ccsrc/distributed/collective/collective_manager.cc:744] GetCommunicatorInitTimeout] HCCL_CONNECT_TIMEOUT is 600 seconds.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.028.093 [device.cpp:143]618984 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 4.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.028.120 [device.cpp:143]618985 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 7.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.028.129 [api_impl.cc:2999] 618984 SetDevice: device_id=4, deviceMode=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.028.151 [device.cc:306] 618984 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.028.165 [api_impl.cc:2999] 618985 SetDevice: device_id=7, deviceMode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.028.188 [device.cc:306] 618985 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.028.183 [runtime.cc:3393] 618984 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x8
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.028.199 [runtime.cc:3560] 618984 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=4
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.028.207 [runtime.cc:3393] 618985 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x8
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.028.211 [api_impl.cc:2987] 618984 NewDevice: SetCurRef = 0xaaab087d6320,userDeviceId=4,deviceId=4
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.028.226 [runtime.cc:3560] 618985 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=7
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.028.243 [runtime.cc:5239] 618984 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.028.243 [api_impl.cc:2987] 618985 NewDevice: SetCurRef = 0xaaab0103b880,userDeviceId=7,deviceId=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.028.259 [runtime.cc:5239] 618985 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.028.261 [api_impl.cc:2992] 618984 NewDevice: New device success, user_device_id=4, die_num=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.028.280 [api_impl.cc:2992] 618985 NewDevice: New device success, user_device_id=7, die_num=1.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:43.028.284 [awatchdog_core.c:175](tid:618984) create watchdog for id : 65543, tid : 618984, timeout : 300s
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.028.301 [api_impl.cc:3025] 618984 SetDevice: SetDevice success, curCtx=0xaaab087d6320, user_device_id=4.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:43.028.304 [awatchdog_core.c:175](tid:618985) create watchdog for id : 65543, tid : 618985, timeout : 300s
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.028.315 [acl.cpp:115]618984 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.028.331 [acl.cpp:121]618984 GetSocVersion: socVersion is Ascend910B3
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.028.322 [api_impl.cc:3025] 618985 SetDevice: SetDevice success, curCtx=0xaaab0103b880, user_device_id=7.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.028.348 [device.cpp:154]618984 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 4
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.028.354 [acl.cpp:115]618985 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.028.369 [acl.cpp:121]618985 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.028.387 [device.cpp:154]618985 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 7
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.052.707 [runtime.cc:5239] 618830 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:43.052.740 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618830] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:43.052.759 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618830] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:43.052.774 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618830] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.052.800 [runtime.cc:3077] 618830 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=2, devId=2, tdt status=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.052.875 [npu_driver.cc:551] 618830 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] DISTRIBUTED(618670,fffec67cefa0,python3.9):2025-04-03-09:27:43.063.367 [mindspore/ccsrc/distributed/collective/collective_manager.cc:806] CreateDeviceCommunicator] Successfully send/fetch unqiueid for communication group hccl_world_group
[INFO] DISTRIBUTED(618670,fffec67cefa0,python3.9):2025-04-03-09:27:43.063.407 [mindspore/ccsrc/distributed/collective/collective_manager.cc:808] CreateDeviceCommunicator] [PROF]BroadcastUniqueID costs 500.658 msec.
[WARNING] DISTRIBUTED(618670,fffec67cefa0,python3.9):2025-04-03-09:27:43.063.427 [mindspore/ccsrc/distributed/collective/collective_manager.cc:817] CreateDeviceCommunicator] Begin initialize communication group on the device side: hccl_world_group
[INFO] DISTRIBUTED(618670,fffec67cefa0,python3.9):2025-04-03-09:27:43.063.451 [mindspore/ccsrc/distributed/collective/collective_manager.cc:744] GetCommunicatorInitTimeout] HCCL_CONNECT_TIMEOUT is 600 seconds.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.063.612 [device.cpp:143]618986 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.063.651 [api_impl.cc:2999] 618986 SetDevice: device_id=6, deviceMode=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.063.669 [device.cc:306] 618986 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.063.687 [runtime.cc:3393] 618986 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x8
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.063.704 [runtime.cc:3560] 618986 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.063.720 [api_impl.cc:2987] 618986 NewDevice: SetCurRef = 0xaaaad9a630c0,userDeviceId=6,deviceId=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.063.734 [runtime.cc:5239] 618986 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.063.753 [api_impl.cc:2992] 618986 NewDevice: New device success, user_device_id=6, die_num=1.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:43.063.786 [awatchdog_core.c:175](tid:618986) create watchdog for id : 65543, tid : 618986, timeout : 300s
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.063.803 [api_impl.cc:3025] 618986 SetDevice: SetDevice success, curCtx=0xaaaad9a630c0, user_device_id=6.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.063.816 [acl.cpp:115]618986 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.063.831 [acl.cpp:121]618986 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.063.843 [device.cpp:154]618986 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 6
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:43.108.171 [trs_cb_event.c:119][ascend][curpid:618666,618808][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =64; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:43.108.185 [trs_cb_event.c:119][ascend][curpid:618666,618809][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =65; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:43.108.195 [trs_sqcq.c:1491][ascend][curpid:618666,618808][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:43.108.205 [trs_sqcq.c:1491][ascend][curpid:618666,618809][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:43.108.208 [npu_driver.cc:3833] 618808 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:43.108.221 [api_impl.cc:5058] 618808 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:43.108.218 [npu_driver.cc:3833] 618809 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=65, drvRetCode=16.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.108.233 [callback.cpp:132]618808 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:43.108.235 [api_impl.cc:5058] 618809 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.108.245 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.108.249 [callback.cpp:132]618809 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.108.259 [npu_driver.cc:3828] 618808 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=64.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.108.262 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.108.277 [npu_driver.cc:3828] 618809 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=65.
[INFO] DISTRIBUTED(618650,fffeda7cefa0,python3.9):2025-04-03-09:27:43.133.964 [mindspore/ccsrc/distributed/collective/collective_manager.cc:806] CreateDeviceCommunicator] Successfully send/fetch unqiueid for communication group hccl_world_group
[INFO] DISTRIBUTED(618650,fffeda7cefa0,python3.9):2025-04-03-09:27:43.134.002 [mindspore/ccsrc/distributed/collective/collective_manager.cc:808] CreateDeviceCommunicator] [PROF]BroadcastUniqueID costs 500.492 msec.
[WARNING] DISTRIBUTED(618650,fffeda7cefa0,python3.9):2025-04-03-09:27:43.134.021 [mindspore/ccsrc/distributed/collective/collective_manager.cc:817] CreateDeviceCommunicator] Begin initialize communication group on the device side: hccl_world_group
[INFO] DISTRIBUTED(618650,fffeda7cefa0,python3.9):2025-04-03-09:27:43.134.041 [mindspore/ccsrc/distributed/collective/collective_manager.cc:744] GetCommunicatorInitTimeout] HCCL_CONNECT_TIMEOUT is 600 seconds.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.134.202 [device.cpp:143]618987 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.134.238 [api_impl.cc:2999] 618987 SetDevice: device_id=1, deviceMode=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.134.252 [device.cc:306] 618987 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.134.265 [runtime.cc:3393] 618987 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x8
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.134.278 [runtime.cc:3560] 618987 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.134.290 [api_impl.cc:2987] 618987 NewDevice: SetCurRef = 0xaaab312ab590,userDeviceId=1,deviceId=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.134.310 [runtime.cc:5239] 618987 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.134.326 [api_impl.cc:2992] 618987 NewDevice: New device success, user_device_id=1, die_num=1.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:43.134.341 [awatchdog_core.c:175](tid:618987) create watchdog for id : 65543, tid : 618987, timeout : 300s
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.134.353 [api_impl.cc:3025] 618987 SetDevice: SetDevice success, curCtx=0xaaab312ab590, user_device_id=1.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.134.365 [acl.cpp:115]618987 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.134.376 [acl.cpp:121]618987 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.134.389 [device.cpp:154]618987 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 1
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:43.140.173 [trs_cb_event.c:119][ascend][curpid:618658,618774][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =64; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:43.140.182 [trs_cb_event.c:119][ascend][curpid:618658,618775][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =65; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:43.140.200 [trs_sqcq.c:1491][ascend][curpid:618658,618774][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:43.140.215 [trs_sqcq.c:1491][ascend][curpid:618658,618775][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:43.140.225 [npu_driver.cc:3833] 618774 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:43.140.238 [npu_driver.cc:3833] 618775 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:43.140.246 [api_impl.cc:5058] 618774 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:43.140.259 [api_impl.cc:5058] 618775 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.140.267 [callback.cpp:132]618774 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.140.282 [callback.cpp:132]618775 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.140.286 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.140.303 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.140.314 [npu_driver.cc:3828] 618774 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=64.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.140.328 [npu_driver.cc:3828] 618775 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=65.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.148.744 [runtime.cc:5239] 618834 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:43.148.782 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618834] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:43.148.805 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618834] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:43.148.823 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618834] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.148.847 [runtime.cc:3077] 618834 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=0, devId=0, tdt status=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.148.933 [npu_driver.cc:551] 618834 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:43.172.183 [trs_cb_event.c:119][ascend][curpid:618674,618818][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =64; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:43.172.183 [trs_cb_event.c:119][ascend][curpid:618674,618819][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =65; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:43.172.171 [trs_cb_event.c:119][ascend][curpid:618662,618816][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =832; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:43.172.179 [trs_cb_event.c:119][ascend][curpid:618662,618817][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =833; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:43.172.200 [trs_sqcq.c:1491][ascend][curpid:618662,618816][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:43.172.208 [trs_sqcq.c:1491][ascend][curpid:618674,618818][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:43.172.222 [trs_sqcq.c:1491][ascend][curpid:618674,618819][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:43.172.211 [trs_sqcq.c:1491][ascend][curpid:618662,618817][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:43.172.224 [npu_driver.cc:3833] 618816 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=832, drvRetCode=16.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:43.172.238 [api_impl.cc:5058] 618816 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:43.172.232 [npu_driver.cc:3833] 618817 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=833, drvRetCode=16.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:43.172.228 [npu_driver.cc:3833] 618818 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:43.172.243 [npu_driver.cc:3833] 618819 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=65, drvRetCode=16.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.172.254 [callback.cpp:132]618816 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:43.172.253 [api_impl.cc:5058] 618818 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:43.172.259 [api_impl.cc:5058] 618817 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:43.172.263 [api_impl.cc:5058] 618819 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.172.272 [callback.cpp:132]618818 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.172.276 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.172.285 [callback.cpp:132]618819 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.172.283 [callback.cpp:132]618817 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.172.297 [npu_driver.cc:3828] 618816 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=832.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.172.292 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.172.307 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.172.302 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.172.315 [npu_driver.cc:3828] 618818 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=64.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.172.321 [npu_driver.cc:3828] 618817 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=833.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.172.327 [npu_driver.cc:3828] 618819 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=65.
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:43.204.170 [trs_cb_event.c:119][ascend][curpid:618670,618822][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =64; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:43.204.175 [trs_cb_event.c:119][ascend][curpid:618670,618823][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =65; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:43.204.196 [trs_sqcq.c:1491][ascend][curpid:618670,618822][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:43.204.168 [queue_client_comm.c:114][ascend][curpid:618658,618787][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:43.204.177 [queue_client_comm.c:114][ascend][curpid:618658,618779][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:43.204.176 [queue_client_comm.c:114][ascend][curpid:618658,618783][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:43.204.204 [trs_sqcq.c:1491][ascend][curpid:618670,618823][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:43.204.215 [npu_driver.cc:3833] 618822 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=64, drvRetCode=16.
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:43.204.176 [queue_client_comm.c:114][ascend][curpid:618658,618781][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:43.204.223 [npu_driver.cc:3833] 618823 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:43.204.229 [api_impl.cc:5058] 618822 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:43.204.240 [api_impl.cc:5058] 618823 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.204.249 [callback.cpp:132]618822 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.204.257 [callback.cpp:132]618823 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.204.263 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:43.204.180 [queue_client_comm.c:114][ascend][curpid:618658,618789][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618658,python3.9):20[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.204.273 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.204.280 [npu_driver.cc:3828] 618822 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=64.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.204.290 [npu_driver.cc:3828] 618823 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=65.
25-04-03-09:27:43.204.180 [queue_client_comm.c:114][ascend][curpid:618658,618785][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:43.204.274 [npu_driver.cc:4338] 618787 MemQueuePeek: queue empty
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:43.204.307 [npu_driver.cc:4338] 618779 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.204.308 [tensor_data_transfer.cpp:612]618787 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_scalar_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.204.333 [tensor_data_transfer.cpp:612]618779 acltdtReceiveTensorV2: queue is empty, device is 3, name is _npu_log
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:43.204.362 [npu_driver.cc:4338] 618781 MemQueuePeek: queue empty
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:43.204.335 [npu_driver.cc:4338] 618783 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.204.360 [tensor_data_transfer.cpp:1054]618787 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_scalar_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.204.373 [tensor_data_transfer.cpp:1054]618779 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is _npu_log
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.204.378 [tensor_data_transfer.cpp:612]618781 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_tensor_dump
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.204.390 [tensor_data_transfer.cpp:612]618783 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_tensor_summary
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:43.204.398 [npu_driver.cc:4338] 618789 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.204.409 [tensor_data_transfer.cpp:1056]618779 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.204.443 [tensor_data_transfer.cpp:612]618789 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_histogram_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.204.398 [tensor_data_transfer.cpp:1056]618787 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:43.204.419 [npu_driver.cc:4338] 618785 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.204.419 [tensor_data_transfer.cpp:1054]618781 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_tensor_dump
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.204.431 [tensor_data_transfer.cpp:1054]618783 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_tensor_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.204.452 [api_impl.cc:6121] 618779 MemQueuePeek: Start to peek queue on devId 3, qid is 0.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.204.463 [tensor_data_transfer.cpp:1054]618789 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_histogram_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.204.472 [api_impl.cc:6121] 618787 MemQueuePeek: Start to peek queue on devId 3, qid is 4.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.204.483 [tensor_data_transfer.cpp:612]618785 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_image_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.204.493 [tensor_data_transfer.cpp:1056]618781 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.204.502 [tensor_data_transfer.cpp:1056]618783 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.204.512 [npu_driver.cc:4330] 618779 MemQueuePeek: peek mem queue, deviceId=3, qid=0, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.204.522 [tensor_data_transfer.cpp:1056]618789 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.204.594 [api_impl.cc:6121] 618789 MemQueuePeek: Start to peek queue on devId 3, qid is 5.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.204.532 [npu_driver.cc:4330] 618787 MemQueuePeek: peek mem queue, deviceId=3, qid=4, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.204.540 [tensor_data_transfer.cpp:1054]618785 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_image_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.204.551 [api_impl.cc:6121] 618781 MemQueuePeek: Start to peek queue on devId 3, qid is 1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.204.559 [api_impl.cc:6121] 618783 MemQueuePeek: Start to peek queue on devId 3, qid is 2.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.204.609 [npu_driver.cc:4330] 618789 MemQueuePeek: peek mem queue, deviceId=3, qid=5, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.204.625 [tensor_data_transfer.cpp:1056]618785 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.204.637 [npu_driver.cc:4330] 618781 MemQueuePeek: peek mem queue, deviceId=3, qid=1, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.204.644 [npu_driver.cc:4330] 618783 MemQueuePeek: peek mem queue, deviceId=3, qid=2, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.204.663 [api_impl.cc:6121] 618785 MemQueuePeek: Start to peek queue on devId 3, qid is 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.204.688 [npu_driver.cc:4330] 618785 MemQueuePeek: peek mem queue, deviceId=3, qid=3, timeout=800.
[INFO] DISTRIBUTED(618654,fffea9fbefa0,python3.9):2025-04-03-09:27:43.257.610 [mindspore/ccsrc/distributed/collective/collective_manager.cc:806] CreateDeviceCommunicator] Successfully send/fetch unqiueid for communication group hccl_world_group
[INFO] DISTRIBUTED(618654,fffea9fbefa0,python3.9):2025-04-03-09:27:43.257.651 [mindspore/ccsrc/distributed/collective/collective_manager.cc:808] CreateDeviceCommunicator] [PROF]BroadcastUniqueID costs 500.58 msec.
[WARNING] DISTRIBUTED(618654,fffea9fbefa0,python3.9):2025-04-03-09:27:43.257.674 [mindspore/ccsrc/distributed/collective/collective_manager.cc:817] CreateDeviceCommunicator] Begin initialize communication group on the device side: hccl_world_group
[INFO] DISTRIBUTED(618654,fffea9fbefa0,python3.9):2025-04-03-09:27:43.257.699 [mindspore/ccsrc/distributed/collective/collective_manager.cc:744] GetCommunicatorInitTimeout] HCCL_CONNECT_TIMEOUT is 600 seconds.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.257.850 [device.cpp:143]618988 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.257.881 [api_impl.cc:2999] 618988 SetDevice: device_id=2, deviceMode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.257.899 [device.cc:306] 618988 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.257.913 [runtime.cc:3393] 618988 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x8
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.257.929 [runtime.cc:3560] 618988 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.257.944 [api_impl.cc:2987] 618988 NewDevice: SetCurRef = 0xaaaaf5082ff0,userDeviceId=2,deviceId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.257.960 [runtime.cc:5239] 618988 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.257.976 [api_impl.cc:2992] 618988 NewDevice: New device success, user_device_id=2, die_num=1.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:43.258.008 [awatchdog_core.c:175](tid:618988) create watchdog for id : 65543, tid : 618988, timeout : 300s
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.258.026 [api_impl.cc:3025] 618988 SetDevice: SetDevice success, curCtx=0xaaaaf5082ff0, user_device_id=2.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.258.040 [acl.cpp:115]618988 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.258.054 [acl.cpp:121]618988 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.258.071 [device.cpp:154]618988 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 2
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.258.417 [device.cpp:231]618988 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.258.442 [runtime.cc:5239] 618988 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.258.428 [device.cpp:231]618982 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.258.453 [runtime.cc:5239] 618982 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.258.420 [device.cpp:231]618987 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.258.444 [device.cpp:231]618984 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.258.473 [runtime.cc:5239] 618984 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.258.473 [device.cpp:231]618983 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.258.463 [runtime.cc:5239] 618987 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.258.496 [runtime.cc:5239] 618983 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.258.495 [device.cpp:231]618985 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.258.528 [runtime.cc:5239] 618985 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.258.492 [device.cpp:231]618986 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.258.527 [runtime.cc:5239] 618986 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.258.499 [device.cpp:231]618981 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.258.547 [runtime.cc:5239] 618981 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.258.633 [api_c_soc.cc:70] 618988 rtGetSocVersion: soc version is Ascend910B3
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.258.634 [api_c_soc.cc:70] 618987 rtGetSocVersion: soc version is Ascend910B3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.258.637 [api_c_soc.cc:70] 618982 rtGetSocVersion: soc version is Ascend910B3
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.258.647 [api_c_soc.cc:70] 618984 rtGetSocVersion: soc version is Ascend910B3
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.258.663 [api_c_soc.cc:70] 618983 rtGetSocVersion: soc version is Ascend910B3
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.258.678 [api_c_soc.cc:70] 618985 rtGetSocVersion: soc version is Ascend910B3
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.258.675 [memory.cpp:559]618987 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.258.675 [memory.cpp:559]618988 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.258.696 [runtime.cc:5239] 618988 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.258.675 [memory.cpp:559]618982 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.258.696 [runtime.cc:5239] 618982 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.258.681 [api_c_soc.cc:70] 618986 rtGetSocVersion: soc version is Ascend910B3
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.258.684 [memory.cpp:559]618984 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.258.678 [api_c_soc.cc:70] 618981 rtGetSocVersion: soc version is Ascend910B3
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.258.697 [runtime.cc:5239] 618987 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.258.712 [api_impl.cc:3100] 618987 GetDevicePhyIdByIndex: get PhyId by Index=0.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.258.708 [memory.cpp:559]618983 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.258.712 [api_impl.cc:3100] 618988 GetDevicePhyIdByIndex: get PhyId by Index=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.258.727 [api_impl.cc:3111] 618988 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.258.712 [api_impl.cc:3100] 618982 GetDevicePhyIdByIndex: get PhyId by Index=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.258.727 [api_impl.cc:3111] 618982 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=0
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.258.721 [memory.cpp:559]618985 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.258.729 [memory.cpp:559]618986 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.258.708 [runtime.cc:5239] 618984 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.258.735 [api_impl.cc:3100] 618984 GetDevicePhyIdByIndex: get PhyId by Index=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.258.747 [api_impl.cc:3111] 618984 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.258.757 [api_impl.cc:3130] 618984 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=0
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.258.721 [memory.cpp:559]618981 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.258.738 [runtime.cc:5239] 618981 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.258.766 [api_impl.cc:3100] 618981 GetDevicePhyIdByIndex: get PhyId by Index=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.258.727 [api_impl.cc:3111] 618987 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.258.742 [api_impl.cc:3130] 618987 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.258.755 [api_impl.cc:3168] 618987 EnableP2P: Enable P2P devIdDes=1, phyIdSrc=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.258.728 [runtime.cc:5239] 618983 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.258.751 [api_impl.cc:3100] 618983 GetDevicePhyIdByIndex: get PhyId by Index=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.258.766 [api_impl.cc:3111] 618983 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.258.778 [api_impl.cc:3130] 618983 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.258.742 [api_impl.cc:3130] 618988 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.258.755 [api_impl.cc:3168] 618988 EnableP2P: Enable P2P devIdDes=2, phyIdSrc=0.
[INFO] DRV(618654,python3.9):2025-04-03-09:27:43.258.778 [devdrv_pcie.c:888][ascend][curpid:618654,618988][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=2; peer_phy_devid=0.)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.258.794 [api_impl.cc:3168] 618983 EnableP2P: Enable P2P devIdDes=5, phyIdSrc=0.
[INFO] DRV(618666,python3.9):2025-04-03-09:27:43.258.817 [devdrv_pcie.c:888][ascend][curpid:618666,618983][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=5; peer_phy_devid=0.)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.258.738 [api_impl.cc:3130] 618982 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.258.755 [api_impl.cc:3168] 618982 EnableP2P: Enable P2P devIdDes=3, phyIdSrc=0.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:43.258.778 [devdrv_pcie.c:888][ascend][curpid:618658,618982][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=3; peer_phy_devid=0.)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.258.739 [runtime.cc:5239] 618985 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.258.764 [api_impl.cc:3100] 618985 GetDevicePhyIdByIndex: get PhyId by Index=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.258.778 [api_impl.cc:3111] 618985 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.258.791 [api_impl.cc:3130] 618985 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.258.747 [runtime.cc:5239] 618986 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.258.762 [api_impl.cc:3100] 618986 GetDevicePhyIdByIndex: get PhyId by Index=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.258.775 [api_impl.cc:3111] 618986 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.258.799 [api_impl.cc:3130] 618986 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.258.813 [api_impl.cc:3168] 618986 EnableP2P: Enable P2P devIdDes=6, phyIdSrc=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.258.771 [api_impl.cc:3168] 618984 EnableP2P: Enable P2P devIdDes=4, phyIdSrc=0.
[INFO] DRV(618662,python3.9):2025-04-03-09:27:43.258.791 [devdrv_pcie.c:888][ascend][curpid:618662,618984][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=4; peer_phy_devid=0.)
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.258.812 [memory.cpp:559]618984 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.258.783 [api_impl.cc:3111] 618981 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.258.794 [api_impl.cc:3130] 618981 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.258.808 [api_impl.cc:3168] 618981 EnableP2P: Enable P2P devIdDes=0, phyIdSrc=1.
[INFO] DRV(618650,python3.9):2025-04-03-09:27:43.258.779 [devdrv_pcie.c:888][ascend][curpid:618650,618987][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=1; peer_phy_devid=0.)
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.258.802 [memory.cpp:559]618987 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.258.815 [runtime.cc:5239] 618987 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.258.828 [api_impl.cc:3100] 618987 GetDevicePhyIdByIndex: get PhyId by Index=2.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.258.801 [memory.cpp:559]618988 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.258.815 [runtime.cc:5239] 618988 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.258.827 [api_impl.cc:3100] 618988 GetDevicePhyIdByIndex: get PhyId by Index=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.258.837 [api_impl.cc:3111] 618988 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=1
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.258.853 [memory.cpp:559]618983 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.258.822 [api_impl.cc:3168] 618985 EnableP2P: Enable P2P devIdDes=7, phyIdSrc=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.258.826 [runtime.cc:5239] 618984 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.258.840 [api_impl.cc:3100] 618984 GetDevicePhyIdByIndex: get PhyId by Index=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.258.851 [api_impl.cc:3111] 618984 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.258.861 [api_impl.cc:3130] 618984 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.258.872 [api_impl.cc:3168] 618984 EnableP2P: Enable P2P devIdDes=4, phyIdSrc=1.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.258.800 [memory.cpp:559]618982 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.258.816 [runtime.cc:5239] 618982 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.258.828 [api_impl.cc:3100] 618982 GetDevicePhyIdByIndex: get PhyId by Index=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.258.839 [api_impl.cc:3111] 618982 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.258.849 [api_impl.cc:3130] 618982 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.258.859 [api_impl.cc:3168] 618982 EnableP2P: Enable P2P devIdDes=3, phyIdSrc=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.258.841 [api_impl.cc:3111] 618987 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.258.853 [api_impl.cc:3130] 618987 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.258.863 [api_impl.cc:3168] 618987 EnableP2P: Enable P2P devIdDes=1, phyIdSrc=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.258.848 [api_impl.cc:3130] 618988 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.258.860 [api_impl.cc:3168] 618988 EnableP2P: Enable P2P devIdDes=2, phyIdSrc=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.258.869 [runtime.cc:5239] 618983 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.258.880 [api_impl.cc:3100] 618983 GetDevicePhyIdByIndex: get PhyId by Index=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.258.892 [api_impl.cc:3111] 618983 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.258.902 [api_impl.cc:3130] 618983 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.258.911 [api_impl.cc:3168] 618983 EnableP2P: Enable P2P devIdDes=5, phyIdSrc=1.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:43.259.049 [devdrv_pcie.c:888][ascend][curpid:618646,618981][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=0; peer_phy_devid=1.)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:43.259.058 [devdrv_pcie.c:888][ascend][curpid:618670,618986][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=6; peer_phy_devid=0.)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:43.259.066 [devdrv_pcie.c:888][ascend][curpid:618674,618985][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=7; peer_phy_devid=0.)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:43.259.071 [devdrv_pcie.c:888][ascend][curpid:618654,618988][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=2; peer_phy_devid=1.)
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.259.077 [memory.cpp:559]618981 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.259.094 [runtime.cc:5239] 618981 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.259.089 [memory.cpp:559]618986 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.259.095 [memory.cpp:559]618985 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.259.097 [memory.cpp:559]618988 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.259.111 [runtime.cc:5239] 618988 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.259.110 [api_impl.cc:3100] 618981 GetDevicePhyIdByIndex: get PhyId by Index=2.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.259.106 [runtime.cc:5239] 618986 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.259.121 [api_impl.cc:3100] 618986 GetDevicePhyIdByIndex: get PhyId by Index=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.259.123 [api_impl.cc:3111] 618981 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.259.136 [api_impl.cc:3130] 618981 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.259.112 [runtime.cc:5239] 618985 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.259.127 [api_impl.cc:3100] 618985 GetDevicePhyIdByIndex: get PhyId by Index=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.259.124 [api_impl.cc:3100] 618988 GetDevicePhyIdByIndex: get PhyId by Index=3.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.259.134 [api_impl.cc:3111] 618988 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=3
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.259.133 [api_impl.cc:3111] 618986 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.259.147 [api_impl.cc:3130] 618986 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.259.148 [api_impl.cc:3168] 618981 EnableP2P: Enable P2P devIdDes=0, phyIdSrc=2.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.259.138 [api_impl.cc:3111] 618985 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.259.150 [api_impl.cc:3130] 618985 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.259.161 [api_impl.cc:3168] 618985 EnableP2P: Enable P2P devIdDes=7, phyIdSrc=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.259.147 [api_impl.cc:3130] 618988 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=3
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.259.161 [api_impl.cc:3168] 618986 EnableP2P: Enable P2P devIdDes=6, phyIdSrc=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.259.172 [api_impl.cc:3168] 618988 EnableP2P: Enable P2P devIdDes=2, phyIdSrc=3.
[INFO] DRV(618650,python3.9):2025-04-03-09:27:43.259.261 [devdrv_pcie.c:888][ascend][curpid:618650,618987][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=1; peer_phy_devid=2.)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:43.259.267 [devdrv_pcie.c:888][ascend][curpid:618662,618984][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=4; peer_phy_devid=1.)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:43.259.272 [devdrv_pcie.c:888][ascend][curpid:618658,618982][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=3; peer_phy_devid=1.)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:43.259.280 [devdrv_pcie.c:888][ascend][curpid:618666,618983][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=5; peer_phy_devid=1.)
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.259.290 [memory.cpp:559]618984 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.259.286 [memory.cpp:559]618987 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.259.303 [runtime.cc:5239] 618987 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.259.295 [memory.cpp:559]618982 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.259.309 [runtime.cc:5239] 618982 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.259.305 [memory.cpp:559]618983 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.259.318 [runtime.cc:5239] 618983 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.259.304 [runtime.cc:5239] 618984 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.259.322 [api_impl.cc:3100] 618984 GetDevicePhyIdByIndex: get PhyId by Index=2.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.259.329 [api_impl.cc:3100] 618983 GetDevicePhyIdByIndex: get PhyId by Index=2.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.259.339 [api_impl.cc:3111] 618983 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.259.334 [api_impl.cc:3111] 618984 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.259.346 [api_impl.cc:3130] 618984 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.259.320 [api_impl.cc:3100] 618987 GetDevicePhyIdByIndex: get PhyId by Index=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.259.323 [api_impl.cc:3100] 618982 GetDevicePhyIdByIndex: get PhyId by Index=2.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.259.336 [api_impl.cc:3111] 618982 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.259.351 [api_impl.cc:3130] 618983 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.259.358 [api_impl.cc:3168] 618984 EnableP2P: Enable P2P devIdDes=4, phyIdSrc=2.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.259.348 [api_impl.cc:3111] 618987 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=3
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.259.360 [api_impl.cc:3130] 618987 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=3
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.259.371 [api_impl.cc:3168] 618987 EnableP2P: Enable P2P devIdDes=1, phyIdSrc=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.259.346 [api_impl.cc:3130] 618982 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.259.358 [api_impl.cc:3168] 618982 EnableP2P: Enable P2P devIdDes=3, phyIdSrc=2.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.259.365 [api_impl.cc:3168] 618983 EnableP2P: Enable P2P devIdDes=5, phyIdSrc=2.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:43.259.444 [devdrv_pcie.c:888][ascend][curpid:618646,618981][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=0; peer_phy_devid=2.)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:43.259.451 [devdrv_pcie.c:888][ascend][curpid:618670,618986][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=6; peer_phy_devid=1.)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:43.259.457 [devdrv_pcie.c:888][ascend][curpid:618674,618985][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=7; peer_phy_devid=1.)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:43.259.460 [devdrv_pcie.c:888][ascend][curpid:618654,618988][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=2; peer_phy_devid=3.)
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.259.469 [memory.cpp:559]618981 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.259.483 [runtime.cc:5239] 618981 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.259.478 [memory.cpp:559]618986 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.259.483 [memory.cpp:559]618985 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.259.496 [runtime.cc:5239] 618985 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.259.485 [memory.cpp:559]618988 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.259.498 [runtime.cc:5239] 618988 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.259.497 [api_impl.cc:3100] 618981 GetDevicePhyIdByIndex: get PhyId by Index=3.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.259.510 [api_impl.cc:3111] 618981 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=3
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.259.492 [runtime.cc:5239] 618986 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.259.505 [api_impl.cc:3100] 618986 GetDevicePhyIdByIndex: get PhyId by Index=2.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.259.515 [api_impl.cc:3111] 618986 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.259.510 [api_impl.cc:3100] 618985 GetDevicePhyIdByIndex: get PhyId by Index=2.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.259.520 [api_impl.cc:3111] 618985 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.259.509 [api_impl.cc:3100] 618988 GetDevicePhyIdByIndex: get PhyId by Index=4.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.259.522 [api_impl.cc:3111] 618988 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=4
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.259.522 [api_impl.cc:3130] 618981 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=3
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.259.535 [api_impl.cc:3168] 618981 EnableP2P: Enable P2P devIdDes=0, phyIdSrc=3.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.259.528 [api_impl.cc:3130] 618986 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.259.540 [api_impl.cc:3168] 618986 EnableP2P: Enable P2P devIdDes=6, phyIdSrc=2.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.259.533 [api_impl.cc:3130] 618985 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.259.544 [api_impl.cc:3168] 618985 EnableP2P: Enable P2P devIdDes=7, phyIdSrc=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.259.532 [api_impl.cc:3130] 618988 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=4
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.259.546 [api_impl.cc:3168] 618988 EnableP2P: Enable P2P devIdDes=2, phyIdSrc=4.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:43.259.663 [devdrv_pcie.c:888][ascend][curpid:618658,618982][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=3; peer_phy_devid=2.)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:43.259.667 [devdrv_pcie.c:888][ascend][curpid:618662,618984][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=4; peer_phy_devid=2.)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:43.259.675 [devdrv_pcie.c:888][ascend][curpid:618666,618983][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=5; peer_phy_devid=2.)
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.259.698 [memory.cpp:559]618983 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.259.687 [memory.cpp:559]618982 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.259.704 [runtime.cc:5239] 618982 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.259.690 [memory.cpp:559]618984 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.259.706 [runtime.cc:5239] 618984 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.259.710 [runtime.cc:5239] 618983 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.259.720 [api_impl.cc:3100] 618982 GetDevicePhyIdByIndex: get PhyId by Index=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.259.721 [api_impl.cc:3100] 618984 GetDevicePhyIdByIndex: get PhyId by Index=3.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.259.724 [api_impl.cc:3100] 618983 GetDevicePhyIdByIndex: get PhyId by Index=3.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.259.733 [api_impl.cc:3111] 618984 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=3
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.259.736 [api_impl.cc:3111] 618983 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=3
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.259.750 [api_impl.cc:3130] 618983 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.259.734 [api_impl.cc:3111] 618982 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=4
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.259.751 [api_impl.cc:3130] 618982 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=4
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.259.759 [api_impl.cc:3168] 618983 EnableP2P: Enable P2P devIdDes=5, phyIdSrc=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.259.766 [api_impl.cc:3168] 618982 EnableP2P: Enable P2P devIdDes=3, phyIdSrc=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.259.750 [api_impl.cc:3130] 618984 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=3
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.259.766 [api_impl.cc:3168] 618984 EnableP2P: Enable P2P devIdDes=4, phyIdSrc=3.
[INFO] DRV(618650,python3.9):2025-04-03-09:27:43.259.825 [devdrv_pcie.c:888][ascend][curpid:618650,618987][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=1; peer_phy_devid=3.)
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.259.850 [memory.cpp:559]618987 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.259.867 [runtime.cc:5239] 618987 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.259.879 [api_impl.cc:3100] 618987 GetDevicePhyIdByIndex: get PhyId by Index=4.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.259.894 [api_impl.cc:3111] 618987 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=4
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.259.906 [api_impl.cc:3130] 618987 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=4
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.259.919 [api_impl.cc:3168] 618987 EnableP2P: Enable P2P devIdDes=1, phyIdSrc=4.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:43.260.139 [devdrv_pcie.c:888][ascend][curpid:618646,618981][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=0; peer_phy_devid=3.)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:43.260.148 [devdrv_pcie.c:888][ascend][curpid:618670,618986][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=6; peer_phy_devid=2.)
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.260.175 [memory.cpp:559]618981 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.260.187 [memory.cpp:559]618986 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.260.201 [runtime.cc:5239] 618986 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.260.195 [runtime.cc:5239] 618981 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.260.212 [api_impl.cc:3100] 618981 GetDevicePhyIdByIndex: get PhyId by Index=4.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.260.214 [api_impl.cc:3100] 618986 GetDevicePhyIdByIndex: get PhyId by Index=3.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.260.230 [api_impl.cc:3111] 618986 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=3
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.260.224 [api_impl.cc:3111] 618981 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=4
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.260.240 [api_impl.cc:3130] 618981 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=4
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.260.243 [api_impl.cc:3130] 618986 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=3
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.260.253 [api_impl.cc:3168] 618981 EnableP2P: Enable P2P devIdDes=0, phyIdSrc=4.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.260.257 [api_impl.cc:3168] 618986 EnableP2P: Enable P2P devIdDes=6, phyIdSrc=3.
[INFO] DRV(618674,python3.9):2025-04-03-09:27:43.260.348 [devdrv_pcie.c:888][ascend][curpid:618674,618985][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=7; peer_phy_devid=2.)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:43.260.344 [devdrv_pcie.c:888][ascend][curpid:618654,618988][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=2; peer_phy_devid=4.)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:43.260.356 [devdrv_pcie.c:888][ascend][curpid:618666,618983][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=5; peer_phy_devid=3.)
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.260.374 [memory.cpp:559]618985 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.260.374 [memory.cpp:559]618988 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.260.391 [runtime.cc:5239] 618988 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.260.380 [memory.cpp:559]618983 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.260.393 [runtime.cc:5239] 618983 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.260.389 [runtime.cc:5239] 618985 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.260.402 [api_impl.cc:3100] 618985 GetDevicePhyIdByIndex: get PhyId by Index=3.
[INFO] DRV(618662,python3.9):2025-04-03-09:27:43.260.363 [devdrv_pcie.c:888][ascend][curpid:618662,618984][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=4; peer_phy_devid=3.)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.260.404 [api_impl.cc:3100] 618988 GetDevicePhyIdByIndex: get PhyId by Index=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.260.406 [api_impl.cc:3100] 618983 GetDevicePhyIdByIndex: get PhyId by Index=4.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.260.417 [api_impl.cc:3111] 618983 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=4
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.260.413 [api_impl.cc:3111] 618985 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=3
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.260.425 [api_impl.cc:3130] 618985 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=3
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.260.409 [memory.cpp:559]618984 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.260.427 [runtime.cc:5239] 618984 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.260.438 [api_impl.cc:3100] 618984 GetDevicePhyIdByIndex: get PhyId by Index=5.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.260.416 [api_impl.cc:3111] 618988 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=5
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.260.430 [api_impl.cc:3130] 618988 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=5
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.260.440 [api_impl.cc:3168] 618988 EnableP2P: Enable P2P devIdDes=2, phyIdSrc=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.260.431 [api_impl.cc:3130] 618983 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=4
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.260.443 [api_impl.cc:3168] 618983 EnableP2P: Enable P2P devIdDes=5, phyIdSrc=4.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.260.438 [api_impl.cc:3168] 618985 EnableP2P: Enable P2P devIdDes=7, phyIdSrc=3.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.260.451 [api_impl.cc:3111] 618984 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=5
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.260.465 [api_impl.cc:3130] 618984 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=5
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.260.478 [api_impl.cc:3168] 618984 EnableP2P: Enable P2P devIdDes=4, phyIdSrc=5.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:43.260.537 [devdrv_pcie.c:888][ascend][curpid:618658,618982][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=3; peer_phy_devid=4.)
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.260.563 [memory.cpp:559]618982 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.260.582 [runtime.cc:5239] 618982 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.260.595 [api_impl.cc:3100] 618982 GetDevicePhyIdByIndex: get PhyId by Index=5.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.260.607 [api_impl.cc:3111] 618982 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=5
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.260.619 [api_impl.cc:3130] 618982 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=5
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.260.634 [api_impl.cc:3168] 618982 EnableP2P: Enable P2P devIdDes=3, phyIdSrc=5.
[INFO] DRV(618650,python3.9):2025-04-03-09:27:43.260.697 [devdrv_pcie.c:888][ascend][curpid:618650,618987][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=1; peer_phy_devid=4.)
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.260.722 [memory.cpp:559]618987 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.260.738 [runtime.cc:5239] 618987 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.260.754 [api_impl.cc:3100] 618987 GetDevicePhyIdByIndex: get PhyId by Index=5.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.260.765 [api_impl.cc:3111] 618987 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=5
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.260.778 [api_impl.cc:3130] 618987 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=5
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.260.793 [api_impl.cc:3168] 618987 EnableP2P: Enable P2P devIdDes=1, phyIdSrc=5.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:43.260.843 [devdrv_pcie.c:888][ascend][curpid:618646,618981][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=0; peer_phy_devid=4.)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:43.260.850 [devdrv_pcie.c:888][ascend][curpid:618670,618986][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=6; peer_phy_devid=3.)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:43.260.857 [devdrv_pcie.c:888][ascend][curpid:618674,618985][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=7; peer_phy_devid=3.)
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.260.866 [memory.cpp:559]618981 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.260.892 [runtime.cc:5239] 618981 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.260.882 [memory.cpp:559]618985 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.260.898 [runtime.cc:5239] 618985 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.260.877 [memory.cpp:559]618986 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.260.894 [runtime.cc:5239] 618986 GetUserDevIdByDeviceId: No need to[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.260.906 [api_impl.cc:3100] 618981 GetDevicePhyIdByIndex: get PhyId by Index=5.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.260.912 [api_impl.cc:3100] 618985 GetDevicePhyIdByIndex: get PhyId by Index=4.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.260.919 [api_impl.cc:3111] 618981 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=5
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.260.932 [api_impl.cc:3130] 618981 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=5
 convert deviceId, userDevId=6, deviceId=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.260.933 [api_impl.cc:3100] 618986 GetDevicePhyIdByIndex: get PhyId by Index=4.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.260.923 [api_impl.cc:3111] 618985 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=4
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.260.947 [api_impl.cc:3111] 618986 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=4
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.260.948 [api_impl.cc:3130] 618985 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=4
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.260.946 [api_impl.cc:3168] 618981 EnableP2P: Enable P2P devIdDes=0, phyIdSrc=5.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.260.961 [api_impl.cc:3130] 618986 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=4
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.260.965 [api_impl.cc:3168] 618985 EnableP2P: Enable P2P devIdDes=7, phyIdSrc=4.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.260.974 [api_impl.cc:3168] 618986 EnableP2P: Enable P2P devIdDes=6, phyIdSrc=4.
[INFO] DRV(618654,python3.9):2025-04-03-09:27:43.261.081 [devdrv_pcie.c:888][ascend][curpid:618654,618988][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=2; peer_phy_devid=5.)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:43.261.088 [devdrv_pcie.c:888][ascend][curpid:618666,618983][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=5; peer_phy_devid=4.)
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.261.112 [memory.cpp:559]618983 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.261.105 [memory.cpp:559]618988 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.261.124 [runtime.cc:5239] 618988 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.261.124 [runtime.cc:5239] 618983 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.261.135 [api_impl.cc:3100] 618983 GetDevicePhyIdByIndex: get PhyId by Index=6.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.261.139 [api_impl.cc:3100] 618988 GetDevicePhyIdByIndex: get PhyId by Index=6.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.261.145 [api_impl.cc:3111] 618983 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=6
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.261.156 [api_impl.cc:3130] 618983 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=6
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.261.152 [api_impl.cc:3111] 618988 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=6
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.261.167 [api_impl.cc:3130] 618988 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=6
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.261.168 [api_impl.cc:3168] 618983 EnableP2P: Enable P2P devIdDes=5, phyIdSrc=6.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.261.182 [api_impl.cc:3168] 618988 EnableP2P: Enable P2P devIdDes=2, phyIdSrc=6.
[INFO] DRV(618662,python3.9):2025-04-03-09:27:43.261.368 [devdrv_pcie.c:888][ascend][curpid:618662,618984][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=4; peer_phy_devid=5.)
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.261.394 [memory.cpp:559]618984 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.261.411 [runtime.cc:5239] 618984 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.261.423 [api_impl.cc:3100] 618984 GetDevicePhyIdByIndex: get PhyId by Index=6.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.261.436 [api_impl.cc:3111] 618984 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=6
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.261.450 [api_impl.cc:3130] 618984 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=6
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.261.462 [api_impl.cc:3168] 618984 EnableP2P: Enable P2P devIdDes=4, phyIdSrc=6.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:43.261.526 [devdrv_pcie.c:888][ascend][curpid:618658,618982][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=3; peer_phy_devid=5.)
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.261.550 [memory.cpp:559]618982 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.261.566 [runtime.cc:5239] 618982 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.261.578 [api_impl.cc:3100] 618982 GetDevicePhyIdByIndex: get PhyId by Index=6.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.261.591 [api_impl.cc:3111] 618982 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=6
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.261.606 [api_impl.cc:3130] 618982 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=6
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.261.629 [api_impl.cc:3168] 618982 EnableP2P: Enable P2P devIdDes=3, phyIdSrc=6.
[INFO] DRV(618650,python3.9):2025-04-03-09:27:43.261.687 [devdrv_pcie.c:888][ascend][curpid:618650,618987][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=1; peer_phy_devid=5.)
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.261.711 [memory.cpp:559]618987 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.261.726 [runtime.cc:5239] 618987 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.261.738 [api_impl.cc:3100] 618987 GetDevicePhyIdByIndex: get PhyId by Index=6.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.261.753 [api_impl.cc:3111] 618987 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=6
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.261.765 [api_impl.cc:3130] 618987 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=6
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.261.778 [api_impl.cc:3168] 618987 EnableP2P: Enable P2P devIdDes=1, phyIdSrc=6.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:43.261.833 [devdrv_pcie.c:888][ascend][curpid:618646,618981][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=0; peer_phy_devid=5.)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:43.261.838 [devdrv_pcie.c:888][ascend][curpid:618674,618985][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=7; peer_phy_devid=4.)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:43.261.846 [devdrv_pcie.c:888][ascend][curpid:618670,618986][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=6; peer_phy_devid=4.)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:43.261.855 [devdrv_pcie.c:888][ascend][curpid:618666,618983][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=5; peer_phy_devid=6.)
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.261.861 [memory.cpp:559]618985 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.261.856 [memory.cpp:559]618981 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.261.874 [runtime.cc:5239] 618981 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.261.874 [memory.cpp:559]618986 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.261.893 [runtime.cc:5239] 618986 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.261.876 [memory.cpp:559]618983 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.261.875 [runtime.cc:5239] 618985 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.261.890 [api_impl.cc:3100] 618985 GetDevicePhyIdByIndex: get PhyId by Index=5.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.261.891 [api_impl.cc:3100] 618981 GetDevicePhyIdByIndex: get PhyId by Index=6.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.261.892 [runtime.cc:5239] 618983 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.261.906 [api_impl.cc:3100] 618983 GetDevicePhyIdByIndex: get PhyId by Index=7.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.261.908 [api_impl.cc:3100] 618986 GetDevicePhyIdByIndex: get PhyId by Index=5.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.261.901 [api_impl.cc:3111] 618985 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=5
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.261.914 [api_impl.cc:3130] 618985 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.261.916 [api_impl.cc:3111] 618983 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=7
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.261.928 [api_impl.cc:3130] 618983 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=7
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.261.904 [api_impl.cc:3111] 618981 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=6
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.261.918 [api_impl.cc:3130] 618981 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.261.923 [api_impl.cc:3111] 618986 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=5
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.261.936 [api_impl.cc:3130] 618986 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=5
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.261.933 [api_impl.cc:3168] 618981 EnableP2P: Enable P2P devIdDes=0, phyIdSrc=6.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.261.928 [api_impl.cc:3168] 618985 EnableP2P: Enable P2P devIdDes=7, phyIdSrc=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.261.940 [api_impl.cc:3168] 618983 EnableP2P: Enable P2P devIdDes=5, phyIdSrc=7.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.261.950 [api_impl.cc:3168] 618986 EnableP2P: Enable P2P devIdDes=6, phyIdSrc=5.
[INFO] DRV(618654,python3.9):2025-04-03-09:27:43.262.044 [devdrv_pcie.c:888][ascend][curpid:618654,618988][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=2; peer_phy_devid=6.)
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.262.070 [memory.cpp:559]618988 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.262.087 [runtime.cc:5239] 618988 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.262.098 [api_impl.cc:3100] 618988 GetDevicePhyIdByIndex: get PhyId by Index=7.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.262.129 [api_impl.cc:3111] 618988 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=7
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.262.142 [api_impl.cc:3130] 618988 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=7
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.262.155 [api_impl.cc:3168] 618988 EnableP2P: Enable P2P devIdDes=2, phyIdSrc=7.
[INFO] DRV(618662,python3.9):2025-04-03-09:27:43.262.204 [devdrv_pcie.c:888][ascend][curpid:618662,618984][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=4; peer_phy_devid=6.)
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.262.230 [memory.cpp:559]618984 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.262.246 [runtime.cc:5239] 618984 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.262.258 [api_impl.cc:3100] 618984 GetDevicePhyIdByIndex: get PhyId by Index=7.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.262.270 [api_impl.cc:3111] 618984 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=7
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.262.285 [api_impl.cc:3130] 618984 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=7
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.262.295 [api_impl.cc:3168] 618984 EnableP2P: Enable P2P devIdDes=4, phyIdSrc=7.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:43.262.451 [devdrv_pcie.c:888][ascend][curpid:618658,618982][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=3; peer_phy_devid=6.)
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.262.475 [memory.cpp:559]618982 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.262.491 [runtime.cc:5239] 618982 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.262.503 [api_impl.cc:3100] 618982 GetDevicePhyIdByIndex: get PhyId by Index=7.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.262.515 [api_impl.cc:3111] 618982 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=7
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.262.530 [api_impl.cc:3130] 618982 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=7
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.262.541 [api_impl.cc:3168] 618982 EnableP2P: Enable P2P devIdDes=3, phyIdSrc=7.
[INFO] DRV(618650,python3.9):2025-04-03-09:27:43.262.726 [devdrv_pcie.c:888][ascend][curpid:618650,618987][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=1; peer_phy_devid=6.)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:43.262.731 [devdrv_pcie.c:888][ascend][curpid:618674,618985][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=7; peer_phy_devid=5.)
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.262.749 [memory.cpp:559]618987 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.262.754 [memory.cpp:559]618985 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.262.767 [runtime.cc:5239] 618985 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.262.780 [api_impl.cc:3100] 618985 GetDevicePhyIdByIndex: get PhyId by Index=6.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.262.791 [api_impl.cc:3111] 618985 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=6
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.262.766 [runtime.cc:5239] 618987 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.262.792 [api_impl.cc:3100] 618987 GetDevicePhyIdByIndex: get PhyId by Index=7.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.262.804 [api_impl.cc:3111] 618987 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.262.805 [api_impl.cc:3130] 618985 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=6
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.262.819 [api_impl.cc:3168] 618985 EnableP2P: Enable P2P devIdDes=7, phyIdSrc=6.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.262.814 [api_impl.cc:3130] 618987 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=7
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.262.830 [api_impl.cc:3168] 618987 EnableP2P: Enable P2P devIdDes=1, phyIdSrc=7.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:43.262.903 [devdrv_pcie.c:888][ascend][curpid:618646,618981][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=0; peer_phy_devid=6.)
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.262.926 [memory.cpp:559]618981 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.262.943 [runtime.cc:5239] 618981 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.262.955 [api_impl.cc:3100] 618981 GetDevicePhyIdByIndex: get PhyId by Index=7.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.262.970 [api_impl.cc:3111] 618981 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=7
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.262.981 [api_impl.cc:3130] 618981 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=7
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.262.994 [api_impl.cc:3168] 618981 EnableP2P: Enable P2P devIdDes=0, phyIdSrc=7.
[INFO] DRV(618666,python3.9):2025-04-03-09:27:43.263.096 [devdrv_pcie.c:888][ascend][curpid:618666,618983][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=5; peer_phy_devid=7.)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.120 [runtime.cc:1664] 618983 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.158 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.185 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.210 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalPureMatmul_float16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.236 [runtime.cc:1664] 618983 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.248 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] DRV(618670,python3.9):2025-04-03-09:27:43.263.253 [devdrv_pcie.c:888][ascend][curpid:618670,618986][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=6; peer_phy_devid=5.)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.265 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.280 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalPureMatmul_bfloat16_t.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.263.282 [memory.cpp:559]618986 aclrtDeviceEnablePeerAccess: start to execute aclrtDeviceEnablePeerAccess
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.263.297 [runtime.cc:5239] 618986 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.295 [runtime.cc:1664] 618983 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.263.311 [api_impl.cc:3100] 618986 GetDevicePhyIdByIndex: get PhyId by Index=7.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.319 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.263.325 [api_impl.cc:3111] 618986 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=7
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.338 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.263.338 [api_impl.cc:3130] 618986 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=7
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.353 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulAllReduce_float16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.263.353 [api_impl.cc:3168] 618986 EnableP2P: Enable P2P devIdDes=6, phyIdSrc=7.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.376 [runtime.cc:1664] 618983 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.388 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.415 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] DRV(618654,python3.9):2025-04-03-09:27:43.263.417 [devdrv_pcie.c:888][ascend][curpid:618654,618988][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=2; peer_phy_devid=7.)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.430 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulAllReduce_bfloat16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.447 [runtime.cc:1664] 618983 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.263.446 [runtime.cc:1664] 618988 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.469 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.487 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.500 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulReduceScatter_float16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.521 [runtime.cc:1664] 618983 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.534 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.263.532 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.549 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.564 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulReduceScatter_bfloat16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.263.568 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.579 [runtime.cc:1664] 618983 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] DRV(618662,python3.9):2025-04-03-09:27:43.263.575 [devdrv_pcie.c:888][ascend][curpid:618662,618984][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=4; peer_phy_devid=7.)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.605 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.263.601 [runtime.cc:1664] 618984 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.263.611 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalPureMatmul_float16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.631 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.648 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmul_float16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.663 [runtime.cc:1664] 618983 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.675 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.263.666 [runtime.cc:1664] 618988 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.263.671 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.263.685 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.702 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.263.706 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.718 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmul_bfloat16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.263.715 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.263.726 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalPureMatmul_bfloat16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.736 [runtime.cc:1664] 618983 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] DRV(618674,python3.9):2025-04-03-09:27:43.263.736 [devdrv_pcie.c:888][ascend][curpid:618674,618985][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=7; peer_phy_devid=6.)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:43.263.732 [devdrv_pcie.c:888][ascend][curpid:618658,618982][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=3; peer_phy_devid=7.)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.750 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.263.747 [runtime.cc:1664] 618988 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.263.749 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalPureMatmul_float16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.263.760 [runtime.cc:1664] 618982 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.263.760 [runtime.cc:1664] 618985 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.775 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.263.785 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.791 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulV2_float16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.808 [runtime.cc:1664] 618983 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.263.786 [runtime.cc:1664] 618984 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.263.806 [elf.cc:566] 618984 ParaseKernelM[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.821 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.263.809 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.263.809 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.263.820 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.838 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.263.828 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulAllReduce_float16_t.
etaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.263.838 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.263.846 [runtime.cc:1664] 618988 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.263.861 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.263.853 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.854 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulV2_bfloat16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.263.862 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.263.873 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalPureMatmul_bfloat16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.884 [runtime.cc:1664] 618983 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.263.875 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalPureMatmul_float16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.263.890 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.263.895 [runtime.cc:1664] 618984 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] DRV(618650,python3.9):2025-04-03-09:27:43.263.895 [devdrv_pcie.c:888][ascend][curpid:618650,618987][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=1; peer_phy_devid=7.)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.908 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.263.905 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalPureMatmul_float16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.263.910 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulAllReduce_bfloat16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.263.921 [runtime.cc:1664] 618982 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.263.923 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.263.941 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.263.960 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.263.975 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalPureMatmul_bfloat16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.263.923 [runtime.cc:1664] 618987 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.934 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.950 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulReduceScatter_float16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.263.939 [runtime.cc:1664] 618985 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.263.955 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.263.932 [runtime.cc:1664] 618988 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.263.967 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.263.946 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.263.962 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulAllReduce_float16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.263.976 [runtime.cc:1664] 618984 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.965 [runtime.cc:1664] 618983 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.978 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.263.995 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.263.991 [runtime.cc:1664] 618982 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.263.973 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.263.989 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalPureMatmul_bfloat16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.004 [runtime.cc:1664] 618985 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.263.987 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.004 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulReduceScatter_float16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.010 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulReduceScatter_bfloat16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.026 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.263.989 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.017 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.019 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.038 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.025 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.028 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.024 [runtime.cc:1664] 618988 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.040 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.056 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.054 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.033 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulAllReduce_bfloat16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.051 [runtime.cc:1664] 618984 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] DRV(618646,python3.9):2025-04-03-09:27:43.264.055 [devdrv_pcie.c:888][ascend][curpid:618646,618981][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=0; peer_phy_devid=7.)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.055 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulAllReduce_float16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.072 [runtime.cc:1664] 618982 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.073 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.060 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.076 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulAllReduce_float16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.092 [runtime.cc:1664] 618985 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.072 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulReduceScatter_bfloat16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.101 [runtime.cc:1664] 618988 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.083 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.097 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.075 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.096 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.085 [runtime.cc:1664] 618981 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.085 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.111 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.114 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalPureMatmul_float16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.106 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.129 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.135 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.110 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalAllReduce_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.125 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.141 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.111 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulReduceScatter_float16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.134 [runtime.cc:1664] 618984 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.148 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.128 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulAllReduce_bfloat16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.145 [runtime.cc:1664] 618982 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.185 [elf.cc:566] 6[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.147 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulAllReduce_bfloat16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.183 [runtime.cc:1664] 618985 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.175 [runtime.cc:1664] 618987 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.177 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.204 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.180 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.208 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmul_float16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.173 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.199 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulReduceScatter_bfloat16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.218 [runtime.cc:1664] 618984 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
18982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.213 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.206 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.228 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.220 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalAllReduce_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.235 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.250 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.229 [runtime.cc:1664] 618988 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.244 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.242 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.229 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.246 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulReduceScatter_float16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.235 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.253 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulReduceScatter_float16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.275 [runtime.cc:1664] 618985 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.243 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalPureMatmul_bfloat16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.261 [runtime.cc:1664] 618987 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.250 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.277 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.291 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int8_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.269 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.289 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmul_bfloat16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.306 [runtime.cc:1664] 618988 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.268 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.289 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmul_float16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.307 [runtime.cc:1664] 618984 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.268 [runtime.cc:1664] 618982 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.286 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.302 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.292 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.312 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.298 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.317 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.319 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.305 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalAllReduce_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.320 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.336 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.322 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.350 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.322 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.349 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.317 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulReduceScatter_bfloat16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.339 [runtime.cc:1664] 618982 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.362 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.326 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulReduceScatter_bfloat16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.344 [runtime.cc:1664] 618985 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.367 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.332 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulAllReduce_float16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.347 [runtime.cc:1664] 618987 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.362 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] DRV(618670,python3.9):2025-04-03-09:27:43.264.364 [devdrv_pcie.c:888][ascend][curpid:618670,618986][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=6; peer_phy_devid=7.)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.357 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalPureMatmul_float16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.358 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.378 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_float.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.391 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalAllReduce_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.370 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulV2_float16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.386 [runtime.cc:1664] 618988 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.400 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.368 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmul_bfloat16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.386 [runtime.cc:1664] 618984 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.412 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.389 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.411 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmul_float16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.392 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.412 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmul_float16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.390 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.408 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulAllReduce_bfloat16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.425 [runtime.cc:1664] 618987 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.264.397 [runtime.cc:1664] 618986 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.398 [runtime.cc:1664] 618981 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.416 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.434 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.409 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.429 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.450 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.418 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.436 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulV2_bfloat16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.452 [runtime.cc:1664] 618988 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.439 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.457 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulV2_float16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.429 [runtime.cc:1664] 618982 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.444 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.467 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.428 [runtime.cc:1664] 618985 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.443 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.465 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.483 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmul_bfloat16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.460 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.479 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.264.478 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.463 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalPureMatmul_bfloat16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.484 [runtime.cc:1664] 618981 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.462 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_float16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.475 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalAllReduce_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.490 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.483 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.513 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.473 [runtime.cc:1664] 618984 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.487 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.507 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.487 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmul_bfloat16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.505 [runtime.cc:1664] 618982 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.517 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.500 [runtime.cc:1664] 618985 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.515 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.495 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulReduceScatter_float16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.516 [runtime.cc:1664] 618987 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.532 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.264.524 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.512 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.536 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.551 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulAllReduce_float16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.511 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.532 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.545 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_bfloat16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.559 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalAllReduce_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.531 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulReduceScatter_float16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.549 [runtime.cc:1664] 618988 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.562 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.523 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulV2_bfloat16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.542 [runtime.cc:1664] 618984 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.568 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.542 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.561 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulV2_float16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.579 [runtime.cc:1664] 618982 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.560 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.579 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulReduceScatter_bfloat16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.264.564 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalPureMatmul_float16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.539 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.558 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulV2_float16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.576 [runtime.cc:1664] 618985 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.568 [runtime.cc:1664] 618981 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.585 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.612 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.577 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.598 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.622 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.581 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.598 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulReduceScatter_bfloat16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.617 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.593 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.612 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulReduceScatter_float16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.630 [runtime.cc:1664] 618984 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.596 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.618 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.633 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulV2_bfloat16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.596 [runtime.cc:1664] 618987 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.635 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.264.629 [runtime.cc:1664] 618986 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.264.648 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.615 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.635 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.656 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulV2_bfloat16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.629 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulAllReduce_bfloat16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.650 [runtime.cc:1664] 618981 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.633 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int64_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.648 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalAllReduce_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.650 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-0[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.644 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.661 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.674 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulReduceScatter_bfloat16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.691 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.650 [runtime.cc:1664] 618982 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.675 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.695 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.667 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.684 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmul_float16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.699 [runtime.cc:1664] 618987 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.264.668 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.264.686 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalPureMatmul_bfloat16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.264.714 [runtime.cc:1664] 618986 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.671 [runtime.cc:1664] 618985 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.697 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.717 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.680 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.700 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.714 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulReduceScatter_float16_t.
3-09:27:43.264.685 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.717 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.732 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalAllReduce_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.717 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.712 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulReduceScatter_float16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.732 [runtime.cc:1664] 618982 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.753 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.712 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.737 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.753 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmul_bfloat16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.772 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.789 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulReduceScatter_bfloat16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.806 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.264.754 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.736 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulReduceScatter_float16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.756 [runtime.cc:1664] 618985 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.771 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.736 [runtime.cc:1664] 618981 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.751 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.770 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.787 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulReduceScatter_bfloat16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.786 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.802 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulReduceScatter_bfloat16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.818 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.748 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.765 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.792 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.748 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.763 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.775 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalAllReduce_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.789 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.770 [runtime.cc:1664] 618987 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.785 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.810 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.264.777 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.264.793 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulAllReduce_float16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.264.810 [runtime.cc:1664] 618986 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.264.824 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.806 [runtime.cc:1664] 618981 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.836 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.834 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.847 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.806 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.822 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalAllReduce_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.836 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.853 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.804 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.833 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.846 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.860 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalAllReduce_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.828 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulV2_float16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.845 [runtime.cc:1664] 618987 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.857 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.876 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.264.850 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.264.867 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulAllReduce_bfloat16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.264.884 [runtime.cc:1664] 618986 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.864 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.882 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmul_float16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.871 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.886 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.899 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalAllReduce_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.878 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.893 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.905 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalAllReduce_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.879 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.894 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int8_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.906 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalAllReduce_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.919 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.875 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.893 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.925 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.895 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulV2_bfloat16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.912 [runtime.cc:1664] 618987 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.264.921 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.264.943 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.900 [runtime.cc:1664] 618981 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.917 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.940 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.916 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.932 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.951 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.922 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.938 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.961 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.936 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.956 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.968 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_float.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.940 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int8_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.955 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalAllReduce_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.969 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.947 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.972 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.264.959 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulReduceScatter_float16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.264.983 [runtime.cc:1664] 618986 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.264.997 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.959 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmul_bfloat16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.978 [runtime.cc:1664] 618981 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.264.990 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.957 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.971 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.264.984 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalAllReduce_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.265.000 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.264.989 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.977 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.264.993 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalAllReduce_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.265.008 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.264.982 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalAllReduce_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.265.000 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.265.022 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.264.983 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.265.007 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.265.023 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_float.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.264.989 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulReduceScatter_float16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.006 [runtime.cc:1664] 618987 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.022 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.016 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.031 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalMatmulReduceScatter_bfloat16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.047 [runtime.cc:1664] 618986 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.025 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.044 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulV2_float16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.059 [runtime.cc:1664] 618981 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.265.016 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.265.050 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.265.062 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int8_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.031 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.045 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.060 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalAllGather_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.265.024 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.265.054 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.265.067 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int8_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.265.078 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalAllReduce_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.265.045 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.265.060 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_float16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.265.076 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalAllReduce_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.265.038 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalAllReduce_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.265.055 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.265.072 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.039 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.054 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulReduceScatter_bfloat16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.073 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.088 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.076 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.096 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.113 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulV2_bfloat16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.265.078 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalAllReduce_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.265.095 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.265.108 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.077 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.101 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.265.096 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.265.131 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.265.092 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.265.116 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.265.138 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.265.092 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.265.105 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_float16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.265.118 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalAllReduce_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.265.132 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.127 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.118 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.136 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmul_float16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.152 [runtime.cc:1664] 618986 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.166 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.129 [runtime.cc:1664] 618981 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.163 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.265.128 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.265.145 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_float.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.265.156 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalAllReduce_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.265.171 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.138 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.152 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.166 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalAllGather_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.189 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.265.154 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.265.171 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_float.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.265.184 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalAllReduce_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.265.197 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.265.154 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_bfloat16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.265.180 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalAllReduce_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.265.194 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.265.153 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.265.176 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.265.189 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_bfloat16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.265.206 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalAllReduce_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.157 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.170 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.185 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalAllReduce_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.200 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.215 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.190 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.209 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulReduceScatter_float16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.225 [runtime.cc:1664] 618981 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.197 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.214 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmul_bfloat16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.230 [runtime.cc:1664] 618986 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.207 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.265.192 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.265.216 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.265.228 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_float16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.265.220 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.265.242 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.265.256 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_float16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.265.215 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.265.239 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.265.249 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int64_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.265.261 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalAllReduce_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.265.222 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.265.243 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.265.265 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.242 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.255 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.268 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalAllReduce_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.239 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.259 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.275 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulReduceScatter_bfloat16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.246 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.259 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int8_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.273 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalAllGather_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.288 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.246 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.273 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618670,python3.9):20[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.265.250 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalAllReduce_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.265.265 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.265.284 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.265.273 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalAllReduce_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.265.291 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.265.311 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.265.277 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int64_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.265.292 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalAllReduce_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.281 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.296 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.326 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.300 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.321 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.304 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.346 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
25-04-03-09:27:43.265.290 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulV2_float16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.320 [runtime.cc:1664] 618986 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.335 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.354 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.265.307 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.265.320 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_bfloat16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.265.335 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalAllReduce_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.265.349 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.265.331 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.265.345 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_bfloat16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.265.359 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalAllReduce_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.337 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int8_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.350 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalAllReduce_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.365 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.380 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.351 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.365 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.378 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalAllReduce_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.393 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.360 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_float.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.374 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalAllGather_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.388 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.371 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulV2_bfloat16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.387 [runtime.cc:1664] 618986 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.265.368 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.265.391 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.265.403 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int64_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.265.376 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.265.396 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.265.417 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.401 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.413 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_float.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.425 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalAllReduce_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.410 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.439 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.404 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.443 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.424 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.451 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.265.420 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalAllReduce_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.265.431 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int64_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.265.444 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalAllReduce_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.439 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.460 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.454 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.471 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalAllReduce_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.455 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_float16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.470 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalAllGather_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.486 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.468 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulReduceScatter_float16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.485 [runtime.cc:1664] 618986 MallocProgramAndReg: MAGIC_ELF new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.482 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.493 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_float16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.505 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalAllReduce_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.487 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.505 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.508 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.501 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.518 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.518 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.538 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.544 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.532 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.552 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int8_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.534 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=0, funcMode=0, kernelInfoExt=LcalAllGatherMatmulReduceScatter_bfloat16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.555 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.556 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_bfloat16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.569 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalAllGather_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.568 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalAllReduce_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.583 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.560 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.586 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.584 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_bfloat16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.597 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalAllReduce_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.598 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.604 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.602 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.610 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.626 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.637 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.639 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_float.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.655 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalAllReduce_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.632 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.640 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.650 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int64_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.663 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalAllGather_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.667 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.652 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.666 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int64_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.659 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.674 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalAllReduce_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.677 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.688 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.265.678 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalAllReduce_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.702 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.690 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.706 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.710 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.736 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.740 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.724 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_float16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.737 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalAllReduce_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.753 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.751 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.754 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.766 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalReduceScatter_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.766 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalAllReduce_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.777 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.783 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.781 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.797 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.799 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.801 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.819 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_bfloat16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.837 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalAllReduce_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.834 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.834 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.850 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.862 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalReduceScatter_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.854 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.850 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int8_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.875 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalAllReduce_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.877 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.879 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.900 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.892 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.905 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.910 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.922 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int64_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.265.940 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalAllReduce_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.936 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.932 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.950 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int8_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.948 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_float.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.962 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalReduceScatter_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.964 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalAllReduce_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.975 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.265.981 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.265.991 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.265.989 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.265.989 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.265.989 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.265.989 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.266.005 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.028 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.266.030 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.040 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_float.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.033 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.037 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.037 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.037 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.266.044 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_float16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.055 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalReduceScatter_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.266.061 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalAllReduce_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.266.076 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.068 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.088 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.081 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.081 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.080 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.082 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.098 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.113 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalAllGather_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.266.101 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.097 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.113 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalAllGather_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.099 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.125 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalAllGather_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.125 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.101 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.117 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalAllGather_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.131 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.128 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.266.128 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.266.143 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_bfloat16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.127 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.147 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.139 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_float16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.151 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalReduceScatter_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.155 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.152 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.266.157 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalAllReduce_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.266.172 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.153 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.170 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.164 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.179 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.266.197 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.189 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.205 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.200 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.190 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.216 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.210 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.220 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalAllGather_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.218 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.266.218 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.217 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.235 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalAllGather_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.234 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalAllGather_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.226 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.241 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalAllGather_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.236 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.255 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.237 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_bfloat16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.252 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalReduceScatter_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.266.235 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllReduce_int64_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.266.253 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalAllReduce_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.250 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.270 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.250 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.269 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.257 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.275 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.267 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.287 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.296 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.306 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.308 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.310 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.314 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int8_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.328 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalAllGather_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.323 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int8_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.325 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int8_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.340 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalAllGather_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.337 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.326 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int8_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.341 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalAllGather_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.337 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalAllGather_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.354 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.348 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.356 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.351 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int64_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.365 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalReduceScatter_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.349 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.344 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.355 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.373 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.372 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.373 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.399 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.379 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.396 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.392 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.384 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.418 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.413 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.428 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_float.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.416 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.430 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_float.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.441 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalAllGather_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.439 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.432 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.444 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.437 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.453 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.427 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.441 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_float.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.454 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalAllGather_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.433 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_float.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.448 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalAllGather_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.463 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.440 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalAllGather_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.457 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.471 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.457 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.483 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.509 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.525 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_float16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.451 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.464 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalAllGather_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.479 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.457 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalAll2All_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.473 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.495 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.465 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalAllGather_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.492 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.469 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.487 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.482 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.522 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.524 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.537 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_float16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.500 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.538 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.554 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.537 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalAllGather_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.532 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.544 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.557 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalAll2All_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.514 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.553 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.568 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.523 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.537 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_float16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.554 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalAllGather_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.568 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.536 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_float16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.552 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalAllGather_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.565 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.555 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalAllGather_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.573 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.585 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.628 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.568 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalAllGather_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.584 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.601 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.559 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.584 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.573 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.590 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.583 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalAllGather_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.599 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.616 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.587 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.626 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.594 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.636 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.641 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_bfloat16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.637 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.650 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int8_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.619 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.634 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_bfloat16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.647 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalAllGather_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.661 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.629 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.643 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int8_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.657 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalAll2All_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.656 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.673 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int8_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.638 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_bfloat16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.652 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalAllGather_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.667 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.683 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.649 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_bfloat16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.663 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalAllGather_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.676 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.692 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.657 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalAllGather_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.674 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.700 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.663 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalAllGather_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.677 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.693 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.679 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.717 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.672 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.694 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.686 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalAllGather_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.703 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.718 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.722 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.735 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.748 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int64_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.740 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.752 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int64_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.736 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int64_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.749 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalAllGather_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.762 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.782 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.741 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.755 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_float.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.734 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int64_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.757 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalAllGather_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.772 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.731 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.742 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_float.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.767 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalAll2All_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.758 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.773 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_float.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.763 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalAllGather_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.777 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.797 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.768 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalAllGather_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.785 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.768 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalAllGather_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.792 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.808 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.795 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.783 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.799 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.821 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.787 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalAllGather_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.804 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.821 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.835 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.848 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.804 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.843 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.850 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.831 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.846 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.858 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalReduceScatter_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.837 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.850 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_float16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.865 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalAll2All_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.838 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.855 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalReduceScatter_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.870 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.857 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.872 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_float16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.885 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalAllGather_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.865 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalReduceScatter_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.882 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.853 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.870 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalReduceScatter_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.884 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.865 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_float16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.877 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalAllGather_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.891 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.872 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.890 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.881 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.899 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.885 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.902 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.925 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.899 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.938 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.904 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.912 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.951 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.926 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.942 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.956 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalReduceScatter_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.942 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.956 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_bfloat16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.970 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.266.993 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.935 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.950 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.962 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalReduceScatter_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.961 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.977 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_bfloat16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.951 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.967 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalReduceScatter_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.266.981 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.945 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.960 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.973 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalReduceScatter_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.266.987 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.963 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_bfloat16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.976 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalAllGather_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.266.993 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.969 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalAll2All_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.266.985 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.267.005 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.975 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.266.999 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.266.993 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalAllGather_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.008 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.031 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.009 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.029 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.004 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,pyth[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.039 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.009 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.048 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.064 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int64_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.267.039 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.267.051 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int64_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.267.065 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalAll2All_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.035 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.048 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int8_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.063 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalReduceScatter_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.076 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.070 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.048 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.065 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int8_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.082 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalReduceScatter_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.048 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int8_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.066 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalReduceScatter_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.084 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
on3.9):2025-04-03-09:27:43.267.043 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.069 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int8_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.083 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalReduceScatter_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.100 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.098 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.078 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalAllGather_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.093 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.115 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.267.083 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.267.100 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.092 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.131 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.087 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int64_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.103 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalAllGather_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.119 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.101 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.118 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.101 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.141 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.154 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_float.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.119 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.157 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.151 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.166 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.154 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.171 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.267.145 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.267.159 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalBroadcast.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.267.172 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=LcalBroadcast, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.144 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_float.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.157 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalReduceScatter_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.171 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.190 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.150 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.193 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.155 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.171 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_float.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.187 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalReduceScatter_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.201 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.168 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalReduceScatter_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.184 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.205 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.172 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_float.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.188 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalReduceScatter_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.202 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.179 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalAllGather_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.194 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.184 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalReduceScatter_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.199 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.216 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.267.196 [api_impl.cc:1990] 618983 DevMalloc: size=423624736, type=1024, moduleId=33.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.225 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.237 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_float16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.250 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalReduceScatter_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.206 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.220 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalReduceScatter_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.233 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.250 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.223 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.242 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.255 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_float16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.268 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalReduceScatter_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.223 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.265 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.276 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_float16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.228 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.271 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.283 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.253 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.282 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.297 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalReduceScatter_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.267 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.283 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.288 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.303 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.318 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalReduceScatter_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.274 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.289 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_float16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.303 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalReduceScatter_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.318 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.281 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.311 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.289 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalReduceScatter_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.305 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.321 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.297 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalAllGather_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.313 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.329 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.310 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.344 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.321 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.336 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_bfloat16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.350 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalReduceScatter_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.364 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.332 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.355 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.336 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.376 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.349 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.364 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_bfloat16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.377 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalReduceScatter_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.364 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.378 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_bfloat16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.392 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalReduceScatter_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.376 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.391 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int8_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.409 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.433 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.405 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalAllGather_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.421 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.438 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.381 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.395 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int8_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.388 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.394 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.409 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int8_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.422 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalReduceScatter_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.391 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_bfloat16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.407 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalReduceScatter_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.421 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.394 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.416 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.409 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalReduceScatter_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.424 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.442 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.425 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.440 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int64_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.461 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalReduceScatter_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.475 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.440 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.458 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.475 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.442 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.480 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.493 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int64_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.486 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.454 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.467 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int64_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.479 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalReduceScatter_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.493 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.482 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.495 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_float.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.491 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.267.505 [api_error.cc:1218] 618983 DevMalloc: device malloc Succ, size=423624736, type=1024, moduleId=33, start ptr=0x12c041200000, end ptr=0x12c05a600020
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.496 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.511 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_float.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.526 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalReduceScatter_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.491 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int64_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.507 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalReduceScatter_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.525 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.510 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalReduceScatter_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.528 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.503 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_float.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.517 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalAllGather_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.531 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.548 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.507 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.544 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.510 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalReduceScatter_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.528 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.552 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.267.528 [api_impl.cc:2664] 618983 MemSetSync: destMax=423624704, value=0, count=423624704
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.530 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.546 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.559 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalAll2All_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.573 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.542 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.565 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.543 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.583 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.546 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.588 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.591 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.558 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.573 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalAll2All_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.587 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.606 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.592 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.605 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_float16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.595 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.632 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.604 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.636 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_float16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.597 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.621 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalAll2All_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.638 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.601 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.614 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalAll2All_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.627 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.646 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.607 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_float16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.622 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalAllGather_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.638 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.645 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.658 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.620 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalReduceScatter_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.638 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.655 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.646 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.659 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalAll2All_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.674 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.653 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalReduceScatter_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.669 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.666 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.683 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.696 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.665 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.705 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.673 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalAll2All_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.688 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.702 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.692 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.705 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_bfloat16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.718 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalReduceScatter_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.738 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.752 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int8_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.767 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalAll2All_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.692 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.727 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.691 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.732 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.710 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.724 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.737 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalAll2All_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.709 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalAll2All_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.725 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.740 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.720 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_bfloat16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.733 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalAllGather_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.748 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.730 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.754 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.739 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int8_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.754 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalAll2All_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.769 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.790 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.746 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_bfloat16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.761 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalReduceScatter_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.775 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.785 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.751 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.770 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.777 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.792 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int8_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.794 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.807 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int64_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.818 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalReduceScatter_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.826 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.763 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.809 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.798 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.841 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.812 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.827 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int8_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.839 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalAll2All_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.854 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.812 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalAll2All_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.826 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.846 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.809 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INF[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.834 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.850 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.841 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_float.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.856 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalAll2All_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.870 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.838 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAllGather_int64_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.853 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalAllGather_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.868 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.857 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int64_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.871 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalReduceScatter_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.886 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.877 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.882 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.896 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_float.
O] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.849 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.884 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_float.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.897 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalAll2All_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.889 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.910 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.887 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.927 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.891 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.932 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.907 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.916 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.930 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_float.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.942 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalAll2All_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.911 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalAll2All_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.926 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.942 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.912 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.929 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.921 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalAll2All_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.936 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.959 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.941 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_float16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.955 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalAll2All_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.977 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.945 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.959 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalReduceScatter_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.972 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.945 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.960 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.973 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalAll2All_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.267.989 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.029 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.957 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.267.975 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.980 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.967 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.981 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_float16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.267.994 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalAll2All_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.268.009 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.267.997 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.011 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.267.995 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.267.989 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.013 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.043 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.268.016 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.268.030 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_float16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.268.043 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalAll2All_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.267.996 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_float16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.268.013 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalAll2All_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.268.028 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.268.045 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.268.025 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.025 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalAll2All_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.041 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.059 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.268.038 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.268.052 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_bfloat16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.268.065 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalAll2All_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.268.078 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.053 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.068 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.082 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalAll2All_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.059 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalReduceScatter_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.074 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.097 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.268.059 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.268.078 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.268.085 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.268.100 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_bfloat16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.268.067 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.268.081 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_bfloat16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.268.093 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalAll2All_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.268.107 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.095 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.110 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int8_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.123 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalAll2All_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.268.100 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.268.133 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.096 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.114 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.268.119 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.268.134 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_bfloat16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.268.146 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalAll2All_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.137 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.150 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int8_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.268.114 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalAll2All_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.268.130 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.268.151 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.268.125 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.268.168 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.268.188 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int64_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.137 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.169 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:43.268.175 [queue_client_comm.c:114][ascend][curpid:618666,618851][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:43.268.175 [queue_client_comm.c:114][ascend][curpid:618666,618843][drv][queuemng][QueueWaitEvent]Hal[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.268.146 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int64_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.268.168 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalAll2All_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.268.190 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.268.207 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.151 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.195 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int8_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.208 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalAll2All_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.268.171 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.268.214 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.182 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalReduceScatter_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.199 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.216 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.268.212 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.268.248 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.268.262 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int64_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.268.277 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalAll2All_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.268.205 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalAll2All_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.268.224 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.212 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.226 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_float.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.241 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalAll2All_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
EschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:43.268.178 [queue_client_comm.c:114][ascend][curpid:618666,618847][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:43.268.180 [queue_client_comm.c:114][ascend][curpid:618666,618849][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:43.268.182 [queue_client_comm.c:114][ascend][curpid:618666,618845][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.268.258 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.228 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.256 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.257 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.274 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_float.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.268.229 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int64_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.268.245 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalAll2All_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.268.260 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.268.276 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.256 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.273 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.268.293 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:43.268.183 [queue_client_comm.c:114][ascend][curpid:618666,618841][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:43.268.300 [npu_driver.cc:4338] 618851 MemQueuePeek: queue empty
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.268.313 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.268.238 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.268.282 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.268.293 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalBroadcast.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.268.308 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=LcalBroadcast, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.268.275 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalBroadcast.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.268.289 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=LcalBroadcast, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.268.312 [api_impl.cc:1990] 618982 DevMalloc: size=423624736, type=1024, moduleId=33.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.295 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.310 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_float.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.324 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalAll2All_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.289 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalReduceScatter_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.306 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.328 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.268.322 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.268.338 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalBroadcast.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.309 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.322 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_float16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.338 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalAll2All_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.268.318 [tensor_data_transfer.cpp:612]618851 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_histogram_summary
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:43.268.324 [npu_driver.cc:4338] 618843 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.268.334 [tensor_data_transfer.cpp:1054]618851 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_histogram_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.268.342 [tensor_data_transfer.cpp:612]618843 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_tensor_dump
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.268.349 [tensor_data_transfer.cpp:1056]618851 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:43.268.357 [npu_driver.cc:4338] 618847 MemQueuePeek: queue empty
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.268.359 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.268.378 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalBroadcast.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.268.395 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=LcalBroadcast, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.268.419 [api_impl.cc:1990] 618988 DevMalloc: size=423624736, type=1024, moduleId=33.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.268.332 [api_impl.cc:1990] 618985 DevMalloc: size=423624736, type=1024, moduleId=33.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.340 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.358 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.370 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.384 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_float16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.406 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalReduceScatter_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.268.354 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=LcalBroadcast, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.268.389 [api_impl.cc:1990] 618984 DevMalloc: size=423624736, type=1024, moduleId=33.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.353 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.368 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.408 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.268.357 [tensor_data_transfer.cpp:1054]618843 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_tensor_dump
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.268.361 [api_impl.cc:6121] 618851 MemQueuePeek: Start to peek queue on devId 5, qid is 5.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.268.374 [tensor_data_transfer.cpp:612]618847 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_image_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.268.379 [tensor_data_transfer.cpp:1056]618843 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:43.268.385 [npu_driver.cc:4338] 618849 MemQueuePeek: queue empty
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.268.385 [npu_driver.cc:4330] 618851 MemQueuePeek: peek mem queue, deviceId=5, qid=5, timeout=800.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.268.389 [tensor_data_transfer.cpp:1054]618847 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_image_summary
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.268.396 [api_impl.cc:6121] 618843 MemQueuePeek: Start to peek queue on devId 5, qid is 1.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.268.403 [tensor_data_transfer.cpp:612]618849 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_scalar_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.268.415 [tensor_data_transfer.cpp:1056]618847 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:43.268.420 [npu_driver.cc:4338] 618845 MemQueuePeek: queue empty
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.396 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.411 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_float16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.425 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalAll2All_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.443 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.459 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.425 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.444 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.423 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_bfloat16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.439 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalAll2All_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.458 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.484 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.268.422 [npu_driver.cc:4330] 618843 MemQueuePeek: peek mem queue, deviceId=5, qid=1, timeout=800.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.268.429 [tensor_data_transfer.cpp:1054]618849 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_scalar_summary
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.268.432 [api_impl.cc:6121] 618847 MemQueuePeek: Start to peek queue on devId 5, qid is 3.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.268.441 [tensor_data_transfer.cpp:612]618845 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_tensor_summary
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:43.268.449 [npu_driver.cc:4338] 618841 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.268.461 [tensor_data_transfer.cpp:1056]618849 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.268.465 [npu_driver.cc:4330] 618847 MemQueuePeek: peek mem queue, deviceId=5, qid=3, timeout=800.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.268.473 [tensor_data_transfer.cpp:1054]618845 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_tensor_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.268.480 [tensor_data_transfer.cpp:612]618841 acltdtReceiveTensorV2: queue is empty, device is 5, name is _npu_log
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.268.485 [api_impl.cc:6121] 618849 MemQueuePeek: Start to peek queue on devId 5, qid is 4.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.268.491 [tensor_data_transfer.cpp:1056]618845 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.484 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.498 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_bfloat16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.501 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.268.499 [tensor_data_transfer.cpp:1054]618841 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is _npu_log
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.268.502 [npu_driver.cc:4330] 618849 MemQueuePeek: peek mem queue, deviceId=5, qid=4, timeout=800.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.268.505 [api_impl.cc:6121] 618845 MemQueuePeek: Start to peek queue on devId 5, qid is 2.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.268.513 [tensor_data_transfer.cpp:1056]618841 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.268.523 [npu_driver.cc:4330] 618845 MemQueuePeek: peek mem queue, deviceId=5, qid=2, timeout=800.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.515 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.511 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalReduceScatter_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.528 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.520 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_bfloat16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.537 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalAll2All_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.268.529 [api_impl.cc:6121] 618841 MemQueuePeek: Start to peek queue on devId 5, qid is 0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.531 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int64_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.545 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalAll2All_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.552 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.552 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.268.543 [npu_driver.cc:4330] 618841 MemQueuePeek: peek mem queue, deviceId=5, qid=0, timeout=800.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.560 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.575 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.576 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.593 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.609 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalReduceScatter_int64_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.621 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.610 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.629 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int64_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.627 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalReduceScatter_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.633 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalBroadcast.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.645 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalAll2All_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.645 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.268.641 [api_error.cc:1218] 618982 DevMalloc: device malloc Succ, size=423624736, type=1024, moduleId=33, start ptr=0x12c041200000, end ptr=0x12c05a600020
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.663 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.646 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=LcalBroadcast, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.663 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.268.667 [api_impl.cc:2664] 618982 MemSetSync: destMax=423624704, value=0, count=423624704
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.268.666 [api_error.cc:1218] 618985 DevMalloc: device malloc Succ, size=423624736, type=1024, moduleId=33, start ptr=0x12c041200000, end ptr=0x12c05a600020
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.268.670 [api_impl.cc:1990] 618987 DevMalloc: size=423624736, type=1024, moduleId=33.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.682 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.268.689 [api_impl.cc:2664] 618985 MemSetSync: destMax=423624704, value=0, count=423624704
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.705 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.268.707 [api_error.cc:1218] 618984 DevMalloc: device malloc Succ, size=423624736, type=1024, moduleId=33, start ptr=0x12c041200000, end ptr=0x12c05a600020
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.268.729 [api_impl.cc:2664] 618984 MemSetSync: destMax=423624704, value=0, count=423624704
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.725 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.722 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.736 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalAll2All_int, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.751 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.268.732 [api_error.cc:1218] 618988 DevMalloc: device malloc Succ, size=423624736, type=1024, moduleId=33, start ptr=0x12c041200000, end ptr=0x12c05a600020
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.739 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalBroadcast.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.754 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=LcalBroadcast, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.268.755 [api_impl.cc:2664] 618988 MemSetSync: destMax=423624704, value=0, count=423624704
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.775 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.268.779 [api_impl.cc:1990] 618981 DevMalloc: size=423624736, type=1024, moduleId=33.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.820 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.836 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.849 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalAll2All_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.867 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.886 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.926 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.942 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int8_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.955 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalAll2All_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.268.972 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.269.002 [api_error.cc:1218] 618987 DevMalloc: device malloc Succ, size=423624736, type=1024, moduleId=33, start ptr=0x12c041200000, end ptr=0x12c05a600020
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.269.002 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.269.023 [api_impl.cc:2664] 618987 MemSetSync: destMax=423624704, value=0, count=423624704
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.269.043 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.269.059 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_float.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.269.071 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalAll2All_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.269.087 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.269.105 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.269.111 [api_error.cc:1218] 618981 DevMalloc: device malloc Succ, size=423624736, type=1024, moduleId=33, start ptr=0x12c041200000, end ptr=0x12c05a600020
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.269.134 [api_impl.cc:2664] 618981 MemSetSync: destMax=423624704, value=0, count=423624704
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.269.147 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.269.163 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_float16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.269.180 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalAll2All_float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.269.199 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.269.218 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.269.262 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.269.278 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_bfloat16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.269.290 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalAll2All_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.269.307 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.269.332 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.269.368 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.269.383 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalAll2All_int64_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.269.396 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalAll2All_int64_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.269.413 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.269.432 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.269.479 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.269.495 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=LcalBroadcast.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.269.512 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=LcalBroadcast, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.269.534 [api_impl.cc:1990] 618986 DevMalloc: size=423624736, type=1024, moduleId=33.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.269.841 [api_error.cc:1218] 618986 DevMalloc: device malloc Succ, size=423624736, type=1024, moduleId=33, start ptr=0x12c041200000, end ptr=0x12c05a600020
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.269.870 [api_impl.cc:2664] 618986 MemSetSync: destMax=423624704, value=0, count=423624704
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.290.872 [npu_driver.cc:3571] 618982 SetIpcMemPid: set ipc mem pid success, name=000970a2000000000000030f0300ffcc0003, pid[0]=618646, num=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.290.899 [npu_driver.cc:3571] 618982 SetIpcMemPid: set ipc mem pid success, name=000970a2000000000000030f0300ffcc0003, pid[0]=618650, num=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.290.872 [npu_driver.cc:3571] 618988 SetIpcMemPid: set ipc mem pid success, name=0009709e000000000000030d0200ffc80002, pid[0]=618646, num=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.290.899 [npu_driver.cc:3571] 618988 SetIpcMemPid: set ipc mem pid success, name=0009709e000000000000030d0200ffc80002, pid[0]=618650, num=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.290.893 [npu_driver.cc:3571] 618984 SetIpcMemPid: set ipc mem pid success, name=000970a600000000000003100400ffd00004, pid[0]=618646, num=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.290.925 [npu_driver.cc:3571] 618984 SetIpcMemPid: set ipc mem pid success, name=000970a600000000000003100400ffd00004, pid[0]=618650, num=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.290.921 [npu_driver.cc:3571] 618988 SetIpcMemPid: set ipc mem pid success, name=0009709e000000000000030d0200ffc80002, pid[0]=618658, num=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.290.921 [npu_driver.cc:3571] 618982 SetIpcMemPid: set ipc mem pid success, name=000970a2000000000000030f0300ffcc0003, pid[0]=618654, num=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.290.920 [npu_driver.cc:3571] 618983 SetIpcMemPid: set ipc mem pid success, name=000970aa00000000000003110500ffd40005, pid[0]=618646, num=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.290.886 [npu_driver.cc:3571] 618987 SetIpcMemPid: set ipc mem pid success, name=0009709a000000000000030e0100ffc40001, pid[0]=618646, num=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.290.934 [npu_driver.cc:3571] 618987 SetIpcMemPid: set ipc mem pid success, name=0009709a000000000000030e0100ffc40001, pid[0]=618654, num=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.290.910 [npu_driver.cc:3571] 618986 SetIpcMemPid: set ipc mem pid success, name=000970ae00000000000003120600ffd80006, pid[0]=618646, num=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.290.938 [npu_driver.cc:3571] 618986 SetIpcMemPid: set ipc mem pid success, name=000970ae00000000000003120600ffd80006, pid[0]=618650, num=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.290.942 [npu_driver.cc:3571] 618988 SetIpcMemPid: set ipc mem pid success, name=0009709e000000000000030d0200ffc80002, pid[0]=618662, num=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.290.951 [npu_driver.cc:3571] 618983 SetIpcMemPid: set ipc mem pid success, name=000970aa00000000000003110500ffd40005, pid[0]=618650, num=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.290.947 [npu_driver.cc:3571] 618984 SetIpcMemPid: set ipc mem pid success, name=000970a600000000000003100400ffd00004, pid[0]=618654, num=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.290.943 [npu_driver.cc:3571] 618982 SetIpcMemPid: set ipc mem pid success, name=000970a2000000000000030f0300ffcc0003, pid[0]=618662, num=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.290.963 [npu_driver.cc:3571] 618982 SetIpcMemPid: set ipc mem pid success, name=000970a2000000000000030f0300ffcc0003, pid[0]=618666, num=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.290.955 [npu_driver.cc:3571] 618987 SetIpcMemPid: set ipc mem pid success, name=0009709a000000000000030e0100ffc40001, pid[0]=618658, num=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.290.959 [npu_driver.cc:3571] 618986 SetIpcMemPid: set ipc mem pid success, name=000970ae00000000000003120600ffd80006, pid[0]=618654, num=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.290.977 [npu_driver.cc:3571] 618986 SetIpcMemPid: set ipc mem pid success, name=000970ae00000000000003120600ffd80006, pid[0]=618658, num=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.290.963 [npu_driver.cc:3571] 618988 SetIpcMemPid: set ipc mem pid success, name=0009709e000000000000030d0200ffc80002, pid[0]=618666, num=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.290.979 [npu_driver.cc:3571] 618988 SetIpcMemPid: set ipc mem pid success, name=0009709e000000000000030d0200ffc80002, pid[0]=618670, num=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.290.930 [npu_driver.cc:3571] 618985 SetIpcMemPid: set ipc mem pid success, name=000970b200000000000003130700ffdc0007, pid[0]=618646, num=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.290.978 [npu_driver.cc:3571] 618985 SetIpcMemPid: set ipc mem pid success, name=000970b200000000000003130700ffdc0007, pid[0]=618650, num=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.290.967 [npu_driver.cc:3571] 618983 SetIpcMemPid: set ipc mem pid success, name=000970aa00000000000003110500ffd40005, pid[0]=618654, num=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.290.982 [npu_driver.cc:3571] 618983 SetIpcMemPid: set ipc mem pid success, name=000970aa00000000000003110500ffd40005, pid[0]=618658, num=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.290.968 [npu_driver.cc:3571] 618984 SetIpcMemPid: set ipc mem pid success, name=000970a600000000000003100400ffd00004, pid[0]=618658, num=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.290.987 [npu_driver.cc:3571] 618984 SetIpcMemPid: set ipc mem pid success, name=000970a600000000000003100400ffd00004, pid[0]=618666, num=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.290.972 [npu_driver.cc:3571] 618987 SetIpcMemPid: set ipc mem pid success, name=0009709a000000000000030e0100ffc40001, pid[0]=618662, num=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.290.989 [npu_driver.cc:3571] 618987 SetIpcMemPid: set ipc mem pid success, name=0009709a000000000000030e0100ffc40001, pid[0]=618666, num=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.291.005 [npu_driver.cc:3571] 618987 SetIpcMemPid: set ipc mem pid success, name=0009709a000000000000030e0100ffc40001, pid[0]=618670, num=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.290.961 [npu_driver.cc:3571] 618981 SetIpcMemPid: set ipc mem pid success, name=0009709600000000000003140000ffc00000, pid[0]=618650, num=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.291.007 [npu_driver.cc:3571] 618981 SetIpcMemPid: set ipc mem pid success, name=0009709600000000000003140000ffc00000, pid[0]=618654, num=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.290.981 [npu_driver.cc:3571] 618982 SetIpcMemPid: set ipc mem pid success, name=000970a2000000000000030f0300ffcc0003, pid[0]=618670, num=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.290.997 [npu_driver.cc:3571] 618982 SetIpcMemPid: set ipc mem pid success, name=000970a2000000000000030f0300ffcc0003, pid[0]=618674, num=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.290.995 [npu_driver.cc:3571] 618986 SetIpcMemPid: set ipc mem pid success, name=000970ae00000000000003120600ffd80006, pid[0]=618662, num=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.291.010 [npu_driver.cc:3571] 618986 SetIpcMemPid: set ipc mem pid success, name=000970ae00000000000003120600ffd80006, pid[0]=618666, num=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.290.995 [npu_driver.cc:3571] 618988 SetIpcMemPid: set ipc mem pid success, name=0009709e000000000000030d0200ffc80002, pid[0]=618674, num=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.291.001 [npu_driver.cc:3571] 618985 SetIpcMemPid: set ipc mem pid success, name=000970b200000000000003130700ffdc0007, pid[0]=618654, num=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.291.018 [npu_driver.cc:3571] 618985 SetIpcMemPid: set ipc mem pid success, name=000970b200000000000003130700ffdc0007, pid[0]=618658, num=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.291.033 [npu_driver.cc:3571] 618985 SetIpcMemPid: set ipc mem pid success, name=000970b200000000000003130700ffdc0007, pid[0]=618662, num=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.290.999 [npu_driver.cc:3571] 618983 SetIpcMemPid: set ipc mem pid success, name=000970aa00000000000003110500ffd40005, pid[0]=618662, num=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.291.015 [npu_driver.cc:3571] 618983 SetIpcMemPid: set ipc mem pid success, name=000970aa00000000000003110500ffd40005, pid[0]=618670, num=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.291.031 [npu_driver.cc:3571] 618983 SetIpcMemPid: set ipc mem pid success, name=000970aa00000000000003110500ffd40005, pid[0]=618674, num=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.291.005 [npu_driver.cc:3571] 618984 SetIpcMemPid: set ipc mem pid success, name=000970a600000000000003100400ffd00004, pid[0]=618670, num=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.291.025 [npu_driver.cc:3571] 618984 SetIpcMemPid: set ipc mem pid success, name=000970a600000000000003100400ffd00004, pid[0]=618674, num=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.291.023 [npu_driver.cc:3571] 618987 SetIpcMemPid: set ipc mem pid success, name=0009709a000000000000030e0100ffc40001, pid[0]=618674, num=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.291.026 [npu_driver.cc:3571] 618981 SetIpcMemPid: set ipc mem pid success, name=0009709600000000000003140000ffc00000, pid[0]=618658, num=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.291.043 [npu_driver.cc:3571] 618981 SetIpcMemPid: set ipc mem pid success, name=0009709600000000000003140000ffc00000, pid[0]=618662, num=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.291.058 [npu_driver.cc:3571] 618981 SetIpcMemPid: set ipc mem pid success, name=0009709600000000000003140000ffc00000, pid[0]=618666, num=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.291.025 [npu_driver.cc:3571] 618986 SetIpcMemPid: set ipc mem pid success, name=000970ae00000000000003120600ffd80006, pid[0]=618674, num=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.291.049 [npu_driver.cc:3571] 618985 SetIpcMemPid: set ipc mem pid success, name=000970b200000000000003130700ffdc0007, pid[0]=618666, num=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.291.066 [npu_driver.cc:3571] 618985 SetIpcMemPid: set ipc mem pid success, name=000970b200000000000003130700ffdc0007, pid[0]=618670, num=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.291.074 [npu_driver.cc:3571] 618981 SetIpcMemPid: set ipc mem pid success, name=0009709600000000000003140000ffc00000, pid[0]=618670, num=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.291.090 [npu_driver.cc:3571] 618981 SetIpcMemPid: set ipc mem pid success, name=0009709600000000000003140000ffc00000, pid[0]=618674, num=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.291.145 [api_impl.cc:4286] 618987 IpcOpenMemory: open ipc memory. name=0009709600000000000003140000ffc00000.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.291.161 [api_impl.cc:4286] 618988 IpcOpenMemory: open ipc memory. name=0009709600000000000003140000ffc00000.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.291.171 [api_impl.cc:4286] 618982 IpcOpenMemory: open ipc memory. name=0009709600000000000003140000ffc00000.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.291.185 [api_impl.cc:4286] 618984 IpcOpenMemory: open ipc memory. name=0009709600000000000003140000ffc00000.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.291.198 [api_impl.cc:4286] 618983 IpcOpenMemory: open ipc memory. name=0009709600000000000003140000ffc00000.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.291.198 [api_impl.cc:4286] 618986 IpcOpenMemory: open ipc memory. name=0009709600000000000003140000ffc00000.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.291.210 [api_impl.cc:4286] 618981 IpcOpenMemory: open ipc memory. name=0009709a000000000000030e0100ffc40001.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.291.216 [api_impl.cc:4286] 618985 IpcOpenMemory: open ipc memory. name=0009709600000000000003140000ffc00000.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.292.067 [npu_driver.cc:3195] 618981 OpenIpcMem: Open ipc mem success, name=0009709a000000000000030e0100ffc40001.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.292.088 [api_impl.cc:4286] 618981 IpcOpenMemory: open ipc memory. name=0009709e000000000000030d0200ffc80002.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.292.309 [npu_driver.cc:3195] 618988 OpenIpcMem: Open ipc mem success, name=0009709600000000000003140000ffc00000.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.292.329 [api_impl.cc:4286] 618988 IpcOpenMemory: open ipc memory. name=0009709a000000000000030e0100ffc40001.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.292.383 [npu_driver.cc:3195] 618984 OpenIpcMem: Open ipc mem success, name=0009709600000000000003140000ffc00000.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.292.403 [api_impl.cc:4286] 618984 IpcOpenMemory: open ipc memory. name=0009709a000000000000030e0100ffc40001.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.292.407 [npu_driver.cc:3195] 618982 OpenIpcMem: Open ipc mem success, name=0009709600000000000003140000ffc00000.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.292.430 [api_impl.cc:4286] 618982 IpcOpenMemory: open ipc memory. name=0009709a000000000000030e0100ffc40001.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.292.422 [npu_driver.cc:3195] 618987 OpenIpcMem: Open ipc mem success, name=0009709600000000000003140000ffc00000.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.292.444 [api_impl.cc:4286] 618987 IpcOpenMemory: open ipc memory. name=0009709e000000000000030d0200ffc80002.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.292.445 [npu_driver.cc:3195] 618986 OpenIpcMem: Open ipc mem success, name=0009709600000000000003140000ffc00000.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.292.465 [api_impl.cc:4286] 618986 IpcOpenMemory: open ipc memory. name=0009709a000000000000030e0100ffc40001.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.292.467 [npu_driver.cc:3195] 618985 OpenIpcMem: Open ipc mem success, name=0009709600000000000003140000ffc00000.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.292.490 [api_impl.cc:4286] 618985 IpcOpenMemory: open ipc memory. name=0009709a000000000000030e0100ffc40001.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.292.495 [npu_driver.cc:3195] 618983 OpenIpcMem: Open ipc mem success, name=0009709600000000000003140000ffc00000.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.292.523 [api_impl.cc:4286] 618983 IpcOpenMemory: open ipc memory. name=0009709a000000000000030e0100ffc40001.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.292.604 [npu_driver.cc:3195] 618981 OpenIpcMem: Open ipc mem success, name=0009709e000000000000030d0200ffc80002.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.292.622 [api_impl.cc:4286] 618981 IpcOpenMemory: open ipc memory. name=000970a2000000000000030f0300ffcc0003.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.292.942 [npu_driver.cc:3195] 618987 OpenIpcMem: Open ipc mem success, name=0009709e000000000000030d0200ffc80002.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.292.969 [api_impl.cc:4286] 618987 IpcOpenMemory: open ipc memory. name=000970a2000000000000030f0300ffcc0003.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.293.063 [npu_driver.cc:3195] 618988 OpenIpcMem: Open ipc mem success, name=0009709a000000000000030e0100ffc40001.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.293.080 [api_impl.cc:4286] 618988 IpcOpenMemory: open ipc memory. name=000970a2000000000000030f0300ffcc0003.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.293.117 [npu_driver.cc:3195] 618981 OpenIpcMem: Open ipc mem success, name=000970a2000000000000030f0300ffcc0003.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.293.134 [api_impl.cc:4286] 618981 IpcOpenMemory: open ipc memory. name=000970a600000000000003100400ffd00004.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.293.220 [npu_driver.cc:3195] 618984 OpenIpcMem: Open ipc mem success, name=0009709a000000000000030e0100ffc40001.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.293.239 [api_impl.cc:4286] 618984 IpcOpenMemory: open ipc memory. name=0009709e000000000000030d0200ffc80002.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.293.317 [npu_driver.cc:3195] 618985 OpenIpcMem: Open ipc mem success, name=0009709a000000000000030e0100ffc40001.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.293.334 [api_impl.cc:4286] 618985 IpcOpenMemory: open ipc memory. name=0009709e000000000000030d0200ffc80002.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.293.328 [npu_driver.cc:3195] 618983 OpenIpcMem: Open ipc mem success, name=0009709a000000000000030e0100ffc40001.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.293.343 [api_impl.cc:4286] 618983 IpcOpenMemory: open ipc memory. name=0009709e000000000000030d0200ffc80002.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.293.338 [npu_driver.cc:3195] 618982 OpenIpcMem: Open ipc mem success, name=0009709a000000000000030e0100ffc40001.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.293.356 [api_impl.cc:4286] 618982 IpcOpenMemory: open ipc memory. name=0009709e000000000000030d0200ffc80002.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.293.540 [npu_driver.cc:3195] 618981 OpenIpcMem: Open ipc mem success, name=000970a600000000000003100400ffd00004.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.293.556 [api_impl.cc:4286] 618981 IpcOpenMemory: open ipc memory. name=000970aa00000000000003110500ffd40005.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.293.561 [npu_driver.cc:3195] 618986 OpenIpcMem: Open ipc mem success, name=0009709a000000000000030e0100ffc40001.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.293.578 [api_impl.cc:4286] 618986 IpcOpenMemory: open ipc memory. name=0009709e000000000000030d0200ffc80002.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.293.580 [npu_driver.cc:3195] 618987 OpenIpcMem: Open ipc mem success, name=000970a2000000000000030f0300ffcc0003.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.293.596 [api_impl.cc:4286] 618987 IpcOpenMemory: open ipc memory. name=000970a600000000000003100400ffd00004.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.293.729 [npu_driver.cc:3195] 618988 OpenIpcMem: Open ipc mem success, name=000970a2000000000000030f0300ffcc0003.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.293.747 [api_impl.cc:4286] 618988 IpcOpenMemory: open ipc memory. name=000970a600000000000003100400ffd00004.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.293.992 [npu_driver.cc:3195] 618984 OpenIpcMem: Open ipc mem success, name=0009709e000000000000030d0200ffc80002.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.294.010 [api_impl.cc:4286] 618984 IpcOpenMemory: open ipc memory. name=000970a2000000000000030f0300ffcc0003.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.294.045 [npu_driver.cc:3195] 618987 OpenIpcMem: Open ipc mem success, name=000970a600000000000003100400ffd00004.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.294.061 [api_impl.cc:4286] 618987 IpcOpenMemory: open ipc memory. name=000970aa00000000000003110500ffd40005.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.294.044 [npu_driver.cc:3195] 618981 OpenIpcMem: Open ipc mem success, name=000970aa00000000000003110500ffd40005.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.294.061 [api_impl.cc:4286] 618981 IpcOpenMemory: open ipc memory. name=000970ae00000000000003120600ffd80006.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.294.151 [npu_driver.cc:3195] 618982 OpenIpcMem: Open ipc mem success, name=0009709e000000000000030d0200ffc80002.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.294.169 [api_impl.cc:4286] 618982 IpcOpenMemory: open ipc memory. name=000970a600000000000003100400ffd00004.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.294.244 [npu_driver.cc:3195] 618983 OpenIpcMem: Open ipc mem success, name=0009709e000000000000030d0200ffc80002.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.294.259 [api_impl.cc:4286] 618983 IpcOpenMemory: open ipc memory. name=000970a2000000000000030f0300ffcc0003.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.294.270 [npu_driver.cc:3195] 618985 OpenIpcMem: Open ipc mem success, name=0009709e000000000000030d0200ffc80002.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.294.289 [api_impl.cc:4286] 618985 IpcOpenMemory: open ipc memory. name=000970a2000000000000030f0300ffcc0003.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.294.272 [npu_driver.cc:3195] 618986 OpenIpcMem: Open ipc mem success, name=0009709e000000000000030d0200ffc80002.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.294.290 [api_impl.cc:4286] 618986 IpcOpenMemory: open ipc memory. name=000970a2000000000000030f0300ffcc0003.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.294.316 [npu_driver.cc:3195] 618988 OpenIpcMem: Open ipc mem success, name=000970a600000000000003100400ffd00004.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.294.334 [api_impl.cc:4286] 618988 IpcOpenMemory: open ipc memory. name=000970aa00000000000003110500ffd40005.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.294.406 [npu_driver.cc:3195] 618984 OpenIpcMem: Open ipc mem success, name=000970a2000000000000030f0300ffcc0003.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.294.423 [api_impl.cc:4286] 618984 IpcOpenMemory: open ipc memory. name=000970aa00000000000003110500ffd40005.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.294.460 [npu_driver.cc:3195] 618981 OpenIpcMem: Open ipc mem success, name=000970ae00000000000003120600ffd80006.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.294.476 [api_impl.cc:4286] 618981 IpcOpenMemory: open ipc memory. name=000970b200000000000003130700ffdc0007.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.294.620 [npu_driver.cc:3195] 618987 OpenIpcMem: Open ipc mem success, name=000970aa00000000000003110500ffd40005.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.294.637 [api_impl.cc:4286] 618987 IpcOpenMemory: open ipc memory. name=000970ae00000000000003120600ffd80006.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.294.687 [npu_driver.cc:3195] 618983 OpenIpcMem: Open ipc mem success, name=000970a2000000000000030f0300ffcc0003.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.294.701 [api_impl.cc:4286] 618983 IpcOpenMemory: open ipc memory. name=000970a600000000000003100400ffd00004.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.294.768 [npu_driver.cc:3195] 618985 OpenIpcMem: Open ipc mem success, name=000970a2000000000000030f0300ffcc0003.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.294.785 [api_impl.cc:4286] 618985 IpcOpenMemory: open ipc memory. name=000970a600000000000003100400ffd00004.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.294.780 [npu_driver.cc:3195] 618986 OpenIpcMem: Open ipc mem success, name=000970a2000000000000030f0300ffcc0003.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.294.796 [api_impl.cc:4286] 618986 IpcOpenMemory: open ipc memory. name=000970a600000000000003100400ffd00004.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.294.869 [npu_driver.cc:3195] 618988 OpenIpcMem: Open ipc mem success, name=000970aa00000000000003110500ffd40005.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.294.886 [api_impl.cc:4286] 618988 IpcOpenMemory: open ipc memory. name=000970ae00000000000003120600ffd80006.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.294.965 [npu_driver.cc:3195] 618981 OpenIpcMem: Open ipc mem success, name=000970b200000000000003130700ffdc0007.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.294.998 [npu_driver.cc:3195] 618984 OpenIpcMem: Open ipc mem success, name=000970aa00000000000003110500ffd40005.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.295.015 [api_impl.cc:4286] 618984 IpcOpenMemory: open ipc memory. name=000970ae00000000000003120600ffd80006.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.294.990 [api_impl.cc:1990] 618981 DevMalloc: size=132576, type=1024, moduleId=33.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.295.013 [npu_driver.cc:3195] 618987 OpenIpcMem: Open ipc mem success, name=000970ae00000000000003120600ffd80006.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.295.027 [api_impl.cc:4286] 618987 IpcOpenMemory: open ipc memory. name=000970b200000000000003130700ffdc0007.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.295.037 [api_error.cc:1218] 618981 DevMalloc: device malloc Succ, size=132576, type=1024, moduleId=33, start ptr=0x12c0c0016000, end ptr=0x12c0c00365e0
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.295.057 [memory.cpp:421]618981 aclrtMemcpy: start to execute aclrtMemcpy, destMaxSize = 132520, srcSize = 132520, kind = 1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.295.231 [npu_driver.cc:3195] 618982 OpenIpcMem: Open ipc mem success, name=000970a600000000000003100400ffd00004.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.295.248 [api_impl.cc:4286] 618982 IpcOpenMemory: open ipc memory. name=000970aa00000000000003110500ffd40005.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.295.260 [npu_driver.cc:3195] 618983 OpenIpcMem: Open ipc mem success, name=000970a600000000000003100400ffd00004.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.295.274 [api_impl.cc:4286] 618983 IpcOpenMemory: open ipc memory. name=000970ae00000000000003120600ffd80006.
[INFO] DEVICE(618646,fffe867cefa0,python3.9):2025-04-03-09:27:43.295.315 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_communication_group.cc:38] Initialize] Successfully initialize LCCL group hccl_world_group
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.295.363 [npu_driver.cc:3195] 618988 OpenIpcMem: Open ipc mem success, name=000970ae00000000000003120600ffd80006.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.295.380 [api_impl.cc:4286] 618988 IpcOpenMemory: open ipc memory. name=000970b200000000000003130700ffdc0007.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.295.370 [device.cpp:143]618981 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.295.387 [npu_driver.cc:3195] 618985 OpenIpcMem: Open ipc mem success, name=000970a600000000000003100400ffd00004.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.295.404 [api_impl.cc:4286] 618985 IpcOpenMemory: open ipc memory. name=000970aa00000000000003110500ffd40005.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.295.394 [api_impl.cc:2999] 618981 SetDevice: device_id=0, deviceMode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.295.410 [device.cc:306] 618981 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.295.425 [runtime.cc:3393] 618981 PrimaryContextRetain: Context inc ref, ts_id=0, count=0xa
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.295.443 [runtime.cc:3560] 618981 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.295.449 [npu_driver.cc:3195] 618987 OpenIpcMem: Open ipc mem success, name=000970b200000000000003130700ffdc0007.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.295.458 [api_impl.cc:2987] 618981 NewDevice: SetCurRef = 0xaaab06c88220,userDeviceId=0,deviceId=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.295.467 [npu_driver.cc:3195] 618986 OpenIpcMem: Open ipc mem success, name=000970a600000000000003100400ffd00004.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.295.483 [api_impl.cc:4286] 618986 IpcOpenMemory: open ipc memory. name=000970aa00000000000003110500ffd40005.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.295.475 [runtime.cc:5239] 618981 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.295.470 [api_impl.cc:1990] 618987 DevMalloc: size=132576, type=1024, moduleId=33.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.295.492 [api_impl.cc:2992] 618981 NewDevice: New device success, user_device_id=0, die_num=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.295.503 [api_error.cc:1218] 618987 DevMalloc: device malloc Succ, size=132576, type=1024, moduleId=33, start ptr=0x12c0c0016000, end ptr=0x12c0c00365e0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.295.510 [api_impl.cc:3025] 618981 SetDevice: SetDevice success, curCtx=0xaaab06c88220, user_device_id=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.295.528 [acl.cpp:115]618981 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.295.540 [acl.cpp:121]618981 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.295.523 [memory.cpp:421]618987 aclrtMemcpy: start to execute aclrtMemcpy, destMaxSize = 132520, srcSize = 132520, kind = 1
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.295.557 [device.cpp:154]618981 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.295.561 [npu_driver.cc:3195] 618984 OpenIpcMem: Open ipc mem success, name=000970ae00000000000003120600ffd80006.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.295.578 [api_impl.cc:4286] 618984 IpcOpenMemory: open ipc memory. name=000970b200000000000003130700ffdc0007.
[WARNING] DEVICE(618646,fffe867cefa0,python3.9):2025-04-03-09:27:43.295.594 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:146] InitializeByRootInfoConfig] Start to initialize communicator by HcclCommInitRootInfo for hccl_world_group, hcclBufferSize is 200 MB. hcclDeterministic is 0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.295.623 [runtime.cc:5239] 618981 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:43.295.644 [adapter_rts.cc:198] [618981][hrtGetDeviceRefresh]deviceLogicId[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:43.295.667 [op_base.cc:1091] [618981]Entry-HcclCommInitRootInfoInner:ranks[8], rank[0], rootinfo: host ip[192.168.0.44] port[60008] nicDeploy[1] identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], deviceLogicId[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:43.295.694 [op_base.cc:128] [618981][HcclGetDeviceId] deviceLogicId[0] 
[INFO] DEVICE(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:43.295.716 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_communication_group.cc:38] Initialize] Successfully initialize LCCL group hccl_world_group
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:43.295.730 [rank_consistentcy_checker.cc:32] [618981][GetInstance] get deviceLogicId[0]
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.295.764 [device.cpp:143]618987 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.295.787 [api_c_soc.cc:70] 618981 rtGetSocVersion: soc version is Ascend910B3
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.295.788 [api_impl.cc:2999] 618987 SetDevice: device_id=1, deviceMode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.295.808 [api_impl.cc:3100] 618981 GetDevicePhyIdByIndex: get PhyId by Index=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.295.805 [device.cc:306] 618987 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.295.819 [runtime.cc:3393] 618987 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x9
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.295.823 [api_impl.cc:3111] 618981 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.295.835 [api_impl.cc:3130] 618981 GetDevicePhyIdByIndex: cloud v2, device[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.295.833 [runtime.cc:3560] 618987 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.295.828 [npu_driver.cc:3195] 618988 OpenIpcMem: Open ipc mem success, name=000970b200000000000003130700ffdc0007.
_mode=0, device_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.295.846 [api_impl.cc:2987] 618987 NewDevice: SetCurRef = 0xaaab312ab590,userDeviceId=1,deviceId=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.295.860 [runtime.cc:5239] 618987 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.295.848 [api_impl.cc:1990] 618988 DevMalloc: size=132576, type=1024, moduleId=33.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.295.877 [api_impl.cc:2992] 618987 NewDevice: New device success, user_device_id=1, die_num=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.295.881 [npu_driver.cc:3195] 618983 OpenIpcMem: Open ipc mem success, name=000970ae00000000000003120600ffd80006.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.295.873 [api_error.cc:1218] 618988 DevMalloc: device malloc Succ, size=132576, type=1024, moduleId=33, start ptr=0x12c0c0016000, end ptr=0x12c0c00365e0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.295.895 [api_impl.cc:4286] 618983 IpcOpenMemory: open ipc memory. name=000970b200000000000003130700ffdc0007.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.295.893 [api_impl.cc:3025] 618987 SetDevice: SetDevice success, curCtx=0xaaab312ab590, user_device_id=1.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.295.894 [memory.cpp:421]618988 aclrtMemcpy: start to execute aclrtMemcpy, destMaxSize = 132520, srcSize = 132520, kind = 1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.295.911 [npu_driver.cc:3195] 618985 OpenIpcMem: Open ipc mem success, name=000970aa00000000000003110500ffd40005.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.295.928 [api_impl.cc:4286] 618985 IpcOpenMemory: open ipc memory. name=000970ae00000000000003120600ffd80006.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.295.912 [acl.cpp:115]618987 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.295.927 [acl.cpp:121]618987 GetSocVersion: socVersion is Ascend910B3
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:43.295.924 [network_manager.cc:69] [618981]NetworkManager::GetInstance deviceLogicID[0].
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.295.928 [npu_driver.cc:3195] 618986 OpenIpcMem: Open ipc mem success, name=000970aa00000000000003110500ffd40005.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.295.945 [api_impl.cc:4286] 618986 IpcOpenMemory: open ipc memory. name=000970b200000000000003130700ffdc0007.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:43.295.941 [network_manager.cc:157] [618981]NetworkManager: init nic, nicPosition[0] ref[2], skip.
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.295.960 [ra_host.c:1764]tid:618981,ra_get_ifnum(1764) : Input parameters: phy_id[0], nic_position:[0], is_all:[0]
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.295.941 [device.cpp:154]618987 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 1
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.295.978 [ra_peer.c:859]tid:618981,ra_peer_get_ifnum(859) : [get][ra_peer_ifnum]ra_peer_get_ifnum phy_id[0] start
[WARNING] DEVICE(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:43.295.988 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:146] InitializeByRootInfoConfig] Start to initialize communicator by HcclCommInitRootInfo for hccl_world_group, hcclBufferSize is 200 MB. hcclDeterministic is 0
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.000 [ra_peer.c:867]tid:618981,ra_peer_get_ifnum(867) : [get][ra_peer_ifnum]ra_peer_get_ifnum phy_id[0] succ
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:43.296.016 [adapter_hccp.cc:1378] [618981][Get][HostIf]hrtGetIfNum success. ifAddrNum[6].
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.033 [ra_host.c:1814]tid:618981,ra_get_ifaddrs(1814) : Input parameters: phy_id[0], nic_position:[0], is_all[0], interface num[6]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.296.034 [runtime.cc:5239] 618987 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.050 [ra_peer.c:874]tid:618981,ra_peer_get_ifaddrs(874) : [get][ra_peer_ifaddrs] ra_peer_get_ifaddrs phy_id[0] start
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.054 [adapter_rts.cc:198] [618987][hrtGetDeviceRefresh]deviceLogicId[1]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.296.057 [npu_driver.cc:3195] 618982 OpenIpcMem: Open ipc mem success, name=000970aa00000000000003110500ffd40005.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.296.076 [api_impl.cc:4286] 618982 IpcOpenMemory: open ipc memory. name=000970ae00000000000003120600ffd80006.
[INFO] DEVICE(618654,fffea97aefa0,python3.9):2025-04-03-09:27:43.296.060 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_communication_group.cc:38] Initialize] Successfully initialize LCCL group hccl_world_group
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.069 [rs_socket.c:2743]tid:618981,rs_peer_fill_ifaddr_infos(2743) : ifname[lo] addr[0x0100007f]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.073 [externalinput.cc:2065] [618987]HCCL_LOG_CONFIG set by default to [0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.296.072 [npu_driver.cc:3195] 618984 OpenIpcMem: Open ipc mem success, name=000970b200000000000003130700ffdc0007.
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.085 [rs_socket.c:2743]tid:618981,rs_peer_fill_ifaddr_infos(2743) : ifname[enp67s0f5] addr[0x2c00a8c0]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.098 [rs_socket.c:2743]tid:618981,rs_peer_fill_ifaddr_infos(2743) : ifname[docker0] addr[0x010011ac]
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.296.097 [device.cpp:143]618988 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 2.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.093 [externalinput.cc:490] [618987]HCCL_CONNECT_TIMEOUT set by environment to [600]s
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.109 [externalinput.cc:429] [618987]HCCL_EXEC_TIMEOUT set by default to [1836]s
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.296.106 [api_impl.cc:1990] 618984 DevMalloc: size=132576, type=1024, moduleId=33.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.296.132 [api_error.cc:1218] 618984 DevMalloc: device malloc Succ, size=132576, type=1024, moduleId=33, start ptr=0x12c0c0016000, end ptr=0x12c0c00365e0
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.109 [rs_socket.c:2749]tid:618981,rs_peer_fill_ifaddr_infos(2749) : ifname[lo] scope_id[0] flowinfo[0]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.123 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[0] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.134 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[1] 0x00
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.296.120 [api_impl.cc:2999] 618988 SetDevice: device_id=2, deviceMode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.296.134 [device.cc:306] 618988 Init: device mode has been already set, mode=0.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.125 [externalinput.cc:543] [618987]HCCL_INTRA_PCIE_ENABLE set by default to [1], HCCL_INTRA_ROCE_ENABLE set by default to [0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.141 [externalinput.cc:622] [618987]environmental variable PROFILING_MODE and GE profiling option is not set, default: false
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.172 [externalinput.cc:714] [618987]HCCL_WHITELIST_DISABLE set by environment to [1]
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.296.150 [memory.cpp:421]618984 aclrtMemcpy: start to execute aclrtMemcpy, destMaxSize = 132520, srcSize = 132520, kind = 1
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.145 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[2] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.170 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[3] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.184 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[4] 0x00
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.195 [externalinput.cc:821] [618987]HCCL_IF_IP is not set
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.296.147 [runtime.cc:3393] 618988 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x9
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.296.176 [runtime.cc:3560] 618988 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.296.196 [api_impl.cc:2987] 618988 NewDevice: SetCurRef = 0xaaaaf5082ff0,userDeviceId=2,deviceId=2
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.197 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[5] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.209 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[6] 0x00
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.210 [externalinput.cc:877] [618987]HCCL_SOCKET_IFNAME set by default to [EmptyString]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.223 [externalinput.cc:844] [618987]HCCL_SOCKET_FAMILY is not set and is used by default [AF_INET]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.296.214 [runtime.cc:5239] 618988 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.296.230 [api_impl.cc:2992] 618988 NewDevice: New device success, user_device_id=2, die_num=1.
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.220 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[7] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.232 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[8] 0x00
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.237 [externalinput.cc:728] [618987]HCCL_DEVICE_NIC_DISABLE set by default to [0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.296.247 [api_impl.cc:3025] 618988 SetDevice: SetDevice success, curCtx=0xaaaaf5082ff0, user_device_id=2.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.296.260 [acl.cpp:115]618988 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.245 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[9] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.257 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[10] 0x00
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.250 [externalinput.cc:758] [618987]HCCL_HOST_RDMA_ENABLE set by default to [0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.265 [externalinput.cc:806] [618987]HCCL_IF_BASE_PORT set by default to [60000]
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.296.274 [acl.cpp:121]618988 GetSocVersion: socVersion is Ascend910B3
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.267 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[11] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.280 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[12] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.290 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[13] 0x00
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.278 [externalinput.cc:1508] [618987]HCCL_ALGO is not set
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.295 [externalinput.cc:1671] [618987][CannVersion][Verification]environmental variable LD_LIBRARY_PATH is too long, actual len[1291], maxlen[1024]
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.296.287 [device.cpp:154]618988 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 2
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.302 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[14] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.312 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[15] 0x01
[INFO] DEVICE(618662,fffed17aefa0,python3.9):2025-04-03-09:27:43.296.309 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_communication_group.cc:38] Initialize] Successfully initialize LCCL group hccl_world_group
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.313 [externalinput.cc:462] [618987]HCCL_HIGH_PERF_ENABLE set by default to [0]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.325 [rs_socket.c:2749]tid:618981,rs_peer_fill_ifaddr_infos(2749) : ifname[enp67s0f5] scope_id[2] flowinfo[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.327 [externalinput.cc:1519] [618987]HCCL_RDMA_TC set by default to [132]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.341 [externalinput.cc:1554] [618987]HCCL_RDMA_SL set by default to [4]
[WARNING] DEVICE(618654,fffea97aefa0,python3.9):2025-04-03-09:27:43.296.323 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:146] InitializeByRootInfoConfig] Start to initialize communicator by HcclCommInitRootInfo for hccl_world_group, hcclBufferSize is 200 MB. hcclDeterministic is 0
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.347 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[0] 0xfe
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.358 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[1] 0x80
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.296.346 [device.cpp:143]618984 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 4.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.296.354 [npu_driver.cc:3195] 618983 OpenIpcMem: Open ipc mem success, name=000970b200000000000003130700ffdc0007.
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.372 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[2] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.385 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[3] 0x00
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.296.369 [api_impl.cc:2999] 618984 SetDevice: device_id=4, deviceMode=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.296.385 [device.cc:306] 618984 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.296.375 [api_impl.cc:1990] 618983 DevMalloc: size=132576, type=1024, moduleId=33.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.296.383 [runtime.cc:5239] 618988 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.296.397 [api_error.cc:1218] 618983 DevMalloc: device malloc Succ, size=132576, type=1024, moduleId=33, start ptr=0x12c0c0016000, end ptr=0x12c0c00365e0
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.399 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[4] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.413 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[5] 0x00
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.406 [adapter_rts.cc:198] [618988][hrtGetDeviceRefresh]deviceLogicId[2]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.296.402 [runtime.cc:3393] 618984 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x9
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.296.416 [memory.cpp:421]618983 aclrtMemcpy: start to execute aclrtMemcpy, destMaxSize = 132520, srcSize = 132520, kind = 1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.296.420 [runtime.cc:3560] 618984 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=4
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.425 [externalinput.cc:2065] [618988]HCCL_LOG_CONFIG set by default to [0]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.427 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[6] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.442 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[7] 0x00
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.296.436 [api_impl.cc:2987] 618984 NewDevice: SetCurRef = 0xaaab087d6320,userDeviceId=4,deviceId=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.296.453 [runtime.cc:5239] 618984 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.454 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[8] 0x8b
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.449 [externalinput.cc:490] [618988]HCCL_CONNECT_TIMEOUT set by environment to [600]s
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.467 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[9] 0x0e
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.468 [externalinput.cc:429] [618988]HCCL_EXEC_TIMEOUT set by default to [1836]s
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.479 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[10] 0xc4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.296.472 [api_impl.cc:2992] 618984 NewDevice: New device success, user_device_id=4, die_num=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.296.460 [npu_driver.cc:3195] 618982 OpenIpcMem: Open ipc mem success, name=000970ae00000000000003120600ffd80006.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.296.480 [api_impl.cc:4286] 618982 IpcOpenMemory: open ipc memory. name=000970b200000000000003130700ffdc0007.
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.492 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[11] 0x02
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.485 [externalinput.cc:543] [618988]HCCL_INTRA_PCIE_ENABLE set by default to [1], HCCL_INTRA_ROCE_ENABLE set by default to [0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.296.490 [api_impl.cc:3025] 618984 SetDevice: SetDevice success, curCtx=0xaaab087d6320, user_device_id=4.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.296.504 [acl.cpp:115]618984 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.505 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[12] 0x33
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.519 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[13] 0x1c
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.504 [externalinput.cc:622] [618988]environmental variable PROFILING_MODE and GE profiling option is not set, default: false
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.524 [externalinput.cc:714] [618988]HCCL_WHITELIST_DISABLE set by environment to [1]
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.296.521 [acl.cpp:121]618984 GetSocVersion: socVersion is Ascend910B3
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.531 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[14] 0x33
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.296.506 [npu_driver.cc:3195] 618985 OpenIpcMem: Open ipc mem success, name=000970ae00000000000003120600ffd80006.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.296.531 [api_impl.cc:1990] 618985 DevMalloc: size=132576, type=1024, moduleId=33.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.296.523 [api_c_soc.cc:70] 618987 rtGetSocVersion: soc version is Ascend910B3
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.543 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[15] 0x2f
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.296.537 [device.cpp:154]618984 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 4
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.540 [externalinput.cc:821] [618988]HCCL_IF_IP is not set
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.557 [externalinput.cc:877] [618988]HCCL_SOCKET_IFNAME set by default to [EmptyString]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.547 [externalinput.cc:1599] [618987]HCCL_RDMA_TIMEOUT set by default to [20]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.555 [rs_socket.c:2749]tid:618981,rs_peer_fill_ifaddr_infos(2749) : ifname[endvnic] scope_id[7] flowinfo[0]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.567 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[0] 0xfe
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.296.559 [api_error.cc:1218] 618985 DevMalloc: device malloc Succ, size=132576, type=1024, moduleId=33, start ptr=0x12c0c0016000, end ptr=0x12c0c00365e0
[WARNING] DEVICE(618662,fffed17aefa0,python3.9):2025-04-03-09:27:43.296.571 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:146] InitializeByRootInfoConfig] Start to initialize communicator by HcclCommInitRootInfo for hccl_world_group, hcclBufferSize is 200 MB. hcclDeterministic is 0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.572 [externalinput.cc:844] [618988]HCCL_SOCKET_FAMILY is not set and is used by default [AF_INET]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.584 [externalinput.cc:728] [618988]HCCL_DEVICE_NIC_DISABLE set by default to [0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.568 [externalinput.cc:1633] [618987]HCCL_RDMA_RETRY_CNT set by default to [7]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.583 [externalinput.cc:1778] [618987]HCCL_BUFFSIZE set by default to [200]M
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.595 [externalinput.cc:1807] [618987]HCCL_OP_BASE_FFTS_MODE_ENABLE set by default to [true]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.296.569 [npu_driver.cc:3195] 618986 OpenIpcMem: Open ipc mem success, name=000970b200000000000003130700ffdc0007.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.296.592 [api_impl.cc:1990] 618986 DevMalloc: size=132576, type=1024, moduleId=33.
[INFO] DEVICE(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:43.296.588 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_communication_group.cc:38] Initialize] Successfully initialize LCCL group hccl_world_group
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.578 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[1] 0x80
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.590 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[2] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.601 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[3] 0x00
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.296.577 [memory.cpp:421]618985 aclrtMemcpy: start to execute aclrtMemcpy, destMaxSize = 132520, srcSize = 132520, kind = 1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.598 [externalinput.cc:758] [618988]HCCL_HOST_RDMA_ENABLE set by default to [0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.611 [externalinput.cc:806] [618988]HCCL_IF_BASE_PORT set by default to [60000]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.624 [externalinput.cc:1508] [618988]HCCL_ALGO is not set
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.296.610 [runtime.cc:5239] 618984 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.296.615 [api_error.cc:1218] 618986 DevMalloc: device malloc Succ, size=132576, type=1024, moduleId=33, start ptr=0x12c0c0016000, end ptr=0x12c0c00365e0
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.296.646 [memory.cpp:421]618986 aclrtMemcpy: start to execute aclrtMemcpy, destMaxSize = 132520, srcSize = 132520, kind = 1
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.296.625 [device.cpp:143]618983 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.296.645 [api_impl.cc:2999] 618983 SetDevice: device_id=5, deviceMode=0.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.609 [externalinput.cc:515] [618987]HCCL_DETERMINISTIC set by default to [false]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.622 [externalinput.cc:1841] [618987]HCCL_DIAGNOSE_ENABLE set by default to [0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.635 [externalinput.cc:1929] [618987]HCCL_ENTRY_LOG_ENABLE set by default to [0]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.614 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[4] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.626 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[5] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.636 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[6] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.647 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[7] 0x00
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.658 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[8] 0xed
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.642 [externalinput.cc:1671] [618988][CannVersion][Verification]environmental variable LD_LIBRARY_PATH is too long, actual len[1291], maxlen[1024]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.656 [externalinput.cc:462] [618988]HCCL_HIGH_PERF_ENABLE set by default to [0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.668 [externalinput.cc:1519] [618988]HCCL_RDMA_TC set by default to [132]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.296.631 [adapter_rts.cc:198] [618984][hrtGetDeviceRefresh]deviceLogicId[4]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.296.650 [externalinput.cc:2065] [618984]HCCL_LOG_CONFIG set by default to [0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.296.667 [externalinput.cc:490] [618984]HCCL_CONNECT_TIMEOUT set by environment to [600]s
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.296.681 [externalinput.cc:429] [618984]HCCL_EXEC_TIMEOUT set by default to [1836]s
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.296.660 [device.cc:306] 618983 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.296.673 [runtime.cc:3393] 618983 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x9
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.296.685 [runtime.cc:3560] 618983 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=5
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.663 [externalinput.cc:1949] [618987]HCCL_INTER_HCCS_DISABLE is not set, default value is 0.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.678 [externalinput.cc:1969] [618987]HCCL_INTER_VNIC_DISABLE is not set, default value is 0.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.681 [externalinput.cc:1554] [618988]HCCL_RDMA_SL set by default to [4]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.670 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[9] 0xaf
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.681 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[10] 0x6d
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.692 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[11] 0xc3
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.702 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[12] 0x6f
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.296.699 [externalinput.cc:543] [618984]HCCL_INTRA_PCIE_ENABLE set by default to [1], HCCL_INTRA_ROCE_ENABLE set by default to [0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.296.715 [externalinput.cc:622] [618984]environmental variable PROFILING_MODE and GE profiling option is not set, default: false
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.296.696 [api_impl.cc:2987] 618983 NewDevice: SetCurRef = 0xaaaaf6e2dcc0,userDeviceId=5,deviceId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.296.706 [runtime.cc:5239] 618983 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.296.721 [api_impl.cc:2992] 618983 NewDevice: New device success, user_device_id=5, die_num=1.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.701 [externalinput.cc:2005] [618987]HCCL_OP_EXPANSION_MODE is not set, aicpuUnfold is [0], aivMode is [0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.718 [externalinput.cc:2036] [618987]environmental variable ASCEND_MC2_DEBUG_MODE is not set
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.732 [externalinput.cc:2209] [618987]HCCL_CONCURRENT_ENABLE is not set, default value is [0].
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.723 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[13] 0xad
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.735 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[14] 0xb4
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.747 [rs_socket.c:2751]tid:618981,rs_peer_fill_ifaddr_infos(2751) : addr[15] 0xb2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.296.733 [api_impl.cc:3025] 618983 SetDevice: SetDevice success, curCtx=0xaaaaf6e2dcc0, user_device_id=5.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.296.757 [acl.cpp:115]618983 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] DEVICE(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:43.296.728 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_communication_group.cc:38] Initialize] Successfully initialize LCCL group hccl_world_group
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.748 [externalinput.cc:2178] [618987][ParseRetryEnable] HCCL_OP_RETRY_ENABLE is not set. The retryEnable of all levels is set to false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.762 [externalinput.cc:889] [618987]HCCL_SEND_CQ_DEPTH set by default to [8192]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.296.729 [externalinput.cc:714] [618984]HCCL_WHITELIST_DISABLE set by environment to [1]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.296.746 [externalinput.cc:821] [618984]HCCL_IF_IP is not set
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:43.296.765 [ra_peer.c:882]tid:618981,ra_peer_get_ifaddrs(882) : [get][ra_peer_ifaddrs] ra_peer_get_ifaddrs phy_id[0] succ
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.296.768 [acl.cpp:121]618983 GetSocVersion: socVersion is Ascend910B3
[INFO] DEVICE(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:43.296.787 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_communication_group.cc:38] Initialize] Successfully initialize LCCL group hccl_world_group
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.296.785 [device.cpp:143]618985 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 7.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.774 [externalinput.cc:914] [618987]HCCL_DFT is not set, default value is 1.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.790 [externalinput.cc:2240] [618987]HCCL_OP_COUNTER_ENABLE set by default to [1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.802 [externalinput.cc:2308] [618987]HCCL_OP_RETRY_PARAMS is not set, default value MaxCnt is 1, HoldTime is 5000, IntervalTime is 1000
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.296.796 [api_c_soc.cc:70] 618988 rtGetSocVersion: soc version is Ascend910B3
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.296.782 [externalinput.cc:877] [618984]HCCL_SOCKET_IFNAME set by default to [EmptyString]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.296.798 [externalinput.cc:844] [618984]HCCL_SOCKET_FAMILY is not set and is used by default [AF_INET]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.296.810 [externalinput.cc:728] [618984]HCCL_DEVICE_NIC_DISABLE set by default to [0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:43.296.787 [adapter_hccp.cc:1407] [618981][Get][HostIf]hrtGetIfAddress: idx[0] ifname[lo] ip[127.0.0.1%lo]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:43.296.805 [adapter_hccp.cc:1407] [618981][Get][HostIf]hrtGetIfAddress: idx[1] ifname[enp67s0f5] ip[192.168.0.44%enp67s0f5]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:43.296.818 [adapter_hccp.cc:1407] [618981][Get][HostIf]hrtGetIfAddress: idx[2] ifname[docker0] ip[172.17.0.1%docker0]
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.296.783 [device.cpp:154]618983 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 5
[WARNING] DEVICE(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:43.296.815 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:146] InitializeByRootInfoConfig] Start to initialize communicator by HcclCommInitRootInfo for hccl_world_group, hcclBufferSize is 200 MB. hcclDeterministic is 0
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.296.819 [device.cpp:143]618986 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 6.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.296.810 [api_impl.cc:2999] 618985 SetDevice: device_id=7, deviceMode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.296.824 [device.cc:306] 618985 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.296.836 [runtime.cc:3393] 618985 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x9
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.816 [externalinput.cc:2339] [618987]HCCL_LOGIC_SUPERPOD_ID is not set, default value[]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.832 [externalinput.cc:2296] [618987]HCCL_STUCK_DETECT_TIME is set default [612]s.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.843 [externalinput.cc:407] [618987]HCCL_RDMA_PCIE_DIRECT_POST_NOSTRICT set by default to [EmptyString], rdmaFastPost is [0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.815 [externalinput.cc:1599] [618988]HCCL_RDMA_TIMEOUT set by default to [20]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.838 [externalinput.cc:1633] [618988]HCCL_RDMA_RETRY_CNT set by default to [7]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.850 [externalinput.cc:1778] [618988]HCCL_BUFFSIZE set by default to [200]M
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.296.821 [externalinput.cc:758] [618984]HCCL_HOST_RDMA_ENABLE set by default to [0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.296.834 [externalinput.cc:806] [618984]HCCL_IF_BASE_PORT set by default to [60000]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.296.848 [externalinput.cc:1508] [618984]HCCL_ALGO is not set
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.296.861 [externalinput.cc:1671] [618984][CannVersion][Verification]environmental variable LD_LIBRARY_PATH is too long, actual len[1291], maxlen[1024]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:43.296.832 [adapter_hccp.cc:1407] [618981][Get][HostIf]hrtGetIfAddress: idx[3] ifname[lo] ip[::1%lo]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:43.296.848 [adapter_hccp.cc:1407] [618981][Get][HostIf]hrtGetIfAddress: idx[4] ifname[enp67s0f5] ip[fe80::8b0e:c402:331c:332f%enp67s0f5]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:43.296.862 [adapter_hccp.cc:1407] [618981][Get][HostIf]hrtGetIfAddress: idx[5] ifname[endvnic] ip[fe80::edaf:6dc3:6fad:b4b2%endvnic]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.296.855 [runtime.cc:5239] 618983 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.296.872 [adapter_rts.cc:198] [618983][hrtGetDeviceRefresh]deviceLogicId[5]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.296.843 [api_impl.cc:2999] 618986 SetDevice: device_id=6, deviceMode=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.296.856 [device.cc:306] 618986 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.296.868 [runtime.cc:3393] 618986 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x9
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.296.881 [runtime.cc:3560] 618986 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=6
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.296.865 [npu_driver.cc:3195] 618982 OpenIpcMem: Open ipc mem success, name=000970b200000000000003130700ffdc0007.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.296.848 [runtime.cc:3560] 618985 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.296.864 [api_impl.cc:2987] 618985 NewDevice: SetCurRef = 0xaaab0103b880,userDeviceId=7,deviceId=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.296.877 [runtime.cc:5239] 618985 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[WARNING] HCCL(618650,python3.9):2025-04-03-09:27:43.296.861 [externalinput.cc:672] [618987][Parse][MultiQpSrcPortConfigPath]environmental variable HCCL_RDMA_QP_PORT_CONFIG_PATH is empty,but HCCL_RDMA_QP_PORT_CONFIG_PATH is not set
[WARNING] HCCL(618650,python3.9):2025-04-03-09:27:43.296.889 [env_config.cc:127] [618987]HCCL_HOST_SOCKET_PORT_RANGE is not set. Multi-process will not be supported!
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.296.894 [api_impl.cc:2992] 618985 NewDevice: New device success, user_device_id=7, die_num=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.296.911 [api_impl.cc:3025] 618985 SetDevice: SetDevice success, curCtx=0xaaab0103b880, user_device_id=7.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.296.923 [acl.cpp:115]618985 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.296.937 [acl.cpp:121]618985 GetSocVersion: socVersion is Ascend910B3
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.863 [externalinput.cc:1807] [618988]HCCL_OP_BASE_FFTS_MODE_ENABLE set by default to [true]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.879 [externalinput.cc:515] [618988]HCCL_DETERMINISTIC set by default to [false]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.890 [externalinput.cc:1841] [618988]HCCL_DIAGNOSE_ENABLE set by default to [0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.904 [externalinput.cc:1929] [618988]HCCL_ENTRY_LOG_ENABLE set by default to [0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.296.877 [externalinput.cc:462] [618984]HCCL_HIGH_PERF_ENABLE set by default to [0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.296.891 [externalinput.cc:1519] [618984]HCCL_RDMA_TC set by default to [132]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.296.904 [externalinput.cc:1554] [618984]HCCL_RDMA_SL set by default to [4]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:43.296.888 [sal.cc:365] [618981]get host ip success. host ifname[enp67s0f5] ip[192.168.0.44%enp67s0f5]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:43.296.902 [sal.cc:432] [618981]nic class[normal]: find nic[192.168.0.44%enp67s0f5] success.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:43.296.921 [network_manager.cc:69] [618981]NetworkManager::GetInstance deviceLogicID[0].
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.296.887 [externalinput.cc:2065] [618983]HCCL_LOG_CONFIG set by default to [0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.296.904 [externalinput.cc:490] [618983]HCCL_CONNECT_TIMEOUT set by environment to [600]s
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.296.920 [externalinput.cc:429] [618983]HCCL_EXEC_TIMEOUT set by default to [1836]s
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.296.894 [api_impl.cc:2987] 618986 NewDevice: SetCurRef = 0xaaaad9a630c0,userDeviceId=6,deviceId=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.296.908 [runtime.cc:5239] 618986 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.296.923 [api_impl.cc:2992] 618986 NewDevice: New device success, user_device_id=6, die_num=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.296.888 [api_impl.cc:1990] 618982 DevMalloc: size=132576, type=1024, moduleId=33.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.296.914 [api_error.cc:1218] 618982 DevMalloc: device malloc Succ, size=132576, type=1024, moduleId=33, start ptr=0x12c0c0016000, end ptr=0x12c0c00365e0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.296.929 [memory.cpp:421]618982 aclrtMemcpy: start to execute aclrtMemcpy, destMaxSize = 132520, srcSize = 132520, kind = 1
[WARNING] HCCL(618650,python3.9):2025-04-03-09:27:43.296.904 [env_config.cc:131] [618987]HCCL_NPU_SOCKET_PORT_RANGE is not set. Multi-process will not be supported!
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.922 [env_config.cc:302] [618987]HCCL_RDMA_TC set by default to [132]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.935 [env_config.cc:302] [618987]HCCL_RDMA_SL set by default to [4]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.947 [op_base.cc:1091] [618987]Entry-HcclCommInitRootInfoInner:ranks[8], rank[1], rootinfo: host ip[192.168.0.44] port[60008] nicDeploy[1] identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], deviceLogicId[1]
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.296.957 [device.cpp:154]618985 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 7
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.920 [externalinput.cc:1949] [618988]HCCL_INTER_HCCS_DISABLE is not set, default value is 0.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.945 [externalinput.cc:1969] [618988]HCCL_INTER_VNIC_DISABLE is not set, default value is 0.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.966 [externalinput.cc:2005] [618988]HCCL_OP_EXPANSION_MODE is not set, aicpuUnfold is [0], aivMode is [0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.296.982 [externalinput.cc:2036] [618988]environmental variable ASCEND_MC2_DEBUG_MODE is not set
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:43.296.935 [network_manager.cc:1257] [618981]ip[192.168.0.44%enp67s0f5] socket start success socketHandle[0xfffe8c08cb40]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:43.296.986 [adapter_hal.cc:298] [618981]Entry-hrtDrvGetPlatformInfo
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.296.936 [externalinput.cc:543] [618983]HCCL_INTRA_PCIE_ENABLE set by default to [1], HCCL_INTRA_ROCE_ENABLE set by default to [0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.296.953 [externalinput.cc:622] [618983]environmental variable PROFILING_MODE and GE profiling option is not set, default: false
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.296.968 [externalinput.cc:714] [618983]HCCL_WHITELIST_DISABLE set by environment to [1]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.296.981 [externalinput.cc:821] [618983]HCCL_IF_IP is not set
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.296.991 [externalinput.cc:877] [618983]HCCL_SOCKET_IFNAME set by default to [EmptyString]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.296.937 [api_impl.cc:3025] 618986 SetDevice: SetDevice success, curCtx=0xaaaad9a630c0, user_device_id=6.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.296.952 [acl.cpp:115]618986 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.296.962 [acl.cpp:121]618986 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.296.975 [device.cpp:154]618986 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 6
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.969 [op_base.cc:128] [618987][HcclGetDeviceId] deviceLogicId[1] 
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.296.986 [op_base.cc:144] [618987][GetHcclOpInfoCtx] Set device, use g_hcclDeviceId[1] 
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.297.008 [rank_consistentcy_checker.cc:32] [618987][GetInstance] get deviceLogicId[1]
[WARNING] DEVICE(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:43.296.994 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:146] InitializeByRootInfoConfig] Start to initialize communicator by HcclCommInitRootInfo for hccl_world_group, hcclBufferSize is 200 MB. hcclDeterministic is 0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.297.000 [externalinput.cc:2209] [618988]HCCL_CONCURRENT_ENABLE is not set, default value is [0].
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.297.013 [externalinput.cc:2178] [618988][ParseRetryEnable] HCCL_OP_RETRY_ENABLE is not set. The retryEnable of all levels is set to false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.297.028 [externalinput.cc:889] [618988]HCCL_SEND_CQ_DEPTH set by default to [8192]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:43.297.008 [sal.cc:593] [618981]IsHostUseDevNic[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:43.297.020 [network_manager.cc:69] [618981]NetworkManager::GetInstance deviceLogicID[0].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:43.297.033 [network_manager.cc:169] [618981]NetworkManager: devicePhyId[4294967295], devicePhyId_[0] deviceLogicId_[0], hasBackup[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.002 [externalinput.cc:844] [618983]HCCL_SOCKET_FAMILY is not set and is used by default [AF_INET]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.014 [externalinput.cc:728] [618983]HCCL_DEVICE_NIC_DISABLE set by default to [0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.026 [externalinput.cc:758] [618983]HCCL_HOST_RDMA_ENABLE set by default to [0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.037 [externalinput.cc:806] [618983]HCCL_IF_BASE_PORT set by default to [60000]
[WARNING] DEVICE(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:43.297.006 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:146] InitializeByRootInfoConfig] Start to initialize communicator by HcclCommInitRootInfo for hccl_world_group, hcclBufferSize is 200 MB. hcclDeterministic is 0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.297.045 [runtime.cc:5239] 618986 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.297.032 [api_impl.cc:3100] 618987 GetDevicePhyIdByIndex: get PhyId by Index=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.297.047 [api_impl.cc:3111] 618987 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.297.059 [api_impl.cc:3130] 618987 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.297.047 [api_c_soc.cc:70] 618984 rtGetSocVersion: soc version is Ascend910B3
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.297.034 [runtime.cc:5239] 618985 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.054 [adapter_rts.cc:198] [618985][hrtGetDeviceRefresh]deviceLogicId[7]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.297.043 [externalinput.cc:914] [618988]HCCL_DFT is not set, default value is 1.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.297.055 [externalinput.cc:2240] [618988]HCCL_OP_COUNTER_ENABLE set by default to [1]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.297.067 [externalinput.cc:2308] [618988]HCCL_OP_RETRY_PARAMS is not set, default value MaxCnt is 1, HoldTime is 5000, IntervalTime is 1000
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.078 [externalinput.cc:2065] [618985]HCCL_LOG_CONFIG set by default to [0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.098 [externalinput.cc:490] [618985]HCCL_CONNECT_TIMEOUT set by environment to [600]s
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.110 [externalinput.cc:429] [618985]HCCL_EXEC_TIMEOUT set by default to [1836]s
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.050 [externalinput.cc:1508] [618983]HCCL_ALGO is not set
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.066 [externalinput.cc:1671] [618983][CannVersion][Verification]environmental variable LD_LIBRARY_PATH is too long, actual len[1291], maxlen[1024]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.078 [externalinput.cc:462] [618983]HCCL_HIGH_PERF_ENABLE set by default to [0]
[INFO] DEVICE(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:43.297.071 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_communication_group.cc:38] Initialize] Successfully initialize LCCL group hccl_world_group
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.062 [adapter_rts.cc:198] [618986][hrtGetDeviceRefresh]deviceLogicId[6]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.078 [externalinput.cc:2065] [618986]HCCL_LOG_CONFIG set by default to [0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.068 [externalinput.cc:1599] [618984]HCCL_RDMA_TIMEOUT set by default to [20]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.087 [externalinput.cc:1633] [618984]HCCL_RDMA_RETRY_CNT set by default to [7]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.099 [externalinput.cc:1778] [618984]HCCL_BUFFSIZE set by default to [200]M
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.114 [externalinput.cc:1807] [618984]HCCL_OP_BASE_FFTS_MODE_ENABLE set by default to [true]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.297.083 [externalinput.cc:2339] [618988]HCCL_LOGIC_SUPERPOD_ID is not set, default value[]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.297.096 [externalinput.cc:2296] [618988]HCCL_STUCK_DETECT_TIME is set default [612]s.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.297.109 [externalinput.cc:407] [618988]HCCL_RDMA_PCIE_DIRECT_POST_NOSTRICT set by default to [EmptyString], rdmaFastPost is [0]
[WARNING] HCCL(618654,python3.9):2025-04-03-09:27:43.297.124 [externalinput.cc:672] [618988][Parse][MultiQpSrcPortConfigPath]environmental variable HCCL_RDMA_QP_PORT_CONFIG_PATH is empty,but HCCL_RDMA_QP_PORT_CONFIG_PATH is not set
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.123 [externalinput.cc:543] [618985]HCCL_INTRA_PCIE_ENABLE set by default to [1], HCCL_INTRA_ROCE_ENABLE set by default to [0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.092 [externalinput.cc:1519] [618983]HCCL_RDMA_TC set by default to [132]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.104 [externalinput.cc:1554] [618983]HCCL_RDMA_SL set by default to [4]
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.297.111 [device.cpp:143]618982 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.297.131 [api_impl.cc:2999] 618982 SetDevice: device_id=3, deviceMode=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.297.143 [device.cc:306] 618982 Init: device mode has been already set, mode=0.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.098 [externalinput.cc:490] [618986]HCCL_CONNECT_TIMEOUT set by environment to [600]s
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.113 [externalinput.cc:429] [618986]HCCL_EXEC_TIMEOUT set by default to [1836]s
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.126 [externalinput.cc:543] [618986]HCCL_INTRA_PCIE_ENABLE set by default to [1], HCCL_INTRA_ROCE_ENABLE set by default to [0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.139 [externalinput.cc:622] [618986]environmental variable PROFILING_MODE and GE profiling option is not set, default: false
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.153 [externalinput.cc:714] [618986]HCCL_WHITELIST_DISABLE set by environment to [1]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.128 [externalinput.cc:515] [618984]HCCL_DETERMINISTIC set by default to [false]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.142 [externalinput.cc:1841] [618984]HCCL_DIAGNOSE_ENABLE set by default to [0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.155 [externalinput.cc:1929] [618984]HCCL_ENTRY_LOG_ENABLE set by default to [0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.139 [externalinput.cc:622] [618985]environmental variable PROFILING_MODE and GE profiling option is not set, default: false
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.155 [externalinput.cc:714] [618985]HCCL_WHITELIST_DISABLE set by environment to [1]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.167 [externalinput.cc:821] [618985]HCCL_IF_IP is not set
[INFO] TDT(618646,python3.9):2025-04-03-09:27:43.297.154 [tsd_client.cpp:189][TsdCapabilityGet][tid:618981] TsdCapabilityGet Begin.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:43.297.173 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618981] [TsdClient] g_userDeviceInfo is empty.
[WARNING] HCCL(618654,python3.9):2025-04-03-09:27:43.297.167 [env_config.cc:127] [618988]HCCL_HOST_SOCKET_PORT_RANGE is not set. Multi-process will not be supported!
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.297.156 [runtime.cc:3393] 618982 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x9
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.297.172 [runtime.cc:3560] 618982 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.297.184 [api_impl.cc:2987] 618982 NewDevice: SetCurRef = 0xaaab0b9e09a0,userDeviceId=3,deviceId=3
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.167 [externalinput.cc:1949] [618984]HCCL_INTER_HCCS_DISABLE is not set, default value is 0.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.181 [externalinput.cc:1969] [618984]HCCL_INTER_VNIC_DISABLE is not set, default value is 0.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.201 [externalinput.cc:2005] [618984]HCCL_OP_EXPANSION_MODE is not set, aicpuUnfold is [0], aivMode is [0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.179 [externalinput.cc:877] [618985]HCCL_SOCKET_IFNAME set by default to [EmptyString]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.194 [externalinput.cc:844] [618985]HCCL_SOCKET_FAMILY is not set and is used by default [AF_INET]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.206 [externalinput.cc:728] [618985]HCCL_DEVICE_NIC_DISABLE set by default to [0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.167 [externalinput.cc:821] [618986]HCCL_IF_IP is not set
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.179 [externalinput.cc:877] [618986]HCCL_SOCKET_IFNAME set by default to [EmptyString]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.190 [externalinput.cc:844] [618986]HCCL_SOCKET_FAMILY is not set and is used by default [AF_INET]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:43.297.188 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618981] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:43.297.203 [process_mode_manager.cpp:1042][CapabilityGet][tid:618981] [ProcessModeManager] enter into CapabilityGet process deviceId[0] type[6]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.297.208 [api_c_soc.cc:70] 618983 rtGetSocVersion: soc version is Ascend910B3
[WARNING] HCCL(618654,python3.9):2025-04-03-09:27:43.297.186 [env_config.cc:131] [618988]HCCL_NPU_SOCKET_PORT_RANGE is not set. Multi-process will not be supported!
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.297.203 [env_config.cc:302] [618988]HCCL_RDMA_TC set by default to [132]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.297.215 [env_config.cc:302] [618988]HCCL_RDMA_SL set by default to [4]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.297.200 [runtime.cc:5239] 618982 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.216 [externalinput.cc:2036] [618984]environmental variable ASCEND_MC2_DEBUG_MODE is not set
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.231 [externalinput.cc:2209] [618984]HCCL_CONCURRENT_ENABLE is not set, default value is [0].
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.220 [externalinput.cc:758] [618985]HCCL_HOST_RDMA_ENABLE set by default to [0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.219 [externalinput.cc:728] [618986]HCCL_DEVICE_NIC_DISABLE set by default to [0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.232 [externalinput.cc:758] [618986]HCCL_HOST_RDMA_ENABLE set by default to [0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.245 [externalinput.cc:806] [618986]HCCL_IF_BASE_PORT set by default to [60000]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:43.297.218 [adapter_tdt.cc:66] [618981]Get TsdCapability success. deviceLogicId[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:43.297.230 [network_manager.cc:175] [618981][NetworkManager][Init]supportMultiProcHCCP[1], hasBackup[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:43.297.251 [network_manager.cc:99] [618981][TsdProcessOpen]params: halAPIVersion[467736], BACKUP_DEVICE_LOG_DEV_VERSION[467736]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.226 [externalinput.cc:1599] [618983]HCCL_RDMA_TIMEOUT set by default to [20]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.244 [externalinput.cc:1633] [618983]HCCL_RDMA_RETRY_CNT set by default to [7]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.258 [externalinput.cc:1778] [618983]HCCL_BUFFSIZE set by default to [200]M
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.297.228 [op_base.cc:1091] [618988]Entry-HcclCommInitRootInfoInner:ranks[8], rank[2], rootinfo: host ip[192.168.0.44] port[60008] nicDeploy[1] identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], deviceLogicId[2]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.297.253 [op_base.cc:128] [618988][HcclGetDeviceId] deviceLogicId[2] 
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.297.230 [api_impl.cc:2992] 618982 NewDevice: New device success, user_device_id=3, die_num=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.297.248 [api_impl.cc:3025] 618982 SetDevice: SetDevice success, curCtx=0xaaab0b9e09a0, user_device_id=3.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.297.261 [acl.cpp:115]618982 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.247 [externalinput.cc:2178] [618984][ParseRetryEnable] HCCL_OP_RETRY_ENABLE is not set. The retryEnable of all levels is set to false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.261 [externalinput.cc:889] [618984]HCCL_SEND_CQ_DEPTH set by default to [8192]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.274 [externalinput.cc:914] [618984]HCCL_DFT is not set, default value is 1.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.247 [externalinput.cc:806] [618985]HCCL_IF_BASE_PORT set by default to [60000]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.261 [externalinput.cc:1508] [618985]HCCL_ALGO is not set
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.275 [externalinput.cc:1671] [618985][CannVersion][Verification]environmental variable LD_LIBRARY_PATH is too long, actual len[1291], maxlen[1024]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.259 [externalinput.cc:1508] [618986]HCCL_ALGO is not set
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.274 [externalinput.cc:1671] [618986][CannVersion][Verification]environmental variable LD_LIBRARY_PATH is too long, actual len[1291], maxlen[1024]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.288 [externalinput.cc:462] [618986]HCCL_HIGH_PERF_ENABLE set by default to [0]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:43.297.267 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618981] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:43.297.280 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618981] [TsdClient] g_userDeviceInfo is empty.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.270 [externalinput.cc:1807] [618983]HCCL_OP_BASE_FFTS_MODE_ENABLE set by default to [true]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.293 [externalinput.cc:515] [618983]HCCL_DETERMINISTIC set by default to [false]
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.297.274 [acl.cpp:121]618982 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.297.290 [device.cpp:154]618982 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 3
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.297.296 [op_base.cc:144] [618988][GetHcclOpInfoCtx] Set device, use g_hcclDeviceId[2] 
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.290 [externalinput.cc:462] [618985]HCCL_HIGH_PERF_ENABLE set by default to [0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.306 [externalinput.cc:1519] [618985]HCCL_RDMA_TC set by default to [132]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.321 [externalinput.cc:1554] [618985]HCCL_RDMA_SL set by default to [4]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.297.300 [network_manager.cc:69] [618987]NetworkManager::GetInstance deviceLogicID[1].
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.301 [externalinput.cc:1519] [618986]HCCL_RDMA_TC set by default to [132]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.314 [externalinput.cc:1554] [618986]HCCL_RDMA_SL set by default to [4]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.287 [externalinput.cc:2240] [618984]HCCL_OP_COUNTER_ENABLE set by default to [1]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.301 [externalinput.cc:2308] [618984]HCCL_OP_RETRY_PARAMS is not set, default value MaxCnt is 1, HoldTime is 5000, IntervalTime is 1000
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.317 [externalinput.cc:2339] [618984]HCCL_LOGIC_SUPERPOD_ID is not set, default value[]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:43.297.303 [process_mode_manager.cpp:1434][ProcessOpenSubProc][tid:618981] enter into ProcessOpenSubProc subtype:0
[INFO] TDT(618646,python3.9):2025-04-03-09:27:43.297.318 [process_mode_manager.cpp:386][InitTsdClient][tid:618981] [TsdClient] tsd client has been inited before
[INFO] TDT(618646,python3.9):2025-04-03-09:27:43.297.338 [process_mode_manager.cpp:1363][SetCommonOpenParamList][tid:618981] cnt:0, extra parameters:--hdcType=18, len:12
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.306 [externalinput.cc:1841] [618983]HCCL_DIAGNOSE_ENABLE set by default to [0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.320 [externalinput.cc:1929] [618983]HCCL_ENTRY_LOG_ENABLE set by default to [0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.333 [externalinput.cc:1949] [618983]HCCL_INTER_HCCS_DISABLE is not set, default value is 0.
[WARNING] DEVICE(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:43.297.327 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:146] InitializeByRootInfoConfig] Start to initialize communicator by HcclCommInitRootInfo for hccl_world_group, hcclBufferSize is 200 MB. hcclDeterministic is 0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.297.352 [rank_consistentcy_checker.cc:32] [618988][GetInstance] get deviceLogicId[2]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.297.330 [network_manager.cc:169] [618987]NetworkManager: devicePhyId[1], devicePhyId_[1] deviceLogicId_[1], hasBackup[0]
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.297.358 [ra_host.c:1594]tid:618987,ra_socket_set_white_list_status(1594) : Input parameters: enable[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.347 [externalinput.cc:2296] [618984]HCCL_STUCK_DETECT_TIME is set default [612]s.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.361 [externalinput.cc:407] [618984]HCCL_RDMA_PCIE_DIRECT_POST_NOSTRICT set by default to [EmptyString], rdmaFastPost is [0]
[WARNING] HCCL(618662,python3.9):2025-04-03-09:27:43.297.375 [externalinput.cc:672] [618984][Parse][MultiQpSrcPortConfigPath]environmental variable HCCL_RDMA_QP_PORT_CONFIG_PATH is empty,but HCCL_RDMA_QP_PORT_CONFIG_PATH is not set
[WARNING] TDT(618646,python3.9):2025-04-03-09:27:43.297.362 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618981] Get env[ASCEND_LATEST_INSTALL_PATH] failed
[INFO] TDT(618646,python3.9):2025-04-03-09:27:43.297.377 [process_mode_manager.cpp:1680][GetAscendLatestIntallPath][tid:618981] latest install path:/usr/local/Ascend/ascend-toolkit/latest
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.346 [externalinput.cc:1969] [618983]HCCL_INTER_VNIC_DISABLE is not set, default value is 0.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.366 [externalinput.cc:2005] [618983]HCCL_OP_EXPANSION_MODE is not set, aicpuUnfold is [0], aivMode is [0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.380 [externalinput.cc:2036] [618983]environmental variable ASCEND_MC2_DEBUG_MODE is not set
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.394 [externalinput.cc:2209] [618983]HCCL_CONCURRENT_ENABLE is not set, default value is [0].
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.297.369 [runtime.cc:5239] 618982 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.388 [adapter_rts.cc:198] [618982][hrtGetDeviceRefresh]deviceLogicId[3]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.297.388 [api_impl.cc:3100] 618988 GetDevicePhyIdByIndex: get PhyId by Index=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.297.403 [api_impl.cc:3111] 618988 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=2
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.297.379 [adapter_hccp.cc:1450] [618987]set host socket whitelist status[0] success.
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.297.415 [ra_host.c:205]tid:618987,ra_init(205) : Input parameters: phy_id[1], nic_position:[0] hdc_type:[6]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.297.406 [api_c_soc.cc:70] 618986 rtGetSocVersion: soc version is Ascend910B3
[INFO] TDT(618646,python3.9):2025-04-03-09:27:43.297.390 [process_mode_manager.cpp:1383][ConstructCommonOpenMsg][tid:618981] runtimePkgPath:/usr/local/Ascend/ascend-toolkit/latest
[INFO] TDT(618646,python3.9):2025-04-03-09:27:43.297.416 [process_mode_manager.cpp:1389][ConstructCommonOpenMsg][tid:618981] hostLibPath:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/lib:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/examples:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/tests/atbopstest:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64/plugin:/usr/local/Ascend/ascend-toolkit/latest/lib64:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/opskernel:/usr/local/Ascend/ascend-toolkit/
[WARNING] HCCL(618662,python3.9):2025-04-03-09:27:43.297.417 [env_config.cc:127] [618984]HCCL_HOST_SOCKET_PORT_RANGE is not set. Multi-process will not be supported!
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.405 [externalinput.cc:2178] [618983][ParseRetryEnable] HCCL_OP_RETRY_ENABLE is not set. The retryEnable of all levels is set to false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.421 [externalinput.cc:889] [618983]HCCL_SEND_CQ_DEPTH set by default to [8192]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.434 [externalinput.cc:914] [618983]HCCL_DFT is not set, default value is 1.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.406 [externalinput.cc:2065] [618982]HCCL_LOG_CONFIG set by default to [0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.423 [externalinput.cc:490] [618982]HCCL_CONNECT_TIMEOUT set by environment to [600]s
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.435 [externalinput.cc:429] [618982]HCCL_EXEC_TIMEOUT set by default to [1836]s
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.297.417 [api_impl.cc:3130] 618988 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=2
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.425 [externalinput.cc:1599] [618986]HCCL_RDMA_TIMEOUT set by default to [20]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.444 [externalinput.cc:1633] [618986]HCCL_RDMA_RETRY_CNT set by default to [7]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.456 [externalinput.cc:1778] [618986]HCCL_BUFFSIZE set by default to [200]M
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.468 [externalinput.cc:1807] [618986]HCCL_OP_BASE_FFTS_MODE_ENABLE set by default to [true]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:43.297.445 [version_verify.cpp:114][SpecialFeatureCheck][tid:618981] VersionVerify: previous type[48], supported
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.297.462 [api_c_soc.cc:70] 618985 rtGetSocVersion: soc version is Ascend910B3
[WARNING] HCCL(618662,python3.9):2025-04-03-09:27:43.297.437 [env_config.cc:131] [618984]HCCL_NPU_SOCKET_PORT_RANGE is not set. Multi-process will not be supported!
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.453 [env_config.cc:302] [618984]HCCL_RDMA_TC set by default to [132]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.465 [env_config.cc:302] [618984]HCCL_RDMA_SL set by default to [4]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.477 [op_base.cc:1091] [618984]Entry-HcclCommInitRootInfoInner:ranks[8], rank[4], rootinfo: host ip[192.168.0.44] port[60008] nicDeploy[1] identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], deviceLogicId[4]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.445 [externalinput.cc:2240] [618983]HCCL_OP_COUNTER_ENABLE set by default to [1]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.457 [externalinput.cc:2308] [618983]HCCL_OP_RETRY_PARAMS is not set, default value MaxCnt is 1, HoldTime is 5000, IntervalTime is 1000
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.471 [externalinput.cc:2339] [618983]HCCL_LOGIC_SUPERPOD_ID is not set, default value[]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.483 [externalinput.cc:2296] [618983]HCCL_STUCK_DETECT_TIME is set default [612]s.
[INFO] ROCE(618650,python3.9):2025-04-03-09:27:43.297.472 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.451 [externalinput.cc:543] [618982]HCCL_INTRA_PCIE_ENABLE set by default to [1], HCCL_INTRA_ROCE_ENABLE set by default to [0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.466 [externalinput.cc:622] [618982]environmental variable PROFILING_MODE and GE profiling option is not set, default: false
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.479 [externalinput.cc:714] [618982]HCCL_WHITELIST_DISABLE set by environment to [1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.492 [externalinput.cc:821] [618982]HCCL_IF_IP is not set
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.482 [externalinput.cc:515] [618986]HCCL_DETERMINISTIC set by default to [false]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.495 [externalinput.cc:1841] [618986]HCCL_DIAGNOSE_ENABLE set by default to [0]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:43.297.497 [hdc_client.cpp:154][TsdRecvData][tid:618981] recv timeout is:150000 ms
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.482 [externalinput.cc:1599] [618985]HCCL_RDMA_TIMEOUT set by default to [20]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.502 [externalinput.cc:1633] [618985]HCCL_RDMA_RETRY_CNT set by default to [7]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.516 [externalinput.cc:1778] [618985]HCCL_BUFFSIZE set by default to [200]M
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.508 [op_base.cc:128] [618984][HcclGetDeviceId] deviceLogicId[4] 
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.495 [externalinput.cc:407] [618983]HCCL_RDMA_PCIE_DIRECT_POST_NOSTRICT set by default to [EmptyString], rdmaFastPost is [0]
[WARNING] HCCL(618666,python3.9):2025-04-03-09:27:43.297.509 [externalinput.cc:672] [618983][Parse][MultiQpSrcPortConfigPath]environmental variable HCCL_RDMA_QP_PORT_CONFIG_PATH is empty,but HCCL_RDMA_QP_PORT_CONFIG_PATH is not set
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.297.491 [ra_peer.c:776]tid:618987,ra_peer_init(776) : [init][ra_peer]ra_peer_init phy_id[1] start
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.504 [externalinput.cc:877] [618982]HCCL_SOCKET_IFNAME set by default to [EmptyString]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.517 [externalinput.cc:844] [618982]HCCL_SOCKET_FAMILY is not set and is used by default [AF_INET]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.529 [externalinput.cc:728] [618982]HCCL_DEVICE_NIC_DISABLE set by default to [0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.540 [externalinput.cc:758] [618982]HCCL_HOST_RDMA_ENABLE set by default to [0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.511 [externalinput.cc:1929] [618986]HCCL_ENTRY_LOG_ENABLE set by default to [0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.525 [externalinput.cc:1949] [618986]HCCL_INTER_HCCS_DISABLE is not set, default value is 0.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.537 [externalinput.cc:1969] [618986]HCCL_INTER_VNIC_DISABLE is not set, default value is 0.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.531 [externalinput.cc:1807] [618985]HCCL_OP_BASE_FFTS_MODE_ENABLE set by default to [true]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.544 [externalinput.cc:515] [618985]HCCL_DETERMINISTIC set by default to [false]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.555 [externalinput.cc:1841] [618985]HCCL_DIAGNOSE_ENABLE set by default to [0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.568 [externalinput.cc:1929] [618985]HCCL_ENTRY_LOG_ENABLE set by default to [0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.547 [op_base.cc:144] [618984][GetHcclOpInfoCtx] Set device, use g_hcclDeviceId[4] 
[WARNING] HCCL(618666,python3.9):2025-04-03-09:27:43.297.540 [env_config.cc:127] [618983]HCCL_HOST_SOCKET_PORT_RANGE is not set. Multi-process will not be supported!
[WARNING] HCCL(618666,python3.9):2025-04-03-09:27:43.297.554 [env_config.cc:131] [618983]HCCL_NPU_SOCKET_PORT_RANGE is not set. Multi-process will not be supported!
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.569 [env_config.cc:302] [618983]HCCL_RDMA_TC set by default to [132]
[INFO] ROCE(618650,python3.9):2025-04-03-09:27:43.297.565 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.553 [externalinput.cc:806] [618982]HCCL_IF_BASE_PORT set by default to [60000]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.569 [externalinput.cc:1508] [618982]HCCL_ALGO is not set
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.581 [externalinput.cc:1671] [618982][CannVersion][Verification]environmental variable LD_LIBRARY_PATH is too long, actual len[1291], maxlen[1024]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.597 [externalinput.cc:462] [618982]HCCL_HIGH_PERF_ENABLE set by default to [0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.556 [externalinput.cc:2005] [618986]HCCL_OP_EXPANSION_MODE is not set, aicpuUnfold is [0], aivMode is [0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.571 [externalinput.cc:2036] [618986]environmental variable ASCEND_MC2_DEBUG_MODE is not set
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.584 [externalinput.cc:2209] [618986]HCCL_CONCURRENT_ENABLE is not set, default value is [0].
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.595 [externalinput.cc:2178] [618986][ParseRetryEnable] HCCL_OP_RETRY_ENABLE is not set. The retryEnable of all levels is set to false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.582 [externalinput.cc:1949] [618985]HCCL_INTER_HCCS_DISABLE is not set, default value is 0.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.597 [externalinput.cc:1969] [618985]HCCL_INTER_VNIC_DISABLE is not set, default value is 0.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.581 [env_config.cc:302] [618983]HCCL_RDMA_SL set by default to [4]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.594 [op_base.cc:1091] [618983]Entry-HcclCommInitRootInfoInner:ranks[8], rank[5], rootinfo: host ip[192.168.0.44] port[60008] nicDeploy[1] identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], deviceLogicId[5]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.586 [rank_consistentcy_checker.cc:32] [618984][GetInstance] get deviceLogicId[4]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.297.613 [api_impl.cc:3100] 618984 GetDevicePhyIdByIndex: get PhyId by Index=4.
[INFO] ROCE(618650,python3.9):2025-04-03-09:27:43.297.628 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.612 [externalinput.cc:1519] [618982]HCCL_RDMA_TC set by default to [132]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.624 [externalinput.cc:1554] [618982]HCCL_RDMA_SL set by default to [4]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.611 [externalinput.cc:889] [618986]HCCL_SEND_CQ_DEPTH set by default to [8192]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.625 [externalinput.cc:914] [618986]HCCL_DFT is not set, default value is 1.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.637 [externalinput.cc:2240] [618986]HCCL_OP_COUNTER_ENABLE set by default to [1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.649 [externalinput.cc:2308] [618986]HCCL_OP_RETRY_PARAMS is not set, default value MaxCnt is 1, HoldTime is 5000, IntervalTime is 1000
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.297.632 [network_manager.cc:69] [618988]NetworkManager::GetInstance deviceLogicID[2].
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.623 [externalinput.cc:2005] [618985]HCCL_OP_EXPANSION_MODE is not set, aicpuUnfold is [0], aivMode is [0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.641 [externalinput.cc:2036] [618985]environmental variable ASCEND_MC2_DEBUG_MODE is not set
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.653 [externalinput.cc:2209] [618985]HCCL_CONCURRENT_ENABLE is not set, default value is [0].
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.617 [op_base.cc:128] [618983][HcclGetDeviceId] deviceLogicId[5] 
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.631 [op_base.cc:144] [618983][GetHcclOpInfoCtx] Set device, use g_hcclDeviceId[5] 
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.656 [rank_consistentcy_checker.cc:32] [618983][GetInstance] get deviceLogicId[5]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.297.630 [api_impl.cc:3111] 618984 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.297.644 [api_impl.cc:3130] 618984 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=4
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.297.660 [rs.c:327]tid:618987,rs_pthread_mutex_init(327) : mutex init ok
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.297.654 [network_manager.cc:169] [618988]NetworkManager: devicePhyId[2], devicePhyId_[2] deviceLogicId_[2], hasBackup[0]
[INFO[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.664 [externalinput.cc:2339] [618986]HCCL_LOGIC_SUPERPOD_ID is not set, default value[]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.677 [externalinput.cc:2296] [618986]HCCL_STUCK_DETECT_TIME is set default [612]s.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.687 [externalinput.cc:407] [618986]HCCL_RDMA_PCIE_DIRECT_POST_NOSTRICT set by default to [EmptyString], rdmaFastPost is [0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.666 [externalinput.cc:2178] [618985][ParseRetryEnable] HCCL_OP_RETRY_ENABLE is not set. The retryEnable of all levels is set to false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.680 [externalinput.cc:889] [618985]HCCL_SEND_CQ_DEPTH set by default to [8192]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.692 [externalinput.cc:914] [618985]HCCL_DFT is not set, default value is 1.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.705 [externalinput.cc:2240] [618985]HCCL_OP_COUNTER_ENABLE set by default to [1]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.297.691 [api_impl.cc:3100] 618983 GetDevicePhyIdByIndex: get PhyId by Index=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.297.706 [api_impl.cc:3111] 618983 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=5
] HCCP(618654,python3.9):2025-04-03-09:27:43.297.689 [ra_host.c:1594]tid:618988,ra_socket_set_white_list_status(1594) : Input parameters: enable[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.297.723 [adapter_hccp.cc:1450] [618988]set host socket whitelist status[0] success.
[WARNING] HCCL(618670,python3.9):2025-04-03-09:27:43.297.714 [externalinput.cc:672] [618986][Parse][MultiQpSrcPortConfigPath]environmental variable HCCL_RDMA_QP_PORT_CONFIG_PATH is empty,but HCCL_RDMA_QP_PORT_CONFIG_PATH is not set
[WARNING] HCCL(618670,python3.9):2025-04-03-09:27:43.297.736 [env_config.cc:127] [618986]HCCL_HOST_SOCKET_PORT_RANGE is not set. Multi-process will not be supported!
[WARNING] HCCL(618670,python3.9):2025-04-03-09:27:43.297.749 [env_config.cc:131] [618986]HCCL_NPU_SOCKET_PORT_RANGE is not set. Multi-process will not be supported!
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.720 [externalinput.cc:2308] [618985]HCCL_OP_RETRY_PARAMS is not set, default value MaxCnt is 1, HoldTime is 5000, IntervalTime is 1000
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.734 [externalinput.cc:2339] [618985]HCCL_LOGIC_SUPERPOD_ID is not set, default value[]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.746 [externalinput.cc:2296] [618985]HCCL_STUCK_DETECT_TIME is set default [612]s.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.757 [externalinput.cc:407] [618985]HCCL_RDMA_PCIE_DIRECT_POST_NOSTRICT set by default to [EmptyString], rdmaFastPost is [0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.297.725 [api_impl.cc:3130] 618983 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=5
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.297.759 [api_c_soc.cc:70] 618982 rtGetSocVersion: soc version is Ascend910B3
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.764 [env_config.cc:302] [618986]HCCL_RDMA_TC set by default to [132]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.777 [env_config.cc:302] [618986]HCCL_RDMA_SL set by default to [4]
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.297.758 [ra_host.c:205]tid:618988,ra_init(205) : Input parameters: phy_id[2], nic_position:[0] hdc_type:[6]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.779 [externalinput.cc:1599] [618982]HCCL_RDMA_TIMEOUT set by default to [20]
[WARNING] HCCL(618674,python3.9):2025-04-03-09:27:43.297.773 [externalinput.cc:672] [618985][Parse][MultiQpSrcPortConfigPath]environmental variable HCCL_RDMA_QP_PORT_CONFIG_PATH is empty,but HCCL_RDMA_QP_PORT_CONFIG_PATH is not set
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.790 [op_base.cc:1091] [618986]Entry-HcclCommInitRootInfoInner:ranks[8], rank[6], rootinfo: host ip[192.168.0.44] port[60008] nicDeploy[1] identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], deviceLogicId[6]
[WARNING] HCCL(618674,python3.9):2025-04-03-09:27:43.297.816 [env_config.cc:127] [618985]HCCL_HOST_SOCKET_PORT_RANGE is not set. Multi-process will not be supported!
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.798 [externalinput.cc:1633] [618982]HCCL_RDMA_RETRY_CNT set by default to [7]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.824 [externalinput.cc:1778] [618982]HCCL_BUFFSIZE set by default to [200]M
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.809 [op_base.cc:128] [618986][HcclGetDeviceId] deviceLogicId[6] 
[WARNING] HCCL(618674,python3.9):2025-04-03-09:27:43.297.832 [env_config.cc:131] [618985]HCCL_NPU_SOCKET_PORT_RANGE is not set. Multi-process will not be supported!
[INFO] ROCE(618654,python3.9):2025-04-03-09:27:43.297.818 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.839 [externalinput.cc:1807] [618982]HCCL_OP_BASE_FFTS_MODE_ENABLE set by default to [true]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.830 [op_base.cc:144] [618986][GetHcclOpInfoCtx] Set device, use g_hcclDeviceId[6] 
[WARNING] ROCE(618650,python3.9):2025-04-03-09:27:43.297.827 [network_comm.c:155]get_saved_tls_config_file_path(155) : conf_path[/home/jenkins/cert] is invalid, reason[-2].
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.850 [env_config.cc:302] [618985]HCCL_RDMA_TC set by default to [132]
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.297.839 [ra_peer.c:776]tid:618988,ra_peer_init(776) : [init][ra_peer]ra_peer_init phy_id[2] start
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.852 [externalinput.cc:515] [618982]HCCL_DETERMINISTIC set by default to [false]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.864 [externalinput.cc:1841] [618982]HCCL_DIAGNOSE_ENABLE set by default to [0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.297.853 [rank_consistentcy_checker.cc:32] [618986][GetInstance] get deviceLogicId[6]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.860 [network_manager.cc:69] [618984]NetworkManager::GetInstance deviceLogicID[4].
[WARNING] ROCE(618650,python3.9):2025-04-03-09:27:43.297.854 [network_comm.c:166]get_saved_tls_config_file_path(166) : conf_path[/home/HwDmUser/cert] is invalid, reason[-2].
[WARNING] HCCP(618650,python3.9):2025-04-03-09:27:43.297.868 [rs_ssl.c:1513]tid:618987,rs_ssl_init(1513) : can not get manage data, ret(-2). maybe not set tls
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.297.882 [rs_ssl.c:1529]tid:618987,rs_ssl_init(1529) : TLS SWITCH (0)
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.862 [env_config.cc:302] [618985]HCCL_RDMA_SL set by default to [4]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.875 [op_base.cc:1091] [618985]Entry-HcclCommInitRootInfoInner:ranks[8], rank[7], rootinfo: host ip[192.168.0.44] port[60008] nicDeploy[1] identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], deviceLogicId[7]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.876 [externalinput.cc:1929] [618982]HCCL_ENTRY_LOG_ENABLE set by default to [0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.891 [externalinput.cc:1949] [618982]HCCL_INTER_HCCS_DISABLE is not set, default value is 0.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.902 [externalinput.cc:1969] [618982]HCCL_INTER_VNIC_DISABLE is not set, default value is 0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.297.878 [api_impl.cc:3100] 618986 GetDevicePhyIdByIndex: get PhyId by Index=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.297.892 [api_impl.cc:3111] 618986 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.297.904 [api_impl.cc:3130] 618986 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=6
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.879 [network_manager.cc:169] [618984]NetworkManager: devicePhyId[4], devicePhyId_[4] deviceLogicId_[4], hasBackup[0]
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.297.917 [rs_epoll.c:692]tid:618987,rs_epoll_connect_handle_init(692) : rs_create_epoll ok
[INFO] ROCE(618654,python3.9):2025-04-03-09:27:43.297.913 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.893 [op_base.cc:128] [618985][HcclGetDeviceId] deviceLogicId[7] 
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.909 [op_base.cc:144] [618985][GetHcclOpInfoCtx] Set device, use g_hcclDeviceId[7] 
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.921 [network_manager.cc:69] [618983]NetworkManager::GetInstance deviceLogicID[5].
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.922 [externalinput.cc:2005] [618982]HCCL_OP_EXPANSION_MODE is not set, aicpuUnfold is [0], aivMode is [0]
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.297.911 [ra_host.c:1594]tid:618984,ra_socket_set_white_list_status(1594) : Input parameters: enable[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.297.931 [adapter_hccp.cc:1450] [618984]set host socket whitelist status[0] success.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.297.931 [rank_consistentcy_checker.cc:32] [618985][GetInstance] get deviceLogicId[7]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.297.967 [api_impl.cc:3100] 618985 GetDevicePhyIdByIndex: get PhyId by Index=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.297.979 [api_impl.cc:3111] 618985 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=7
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.297.938 [network_manager.cc:169] [618983]NetworkManager: devicePhyId[5], devicePhyId_[5] deviceLogicId_[5], hasBackup[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.938 [externalinput.cc:2036] [618982]environmental variable ASCEND_MC2_DEBUG_MODE is not set
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.952 [externalinput.cc:2209] [618982]HCCL_CONCURRENT_ENABLE is not set, default value is [0].
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.964 [externalinput.cc:2178] [618982][ParseRetryEnable] HCCL_OP_RETRY_ENABLE is not set. The retryEnable of all levels is set to false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.976 [externalinput.cc:889] [618982]HCCL_SEND_CQ_DEPTH set by default to [8192]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.987 [externalinput.cc:914] [618982]HCCL_DFT is not set, default value is 1.
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.297.964 [ra_host.c:205]tid:618984,ra_init(205) : Input parameters: phy_id[4], nic_position:[0] hdc_type:[6]
[INFO] ROCE(618654,python3.9):2025-04-03-09:27:43.297.985 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.297.992 [api_impl.cc:3130] 618985 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=7
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.297.980 [ra_host.c:1594]tid:618983,ra_socket_set_white_list_status(1594) : Input parameters: enable[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.298.003 [adapter_hccp.cc:1450] [618983]set host socket whitelist status[0] success.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.297.998 [externalinput.cc:2240] [618982]HCCL_OP_COUNTER_ENABLE set by default to [1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.298.011 [externalinput.cc:2308] [618982]HCCL_OP_RETRY_PARAMS is not set, default value MaxCnt is 1, HoldTime is 5000, IntervalTime is 1000
[INFO] ROCE(618662,python3.9):2025-04-03-09:27:43.298.018 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.298.025 [externalinput.cc:2339] [618982]HCCL_LOGIC_SUPERPOD_ID is not set, default value[]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.298.037 [externalinput.cc:2296] [618982]HCCL_STUCK_DETECT_TIME is set default [612]s.
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.298.017 [rs.c:327]tid:618988,rs_pthread_mutex_init(327) : mutex init ok
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.298.036 [ra_host.c:205]tid:618983,ra_init(205) : Input parameters: phy_id[5], nic_position:[0] hdc_type:[6]
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.298.034 [ra_peer.c:776]tid:618984,ra_peer_init(776) : [init][ra_peer]ra_peer_init phy_id[4] start
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.298.023 [rs_epoll.c:487]tid:618989,rs_epoll_handle(487) : <EPOLL> thread begin! thread_id:281470035488672, pid:618650, ppid:618638
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.298.047 [rs_epoll.c:713]tid:618987,rs_epoll_connect_handle_init(713) : RS INIT OK!
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.298.052 [externalinput.cc:407] [618982]HCCL_RDMA_PCIE_DIRECT_POST_NOSTRICT set by default to [EmptyString], rdmaFastPost is [0]
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.298.060 [rs_epoll.c:623]tid:618990,rs_connect_handle(623) : <SOCKET> thread begin! thread_id:281470027034528, pid:618650, ppid:618638
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.298.063 [rs.c:366]tid:618987,rs_init_rscb_cfg(366) : rs_epoll_connect_handle_init ok cost [0.167000] ms
[WARNING] HCCL(618658,python3.9):2025-04-03-09:27:43.298.066 [externalinput.cc:672] [618982][Parse][MultiQpSrcPortConfigPath]environmental variable HCCL_RDMA_QP_PORT_CONFIG_PATH is empty,but HCCL_RDMA_QP_PORT_CONFIG_PATH is not set
[WARNING] HCCL(618658,python3.9):2025-04-03-09:27:43.298.090 [env_config.cc:127] [618982]HCCL_HOST_SOCKET_PORT_RANGE is not set. Multi-process will not be supported!
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.298.086 [rs_epoll.c:415]tid:618989,bind_data_cpu(415) : host not need bind cpu, info[1]
[INFO] ROCE(618666,python3.9):2025-04-03-09:27:43.298.096 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.298.105 [rs_epoll.c:511]tid:618989,rs_epoll_handle(511) : pthread[epoll_pthread] is alive!
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.298.113 [rs_epoll.c:641]tid:618990,rs_connect_handle(641) : pthread[connect_pthread] is alive!
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.298.088 [network_manager.cc:69] [618986]NetworkManager::GetInstance deviceLogicID[6].
[INFO] ROCE(618662,python3.9):2025-04-03-09:27:43.298.088 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[WARNING] HCCL(618658,python3.9):2025-04-03-09:27:43.298.107 [env_config.cc:131] [618982]HCCL_NPU_SOCKET_PORT_RANGE is not set. Multi-process will not be supported!
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.298.109 [ra_peer.c:776]tid:618983,ra_peer_init(776) : [init][ra_peer]ra_peer_init phy_id[5] start
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.298.108 [network_manager.cc:169] [618986]NetworkManager: devicePhyId[6], devicePhyId_[6] deviceLogicId_[6], hasBackup[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.298.125 [env_config.cc:302] [618982]HCCL_RDMA_TC set by default to [132]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.298.139 [env_config.cc:302] [618982]HCCL_RDMA_SL set by default to [4]
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.298.138 [ra_host.c:1594]tid:618986,ra_socket_set_white_list_status(1594) : Input parameters: enable[0]
[INFO] ROCE(618662,python3.9):2025-04-03-09:27:43.298.145 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.298.149 [op_base.cc:1091] [618982]Entry-HcclCommInitRootInfoInner:ranks[8], rank[3], rootinfo: host ip[192.168.0.44] port[60008] nicDeploy[1] identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], deviceLogicId[3]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.298.161 [adapter_hccp.cc:1450] [618986]set host socket whitelist status[0] success.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.298.170 [op_base.cc:128] [618982][HcclGetDeviceId] deviceLogicId[3] 
[INFO] ROCE(618666,python3.9):2025-04-03-09:27:43.298.182 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.298.176 [rs.c:327]tid:618984,rs_pthread_mutex_init(327) : mutex init ok
[WARNING] ROCE(618654,python3.9):2025-04-03-09:27:43.298.184 [network_comm.c:155]get_saved_tls_config_file_path(155) : conf_path[/home/jenkins/cert] is invalid, reason[-2].
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.298.196 [op_base.cc:144] [618982][GetHcclOpInfoCtx] Set device, use g_hcclDeviceId[3] 
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.298.197 [ra_host.c:205]tid:618986,ra_init(205) : Input parameters: phy_id[6], nic_position:[0] hdc_type:[6]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.298.198 [network_manager.cc:69] [618985]NetworkManager::GetInstance deviceLogicID[7].
[WARNING] ROCE(618654,python3.9):2025-04-03-09:27:43.298.211 [network_comm.c:166]get_saved_tls_config_file_path(166) : conf_path[/home/HwDmUser/cert] is invalid, reason[-2].
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.298.224 [network_manager.cc:169] [618985]NetworkManager: devicePhyId[7], devicePhyId_[7] deviceLogicId_[7], hasBackup[0]
[WARNING] HCCP(618654,python3.9):2025-04-03-09:27:43.298.228 [rs_ssl.c:1513]tid:618988,rs_ssl_init(1513) : can not get manage data, ret(-2). maybe not set tls
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.298.243 [rs_ssl.c:1529]tid:618988,rs_ssl_init(1529) : TLS SWITCH (0)
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.298.224 [rank_consistentcy_checker.cc:32] [618982][GetInstance] get deviceLogicId[3]
[INFO] ROCE(618666,python3.9):2025-04-03-09:27:43.298.257 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] ROCE(618670,python3.9):2025-04-03-09:27:43.298.250 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.298.260 [api_impl.cc:3100] 618982 GetDevicePhyIdByIndex: get PhyId by Index=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.298.276 [api_impl.cc:3111] 618982 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=3
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.298.257 [ra_host.c:1594]tid:618985,ra_socket_set_white_list_status(1594) : Input parameters: enable[0]
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.298.267 [ra_peer.c:776]tid:618986,ra_peer_init(776) : [init][ra_peer]ra_peer_init phy_id[6] start
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.298.286 [adapter_hccp.cc:1450] [618985]set host socket whitelist status[0] success.
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.298.284 [rs_epoll.c:692]tid:618988,rs_epoll_connect_handle_init(692) : rs_create_epoll ok
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.298.285 [rs.c:327]tid:618983,rs_pthread_mutex_init(327) : mutex init ok
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.298.290 [api_impl.cc:3130] 618982 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=3
[WARNING] ROCE(618662,python3.9):2025-04-03-09:27:43.298.310 [network_comm.c:155]get_saved_tls_config_file_path(155) : conf_path[/home/jenkins/cert] is invalid, reason[-2].
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.298.319 [ra_host.c:205]tid:618985,ra_init(205) : Input parameters: phy_id[7], nic_position:[0] hdc_type:[6]
[WARNING] ROCE(618662,python3.9):2025-04-03-09:27:43.298.336 [network_comm.c:166]get_saved_tls_config_file_path(166) : conf_path[/home/HwDmUser/cert] is invalid, reason[-2].
[INFO] ROCE(618670,python3.9):2025-04-03-09:27:43.298.338 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] ROCE(618674,python3.9):2025-04-03-09:27:43.298.365 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[WARNING] HCCP(618662,python3.9):2025-04-03-09:27:43.298.352 [rs_ssl.c:1513]tid:618984,rs_ssl_init(1513) : can not get manage data, ret(-2). maybe not set tls
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.298.379 [rs_ssl.c:1529]tid:618984,rs_ssl_init(1529) : TLS SWITCH (0)
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.298.381 [ra_peer.c:776]tid:618985,ra_peer_init(776) : [init][ra_peer]ra_peer_init phy_id[7] start
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.298.387 [rs_epoll.c:487]tid:618991,rs_epoll_handle(487) : <EPOLL> thread begin! thread_id:281469221728160, pid:618654, ppid:618638
[INFO] ROCE(618670,python3.9):2025-04-03-09:27:43.298.403 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.298.408 [rs_epoll.c:692]tid:618984,rs_epoll_connect_handle_init(692) : rs_create_epoll ok
[WARNING] ROCE(618666,python3.9):2025-04-03-09:27:43.298.434 [network_comm.c:155]get_saved_tls_config_file_path(155) : conf_path[/home/jenkins/cert] is invalid, reason[-2].
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.298.433 [rs.c:327]tid:618986,rs_pthread_mutex_init(327) : mutex init ok
[WARNING] ROCE(618666,python3.9):2025-04-03-09:27:43.298.455 [network_comm.c:166]get_saved_tls_config_file_path(166) : conf_path[/home/HwDmUser/cert] is invalid, reason[-2].
[INFO] ROCE(618674,python3.9):2025-04-03-09:27:43.298.448 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[WARNING] HCCP(618666,python3.9):2025-04-03-09:27:43.298.469 [rs_ssl.c:1513]tid:618983,rs_ssl_init(1513) : can not get manage data, ret(-2). maybe not set tls
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.298.482 [rs_ssl.c:1529]tid:618983,rs_ssl_init(1529) : TLS SWITCH (0)
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.298.480 [rs_epoll.c:415]tid:618991,bind_data_cpu(415) : host not need bind cpu, info[1]
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.298.494 [rs_epoll.c:713]tid:618988,rs_epoll_connect_handle_init(713) : RS INIT OK!
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.298.503 [rs_epoll.c:511]tid:618991,rs_epoll_handle(511) : pthread[epoll_pthread] is alive!
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.298.500 [rs_epoll.c:623]tid:618993,rs_connect_handle(623) : <SOCKET> thread begin! thread_id:281468802690976, pid:618654, ppid:618638
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.298.513 [rs_epoll.c:692]tid:618983,rs_epoll_connect_handle_init(692) : rs_create_epoll ok
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.298.503 [network_manager.cc:69] [618982]NetworkManager::GetInstance deviceLogicID[3].
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.298.510 [rs.c:366]tid:618988,rs_init_rscb_cfg(366) : rs_epoll_connect_handle_init ok cost [0.251000] ms
[INFO] ROCE(618674,python3.9):2025-04-03-09:27:43.298.511 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.298.525 [network_manager.cc:169] [618982]NetworkManager: devicePhyId[3], devicePhyId_[3] deviceLogicId_[3], hasBackup[0]
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.298.515 [rs_epoll.c:487]tid:618992,rs_epoll_handle(487) : <EPOLL> thread begin! thread_id:281469892816800, pid:618662, ppid:618638
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.298.540 [rs.c:327]tid:618985,rs_pthread_mutex_init(327) : mutex init ok
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.298.554 [ra_host.c:1594]tid:618982,ra_socket_set_white_list_status(1594) : Input parameters: enable[0]
[WARNING] ROCE(618670,python3.9):2025-04-03-09:27:43.298.554 [network_comm.c:155]get_saved_tls_config_file_path(155) : conf_path[/home/jenkins/cert] is invalid, reason[-2].
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.298.563 [rs_epoll.c:641]tid:618993,rs_connect_handle(641) : pthread[connect_pthread] is alive!
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.298.576 [adapter_hccp.cc:1450] [618982]set host socket whitelist status[0] success.
[WARNING] ROCE(618670,python3.9):2025-04-03-09:27:43.298.579 [network_comm.c:166]get_saved_tls_config_file_path(166) : conf_path[/home/HwDmUser/cert] is invalid, reason[-2].
[WARNING] HCCP(618670,python3.9):2025-04-03-09:27:43.298.594 [rs_ssl.c:1513]tid:618986,rs_ssl_init(1513) : can not get manage data, ret(-2). maybe not set tls
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.298.615 [rs_ssl.c:1529]tid:618986,rs_ssl_init(1529) : TLS SWITCH (0)
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.298.610 [ra_host.c:205]tid:618982,ra_init(205) : Input parameters: phy_id[3], nic_position:[0] hdc_type:[6]
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.298.607 [rs_epoll.c:415]tid:618992,bind_data_cpu(415) : host not need bind cpu, info[1]
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.298.626 [rs_epoll.c:713]tid:618984,rs_epoll_connect_handle_init(713) : RS INIT OK!
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.298.628 [rs_epoll.c:511]tid:618992,rs_epoll_handle(511) : pthread[epoll_pthread] is alive!
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.298.633 [rs_epoll.c:623]tid:618994,rs_connect_handle(623) : <SOCKET> thread begin! thread_id:281469473779616, pid:618662, ppid:618638
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.298.644 [rs.c:366]tid:618984,rs_init_rscb_cfg(366) : rs_epoll_connect_handle_init ok cost [0.252000] ms
[INFO] ROCE(618658,python3.9):2025-04-03-09:27:43.298.658 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.298.644 [rs_epoll.c:692]tid:618986,rs_epoll_connect_handle_init(692) : rs_create_epoll ok
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.298.682 [rs_epoll.c:487]tid:618995,rs_epoll_handle(487) : <EPOLL> thread begin! thread_id:281468802690976, pid:618666, ppid:618638
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.298.675 [ra_peer.c:776]tid:618982,ra_peer_init(776) : [init][ra_peer]ra_peer_init phy_id[3] start
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.298.688 [rs_epoll.c:641]tid:618994,rs_connect_handle(641) : pthread[connect_pthread] is alive!
[WARNING] ROCE(618674,python3.9):2025-04-03-09:27:43.298.685 [network_comm.c:155]get_saved_tls_config_file_path(155) : conf_path[/home/jenkins/cert] is invalid, reason[-2].
[WARNING] ROCE(618674,python3.9):2025-04-03-09:27:43.298.712 [network_comm.c:166]get_saved_tls_config_file_path(166) : conf_path[/home/HwDmUser/cert] is invalid, reason[-2].
[WARNING] HCCP(618674,python3.9):2025-04-03-09:27:43.298.726 [rs_ssl.c:1513]tid:618985,rs_ssl_init(1513) : can not get manage data, ret(-2). maybe not set tls
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.298.740 [rs_ssl.c:1529]tid:618985,rs_ssl_init(1529) : TLS SWITCH (0)
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.298.729 [rs_epoll.c:415]tid:618995,bind_data_cpu(415) : host not need bind cpu, info[1]
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.298.735 [rs_epoll.c:713]tid:618983,rs_epoll_connect_handle_init(713) : RS INIT OK!
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.298.747 [rs_epoll.c:511]tid:618995,rs_epoll_handle(511) : pthread[epoll_pthread] is alive!
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.298.746 [rs_epoll.c:623]tid:618997,rs_connect_handle(623) : <SOCKET> thread begin! thread_id:281468794236832, pid:618666, ppid:618638
[INFO] ROCE(618658,python3.9):2025-04-03-09:27:43.298.742 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.298.742 [rs_epoll.c:487]tid:618996,rs_epoll_handle(487) : <EPOLL> thread begin! thread_id:281469699944352, pid:618670, ppid:618638
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.298.752 [rs.c:366]tid:618983,rs_init_rscb_cfg(366) : rs_epoll_connect_handle_init ok cost [0.259000] ms
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.298.771 [rs_epoll.c:713]tid:618986,rs_epoll_connect_handle_init(713) : RS INIT OK!
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.298.782 [rs_epoll.c:692]tid:618985,rs_epoll_connect_handle_init(692) : rs_create_epoll ok
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.298.787 [rs_epoll.c:623]tid:618998,rs_connect_handle(623) : <SOCKET> thread begin! thread_id:281469691490208, pid:618670, ppid:618638
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.298.790 [rs.c:366]tid:618986,rs_init_rscb_cfg(366) : rs_epoll_connect_handle_init ok cost [0.161000] ms
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.298.791 [rs_epoll.c:415]tid:618996,bind_data_cpu(415) : host not need bind cpu, info[1]
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.298.805 [rs_epoll.c:641]tid:618997,rs_connect_handle(641) : pthread[connect_pthread] is alive!
[INFO] ROCE(618658,python3.9):2025-04-03-09:27:43.298.802 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.298.825 [rs_epoll.c:511]tid:618996,rs_epoll_handle(511) : pthread[epoll_pthread] is alive!
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.298.833 [rs.c:327]tid:618982,rs_pthread_mutex_init(327) : mutex init ok
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.298.842 [rs_epoll.c:641]tid:618998,rs_connect_handle(641) : pthread[connect_pthread] is alive!
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.298.869 [rs_epoll.c:487]tid:618999,rs_epoll_handle(487) : <EPOLL> thread begin! thread_id:281469163073440, pid:618674, ppid:618638
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.298.897 [rs_epoll.c:713]tid:618985,rs_epoll_connect_handle_init(713) : RS INIT OK!
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.298.908 [rs_epoll.c:623]tid:619000,rs_connect_handle(623) : <SOCKET> thread begin! thread_id:281469154619296, pid:618674, ppid:618638
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.298.921 [rs_epoll.c:415]tid:618999,bind_data_cpu(415) : host not need bind cpu, info[1]
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.298.926 [rs.c:366]tid:618985,rs_init_rscb_cfg(366) : rs_epoll_connect_handle_init ok cost [0.171000] ms
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.298.940 [rs_epoll.c:511]tid:618999,rs_epoll_handle(511) : pthread[epoll_pthread] is alive!
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.298.957 [rs_epoll.c:641]tid:619000,rs_connect_handle(641) : pthread[connect_pthread] is alive!
[WARNING] ROCE(618658,python3.9):2025-04-03-09:27:43.298.944 [network_comm.c:155]get_saved_tls_config_file_path(155) : conf_path[/home/jenkins/cert] is invalid, reason[-2].
[WARNING] ROCE(618658,python3.9):2025-04-03-09:27:43.298.968 [network_comm.c:166]get_saved_tls_config_file_path(166) : conf_path[/home/HwDmUser/cert] is invalid, reason[-2].
[WARNING] HCCP(618658,python3.9):2025-04-03-09:27:43.298.986 [rs_ssl.c:1513]tid:618982,rs_ssl_init(1513) : can not get manage data, ret(-2). maybe not set tls
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.299.010 [rs_ssl.c:1529]tid:618982,rs_ssl_init(1529) : TLS SWITCH (0)
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.299.033 [rs_epoll.c:692]tid:618982,rs_epoll_connect_handle_init(692) : rs_create_epoll ok
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.299.112 [rs_epoll.c:487]tid:619001,rs_epoll_handle(487) : <EPOLL> thread begin! thread_id:281469716852640, pid:618658, ppid:618638
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.299.148 [rs_epoll.c:713]tid:618982,rs_epoll_connect_handle_init(713) : RS INIT OK!
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.299.158 [rs_epoll.c:415]tid:619001,bind_data_cpu(415) : host not need bind cpu, info[1]
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.299.161 [rs_epoll.c:623]tid:619002,rs_connect_handle(623) : <SOCKET> thread begin! thread_id:281469708398496, pid:618658, ppid:618638
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.299.166 [rs.c:366]tid:618982,rs_init_rscb_cfg(366) : rs_epoll_connect_handle_init ok cost [0.145000] ms
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.299.173 [rs_epoll.c:511]tid:619001,rs_epoll_handle(511) : pthread[epoll_pthread] is alive!
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.299.221 [rs_epoll.c:641]tid:619002,rs_connect_handle(641) : pthread[connect_pthread] is alive!
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:43.300.184 [trs_cb_event.c:119][ascend][curpid:618650,618828][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =320; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:43.300.185 [trs_cb_event.c:119][ascend][curpid:618650,618829][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =321; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:43.300.211 [trs_sqcq.c:1491][ascend][curpid:618650,618828][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:43.300.223 [trs_sqcq.c:1491][ascend][curpid:618650,618829][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:43.300.226 [npu_driver.cc:3833] 618828 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=320, drvRetCode=16.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:43.300.237 [npu_driver.cc:3833] 618829 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:43.300.240 [api_impl.cc:5058] 618828 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:43.300.265 [api_impl.cc:5058] 618829 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.300.269 [callback.cpp:132]618828 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.300.278 [callback.cpp:132]618829 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.300.281 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.300.292 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.300.296 [npu_driver.cc:3828] 618828 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=320.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.300.305 [npu_driver.cc:3828] 618829 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=321.
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.070 [rs.c:471]tid:618987,rs_init(471) : rs init success, chip_id[1]
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.096 [ra_peer.c:813]tid:618987,ra_peer_init(813) : [init][ra_peer]ra_peer_init phy_id[1] succ
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.306.113 [adapter_hccp.cc:583] [618987]init ra success.
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.107 [rs.c:471]tid:618983,rs_init(471) : rs init success, chip_id[5]
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.136 [ra_peer.c:813]tid:618983,ra_peer_init(813) : [init][ra_peer]ra_peer_init phy_id[5] succ
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.102 [rs.c:471]tid:618984,rs_init(471) : rs init success, chip_id[4]
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.132 [ra_peer.c:813]tid:618984,ra_peer_init(813) : [init][ra_peer]ra_peer_init phy_id[4] succ
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.100 [rs.c:471]tid:618982,rs_init(471) : rs init success, chip_id[3]
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.132 [ra_peer.c:813]tid:618982,ra_peer_init(813) : [init][ra_peer]ra_peer_init phy_id[3] succ
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.100 [rs.c:471]tid:618988,rs_init(471) : rs init success, chip_id[2]
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.132 [ra_peer.c:813]tid:618988,ra_peer_init(813) : [init][ra_peer]ra_peer_init phy_id[2] succ
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.114 [rs.c:471]tid:618986,rs_init(471) : rs init success, chip_id[6]
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.142 [ra_peer.c:813]tid:618986,ra_peer_init(813) : [init][ra_peer]ra_peer_init phy_id[6] succ
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.306.129 [network_manager.cc:222] [618987]NetworkManager nicDeploy[0] deviceLogicId_[1] devicePhyId_[1] init ra OK, nicSocketMap size[0], isHostUseDevNic[0]
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.112 [rs.c:471]tid:618985,rs_init(471) : rs init success, chip_id[7]
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.141 [ra_peer.c:813]tid:618985,ra_peer_init(813) : [init][ra_peer]ra_peer_init phy_id[7] succ
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.306.152 [adapter_hccp.cc:583] [618984]init ra success.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.306.152 [adapter_hccp.cc:583] [618983]init ra success.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.306.154 [adapter_hccp.cc:583] [618988]init ra success.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.306.168 [network_manager.cc:222] [618988]NetworkManager nicDeploy[0] deviceLogicId_[2] devicePhyId_[2] init ra OK, nicSocketMap size[0], isHostUseDevNic[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.306.159 [adapter_hccp.cc:583] [618986]init ra success.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.306.172 [network_manager.cc:222] [618986]NetworkManager nicDeploy[0] deviceLogicId_[6] devicePhyId_[6] init ra OK, nicSocketMap size[0], isHostUseDevNic[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.306.153 [adapter_hccp.cc:583] [618982]init ra success.
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.152 [ra_host.c:1764]tid:618987,ra_get_ifnum(1764) : Input parameters: phy_id[1], nic_position:[0], is_all:[0]
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.172 [ra_peer.c:859]tid:618987,ra_peer_get_ifnum(859) : [get][ra_peer_ifnum]ra_peer_get_ifnum phy_id[1] start
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.306.158 [adapter_hccp.cc:583] [618985]init ra success.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.306.174 [network_manager.cc:222] [618985]NetworkManager nicDeploy[0] deviceLogicId_[7] devicePhyId_[7] init ra OK, nicSocketMap size[0], isHostUseDevNic[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.306.168 [network_manager.cc:222] [618984]NetworkManager nicDeploy[0] deviceLogicId_[4] devicePhyId_[4] init ra OK, nicSocketMap size[0], isHostUseDevNic[0]
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.203 [ra_host.c:1764]tid:618984,ra_get_ifnum(1764) : Input parameters: phy_id[4], nic_position:[0], is_all:[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.306.166 [network_manager.cc:222] [618983]NetworkManager nicDeploy[0] deviceLogicId_[5] devicePhyId_[5] init ra OK, nicSocketMap size[0], isHostUseDevNic[0]
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.193 [ra_host.c:1764]tid:618983,ra_get_ifnum(1764) : Input parameters: phy_id[5], nic_position:[0], is_all:[0]
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.191 [ra_host.c:1764]tid:618988,ra_get_ifnum(1764) : Input parameters: phy_id[2], nic_position:[0], is_all:[0]
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.213 [ra_peer.c:859]tid:618988,ra_peer_get_ifnum(859) : [get][ra_peer_ifnum]ra_peer_get_ifnum phy_id[2] start
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.189 [ra_host.c:1764]tid:618986,ra_get_ifnum(1764) : Input parameters: phy_id[6], nic_position:[0], is_all:[0]
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.209 [ra_peer.c:859]tid:618986,ra_peer_get_ifnum(859) : [get][ra_peer_ifnum]ra_peer_get_ifnum phy_id[6] start
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.306.191 [network_manager.cc:222] [618982]NetworkManager nicDeploy[0] deviceLogicId_[3] devicePhyId_[3] init ra OK, nicSocketMap size[0], isHostUseDevNic[0]
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.211 [ra_host.c:1764]tid:618982,ra_get_ifnum(1764) : Input parameters: phy_id[3], nic_position:[0], is_all:[0]
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.228 [ra_peer.c:859]tid:618982,ra_peer_get_ifnum(859) : [get][ra_peer_ifnum]ra_peer_get_ifnum phy_id[3] start
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.198 [ra_peer.c:867]tid:618987,ra_peer_get_ifnum(867) : [get][ra_peer_ifnum]ra_peer_get_ifnum phy_id[1] succ
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.306.213 [adapter_hccp.cc:1378] [618987][Get][HostIf]hrtGetIfNum success. ifAddrNum[6].
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.226 [ra_host.c:1814]tid:618987,ra_get_ifaddrs(1814) : Input parameters: phy_id[1], nic_position:[0], is_all[0], interface num[6]
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.205 [ra_host.c:1764]tid:618985,ra_get_ifnum(1764) : Input parameters: phy_id[7], nic_position:[0], is_all:[0]
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.223 [ra_peer.c:859]tid:618985,ra_peer_get_ifnum(859) : [get][ra_peer_ifnum]ra_peer_get_ifnum phy_id[7] start
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.223 [ra_peer.c:859]tid:618984,ra_peer_get_ifnum(859) : [get][ra_peer_ifnum]ra_peer_get_ifnum phy_id[4] start
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.248 [ra_peer.c:867]tid:618984,ra_peer_get_ifnum(867) : [get][ra_peer_ifnum]ra_peer_get_ifnum phy_id[4] succ
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.222 [ra_peer.c:859]tid:618983,ra_peer_get_ifnum(859) : [get][ra_peer_ifnum]ra_peer_get_ifnum phy_id[5] start
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.245 [ra_peer.c:867]tid:618983,ra_peer_get_ifnum(867) : [get][ra_peer_ifnum]ra_peer_get_ifnum phy_id[5] succ
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.237 [ra_peer.c:867]tid:618988,ra_peer_get_ifnum(867) : [get][ra_peer_ifnum]ra_peer_get_ifnum phy_id[2] succ
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.306.251 [adapter_hccp.cc:1378] [618988][Get][HostIf]hrtGetIfNum success. ifAddrNum[6].
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.226 [ra_peer.c:867]tid:618986,ra_peer_get_ifnum(867) : [get][ra_peer_ifnum]ra_peer_get_ifnum phy_id[6] succ
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.306.241 [adapter_hccp.cc:1378] [618986][Get][HostIf]hrtGetIfNum success. ifAddrNum[6].
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.254 [ra_host.c:1814]tid:618986,ra_get_ifaddrs(1814) : Input parameters: phy_id[6], nic_position:[0], is_all[0], interface num[6]
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.266 [ra_peer.c:874]tid:618986,ra_peer_get_ifaddrs(874) : [get][ra_peer_ifaddrs] ra_peer_get_ifaddrs phy_id[6] start
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.250 [ra_peer.c:867]tid:618982,ra_peer_get_ifnum(867) : [get][ra_peer_ifnum]ra_peer_get_ifnum phy_id[3] succ
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.306.262 [adapter_hccp.cc:1378] [618982][Get][HostIf]hrtGetIfNum success. ifAddrNum[6].
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.239 [ra_peer.c:874]tid:618987,ra_peer_get_ifaddrs(874) : [get][ra_peer_ifaddrs] ra_peer_get_ifaddrs phy_id[1] start
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.254 [rs_socket.c:2743]tid:618987,rs_peer_fill_ifaddr_infos(2743) : ifname[lo] addr[0x0100007f]
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.267 [rs_socket.c:2743]tid:618987,rs_peer_fill_ifaddr_infos(2743) : ifname[enp67s0f5] addr[0x2c00a8c0]
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.278 [rs_socket.c:2743]tid:618987,rs_peer_fill_ifaddr_infos(2743) : ifname[docker0] addr[0x010011ac]
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.289 [rs_socket.c:2749]tid:618987,rs_peer_fill_ifaddr_infos(2749) : ifname[lo] scope_id[0] flowinfo[0]
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.250 [ra_peer.c:867]tid:618985,ra_peer_get_ifnum(867) : [get][ra_peer_ifnum]ra_peer_get_ifnum phy_id[7] succ
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.306.263 [adapter_hccp.cc:1378] [618985][Get][HostIf]hrtGetIfNum success. ifAddrNum[6].
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.278 [ra_host.c:1814]tid:618985,ra_get_ifaddrs(1814) : Input parameters: phy_id[7], nic_position:[0], is_all[0], interface num[6]
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.293 [ra_peer.c:874]tid:618985,ra_peer_get_ifaddrs(874) : [get][ra_peer_ifaddrs] ra_peer_get_ifaddrs phy_id[7] start
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.306.263 [adapter_hccp.cc:1378] [618984][Get][HostIf]hrtGetIfNum success. ifAddrNum[6].
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.278 [ra_host.c:1814]tid:618984,ra_get_ifaddrs(1814) : Input parameters: phy_id[4], nic_position:[0], is_all[0], interface num[6]
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.295 [ra_peer.c:874]tid:618984,ra_peer_get_ifaddrs(874) : [get][ra_peer_ifaddrs] ra_peer_get_ifaddrs phy_id[4] start
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.306.257 [adapter_hccp.cc:1378] [618983][Get][HostIf]hrtGetIfNum success. ifAddrNum[6].
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.271 [ra_host.c:1814]tid:618983,ra_get_ifaddrs(1814) : Input parameters: phy_id[5], nic_position:[0], is_all[0], interface num[6]
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.285 [ra_peer.c:874]tid:618983,ra_peer_get_ifaddrs(874) : [get][ra_peer_ifaddrs] ra_peer_get_ifaddrs phy_id[5] start
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.299 [rs_socket.c:2743]tid:618983,rs_peer_fill_ifaddr_infos(2743) : ifname[lo] addr[0x0100007f]
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.279 [ra_host.c:1814]tid:618988,ra_get_ifaddrs(1814) : Input parameters: phy_id[2], nic_position:[0], is_all[0], interface num[6]
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.294 [ra_peer.c:874]tid:618988,ra_peer_get_ifaddrs(874) : [get][ra_peer_ifaddrs] ra_peer_get_ifaddrs phy_id[2] start
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.307 [rs_socket.c:2743]tid:618988,rs_peer_fill_ifaddr_infos(2743) : ifname[lo] addr[0x0100007f]
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.280 [rs_socket.c:2743]tid:618986,rs_peer_fill_ifaddr_infos(2743) : ifname[lo] addr[0x0100007f]
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.295 [rs_socket.c:2743]tid:618986,rs_peer_fill_ifaddr_infos(2743) : ifname[enp67s0f5] addr[0x2c00a8c0]
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.308 [rs_socket.c:2743]tid:618986,rs_peer_fill_ifaddr_infos(2743) : ifname[docker0] addr[0x010011ac]
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.320 [rs_socket.c:2749]tid:618986,rs_peer_fill_ifaddr_infos(2749) : ifname[lo] scope_id[0] flowinfo[0]
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.278 [ra_host.c:1814]tid:618982,ra_get_ifaddrs(1814) : Input parameters: phy_id[3], nic_position:[0], is_all[0], interface num[6]
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.295 [ra_peer.c:874]tid:618982,ra_peer_get_ifaddrs(874) : [get][ra_peer_ifaddrs] ra_peer_get_ifaddrs phy_id[3] start
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.310 [rs_socket.c:2743]tid:618982,rs_peer_fill_ifaddr_infos(2743) : ifname[lo] addr[0x0100007f]
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.321 [rs_socket.c:2743]tid:618982,rs_peer_fill_ifaddr_infos(2743) : ifname[enp67s0f5] addr[0x2c00a8c0]
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.302 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[0] 0x00
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.314 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[1] 0x00
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.326 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[2] 0x00
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.310 [rs_socket.c:2743]tid:618985,rs_peer_fill_ifaddr_infos(2743) : ifname[lo] addr[0x0100007f]
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.325 [rs_socket.c:2743]tid:618985,rs_peer_fill_ifaddr_infos(2743) : ifname[enp67s0f5] addr[0x2c00a8c0]
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.339 [rs_socket.c:2743]tid:618985,rs_peer_fill_ifaddr_infos(2743) : ifname[docker0] addr[0x010011ac]
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.313 [rs_socket.c:2743]tid:618984,rs_peer_fill_ifaddr_infos(2743) : ifname[lo] addr[0x0100007f]
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.329 [rs_socket.c:2743]tid:618984,rs_peer_fill_ifaddr_infos(2743) : ifname[enp67s0f5] addr[0x2c00a8c0]
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.340 [rs_socket.c:2743]tid:618984,rs_peer_fill_ifaddr_infos(2743) : ifname[docker0] addr[0x010011ac]
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.353 [rs_socket.c:2749]tid:618984,rs_peer_fill_ifaddr_infos(2749) : ifname[lo] scope_id[0] flowinfo[0]
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.311 [rs_socket.c:2743]tid:618983,rs_peer_fill_ifaddr_infos(2743) : ifname[enp67s0f5] addr[0x2c00a8c0]
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.324 [rs_socket.c:2743]tid:618983,rs_peer_fill_ifaddr_infos(2743) : ifname[docker0] addr[0x010011ac]
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.335 [rs_socket.c:2749]tid:618983,rs_peer_fill_ifaddr_infos(2749) : ifname[lo] scope_id[0] flowinfo[0]
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.349 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[0] 0x00
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.321 [rs_socket.c:2743]tid:618988,rs_peer_fill_ifaddr_infos(2743) : ifname[enp67s0f5] addr[0x2c00a8c0]
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.335 [rs_socket.c:2743]tid:618988,rs_peer_fill_ifaddr_infos(2743) : ifname[docker0] addr[0x010011ac]
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.346 [rs_socket.c:2749]tid:618988,rs_peer_fill_ifaddr_infos(2749) : ifname[lo] scope_id[0] flowinfo[0]
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.356 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[0] 0x00
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.365 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[1] 0x00
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.335 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[0] 0x00
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.349 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[1] 0x00
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.360 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[2] 0x00
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.371 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[3] 0x00
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.333 [rs_socket.c:2743]tid:618982,rs_peer_fill_ifaddr_infos(2743) : ifname[docker0] addr[0x010011ac]
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.346 [rs_socket.c:2749]tid:618982,rs_peer_fill_ifaddr_infos(2749) : ifname[lo] scope_id[0] flowinfo[0]
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.357 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[0] 0x00
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.366 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[1] 0x00
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.337 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[3] 0x00
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.350 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[4] 0x00
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.372 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[5] 0x00
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.384 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[6] 0x00
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.353 [rs_socket.c:2749]tid:618985,rs_peer_fill_ifaddr_infos(2749) : ifname[lo] scope_id[0] flowinfo[0]
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.365 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[0] 0x00
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.378 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[1] 0x00
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.389 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[2] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.364 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[0] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.379 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[1] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.390 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[2] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.401 [rs_socket.c:2751]tid:618984,rs_p[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.361 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[1] 0x00
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.372 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[2] 0x00
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.384 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[3] 0x00
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.397 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[4] 0x00
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.409 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[5] 0x00
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.379 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[2] 0x00
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.391 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[3] 0x00
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.401 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[4] 0x00
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.411 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[5] 0x00
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.419 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[6] 0x00
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.430 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[7] 0x00
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.440 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[8] 0x00
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.453 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[9] 0x00
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.463 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[10] 0x00
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.385 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[4] 0x00
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.396 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[5] 0x00
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.418 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[6] 0x00
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.378 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[2] 0x00
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.390 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[3] 0x00
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.400 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[4] 0x00
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.411 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[5] 0x00
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.423 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[6] 0x00
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.396 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[7] 0x00
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.407 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[8] 0x00
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.417 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[9] 0x00
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.428 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[10] 0x00
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.439 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[11] 0x00
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.402 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[3] 0x00
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.412 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[4] 0x00
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.423 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[5] 0x00
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.435 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[6] 0x00
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.446 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[eer_fill_ifaddr_infos(2751) : addr[3] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.426 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[4] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.436 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[5] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.448 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[6] 0x00
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.424 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[6] 0x00
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.437 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[7] 0x00
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.448 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[8] 0x00
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.461 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[9] 0x00
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.473 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[10] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.460 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[7] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.478 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[8] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.491 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[9] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.502 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[10] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.514 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[11] 0x00
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.476 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[11] 0x00
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.431 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[7] 0x00
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.445 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[8] 0x00
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.458 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[9] 0x00
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.468 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[10] 0x00
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.479 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[11] 0x00
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.436 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[7] 0x00
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.448 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[8] 0x00
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.460 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[9] 0x00
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.473 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[10] 0x00
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.484 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[11] 0x00
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.451 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[12] 0x00
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.462 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[13] 0x00
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.472 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[14] 0x00
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.484 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[15] 0x01
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.494 [rs_socket.c:2749]tid:618987,rs_peer_fill_ifaddr_infos(2749) : ifname[enp67s0f5] scope_id[2] flowinfo[0]
7] 0x00
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.478 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[8] 0x00
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.492 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[9] 0x00
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.503 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[10] 0x00
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.514 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[11] 0x00
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.486 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[11] 0x00
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.498 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[12] 0x00
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.509 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[13] 0x00
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.521 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[14] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.528 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[12] 0x00
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.488 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[12] 0x00
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.500 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[13] 0x00
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.511 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[14] 0x00
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.522 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[15] 0x01
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.534 [rs_socket.c:2749]tid:618983,rs_peer_fill_ifaddr_infos(2749) : ifname[enp67s0f5] scope_id[2] flowinfo[0]
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.492 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[12] 0x00
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.504 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[13] 0x00
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.515 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[14] 0x00
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.527 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[15] 0x01
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.538 [rs_socket.c:2749]tid:618986,rs_peer_fill_ifaddr_infos(2749) : ifname[enp67s0f5] scope_id[2] flowinfo[0]
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.547 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[0] 0xfe
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.558 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[1] 0x80
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.569 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[2] 0x00
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.589 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[3] 0x00
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.497 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[12] 0x00
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.510 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[13] 0x00
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.520 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[14] 0x00
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.532 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[15] 0x01
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.542 [rs_socket.c:2749]tid:618982,rs_peer_fill_ifaddr_infos(2749) : ifname[enp67s0f5] scope_id[2] flowinfo[0]
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.506 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[0] 0xfe
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.519 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[1] 0x80
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.529 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[2] 0x00
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.538 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[3] 0x00
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.549 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[4] 0x00
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.560 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[5] 0x00
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.529 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[12] 0x00
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.542 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[13] 0x00
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.553 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[14] 0x00
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.564 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[15] 0x01
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.532 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[15] 0x01
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.545 [rs_socket.c:2749]tid:618988,rs_peer_fill_ifaddr_infos(2749) : ifname[enp67s0f5] scope_id[2] flowinfo[0]
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.556 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[0] 0xfe
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.566 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[1] 0x80
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.576 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[2] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.543 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[13] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.555 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[14] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.566 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[15] 0x01
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.577 [rs_socket.c:2749]tid:618984,rs_peer_fill_ifaddr_infos(2749) : ifname[enp67s0f5] scope_id[2] flowinfo[0]
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.590 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[0] 0xfe
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.550 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[0] 0xfe
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.564 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[1] 0x80
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.575 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[2] 0x00
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.584 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[3] 0x00
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.593 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[4] 0x00
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.599 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[4] 0x00
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.562 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[0] 0xfe
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.576 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[1] 0x80
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.591 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[2] 0x00
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.607 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[3] 0x00
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.573 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[6] 0x00
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.584 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[7] 0x00
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.595 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[8] 0x8b
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.606 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[9] 0x0e
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.620 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[10] 0xc4
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.577 [rs_socket.c:2749]tid:618985,rs_peer_fill_ifaddr_infos(2749) : ifname[enp67s0f5] scope_id[2] flowinfo[0]
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.593 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[0] 0xfe
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.606 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[1] 0x80
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.620 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[2] 0x00
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.631 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[3] 0x00
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.592 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[3] 0x00
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.606 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[4] 0x00
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.619 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[5] 0x00
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.639 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[6] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.608 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[1] 0x80
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.622 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[2] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.633 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[3] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.645 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[4] 0x00
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.606 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[5] 0x00
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.619 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[6] 0x00
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.630 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[7] 0x00
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.641 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[8] 0x8b
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.652 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[9] 0x0e
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.609 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[5] 0x00
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.624 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[6] 0x00
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.635 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[7] 0x00
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.647 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[8] 0x8b
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.621 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[4] 0x00
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.633 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[5] 0x00
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.644 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[6] 0x00
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.655 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[7] 0x00
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.630 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[11] 0x02
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.643 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[12] 0x33
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.653 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[13] 0x1c
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.663 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[14] 0x33
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.674 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[15] 0x2f
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.644 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[4] 0x00
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.656 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[5] 0x00
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.668 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[6] 0x00
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.679 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[7] 0x00
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.690 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[8] 0x8b
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.654 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[7] 0x00
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.667 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[8] 0x8b
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.678 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[9] 0x0e
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.690 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[10] 0xc4
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.700 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[11] 0x02
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.656 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[5] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.671 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[6] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.681 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[7] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.691 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[8] 0x8b
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.701 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[9] 0x0e
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.665 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[10] 0xc4
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.675 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[11] 0x02
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.686 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[12] 0x33
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.698 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[13] 0x1c
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.709 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[14] 0x33
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.658 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[9] 0x0e
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.672 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[10] 0xc4
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.684 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[11] 0x02
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.695 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[12] 0x33
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.705 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[13] 0x1c
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.668 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[8] 0x8b
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.680 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[9] 0x0e
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.690 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[10] 0xc4
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.701 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[11] 0x02
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.712 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[12] 0x33
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.723 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[13] 0x1c
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.685 [rs_socket.c:2749]tid:618987,rs_peer_fill_ifaddr_infos(2749) : ifname[endvnic] scope_id[7] flowinfo[0]
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.699 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[0] 0xfe
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.717 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[1] 0x80
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.729 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[2] 0x00
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.740 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[3] 0x00
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.702 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[9] 0x0e
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.715 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[10] 0xc4
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.725 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[11] 0x02
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.735 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[12] 0x33
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.748 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[13] 0x1c
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.713 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[12] 0x33
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.727 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[13] 0x1c
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.736 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[14] 0x33
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.749 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[15] 0x2f
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.762 [rs_socket.c:2749]tid:618988,rs_peer_fill_ifaddr_infos(2749) : ifname[endvnic] scope_id[7] flowinfo[0]
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.714 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[10] 0xc4
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.726 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[11] 0x02
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.736 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[12] 0x33
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.748 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[13] 0x1c
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.761 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[14] 0x33
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.718 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[14] 0x33
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.729 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[15] 0x2f
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.742 [rs_socket.c:2749]tid:618983,rs_peer_fill_ifaddr_infos(2749) : ifname[endvnic] scope_id[7] flowinfo[0]
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.753 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[0] 0xfe
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.763 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[1] 0x80
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.775 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[2] 0x00
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.721 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[15] 0x2f
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.734 [rs_socket.c:2749]tid:618986,rs_peer_fill_ifaddr_infos(2749) : ifname[endvnic] scope_id[7] flowinfo[0]
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.748 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[0] 0xfe
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.759 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[1] 0x80
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.736 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[14] 0x33
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.749 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[15] 0x2f
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.761 [rs_socket.c:2749]tid:618982,rs_peer_fill_ifaddr_infos(2749) : ifname[endvnic] scope_id[7] flowinfo[0]
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.774 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[0] 0xfe
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.786 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[1] 0x80
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.754 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[4] 0x00
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.768 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[5] 0x00
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.777 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[6] 0x00
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.789 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[7] 0x00
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.800 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[8] 0xed
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.761 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[14] 0x33
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.774 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[15] 0x2f
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.786 [rs_socket.c:2749]tid:618985,rs_peer_fill_ifaddr_infos(2749) : ifname[endvnic] scope_id[7] flowinfo[0]
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.800 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[0] 0xfe
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.811 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[1] 0x80
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.775 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[0] 0xfe
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.788 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[1] 0x80
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.799 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[2] 0x00
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.812 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[3] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.774 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[15] 0x2f
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.791 [rs_socket.c:2749]tid:618984,rs_peer_fill_ifaddr_infos(2749) : ifname[endvnic] scope_id[7] flowinfo[0]
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.817 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[0] 0xfe
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.790 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[3] 0x00
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.802 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[4] 0x00
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.816 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[5] 0x00
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.777 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[2] 0x00
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.790 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[3] 0x00
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.800 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[4] 0x00
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.813 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[5] 0x00
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.824 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[6] 0x00
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.836 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[7] 0x00
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.798 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[2] 0x00
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.817 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[3] 0x00
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.828 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[4] 0x00
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.838 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[5] 0x00
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.814 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[9] 0xaf
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.826 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[10] 0x6d
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.838 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[11] 0xc3
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.847 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[12] 0x6f
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.857 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[13] 0xad
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.824 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[2] 0x00
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.839 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[3] 0x00
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.853 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[4] 0x00
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.824 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[4] 0x00
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.839 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[5] 0x00
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.853 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[6] 0x00
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.866 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[7] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.830 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[1] 0x80
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.843 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[2] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.855 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[3] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.868 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[4] 0x00
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.829 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[6] 0x00
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.840 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[7] 0x00
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.854 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[8] 0xed
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.868 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[9] 0xaf
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.880 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[10] 0x6d
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.849 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[8] 0xed
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.862 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[9] 0xaf
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.871 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[10] 0x6d
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.883 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[11] 0xc3
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.853 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[6] 0x00
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.868 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[7] 0x00
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.880 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[8] 0xed
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.890 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[9] 0xaf
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.900 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[10] 0x6d
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.871 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[14] 0xb4
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.884 [rs_socket.c:2751]tid:618987,rs_peer_fill_ifaddr_infos(2751) : addr[15] 0xb2
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.306.894 [ra_peer.c:882]tid:618987,ra_peer_get_ifaddrs(882) : [get][ra_peer_ifaddrs] ra_peer_get_ifaddrs phy_id[1] succ
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.869 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[5] 0x00
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.884 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[6] 0x00
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.895 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[7] 0x00
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.908 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[8] 0xed
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.877 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[8] 0xed
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.891 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[9] 0xaf
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.900 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[10] 0x6d
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.910 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[11] 0xc3
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.923 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[12] 0x6f
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.881 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[5] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.894 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[6] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.908 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[7] 0x00
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.924 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[8] 0xed
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.893 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[11] 0xc3
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.908 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[12] 0x6f
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.922 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[13] 0xad
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.933 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[14] 0xb4
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.894 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[12] 0x6f
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.907 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[13] 0xad
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.920 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[14] 0xb4
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.930 [rs_socket.c:2751]tid:618986,rs_peer_fill_ifaddr_infos(2751) : addr[15] 0xb2
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.306.941 [ra_peer.c:882]tid:618986,ra_peer_get_ifaddrs(882) : [get][ra_peer_ifaddrs] ra_peer_get_ifaddrs phy_id[6] succ
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.911 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[11] 0xc3
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.925 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[12] 0x6f
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.945 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[13] 0xad
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.306.913 [adapter_hccp.cc:1407] [618987][Get][HostIf]hrtGetIfAddress: idx[0] ifname[lo] ip[127.0.0.1%lo]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.306.930 [adapter_hccp.cc:1407] [618987][Get][HostIf]hrtGetIfAddress: idx[1] ifname[enp67s0f5] ip[192.168.0.44%enp67s0f5]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.306.944 [adapter_hccp.cc:1407] [618987][Get][HostIf]hrtGetIfAddress: idx[2] ifname[docker0] ip[172.17.0.1%docker0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.306.957 [adapter_hccp.cc:1407] [618987][Get][HostIf]hrtGetIfAddress: idx[3] ifname[lo] ip[::1%lo]
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.925 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[9] 0xaf
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.936 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[10] 0x6d
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.947 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[11] 0xc3
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.957 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[12] 0x6f
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.969 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[13] 0xad
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.936 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[13] 0xad
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.948 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[14] 0xb4
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.960 [rs_socket.c:2751]tid:618988,rs_peer_fill_ifaddr_infos(2751) : addr[15] 0xb2
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.306.971 [ra_peer.c:882]tid:618988,ra_peer_get_ifaddrs(882) : [get][ra_peer_ifaddrs] ra_peer_get_ifaddrs phy_id[2] succ
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.936 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[9] 0xaf
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.949 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[10] 0x6d
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.960 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[11] 0xc3
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.971 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[12] 0x6f
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.943 [rs_socket.c:2751]tid:618983,rs_peer_fill_ifaddr_infos(2751) : addr[15] 0xb2
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.306.963 [ra_peer.c:882]tid:618983,ra_peer_get_ifaddrs(882) : [get][ra_peer_ifaddrs] ra_peer_get_ifaddrs phy_id[5] succ
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.306.983 [adapter_hccp.cc:1407] [618983][Get][HostIf]hrtGetIfAddress: idx[0] ifname[lo] ip[127.0.0.1%lo]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.306.962 [adapter_hccp.cc:1407] [618986][Get][HostIf]hrtGetIfAddress: idx[0] ifname[lo] ip[127.0.0.1%lo]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.306.980 [adapter_hccp.cc:1407] [618986][Get][HostIf]hrtGetIfAddress: idx[1] ifname[enp67s0f5] ip[192.168.0.44%enp67s0f5]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.306.994 [adapter_hccp.cc:1407] [618986][Get][HostIf]hrtGetIfAddress: idx[2] ifname[docker0] ip[172.17.0.1%docker0]
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.959 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[14] 0xb4
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.973 [rs_socket.c:2751]tid:618982,rs_peer_fill_ifaddr_infos(2751) : addr[15] 0xb2
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.306.986 [ra_peer.c:882]tid:618982,ra_peer_get_ifaddrs(882) : [get][ra_peer_ifaddrs] ra_peer_get_ifaddrs phy_id[3] succ
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.307.008 [adapter_hccp.cc:1407] [618986][Get][HostIf]hrtGetIfAddress: idx[3] ifname[lo] ip[::1%lo]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.307.023 [adapter_hccp.cc:1407] [618986][Get][HostIf]hrtGetIfAddress: idx[4] ifname[enp67s0f5] ip[fe80::8b0e:c402:331c:332f%enp67s0f5]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.307.036 [adapter_hccp.cc:1407] [618986][Get][HostIf]hrtGetIfAddress: idx[5] ifname[endvnic] ip[fe80::edaf:6dc3:6fad:b4b2%endvnic]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.306.971 [adapter_hccp.cc:1407] [618987][Get][HostIf]hrtGetIfAddress: idx[4] ifname[enp67s0f5] ip[fe80::8b0e:c402:331c:332f%enp67s0f5]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.306.989 [adapter_hccp.cc:1407] [618987][Get][HostIf]hrtGetIfAddress: idx[5] ifname[endvnic] ip[fe80::edaf:6dc3:6fad:b4b2%endvnic]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.307.009 [sal.cc:365] [618987]get host ip success. host ifname[enp67s0f5] ip[192.168.0.44%enp67s0f5]
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.982 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[14] 0xb4
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.306.994 [rs_socket.c:2751]tid:618985,rs_peer_fill_ifaddr_infos(2751) : addr[15] 0xb2
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.307.004 [ra_peer.c:882]tid:618985,ra_peer_get_ifaddrs(882) : [get][ra_peer_ifaddrs] ra_peer_get_ifaddrs phy_id[7] succ
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.306.995 [adapter_hccp.cc:1407] [618988][Get][HostIf]hrtGetIfAddress: idx[0] ifname[lo] ip[127.0.0.1%lo]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.307.012 [adapter_hccp.cc:1407] [618988][Get][HostIf]hrtGetIfAddress: idx[1] ifname[enp67s0f5] ip[192.168.0.44%enp67s0f5]
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.982 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[13] 0xad
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.306.998 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[14] 0xb4
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.307.008 [rs_socket.c:2751]tid:618984,rs_peer_fill_ifaddr_infos(2751) : addr[15] 0xb2
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.307.019 [ra_peer.c:882]tid:618984,ra_peer_get_ifaddrs(882) : [get][ra_peer_ifaddrs] ra_peer_get_ifaddrs phy_id[4] succ
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.307.001 [adapter_hccp.cc:1407] [618983][Get][HostIf]hrtGetIfAddress: idx[1] ifname[enp67s0f5] ip[192.168.0.44%enp67s0f5]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.307.016 [adapter_hccp.cc:1407] [618983][Get][HostIf]hrtGetIfAddress: idx[2] ifname[docker0] ip[172.17.0.1%docker0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.307.028 [adapter_hccp.cc:1407] [618983][Get][HostIf]hrtGetIfAddress: idx[3] ifname[lo] ip[::1%lo]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.307.005 [adapter_hccp.cc:1407] [618982][Get][HostIf]hrtGetIfAddress: idx[0] ifname[lo] ip[127.0.0.1%lo]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.307.022 [adapter_hccp.cc:1407] [618982][Get][HostIf]hrtGetIfAddress: idx[1] ifname[enp67s0f5] ip[192.168.0.44%enp67s0f5]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.307.035 [adapter_hccp.cc:1407] [618982][Get][HostIf]hrtGetIfAddress: idx[2] ifname[docker0] ip[172.17.0.1%docker0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.307.051 [adapter_hccp.cc:1407] [618982][Get][HostIf]hrtGetIfAddress: idx[3] ifname[lo] ip[::1%lo]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.307.022 [sal.cc:432] [618987]nic class[normal]: find nic[192.168.0.44%enp67s0f5] success.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.307.040 [network_manager.cc:69] [618987]NetworkManager::GetInstance deviceLogicID[1].
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.307.054 [sal.cc:365] [618986]get host ip success. host ifname[enp67s0f5] ip[192.168.0.44%enp67s0f5]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.307.071 [sal.cc:432] [618986]nic class[normal]: find nic[192.168.0.44%enp67s0f5] success.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.307.023 [adapter_hccp.cc:1407] [618985][Get][HostIf]hrtGetIfAddress: idx[0] ifname[lo] ip[127.0.0.1%lo]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.307.040 [adapter_hccp.cc:1407] [618985][Get][HostIf]hrtGetIfAddress: idx[1] ifname[enp67s0f5] ip[192.168.0.44%enp67s0f5]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.307.056 [adapter_hccp.cc:1407] [618985][Get][HostIf]hrtGetIfAddress: idx[2] ifname[docker0] ip[172.17.0.1%docker0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.307.071 [adapter_hccp.cc:1407] [618985][Get][HostIf]hrtGetIfAddress: idx[3] ifname[lo] ip[::1%lo]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.307.041 [adapter_hccp.cc:1407] [618988][Get][HostIf]hrtGetIfAddress: idx[2] ifname[docker0] ip[172.17.0.1%docker0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.307.055 [adapter_hccp.cc:1407] [618988][Get][HostIf]hrtGetIfAddress: idx[3] ifname[lo] ip[::1%lo]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.307.071 [adapter_hccp.cc:1407] [618988][Get][HostIf]hrtGetIfAddress: idx[4] ifname[enp67s0f5] ip[fe80::8b0e:c402:331c:332f%enp67s0f5]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.307.038 [adapter_hccp.cc:1407] [618984][Get][HostIf]hrtGetIfAddress: idx[0] ifname[lo] ip[127.0.0.1%lo]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.307.056 [adapter_hccp.cc:1407] [618984][Get][HostIf]hrtGetIfAddress: idx[1] ifname[enp67s0f5] ip[192.168.0.44%enp67s0f5]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.307.071 [adapter_hccp.cc:1407] [618984][Get][HostIf]hrtGetIfAddress: idx[2] ifname[docker0] ip[172.17.0.1%docker0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.307.043 [adapter_hccp.cc:1407] [618983][Get][HostIf]hrtGetIfAddress: idx[4] ifname[enp67s0f5] ip[fe80::8b0e:c402:331c:332f%enp67s0f5]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.307.057 [adapter_hccp.cc:1407] [618983][Get][HostIf]hrtGetIfAddress: idx[5] ifname[endvnic] ip[fe80::edaf:6dc3:6fad:b4b2%endvnic]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.307.081 [sal.cc:365] [618983]get host ip success. host ifname[enp67s0f5] ip[192.168.0.44%enp67s0f5]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.307.066 [adapter_hccp.cc:1407] [618982][Get][HostIf]hrtGetIfAddress: idx[4] ifname[enp67s0f5] ip[fe80::8b0e:c402:331c:332f%enp67s0f5]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.307.081 [adapter_hccp.cc:1407] [618982][Get][HostIf]hrtGetIfAddress: idx[5] ifname[endvnic] ip[fe80::edaf:6dc3:6fad:b4b2%endvnic]
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:43.307.067 [ra_host.c:340]tid:618987,ra_socket_init_v1(340) : socket init:mode=0 phy_id=1 scope_id=0 family=2 ip=192.168.0.44
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.307.083 [adapter_hccp.cc:818] [618987]socket init v1 success, socketHandle[0xfffeb80fa610]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.307.096 [network_manager.cc:1218] [618987]ip[192.168.0.44%enp67s0f5] socket init OK
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.307.111 [network_manager.cc:1257] [618987]ip[192.168.0.44%enp67s0f5] socket start success socketHandle[0xfffeb80fa610]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.307.091 [network_manager.cc:69] [618986]NetworkManager::GetInstance deviceLogicID[6].
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:43.307.112 [ra_host.c:340]tid:618986,ra_socket_init_v1(340) : socket init:mode=0 phy_id=6 scope_id=0 family=2 ip=192.168.0.44
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.307.088 [adapter_hccp.cc:1407] [618985][Get][HostIf]hrtGetIfAddress: idx[4] ifname[enp67s0f5] ip[fe80::8b0e:c402:331c:332f%enp67s0f5]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.307.104 [adapter_hccp.cc:1407] [618985][Get][HostIf]hrtGetIfAddress: idx[5] ifname[endvnic] ip[fe80::edaf:6dc3:6fad:b4b2%endvnic]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.307.122 [sal.cc:365] [618985]get host ip success. host ifname[enp67s0f5] ip[192.168.0.44%enp67s0f5]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.307.088 [adapter_hccp.cc:1407] [618988][Get][HostIf]hrtGetIfAddress: idx[5] ifname[endvnic] ip[fe80::edaf:6dc3:6fad:b4b2%endvnic]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.307.109 [sal.cc:365] [618988]get host ip success. host ifname[enp67s0f5] ip[192.168.0.44%enp67s0f5]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.307.120 [sal.cc:432] [618988]nic class[normal]: find nic[192.168.0.44%enp67s0f5] success.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.307.136 [network_manager.cc:69] [618988]NetworkManager::GetInstance deviceLogicID[2].
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.307.088 [adapter_hccp.cc:1407] [618984][Get][HostIf]hrtGetIfAddress: idx[3] ifname[lo] ip[::1%lo]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.307.104 [adapter_hccp.cc:1407] [618984][Get][HostIf]hrtGetIfAddress: idx[4] ifname[enp67s0f5] ip[fe80::8b0e:c402:331c:332f%enp67s0f5]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.307.118 [adapter_hccp.cc:1407] [618984][Get][HostIf]hrtGetIfAddress: idx[5] ifname[endvnic] ip[fe80::edaf:6dc3:6fad:b4b2%endvnic]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.307.137 [sal.cc:365] [618984]get host ip success. host ifname[enp67s0f5] ip[192.168.0.44%enp67s0f5]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.307.092 [sal.cc:432] [618983]nic class[normal]: find nic[192.168.0.44%enp67s0f5] success.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.307.111 [network_manager.cc:69] [618983]NetworkManager::GetInstance deviceLogicID[5].
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:43.307.139 [ra_host.c:340]tid:618983,ra_socket_init_v1(340) : socket init:mode=0 phy_id=5 scope_id=0 family=2 ip=192.168.0.44
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.307.106 [sal.cc:365] [618982]get host ip success. host ifname[enp67s0f5] ip[192.168.0.44%enp67s0f5]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.307.118 [sal.cc:432] [618982]nic class[normal]: find nic[192.168.0.44%enp67s0f5] success.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.307.136 [network_manager.cc:69] [618982]NetworkManager::GetInstance deviceLogicID[3].
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.307.127 [adapter_hccp.cc:818] [618986]socket init v1 success, socketHandle[0xfffea40fa610]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.307.140 [network_manager.cc:1218] [618986]ip[192.168.0.44%enp67s0f5] socket init OK
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.307.152 [network_manager.cc:1257] [618986]ip[192.168.0.44%enp67s0f5] socket start success socketHandle[0xfffea40fa610]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.307.164 [adapter_hal.cc:298] [618987]Entry-hrtDrvGetPlatformInfo
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.307.133 [sal.cc:432] [618985]nic class[normal]: find nic[192.168.0.44%enp67s0f5] success.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.307.151 [network_manager.cc:69] [618985]NetworkManager::GetInstance deviceLogicID[7].
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:43.307.175 [ra_host.c:340]tid:618985,ra_socket_init_v1(340) : socket init:mode=0 phy_id=7 scope_id=0 family=2 ip=192.168.0.44
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:43.307.168 [ra_host.c:340]tid:618988,ra_socket_init_v1(340) : socket init:mode=0 phy_id=2 scope_id=0 family=2 ip=192.168.0.44
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.307.184 [adapter_hccp.cc:818] [618988]socket init v1 success, socketHandle[0xfffe880fa610]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.307.189 [adapter_hccp.cc:818] [618985]socket init v1 success, socketHandle[0xfffe840fa610]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.307.203 [network_manager.cc:1218] [618985]ip[192.168.0.44%enp67s0f5] socket init OK
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.307.216 [network_manager.cc:1257] [618985]ip[192.168.0.44%enp67s0f5] socket start success socketHandle[0xfffe840fa610]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.307.149 [sal.cc:432] [618984]nic class[normal]: find nic[192.168.0.44%enp67s0f5] success.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.307.169 [network_manager.cc:69] [618984]NetworkManager::GetInstance deviceLogicID[4].
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:43.307.191 [ra_host.c:340]tid:618984,ra_socket_init_v1(340) : socket init:mode=0 phy_id=4 scope_id=0 family=2 ip=192.168.0.44
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.307.154 [adapter_hccp.cc:818] [618983]socket init v1 success, socketHandle[0xfffe880fa610]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.307.167 [network_manager.cc:1218] [618983]ip[192.168.0.44%enp67s0f5] socket init OK
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.307.177 [network_manager.cc:1257] [618983]ip[192.168.0.44%enp67s0f5] socket start success socketHandle[0xfffe880fa610]
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:43.307.168 [ra_host.c:340]tid:618982,ra_socket_init_v1(340) : socket init:mode=0 phy_id=3 scope_id=0 family=2 ip=192.168.0.44
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.307.184 [adapter_hccp.cc:818] [618982]socket init v1 success, socketHandle[0xfffeac0fa610]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.307.195 [network_manager.cc:1218] [618982]ip[192.168.0.44%enp67s0f5] socket init OK
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.307.206 [network_manager.cc:1257] [618982]ip[192.168.0.44%enp67s0f5] socket start success socketHandle[0xfffeac0fa610]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.307.204 [adapter_hal.cc:298] [618986]Entry-hrtDrvGetPlatformInfo
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.307.188 [sal.cc:593] [618987]IsHostUseDevNic[1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.307.202 [network_manager.cc:69] [618987]NetworkManager::GetInstance deviceLogicID[1].
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.307.214 [network_manager.cc:169] [618987]NetworkManager: devicePhyId[4294967295], devicePhyId_[1] deviceLogicId_[1], hasBackup[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.307.197 [network_manager.cc:1218] [618988]ip[192.168.0.44%enp67s0f5] socket init OK
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.307.208 [network_manager.cc:1257] [618988]ip[192.168.0.44%enp67s0f5] socket start success socketHandle[0xfffe880fa610]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.307.238 [adapter_hal.cc:298] [618983]Entry-hrtDrvGetPlatformInfo
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.307.206 [adapter_hccp.cc:818] [618984]socket init v1 success, socketHandle[0xfffeb00fa610]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.307.219 [network_manager.cc:1218] [618984]ip[192.168.0.44%enp67s0f5] socket init OK
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.307.233 [network_manager.cc:1257] [618984]ip[192.168.0.44%enp67s0f5] socket start success socketHandle[0xfffeb00fa610]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.307.229 [sal.cc:593] [618986]IsHostUseDevNic[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.307.242 [network_manager.cc:69] [618986]NetworkManager::GetInstance deviceLogicID[6].
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.307.255 [network_manager.cc:169] [618986]NetworkManager: devicePhyId[4294967295], devicePhyId_[6] deviceLogicId_[6], hasBackup[0]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:43.307.262 [tsd_client.cpp:189][TsdCapabilityGet][tid:618987] TsdCapabilityGet Begin.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.307.265 [adapter_hal.cc:298] [618985]Entry-hrtDrvGetPlatformInfo
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.307.265 [adapter_hal.cc:298] [618982]Entry-hrtDrvGetPlatformInfo
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.307.265 [adapter_hal.cc:298] [618988]Entry-hrtDrvGetPlatformInfo
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.307.260 [sal.cc:593] [618983]IsHostUseDevNic[1]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.307.271 [network_manager.cc:69] [618983]NetworkManager::GetInstance deviceLogicID[5].
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.307.284 [network_manager.cc:169] [618983]NetworkManager: devicePhyId[4294967295], devicePhyId_[5] deviceLogicId_[5], hasBackup[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.307.283 [adapter_hal.cc:298] [618984]Entry-hrtDrvGetPlatformInfo
[INFO] TDT(618666,python3.9):2025-04-03-09:27:43.307.325 [tsd_client.cpp:189][TsdCapabilityGet][tid:618983] TsdCapabilityGet Begin.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:43.307.278 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618987] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:43.307.291 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618987] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:43.307.305 [process_mode_manager.cpp:1042][CapabilityGet][tid:618987] [ProcessModeManager] enter into CapabilityGet process deviceId[1] type[6]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:43.307.342 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618983] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:43.307.294 [tsd_client.cpp:189][TsdCapabilityGet][tid:618986] TsdCapabilityGet Begin.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:43.307.310 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618986] [TsdClient] g_userDeviceInfo is empty.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.307.290 [sal.cc:593] [618985]IsHostUseDevNic[1]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.307.304 [network_manager.cc:69] [618985]NetworkManager::GetInstance deviceLogicID[7].
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.307.290 [sal.cc:593] [618982]IsHostUseDevNic[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.307.306 [network_manager.cc:69] [618982]NetworkManager::GetInstance deviceLogicID[3].
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.307.318 [network_manager.cc:169] [618982]NetworkManager: devicePhyId[4294967295], devicePhyId_[3] deviceLogicId_[3], hasBackup[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.307.289 [sal.cc:593] [618988]IsHostUseDevNic[1]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.307.306 [network_manager.cc:69] [618988]NetworkManager::GetInstance deviceLogicID[2].
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.307.318 [network_manager.cc:169] [618988]NetworkManager: devicePhyId[4294967295], devicePhyId_[2] deviceLogicId_[2], hasBackup[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.307.311 [sal.cc:593] [618984]IsHostUseDevNic[1]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.307.326 [network_manager.cc:69] [618984]NetworkManager::GetInstance deviceLogicID[4].
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.307.338 [network_manager.cc:169] [618984]NetworkManager: devicePhyId[4294967295], devicePhyId_[4] deviceLogicId_[4], hasBackup[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.307.321 [adapter_tdt.cc:66] [618987]Get TsdCapability success. deviceLogicId[1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.307.332 [network_manager.cc:175] [618987][NetworkManager][Init]supportMultiProcHCCP[1], hasBackup[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:43.307.349 [network_manager.cc:99] [618987][TsdProcessOpen]params: halAPIVersion[467736], BACKUP_DEVICE_LOG_DEV_VERSION[467736]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:43.307.358 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618983] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:43.307.326 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618986] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:43.307.339 [process_mode_manager.cpp:1042][CapabilityGet][tid:618986] [ProcessModeManager] enter into CapabilityGet process deviceId[6] type[6]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.307.352 [adapter_tdt.cc:66] [618986]Get TsdCapability success. deviceLogicId[6]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.307.362 [network_manager.cc:175] [618986][NetworkManager][Init]supportMultiProcHCCP[1], hasBackup[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.307.326 [network_manager.cc:169] [618985]NetworkManager: devicePhyId[4294967295], devicePhyId_[7] deviceLogicId_[7], hasBackup[0]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:43.307.371 [tsd_client.cpp:189][TsdCapabilityGet][tid:618985] TsdCapabilityGet Begin.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:43.307.366 [tsd_client.cpp:189][TsdCapabilityGet][tid:618982] TsdCapabilityGet Begin.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:43.307.379 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618982] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:43.307.365 [tsd_client.cpp:189][TsdCapabilityGet][tid:618988] TsdCapabilityGet Begin.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:43.307.380 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618988] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:43.307.391 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618988] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:43.307.383 [tsd_client.cpp:189][TsdCapabilityGet][tid:618984] TsdCapabilityGet Begin.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:43.307.398 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618984] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:43.307.363 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618987] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:43.307.375 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618987] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:43.307.387 [process_mode_manager.cpp:1434][ProcessOpenSubProc][tid:618987] enter into ProcessOpenSubProc subtype:0
[INFO] TDT(618650,python3.9):2025-04-03-09:27:43.307.400 [process_mode_manager.cpp:386][InitTsdClient][tid:618987] [TsdClient] tsd client has been inited before
[INFO] TDT(618666,python3.9):2025-04-03-09:27:43.307.370 [process_mode_manager.cpp:1042][CapabilityGet][tid:618983] [ProcessModeManager] enter into CapabilityGet process deviceId[5] type[6]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.307.386 [adapter_tdt.cc:66] [618983]Get TsdCapability success. deviceLogicId[5]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.307.399 [network_manager.cc:175] [618983][NetworkManager][Init]supportMultiProcHCCP[1], hasBackup[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:43.307.380 [network_manager.cc:99] [618986][TsdProcessOpen]params: halAPIVersion[467736], BACKUP_DEVICE_LOG_DEV_VERSION[467736]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:43.307.397 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618986] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:43.307.408 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618986] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:43.307.419 [process_mode_manager.cpp:1434][ProcessOpenSubProc][tid:618986] enter into ProcessOpenSubProc subtype:0
[INFO] TDT(618674,python3.9):2025-04-03-09:27:43.307.383 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618985] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:43.307.398 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618985] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:43.307.410 [process_mode_manager.cpp:1042][CapabilityGet][tid:618985] [ProcessModeManager] enter into CapabilityGet process deviceId[7] type[6]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.307.422 [adapter_tdt.cc:66] [618985]Get TsdCapability success. deviceLogicId[7]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.307.434 [network_manager.cc:175] [618985][NetworkManager][Init]supportMultiProcHCCP[1], hasBackup[0]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:43.307.392 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618982] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:43.307.406 [process_mode_manager.cpp:1042][CapabilityGet][tid:618982] [ProcessModeManager] enter into CapabilityGet process deviceId[3] type[6]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.307.419 [adapter_tdt.cc:66] [618982]Get TsdCapability success. deviceLogicId[3]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.307.430 [network_manager.cc:175] [618982][NetworkManager][Init]supportMultiProcHCCP[1], hasBackup[0]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:43.307.405 [process_mode_manager.cpp:1042][CapabilityGet][tid:618988] [ProcessModeManager] enter into CapabilityGet process deviceId[2] type[6]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.307.421 [adapter_tdt.cc:66] [618988]Get TsdCapability success. deviceLogicId[2]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.307.434 [network_manager.cc:175] [618988][NetworkManager][Init]supportMultiProcHCCP[1], hasBackup[0]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:43.307.415 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618984] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:43.307.428 [process_mode_manager.cpp:1042][CapabilityGet][tid:618984] [ProcessModeManager] enter into CapabilityGet process deviceId[4] type[6]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.307.440 [adapter_tdt.cc:66] [618984]Get TsdCapability success. deviceLogicId[4]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.307.454 [network_manager.cc:175] [618984][NetworkManager][Init]supportMultiProcHCCP[1], hasBackup[0]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:43.307.419 [process_mode_manager.cpp:1363][SetCommonOpenParamList][tid:618987] cnt:0, extra parameters:--hdcType=18, len:12
[WARNING] TDT(618650,python3.9):2025-04-03-09:27:43.307.441 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618987] Get env[ASCEND_LATEST_INSTALL_PATH] failed
[INFO] TDT(618650,python3.9):2025-04-03-09:27:43.307.456 [process_mode_manager.cpp:1680][GetAscendLatestIntallPath][tid:618987] latest install path:/usr/local/Ascend/ascend-toolkit/latest
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:43.307.421 [network_manager.cc:99] [618983][TsdProcessOpen]params: halAPIVersion[467736], BACKUP_DEVICE_LOG_DEV_VERSION[467736]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:43.307.438 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618983] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:43.307.456 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618983] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:43.307.432 [process_mode_manager.cpp:386][InitTsdClient][tid:618986] [TsdClient] tsd client has been inited before
[INFO] TDT(618670,python3.9):2025-04-03-09:27:43.307.450 [process_mode_manager.cpp:1363][SetCommonOpenParamList][tid:618986] cnt:0, extra parameters:--hdcType=18, len:12
[WARNING] TDT(618670,python3.9):2025-04-03-09:27:43.307.469 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618986] Get env[ASCEND_LATEST_INSTALL_PATH] failed
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:43.307.452 [network_manager.cc:99] [618985][TsdProcessOpen]params: halAPIVersion[467736], BACKUP_DEVICE_LOG_DEV_VERSION[467736]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:43.307.469 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618985] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:43.307.481 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618985] [TsdClient] g_userDeviceInfo is empty.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:43.307.448 [network_manager.cc:99] [618982][TsdProcessOpen]params: halAPIVersion[467736], BACKUP_DEVICE_LOG_DEV_VERSION[467736]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:43.307.473 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618982] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:43.307.486 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618982] [TsdClient] g_userDeviceInfo is empty.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:43.307.452 [network_manager.cc:99] [618988][TsdProcessOpen]params: halAPIVersion[467736], BACKUP_DEVICE_LOG_DEV_VERSION[467736]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:43.307.469 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618988] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:43.307.482 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618988] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:43.307.494 [process_mode_manager.cpp:1434][ProcessOpenSubProc][tid:618988] enter into ProcessOpenSubProc subtype:0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:43.307.477 [network_manager.cc:99] [618984][TsdProcessOpen]params: halAPIVersion[467736], BACKUP_DEVICE_LOG_DEV_VERSION[467736]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:43.307.491 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618984] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:43.307.502 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618984] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:43.307.500 [process_mode_manager.cpp:1434][ProcessOpenSubProc][tid:618982] enter into ProcessOpenSubProc subtype:0
[INFO] TDT(618658,python3.9):2025-04-03-09:27:43.307.514 [process_mode_manager.cpp:386][InitTsdClient][tid:618982] [TsdClient] tsd client has been inited before
[INFO] TDT(618658,python3.9):2025-04-03-09:27:43.307.530 [process_mode_manager.cpp:1363][SetCommonOpenParamList][tid:618982] cnt:0, extra parameters:--hdcType=18, len:12
[WARNING] TDT(618658,python3.9):2025-04-03-09:27:43.307.550 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618982] Get env[ASCEND_LATEST_INSTALL_PATH] failed
[INFO] TDT(618650,python3.9):2025-04-03-09:27:43.307.468 [process_mode_manager.cpp:1383][ConstructCommonOpenMsg][tid:618987] runtimePkgPath:/usr/local/Ascend/ascend-toolkit/latest
[INFO] TDT(618650,python3.9):2025-04-03-09:27:43.307.484 [process_mode_manager.cpp:1389][ConstructCommonOpenMsg][tid:618987] hostLibPath:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/lib:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/examples:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/tests/atbopstest:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64/plugin:/usr/local/Ascend/ascend-toolkit/latest/lib64:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/opskernel:/usr/local/Ascend/ascend-toolkit/
[INFO] TDT(618666,python3.9):2025-04-03-09:27:43.307.471 [process_mode_manager.cpp:1434][ProcessOpenSubProc][tid:618983] enter into ProcessOpenSubProc subtype:0
[INFO] TDT(618666,python3.9):2025-04-03-09:27:43.307.483 [process_mode_manager.cpp:386][InitTsdClient][tid:618983] [TsdClient] tsd client has been inited before
[INFO] TDT(618666,python3.9):2025-04-03-09:27:43.307.503 [process_mode_manager.cpp:1363][SetCommonOpenParamList][tid:618983] cnt:0, extra parameters:--hdcType=18, len:12
[INFO] TDT(618670,python3.9):2025-04-03-09:27:43.307.483 [process_mode_manager.cpp:1680][GetAscendLatestIntallPath][tid:618986] latest install path:/usr/local/Ascend/ascend-toolkit/latest
[INFO] TDT(618670,python3.9):2025-04-03-09:27:43.307.498 [process_mode_manager.cpp:1383][ConstructCommonOpenMsg][tid:618986] runtimePkgPath:/usr/local/Ascend/ascend-toolkit/latest
[INFO] TDT(618670,python3.9):2025-04-03-09:27:43.307.511 [process_mode_manager.cpp:1389][ConstructCommonOpenMsg][tid:618986] hostLibPath:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/lib:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/examples:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/tests/atbopstest:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64/plugin:/usr/local/Ascend/ascend-toolkit/latest/lib64:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/opskernel:/usr/local/Ascend/ascend-toolkit/
[INFO] TDT(618674,python3.9):2025-04-03-09:27:43.307.495 [process_mode_manager.cpp:1434][ProcessOpenSubProc][tid:618985] enter into ProcessOpenSubProc subtype:0
[INFO] TDT(618674,python3.9):2025-04-03-09:27:43.307.507 [process_mode_manager.cpp:386][InitTsdClient][tid:618985] [TsdClient] tsd client has been inited before
[INFO] TDT(618674,python3.9):2025-04-03-09:27:43.307.526 [process_mode_manager.cpp:1363][SetCommonOpenParamList][tid:618985] cnt:0, extra parameters:--hdcType=18, len:12
[INFO] TDT(618654,python3.9):2025-04-03-09:27:43.307.506 [process_mode_manager.cpp:386][InitTsdClient][tid:618988] [TsdClient] tsd client has been inited before
[INFO] TDT(618654,python3.9):2025-04-03-09:27:43.307.526 [process_mode_manager.cpp:1363][SetCommonOpenParamList][tid:618988] cnt:0, extra parameters:--hdcType=18, len:12
[INFO] TDT(618662,python3.9):2025-04-03-09:27:43.307.515 [process_mode_manager.cpp:1434][ProcessOpenSubProc][tid:618984] enter into ProcessOpenSubProc subtype:0
[INFO] TDT(618662,python3.9):2025-04-03-09:27:43.307.530 [process_mode_manager.cpp:386][InitTsdClient][tid:618984] [TsdClient] tsd client has been inited before
[INFO] TDT(618662,python3.9):2025-04-03-09:27:43.307.546 [process_mode_manager.cpp:1363][SetCommonOpenParamList][tid:618984] cnt:0, extra parameters:--hdcType=18, len:12
[INFO] TDT(618650,python3.9):2025-04-03-09:27:43.307.522 [version_verify.cpp:114][SpecialFeatureCheck][tid:618987] VersionVerify: previous type[48], supported
[INFO] TDT(618650,python3.9):2025-04-03-09:27:43.307.561 [hdc_client.cpp:154][TsdRecvData][tid:618987] recv timeout is:150000 ms
[WARNING] TDT(618666,python3.9):2025-04-03-09:27:43.307.524 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618983] Get env[ASCEND_LATEST_INSTALL_PATH] failed
[INFO] TDT(618666,python3.9):2025-04-03-09:27:43.307.541 [process_mode_manager.cpp:1680][GetAscendLatestIntallPath][tid:618983] latest install path:/usr/local/Ascend/ascend-toolkit/latest
[INFO] TDT(618666,python3.9):2025-04-03-09:27:43.307.556 [process_mode_manager.cpp:1383][ConstructCommonOpenMsg][tid:618983] runtimePkgPath:/usr/local/Ascend/ascend-toolkit/latest
[INFO] TDT(618666,python3.9):2025-04-03-09:27:43.307.569 [process_mode_manager.cpp:1389][ConstructCommonOpenMsg][tid:618983] hostLibPath:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/lib:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/examples:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/tests/atbopstest:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64/plugin:/usr/local/Ascend/ascend-toolkit/latest/lib64:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/opskernel:/usr/local/Ascend/ascend-toolkit/
[INFO] TDT(618658,python3.9):2025-04-03-09:27:43.307.566 [process_mode_manager.cpp:1680][GetAscendLatestIntallPath][tid:618982] latest install path:/usr/local/Ascend/ascend-toolkit/latest
[INFO] TDT(618658,python3.9):2025-04-03-09:27:43.307.583 [process_mode_manager.cpp:1383][ConstructCommonOpenMsg][tid:618982] runtimePkgPath:/usr/local/Ascend/ascend-toolkit/latest
[INFO] TDT(618670,python3.9):2025-04-03-09:27:43.307.531 [version_verify.cpp:114][SpecialFeatureCheck][tid:618986] VersionVerify: previous type[48], supported
[INFO] TDT(618670,python3.9):2025-04-03-09:27:43.307.572 [hdc_client.cpp:154][TsdRecvData][tid:618986] recv timeout is:150000 ms
[WARNING] TDT(618674,python3.9):2025-04-03-09:27:43.307.551 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618985] Get env[ASCEND_LATEST_INSTALL_PATH] failed
[INFO] TDT(618674,python3.9):2025-04-03-09:27:43.307.565 [process_mode_manager.cpp:1680][GetAscendLatestIntallPath][tid:618985] latest install path:/usr/local/Ascend/ascend-toolkit/latest
[INFO] TDT(618674,python3.9):2025-04-03-09:27:43.307.577 [process_mode_manager.cpp:1383][ConstructCommonOpenMsg][tid:618985] runtimePkgPath:/usr/local/Ascend/ascend-toolkit/latest
[INFO] TDT(618674,python3.9):2025-04-03-09:27:43.307.590 [process_mode_manager.cpp:1389][ConstructCommonOpenMsg][tid:618985] hostLibPath:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/lib:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/examples:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/tests/atbopstest:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64/plugin:/usr/local/Ascend/ascend-toolkit/latest/lib64:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/opskernel:/usr/local/Ascend/ascend-toolkit/
[WARNING] TDT(618654,python3.9):2025-04-03-09:27:43.307.556 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618988] Get env[ASCEND_LATEST_INSTALL_PATH] failed
[INFO] TDT(618654,python3.9):2025-04-03-09:27:43.307.573 [process_mode_manager.cpp:1680][GetAscendLatestIntallPath][tid:618988] latest install path:/usr/local/Ascend/ascend-toolkit/latest
[INFO] TDT(618654,python3.9):2025-04-03-09:27:43.307.588 [process_mode_manager.cpp:1383][ConstructCommonOpenMsg][tid:618988] runtimePkgPath:/usr/local/Ascend/ascend-toolkit/latest
[INFO] TDT(618654,python3.9):2025-04-03-09:27:43.307.599 [process_mode_manager.cpp:1389][ConstructCommonOpenMsg][tid:618988] hostLibPath:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/lib:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/examples:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/tests/atbopstest:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64/plugin:/usr/local/Ascend/ascend-toolkit/latest/lib64:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/opskernel:/usr/local/Ascend/ascend-toolkit/
[INFO] TDT(618674,python3.9):2025-04-03-09:27:43.307.614 [version_verify.cpp:114][SpecialFeatureCheck][tid:618985] VersionVerify: previous type[48], supported
[WARNING] TDT(618662,python3.9):2025-04-03-09:27:43.307.563 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618984] Get env[ASCEND_LATEST_INSTALL_PATH] failed
[INFO] TDT(618662,python3.9):2025-04-03-09:27:43.307.578 [process_mode_manager.cpp:1680][GetAscendLatestIntallPath][tid:618984] latest install path:/usr/local/Ascend/ascend-toolkit/latest
[INFO] TDT(618662,python3.9):2025-04-03-09:27:43.307.589 [process_mode_manager.cpp:1383][ConstructCommonOpenMsg][tid:618984] runtimePkgPath:/usr/local/Ascend/ascend-toolkit/latest
[INFO] TDT(618662,python3.9):2025-04-03-09:27:43.307.601 [process_mode_manager.cpp:1389][ConstructCommonOpenMsg][tid:618984] hostLibPath:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/lib:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/examples:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/tests/atbopstest:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64/plugin:/usr/local/Ascend/ascend-toolkit/latest/lib64:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/opskernel:/usr/local/Ascend/ascend-toolkit/
[INFO] TDT(618666,python3.9):2025-04-03-09:27:43.307.594 [version_verify.cpp:114][SpecialFeatureCheck][tid:618983] VersionVerify: previous type[48], supported
[INFO] TDT(618658,python3.9):2025-04-03-09:27:43.307.598 [process_mode_manager.cpp:1389][ConstructCommonOpenMsg][tid:618982] hostLibPath:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/lib:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/examples:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/tests/atbopstest:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64/plugin:/usr/local/Ascend/ascend-toolkit/latest/lib64:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/opskernel:/usr/local/Ascend/ascend-toolkit/
[INFO] TDT(618658,python3.9):2025-04-03-09:27:43.307.621 [version_verify.cpp:114][SpecialFeatureCheck][tid:618982] VersionVerify: previous type[48], supported
[INFO] TDT(618654,python3.9):2025-04-03-09:27:43.307.619 [version_verify.cpp:114][SpecialFeatureCheck][tid:618988] VersionVerify: previous type[48], supported
[INFO] TDT(618662,python3.9):2025-04-03-09:27:43.307.628 [version_verify.cpp:114][SpecialFeatureCheck][tid:618984] VersionVerify: previous type[48], supported
[INFO] TDT(618662,python3.9):2025-04-03-09:27:43.307.667 [hdc_client.cpp:154][TsdRecvData][tid:618984] recv timeout is:150000 ms
[INFO] TDT(618658,python3.9):2025-04-03-09:27:43.307.666 [hdc_client.cpp:154][TsdRecvData][tid:618982] recv timeout is:150000 ms
[INFO] TDT(618666,python3.9):2025-04-03-09:27:43.307.653 [hdc_client.cpp:154][TsdRecvData][tid:618983] recv timeout is:150000 ms
[INFO] TDT(618674,python3.9):2025-04-03-09:27:43.307.666 [hdc_client.cpp:154][TsdRecvData][tid:618985] recv timeout is:150000 ms
[INFO] TDT(618654,python3.9):2025-04-03-09:27:43.307.666 [hdc_client.cpp:154][TsdRecvData][tid:618988] recv timeout is:150000 ms
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:43.332.170 [queue_client_comm.c:114][ascend][curpid:618662,618876][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:43.332.179 [queue_client_comm.c:114][ascend][curpid:618662,618872][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:43.332.182 [queue_client_comm.c:114][ascend][curpid:618662,618868][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:43.332.181 [queue_client_comm.c:114][ascend][curpid:618662,618864][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:43.332.176 [queue_client_comm.c:114][ascend][curpid:618674,618873][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:43.332.177 [queue_client_comm.c:114][ascend][curpid:618674,618866][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:43.332.178 [queue_client_comm.c:114][ascend][curpid:618674,618881][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:43.332.190 [queue_client_comm.c:114][ascend][curpid:618662,618885][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:43.332.179 [queue_client_comm.c:114][ascend][curpid:618674,618870][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:43.332.189 [queue_client_comm.c:114][ascend][curpid:618662,618880][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:43.332.180 [queue_client_comm.c:114][ascend][curpid:618674,618884][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:43.332.175 [queue_client_comm.c:114][ascend][curpid:618674,618878][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:43.332.303 [npu_driver.cc:4338] 618876 MemQueuePeek: queue empty
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:43.332.321 [npu_driver.cc:4338] 618873 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.332.330 [tensor_data_transfer.cpp:612]618876 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_image_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.332.345 [tensor_data_transfer.cpp:612]618873 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_tensor_summary
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:43.332.349 [npu_driver.cc:4338] 618872 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.332.350 [tensor_data_transfer.cpp:1054]618876 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_image_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.332.368 [tensor_data_transfer.cpp:612]618872 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_tensor_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.332.373 [tensor_data_transfer.cpp:1056]618876 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.332.365 [tensor_data_transfer.cpp:1054]618873 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_tensor_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.332.382 [tensor_data_transfer.cpp:1056]618873 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.332.384 [tensor_data_transfer.cpp:1054]618872 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_tensor_summary
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.332.390 [api_impl.cc:6121] 618876 MemQueuePeek: Start to peek queue on devId 4, qid is 3.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:43.332.365 [npu_driver.cc:4338] 618866 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.332.398 [tensor_data_transfer.cpp:1056]618872 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.332.406 [npu_driver.cc:4330] 618876 MemQueuePeek: peek mem queue, deviceId=4, qid=3, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.332.411 [api_impl.cc:6121] 618872 MemQueuePeek: Start to peek queue on devId 4, qid is 2.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.332.397 [api_impl.cc:6121] 618873 MemQueuePeek: Start to peek queue on devId 7, qid is 2.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:43.332.403 [npu_driver.cc:4338] 618881 MemQueuePeek: queue empty
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.332.415 [npu_driver.cc:4330] 618873 MemQueuePeek: peek mem queue, deviceId=7, qid=2, timeout=800.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:43.332.393 [npu_driver.cc:4338] 618868 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.332.423 [tensor_data_transfer.cpp:612]618881 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_scalar_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.332.431 [tensor_data_transfer.cpp:612]618866 acltdtReceiveTensorV2: queue is empty, device is 7, name is _npu_log
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.332.425 [npu_driver.cc:4330] 618872 MemQueuePeek: peek mem queue, deviceId=4, qid=2, timeout=800.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.332.441 [tensor_data_transfer.cpp:1054]618881 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_scalar_summary
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:43.332.434 [npu_driver.cc:4338] 618864 MemQueuePeek: queue empty
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:43.332.450 [npu_driver.cc:4338] 618870 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.332.459 [tensor_data_transfer.cpp:1056]618881 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.332.459 [tensor_data_transfer.cpp:612]618864 acltdtReceiveTensorV2: queue is empty, device is 4, name is _npu_log
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.332.496 [tensor_data_transfer.cpp:1054]618864 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is _npu_log
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:43.332.505 [npu_driver.cc:4338] 618880 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.332.454 [tensor_data_transfer.cpp:1054]618866 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is _npu_log
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.332.482 [tensor_data_transfer.cpp:612]618870 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_tensor_dump
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.332.462 [tensor_data_transfer.cpp:612]618868 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_tensor_dump
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.332.489 [api_impl.cc:6121] 618881 MemQueuePeek: Start to peek queue on devId 7, qid is 4.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:43.332.469 [npu_driver.cc:4338] 618885 MemQueuePeek: queue empty
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:43.332.499 [npu_driver.cc:4338] 618884 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.332.515 [tensor_data_transfer.cpp:1056]618864 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:43.332.515 [npu_driver.cc:4338] 618878 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.332.532 [tensor_data_transfer.cpp:612]618880 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_scalar_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.332.547 [tensor_data_transfer.cpp:612]618885 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_histogram_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.332.525 [ten[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.332.559 [api_impl.cc:6121] 618864 MemQueuePeek: Start to peek queue on devId 4, qid is 0.
sor_data_transfer.cpp:1056]618866 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.332.534 [tensor_data_transfer.cpp:1054]618870 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_tensor_dump
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.332.544 [npu_driver.cc:4330] 618881 MemQueuePeek: peek mem queue, deviceId=7, qid=4, timeout=800.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.332.559 [tensor_data_transfer.cpp:612]618884 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_histogram_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.332.564 [tensor_data_transfer.cpp:612]618878 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_image_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.332.543 [tensor_data_transfer.cpp:1054]618868 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_tensor_dump
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.332.572 [tensor_data_transfer.cpp:1054]618880 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_scalar_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.332.578 [tensor_data_transfer.cpp:1054]618885 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_histogram_summary
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.332.604 [api_impl.cc:6121] 618866 MemQueuePeek: Start to peek queue on devId 7, qid is 0.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.332.606 [tensor_data_transfer.cpp:1056]618870 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.332.630 [tensor_data_transfer.cpp:1054]618884 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_histogram_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.332.634 [tensor_data_transfer.cpp:1054]618878 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_image_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.332.629 [tensor_data_transfer.cpp:1056]618880 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.332.589 [npu_driver.cc:4330] 618864 MemQueuePeek: peek mem queue, deviceId=4, qid=0, timeout=800.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.332.646 [api_impl.cc:6121] 618870 MemQueuePeek: Start to peek queue on devId 7, qid is 1.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.332.623 [tensor_data_transfer.cpp:1056]618868 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.332.649 [tensor_data_transfer.cpp:1056]618884 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.332.653 [tensor_data_transfer.cpp:1056]618878 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.332.636 [tensor_data_transfer.cpp:1056]618885 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.332.649 [api_impl.cc:6121] 618880 MemQueuePeek: Start to peek queue on devId 4, qid is 4.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.332.639 [npu_driver.cc:4330] 618866 MemQueuePeek: peek mem queue, deviceId=7, qid=0, timeout=800.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.332.659 [npu_driver.cc:4330] 618870 MemQueuePeek: peek mem queue, deviceId=7, qid=1, timeout=800.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.332.665 [api_impl.cc:6121] 618884 MemQueuePeek: Start to peek queue on devId 7, qid is 5.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.332.669 [api_impl.cc:6121] 618878 MemQueuePeek: Start to peek queue on devId 7, qid is 3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.332.686 [npu_driver.cc:4330] 618884 MemQueuePeek: peek mem queue, deviceId=7, qid=5, timeout=800.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.332.689 [npu_driver.cc:4330] 618878 MemQueuePeek: peek mem queue, deviceId=7, qid=3, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.332.669 [api_impl.cc:6121] 618868 MemQueuePeek: Start to peek queue on devId 4, qid is 1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.332.676 [api_impl.cc:6121] 618885 MemQueuePeek: Start to peek queue on devId 4, qid is 5.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.332.683 [npu_driver.cc:4330] 618880 MemQueuePeek: peek mem queue, deviceId=4, qid=4, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.332.710 [npu_driver.cc:4330] 618868 MemQueuePeek: peek mem queue, deviceId=4, qid=1, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.332.714 [npu_driver.cc:4330] 618885 MemQueuePeek: peek mem queue, deviceId=4, qid=5, timeout=800.
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:43.364.172 [queue_client_comm.c:114][ascend][curpid:618670,618907][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:43.364.172 [queue_client_comm.c:114][ascend][curpid:618670,618909][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:43.364.173 [queue_client_comm.c:114][ascend][curpid:618670,618911][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:43.364.174 [queue_client_comm.c:114][ascend][curpid:618670,618903][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:43.364.174 [queue_client_comm.c:114][ascend][curpid:618670,618905][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:43.364.176 [queue_client_comm.c:114][ascend][curpid:618670,618901][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:43.364.277 [npu_driver.cc:4338] 618907 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.364.295 [tensor_data_transfer.cpp:612]618907 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_image_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.364.313 [tensor_data_transfer.cpp:1054]618907 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_image_summary
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:43.364.315 [npu_driver.cc:4338] 618909 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.364.329 [tensor_data_transfer.cpp:1056]618907 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.364.338 [tensor_data_transfer.cpp:612]618909 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_scalar_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.364.342 [api_impl.cc:6121] 618907 MemQueuePeek: Start to peek queue on devId 6, qid is 3.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.364.353 [tensor_data_transfer.cpp:1054]618909 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_scalar_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.364.359 [npu_driver.cc:4330] 618907 MemQueuePeek: peek mem queue, deviceId=6, qid=3, timeout=800.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.364.367 [tensor_data_transfer.cpp:1056]618909 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:43.364.377 [npu_driver.cc:4338] 618911 MemQueuePeek: queue empty
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.364.380 [api_impl.cc:6121] 618909 MemQueuePeek: Start to peek queue on devId 6, qid is 4.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.364.391 [tensor_data_transfer.cpp:612]618911 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_histogram_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.364.394 [npu_driver.cc:4330] 618909 MemQueuePeek: peek mem queue, deviceId=6, qid=4, timeout=800.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.364.405 [tensor_data_transfer.cpp:1054]618911 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_histogram_summary
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:43.364.414 [npu_driver.cc:4338] 618903 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.364.419 [tensor_data_transfer.cpp:1056]618911 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.364.429 [tensor_data_transfer.cpp:612]618903 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_tensor_dump
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.364.450 [api_impl.cc:6121] 618911 MemQueuePeek: Start to peek queue on devId 6, qid is 5.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:43.364.453 [npu_driver.cc:4338] 618905 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.364.455 [tensor_data_transfer.cpp:1054]618903 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_tensor_dump
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.364.463 [npu_driver.cc:4330] 618911 MemQueuePeek: peek mem queue, deviceId=6, qid=5, timeout=800.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.364.470 [tensor_data_transfer.cpp:612]618905 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_tensor_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.364.477 [tensor_data_transfer.cpp:1056]618903 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:43.364.487 [npu_driver.cc:4338] 618901 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.364.490 [tensor_data_transfer.cpp:1054]618905 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_tensor_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.364.497 [api_impl.cc:6121] 618903 MemQueuePeek: Start to peek queue on devId 6, qid is 1.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.364.502 [tensor_data_transfer.cpp:612]618901 acltdtReceiveTensorV2: queue is empty, device is 6, name is _npu_log
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.364.508 [tensor_data_transfer.cpp:1056]618905 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.364.516 [npu_driver.cc:4330] 618903 MemQueuePeek: peek mem queue, deviceId=6, qid=1, timeout=800.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.364.522 [tensor_data_transfer.cpp:1054]618901 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is _npu_log
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.364.527 [api_impl.cc:6121] 618905 MemQueuePeek: Start to peek queue on devId 6, qid is 2.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.364.538 [tensor_data_transfer.cpp:1056]618901 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.364.543 [npu_driver.cc:4330] 618905 MemQueuePeek: peek mem queue, deviceId=6, qid=2, timeout=800.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.364.552 [api_impl.cc:6121] 618901 MemQueuePeek: Start to peek queue on devId 6, qid is 0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.364.565 [npu_driver.cc:4330] 618901 MemQueuePeek: peek mem queue, deviceId=6, qid=0, timeout=800.
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:43.396.173 [trs_cb_event.c:119][ascend][curpid:618654,618832][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =320; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:43.396.173 [trs_cb_event.c:119][ascend][curpid:618654,618833][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =321; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:43.396.201 [trs_sqcq.c:1491][ascend][curpid:618654,618832][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:43.396.210 [trs_sqcq.c:1491][ascend][curpid:618654,618833][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:43.396.220 [npu_driver.cc:3833] 618832 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=320, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:43.396.228 [npu_driver.cc:3833] 618833 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:43.396.235 [api_impl.cc:5058] 618832 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:43.396.244 [api_impl.cc:5058] 618833 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.396.252 [callback.cpp:132]618832 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.396.261 [callback.cpp:132]618833 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.396.267 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.396.278 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.396.286 [npu_driver.cc:3828] 618832 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=320.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.396.296 [npu_driver.cc:3828] 618833 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=321.
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:43.460.176 [queue_client_comm.c:114][ascend][curpid:618650,618929][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:43.460.176 [queue_client_comm.c:114][ascend][curpid:618650,618931][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:43.460.178 [queue_client_comm.c:114][ascend][curpid:618650,618923][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:43.460.179 [queue_client_comm.c:114][ascend][curpid:618650,618921][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:43.460.181 [queue_client_comm.c:114][ascend][curpid:618650,618927][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:43.460.181 [queue_client_comm.c:114][ascend][curpid:618650,618925][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:43.460.289 [npu_driver.cc:4338] 618929 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.460.303 [tensor_data_transfer.cpp:612]618929 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_scalar_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.460.316 [tensor_data_transfer.cpp:1054]618929 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_scalar_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.460.326 [tensor_data_transfer.cpp:1056]618929 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.460.335 [api_impl.cc:6121] 618929 MemQueuePeek: Start to peek queue on devId 1, qid is 4.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:43.460.345 [npu_driver.cc:4338] 618931 MemQueuePeek: queue empty
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.460.346 [npu_driver.cc:4330] 618929 MemQueuePeek: peek mem queue, deviceId=1, qid=4, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.460.358 [tensor_data_transfer.cpp:612]618931 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_histogram_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.460.368 [tensor_data_transfer.cpp:1054]618931 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_histogram_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.460.379 [tensor_data_transfer.cpp:1056]618931 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:43.460.383 [npu_driver.cc:4338] 618923 MemQueuePeek: queue empty
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.460.389 [api_impl.cc:6121] 618931 MemQueuePeek: Start to peek queue on devId 1, qid is 5.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.460.395 [tensor_data_transfer.cpp:612]618923 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_tensor_dump
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.460.399 [npu_driver.cc:4330] 618931 MemQueuePeek: peek mem queue, deviceId=1, qid=5, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.460.410 [tensor_data_transfer.cpp:1054]618923 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_tensor_dump
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:43.460.418 [npu_driver.cc:4338] 618921 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.460.438 [tensor_data_transfer.cpp:1056]618923 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.460.443 [tensor_data_transfer.cpp:612]618921 acltdtReceiveTensorV2: queue is empty, device is 1, name is _npu_log
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.460.449 [api_impl.cc:6121] 618923 MemQueuePeek: Start to peek queue on devId 1, qid is 1.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.460.456 [tensor_data_transfer.cpp:1054]618921 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is _npu_log
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:43.460.457 [npu_driver.cc:4338] 618927 MemQueuePeek: queue empty
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.460.459 [npu_driver.cc:4330] 618923 MemQueuePeek: peek mem queue, deviceId=1, qid=1, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.460.470 [tensor_data_transfer.cpp:1056]618921 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.460.476 [tensor_data_transfer.cpp:612]618927 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_image_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.460.482 [api_impl.cc:6121] 618921 MemQueuePeek: Start to peek queue on devId 1, qid is 0.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.460.489 [tensor_data_transfer.cpp:1054]618927 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_image_summary
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:43.460.491 [npu_driver.cc:4338] 618925 MemQueuePeek: queue empty
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.460.492 [npu_driver.cc:4330] 618921 MemQueuePeek: peek mem queue, deviceId=1, qid=0, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.460.501 [tensor_data_transfer.cpp:1056]618927 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.460.507 [tensor_data_transfer.cpp:612]618925 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_tensor_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.460.514 [api_impl.cc:6121] 618927 MemQueuePeek: Start to peek queue on devId 1, qid is 3.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.460.518 [tensor_data_transfer.cpp:1054]618925 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_tensor_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.460.524 [npu_driver.cc:4330] 618927 MemQueuePeek: peek mem queue, deviceId=1, qid=3, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.460.529 [tensor_data_transfer.cpp:1056]618925 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.460.539 [api_impl.cc:6121] 618925 MemQueuePeek: Start to peek queue on devId 1, qid is 2.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.460.551 [npu_driver.cc:4330] 618925 MemQueuePeek: peek mem queue, deviceId=1, qid=2, timeout=800.
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:43.492.168 [trs_cb_event.c:119][ascend][curpid:618646,618837][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =65; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:43.492.180 [trs_cb_event.c:119][ascend][curpid:618646,618836][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =64; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:43.492.195 [trs_sqcq.c:1491][ascend][curpid:618646,618837][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:43.492.209 [trs_sqcq.c:1491][ascend][curpid:618646,618836][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:43.492.215 [npu_driver.cc:3833] 618837 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:43.492.227 [npu_driver.cc:3833] 618836 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:43.492.235 [api_impl.cc:5058] 618837 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:43.492.246 [api_impl.cc:5058] 618836 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.492.254 [callback.cpp:132]618837 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.492.264 [callback.cpp:132]618836 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.492.276 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.492.304 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.492.316 [npu_driver.cc:3828] 618837 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=65.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.492.327 [npu_driver.cc:3828] 618836 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=64.
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:43.556.172 [queue_client_comm.c:114][ascend][curpid:618654,618943][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:43.556.176 [queue_client_comm.c:114][ascend][curpid:618654,618945][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:43.556.177 [queue_client_comm.c:114][ascend][curpid:618654,618947][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:43.556.176 [queue_client_comm.c:114][ascend][curpid:618654,618951][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:43.556.176 [queue_client_comm.c:114][ascend][curpid:618654,618941][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:43.556.176 [queue_client_comm.c:114][ascend][curpid:618654,618949][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:43.556.290 [npu_driver.cc:4338] 618943 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.556.309 [tensor_data_transfer.cpp:612]618943 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_tensor_dump
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:43.556.325 [npu_driver.cc:4338] 618945 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.556.329 [tensor_data_transfer.cpp:1054]618943 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_tensor_dump
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.556.342 [tensor_data_transfer.cpp:612]618945 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_tensor_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.556.347 [tensor_data_transfer.cpp:1056]618943 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.556.358 [tensor_data_transfer.cpp:1054]618945 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_tensor_summary
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:43.556.359 [npu_driver.cc:4338] 618947 MemQueuePeek: queue empty
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.556.367 [api_impl.cc:6121] 618943 MemQueuePeek: Start to peek queue on devId 2, qid is 1.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.556.371 [tensor_data_transfer.cpp:1056]618945 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.556.382 [tensor_data_transfer.cpp:612]618947 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_image_summary
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.556.388 [npu_driver.cc:4330] 618943 MemQueuePeek: peek mem queue, deviceId=2, qid=1, timeout=800.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.556.394 [api_impl.cc:6121] 618945 MemQueuePeek: Start to peek queue on devId 2, qid is 2.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.556.405 [tensor_data_transfer.cpp:1054]618947 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_image_summary
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:43.556.407 [npu_driver.cc:4338] 618951 MemQueuePeek: queue empty
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.556.417 [npu_driver.cc:4330] 618945 MemQueuePeek: peek mem queue, deviceId=2, qid=2, timeout=800.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.556.427 [tensor_data_transfer.cpp:1056]618947 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.556.436 [tensor_data_transfer.cpp:612]618951 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_histogram_summary
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:43.556.443 [npu_driver.cc:4338] 618941 MemQueuePeek: queue empty
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.556.464 [api_impl.cc:6121] 618947 MemQueuePeek: Start to peek queue on devId 2, qid is 3.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.556.470 [tensor_data_transfer.cpp:1054]618951 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_histogram_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.556.477 [tensor_data_transfer.cpp:612]618941 acltdtReceiveTensorV2: queue is empty, device is 2, name is _npu_log
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:43.556.480 [npu_driver.cc:4338] 618949 MemQueuePeek: queue empty
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.556.483 [npu_driver.cc:4330] 618947 MemQueuePeek: peek mem queue, deviceId=2, qid=3, timeout=800.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.556.488 [tensor_data_transfer.cpp:1056]618951 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.556.497 [tensor_data_transfer.cpp:1054]618941 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is _npu_log
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.556.504 [tensor_data_transfer.cpp:612]618949 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_scalar_summary
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.556.517 [api_impl.cc:6121] 618951 MemQueuePeek: Start to peek queue on devId 2, qid is 5.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.556.521 [tensor_data_transfer.cpp:1056]618941 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.556.528 [tensor_data_transfer.cpp:1054]618949 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_scalar_summary
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.556.533 [npu_driver.cc:4330] 618951 MemQueuePeek: peek mem queue, deviceId=2, qid=5, timeout=800.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.556.539 [api_impl.cc:6121] 618941 MemQueuePeek: Start to peek queue on devId 2, qid is 0.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.556.544 [tensor_data_transfer.cpp:1056]618949 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.556.555 [npu_driver.cc:4330] 618941 MemQueuePeek: peek mem queue, deviceId=2, qid=0, timeout=800.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.556.564 [api_impl.cc:6121] 618949 MemQueuePeek: Start to peek queue on devId 2, qid is 4.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.556.579 [npu_driver.cc:4330] 618949 MemQueuePeek: peek mem queue, deviceId=2, qid=4, timeout=800.
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:43.620.168 [trs_cb_event.c:119][ascend][curpid:618666,618808][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =64; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:43.620.175 [trs_cb_event.c:119][ascend][curpid:618666,618809][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =65; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:43.620.188 [trs_sqcq.c:1491][ascend][curpid:618666,618808][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:43.620.194 [trs_sqcq.c:1491][ascend][curpid:618666,618809][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:43.620.200 [npu_driver.cc:3833] 618808 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=64, drvRetCode=16.
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:43.620.176 [queue_client_comm.c:114][ascend][curpid:618646,618963][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:43.620.176 [queue_client_comm.c:114][ascend][curpid:618646,618965][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:43.620.176 [queue_client_comm.c:114][ascend][curpid:618646,618961][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:43.620.206 [npu_driver.cc:3833] 618809 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:43.620.211 [api_impl.cc:5058] 618808 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:43.620.218 [api_impl.cc:5058] 618809 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.620.221 [callback.cpp:132]618808 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.620.230 [callback.cpp:132]618809 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.620.232 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:43.620.251 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.620.255 [npu_driver.cc:3828] 618808 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=64.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.620.265 [npu_driver.cc:3828] 618809 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=65.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:43.620.317 [npu_driver.cc:4338] 618963 MemQueuePeek: queue empty
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:43.620.345 [npu_driver.cc:4338] 618965 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.620.378 [tensor_data_transfer.cpp:612]618963 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_tensor_dump
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:43.620.382 [npu_driver.cc:4338] 618961 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.620.387 [tensor_data_transfer.cpp:612]618965 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_tensor_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.620.401 [tensor_data_transfer.cpp:1054]618963 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_tensor_dump
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.620.413 [tensor_data_transfer.cpp:612]618961 acltdtReceiveTensorV2: queue is empty, device is 0, name is _npu_log
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.620.416 [tensor_data_transfer.cpp:1054]618965 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_tensor_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.620.425 [tensor_data_transfer.cpp:1056]618963 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.620.437 [tensor_data_transfer.cpp:1056]618965 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.620.435 [tensor_data_transfer.cpp:1054]618961 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is _npu_log
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.620.449 [api_impl.cc:6121] 618963 MemQueuePeek: Start to peek queue on devId 0, qid is 1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.620.456 [api_impl.cc:6121] 618965 MemQueuePeek: Start to peek queue on devId 0, qid is 2.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.620.459 [tensor_data_transfer.cpp:1056]618961 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.620.469 [npu_driver.cc:4330] 618963 MemQueuePeek: peek mem queue, deviceId=0, qid=1, timeout=800.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.620.476 [npu_driver.cc:4330] 618965 MemQueuePeek: peek mem queue, deviceId=0, qid=2, timeout=800.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.620.482 [api_impl.cc:6121] 618961 MemQueuePeek: Start to peek queue on devId 0, qid is 0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.620.502 [npu_driver.cc:4330] 618961 MemQueuePeek: peek mem queue, deviceId=0, qid=0, timeout=800.
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:43.652.178 [queue_client_comm.c:114][ascend][curpid:618646,618969][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:43.652.179 [queue_client_comm.c:114][ascend][curpid:618646,618971][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:43.652.180 [queue_client_comm.c:114][ascend][curpid:618646,618967][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:43.652.177 [trs_cb_event.c:119][ascend][curpid:618658,618774][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =64; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:43.652.178 [trs_cb_event.c:119][ascend][curpid:618658,618775][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =65; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:43.652.210 [trs_sqcq.c:1491][ascend][curpid:618658,618774][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:43.652.223 [trs_sqcq.c:1491][ascend][curpid:618658,618775][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:43.652.235 [npu_driver.cc:3833] 618774 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:43.652.245 [npu_driver.cc:3833] 618775 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:43.652.256 [api_impl.cc:5058] 618774 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:43.652.280 [npu_driver.cc:4338] 618969 MemQueuePeek: queue empty
658,python3.9):2025-04-03-09:27:43.652.266 [api_impl.cc:5058] 618775 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.652.276 [callback.cpp:132]618774 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.652.297 [tensor_data_transfer.cpp:612]618969 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_scalar_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.652.305 [callback.cpp:132]618775 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.652.315 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.652.314 [tensor_data_transfer.cpp:1054]618969 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_scalar_summary
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:43.652.322 [npu_driver.cc:4338] 618971 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:43.652.326 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.652.327 [tensor_data_transfer.cpp:1056]618969 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.652.337 [npu_driver.cc:3828] 618774 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=64.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.652.339 [tensor_data_transfer.cpp:612]618971 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_histogram_summary
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.652.344 [api_impl.cc:6121] 618969 MemQueuePeek: Start to peek queue on devId 0, qid is 4.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.652.352 [tensor_data_transfer.cpp:1054]618971 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_histogram_summary
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:43.652.353 [npu_driver.cc:4338] 618967 MemQueuePeek: queue empty
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.652.358 [npu_driver.cc:4330] 618969 MemQueuePeek: peek mem queue, deviceId=0, qid=4, timeout=800.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.652.362 [tensor_data_transfer.cpp:1056]618971 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.652.351 [npu_driver.cc:3828] 618775 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=65.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.652.370 [tensor_data_transfer.cpp:612]618967 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_image_summary
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.652.376 [api_impl.cc:6121] 618971 MemQueuePeek: Start to peek queue on devId 0, qid is 5.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.652.382 [tensor_data_transfer.cpp:1054]618967 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_image_summary
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.652.386 [npu_driver.cc:4330] 618971 MemQueuePeek: peek mem queue, deviceId=0, qid=5, timeout=800.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:43.652.392 [tensor_data_transfer.cpp:1056]618967 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.652.402 [api_impl.cc:6121] 618967 MemQueuePeek: Start to peek queue on devId 0, qid is 3.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:43.652.413 [npu_driver.cc:4330] 618967 MemQueuePeek: peek mem queue, deviceId=0, qid=3, timeout=800.
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:43.684.171 [trs_cb_event.c:119][ascend][curpid:618674,618818][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =64; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:43.684.181 [trs_cb_event.c:119][ascend][curpid:618674,618819][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =65; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:43.684.190 [trs_sqcq.c:1491][ascend][curpid:618674,618818][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:43.684.206 [trs_sqcq.c:1491][ascend][curpid:618674,618819][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:43.684.212 [npu_driver.cc:3833] 618818 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=64, drvRetCode=16.
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:43.684.174 [trs_cb_event.c:119][ascend][curpid:618662,618817][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =833; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:43.684.176 [trs_cb_event.c:119][ascend][curpid:618662,618816][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =832; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:43.684.200 [trs_sqcq.c:1491][ascend][curpid:618662,618817][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:43.684.213 [trs_sqcq.c:1491][ascend][curpid:618662,618816][drv][tsdrv][trsCbCqRecv]Recv warn. (de[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:43.684.226 [npu_driver.cc:3833] 618819 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=65, drvRetCode=16.
vId=4; type=1; ret=16)
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:43.684.233 [api_impl.cc:5058] 618818 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618674,python3.9):[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:43.684.219 [npu_driver.cc:3833] 618817 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=833, drvRetCode=16.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:43.684.257 [npu_driver.cc:3833] 618816 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=832, drvRetCode=16.
2025-04-03-09:27:43.684.244 [api_impl.cc:5058] 618819 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.684.252 [callback.cpp:132]618818 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:43.684.270 [api_impl.cc:5058] 618817 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:43.684.280 [api_impl.cc:5058] 618816 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.684.289 [callback.cpp:132]618817 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.684.283 [callback.cpp:132]618819 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.684.290 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.684.298 [callback.cpp:132]618816 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:43.684.302 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.684.304 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:43.684.313 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.684.311 [npu_driver.cc:3828] 618818 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=64.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.684.323 [npu_driver.cc:3828] 618817 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=833.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:43.684.322 [npu_driver.cc:3828] 618819 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=65.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:43.684.329 [npu_driver.cc:3828] 618816 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=832.
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:43.716.171 [trs_cb_event.c:119][ascend][curpid:618670,618823][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =65; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:43.716.183 [trs_cb_event.c:119][ascend][curpid:618670,618822][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =64; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:43.716.194 [trs_sqcq.c:1491][ascend][curpid:618670,618823][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:43.716.202 [trs_sqcq.c:1491][ascend][curpid:618670,618822][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:43.716.207 [npu_driver.cc:3833] 618823 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:43.716.218 [npu_driver.cc:3833] 618822 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:43.716.225 [api_impl.cc:5058] 618823 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:43.716.247 [api_impl.cc:5058] 618822 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.716.253 [callback.cpp:132]618823 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.716.264 [callback.cpp:132]618822 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.716.267 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:43.716.278 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.716.286 [npu_driver.cc:3828] 618823 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=65.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:43.716.294 [npu_driver.cc:3828] 618822 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=64.
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:43.812.176 [trs_cb_event.c:119][ascend][curpid:618650,618829][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =321; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:43.812.177 [trs_cb_event.c:119][ascend][curpid:618650,618828][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =320; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:43.812.196 [trs_sqcq.c:1491][ascend][curpid:618650,618829][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:43.812.202 [trs_sqcq.c:1491][ascend][curpid:618650,618828][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:43.812.207 [npu_driver.cc:3833] 618829 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:43.812.214 [npu_driver.cc:3833] 618828 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=320, drvRetCode=16.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:43.812.227 [api_impl.cc:5058] 618829 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:43.812.230 [api_impl.cc:5058] 618828 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.812.238 [callback.cpp:132]618829 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.812.241 [callback.cpp:132]618828 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.812.249 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:43.812.252 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.812.261 [npu_driver.cc:3828] 618829 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=321.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:43.812.264 [npu_driver.cc:3828] 618828 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=320.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:43.884.672 [runtime.cc:5239] 618772 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:43.884.701 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618772] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:43.884.722 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618772] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:43.884.736 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618772] [TsdClient] g_userDeviceInfo is empty.
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:43.908.178 [trs_cb_event.c:119][ascend][curpid:618654,618833][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =321; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:43.908.179 [trs_cb_event.c:119][ascend][curpid:618654,618832][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =320; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:43.908.207 [trs_sqcq.c:1491][ascend][curpid:618654,618833][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:43.908.219 [trs_sqcq.c:1491][ascend][curpid:618654,618832][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:43.908.227 [npu_driver.cc:3833] 618833 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:43.908.241 [npu_driver.cc:3833] 618832 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=320, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:43.908.249 [api_impl.cc:5058] 618833 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:43.908.268 [api_impl.cc:5058] 618832 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.908.275 [callback.cpp:132]618833 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.908.285 [callback.cpp:132]618832 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.908.289 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:43.908.301 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.908.309 [npu_driver.cc:3828] 618833 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=321.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:43.908.319 [npu_driver.cc:3828] 618832 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=320.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:43.980.723 [runtime.cc:5239] 618806 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:43.980.749 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618806] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:43.980.761 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618806] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:43.980.773 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618806] [TsdClient] g_userDeviceInfo is empty.
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:44.004.177 [trs_cb_event.c:119][ascend][curpid:618646,618836][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =64; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:44.004.179 [trs_cb_event.c:119][ascend][curpid:618646,618837][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =65; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:44.004.204 [trs_sqcq.c:1491][ascend][curpid:618646,618836][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:44.004.219 [trs_sqcq.c:1491][ascend][curpid:618646,618837][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:44.004.240 [npu_driver.cc:3833] 618836 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:44.004.252 [npu_driver.cc:3833] 618837 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:44.004.265 [api_impl.cc:5058] 618836 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:44.004.274 [api_impl.cc:5058] 618837 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:44.004.283 [callback.cpp:132]618836 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:44.004.292 [callback.cpp:132]618837 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:44.004.300 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:44.004.310 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:44.004.325 [npu_driver.cc:3828] 618836 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=64.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:44.004.335 [npu_driver.cc:3828] 618837 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=65.
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:44.036.169 [queue_client_comm.c:114][ascend][curpid:618658,618781][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:44.036.172 [queue_client_comm.c:114][ascend][curpid:618658,618779][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:44.036.176 [queue_client_comm.c:114][ascend][curpid:618658,618785][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:44.036.177 [queue_client_comm.c:114][ascend][curpid:618658,618789][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:44.036.181 [queue_client_comm.c:114][ascend][curpid:618658,618787][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:44.036.180 [queue_client_comm.c:114][ascend][curpid:618658,618783][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:44.036.297 [npu_driver.cc:4338] 618781 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.036.316 [tensor_data_transfer.cpp:612]618781 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_tensor_dump
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:44.036.327 [npu_driver.cc:4338] 618779 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.036.335 [tensor_data_transfer.cpp:1054]618781 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_tensor_dump
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.036.341 [tensor_data_transfer.cpp:612]618779 acltdtReceiveTensorV2: queue is empty, device is 3, name is _npu_log
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.036.351 [tensor_data_transfer.cpp:1056]618781 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:44.036.358 [npu_driver.cc:4338] 618785 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.036.358 [tensor_data_transfer.cpp:1054]618779 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is _npu_log
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:44.036.365 [api_impl.cc:6121] 618781 MemQueuePeek: Start to peek queue on devId 3, qid is 1.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.036.394 [tensor_data_transfer.cpp:612]618785 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_image_summary
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:44.036.400 [npu_driver.cc:4338] 618789 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.036.405 [tensor_data_transfer.cpp:1056]618779 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:44.036.417 [npu_driver.cc:4330] 618781 MemQueuePeek: peek mem queue, deviceId=3, qid=1, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.036.427 [tensor_data_transfer.cpp:1054]618785 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_image_summary
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:44.036.440 [npu_driver.cc:4338] 618787 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.036.468 [tensor_data_transfer.cpp:1056]618785 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.036.445 [tensor_data_transfer.cpp:612]618789 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_histogram_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:44.036.451 [api_impl.cc:6121] 618779 MemQueuePeek: Start to peek queue on devId 3, qid is 0.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.036.493 [tensor_data_transfer.cpp:1054]618789 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_histogram_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.036.476 [tensor_data_transfer.cpp:612]618787 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_scalar_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:44.036.481 [api_impl.cc:6121] 618785 MemQueuePeek: Start to peek queue on devId 3, qid is 3.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:44.036.480 [npu_driver.cc:4338] 618783 MemQueuePeek: queue empty
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:44.036.499 [npu_driver.cc:4330] 618779 MemQueuePeek: peek mem queue, deviceId=3, qid=0, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.036.509 [tensor_data_transfer.cpp:1056]618789 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:44.036.556 [api_impl.cc:6121] 618789 MemQueuePeek: Start to peek queue on devId 3, qid is 5.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:44.036.574 [npu_driver.cc:4330] 618789 MemQueuePeek: peek mem queue, deviceId=3, qid=5, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.036.519 [tensor_data_transfer.cpp:1054]618787 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_scalar_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:44.036.526 [npu_driver.cc:4330] 618785 MemQueuePeek: peek mem queue, deviceId=3, qid=3, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.036.544 [tensor_data_transfer.cpp:612]618783 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_tensor_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.036.596 [tensor_data_transfer.cpp:1056]618787 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.036.621 [tensor_data_transfer.cpp:1054]618783 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_tensor_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.036.645 [tensor_data_transfer.cpp:1056]618783 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:44.036.663 [api_impl.cc:6121] 618783 MemQueuePeek: Start to peek queue on devId 3, qid is 2.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:44.036.635 [api_impl.cc:6121] 618787 MemQueuePeek: Start to peek queue on devId 3, qid is 4.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:44.036.693 [npu_driver.cc:4330] 618783 MemQueuePeek: peek mem queue, deviceId=3, qid=2, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:44.036.720 [npu_driver.cc:4330] 618787 MemQueuePeek: peek mem queue, deviceId=3, qid=4, timeout=800.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.044.717 [runtime.cc:5239] 618812 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:44.044.738 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618812] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.044.708 [runtime.cc:5239] 618814 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:44.044.733 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618814] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:44.044.752 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618812] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:44.044.749 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618814] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:44.044.765 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618814] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:44.044.766 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618812] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:44.076.714 [runtime.cc:5239] 618820 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:44.076.736 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618820] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:44.076.753 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618820] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:44.076.766 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618820] [TsdClient] g_userDeviceInfo is empty.
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:44.100.183 [queue_client_comm.c:114][ascend][curpid:618666,618851][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:44.100.187 [queue_client_comm.c:114][ascend][curpid:618666,618845][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:44.100.188 [queue_client_comm.c:114][ascend][curpid:618666,618843][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:44.100.190 [queue_client_comm.c:114][ascend][curpid:618666,618847][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:44.100.191 [queue_client_comm.c:114][ascend][curpid:618666,618841][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:44.100.193 [queue_client_comm.c:114][ascend][curpid:618666,618849][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:44.100.283 [npu_driver.cc:4338] 618851 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.100.300 [tensor_data_transfer.cpp:612]618851 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_histogram_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.100.312 [tensor_data_transfer.cpp:1054]618851 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_histogram_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.100.325 [tensor_data_transfer.cpp:1056]618851 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:44.100.330 [npu_driver.cc:4338] 618845 MemQueuePeek: queue empty
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:44.100.336 [api_impl.cc:6121] 618851 MemQueuePeek: Start to peek queue on devId 5, qid is 5.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:44.100.364 [npu_driver.cc:4338] 618843 MemQueuePeek: queue empty
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:44.100.377 [npu_driver.cc:4330] 618851 MemQueuePeek: peek mem queue, deviceId=5, qid=5, timeout=800.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.100.383 [tensor_data_transfer.cpp:612]618843 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_tensor_dump
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.100.373 [tensor_data_transfer.cpp:612]618845 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_tensor_summary
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:44.100.395 [npu_driver.cc:4338] 618847 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.100.409 [tensor_data_transfer.cpp:1054]618843 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_tensor_dump
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.100.453 [tensor_data_transfer.cpp:1056]618843 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.100.452 [tensor_data_transfer.cpp:612]618847 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_image_summary
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:44.100.453 [npu_driver.cc:4338] 618841 MemQueuePeek: queue empty
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:44.100.473 [npu_driver.cc:4338] 618849 MemQueuePeek: queue empty
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:44.100.466 [api_impl.cc:6121] 618843 MemQueuePeek: Start to peek queue on devId 5, qid is 1.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.100.470 [tensor_data_transfer.cpp:1054]618847 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_image_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.100.443 [tensor_data_transfer.cpp:1054]618845 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_tensor_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.100.485 [tensor_data_transfer.cpp:612]618841 acltdtReceiveTensorV2: queue is empty, device is 5, name is _npu_log
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.100.489 [tensor_data_transfer.cpp:612]618849 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_scalar_summary
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:44.100.492 [npu_driver.cc:4330] 618843 MemQueuePeek: peek mem queue, deviceId=5, qid=1, timeout=800.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.100.496 [tensor_data_transfer.cpp:1056]618847 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.100.522 [tensor_data_transfer.cpp:1054]618849 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_scalar_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.100.508 [tensor_data_transfer.cpp:1056]618845 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.100.516 [tensor_data_transfer.cpp:1054]618841 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is _npu_log
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:44.100.529 [api_impl.cc:6121] 618847 MemQueuePeek: Start to peek queue on devId 5, qid is 3.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.100.534 [tensor_data_transfer.cpp:1056]618849 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.100.551 [tensor_data_transfer.cpp:1056]618841 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:44.100.559 [npu_driver.cc:4330] 618847 MemQueuePeek: peek mem queue, deviceId=5, qid=3, timeout=800.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:44.100.548 [api_impl.cc:6121] 618845 MemQueuePeek: Start to peek queue on devId 5, qid is 2.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:44.100.564 [api_impl.cc:6121] 618849 MemQueuePeek: Start to peek queue on devId 5, qid is 4.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:44.100.572 [api_impl.cc:6121] 618841 MemQueuePeek: Start to peek queue on devId 5, qid is 0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:44.100.605 [npu_driver.cc:4330] 618841 MemQueuePeek: peek mem queue, deviceId=5, qid=0, timeout=800.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:44.100.586 [npu_driver.cc:4330] 618845 MemQueuePeek: peek mem queue, deviceId=5, qid=2, timeout=800.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:44.100.594 [npu_driver.cc:4330] 618849 MemQueuePeek: peek mem queue, deviceId=5, qid=4, timeout=800.
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:44.132.175 [trs_cb_event.c:119][ascend][curpid:618666,618808][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =64; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:44.132.176 [trs_cb_event.c:119][ascend][curpid:618666,618809][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =65; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:44.132.194 [trs_sqcq.c:1491][ascend][curpid:618666,618808][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:44.132.199 [trs_sqcq.c:1491][ascend][curpid:618666,618809][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:44.132.206 [npu_driver.cc:3833] 618808 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:44.132.211 [npu_driver.cc:3833] 618809 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:44.132.218 [api_impl.cc:5058] 618808 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:44.132.222 [api_impl.cc:5058] 618809 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.132.228 [callback.cpp:132]618808 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.132.232 [callback.cpp:132]618809 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.132.240 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.132.243 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:44.132.252 [npu_driver.cc:3828] 618808 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=64.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:44.132.256 [npu_driver.cc:3828] 618809 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=65.
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:44.160.181 [queue_client_comm.c:114][ascend][curpid:618674,618878][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:44.160.185 [trs_cb_event.c:119][ascend][curpid:618658,618774][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =64; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:44.160.219 [trs_sqcq.c:1491][ascend][curpid:618658,618774][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:44.160.238 [npu_driver.cc:3833] 618774 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:44.160.256 [api_impl.cc:5058] 618774 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:44.160.278 [npu_driver.cc:4338] 618878 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.160.277 [callback.cpp:132]618774 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.160.293 [tensor_data_transfer.cpp:612]618878 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_image_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.160.294 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.160.305 [tensor_data_transfer.cpp:1054]618878 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_image_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:44.160.310 [npu_driver.cc:3828] 618774 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=64.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.160.316 [tensor_data_transfer.cpp:1056]618878 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.160.327 [api_impl.cc:6121] 618878 MemQueuePeek: Start to peek queue on devId 7, qid is 3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.160.337 [npu_driver.cc:4330] 618878 MemQueuePeek: peek mem queue, deviceId=7, qid=3, timeout=800.
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:44.164.171 [queue_client_comm.c:114][ascend][curpid:618674,618870][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:44.164.175 [queue_client_comm.c:114][ascend][curpid:618674,618881][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:44.164.166 [queue_client_comm.c:114][ascend][curpid:618662,618876][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:44.164.173 [queue_client_comm.c:114][ascend][curpid:618662,618880][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:44.164.179 [queue_client_comm.c:114][ascend][curpid:618662,618885][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:44.164.178 [trs_cb_event.c:119][ascend][curpid:618658,618775][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =65; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:44.164.208 [trs_sqcq.c:1491][ascend][curpid:618658,618775][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:44.164.181 [queue_client_comm.c:114][ascend][curpid:618662,618868][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:44.164.177 [queue_client_comm.c:114][ascend][curpid:618662,618872][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:44.164.175 [queue_client_comm.c:114][ascend][curpid:618674,618873][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:44.164.227 [npu_driver.cc:3833] 618775 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=65, drvRetCode=16.
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:44.164.179 [queue_client_comm.c:114][ascend][curpid:618674,618866][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:44.164.181 [queue_client_comm.c:114][ascend][curpid:618674,618884][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:44.164.177 [queue_client_comm.c:114][ascend][curpid:618662,618864][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:44.164.244 [api_impl.cc:5058] 618775 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.164.260 [callback.cpp:132]618775 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.164.283 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:44.164.256 [npu_driver.cc:4338] 618870 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.164.296 [tensor_data_transfer.cpp:612]618870 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_tensor_dump
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:44.164.301 [npu_driver.cc:4338] 618881 MemQueuePeek: queue empty
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:44.164.291 [npu_driver.cc:4338] 618876 MemQueuePeek: queue empty
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:44.164.301 [npu_driver.cc:3828] 618775 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=65.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.164.313 [tensor_data_transfer.cpp:1054]618870 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_tensor_dump
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.164.317 [tensor_data_transfer.cpp:612]618876 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_image_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.164.323 [tensor_data_transfer.cpp:612]618881 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_scalar_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.164.332 [tensor_data_transfer.cpp:1056]618870 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:44.164.329 [npu_driver.cc:4338] 618880 MemQueuePeek: queue empty
[INFO] ASCENDCL(618[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:44.164.335 [npu_driver.cc:4338] 618873 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.164.344 [tensor_data_transfer.cpp:1054]618881 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_scalar_summary
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.164.353 [api_impl.cc:6121] 618870 MemQueuePeek: Start to peek queue on devId 7, qid is 1.
662,python3.9):2025-04-03-09:27:44.164.334 [tensor_data_transfer.cpp:1054]618876 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_image_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.164.347 [tensor_data_transfer.cpp:612]618880 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_scalar_summary
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:44.164.360 [npu_driver.cc:4338] 618866 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.164.363 [tensor_data_transfer.cpp:612]618873 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_tensor_summary
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:44.164.357 [npu_driver.cc:4338] 618885 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.164.370 [tensor_data_transfer.cpp:1056]618881 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.164.383 [tensor_data_transfer.cpp:1056]618876 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.164.381 [npu_driver.cc:4330] 618870 MemQueuePeek: peek mem queue, deviceId=7, qid=1, timeout=800.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:44.164.387 [npu_driver.cc:4338] 618884 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.164.390 [tensor_data_transfer.cpp:612]618866 acltdtReceiveTensorV2: queue is empty, device is 7, name is _npu_log
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:44.164.396 [npu_driver.cc:4338] 618868 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.164.394 [tensor_data_transfer.cpp:1054]618880 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_scalar_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.164.403 [tensor_data_transfer.cpp:612]618885 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_histogram_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.164.402 [tensor_data_transfer.cpp:1054]618873 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_tensor_summary
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.164.409 [api_impl.cc:6121] 618881 MemQueuePeek: Start to peek queue on devId 7, qid is 4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.164.414 [api_impl.cc:6121] 618876 MemQueuePeek: Start to peek queue on devId 4, qid is 3.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:44.164.438 [npu_driver.cc:4338] 618872 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.164.426 [tensor_data_transfer.cpp:612]618884 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_histogram_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.164.430 [tensor_data_transfer.cpp:1054]618866 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is _npu_log
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.164.444 [tensor_data_transfer.cpp:1056]618873 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.164.440 [tensor_data_transfer.cpp:612]618868 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_tensor_dump
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.164.445 [tensor_data_transfer.cpp:1056]618880 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.164.454 [npu_driver.cc:4330] 618881 MemQueuePeek: peek mem queue, deviceId=7, qid=4, timeout=800.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.164.452 [tensor_data_transfer.cpp:1054]618885 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_histogram_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.164.465 [tensor_data_transfer.cpp:1054]618884 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_histogram_summary
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.164.462 [npu_driver.cc:4330] 618876 MemQueuePeek: peek mem queue, deviceId=4, qid=3, timeout=800.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.164.472 [tensor_data_transfer.cpp:1056]618866 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:44.164.469 [npu_driver.cc:4338] 618864 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.164.478 [tensor_data_transfer.cpp:612]618872 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_tensor_summary
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.164.485 [api_impl.cc:6121] 618873 MemQueuePeek: Start to peek queue on devId 7, qid is 2.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.164.500 [tensor_data_transfer.cpp:1056]618884 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.164.482 [tensor_data_transfer.cpp:1054]618868 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_tensor_dump
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.164.511 [api_impl.cc:6121] 618866 MemQueuePeek: Start to peek queue on devId 7, qid is 0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.164.522 [npu_driver.cc:4330] 6188[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.164.489 [api_impl.cc:6121] 618880 MemQueuePeek: Start to peek queue on devId 4, qid is 4.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.164.494 [tensor_data_transfer.cpp:1056]618885 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.164.520 [tensor_data_transfer.cpp:612]618864 acltdtReceiveTensorV2: queue is empty, device is 4, name is _npu_log
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.164.529 [tensor_data_transfer.cpp:1054]618872 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_tensor_summary
73 MemQueuePeek: peek mem queue, deviceId=7, qid=2, timeout=800.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.164.532 [api_impl.cc:6121] 618884 MemQueuePeek: Start to peek queue on devId 7, qid is 5.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.164.551 [tensor_data_transfer.cpp:1056]618868 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.164.557 [npu_driver.cc:4330] 618880 MemQueuePeek: peek mem queue, deviceId=4, qid=4, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.164.565 [api_impl.cc:6121] 618885 MemQueuePeek: Start to peek queue on devId 4, qid is 5.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.164.588 [npu_driver.cc:4330] 618884 MemQueuePeek: peek mem queue, deviceId=7, qid=5, timeout=800.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.164.574 [tensor_data_transfer.cpp:1054]618864 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is _npu_log
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.164.577 [tensor_data_transfer.cpp:1056]618872 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.164.584 [api_impl.cc:6121] 618868 MemQueuePee[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.164.545 [npu_driver.cc:4330] 618866 MemQueuePeek: peek mem queue, deviceId=7, qid=0, timeout=800.
k: Start to peek queue on devId 4, qid is 1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.164.598 [npu_driver.cc:4330] 618885 MemQueuePeek: peek mem queue, deviceId=4, qid=5, timeout=800.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.164.604 [tensor_data_transfer.cpp:1056]618864 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.164.612 [api_impl.cc:6121] 618872 MemQueuePeek: Start to peek queue on devId 4, qid is 2.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.164.656 [npu_driver.cc:4330] 618868 MemQueuePeek: peek mem queue, deviceId=4, qid=1, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.164.665 [api_impl.cc:6121] 618864 MemQueuePeek: Start to peek queue on devId 4, qid is 0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.164.669 [npu_driver.cc:4330] 618872 MemQueuePeek: peek mem queue, deviceId=4, qid=2, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.164.681 [npu_driver.cc:4330] 618864 MemQueuePeek: peek mem queue, deviceId=4, qid=0, timeout=800.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:44.172.715 [runtime.cc:5239] 618826 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:44.172.739 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618826] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:44.172.751 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618826] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:44.172.762 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618826] [TsdClient] g_userDeviceInfo is empty.
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:44.192.175 [trs_cb_event.c:119][ascend][curpid:618674,618819][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =65; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:44.192.207 [trs_sqcq.c:1491][ascend][curpid:618674,618819][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:44.192.226 [npu_driver.cc:3833] 618819 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:44.192.244 [api_impl.cc:5058] 618819 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.192.262 [callback.cpp:132]618819 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.192.279 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.192.295 [npu_driver.cc:3828] 618819 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=65.
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:44.196.169 [queue_client_comm.c:114][ascend][curpid:618670,618903][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:44.196.169 [queue_client_comm.c:114][ascend][curpid:618670,618901][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:44.196.170 [queue_client_comm.c:114][ascend][curpid:618670,618905][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:44.196.171 [queue_client_comm.c:114][ascend][curpid:618670,618909][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:44.196.183 [trs_cb_event.c:119][ascend][curpid:618674,618818][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =64; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:44.196.179 [trs_cb_event.c:119][ascend][curpid:618662,618817][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =833; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:44.196.184 [trs_cb_event.c:119][ascend][curpid:618662,618816][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =832; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:44.196.208 [trs_sqcq.c:1491][ascend][curpid:618662,618817][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:44.196.217 [trs_sqcq.c:1491][ascend][curpid:618662,618816][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:44.196.172 [queue_client_comm.c:114][ascend][curpid:618670,618911][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:44.196.177 [queue_client_comm.c:114][ascend][curpid:618670,618907][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:44.196.212 [trs_sqcq.c:1491][ascend][curpid:618674,618818][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:44.196.228 [npu_driver.cc:3833] 618817 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=833, drvRetCode=16.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:44.196.228 [npu_driver.cc:3833] 618818 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:44.196.241 [api_impl.cc:5058] 618818 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:44.196.237 [npu_driver.cc:3833] 618816 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=832, drvRetCode=16.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:44.196.245 [api_impl.cc:5058] 618817 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.196.253 [callback.cpp:132]618818 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:44.196.255 [api_impl.cc:5058] 618816 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.196.265 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:44.196.256 [npu_driver.cc:4338] 618903 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:44.196.272 [tensor_data_transfer.cpp:612]618903 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_tensor_dump
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.196.262 [callback.cpp:132]618817 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.196.277 [callback.cpp:132]618816 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.196.279 [npu_driver.cc:3828] 618818 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=64.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.196.285 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.196.294 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.196.303 [npu_driver.cc:3828] 618817 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=833.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.196.309 [npu_driver.cc:3828] 618816 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=832.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:44.196.286 [npu_driver.cc:4338] 618901 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:44.196.288 [tensor_data_transfer.cpp:1054]618903 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_tensor_dump
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:44.196.301 [tensor_data_transfer.cpp:612]618901 acltdtReceiveTensorV2: queue is empty, device is 6, name is _npu_log
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:44.196.304 [tensor_data_transfer.cpp:1056]618903 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:44.196.327 [tensor_data_transfer.cpp:1054]618901 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is _npu_log
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:44.196.332 [api_impl.cc:6121] 618903 MemQueuePeek: Start to peek queue on devId 6, qid is 1.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:44.196.337 [npu_driver.cc:4338] 618905 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:44.196.341 [tensor_data_transfer.cpp:1056]618901 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:44.196.348 [npu_driver.cc:4330] 618903 MemQueuePeek: peek mem queue, deviceId=6, qid=1, timeout=800.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:44.196.354 [tensor_data_transfer.cpp:612]618905 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_tensor_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:44.196.362 [api_impl.cc:6121] 618901 MemQueuePeek: Start to peek queue on devId 6, qid is 0.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:44.196.368 [npu_driver.cc:4338] 618909 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:44.196.372 [tensor_data_transfer.cpp:1054]618905 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_tensor_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:44.196.380 [npu_driver.cc:4330] 618901 MemQueuePeek: peek mem queue, deviceId=6, qid=0, timeout=800.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:44.196.386 [tensor_data_transfer.cpp:612]618909 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_scalar_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:44.196.391 [tensor_data_transfer.cpp:1056]618905 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:44.196.404 [npu_driver.cc:4338] 618911 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:44.196.404 [tensor_data_transfer.cpp:1054]618909 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_scalar_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:44.196.408 [api_impl.cc:6121] 618905 MemQueuePeek: Start to peek queue on devId 6, qid is 2.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:44.196.418 [tensor_data_transfer.cpp:612]618911 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_histogram_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:44.196.423 [tensor_data_transfer.cpp:1056]618909 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:44.196.429 [npu_driver.cc:4330] 618905 MemQueuePeek: peek mem queue, deviceId=6, qid=2, timeout=800.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:44.196.435 [tensor_data_transfer.cpp:1054]618911 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_histogram_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:44.196.439 [api_impl.cc:6121] 618909 MemQueuePeek: Start to peek queue on devId 6, qid is 4.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:44.196.440 [npu_driver.cc:4338] 618907 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:44.196.449 [tensor_data_transfer.cpp:1056]618911 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:44.196.456 [npu_driver.cc:4330] 618909 MemQueuePeek: peek mem queue, deviceId=6, qid=4, timeout=800.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:44.196.469 [api_impl.cc:6121] 618911 MemQueuePeek: Start to peek queue on devId 6, qid is 5.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:44.196.464 [tensor_data_transfer.cpp:612]618907 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_image_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:44.196.481 [npu_driver.cc:4330] 618911 MemQueuePeek: peek mem queue, deviceId=6, qid=5, timeout=800.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:44.196.490 [tensor_data_transfer.cpp:1054]618907 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_image_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:44.196.509 [tensor_data_transfer.cpp:1056]618907 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:44.196.523 [api_impl.cc:6121] 618907 MemQueuePeek: Start to peek queue on devId 6, qid is 3.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:44.196.538 [npu_driver.cc:4330] 618907 MemQueuePeek: peek mem queue, deviceId=6, qid=3, timeout=800.
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:44.228.177 [trs_cb_event.c:119][ascend][curpid:618670,618823][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =65; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:44.228.177 [trs_cb_event.c:119][ascend][curpid:618670,618822][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =64; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:44.228.203 [trs_sqcq.c:1491][ascend][curpid:618670,618823][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:44.228.216 [trs_sqcq.c:1491][ascend][curpid:618670,618822][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:44.228.223 [npu_driver.cc:3833] 618823 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:44.228.232 [npu_driver.cc:3833] 618822 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:44.228.239 [api_impl.cc:5058] 618823 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:44.228.246 [api_impl.cc:5058] 618822 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:44.228.254 [callback.cpp:132]618823 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:44.228.265 [callback.cpp:132]618822 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:44.228.268 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:44.228.281 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:44.228.290 [npu_driver.cc:3828] 618823 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=65.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:44.228.297 [npu_driver.cc:3828] 618822 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=64.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:44.268.664 [runtime.cc:5239] 618830 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:44.268.694 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618830] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:44.268.711 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618830] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:44.268.726 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618830] [TsdClient] g_userDeviceInfo is empty.
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:44.292.170 [queue_client_comm.c:114][ascend][curpid:618650,618929][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:44.292.171 [queue_client_comm.c:114][ascend][curpid:618650,618927][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:44.292.172 [queue_client_comm.c:114][ascend][curpid:618650,618925][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:44.292.177 [queue_client_comm.c:114][ascend][curpid:618650,618923][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:44.292.178 [queue_client_comm.c:114][ascend][curpid:618650,618931][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:44.292.179 [queue_client_comm.c:114][ascend][curpid:618650,618921][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:44.292.256 [npu_driver.cc:4338] 618929 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:44.292.267 [tensor_data_transfer.cpp:612]618929 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_scalar_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:44.292.278 [tensor_data_transfer.cpp:1054]618929 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_scalar_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:44.292.288 [tensor_data_transfer.cpp:1056]618929 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:44.292.302 [npu_driver.cc:4338] 618927 MemQueuePeek: queue empty
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:44.292.304 [api_impl.cc:6121] 618929 MemQueuePeek: Start to peek queue on devId 1, qid is 4.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:44.292.315 [tensor_data_transfer.cpp:612]618927 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_image_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:44.292.318 [npu_driver.cc:4330] 618929 MemQueuePeek: peek mem queue, deviceId=1, qid=4, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:44.292.327 [tensor_data_transfer.cpp:1054]618927 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_image_summary
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:44.292.336 [npu_driver.cc:4338] 618925 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:44.292.339 [tensor_data_transfer.cpp:1056]618927 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:44.292.349 [tensor_data_transfer.cpp:612]618925 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_tensor_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:44.292.351 [api_impl.cc:6121] 618927 MemQueuePeek: Start to peek queue on devId 1, qid is 3.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:44.292.362 [tensor_data_transfer.cpp:1054]618925 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_tensor_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:44.292.365 [npu_driver.cc:4330] 618927 MemQueuePeek: peek mem queue, deviceId=1, qid=3, timeout=800.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:44.292.371 [npu_driver.cc:4338] 618923 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:44.292.373 [tensor_data_transfer.cpp:1056]618925 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:44.292.382 [tensor_data_transfer.cpp:612]618923 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_tensor_dump
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:44.292.385 [api_impl.cc:6121] 618925 MemQueuePeek: Start to peek queue on devId 1, qid is 2.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:44.292.393 [tensor_data_transfer.cpp:1054]618923 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_tensor_dump
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:44.292.396 [npu_driver.cc:4330] 618925 MemQueuePeek: peek mem queue, deviceId=1, qid=2, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:44.292.403 [tensor_data_transfer.cpp:1056]618923 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:44.292.406 [npu_driver.cc:4338] 618931 MemQueuePeek: queue empty
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:44.292.413 [api_impl.cc:6121] 618923 MemQueuePeek: Start to peek queue on devId 1, qid is 1.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:44.292.417 [tensor_data_transfer.cpp:612]618931 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_histogram_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:44.292.425 [npu_driver.cc:4330] 618923 MemQueuePeek: peek mem queue, deviceId=1, qid=1, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:44.292.428 [tensor_data_transfer.cpp:1054]618931 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_histogram_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:44.292.438 [tensor_data_transfer.cpp:1056]618931 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:44.292.442 [npu_driver.cc:4338] 618921 MemQueuePeek: queue empty
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:44.292.449 [api_impl.cc:6121] 618931 MemQueuePeek: Start to peek queue on devId 1, qid is 5.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:44.292.454 [tensor_data_transfer.cpp:612]618921 acltdtReceiveTensorV2: queue is empty, device is 1, name is _npu_log
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:44.292.467 [npu_driver.cc:4330] 618931 MemQueuePeek: peek mem queue, deviceId=1, qid=5, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:44.292.472 [tensor_data_transfer.cpp:1054]618921 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is _npu_log
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:44.292.483 [tensor_data_transfer.cpp:1056]618921 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:44.292.496 [api_impl.cc:6121] 618921 MemQueuePeek: Start to peek queue on devId 1, qid is 0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:44.292.506 [npu_driver.cc:4330] 618921 MemQueuePeek: peek mem queue, deviceId=1, qid=0, timeout=800.
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:44.324.170 [trs_cb_event.c:119][ascend][curpid:618650,618829][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =321; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:44.324.173 [trs_cb_event.c:119][ascend][curpid:618650,618828][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =320; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:44.324.186 [trs_sqcq.c:1491][ascend][curpid:618650,618829][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:44.324.191 [trs_sqcq.c:1491][ascend][curpid:618650,618828][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:44.324.197 [npu_driver.cc:3833] 618829 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:44.324.204 [npu_driver.cc:3833] 618828 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=320, drvRetCode=16.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:44.324.207 [api_impl.cc:5058] 618829 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:44.324.215 [api_impl.cc:5058] 618828 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:44.324.218 [callback.cpp:132]618829 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:44.324.228 [callback.cpp:132]618828 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:44.324.230 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:44.324.239 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:44.324.243 [npu_driver.cc:3828] 618829 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=321.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:44.324.253 [npu_driver.cc:3828] 618828 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=320.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:44.364.718 [runtime.cc:5239] 618834 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:44.364.743 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618834] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:44.364.756 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618834] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:44.364.773 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618834] [TsdClient] g_userDeviceInfo is empty.
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:44.388.166 [queue_client_comm.c:114][ascend][curpid:618654,618943][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:44.388.169 [queue_client_comm.c:114][ascend][curpid:618654,618949][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:44.388.174 [queue_client_comm.c:114][ascend][curpid:618654,618945][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:44.388.172 [queue_client_comm.c:114][ascend][curpid:618654,618947][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:44.388.173 [queue_client_comm.c:114][ascend][curpid:618654,618951][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:44.388.178 [queue_client_comm.c:114][ascend][curpid:618654,618941][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:44.388.262 [npu_driver.cc:4338] 618943 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:44.388.279 [tensor_data_transfer.cpp:612]618943 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_tensor_dump
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:44.388.290 [npu_driver.cc:4338] 618949 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:44.388.293 [tensor_data_transfer.cpp:1054]618943 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_tensor_dump
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:44.388.307 [tensor_data_transfer.cpp:612]618949 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_scalar_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:44.388.312 [tensor_data_transfer.cpp:1056]618943 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:44.388.322 [npu_driver.cc:4338] 618945 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:44.388.342 [tensor_data_transfer.cpp:1054]618949 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_scalar_summary
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:44.388.354 [npu_driver.cc:4338] 618947 MemQueuePeek: queue empty
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:44.388.348 [api_impl.cc:6121] 618943 MemQueuePeek: Start to peek queue on devId 2, qid is 1.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:44.388.357 [tensor_data_transfer.cpp:612]618945 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_tensor_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:44.388.362 [tensor_data_transfer.cpp:1056]618949 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:44.388.371 [tensor_data_transfer.cpp:612]618947 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_image_summary
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:44.388.376 [npu_driver.cc:4330] 618943 MemQueuePeek: peek mem queue, deviceId=2, qid=1, timeout=800.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:44.388.382 [tensor_data_transfer.cpp:1054]618945 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_tensor_summary
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:44.388.384 [npu_driver.cc:4338] 618951 MemQueuePeek: queue empty
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:44.388.389 [api_impl.cc:6121] 618949 MemQueuePeek: Start to peek queue on devId 2, qid is 4.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:44.388.395 [tensor_data_transfer.cpp:1054]618947 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_image_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:44.388.404 [tensor_data_transfer.cpp:1056]618945 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:44.388.417 [tensor_data_transfer.cpp:612]618951 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_histogram_summary
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:44.388.422 [npu_driver.cc:4330] 618949 MemQueuePeek: peek mem queue, deviceId=2, qid=4, timeout=800.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:44.388.423 [npu_driver.cc:4338] 618941 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:44.388.428 [tensor_data_transfer.cpp:1056]618947 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:44.388.434 [api_impl.cc:6121] 618945 MemQueuePeek: Start to peek queue on devId 2, qid is 2.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:44.388.441 [tensor_data_transfer.cpp:1054]618951 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_histogram_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:44.388.454 [tensor_data_transfer.cpp:612]618941 acltdtReceiveTensorV2: queue is empty, device is 2, name is _npu_log
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:44.388.460 [api_impl.cc:6121] 618947 MemQueuePeek: Start to peek queue on devId 2, qid is 3.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:44.388.467 [npu_driver.cc:4330] 618945 MemQueuePeek: peek mem queue, deviceId=2, qid=2, timeout=800.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:44.388.470 [tensor_data_transfer.cpp:1056]618951 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:44.388.477 [tensor_data_transfer.cpp:1054]618941 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is _npu_log
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:44.388.482 [npu_driver.cc:4330] 618947 MemQueuePeek: peek mem queue, deviceId=2, qid=3, timeout=800.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:44.388.495 [api_impl.cc:6121] 618951 MemQueuePeek: Start to peek queue on devId 2, qid is 5.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:44.388.500 [tensor_data_transfer.cpp:1056]618941 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:44.388.534 [npu_driver.cc:4330] 618951 MemQueuePeek: peek mem queue, deviceId=2, qid=5, timeout=800.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:44.388.539 [api_impl.cc:6121] 618941 MemQueuePeek: Start to peek queue on devId 2, qid is 0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:44.388.555 [npu_driver.cc:4330] 618941 MemQueuePeek: peek mem queue, deviceId=2, qid=0, timeout=800.
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:44.420.185 [trs_cb_event.c:119][ascend][curpid:618654,618833][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =321; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:44.420.186 [trs_cb_event.c:119][ascend][curpid:618654,618832][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =320; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:44.420.208 [trs_sqcq.c:1491][ascend][curpid:618654,618833][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:44.420.215 [trs_sqcq.c:1491][ascend][curpid:618654,618832][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:44.420.228 [npu_driver.cc:3833] 618833 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:44.420.234 [npu_driver.cc:3833] 618832 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=320, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:44.420.243 [api_impl.cc:5058] 618833 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:44.420.255 [api_impl.cc:5058] 618832 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:44.420.262 [callback.cpp:132]618833 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:44.420.273 [callback.cpp:132]618832 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:44.420.277 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:44.420.288 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:44.420.296 [npu_driver.cc:3828] 618833 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=321.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:44.420.305 [npu_driver.cc:3828] 618832 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=320.
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:44.452.184 [queue_client_comm.c:114][ascend][curpid:618646,618965][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:44.452.184 [queue_client_comm.c:114][ascend][curpid:618646,618961][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:44.452.190 [queue_client_comm.c:114][ascend][curpid:618646,618963][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:44.452.302 [npu_driver.cc:4338] 618965 MemQueuePeek: queue empty
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:44.452.318 [npu_driver.cc:4338] 618961 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:44.452.322 [tensor_data_transfer.cpp:612]618965 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_tensor_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:44.452.335 [tensor_data_transfer.cpp:612]618961 acltdtReceiveTensorV2: queue is empty, device is 0, name is _npu_log
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:44.452.337 [tensor_data_transfer.cpp:1054]618965 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_tensor_summary
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:44.452.346 [npu_driver.cc:4338] 618963 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:44.452.349 [tensor_data_transfer.cpp:1054]618961 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is _npu_log
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:44.452.351 [tensor_data_transfer.cpp:1056]618965 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:44.452.365 [tensor_data_transfer.cpp:612]618963 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_tensor_dump
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:44.452.381 [tensor_data_transfer.cpp:1056]618961 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:44.452.386 [api_impl.cc:6121] 618965 MemQueuePeek: Start to peek queue on devId 0, qid is 2.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:44.452.397 [tensor_data_transfer.cpp:1054]618963 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_tensor_dump
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:44.452.405 [api_impl.cc:6121] 618961 MemQueuePeek: Start to peek queue on devId 0, qid is 0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:44.452.408 [npu_driver.cc:4330] 618965 MemQueuePeek: peek mem queue, deviceId=0, qid=2, timeout=800.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:44.452.417 [tensor_data_transfer.cpp:1056]618963 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:44.452.425 [npu_driver.cc:4330] 618961 MemQueuePeek: peek mem queue, deviceId=0, qid=0, timeout=800.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:44.452.439 [api_impl.cc:6121] 618963 MemQueuePeek: Start to peek queue on devId 0, qid is 1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:44.452.492 [npu_driver.cc:4330] 618963 MemQueuePeek: peek mem queue, deviceId=0, qid=1, timeout=800.
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:44.484.174 [queue_client_comm.c:114][ascend][curpid:618646,618969][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:44.484.175 [queue_client_comm.c:114][ascend][curpid:618646,618967][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:44.484.176 [queue_client_comm.c:114][ascend][curpid:618646,618971][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:44.484.269 [npu_driver.cc:4338] 618969 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:44.484.283 [tensor_data_transfer.cpp:612]618969 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_scalar_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:44.484.297 [tensor_data_transfer.cpp:1054]618969 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_scalar_summary
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:44.484.298 [npu_driver.cc:4338] 618967 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:44.484.308 [tensor_data_transfer.cpp:1056]618969 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:44.484.314 [tensor_data_transfer.cpp:612]618967 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_image_summary
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:44.484.319 [api_impl.cc:6121] 618969 MemQueuePeek: Start to peek queue on devId 0, qid is 4.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:44.484.324 [npu_driver.cc:4338] 618971 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:44.484.326 [tensor_data_transfer.cpp:1054]618967 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_image_summary
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:44.484.329 [npu_driver.cc:4330] 618969 MemQueuePeek: peek mem queue, deviceId=0, qid=4, timeout=800.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:44.484.341 [tensor_data_transfer.cpp:1056]618967 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:44.484.340 [tensor_data_transfer.cpp:612]618971 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_histogram_summary
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:44.484.364 [api_impl.cc:6121] 618967 MemQueuePeek: Start to peek queue on devId 0, qid is 3.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:44.484.367 [tensor_data_transfer.cpp:1054]618971 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_histogram_summary
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:44.484.374 [npu_driver.cc:4330] 618967 MemQueuePeek: peek mem queue, deviceId=0, qid=3, timeout=800.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:44.484.378 [tensor_data_transfer.cpp:1056]618971 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:44.484.388 [api_impl.cc:6121] 618971 MemQueuePeek: Start to peek queue on devId 0, qid is 5.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:44.484.400 [npu_driver.cc:4330] 618971 MemQueuePeek: peek mem queue, deviceId=0, qid=5, timeout=800.
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:44.516.177 [trs_cb_event.c:119][ascend][curpid:618646,618836][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =64; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:44.516.182 [trs_cb_event.c:119][ascend][curpid:618646,618837][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =65; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:44.516.203 [trs_sqcq.c:1491][ascend][curpid:618646,618836][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:44.516.214 [trs_sqcq.c:1491][ascend][curpid:618646,618837][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:44.516.224 [npu_driver.cc:3833] 618836 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:44.516.233 [npu_driver.cc:3833] 618837 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:44.516.242 [api_impl.cc:5058] 618836 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:44.516.251 [api_impl.cc:5058] 618837 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:44.516.265 [callback.cpp:132]618836 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:44.516.274 [callback.cpp:132]618837 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:44.516.284 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:44.516.292 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:44.516.303 [npu_driver.cc:3828] 618836 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=64.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:44.516.317 [npu_driver.cc:3828] 618837 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=65.
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:44.644.174 [trs_cb_event.c:119][ascend][curpid:618666,618809][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =65; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:44.644.175 [trs_cb_event.c:119][ascend][curpid:618666,618808][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =64; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:44.644.193 [trs_sqcq.c:1491][ascend][curpid:618666,618809][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:44.644.200 [trs_sqcq.c:1491][ascend][curpid:618666,618808][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:44.644.205 [npu_driver.cc:3833] 618809 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:44.644.212 [npu_driver.cc:3833] 618808 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:44.644.216 [api_impl.cc:5058] 618809 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:44.644.227 [api_impl.cc:5058] 618808 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.644.231 [callback.cpp:132]618809 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.644.242 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.644.238 [callback.cpp:132]618808 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:44.644.262 [npu_driver.cc:3828] 618809 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=65.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.644.264 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:44.644.277 [npu_driver.cc:3828] 618808 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=64.
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:44.676.175 [trs_cb_event.c:119][ascend][curpid:618658,618775][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =65; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:44.676.181 [trs_cb_event.c:119][ascend][curpid:618658,618774][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =64; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:44.676.204 [trs_sqcq.c:1491][ascend][curpid:618658,618775][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:44.676.214 [trs_sqcq.c:1491][ascend][curpid:618658,618774][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:44.676.227 [npu_driver.cc:3833] 618775 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:44.676.237 [npu_driver.cc:3833] 618774 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:44.676.248 [api_impl.cc:5058] 618775 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:44.676.257 [api_impl.cc:5058] 618774 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.676.296 [callback.cpp:132]618775 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.676.307 [callback.cpp:132]618774 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.676.317 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.676.326 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:44.676.341 [npu_driver.cc:3828] 618775 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=65.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:44.676.350 [npu_driver.cc:3828] 618774 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=64.
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:44.708.173 [trs_cb_event.c:119][ascend][curpid:618674,618818][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =64; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:44.708.174 [trs_cb_event.c:119][ascend][curpid:618674,618819][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =65; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:44.708.193 [trs_sqcq.c:1491][ascend][curpid:618674,618818][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:44.708.206 [trs_sqcq.c:1491][ascend][curpid:618674,618819][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:44.708.212 [npu_driver.cc:3833] 618818 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=64, drvRetCode=16.
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:44.708.170 [trs_cb_event.c:119][ascend][curpid:618662,618817][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =833; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:44.708.178 [trs_cb_event.c:119][ascend][curpid:618662,618816][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =832; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:44.708.200 [trs_sqcq.c:1491][ascend][curpid:618662,618817][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:44.708.209 [trs_sqcq.c:1491][ascend][curpid:618662,[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:44.708.226 [npu_driver.cc:3833] 618819 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:44.708.233 [api_impl.cc:5058] 618818 ProcessReport: CqReportIrqWait, retCode=0x711000c
618816][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:44.708.219 [npu_driver.cc:3833] 618817 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=833, drvRetCode=16.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:44.708.247 [api_impl.cc:5058] 618819 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:44.708.263 [npu_driver.cc:3833] 618816 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=832, drvRetCode=16.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:44.708.273 [api_impl.cc:5058] 618817 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:44.708.279 [api_impl.cc:5058] 618816 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.708.255 [callback.cpp:132]618818 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.708.287 [callback.cpp:132]618819 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.708.290 [callback.cpp:132]618817 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.708.298 [callback.cpp:132]618816 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.708.295 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.708.305 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.708.315 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.708.307 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.708.317 [npu_driver.cc:3828] 618818 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=64.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.708.325 [npu_driver.cc:3828] 618817 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=833.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.708.330 [npu_driver.cc:3828] 618819 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=65.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.708.331 [npu_driver.cc:3828] 618816 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=832.
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:44.740.165 [trs_cb_event.c:119][ascend][curpid:618670,618822][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =64; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:44.740.167 [trs_cb_event.c:119][ascend][curpid:618670,618823][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =65; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:44.740.186 [trs_sqcq.c:1491][ascend][curpid:618670,618822][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:44.740.193 [trs_sqcq.c:1491][ascend][curpid:618670,618823][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:44.740.199 [npu_driver.cc:3833] 618822 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:44.740.209 [npu_driver.cc:3833] 618823 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:44.740.216 [api_impl.cc:5058] 618822 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:44.740.238 [api_impl.cc:5058] 618823 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:44.740.243 [callback.cpp:132]618822 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:44.740.253 [callback.cpp:132]618823 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:44.740.257 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:44.740.267 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:44.740.272 [npu_driver.cc:3828] 618822 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=64.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:44.740.286 [npu_driver.cc:3828] 618823 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=65.
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:44.836.167 [trs_cb_event.c:119][ascend][curpid:618650,618829][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =321; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:44.836.173 [trs_cb_event.c:119][ascend][curpid:618650,618828][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =320; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:44.836.183 [trs_sqcq.c:1491][ascend][curpid:618650,618829][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:44.836.189 [trs_sqcq.c:1491][ascend][curpid:618650,618828][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:44.836.194 [npu_driver.cc:3833] 618829 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:44.836.201 [npu_driver.cc:3833] 618828 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=320, drvRetCode=16.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:44.836.210 [api_impl.cc:5058] 618829 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:44.836.213 [api_impl.cc:5058] 618828 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:44.836.219 [callback.cpp:132]618829 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:44.836.224 [callback.cpp:132]618828 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:44.836.229 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:44.836.235 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:44.836.240 [npu_driver.cc:3828] 618829 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=321.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:44.836.247 [npu_driver.cc:3828] 618828 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=320.
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:44.868.168 [queue_client_comm.c:114][ascend][curpid:618658,618787][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:44.868.171 [queue_client_comm.c:114][ascend][curpid:618658,618785][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:44.868.184 [queue_client_comm.c:114][ascend][curpid:618658,618781][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:44.868.185 [queue_client_comm.c:114][ascend][curpid:618658,618783][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:44.868.186 [queue_client_comm.c:114][ascend][curpid:618658,618789][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:44.868.184 [queue_client_comm.c:114][ascend][curpid:618658,618779][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:44.868.265 [npu_driver.cc:4338] 618787 MemQueuePeek: queue empty
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:44.868.293 [npu_driver.cc:4338] 618785 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.868.306 [tensor_data_transfer.cpp:612]618785 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_image_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.868.297 [tensor_data_transfer.cpp:612]618787 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_scalar_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.868.323 [tensor_data_transfer.cpp:1054]618785 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_image_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.868.326 [tensor_data_transfer.cpp:1054]618787 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_scalar_summary
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:44.868.330 [npu_driver.cc:4338] 618781 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.868.334 [tensor_data_transfer.cpp:1056]618785 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.868.353 [tensor_data_transfer.cpp:1056]618787 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:44.868.360 [npu_driver.cc:4338] 618783 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.868.367 [tensor_data_transfer.cpp:612]618781 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_tensor_dump
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:44.868.380 [api_impl.cc:6121] 618785 MemQueuePeek: Start to peek queue on devId 3, qid is 3.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:44.868.387 [npu_driver.cc:4338] 618789 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.868.400 [tensor_data_transfer.cpp:612]618783 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_tensor_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:44.868.389 [api_impl.cc:6121] 618787 MemQueuePeek: Start to peek queue on devId 3, qid is 4.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:44.868.415 [npu_driver.cc:4338] 618779 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.868.419 [tensor_data_transfer.cpp:1054]618781 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_tensor_dump
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:44.868.429 [npu_driver.cc:4330] 618785 MemQueuePeek: peek mem queue, deviceId=3, qid=3, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.868.440 [tensor_data_transfer.cpp:612]618789 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_histogram_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.868.448 [tensor_data_transfer.cpp:1054]618783 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_tensor_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:44.868.459 [npu_driver.cc:4330] 618787 MemQueuePeek: peek mem queue, deviceId=3, qid=4, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.868.472 [tensor_data_transfer.cpp:612]618779 acltdtReceiveTensorV2: queue is empty, device is 3, name is _npu_log
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.868.478 [tensor_data_transfer.cpp:1056]618781 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.868.499 [tensor_data_transfer.cpp:1054]618789 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_histogram_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.868.507 [tensor_data_transfer.cpp:1056]618783 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.868.543 [tensor_data_transfer.cpp:1054]618779 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is _npu_log
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:44.868.550 [api_impl.cc:6121] 618781 MemQueuePeek: Start to peek queue on devId 3, qid is 1.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.868.555 [tensor_data_transfer.cpp:1056]618789 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:44.868.562 [api_impl.cc:6121] 618783 MemQueuePeek: Start to peek queue on devId 3, qid is 2.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:44.868.567 [tensor_data_transfer.cpp:1056]618779 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:44.868.573 [npu_driver.cc:4330] 618781 MemQueuePeek: peek mem queue, deviceId=3, qid=1, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:44.868.580 [api_impl.cc:6121] 618789 MemQueuePeek: Start to peek queue on devId 3, qid is 5.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:44.868.586 [npu_driver.cc:4330] 618783 MemQueuePeek: peek mem queue, deviceId=3, qid=2, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:44.868.593 [api_impl.cc:6121] 618779 MemQueuePeek: Start to peek queue on devId 3, qid is 0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:44.868.603 [npu_driver.cc:4330] 618789 MemQueuePeek: peek mem queue, deviceId=3, qid=5, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:44.868.615 [npu_driver.cc:4330] 618779 MemQueuePeek: peek mem queue, deviceId=3, qid=0, timeout=800.
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:44.928.180 [queue_client_comm.c:114][ascend][curpid:618666,618841][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:44.928.180 [queue_client_comm.c:114][ascend][curpid:618666,618845][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:44.928.273 [npu_driver.cc:4338] 618841 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.928.290 [tensor_data_transfer.cpp:612]618841 acltdtReceiveTensorV2: queue is empty, device is 5, name is _npu_log
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:44.928.302 [npu_driver.cc:4338] 618845 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.928.304 [tensor_data_transfer.cpp:1054]618841 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is _npu_log
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.928.319 [tensor_data_transfer.cpp:612]618845 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_tensor_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.928.322 [tensor_data_transfer.cpp:1056]618841 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.928.335 [tensor_data_transfer.cpp:1054]618845 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_tensor_summary
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:44.928.341 [api_impl.cc:6121] 618841 MemQueuePeek: Start to peek queue on devId 5, qid is 0.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.928.348 [tensor_data_transfer.cpp:1056]618845 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:44.928.354 [npu_driver.cc:4330] 618841 MemQueuePeek: peek mem queue, deviceId=5, qid=0, timeout=800.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:44.928.362 [api_impl.cc:6121] 618845 MemQueuePeek: Start to peek queue on devId 5, qid is 2.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:44.928.375 [npu_driver.cc:4330] 618845 MemQueuePeek: peek mem queue, deviceId=5, qid=2, timeout=800.
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:44.932.176 [queue_client_comm.c:114][ascend][curpid:618666,618849][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:44.932.176 [queue_client_comm.c:114][ascend][curpid:618666,618843][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:44.932.170 [trs_cb_event.c:119][ascend][curpid:618654,618833][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =321; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:44.932.179 [trs_cb_event.c:119][ascend][curpid:618654,618832][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =320; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:44.932.195 [trs_sqcq.c:1491][ascend][curpid:618654,618833][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:44.932.178 [queue_client_comm.c:114][ascend][curpid:618666,618851][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:44.932.180 [queue_client_comm.c:114][ascend][curpid:618666,618847][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:44.932.206 [trs_sqcq.c:1491][ascend][curpid:618654,618832][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:44.932.218 [npu_driver.cc:3833] 618833 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:44.932.228 [npu_driver.cc:3833] 618832 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=320, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:44.932.235 [api_impl.cc:5058] 618833 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:44.932.262 [api_impl.cc:5058] 618832 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:44.932.262 [npu_driver.cc:4338] 618849 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:44.932.269 [callback.cpp:132]618833 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:44.932.282 [callback.cpp:132]618832 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:44.932.287 [npu_driver.cc:4338] 618843 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.932.291 [tensor_data_transfer.cpp:612]618849 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_scalar_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:44.932.287 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:44.932.300 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.932.305 [tensor_data_transfer.cpp:612]618843 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_tensor_dump
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:44.932.311 [npu_driver.cc:3828] 618833 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=321.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.932.310 [tensor_data_transfer.cpp:1054]618849 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_scalar_summary
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:44.932.315 [npu_driver.cc:4338] 618851 MemQueuePeek: queue empty
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:44.932.321 [npu_driver.cc:3828] 618832 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=320.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.932.318 [tensor_data_transfer.cpp:1054]618843 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_tensor_dump
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.932.322 [tensor_data_transfer.cpp:1056]618849 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.932.330 [tensor_data_transfer.cpp:612]618851 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_histogram_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.932.336 [tensor_data_transfer.cpp:1056]618843 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:44.932.341 [npu_driver.cc:4338] 618847 MemQueuePeek: queue empty
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:44.932.342 [api_impl.cc:6121] 618849 MemQueuePeek: Start to peek queue on devId 5, qid is 4.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.932.344 [tensor_data_transfer.cpp:1054]618851 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_histogram_summary
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:44.932.348 [api_impl.cc:6121] 618843 MemQueuePeek: Start to peek queue on devId 5, qid is 1.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.932.353 [tensor_data_transfer.cpp:612]618847 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_image_summary
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:44.932.356 [npu_driver.cc:4330] 618849 MemQueuePeek: peek mem queue, deviceId=5, qid=4, timeout=800.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.932.359 [tensor_data_transfer.cpp:1056]618851 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:44.932.363 [npu_driver.cc:4330] 618843 MemQueuePeek: peek mem queue, deviceId=5, qid=1, timeout=800.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.932.366 [tensor_data_transfer.cpp:1054]618847 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_image_summary
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:44.932.372 [api_impl.cc:6121] 618851 MemQueuePeek: Start to peek queue on devId 5, qid is 5.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:44.932.378 [tensor_data_transfer.cpp:1056]618847 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:44.932.382 [npu_driver.cc:4330] 618851 MemQueuePeek: peek mem queue, deviceId=5, qid=5, timeout=800.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:44.932.389 [api_impl.cc:6121] 618847 MemQueuePeek: Start to peek queue on devId 5, qid is 3.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:44.932.402 [npu_driver.cc:4330] 618847 MemQueuePeek: peek mem queue, deviceId=5, qid=3, timeout=800.
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:44.996.169 [queue_client_comm.c:114][ascend][curpid:618662,618880][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:44.996.171 [queue_client_comm.c:114][ascend][curpid:618662,618885][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:44.996.170 [queue_client_comm.c:114][ascend][curpid:618662,618872][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:44.996.172 [queue_client_comm.c:114][ascend][curpid:618662,618868][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:44.996.174 [queue_client_comm.c:114][ascend][curpid:618674,618881][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:44.996.175 [queue_client_comm.c:114][ascend][curpid:618674,618873][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:44.996.181 [queue_client_comm.c:114][ascend][curpid:618674,618884][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:44.996.179 [queue_client_comm.c:114][ascend][curpid:618662,618876][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:44.996.181 [queue_client_comm.c:114][ascend][curpid:618674,618870][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:44.996.184 [queue_client_comm.c:114][ascend][curpid:618674,618866][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:44.996.191 [queue_client_comm.c:114][ascend][curpid:618674,618878][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:44.996.184 [queue_client_comm.c:114][ascend][curpid:618662,618864][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:44.996.258 [npu_driver.cc:4338] 618880 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.996.273 [tensor_data_transfer.cpp:612]618880 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_scalar_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.996.286 [tensor_data_transfer.cpp:1054]618880 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_scalar_summary
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:44.996.294 [npu_driver.cc:4338] 618885 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.996.301 [tensor_data_transfer.cpp:1056]618880 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:44.996.286 [npu_driver.cc:4338] 618881 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.996.307 [tensor_data_transfer.cpp:612]618881 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_scalar_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.996.308 [tensor_data_transfer.cpp:612]618885 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_histogram_summary
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:44.996.310 [npu_driver.cc:4338] 618873 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.996.325 [tensor_data_transfer.cpp:1054]618881 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_scalar_summary
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.996.313 [api_impl.cc:6121] 618880 MemQueuePeek: Start to peek queue on devId 4, qid is 4.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.996.335 [tensor_data_transfer.cpp:612]618873 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_tensor_summary
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:44.996.320 [npu_driver.cc:4338] 618872 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.996.322 [tensor_data_transfer.cpp:1054]618885 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_histogram_summary
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:44.996.353 [npu_driver.cc:4338] 618868 MemQueuePeek: queue empty
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:44.996.338 [npu_driver.cc:4338] 618884 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.996.340 [tensor_data_transfer.cpp:1056]618881 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.996.352 [npu_driver.cc:4330] 618880 MemQueuePeek: peek mem queue, deviceId=4, qid=4, timeout=800.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.996.353 [tensor_data_transfer.cpp:1054]618873 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_tensor_summary
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:44.996.362 [npu_driver.cc:4338] 618870 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.996.365 [tensor_data_transfer.cpp:612]618884 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_histogram_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.996.360 [tensor_data_transfer.cpp:612]618872 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_tensor_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.996.365 [tensor_data_transfer.cpp:1056]618885 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.996.404 [tensor_data_transfer.cpp:1054]618872 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_tensor_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.996.418 [tensor_data_transfer.cpp:1056]618872 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.996.376 [api_impl.cc:6121] 618881 MemQueuePeek: Start to peek queue on devId 7, qid is 4.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.996.389 [tensor_data_transfer.cpp:612]618868 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_tensor_dump
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.996.382 [tensor_data_transfer.cpp:1056]618873 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.996.393 [tensor_data_transfer.cpp:612]618870 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_tensor_dump
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.996.432 [api_impl.cc:6121] 618872 MemQueuePeek: Start to peek queue on devId 4, qid is 2.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:44.996.398 [npu_driver.cc:4338] 618866 MemQueuePeek: queue empty
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:44.996.394 [npu_driver.cc:4338] 618876 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.996.399 [tensor_data_transfer.cpp:1054]618884 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_histogram_summary
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:44.996.429 [npu_driver.cc:4338] 618878 MemQueuePeek: queue empty
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.996.411 [api_impl.cc:6121] 618885 MemQueuePeek: Start to peek queue on devId 4, qid is 5.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:44.996.421 [npu_driver.cc:4338] 618864 MemQueuePeek: queue empty
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.996.430 [npu_driver.cc:4330] 618881 MemQueuePeek: peek mem queue, deviceId=7, qid=4, timeout=800.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.996.443 [api_impl.cc:6121] 618873 MemQueuePeek: Start to peek queue on devId 7, qid is 2.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.996.439 [tensor_data_transfer.cpp:1054]618868 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_tensor_dump
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.996.449 [npu_driver.cc:4330] 618872 MemQueuePeek: peek mem queue, deviceId=4, qid=2, timeout=800.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.996.451 [tensor_data_transfer.cpp:1054]618870 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_tensor_dump
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.996.467 [tensor_data_transfer.cpp:612]618876 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_image_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.996.455 [tensor_data_transfer.cpp:612]618866 acltdtReceiveTensorV2: queue is empty, device is 7, name is _npu_log
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.996.463 [tensor_data_transfer.cpp:1056]618884 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.996.474 [npu_driver.cc:4330] 618885 MemQueuePeek: peek mem queue, deviceId=4, qid=5, timeout=800.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.996.483 [tensor_data_transfer.cpp:612]618864 acltdtReceiveTensorV2: queue is empty, device is 4, name is _npu_log
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.996.469 [tensor_data_transfer.cpp:612]618878 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_image_summary
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.996.491 [npu_driver.cc:4330] 618873 MemQueuePeek: peek mem queue, deviceId=7, qid=2, timeout=800.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.996.488 [tensor_data_transfer.cpp:1056]618868 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.996.500 [tensor_data_transfer.cpp:1056]618870 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.996.513 [api_impl.cc:6121] 618884 MemQueuePeek: Start to peek queue on devId 7, qid is 5.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.996.510 [tensor_data_transfer.cpp:1054]618876 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_image_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.996.519 [tensor_data_transfer.cpp:1054]618878 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_image_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.996.525 [tensor_data_transfer.cpp:1054]618864 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is _npu_log
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.996.506 [tensor_data_transfer.cpp:1054]618866 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is _npu_log
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.996.540 [api_impl.cc:6121] 618870 MemQueuePeek: Start to peek queue on devId 7, qid is 1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.996.545 [npu_driver.cc:4330] 618884 MemQueuePeek: peek mem queue, deviceId=7, qid=5, timeout=800.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.996.550 [tensor_data_transfer.cpp:1056]618876 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.996.551 [tensor_data_transfer.cpp:1056]618878 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.996.574 [api_impl.cc:6121] 618878 MemQueuePeek: Start to peek queue on devId 7, qid is 3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.996.584 [npu_driver.cc:4330] 618878 MemQueuePeek: peek mem queue, deviceId=7, qid=3, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.996.538 [api_impl.cc:6121] 618868 MemQueuePeek: Start to peek queue on devId 4, qid is 1.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:44.996.559 [tensor_data_transfer.cpp:1056]618864 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:44.996.557 [tensor_data_transfer.cpp:1056]618866 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.996.562 [npu_driver.cc:4330] 618870 MemQueuePeek: peek mem queue, deviceId=7, qid=1, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.996.575 [api_impl.cc:6121] 618876 MemQueuePeek: Start to peek queue on devId 4, qid is 3.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.996.606 [api_impl.cc:6121] 618864 MemQueuePeek: Start to peek queue on devId 4[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.996.618 [api_impl.cc:6121] 618866 MemQueuePeek: Start to peek queue on devId 7, qid is 0.
, qid is 0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.996.600 [npu_driver.cc:4330] 618868 MemQueuePeek: peek mem queue, deviceId=4, qid=1, timeout=800.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:44.996.646 [npu_driver.cc:4330] 618866 MemQueuePeek: peek mem queue, deviceId=7, qid=0, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.996.665 [npu_driver.cc:4330] 618864 MemQueuePeek: peek mem queue, deviceId=4, qid=0, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:44.996.622 [npu_driver.cc:4330] 618876 MemQueuePeek: peek mem queue, deviceId=4, qid=3, timeout=800.
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:45.028.169 [queue_client_comm.c:114][ascend][curpid:618670,618901][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:45.028.169 [queue_client_comm.c:114][ascend][curpid:618670,618903][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:45.028.170 [queue_client_comm.c:114][ascend][curpid:618670,618909][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:45.028.171 [queue_client_comm.c:114][ascend][curpid:618670,618911][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:45.028.176 [trs_cb_event.c:119][ascend][curpid:618646,618836][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =64; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:45.028.205 [trs_sqcq.c:1491][ascend][curpid:618646,618836][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:45.028.174 [queue_client_comm.c:114][ascend][curpid:618670,618907][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:45.028.174 [queue_client_comm.c:114][ascend][curpid:618670,618905][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:45.028.225 [npu_driver.cc:3833] 618836 CqReportIrqWait: [drv api] ha[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:45.028.273 [npu_driver.cc:4338] 618901 MemQueuePeek: queue empty
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:45.028.289 [npu_driver.cc:4338] 618903 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.028.290 [tensor_data_transfer.cpp:612]618901 acltdtReceiveTensorV2: queue is empty, device is 6, name is _npu_log
lCqReportIrqWait: device_id=0, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:45.028.260 [api_impl.cc:5058] 618836 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:45.028.271 [callback.cpp:132]618836 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:45.028.281 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.028.294 [npu_driver.cc:3828] 618836 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=64.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.028.302 [tensor_data_transfer.cpp:612]618903 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_tensor_dump
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.028.309 [tensor_data_transfer.cpp:1054]618901 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is _npu_log
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.028.315 [tensor_data_transfer.cpp:1054]618903 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_tensor_dump
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.028.324 [tensor_data_transfer.cpp:1056]618901 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.028.329 [tensor_data_transfer.cpp:1056]618903 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.028.336 [api_impl.cc:6121] 618901 MemQueuePeek: Start to peek queue on devId 6, qid is 0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.028.340 [api_impl.cc:6121] 618903 MemQueuePeek: Start to peek queue on devId 6, qid is 1.
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:45.028.330 [trs_cb_event.c:119][ascend][curpid:618646,618837][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =65; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:45.028.354 [trs_sqcq.c:1491][ascend][curpid:618646,618837][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:45.028.340 [npu_driver.cc:4338] 618909 MemQueuePeek: queue empty
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.028.360 [npu_driver.cc:4330] 618901 MemQueuePeek: peek mem queue, deviceId=6, qid=0, timeout=800.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:45.028.368 [npu_driver.cc:3833] 618837 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=65, drvRetCode=16.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.028.367 [npu_driver.cc:4330] 618903 MemQueuePeek: peek mem queue, deviceId=6, qid=1, timeout=800.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:45.028.382 [api_impl.cc:5058] 618837 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.028.375 [tensor_data_transfer.cpp:612]618909 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_scalar_summary
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:45.028.376 [npu_driver.cc:4338] 618911 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.028.397 [tensor_data_transfer.cpp:1054]618909 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_scalar_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:45.028.394 [callback.cpp:132]618837 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.028.403 [tensor_data_transfer.cpp:612]618911 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_histogram_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.028.410 [tensor_data_transfer.cpp:1056]618909 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:45.028.409 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:45.028.411 [npu_driver.cc:4338] 618907 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.028.418 [tensor_data_transfer.cpp:1054]618911 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_histogram_summary
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.028.422 [npu_driver.cc:3828] 618837 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=65.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.028.424 [api_impl.cc:6121] 618909 MemQueuePeek: Start to peek queue on devId 6, qid is 4.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.028.431 [tensor_data_transfer.cpp:612]618907 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_image_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.028.437 [tensor_data_transfer.cpp:1056]618911 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.028.443 [npu_driver.cc:4330] 618909 MemQueuePeek: peek mem queue, deviceId=6, qid=4, timeout=800.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:45.028.443 [npu_driver.cc:4338] 618905 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.028.449 [tensor_data_transfer.cpp:1054]618907 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_image_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.028.455 [api_impl.cc:6121] 618911 MemQueuePeek: Start to peek queue on devId 6, qid is 5.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.028.468 [tensor_data_transfer.cpp:612]618905 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_tensor_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.028.474 [tensor_data_transfer.cpp:1056]618907 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.028.479 [npu_driver.cc:4330] 618911 MemQueuePeek: peek mem queue, deviceId=6, qid=5, timeout=800.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.028.484 [tensor_data_transfer.cpp:1054]618905 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_tensor_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.028.489 [api_impl.cc:6121] 618907 MemQueuePeek: Start to peek queue on devId 6, qid is 3.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.028.502 [tensor_data_transfer.cpp:1056]618905 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.028.508 [npu_driver.cc:4330] 618907 MemQueuePeek: peek mem queue, deviceId=6, qid=3, timeout=800.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.028.513 [api_impl.cc:6121] 618905 MemQueuePeek: Start to peek queue on devId 6, qid is 2.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.028.528 [npu_driver.cc:4330] 618905 MemQueuePeek: peek mem queue, deviceId=6, qid=2, timeout=800.
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:45.124.162 [queue_client_comm.c:114][ascend][curpid:618650,618929][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:45.124.171 [queue_client_comm.c:114][ascend][curpid:618650,618923][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:45.124.168 [queue_client_comm.c:114][ascend][curpid:618650,618931][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:45.124.170 [queue_client_comm.c:114][ascend][curpid:618650,618927][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:45.124.172 [queue_client_comm.c:114][ascend][curpid:618650,618925][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:45.124.195 [queue_client_comm.c:114][ascend][curpid:618650,618921][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:45.124.241 [npu_driver.cc:4338] 618929 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.124.257 [tensor_data_transfer.cpp:612]618929 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_scalar_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.124.267 [tensor_data_transfer.cpp:1054]618929 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_scalar_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.124.276 [tensor_data_transfer.cpp:1056]618929 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:45.124.282 [npu_driver.cc:4338] 618923 MemQueuePeek: queue empty
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.124.286 [api_impl.cc:6121] 618929 MemQueuePeek: Start to peek queue on devId 1, qid is 4.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.124.294 [tensor_data_transfer.cpp:612]618923 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_tensor_dump
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.124.297 [npu_driver.cc:4330] 618929 MemQueuePeek: peek mem queue, deviceId=1, qid=4, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.124.305 [tensor_data_transfer.cpp:1054]618923 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_tensor_dump
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:45.124.314 [npu_driver.cc:4338] 618931 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.124.318 [tensor_data_transfer.cpp:1056]618923 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.124.327 [tensor_data_transfer.cpp:612]618931 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_histogram_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.124.330 [api_impl.cc:6121] 618923 MemQueuePeek: Start to peek queue on devId 1, qid is 1.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.124.337 [tensor_data_transfer.cpp:1054]618931 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_histogram_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.124.340 [npu_driver.cc:4330] 618923 MemQueuePeek: peek mem queue, deviceId=1, qid=1, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.124.347 [tensor_data_transfer.cpp:1056]618931 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:45.124.348 [npu_driver.cc:4338] 618927 MemQueuePeek: queue empty
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.124.357 [api_impl.cc:6121] 618931 MemQueuePeek: Start to peek queue on devId 1, qid is 5.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.124.361 [tensor_data_transfer.cpp:612]618927 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_image_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.124.366 [npu_driver.cc:4330] 618931 MemQueuePeek: peek mem queue, deviceId=1, qid=5, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.124.372 [tensor_data_transfer.cpp:1054]618927 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_image_summary
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:45.124.382 [npu_driver.cc:4338] 618925 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.124.385 [tensor_data_transfer.cpp:1056]618927 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.124.397 [tensor_data_transfer.cpp:612]618925 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_tensor_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.124.400 [api_impl.cc:6121] 618927 MemQueuePeek: Start to peek queue on devId 1, qid is 3.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.124.409 [tensor_data_transfer.cpp:1054]618925 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_tensor_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.124.411 [npu_driver.cc:4330] 618927 MemQueuePeek: peek mem queue, deviceId=1, qid=3, timeout=800.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:45.124.418 [npu_driver.cc:4338] 618921 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.124.421 [tensor_data_transfer.cpp:1056]618925 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.124.441 [tensor_data_transfer.cpp:612]618921 acltdtReceiveTensorV2: queue is empty, device is 1, name is _npu_log
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.124.447 [api_impl.cc:6121] 618925 MemQueuePeek: Start to peek queue on devId 1, qid is 2.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.124.466 [tensor_data_transfer.cpp:1054]618921 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is _npu_log
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.124.472 [npu_driver.cc:4330] 618925 MemQueuePeek: peek mem queue, deviceId=1, qid=2, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.124.485 [tensor_data_transfer.cpp:1056]618921 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.124.526 [api_impl.cc:6121] 618921 MemQueuePeek: Start to peek queue on devId 1, qid is 0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.124.544 [npu_driver.cc:4330] 618921 MemQueuePeek: peek mem queue, deviceId=1, qid=0, timeout=800.
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:45.156.166 [trs_cb_event.c:119][ascend][curpid:618666,618808][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =64; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:45.156.172 [trs_cb_event.c:119][ascend][curpid:618666,618809][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =65; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:45.156.188 [trs_sqcq.c:1491][ascend][curpid:618666,618808][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:45.156.193 [trs_sqcq.c:1491][ascend][curpid:618666,618809][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:45.156.214 [npu_driver.cc:3833] 618808 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:45.156.218 [npu_driver.cc:3833] 618809 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:45.156.228 [api_impl.cc:5058] 618808 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:45.156.231 [api_impl.cc:5058] 618809 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:45.156.241 [callback.cpp:132]618808 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:45.156.244 [callback.cpp:132]618809 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:45.156.252 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:45.156.255 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.156.266 [npu_driver.cc:3828] 618808 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=64.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.156.269 [npu_driver.cc:3828] 618809 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=65.
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:45.184.175 [trs_cb_event.c:119][ascend][curpid:618658,618774][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =64; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:45.184.219 [trs_sqcq.c:1491][ascend][curpid:618658,618774][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:45.184.232 [npu_driver.cc:3833] 618774 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:45.184.248 [api_impl.cc:5058] 618774 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:45.184.260 [callback.cpp:132]618774 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:45.184.275 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.184.288 [npu_driver.cc:3828] 618774 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=64.
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:45.188.185 [trs_cb_event.c:119][ascend][curpid:618658,618775][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =65; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:45.188.214 [trs_sqcq.c:1491][ascend][curpid:618658,618775][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:45.188.235 [npu_driver.cc:3833] 618775 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:45.188.253 [api_impl.cc:5058] 618775 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:45.188.267 [callback.cpp:132]618775 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:45.188.289 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.188.305 [npu_driver.cc:3828] 618775 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=65.
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:45.220.181 [trs_cb_event.c:119][ascend][curpid:618662,618817][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =833; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:45.220.181 [trs_cb_event.c:119][ascend][curpid:618662,618816][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =832; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:45.220.202 [trs_sqcq.c:1491][ascend][curpid:618662,618817][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:45.220.211 [trs_sqcq.c:1491][ascend][curpid:618662,618816][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:45.220.177 [queue_client_comm.c:114][ascend][curpid:618654,618943][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:45.220.180 [queue_client_comm.c:114][ascend][curpid:618654,618945][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:45.220.179 [queue_client_comm.c:114][ascend][curpid:618654,618947][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:45.220.215 [npu_driver.cc:3833] 618817 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=833, drvRetCode=16.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:45.220.230 [npu_driver.cc:3833] 618816 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=832, drvRetCode=16.
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:45.220.185 [trs_cb_event.c:119][ascend][curpid:618674,618818][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =64; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:45.220.188 [trs_cb_event.c:119][ascend][curpid:618674,618819][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =65; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:45.220.230 [trs_sqcq.c:1491][ascend][curpid:618674,618818][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:45.220.180 [queue_client_comm.c:114][ascend][curpid:618654,618941][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:45.220.183 [queue_client_comm.c:114][ascend][curpid:618654,618949][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:45.220.189 [queue_client_comm.c:114][ascend][curpid:618654,618951][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:45.220.237 [api_impl.cc:5058] 618817 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:45.220.243 [trs_sqcq.c:1491][ascend][curpid:618674,618819][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:45.220.252 [npu_driver.cc:3833] 618818 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:45.220.252 [api_impl.cc:5058] 618816 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:45.220.261 [callback.cpp:132]618817 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:45.220.267 [callback.cpp:132]618816 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:45.220.275 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:45.220.280 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:45.220.263 [npu_driver.cc:3833] 618819 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:45.220.272 [api_impl.cc:5058] 618818 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:45.220.283 [api_impl.cc:5058] 618819 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.220.289 [npu_driver.cc:3828] 618817 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=833.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.220.295 [npu_driver.cc:3828] 618816 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=832.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:45.220.294 [callback.cpp:132]618818 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:45.220.282 [npu_driver.cc:4338] 618943 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:45.220.303 [tensor_data_transfer.cpp:612]618943 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_tensor_dump
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:45.220.305 [callback.cpp:132]618819 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:45.220.311 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:45.220.308 [npu_driver.cc:4338] 618945 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:45.220.318 [tensor_data_transfer.cpp:1054]618943 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_tensor_dump
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:45.220.326 [tensor_data_transfer.cpp:612]618945 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_tensor_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:45.220.322 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:45.220.332 [tensor_data_transfer.cpp:1056]618943 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:45.220.342 [npu_driver.cc:4338] 618947 MemQueuePeek: queue empty
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.220.334 [npu_driver.cc:3828] 618818 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=64.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.220.344 [npu_driver.cc:3828] 618819 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=65.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.220.352 [api_impl.cc:6121] 618943 MemQueuePeek: Start to peek queue on devId 2, qid is 1.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:45.220.343 [tensor_data_transfer.cpp:1054]618945 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_tensor_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:45.220.360 [tensor_data_transfer.cpp:612]618947 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_image_summary
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.220.366 [npu_driver.cc:4330] 618943 MemQueuePeek: peek mem queue, deviceId=2, qid=1, timeout=800.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:45.220.378 [npu_driver.cc:4338] 618941 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:45.220.393 [tensor_data_transfer.cpp:1056]618945 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:45.220.401 [tensor_data_transfer.cpp:1054]618947 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_image_summary
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:45.220.409 [npu_driver.cc:4338] 618949 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:45.220.414 [tensor_data_transfer.cpp:612]618941 acltdtReceiveTensorV2: queue is empty, device is 2, name is _npu_log
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.220.422 [api_impl.cc:6121] 618945 MemQueuePeek: Start to peek queue on devId 2, qid is 2.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:45.220.427 [tensor_data_transfer.cpp:1056]618947 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:45.220.441 [tensor_data_transfer.cpp:612]618949 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_scalar_summary
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:45.220.447 [npu_driver.cc:4338] 618951 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:45.220.447 [tensor_data_transfer.cpp:1054]618941 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is _npu_log
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.220.453 [npu_driver.cc:4330] 618945 MemQueuePeek: peek mem queue, deviceId=2, qid=2, timeout=800.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.220.459 [api_impl.cc:6121] 618947 MemQueuePeek: Start to peek queue on devId 2, qid is 3.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:45.220.466 [tensor_data_transfer.cpp:1054]618949 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_scalar_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:45.220.475 [tensor_data_transfer.cpp:612]618951 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_histogram_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:45.220.481 [tensor_data_transfer.cpp:1056]618941 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.220.492 [npu_driver.cc:4330] 618947 MemQueuePeek: peek mem queue, deviceId=2, qid=3, timeout=800.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:45.220.498 [tensor_data_transfer.cpp:1056]618949 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:45.220.505 [tensor_data_transfer.cpp:1054]618951 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_histogram_summary
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.220.512 [api_impl.cc:6121] 618941 MemQueuePeek: Start to peek queue on devId 2, qid is 0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.220.523 [api_impl.cc:6121] 618949 MemQueuePeek: Start to peek queue on devId 2, qid is 4.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:45.220.531 [tensor_data_transfer.cpp:1056]618951 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.220.538 [npu_driver.cc:4330] 618941 MemQueuePeek: peek mem queue, deviceId=2, qid=0, timeout=800.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.220.543 [npu_driver.cc:4330] 618949 MemQueuePeek: peek mem queue, deviceId=2, qid=4, timeout=800.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.220.551 [api_impl.cc:6121] 618951 MemQueuePeek: Start to peek queue on devId 2, qid is 5.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.220.581 [npu_driver.cc:4330] 618951 MemQueuePeek: peek mem queue, deviceId=2, qid=5, timeout=800.
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:45.252.169 [trs_cb_event.c:119][ascend][curpid:618670,618822][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =64; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:45.252.169 [trs_cb_event.c:119][ascend][curpid:618670,618823][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =65; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:45.252.189 [trs_sqcq.c:1491][ascend][curpid:618670,618822][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:45.252.195 [trs_sqcq.c:1491][ascend][curpid:618670,618823][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:45.252.203 [npu_driver.cc:3833] 618822 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:45.252.211 [npu_driver.cc:3833] 618823 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:45.252.218 [api_impl.cc:5058] 618822 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:45.252.224 [api_impl.cc:5058] 618823 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.252.229 [callback.cpp:132]618822 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.252.237 [callback.cpp:132]618823 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.252.244 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.252.251 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.252.259 [npu_driver.cc:3828] 618822 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=64.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.252.265 [npu_driver.cc:3828] 618823 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=65.
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:45.284.169 [queue_client_comm.c:114][ascend][curpid:618646,618965][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:45.284.174 [queue_client_comm.c:114][ascend][curpid:618646,618963][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:45.284.176 [queue_client_comm.c:114][ascend][curpid:618646,618961][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:45.284.274 [npu_driver.cc:4338] 618965 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:45.284.289 [tensor_data_transfer.cpp:612]618965 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_tensor_summary
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:45.284.298 [npu_driver.cc:4338] 618963 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:45.284.302 [tensor_data_transfer.cpp:1054]618965 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_tensor_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:45.284.333 [tensor_data_transfer.cpp:612]618963 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_tensor_dump
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:45.284.336 [npu_driver.cc:4338] 618961 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:45.284.342 [tensor_data_transfer.cpp:1056]618965 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:45.284.354 [tensor_data_transfer.cpp:1054]618963 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_tensor_dump
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:45.284.366 [tensor_data_transfer.cpp:612]618961 acltdtReceiveTensorV2: queue is empty, device is 0, name is _npu_log
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.284.369 [api_impl.cc:6121] 618965 MemQueuePeek: Start to peek queue on devId 0, qid is 2.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:45.284.378 [tensor_data_transfer.cpp:1056]618963 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:45.284.388 [tensor_data_transfer.cpp:1054]618961 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is _npu_log
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.284.427 [api_impl.cc:6121] 618963 MemQueuePeek: Start to peek queue on devId 0, qid is 1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.284.391 [npu_driver.cc:4330] 618965 MemQueuePeek: peek mem queue, deviceId=0, qid=2, timeout=800.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:45.284.445 [tensor_data_transfer.cpp:1056]618961 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.284.455 [npu_driver.cc:4330] 618963 MemQueuePeek: peek mem queue, deviceId=0, qid=1, timeout=800.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.284.468 [api_impl.cc:6121] 618961 MemQueuePeek: Start to peek queue on devId 0, qid is 0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.284.485 [npu_driver.cc:4330] 618961 MemQueuePeek: peek mem queue, deviceId=0, qid=0, timeout=800.
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:45.316.173 [queue_client_comm.c:114][ascend][curpid:618646,618969][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:45.316.175 [queue_client_comm.c:114][ascend][curpid:618646,618967][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:45.316.176 [queue_client_comm.c:114][ascend][curpid:618646,618971][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:45.316.257 [npu_driver.cc:4338] 618969 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:45.316.270 [tensor_data_transfer.cpp:612]618969 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_scalar_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:45.316.282 [tensor_data_transfer.cpp:1054]618969 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_scalar_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:45.316.293 [tensor_data_transfer.cpp:1056]618969 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:45.316.294 [npu_driver.cc:4338] 618967 MemQueuePeek: queue empty
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.316.303 [api_impl.cc:6121] 618969 MemQueuePeek: Start to peek queue on devId 0, qid is 4.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:45.316.307 [tensor_data_transfer.cpp:612]618967 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_image_summary
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.316.312 [npu_driver.cc:4330] 618969 MemQueuePeek: peek mem queue, deviceId=0, qid=4, timeout=800.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:45.316.318 [tensor_data_transfer.cpp:1054]618967 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_image_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:45.316.329 [tensor_data_transfer.cpp:1056]618967 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:45.316.326 [npu_driver.cc:4338] 618971 MemQueuePeek: queue empty
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.316.341 [api_impl.cc:6121] 618967 MemQueuePeek: Start to peek queue on devId 0, qid is 3.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:45.316.373 [tensor_data_transfer.cpp:612]618971 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_histogram_summary
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.316.379 [npu_driver.cc:4330] 618967 MemQueuePeek: peek mem queue, deviceId=0, qid=3, timeout=800.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:45.316.395 [tensor_data_transfer.cpp:1054]618971 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_histogram_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:45.316.455 [tensor_data_transfer.cpp:1056]618971 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.316.467 [api_impl.cc:6121] 618971 MemQueuePeek: Start to peek queue on devId 0, qid is 5.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.316.482 [npu_driver.cc:4330] 618971 MemQueuePeek: peek mem queue, deviceId=0, qid=5, timeout=800.
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:45.348.183 [trs_cb_event.c:119][ascend][curpid:618650,618829][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =321; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:45.348.184 [trs_cb_event.c:119][ascend][curpid:618650,618828][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =320; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:45.348.205 [trs_sqcq.c:1491][ascend][curpid:618650,618829][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:45.348.211 [trs_sqcq.c:1491][ascend][curpid:618650,618828][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:45.348.217 [npu_driver.cc:3833] 618829 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:45.348.223 [npu_driver.cc:3833] 618828 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=320, drvRetCode=16.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:45.348.227 [api_impl.cc:5058] 618829 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:45.348.234 [api_impl.cc:5058] 618828 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.348.238 [callback.cpp:132]618829 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.348.247 [callback.cpp:132]618828 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.348.250 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.348.259 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.348.262 [npu_driver.cc:3828] 618829 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=321.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.348.272 [npu_driver.cc:3828] 618828 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=320.
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:45.444.171 [trs_cb_event.c:119][ascend][curpid:618654,618833][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =321; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:45.444.171 [trs_cb_event.c:119][ascend][curpid:618654,618832][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =320; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:45.444.196 [trs_sqcq.c:1491][ascend][curpid:618654,618833][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:45.444.210 [npu_driver.cc:3833] 618833 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=321, drvRetCode=16.
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:45.444.207 [trs_sqcq.c:1491][ascend][curpid:618654,618832][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:45.444.228 [api_impl.cc:5058] 618833 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:45.444.236 [npu_driver.cc:3833] 618832 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=320, drvRetCode=16.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:45.444.241 [callback.cpp:132]618833 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:45.444.251 [api_impl.cc:5058] 618832 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:45.444.260 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:45.444.267 [callback.cpp:132]618832 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.444.280 [npu_driver.cc:3828] 618833 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=321.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:45.444.286 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.444.306 [npu_driver.cc:3828] 618832 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=320.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.486.533 [runtime.cc:3077] 618834 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=0, devId=0, tdt status=0
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.486.568 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618981] [ServerToClientMsgProc] [sessionID=1]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.486.597 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618981] [TsdClient] DeviceMsgProc recvMsg realDeviceId[0] msgType[49] localDevId[0] rspCode[0]heterogeneousSubPid[31762], tsdSupportLevel_[63]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.486.611 [hdc_client.cpp:172][TsdRecvData][tid:618981] [deviceId=0] the Tsd recv data already
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.486.624 [process_mode_manager.cpp:1461][ProcessOpenSubProc][tid:618981] OpenSubProc success stype:0, pid:31762
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.486.636 [adapter_tdt.cc:39] [618981]Open TsdProcess success. deviceLogicId[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.486.645 [network_manager.cc:118] [618981][TsdProcessOpen]hrtTsdProcessOpen success, subPid[31762], devicePhyId_[0], deviceLogicId_[0], hasBackup[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.486.657 [network_manager.cc:180] [618981][NetworkManager][Init]open tsd by process success, devicePhyId[0], deviceLogicId_[0].
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.486.661 [npu_driver.cc:551] 618834 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.486.709 [ra_host.c:205]tid:618981,ra_init(205) : Input parameters: phy_id[0], nic_position:[1] hdc_type:[18]
[INFO] ROCE(618646,python3.9):2025-04-03-09:27:45.486.728 [dl_hal_function.c:218]dl_hal_init(218) : dl_hal_init success, no need to dlopen libascend_hal.so!
[INFO] DRV(618646,python3.9):2025-04-03-09:27:45.486.747 [devdrv_hccl.c:103][ascend][curpid:618646,618981][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618646)
[INFO] ROCE(618646,python3.9):2025-04-03-09:27:45.486.762 [dl_hal_function.c:218]dl_hal_init(218) : dl_hal_init success, no need to dlopen libascend_hal.so!
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.486.778 [ra_hdc.c:580]tid:618981,ra_hdc_init(580) : hdc init start! logic id is 0, phy id is 0, hdc_type is 18
[INFO] DRV(618646,python3.9):2025-04-03-09:27:45.486.984 [hdc_core.c:1982][ascend][curpid:618646,618981][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4187; pid=618646)
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.487.278 [ra_hdc.c:616]tid:618981,ra_hdc_init(616) : hdc init OK! phy_id[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.490.980 [adapter_hccp.cc:583] [618981]init ra success.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.490.995 [network_manager.cc:222] [618981]NetworkManager nicDeploy[1] deviceLogicId_[0] devicePhyId_[0] init ra OK, nicSocketMap size[1], isHostUseDevNic[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.491.020 [topoinfo_detect.cc:534] [618981]NetworkManager start host net success! ip[192.168.0.44%enp67s0f5]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.491.054 [ra_host.c:1764]tid:618981,ra_get_ifnum(1764) : Input parameters: phy_id[0], nic_position:[1], is_all:[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.491.440 [adapter_hccp.cc:1538] [618981][Get][DeviceIP]hrtGetIfNum success. ifAddrNum[2].
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.491.466 [ra_host.c:1814]tid:618981,ra_get_ifaddrs(1814) : Input parameters: phy_id[0], nic_position:[1], is_all[0], interface num[2]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.491.806 [adapter_hccp.cc:1568] [618981][Get][DeviceIP]hrtGetIfAddress: idx[0] ifname[eth0] ip[192.168.100.101%eth0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.491.824 [adapter_hccp.cc:1568] [618981][Get][DeviceIP]hrtGetIfAddress: idx[1] ifname[eth0] ip[fe80::2287:ecff:fe02:45f2%eth0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.491.839 [topoinfo_detect.cc:577] [618981]select AF_INET family as device socket family.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.491.856 [topoinfo_detect.cc:756] [618981]no backup device ip: use 0 as device ip.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.491.867 [topoinfo_detect.cc:294] [618981][HCCL_TRACE]SetupAgent rankNum[8], rank[0], rootInfo identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], server[192.168.0.44%enp67s0f5], serverPort[60008]deviceType[2], logicDevId[0], phydevId[0], deviceIp[192.168.100.101]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.491.901 [network_manager.cc:69] [618981]NetworkManager::GetInstance deviceLogicID[0].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.491.916 [hccl_socket.cc:516] [618981][Get][NicHandleInfo]phyId[0], nicSocketMap[1] localIp[[192.168.0.44%enp67s0f5]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.491.931 [hccl_socket.cc:217] [618981][Connect] localIp[192.168.0.44%enp67s0f5], remoteIp[192.168.0.44], socket_handle[281468736162624], tag[topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008], port[60008]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.491.945 [adapter_hccp.cc:1050] [618981]batch conncet, port[60008] remoteip[7f7f7f7f]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.491.961 [ra_host.c:759]tid:618981,ra_socket_batch_connect(759) : Input parameters: [0]th, phy_id[0], local_ip[192.168.0.44], remote_ip[192.168.0.44], port[60008], tag[topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008], cnt[0]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.491.984 [rs_socket.c:1810]tid:618981,rs_socket_IP_convert(1810) : local IP[0xfffe2c00a8c0], ret:-1, remote IP[0xfffe2c00a8c0], ret:-1
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.492.002 [rs_socket.c:1819]tid:618981,rs_socket_IP_convert(1819) : local IP[192.168.0.44], ret:0, remote IP[192.168.0.44], ret:-1
[WARNING] HCCP(618646,python3.9):2025-04-03-09:27:45.492.017 [rs_socket.c:132]tid:618981,rs_get_conn_info(132) : conn node for IP(192.168.0.44) server_port(60008) tag(topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008) not found
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.492.034 [rs_socket.c:1880]tid:618981,rs_socket_batch_connect(1880) : create conn node for {remote_ip(192.168.0.44), server_port(60008), tag(topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008)}!
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.492.403 [rs_socket.c:1577]tid:618979,rs_connect_bind_client(1577) : client bind success. client family 2 addr 192.168.0.44:35923, fd:53
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.492.438 [rs_drv_socket.c:59]tid:618979,rs_drv_connect(59) : IP(192.168.0.44) port 60008 family 2 fd:53 begin
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.492.534 [rs_drv_socket.c:98]tid:618979,rs_drv_connect(98) : client connect success. client family 2 addr 192.168.0.44:35923, server addr 192.168.0.44:60008, fd:53
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.492.554 [rs_socket.c:1427]tid:618979,rs_conn_cost_time(1427) : socket [53] connect success! cost [0.522000] ms
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.492.601 [rs_socket.c:1392]tid:618979,rs_socket_tag_sync(1392) : [client]send tag success! ret:256, tag_sync_time:1, client_ip:192.168.0.44 server_ip:192.168.0.44 server_port:60008 tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.492.635 [rs_socket.c:829]tid:618978,rs_epoll_event_listen_in_handle(829) : [server]server_ip:192.168.0.44 server_port:60008 accept ok @ listen_fd:51, new fd:54
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.492.677 [rs_socket.c:694]tid:618978,rs_tcp_recv_tag_in_handle(694) : recv tag success, server:{192.168.0.44:60008} client:192.168.0.44 time_cost:0.005000ms tag_sync_time:1 tag_eintr_time:0
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.492.702 [rs_epoll.c:120]tid:618978,rs_wlist_check_conn_add(120) : [Server]chip_id 0, fd 54 accept, server ip:192.168.0.44, client ip:192.168.0.44, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.492.718 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:54, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.492.731 [rs_epoll.c:329]tid:618978,rs_epoll_event_in_handle(329) : the fd:51 is tcp listened, no need to go on, ret:0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.493.117 [topoinfo_exchange_agent.cc:212] [618981]TopoInfoExchangeAgent get socket success.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.493.184 [topoinfo_exchange_agent.cc:236] [618981]local rank[0] get socket connection with server[192.168.0.44] port[60008] success.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.493.200 [topoinfo_exchange_agent.cc:43] [618981]TopoExchangeAgent: client connect with server ip[192.168.0.44] port[60008] success.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.493.216 [topoinfo_exchange_agent.cc:345] [618981]ConstructRankTableServerId serverId 192.168.0.44
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.493.344 [topoinfo_exchange_agent.cc:77] [618981]topo exchange client send rank basic info success.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.493.429 [topoinfo_exchange_server.cc:130] [618980]listenSocket_->Accept completed.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.493.466 [topoinfo_exchange_server.cc:226] [618980]get remote rank[0000000000000000 / 8] success.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.493.488 [hccl_socket.cc:342] [618980][Accept]localIp[192.168.0.44%enp67s0f5], remoteIp[0.0.0.0], socket_handle[0xfffe8c08cb40], tag[topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.493.501 [network_manager.cc:69] [618980]NetworkManager::GetInstance deviceLogicID[0].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.493.514 [hccl_socket.cc:516] [618980][Get][NicHandleInfo]phyId[0], nicSocketMap[1] localIp[[192.168.0.44%enp67s0f5]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.495.583 [runtime.cc:3077] 618814 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=4, devId=4, tdt status=0
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.495.590 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618984] [ServerToClientMsgProc] [sessionID=1]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.495.620 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618984] [TsdClient] DeviceMsgProc recvMsg realDeviceId[4] msgType[49] localDevId[4] rspCode[0]heterogeneousSubPid[29683], tsdSupportLevel_[63]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.495.641 [hdc_client.cpp:172][TsdRecvData][tid:618984] [deviceId=4] the Tsd recv data already
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.495.658 [process_mode_manager.cpp:1461][ProcessOpenSubProc][tid:618984] OpenSubProc success stype:0, pid:29683
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.495.667 [npu_driver.cc:551] 618814 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.495.676 [adapter_tdt.cc:39] [618984]Open TsdProcess success. deviceLogicId[4]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.495.694 [network_manager.cc:118] [618984][TsdProcessOpen]hrtTsdProcessOpen success, subPid[29683], devicePhyId_[4], deviceLogicId_[4], hasBackup[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.495.732 [network_manager.cc:180] [618984][NetworkManager][Init]open tsd by process success, devicePhyId[4], deviceLogicId_[4].
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.495.772 [ra_host.c:205]tid:618984,ra_init(205) : Input parameters: phy_id[4], nic_position:[1] hdc_type:[18]
[INFO] ROCE(618662,python3.9):2025-04-03-09:27:45.495.791 [dl_hal_function.c:218]dl_hal_init(218) : dl_hal_init success, no need to dlopen libascend_hal.so!
[INFO] DRV(618662,python3.9):2025-04-03-09:27:45.495.811 [devdrv_hccl.c:103][ascend][curpid:618662,618984][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618662)
[INFO] ROCE(618662,python3.9):2025-04-03-09:27:45.495.830 [dl_hal_function.c:218]dl_hal_init(218) : dl_hal_init success, no need to dlopen libascend_hal.so!
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.495.839 [runtime.cc:3077] 618826 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=1, devId=1, tdt status=0
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.495.849 [ra_hdc.c:580]tid:618984,ra_hdc_init(580) : hdc init start! logic id is 4, phy id is 4, hdc_type is 18
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.495.919 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618987] [ServerToClientMsgProc] [sessionID=1]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.495.952 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618987] [TsdClient] DeviceMsgProc recvMsg realDeviceId[1] msgType[49] localDevId[1] rspCode[0]heterogeneousSubPid[30511], tsdSupportLevel_[63]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.495.973 [npu_driver.cc:551] 618826 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.495.979 [hdc_client.cpp:172][TsdRecvData][tid:618987] [deviceId=1] the Tsd recv data already
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.496.005 [process_mode_manager.cpp:1461][ProcessOpenSubProc][tid:618987] OpenSubProc success stype:0, pid:30511
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.495.979 [runtime.cc:3077] 618772 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=3, devId=3, tdt status=0
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.495.981 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618982] [ServerToClientMsgProc] [sessionID=1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.496.018 [adapter_tdt.cc:39] [618987]Open TsdProcess success. deviceLogicId[1]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.496.015 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618982] [TsdClient] DeviceMsgProc recvMsg realDeviceId[3] msgType[49] localDevId[3] rspCode[0]heterogeneousSubPid[30134], tsdSupportLevel_[63]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.496.035 [hdc_client.cpp:172][TsdRecvData][tid:618982] [deviceId=3] the Tsd recv data already
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.496.049 [process_mode_manager.cpp:1461][ProcessOpenSubProc][tid:618982] OpenSubProc success stype:0, pid:30134
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.496.038 [network_manager.cc:118] [618987][TsdProcessOpen]hrtTsdProcessOpen success, subPid[30511], devicePhyId_[1], deviceLogicId_[1], hasBackup[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.496.063 [adapter_tdt.cc:39] [618982]Open TsdProcess success. deviceLogicId[3]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.496.070 [npu_driver.cc:551] 618772 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.496.069 [network_manager.cc:180] [618987][NetworkManager][Init]open tsd by process success, devicePhyId[1], deviceLogicId_[1].
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.496.053 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618988] [ServerToClientMsgProc] [sessionID=1]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.496.055 [runtime.cc:3077] 618830 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=2, devId=2, tdt status=0
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.496.075 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618988] [TsdClient] DeviceMsgProc recvMsg realDeviceId[2] msgType[49] localDevId[2] rspCode[0]heterogeneousSubPid[5093], tsdSupportLevel_[63]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.496.080 [network_manager.cc:118] [618982][TsdProcessOpen]hrtTsdProcessOpen success, subPid[30134], devicePhyId_[3], deviceLogicId_[3], hasBackup[0]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.496.093 [hdc_client.cpp:172][TsdRecvData][tid:618988] [deviceId=2] the Tsd recv data already
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.496.109 [process_mode_manager.cpp:1461][ProcessOpenSubProc][tid:618988] OpenSubProc success stype:0, pid:5093
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.496.097 [network_manager.cc:180] [618982][NetworkManager][Init]open tsd by process success, devicePhyId[3], deviceLogicId_[3].
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.496.124 [adapter_tdt.cc:39] [618988]Open TsdProcess success. deviceLogicId[2]
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.496.118 [ra_host.c:205]tid:618987,ra_init(205) : Input parameters: phy_id[1], nic_position:[1] hdc_type:[18]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.496.122 [npu_driver.cc:551] 618830 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] ROCE(618650,python3.9):2025-04-03-09:27:45.496.138 [dl_hal_function.c:218]dl_hal_init(218) : dl_hal_init success, no need to dlopen libascend_hal.so!
[INFO] DRV(618650,python3.9):2025-04-03-09:27:45.496.168 [devdrv_hccl.c:103][ascend][curpid:618650,618987][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618650)
[INFO] ROCE(618650,python3.9):2025-04-03-09:27:45.496.188 [dl_hal_function.c:218]dl_hal_init(218) : dl_hal_init success, no need to dlopen libascend_hal.so!
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.496.206 [ra_hdc.c:580]tid:618987,ra_hdc_init(580) : hdc init start! logic id is 1, phy id is 1, hdc_type is 18
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.496.139 [ra_host.c:205]tid:618982,ra_init(205) : Input parameters: phy_id[3], nic_position:[1] hdc_type:[18]
[INFO] ROCE(618658,python3.9):2025-04-03-09:27:45.496.162 [dl_hal_function.c:218]dl_hal_init(218) : dl_hal_init success, no need to dlopen libascend_hal.so!
[INFO] DRV(618658,python3.9):2025-04-03-09:27:45.496.198 [devdrv_hccl.c:103][ascend][curpid:618658,618982][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618658)
[INFO] ROCE(618658,python3.9):2025-04-03-09:27:45.496.211 [dl_hal_function.c:218]dl_hal_init(218) : dl_hal_init success, no need to dlopen libascend_hal.so!
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.496.224 [ra_hdc.c:580]tid:618982,ra_hdc_init(580) : hdc init start! logic id is 3, phy id is 3, hdc_type is 18
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.496.137 [network_manager.cc:118] [618988][TsdProcessOpen]hrtTsdProcessOpen success, subPid[5093], devicePhyId_[2], deviceLogicId_[2], hasBackup[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.496.153 [network_manager.cc:180] [618988][NetworkManager][Init]open tsd by process success, devicePhyId[2], deviceLogicId_[2].
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.496.217 [ra_host.c:205]tid:618988,ra_init(205) : Input parameters: phy_id[2], nic_position:[1] hdc_type:[18]
[INFO] ROCE(618654,python3.9):2025-04-03-09:27:45.496.230 [dl_hal_function.c:218]dl_hal_init(218) : dl_hal_init success, no need to dlopen libascend_hal.so!
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.496.226 [runtime.cc:3077] 618820 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=6, devId=6, tdt status=0
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.496.227 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618986] [ServerToClientMsgProc] [sessionID=1]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:45.496.248 [devdrv_hccl.c:103][ascend][curpid:618654,618988][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618654)
[INFO] ROCE(618654,python3.9):2025-04-03-09:27:45.496.265 [dl_hal_function.c:218]dl_hal_init(218) : dl_hal_init success, no need to dlopen libascend_hal.so!
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.496.263 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618986] [TsdClient] DeviceMsgProc recvMsg realDeviceId[6] msgType[49] localDevId[6] rspCode[0]heterogeneousSubPid[29770], tsdSupportLevel_[63]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.496.280 [hdc_client.cpp:172][TsdRecvData][tid:618986] [deviceId=6] the Tsd recv data already
[INFO] DRV(618662,python3.9):2025-04-03-09:27:45.496.290 [hdc_core.c:1982][ascend][curpid:618662,618984][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4188; pid=618662)
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.496.281 [ra_hdc.c:580]tid:618988,ra_hdc_init(580) : hdc init start! logic id is 2, phy id is 2, hdc_type is 18
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.496.296 [process_mode_manager.cpp:1461][ProcessOpenSubProc][tid:618986] OpenSubProc success stype:0, pid:29770
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.496.313 [adapter_tdt.cc:39] [618986]Open TsdProcess success. deviceLogicId[6]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.496.325 [network_manager.cc:118] [618986][TsdProcessOpen]hrtTsdProcessOpen success, subPid[29770], devicePhyId_[6], deviceLogicId_[6], hasBackup[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.496.337 [network_manager.cc:180] [618986][NetworkManager][Init]open tsd by process success, devicePhyId[6], deviceLogicId_[6].
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.496.353 [npu_driver.cc:551] 618820 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] DRV(618650,python3.9):2025-04-03-09:27:45.496.378 [hdc_core.c:1982][ascend][curpid:618650,618987][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4189; pid=618650)
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.496.374 [ra_host.c:205]tid:618986,ra_init(205) : Input parameters: phy_id[6], nic_position:[1] hdc_type:[18]
[INFO] ROCE(618670,python3.9):2025-04-03-09:27:45.496.406 [dl_hal_function.c:218]dl_hal_init(218) : dl_hal_init success, no need to dlopen libascend_hal.so!
[INFO] DRV(618670,python3.9):2025-04-03-09:27:45.496.427 [devdrv_hccl.c:103][ascend][curpid:618670,618986][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618670)
[INFO] ROCE(618670,python3.9):2025-04-03-09:27:45.496.444 [dl_hal_function.c:218]dl_hal_init(218) : dl_hal_init success, no need to dlopen libascend_hal.so!
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.496.458 [ra_hdc.c:580]tid:618986,ra_hdc_init(580) : hdc init start! logic id is 6, phy id is 6, hdc_type is 18
[INFO] DRV(618658,python3.9):2025-04-03-09:27:45.496.461 [hdc_core.c:1982][ascend][curpid:618658,618982][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4190; pid=618658)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:45.496.520 [hdc_core.c:1982][ascend][curpid:618654,618988][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4191; pid=618654)
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.496.592 [ra_hdc.c:616]tid:618984,ra_hdc_init(616) : hdc init OK! phy_id[4]
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.496.674 [ra_hdc.c:616]tid:618987,ra_hdc_init(616) : hdc init OK! phy_id[1]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:45.496.698 [hdc_core.c:1982][ascend][curpid:618670,618986][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4192; pid=618670)
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.496.751 [ra_hdc.c:616]tid:618982,ra_hdc_init(616) : hdc init OK! phy_id[3]
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.496.984 [ra_hdc.c:616]tid:618986,ra_hdc_init(616) : hdc init OK! phy_id[6]
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.496.984 [ra_hdc.c:616]tid:618988,ra_hdc_init(616) : hdc init OK! phy_id[2]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.497.197 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618983] [ServerToClientMsgProc] [sessionID=1]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.497.198 [runtime.cc:3077] 618806 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=5, devId=5, tdt status=0
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.497.219 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618983] [TsdClient] DeviceMsgProc recvMsg realDeviceId[5] msgType[49] localDevId[5] rspCode[0]heterogeneousSubPid[30089], tsdSupportLevel_[63]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.497.233 [hdc_client.cpp:172][TsdRecvData][tid:618983] [deviceId=5] the Tsd recv data already
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.497.245 [process_mode_manager.cpp:1461][ProcessOpenSubProc][tid:618983] OpenSubProc success stype:0, pid:30089
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.497.257 [adapter_tdt.cc:39] [618983]Open TsdProcess success. deviceLogicId[5]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.497.268 [network_manager.cc:118] [618983][TsdProcessOpen]hrtTsdProcessOpen success, subPid[30089], devicePhyId_[5], deviceLogicId_[5], hasBackup[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.497.280 [network_manager.cc:180] [618983][NetworkManager][Init]open tsd by process success, devicePhyId[5], deviceLogicId_[5].
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.497.294 [npu_driver.cc:551] 618806 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.497.321 [ra_host.c:205]tid:618983,ra_init(205) : Input parameters: phy_id[5], nic_position:[1] hdc_type:[18]
[INFO] ROCE(618666,python3.9):2025-04-03-09:27:45.497.334 [dl_hal_function.c:218]dl_hal_init(218) : dl_hal_init success, no need to dlopen libascend_hal.so!
[INFO] DRV(618666,python3.9):2025-04-03-09:27:45.497.353 [devdrv_hccl.c:103][ascend][curpid:618666,618983][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618666)
[INFO] ROCE(618666,python3.9):2025-04-03-09:27:45.497.367 [dl_hal_function.c:218]dl_hal_init(218) : dl_hal_init success, no need to dlopen libascend_hal.so!
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.497.387 [ra_hdc.c:580]tid:618983,ra_hdc_init(580) : hdc init start! logic id is 5, phy id is 5, hdc_type is 18
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.497.620 [runtime.cc:3077] 618812 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=7, devId=7, tdt status=0
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.497.622 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618985] [ServerToClientMsgProc] [sessionID=1]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.497.657 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618985] [TsdClient] DeviceMsgProc recvMsg realDeviceId[7] msgType[49] localDevId[7] rspCode[0]heterogeneousSubPid[29960], tsdSupportLevel_[63]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.497.678 [hdc_client.cpp:172][TsdRecvData][tid:618985] [deviceId=7] the Tsd recv data already
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.497.679 [npu_driver.cc:551] 618812 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.497.697 [process_mode_manager.cpp:1461][ProcessOpenSubProc][tid:618985] OpenSubProc success stype:0, pid:29960
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.497.717 [adapter_tdt.cc:39] [618985]Open TsdProcess success. deviceLogicId[7]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.497.732 [network_manager.cc:118] [618985][TsdProcessOpen]hrtTsdProcessOpen success, subPid[29960], devicePhyId_[7], deviceLogicId_[7], hasBackup[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.497.750 [network_manager.cc:180] [618985][NetworkManager][Init]open tsd by process success, devicePhyId[7], deviceLogicId_[7].
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.497.791 [ra_host.c:205]tid:618985,ra_init(205) : Input parameters: phy_id[7], nic_position:[1] hdc_type:[18]
[INFO] ROCE(618674,python3.9):2025-04-03-09:27:45.497.809 [dl_hal_function.c:218]dl_hal_init(218) : dl_hal_init success, no need to dlop[INFO] DRV(618666,python3.9):2025-04-03-09:27:45.497.808 [hdc_core.c:1982][ascend][curpid:618666,618983][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4193; pid=618666)
en libascend_hal.so!
[INFO] DRV(618674,python3.9):2025-04-03-09:27:45.497.849 [devdrv_hccl.c:103][ascend][curpid:618674,618985][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618674)
[INFO] ROCE(618674,python3.9):2025-04-03-09:27:45.497.867 [dl_hal_function.c:218]dl_hal_init(218) : dl_hal_init success, no need to dlopen libascend_hal.so!
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.497.885 [ra_hdc.c:580]tid:618985,ra_hdc_init(580) : hdc init start! logic id is 7, phy id is 7, hdc_type is 18
[INFO] DRV(618674,python3.9):2025-04-03-09:27:45.498.126 [hdc_core.c:1982][ascend][curpid:618674,618985][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4194; pid=618674)
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.498.134 [ra_hdc.c:616]tid:618983,ra_hdc_init(616) : hdc init OK! phy_id[5]
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.498.370 [ra_hdc.c:616]tid:618985,ra_hdc_init(616) : hdc init OK! phy_id[7]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.500.149 [adapter_hccp.cc:583] [618982]init ra success.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.500.196 [network_manager.cc:222] [618982]NetworkManager nicDeploy[1] deviceLogicId_[3] devicePhyId_[3] init ra OK, nicSocketMap size[0], isHostUseDevNic[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.500.246 [topoinfo_detect.cc:534] [618982]NetworkManager start host net success! ip[192.168.0.44%enp67s0f5]
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.500.278 [ra_host.c:1764]tid:618982,ra_get_ifnum(1764) : Input parameters: phy_id[3], nic_position:[1], is_all:[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.500.288 [adapter_hccp.cc:583] [618984]init ra success.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.500.306 [network_manager.cc:222] [618984]NetworkManager nicDeploy[1] deviceLogicId_[4] devicePhyId_[4] init ra OK, nicSocketMap size[0], isHostUseDevNic[1]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.500.333 [topoinfo_detect.cc:534] [618984]NetworkManager start host net success! ip[192.168.0.44%enp67s0f5]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.500.323 [adapter_hccp.cc:583] [618987]init ra success.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.500.358 [network_manager.cc:222] [618987]NetworkManager nicDeploy[1] deviceLogicId_[1] devicePhyId_[1] init ra OK, nicSocketMap size[0], isHostUseDevNic[1]
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.500.353 [ra_host.c:1764]tid:618984,ra_get_ifnum(1764) : Input parameters: phy_id[4], nic_position:[1], is_all:[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.500.392 [topoinfo_detect.cc:534] [618987]NetworkManager start host net success! ip[192.168.0.44%enp67s0f5]
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.500.437 [ra_host.c:1764]tid:618987,ra_get_ifnum(1764) : Input parameters: phy_id[1], nic_position:[1], is_all:[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.500.668 [adapter_hccp.cc:1538] [618982][Get][DeviceIP]hrtGetIfNum success. ifAddrNum[2].
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.500.688 [ra_host.c:1814]tid:618982,ra_get_ifaddrs(1814) : Input parameters: phy_id[3], nic_position:[1], is_all[0], interface num[2]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.500.676 [adapter_hccp.cc:583] [618988]init ra success.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.500.697 [network_manager.cc:222] [618988]NetworkManager nicDeploy[1] deviceLogicId_[2] devicePhyId_[2] init ra OK, nicSocketMap size[0], isHostUseDevNic[1]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.500.724 [topoinfo_detect.cc:534] [618988]NetworkManager start host net success! ip[192.168.0.44%enp67s0f5]
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.500.744 [ra_host.c:1764]tid:618988,ra_get_ifnum(1764) : Input parameters: phy_id[2], nic_position:[1], is_all:[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.500.750 [adapter_hccp.cc:1538] [618984][Get][DeviceIP]hrtGetIfNum success. ifAddrNum[2].
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.500.768 [ra_host.c:1814]tid:618984,ra_get_ifaddrs(1814) : Input parameters: phy_id[4], nic_position:[1], is_all[0], interface num[2]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.500.814 [adapter_hccp.cc:1538] [618987][Get][DeviceIP]hrtGetIfNum success. ifAddrNum[2].
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.500.833 [ra_host.c:1814]tid:618987,ra_get_ifaddrs(1814) : Input parameters: phy_id[1], nic_position:[1], is_all[0], interface num[2]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.500.982 [adapter_hccp.cc:583] [618986]init ra success.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.501.000 [network_manager.cc:222] [618986]NetworkManager nicDeploy[1] deviceLogicId_[6] devicePhyId_[6] init ra OK, nicSocketMap size[0], isHostUseDevNic[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.501.023 [topoinfo_detect.cc:534] [618986]NetworkManager start host net success! ip[192.168.0.44%enp67s0f5]
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.501.042 [ra_host.c:1764]tid:618986,ra_get_ifnum(1764) : Input parameters: phy_id[6], nic_position:[1], is_all:[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.501.052 [adapter_hccp.cc:1568] [618982][Get][DeviceIP]hrtGetIfAddress: idx[0] ifname[eth3] ip[29.105.51.138%eth3]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.501.075 [adapter_hccp.cc:1568] [618982][Get][DeviceIP]hrtGetIfAddress: idx[1] ifname[eth3] ip[fe80::2287:ecff:fe02:45b4%eth3]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.501.095 [topoinfo_detect.cc:577] [618982]select AF_INET family as device socket family.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.501.119 [topoinfo_detect.cc:756] [618982]no backup device ip: use 0 as device ip.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.501.117 [adapter_hccp.cc:1568] [618984][Get][DeviceIP]hrtGetIfAddress: idx[0] ifname[eth4] ip[29.105.24.184%eth4]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.501.136 [topoinfo_detect.cc:294] [618982][HCCL_TRACE]SetupAgent rankNum[8], rank[3], rootInfo identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], server[192.168.0.44%enp67s0f5], serverPort[60008]deviceType[2], logicDevId[3], phydevId[3], deviceIp[29.105.51.138]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.501.139 [adapter_hccp.cc:1568] [618984][Get][DeviceIP]hrtGetIfAddress: idx[1] ifname[eth4] ip[fe80::2287:ecff:fe02:45b0%eth4]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.501.153 [adapter_hccp.cc:1538] [618988][Get][DeviceIP]hrtGetIfNum success. ifAddrNum[2].
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.501.161 [topoinfo_detect.cc:577] [618984]select AF_INET family as device socket family.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.501.178 [topoinfo_detect.cc:756] [618984]no backup device ip: use 0 as device ip.
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.501.170 [ra_host.c:1814]tid:618988,ra_get_ifaddrs(1814) : Input parameters: phy_id[2], nic_position:[1], is_all[0], interface num[2]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.501.176 [adapter_hccp.cc:1568] [618987][Get][DeviceIP]hrtGetIfAddress: idx[0] ifname[eth1] ip[29.105.19.202%eth1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.501.184 [network_manager.cc:69] [618982]NetworkManager::GetInstance deviceLogicID[3].
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.501.189 [topoinfo_detect.cc:294] [618984][HCCL_TRACE]SetupAgent rankNum[8], rank[4], rootInfo identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], server[192.168.0.44%enp67s0f5], serverPort[60008]deviceType[2], logicDevId[4], phydevId[4], deviceIp[29.105.24.184]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.501.201 [adapter_hccp.cc:1568] [618987][Get][DeviceIP]hrtGetIfAddress: idx[1] ifname[eth1] ip[fe80::2287:ecff:fe02:45ec%eth1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.501.205 [hccl_socket.cc:516] [618982][Get][NicHandleInfo]phyId[3], nicSocketMap[1] localIp[[192.168.0.44%enp67s0f5]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.501.221 [topoinfo_detect.cc:577] [618987]select AF_INET family as device socket family.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.501.223 [hccl_socket.cc:217] [618982][Connect] localIp[192.168.0.44%enp67s0f5], remoteIp[192.168.0.44], socket_handle[281469273482768], tag[topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008], port[60008]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.501.224 [network_manager.cc:69] [618984]NetworkManager::GetInstance deviceLogicID[4].
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.501.240 [topoinfo_detect.cc:756] [618987]no backup device ip: use 0 as device ip.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.501.241 [adapter_hccp.cc:1050] [618982]batch conncet, port[60008] remoteip[7f7f7f7f]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.501.243 [hccl_socket.cc:516] [618984][Get][NicHandleInfo]phyId[4], nicSocketMap[1] localIp[[192.168.0.44%enp67s0f5]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.501.256 [topoinfo_detect.cc:294] [618987][HCCL_TRACE]SetupAgent rankNum[8], rank[1], rootInfo identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], server[192.168.0.44%enp67s0f5], serverPort[60008]deviceType[2], logicDevId[1], phydevId[1], deviceIp[29.105.19.202]
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.501.261 [ra_host.c:759]tid:618982,ra_socket_batch_connect(759) : Input parameters: [0]th, phy_id[3], local_ip[192.168.0.44], remote_ip[192.168.0.44], port[60008], tag[topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008], cnt[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.501.260 [hccl_socket.cc:217] [618984][Connect] localIp[192.168.0.44%enp67s0f5], remoteIp[192.168.0.44], socket_handle[281469340591632], tag[topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008], port[60008]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.501.277 [adapter_hccp.cc:1050] [618984]batch conncet, port[60008] remoteip[7f7f7f7f]
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.501.294 [ra_host.[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.501.292 [network_manager.cc:69] [618987]NetworkManager::GetInstance deviceLogicID[1].
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.501.313 [hccl_socket.cc:516] [618987][Get][NicHandleInfo]phyId[1], nicSocketMap[1] localIp[[192.168.0.44%enp67s0f5]
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.501.311 [rs_socket.c:1810]tid:618982,rs_socket_IP_convert(1810) : local IP[0xfffe2c00a8c0], ret:-1, remote IP[0xfffe2c00a8c0], ret:-1
c:759]tid:618984,ra_socket_batch_connect(759) : Input parameters: [0]th, phy_id[4], local_ip[192.168.0.44], remote_ip[192.168.0.44], port[60008], tag[topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008], cnt[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.501.333 [hccl_socket.cc:217] [618987][Connect] localIp[192.168.0.44%enp67s0f5], remoteIp[192.168.0.44], socket_handle[281469474809360], tag[topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008], port[60008]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.501.349 [adapter_hccp.cc:1050] [618987]batch conncet, port[60008] remoteip[7f7f7f7f]
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.501.335 [rs_socket.c:1819]tid:618982,rs_socket_IP_convert(1819) : local IP[192.168.0.44], ret:0, remote IP[192.168.0.44], ret:-1
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.501.349 [rs_socket.c:1810]tid:618984,rs_socket_IP_convert(1810) : local IP[0xfffe2c00a8c0], ret:-1, remote IP[0xfffe2c00a8c0], ret:-1
[WARNING] HCCP(618658,python3.9):2025-04-03-09:27:45.501.367 [rs_socket.c:132]tid:618982,rs_get_conn_info(132) : conn node for IP(192.168.0.44) server_port(60008) tag(topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008) not found
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.501.369 [rs_socket.c:1819]tid:618984,rs_socket_IP_convert(1819) : local IP[192.168.0.44], ret:0, remote IP[192.168.0.44], ret:-1
[WARNING] HCCP(618662,python3.9):2025-04-03-09:27:45.501.388 [rs_socket.c:132]tid:618984,rs_get_conn_info(132) : conn node for IP(192.168.0.44) server_port(60008) tag(topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008) not found
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.501.363 [ra_host.c:759]tid:618987,ra_socket_batch_connect(759) : Input parameters: [0]th, phy_id[1], local_ip[192.168.0.44], remote_ip[192.168.0.44], port[60008], tag[topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008], cnt[0]
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.501.387 [rs_socket.c:1880]tid:618982,rs_socket_batch_connect(1880) : create conn node for {remote_ip(192.168.0.44), server_port(60008), tag(topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008)}!
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.501.409 [rs_socket.c:1880]tid:618984,rs_socket_batch_connect(1880) : create conn node for {remote_ip(192.168.0.44), server_port(60008), tag(topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008)}!
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.501.423 [rs_socket.c:1810]tid:618987,rs_socket_IP_convert(1810) : local IP[0xfffe2c00a8c0], ret:-1, remote IP[0xfffe2c00a8c0], ret:-1
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.501.441 [adapter_hccp.cc:1538] [618986][Get][DeviceIP]hrtGetIfNum success. ifAddrNum[2].
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.501.447 [rs_socket.c:1819]tid:618987,rs_socket_IP_convert(1819) : local IP[192.168.0.44], ret:0, remote IP[192.168.0.44], ret:-1
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.501.458 [ra_host.c:1814]tid:618986,ra_get_ifaddrs(1814) : Input parameters: phy_id[6], nic_position:[1], is_all[0], interface num[2]
[WARNING] HCCP(618650,python3.9):2025-04-03-09:27:45.501.463 [rs_socket.c:132]tid:618987,rs_get_conn_info(132) : conn node for IP(192.168.0.44) server_port(60008) tag(topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008) not found
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.501.479 [rs_socket.c:1880]tid:618987,rs_socket_batch_connect(1880) : create conn node for {remote_ip(192.168.0.44), server_port(60008), tag(topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008)}!
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.501.515 [adapter_hccp.cc:1568] [618988][Get][DeviceIP]hrtGetIfAddress: idx[0] ifname[eth2] ip[29.105.165.16%eth2]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.501.536 [adapter_hccp.cc:1568] [618988][Get][DeviceIP]hrtGetIfAddress: idx[1] ifname[eth2] ip[fe80::2287:ecff:fe02:4625%eth2]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.501.551 [topoinfo_detect.cc:577] [618988]select AF_INET family as device socket family.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.501.568 [topoinfo_detect.cc:756] [618988]no backup device ip: use 0 as device ip.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.501.581 [topoinfo_detect.cc:294] [618988][HCCL_TRACE]SetupAgent rankNum[8], rank[2], rootInfo identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], server[192.168.0.44%enp67s0f5], serverPort[60008]deviceType[2], logicDevId[2], phydevId[2], deviceIp[29.105.165.16]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.501.615 [network_manager.cc:69] [618988]NetworkManager::GetInstance deviceLogicID[2].
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.501.633 [hccl_socket.cc:516] [618988][Get][NicHandleInfo]phyId[2], nicSocketMap[1] localIp[[192.168.0.44%enp67s0f5]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.501.646 [hccl_socket.cc:217] [618988][Connect] localIp[192.168.0.44%enp67s0f5], remoteIp[192.168.0.44], socket_handle[281468669502992], tag[topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008], port[60008]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.501.663 [adapter_hccp.cc:1050] [618988]batch conncet, port[60008] remoteip[7f7f7f7f]
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.501.679 [ra_host.c:759]tid:618988,ra_socket_batch_connect(759) : Input parameters: [0]th, phy_id[2], local_ip[192.168.0.44], remote_ip[192.168.0.44], port[60008], tag[topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008], cnt[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.501.722 [adapter_hccp.cc:583] [618983]init ra success.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.501.739 [network_manager.cc:222] [618983]NetworkManager nicDeploy[1] deviceLogicId_[5] devicePhyId_[5] init ra OK, nicSocketMap size[0], isHostUseDevNic[1]
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.501.717 [rs_socket.c:1810]tid:618988,rs_socket_IP_convert(1810) : local IP[0xfffe2c00a8c0], ret:-1, remote IP[0xfffe2c00a8c0], ret:-1
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.501.749 [rs_socket.c:1819]tid:618988,rs_socket_IP_convert(1819) : local IP[192.168.0.44], ret:0, remote IP[192.168.0.44], ret:-1
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.501.760 [topoinfo_detect.cc:534] [618983]NetworkManager start host net success! ip[192.168.0.44%enp67s0f5]
[WARNING] HCCP(618654,python3.9):2025-04-03-09:27:45.501.767 [rs_socket.c:132]tid:618988,rs_get_conn_info(132) : conn node for IP(192.168.0.44) server_port(60008) tag(topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008) not found
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.501.777 [ra_host.c:1764]tid:618983,ra_get_ifnum(1764) : Input parameters: phy_id[5], nic_position:[1], is_all:[0]
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.501.786 [rs_socket.c:1880]tid:618988,rs_socket_batch_connect(1880) : create conn node for {remote_ip(192.168.0.44), server_port(60008), tag(topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008)}!
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.501.807 [adapter_hccp.cc:1568] [618986][Get][DeviceIP]hrtGetIfAddress: idx[0] ifname[eth6] ip[29.105.134.38%eth6]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.501.827 [adapter_hccp.cc:1568] [618986][Get][DeviceIP]hrtGetIfAddress: idx[1] ifname[eth6] ip[fe80::2287:ecff:fe02:45f5%eth6]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.501.845 [topoinfo_detect.cc:577] [618986]select AF_INET family as device socket family.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.501.865 [topoinfo_detect.cc:756] [618986]no backup device ip: use 0 as device ip.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.501.880 [topoinfo_detect.cc:294] [618986][HCCL_TRACE]SetupAgent rankNum[8], rank[6], rootInfo identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], server[192.168.0.44%enp67s0f5], serverPort[60008]deviceType[2], logicDevId[6], phydevId[6], deviceIp[29.105.134.38]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.501.913 [network_manager.cc:69] [618986]NetworkManager::GetInstance deviceLogicID[6].
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.501.931 [hccl_socket.cc:516] [618986][Get][NicHandleInfo]phyId[6], nicSocketMap[1] localIp[[192.168.0.44%enp67s0f5]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.501.949 [hccl_socket.cc:217] [618986][Connect] localIp[192.168.0.44%enp67s0f5], remoteIp[192.168.0.44], socket_handle[281469139265040], tag[topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008], port[60008]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.501.965 [adapter_hccp.cc:1050] [618986]batch conncet, port[60008] remoteip[7f7f7f7f]
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.501.981 [ra_host.c:759]tid:618986,ra_socket_batch_connect(759) : Input parameters: [0]th, phy_id[6], local_ip[192.168.0.44], remote_ip[192.168.0.44], port[60008], tag[topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008], cnt[0]
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.501.999 [rs_socket.c:1577]tid:618994,rs_connect_bind_client(1577) : client bind success. client family 2 addr 192.168.0.44:43985, fd:52
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.502.015 [rs_socket.c:1810]tid:618986,rs_socket_IP_convert(1810) : local IP[0xfffe2c00a8c0], ret:-1, remote IP[0xfffe2c00a8c0], ret:-1
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.502.035 [rs_drv_socket.c:59]tid:618994,rs_drv_connect(59) : IP(192.168.0.44) port 60008 family 2 fd:52 begin
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.502.047 [rs_socket.c:1819]tid:618986,rs_socket_IP_convert(1819) : local IP[192.168.0.44], ret:0, remote IP[192.168.0.44], ret:-1
[WARNING] HCCP(618670,python3.9):2025-04-03-09:27:45.502.067 [rs_socket.c:132]tid:618986,rs_get_conn_info(132) : conn node for IP(192.168.0.44) server_port(60008) tag(topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008) not found
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.502.085 [rs_socket.c:1880]tid:618986,rs_socket_batch_connect(1880) : create conn node for {remote_ip(192.168.0.44), server_port(60008), tag(topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008)}!
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.502.133 [rs_drv_socket.c:98]tid:618994,rs_drv_connect(98) : client connect success. client family 2 addr 192.168.0.44:43985, server addr 192.168.0.44:60008, fd:52
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.502.131 [adapter_hccp.cc:583] [618985]init ra success.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.502.150 [network_manager.cc:222] [618985]NetworkManager nicDeploy[1] deviceLogicId_[7] devicePhyId_[7] init ra OK, nicSocketMap size[0], isHostUseDevNic[1]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.145 [rs_socket.c:829]tid:618978,rs_epoll_event_listen_in_handle(829) : [server]server_ip:192.168.0.44 server_port:60008 accept ok @ listen_fd:51, new fd:55
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.502.161 [adapter_hccp.cc:1538] [618983][Get][DeviceIP]hrtGetIfNum success. ifAddrNum[2].
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.502.157 [rs_socket.c:1427]tid:618994,rs_conn_cost_time(1427) : socket [52] connect success! cost [0.748000] ms
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.502.178 [ra_host.c:1814]tid:618983,ra_get_ifaddrs(1814) : Input parameters: phy_id[5], nic_position:[1], is_all[0], interface num[2]
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.502.167 [rs_socket.c:1577]tid:618998,rs_connect_bind_client(1577) : client bind success. client family 2 addr 192.168.0.44:54845, fd:52
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.502.178 [topoinfo_detect.cc:534] [618985]NetworkManager start host net success! ip[192.168.0.44%enp67s0f5]
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.502.197 [rs_drv_socket.c:59]tid:618998,rs_drv_connect(59) : IP(192.168.0.44) port 60008 family 2 fd:52 begin
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.502.199 [ra_host.c:1764]tid:618985,ra_get_ifnum(1764) : Input parameters: phy_id[7], nic_position:[1], is_all:[0]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.208 [rs_socket.c:694]tid:618978,rs_tcp_recv_tag_in_handle(694) : recv tag success, server:{192.168.0.44:60008} client:192.168.0.44 time_cost:0.034000ms tag_sync_time:1 tag_eintr_time:0
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.502.205 [rs_socket.c:1392]tid:618994,rs_socket_tag_sync(1392) : [client]send tag success! ret:256, tag_sync_time:1, client_ip:192.168.0.44 server_ip:192.168.0.44 server_port:60008 tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.236 [rs_epoll.c:120]tid:618978,rs_wlist_check_conn_add(120) : [Server]chip_id 0, fd 55 accept, server ip:192.168.0.44, client ip:192.168.0.44, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.250 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:54, state:9, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.263 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:55, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.275 [rs_epoll.c:329]tid:618978,rs_epoll_event_in_handle(329) : the fd:51 is tcp listened, no need to go on, ret:0
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.502.293 [rs_socket.c:1577]tid:618990,rs_connect_bind_client(1577) : client bind success. client family 2 addr 192.168.0.44:37785, fd:52
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.502.312 [rs_drv_socket.c:98]tid:618998,rs_drv_connect(98) : client connect success. client family 2 addr 192.168.0.44:54845, server addr 192.168.0.44:60008, fd:52
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.322 [rs_socket.c:829]tid:618978,rs_epoll_event_listen_in_handle(829) : [server]server_ip:192.168.0.44 server_port:60008 accept ok @ listen_fd:51, new fd:56
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.502.325 [rs_drv_socket.c:59]tid:618990,rs_drv_connect(59) : IP(192.168.0.44) port 60008 family 2 fd:52 begin
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.502.333 [rs_socket.c:1427]tid:618998,rs_conn_cost_time(1427) : socket [52] connect success! cost [0.248000] ms
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.387 [rs_socket.c:694]tid:618978,rs_tcp_recv_tag_in_handle(694) : recv tag success, server:{192.168.0.44:60008} client:192.168.0.44 time_cost:0.046000ms tag_sync_time:1 tag_eintr_time:0
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.502.386 [rs_socket.c:1392]tid:618998,rs_socket_tag_sync(1392) : [client]send tag success! ret:256, tag_sync_time:1, client_ip:192.168.0.44 server_ip:192.168.0.44 server_port:60008 tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.502.393 [rs_drv_socket.c:98]tid:618990,rs_drv_connect(98) : client connect success. client family 2 addr 192.168.0.44:37785, server addr 192.168.0.44:60008, fd:52
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.406 [rs_epoll.c:120]tid:618978,rs_wlist_check_conn_add(120) : [Server]chip_id 0, fd 56 accept, server ip:192.168.0.44, client ip:192.168.0.44, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.421 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:54, state:9, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.502.415 [rs_socket.c:1427]tid:618990,rs_conn_cost_time(1427) : socket [52] connect success! cost [0.936000] ms
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.433 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:55, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.502.442 [rs_socket.c:1577]tid:619002,rs_connect_bind_client(1577) : client bind success. client family 2 addr 192.168.0.44:54069, fd:52
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.449 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:56, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.461 [rs_epoll.c:329]tid:618978,rs_epoll_event_in_handle(329) : the fd:51 is tcp listened, no need to go on, ret:0
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.502.458 [rs_socket.c:1392]tid:618990,rs_socket_tag_sync(1392) : [client]send tag success! ret:256, tag_sync_time:1, client_ip:192.168.0.44 server_ip:192.168.0.44 server_port:60008 tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.481 [rs_socket.c:829]tid:618978,rs_epoll_event_listen_in_handle(829) : [server]server_ip:192.168.0.44 server_port:60008 accept ok @ listen_fd:51, new fd:57
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.502.473 [rs_drv_socket.c:59]tid:619002,rs_drv_connect(59) : IP(192.168.0.44) port 60008 family 2 fd:52 begin
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.504 [rs_socket.c:694]tid:618978,rs_tcp_recv_tag_in_handle(694) : recv tag success, server:{192.168.0.44:60008} client:192.168.0.44 time_cost:0.006000ms tag_sync_time:1 tag_eintr_time:0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.502.504 [topoinfo_exchange_agent.cc:212] [618984]TopoInfoExchangeAgent get socket success.
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.520 [rs_epoll.c:120]tid:618978,rs_wlist_check_conn_add(120) : [Server]chip_id 0, fd 57 accept, server ip:192.168.0.44, client ip:192.168.0.44, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.502.523 [adapter_hccp.cc:1568] [618983][Get][DeviceIP]hrtGetIfAddress: idx[0] ifname[eth5] ip[29.105.72.114%eth5]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.533 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:54, state:9, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.502.540 [adapter_hccp.cc:1568] [618983][Get][DeviceIP]hrtGetIfAddress: idx[1] ifname[eth5] ip[fe80::2287:ecff:fe02:4618%eth5]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.546 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:55, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.502.554 [topoinfo_detect.cc:577] [618983]select AF_INET family as device socket family.
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.558 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:56, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.569 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:57, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.502.561 [rs_drv_socket.c:98]tid:619002,rs_drv_connect(98) : client connect success. client family 2 addr 192.168.0.44:54069, server addr 192.168.0.44:60008, fd:52
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.502.574 [topoinfo_detect.cc:756] [618983]no backup device ip: use 0 as device ip.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.502.566 [topoinfo_exchange_agent.cc:212] [618987]TopoInfoExchangeAgent get socket success.
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.584 [rs_epoll.c:329]tid:618978,rs_epoll_event_in_handle(329) : the fd:51 is tcp listened, no need to go on, ret:0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.502.576 [topoinfo_exchange_agent.cc:236] [618984]local rank[4] get socket connection with server[192.168.0.44] port[60008] success.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.502.588 [topoinfo_detect.cc:294] [618983][HCCL_TRACE]SetupAgent rankNum[8], rank[5], rootInfo identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], server[192.168.0.44%enp67s0f5], serverPort[60008]deviceType[2], logicDevId[5], phydevId[5], deviceIp[29.105.72.114]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.502.589 [adapter_hccp.cc:1538] [618985][Get][DeviceIP]hrtGetIfNum success. ifAddrNum[2].
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.502.584 [rs_socket.c:1427]tid:619002,rs_conn_cost_time(1427) : socket [52] connect success! cost [1.198000] ms
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.605 [rs_socket.c:829]tid:618978,rs_epoll_event_listen_in_handle(829) : [server]server_ip:192.168.0.44 server_port:60008 accept ok @ listen_fd:51, new fd:58
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.502.598 [topoinfo_exchange_agent.cc:43] [618984]TopoExchangeAgent: client connect with server ip[192.168.0.44] port[60008] success.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.502.616 [topoinfo_exchange_agent.cc:345] [618984]ConstructRankTableServerId serverId 192.168.0.44
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.502.614 [network_manager.cc:69] [618983]NetworkManager::GetInstance deviceLogicID[5].
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.502.629 [hccl_socket.cc:516] [618983][Get][NicHandleInfo]phyId[5], nicSocketMap[1] localIp[[192.168.0.44%enp67s0f5]
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.502.609 [ra_host.c:1814]tid:618985,ra_get_ifaddrs(1814) : Input parameters: phy_id[7], nic_position:[1], is_all[0], interface num[2]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.636 [rs_socket.c:694]tid:618978,rs_tcp_recv_tag_in_handle(694) : recv tag success, server:{192.168.0.44:60008} client:192.168.0.44 time_cost:0.014000ms tag_sync_time:1 tag_eintr_time:0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.502.641 [hccl_socket.cc:217] [618983][Connect] localIp[192.168.0.44%enp67s0f5], remoteIp[192.168.0.44], socket_handle[281468669502992], tag[topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008], port[60008]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.502.654 [adapter_hccp.cc:1050] [618983]batch conncet, port[60008] remoteip[7f7f7f7f]
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.502.635 [rs_socket.c:1392]tid:619002,rs_socket_tag_sync(1392) : [client]send tag success! ret:256, tag_sync_time:1, client_ip:192.168.0.44 server_ip:192.168.0.44 server_port:60008 tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.659 [rs_epoll.c:120]tid:618978,rs_wlist_check_conn_add(120) : [Server]chip_id 0, fd 58 accept, server ip:192.168.0.44, client ip:192.168.0.44, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.502.668 [ra_host.c:759]tid:618983,ra_socket_batch_connect(759) : Input parameters: [0]th, phy_id[5], local_ip[192.168.0.44], remote_ip[192.168.0.44], port[60008], tag[topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008], cnt[0]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.672 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:54, state:9, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.683 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:55, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.502.692 [rs_socket.c:1810]tid:618983,rs_socket_IP_convert(1810) : local IP[0xfffe2c00a8c0], ret:-1, remote IP[0xfffe2c00a8c0], ret:-1
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.694 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:56, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.502.691 [topoinfo_exchange_agent.cc:236] [618987]local rank[1] get socket connection with server[192.168.0.44] port[60008] success.
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.705 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:57, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.502.707 [rs_socket.c:1819]tid:618983,rs_socket_IP_convert(1819) : local IP[192.168.0.44], ret:0, remote IP[192.168.0.44], ret:-1
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.502.713 [topoinfo_exchange_agent.cc:43] [618987]TopoExchangeAgent: client connect with server ip[192.168.0.44] port[60008] success.
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.717 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:58, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.730 [rs_epoll.c:329]tid:618978,rs_epoll_event_in_handle(329) : the fd:51 is tcp listened, no need to go on, ret:0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.502.723 [topoinfo_exchange_agent.cc:77] [618984]topo exchange client send rank basic info success.
[WARNING] HCCP(618666,python3.9):2025-04-03-09:27:45.502.720 [rs_socket.c:132]tid:618983,rs_get_conn_info(132) : conn node for IP(192.168.0.44) server_port(60008) tag(topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008) not found
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.502.734 [rs_socket.c:1880]tid:618983,rs_socket_batch_connect(1880) : create conn node for {remote_ip(192.168.0.44), server_port(60008), tag(topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008)}!
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.502.732 [topoinfo_exchange_agent.cc:345] [618987]ConstructRankTableServerId serverId 192.168.0.44
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.502.849 [topoinfo_exchange_agent.cc:77] [618987]topo exchange client send rank basic info success.
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.502.860 [rs_socket.c:1577]tid:618993,rs_connect_bind_client(1577) : client bind success. client family 2 addr 192.168.0.44:40123, fd:52
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.502.889 [rs_drv_socket.c:59]tid:618993,rs_drv_connect(59) : IP(192.168.0.44) port 60008 family 2 fd:52 begin
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.502.955 [adapter_hccp.cc:1568] [618985][Get][DeviceIP]hrtGetIfAddress: idx[0] ifname[eth7] ip[29.105.73.96%eth7]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.502.965 [rs_socket.c:829]tid:618978,rs_epoll_event_listen_in_handle(829) : [server]server_ip:192.168.0.44 server_port:60008 accept ok @ listen_fd:51, new fd:59
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.502.955 [rs_drv_socket.c:98]tid:618993,rs_drv_connect(98) : client connect success. client family 2 addr 192.168.0.44:40123, server addr 192.168.0.44:60008, fd:52
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.502.979 [rs_socket.c:1427]tid:618993,rs_conn_cost_time(1427) : socket [52] connect success! cost [1.193000] ms
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.502.975 [adapter_hccp.cc:1568] [618985][Get][DeviceIP]hrtGetIfAddress: idx[1] ifname[eth7] ip[fe80::2287:ecff:fe02:45fa%eth7]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.502.993 [topoinfo_detect.cc:577] [618985]select AF_INET family as device socket family.
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.502.998 [rs_socket.c:1577]tid:618997,rs_connect_bind_client(1577) : client bind success. client family 2 addr 192.168.0.44:50643, fd:52
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.503.011 [topoinfo_detect.cc:756] [618985]no backup device ip: use 0 as device ip.
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.503.019 [rs_socket.c:694]tid:618978,rs_tcp_recv_tag_in_handle(694) : recv tag success, server:{192.168.0.44:60008} client:192.168.0.44 time_cost:0.033000ms tag_sync_time:1 tag_eintr_time:0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.503.025 [topoinfo_exchange_server.cc:130] [618980]listenSocket_->Accept completed.
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.503.017 [rs_socket.c:1392]tid:618993,rs_socket_tag_sync(1392) : [client]send tag success! ret:256, tag_sync_time:1, client_ip:192.168.0.44 server_ip:192.168.0.44 server_port:60008 tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.503.025 [rs_drv_socket.c:59]tid:618997,rs_drv_connect(59) : IP(192.168.0.44) port 60008 family 2 fd:52 begin
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.503.026 [topoinfo_detect.cc:294] [618985][HCCL_TRACE]SetupAgent rankNum[8], rank[7], rootInfo identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], server[192.168.0.44%enp67s0f5], serverPort[60008]deviceType[2], logicDevId[7], phydevId[7], deviceIp[29.105.73.96]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.503.038 [rs_epoll.c:120]tid:618978,rs_wlist_check_conn_add(120) : [Server]chip_id 0, fd 59 accept, server ip:192.168.0.44, client ip:192.168.0.44, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.503.051 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:54, state:9, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.503.053 [topoinfo_exchange_server.cc:226] [618980]get remote rank[0000000000000004 / 8] success.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.503.056 [network_manager.cc:69] [618985]NetworkManager::GetInstance deviceLogicID[7].
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.503.072 [hccl_socket.cc:516] [618985][Get][NicHandleInfo]phyId[7], nicSocketMap[1] localIp[[192.168.0.44%enp67s0f5]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.503.062 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:55, state:9, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.503.069 [hccl_socket.cc:342] [618980][Accept]localIp[192.168.0.44%enp67s0f5], remoteIp[0.0.0.0], socket_handle[0xfffe8c08cb40], tag[topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.503.074 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:56, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.503.081 [network_manager.cc:69] [618980]NetworkManager::GetInstance deviceLogicID[0].
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.503.087 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:57, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.503.093 [hccl_socket.cc:516] [618980][Get][NicHandleInfo]phyId[0], nicSocketMap[1] localIp[[192.168.0.44%enp67s0f5]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.503.089 [hccl_socket.cc:217] [618985][Connect] localIp[192.168.0.44%enp67s0f5], remoteIp[192.168.0.44], socket_handle[281468602394128], tag[topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008], port[60008]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.503.108 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:58, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.503.107 [rs_drv_socket.c:98]tid:618997,rs_drv_connect(98) : client connect success. client family 2 addr 192.168.0.44:50643, server addr 192.168.0.44:60008, fd:52
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.503.106 [adapter_hccp.cc:1050] [618985]batch conncet, port[60008] remoteip[7f7f7f7f]
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.503.123 [ra_host.c:759]tid:618985,ra_socket_batch_connect(759) : Input parameters: [0]th, phy_id[7], local_ip[192.168.0.44], remote_ip[192.168.0.44], port[60008], tag[topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008], cnt[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.503.116 [topoinfo_exchange_server.cc:130] [618980]listenSocket_->Accept completed.
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.503.124 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:59, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.503.136 [rs_epoll.c:329]tid:618978,rs_epoll_event_in_handle(329) : the fd:51 is tcp listened, no need to go on, ret:0
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.503.128 [rs_socket.c:1427]tid:618997,rs_conn_cost_time(1427) : socket [52] connect success! cost [0.393000] ms
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.503.153 [rs_socket.c:829]tid:618978,rs_epoll_event_listen_in_handle(829) : [server]server_ip:192.168.0.44 server_port:60008 accept ok @ listen_fd:51, new fd:60
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.503.151 [rs_socket.c:1810]tid:618985,rs_socket_IP_convert(1810) : local IP[0xfffe2c00a8c0], ret:-1, remote IP[0xfffe2c00a8c0], ret:-1
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.503.173 [rs_socket.c:694]tid:618978,rs_tcp_recv_tag_in_handle(694) : recv tag success, server:{192.168.0.44:60008} client:192.168.0.44 time_cost:0.002000ms tag_sync_time:1 tag_eintr_time:0
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.503.172 [rs_socket.c:1392]tid:618997,rs_socket_tag_sync(1392) : [client]send tag success! ret:256, tag_sync_time:1, client_ip:192.168.0.44 server_ip:192.168.0.44 server_port:60008 tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.503.172 [topoinfo_exchange_agent.cc:212] [618986]TopoInfoExchangeAgent get socket success.
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.503.192 [rs_epoll.c:120]tid:618978,rs_wlist_check_conn_add(120) : [Server]chip_id 0, fd 60 accept, server ip:192.168.0.44, client ip:192.168.0.44, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.503.172 [rs_socket.c:1819]tid:618985,rs_socket_IP_convert(1819) : local IP[192.168.0.44], ret:0, remote IP[192.168.0.44], ret:-1
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.503.206 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:54, state:9, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[WARNING] HCCP(618674,python3.9):2025-04-03-09:27:45.503.204 [rs_socket.c:132]tid:618985,rs_get_conn_info(132) : conn node for IP(192.168.0.44) server_port(60008) tag(topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008) not found
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.503.219 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:55, state:9, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.503.225 [rs_socket.c:1880]tid:618985,rs_socket_batch_connect(1880) : create conn node for {remote_ip(192.168.0.44), server_port(60008), tag(topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008)}!
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.503.231 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:56, state:9, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.503.243 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:57, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.503.237 [topoinfo_exchange_agent.cc:236] [618986]local rank[6] get socket connection with server[192.168.0.44] port[60008] success.
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.503.255 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:58, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.503.256 [topoinfo_exchange_agent.cc:43] [618986]TopoExchangeAgent: client connect with server ip[192.168.0.44] port[60008] success.
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.503.265 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:59, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.503.277 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:60, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.503.272 [topoinfo_exchange_agent.cc:345] [618986]ConstructRankTableServerId serverId 192.168.0.44
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.503.289 [rs_epoll.c:329]tid:618978,rs_epoll_event_in_handle(329) : the fd:51 is tcp listened, no need to go on, ret:0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.503.378 [topoinfo_exchange_agent.cc:77] [618986]topo exchange client send rank basic info success.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.503.542 [topoinfo_exchange_agent.cc:212] [618982]TopoInfoExchangeAgent get socket success.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.503.609 [topoinfo_exchange_agent.cc:236] [618982]local rank[3] get socket connection with server[192.168.0.44] port[60008] success.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.503.627 [topoinfo_exchange_agent.cc:43] [618982]TopoExchangeAgent: client connect with server ip[192.168.0.44] port[60008] success.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.503.645 [topoinfo_exchange_agent.cc:345] [618982]ConstructRankTableServerId serverId 192.168.0.44
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.503.741 [topoinfo_exchange_agent.cc:77] [618982]topo exchange client send rank basic info success.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.503.826 [topoinfo_exchange_agent.cc:212] [618983]TopoInfoExchangeAgent get socket success.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.503.890 [topoinfo_exchange_agent.cc:236] [618983]local rank[5] get socket connection with server[192.168.0.44] port[60008] success.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.503.906 [topoinfo_exchange_agent.cc:43] [618983]TopoExchangeAgent: client connect with server ip[192.168.0.44] port[60008] success.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.503.920 [topoinfo_exchange_agent.cc:345] [618983]ConstructRankTableServerId serverId 192.168.0.44
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.503.928 [topoinfo_exchange_agent.cc:212] [618988]TopoInfoExchangeAgent get socket success.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.503.996 [topoinfo_exchange_agent.cc:236] [618988]local rank[2] get socket connection with server[192.168.0.44] port[60008] success.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.504.015 [topoinfo_exchange_agent.cc:43] [618988]TopoExchangeAgent: client connect with server ip[192.168.0.44] port[60008] success.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.504.008 [topoinfo_exchange_agent.cc:77] [618983]topo exchange client send rank basic info success.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.504.033 [topoinfo_exchange_agent.cc:345] [618988]ConstructRankTableServerId serverId 192.168.0.44
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.504.123 [topoinfo_exchange_agent.cc:77] [618988]topo exchange client send rank basic info success.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.504.189 [topoinfo_exchange_server.cc:226] [618980]get remote rank[0000000000000006 / 8] success.
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.504.188 [rs_socket.c:1577]tid:619000,rs_connect_bind_client(1577) : client bind success. client family 2 addr 192.168.0.44:57641, fd:52
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.504.219 [rs_drv_socket.c:59]tid:619000,rs_drv_connect(59) : IP(192.168.0.44) port 60008 family 2 fd:52 begin
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.504.223 [hccl_socket.cc:342] [618980][Accept]localIp[192.168.0.44%enp67s0f5], remoteIp[0.0.0.0], socket_handle[0xfffe8c08cb40], tag[topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.504.239 [network_manager.cc:69] [618980]NetworkManager::GetInstance deviceLogicID[0].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.504.250 [hccl_socket.cc:516] [618980][Get][NicHandleInfo]phyId[0], nicSocketMap[1] localIp[[192.168.0.44%enp67s0f5]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.504.265 [topoinfo_exchange_server.cc:130] [618980]listenSocket_->Accept completed.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.504.282 [topoinfo_exchange_server.cc:226] [618980]get remote rank[0000000000000001 / 8] success.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.504.295 [hccl_socket.cc:342] [618980][Accept]localIp[192.168.0.44%enp67s0f5], remoteIp[0.0.0.0], socket_handle[0xfffe8c08cb40], tag[topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.504.301 [rs_socket.c:829]tid:618978,rs_epoll_event_listen_in_handle(829) : [server]server_ip:192.168.0.44 server_port:60008 accept ok @ listen_fd:51, new fd:61
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.504.307 [network_manager.cc:69] [618980]NetworkManager::GetInstance deviceLogicID[0].
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.504.293 [rs_drv_socket.c:98]tid:619000,rs_drv_connect(98) : client connect success. client family 2 addr 192.168.0.44:57641, server addr 192.168.0.44:60008, fd:52
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.504.322 [hccl_socket.cc:516] [618980][Get][NicHandleInfo]phyId[0], nicSocketMap[1] localIp[[192.168.0.44%enp67s0f5]
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.504.316 [rs_socket.c:1427]tid:619000,rs_conn_cost_time(1427) : socket [52] connect success! cost [1.091000] ms
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.504.338 [topoinfo_exchange_server.cc:130] [618980]listenSocket_->Accept completed.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.504.356 [topoinfo_exchange_server.cc:226] [618980]get remote rank[0000000000000003 / 8] success.
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.504.364 [rs_socket.c:694]tid:618978,rs_tcp_recv_tag_in_handle(694) : recv tag success, server:{192.168.0.44:60008} client:192.168.0.44 time_cost:0.043000ms tag_sync_time:1 tag_eintr_time:0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.504.369 [hccl_socket.cc:342] [618980][Accept]localIp[192.168.0.44%enp67s0f5], remoteIp[0.0.0.0], socket_handle[0xfffe8c08cb40], tag[topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008]
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.504.363 [rs_socket.c:1392]tid:619000,rs_socket_tag_sync(1392) : [client]send tag success! ret:256, tag_sync_time:1, client_ip:192.168.0.44 server_ip:192.168.0.44 server_port:60008 tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.504.383 [rs_epoll.c:120]tid:618978,rs_wlist_check_conn_add(120) : [Server]chip_id 0, fd 61 accept, server ip:192.168.0.44, client ip:192.168.0.44, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.504.387 [network_manager.cc:69] [618980]NetworkManager::GetInstance deviceLogicID[0].
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.504.396 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:54, state:9, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.504.402 [hccl_socket.cc:516] [618980][Get][NicHandleInfo]phyId[0], nicSocketMap[1] localIp[[192.168.0.44%enp67s0f5]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.504.408 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:55, state:9, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.504.416 [topoinfo_exchange_server.cc:130] [618980]listenSocket_->Accept completed.
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.504.421 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:56, state:9, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.504.432 [topoinfo_exchange_server.cc:226] [618980]get remote rank[0000000000000002 / 8] success.
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.504.432 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:57, state:9, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.504.445 [hccl_socket.cc:342] [618980][Accept]localIp[192.168.0.44%enp67s0f5], remoteIp[0.0.0.0], socket_handle[0xfffe8c08cb40], tag[topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.504.453 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:58, state:9, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.504.457 [network_manager.cc:69] [618980]NetworkManager::GetInstance deviceLogicID[0].
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.504.466 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:59, state:9, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.504.470 [hccl_socket.cc:516] [618980][Get][NicHandleInfo]phyId[0], nicSocketMap[1] localIp[[192.168.0.44%enp67s0f5]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.504.477 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:60, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.504.484 [topoinfo_exchange_server.cc:130] [618980]listenSocket_->Accept completed.
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.504.489 [rs_socket.c:62]tid:618978,show_conn_node(62) : current server ip: 192.168.0.44, client ip:192.168.0.44, fd:61, state:7, tag:topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.504.498 [topoinfo_exchange_server.cc:226] [618980]get remote rank[0000000000000005 / 8] success.
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.504.500 [rs_epoll.c:329]tid:618978,rs_epoll_event_in_handle(329) : the fd:51 is tcp listened, no need to go on, ret:0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.504.511 [hccl_socket.cc:342] [618980][Accept]localIp[192.168.0.44%enp67s0f5], remoteIp[0.0.0.0], socket_handle[0xfffe8c08cb40], tag[topo_detect_default_tag_192.168.0.44%enp67s0f5_60008_0_1743643662827273_60008]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.504.522 [network_manager.cc:69] [618980]NetworkManager::GetInstance deviceLogicID[0].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.504.532 [hccl_socket.cc:516] [618980][Get][NicHandleInfo]phyId[0], nicSocketMap[1] localIp[[192.168.0.44%enp67s0f5]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.504.547 [topoinfo_exchange_server.cc:130] [618980]listenSocket_->Accept completed.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.505.365 [topoinfo_exchange_agent.cc:212] [618985]TopoInfoExchangeAgent get socket success.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.505.422 [topoinfo_exchange_agent.cc:236] [618985]local rank[7] get socket connection with server[192.168.0.44] port[60008] success.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.505.440 [topoinfo_exchange_agent.cc:43] [618985]TopoExchangeAgent: client connect with server ip[192.168.0.44] port[60008] success.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.505.460 [topoinfo_exchange_agent.cc:345] [618985]ConstructRankTableServerId serverId 192.168.0.44
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.505.547 [topoinfo_exchange_agent.cc:77] [618985]topo exchange client send rank basic info success.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.505.618 [topoinfo_exchange_server.cc:226] [618980]get remote rank[0000000000000007 / 8] success.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.505.632 [topoinfo_exchange_server.cc:53] [618980]cluster topo exchange server connect with all agent success.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.505.668 [api_impl.cc:2096] 618980 HostMalloc: size=463
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.505.707 [api_error.cc:1260] 618980 HostMalloc: Host memory malloc succeed,size=463 , moduleId=3, host addr=0x12c0807f0000.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.505.832 [api_error.cc:1278] 618980 HostFree: Free host memory succeed, host addr=0x12c0807f0000.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.505.850 [topoinfo_exchange_server.cc:467] [618980]get rank basicInfo nicDeploy[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.505.863 [topoinfo_exchange_server.cc:479] [618980]get rank basicInfo serverNum[1] rankNum[1] deviceNum[1] superPodNum[0], nicDeploy[1].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.505.879 [topoinfo_exchange_server.cc:372] [618980]GetRankBasicInfo from agentId[0000000000000000] rankId[0] success.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.505.900 [api_impl.cc:2096] 618980 HostMalloc: size=461
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.505.916 [api_error.cc:1260] 618980 HostMalloc: Host memory malloc succeed,size=461 , moduleId=3, host addr=0x12c0807f0000.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.505.984 [api_error.cc:1278] 618980 HostFree: Free host memory succeed, host addr=0x12c0807f0000.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.506.000 [topoinfo_exchange_server.cc:479] [618980]get rank basicInfo serverNum[1] rankNum[2] deviceNum[2] superPodNum[0], nicDeploy[1].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.506.014 [topoinfo_exchange_server.cc:372] [618980]GetRankBasicInfo from agentId[0000000000000001] rankId[1] success.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.506.027 [api_impl.cc:2096] 618980 HostMalloc: size=461
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.506.040 [api_error.cc:1260] 618980 HostMalloc: Host memory malloc succeed,size=461 , moduleId=3, host addr=0x12c0807f0000.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.506.102 [api_error.cc:1278] 618980 HostFree: Free host memory succeed, host addr=0x12c0807f0000.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.506.118 [topoinfo_exchange_server.cc:479] [618980]get rank basicInfo serverNum[1] rankNum[3] deviceNum[3] superPodNum[0], nicDeploy[1].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.506.132 [topoinfo_exchange_server.cc:372] [618980]GetRankBasicInfo from agentId[0000000000000002] rankId[2] success.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.506.144 [api_impl.cc:2096] 618980 HostMalloc: size=461
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.506.157 [api_error.cc:1260] 618980 HostMalloc: Host memory malloc succeed,size=461 , moduleId=3, host addr=0x12c0807f0000.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.506.218 [api_error.cc:1278] 618980 HostFree: Free host memory succeed, host addr=0x12c0807f0000.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.506.232 [topoinfo_exchange_server.cc:479] [618980]get rank basicInfo serverNum[1] rankNum[4] deviceNum[4] superPodNum[0], nicDeploy[1].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.506.245 [topoinfo_exchange_server.cc:372] [618980]GetRankBasicInfo from agentId[0000000000000003] rankId[3] success.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.506.258 [api_impl.cc:2096] 618980 HostMalloc: size=461
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.506.270 [api_error.cc:1260] 618980 HostMalloc: Host memory malloc succeed,size=461 , moduleId=3, host addr=0x12c0807f0000.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.506.330 [api_error.cc:1278] 618980 HostFree: Free host memory succeed, host addr=0x12c0807f0000.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.506.347 [topoinfo_exchange_server.cc:479] [618980]get rank basicInfo serverNum[1] rankNum[5] deviceNum[5] superPodNum[0], nicDeploy[1].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.506.360 [topoinfo_exchange_server.cc:372] [618980]GetRankBasicInfo from agentId[0000000000000004] rankId[4] success.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.506.373 [api_impl.cc:2096] 618980 HostMalloc: size=461
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.506.385 [api_error.cc:1260] 618980 HostMalloc: Host memory malloc succeed,size=461 , moduleId=3, host addr=0x12c0807f0000.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.506.442 [api_error.cc:1278] 618980 HostFree: Free host memory succeed, host addr=0x12c0807f0000.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.506.457 [topoinfo_exchange_server.cc:479] [618980]get rank basicInfo serverNum[1] rankNum[6] deviceNum[6] superPodNum[0], nicDeploy[1].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.506.470 [topoinfo_exchange_server.cc:372] [618980]GetRankBasicInfo from agentId[0000000000000005] rankId[5] success.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.506.483 [api_impl.cc:2096] 618980 HostMalloc: size=461
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.506.501 [api_error.cc:1260] 618980 HostMalloc: Host memory malloc succeed,size=461 , moduleId=3, host addr=0x12c0807f0000.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.506.558 [api_error.cc:1278] 618980 HostFree: Free host memory succeed, host addr=0x12c0807f0000.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.506.571 [topoinfo_exchange_server.cc:479] [618980]get rank basicInfo serverNum[1] rankNum[7] deviceNum[7] superPodNum[0], nicDeploy[1].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.506.583 [topoinfo_exchange_server.cc:372] [618980]GetRankBasicInfo from agentId[0000000000000006] rankId[6] success.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.506.596 [api_impl.cc:2096] 618980 HostMalloc: size=460
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.506.610 [api_error.cc:1260] 618980 HostMalloc: Host memory malloc succeed,size=460 , moduleId=3, host addr=0x12c0807f0000.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.506.666 [api_error.cc:1278] 618980 HostFree: Free host memory succeed, host addr=0x12c0807f0000.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.506.680 [topoinfo_exchange_server.cc:479] [618980]get rank basicInfo serverNum[1] rankNum[8] deviceNum[8] superPodNum[0], nicDeploy[1].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.506.693 [topoinfo_exchange_server.cc:372] [618980]GetRankBasicInfo from agentId[0000000000000007] rankId[7] success.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.506.713 [topoinfo_exchange_server.cc:59] [618980]cluster topo exchange server get rank basic info from all agent success.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.506.728 [topoinfo_exchange_dispatcher.cc:43] [618980][TopoInfoExchangeDispather][InitWorkerThread]calculate threadNum[1], rankNum[8]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.507.199 [api_impl.cc:2096] 618983 HostMalloc: size=2485
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.507.235 [api_error.cc:1260] 618983 HostMalloc: Host memory malloc succeed,size=2485 , moduleId=3, host addr=0x12c0807f0000.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.507.238 [topoinfo_exchange_dispatcher.cc:230] [618980][TopoInfoExchangeDispather][ProcessSend]sendOnce success, start epoll_wait. sendDoneCount[8], rankNum[8].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.507.270 [topoinfo_exchange_dispatcher.cc:35] [618980]cluster topo exchange worker broadcast topoinfo success, rankNum[8], threadNum[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.507.284 [topoinfo_exchange_server.cc:65] [618980]cluster topo exchange server send rank basic info to all agent success.
[WARNING] HCCL(618646,python3.9):2025-04-03-09:27:45.507.297 [hccl_socket.cc:232] [618980][Close] socket's fdHandle is null, do not need close.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.507.308 [network_manager.cc:69] [618980]NetworkManager::GetInstance deviceLogicID[0].
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.507.327 [ra_host.c:911]tid:618980,ra_socket_listen_stop(911) : Input parameters: [0]th, phy_id[0], local_ip[192.168.0.44]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.507.317 [api_impl.cc:2096] 618988 HostMalloc: size=2485
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.507.345 [rs_socket.c:1262]tid:618980,rs_socket_listen_stop(1262) : listen [0] IP 0xffffffff2c00a8c0, ret_vnic -1
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.507.362 [rs_socket.c:746]tid:618980,rs_socket_listen_del_from_epoll(746) : IP:192.168.0.44 server_port:60008 listen_fd:51 del from epoll:49
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.507.365 [api_error.cc:1260] 618988 HostMalloc: Host memory malloc succeed,size=2485 , moduleId=3, host addr=0x12c0807f0000.
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.507.390 [rs_socket.c:1292]tid:618980,rs_socket_listen_stop(1292) : IP(192.168.0.44) close listen fd:51 !
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.507.407 [network_manager.cc:786] [618980]ip[192.168.0.44%enp67s0f5] port[60008] stop success.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.507.421 [hccl_socket.cc:68] [618980][HcclSocket][DeInit] device[0] stops listen on ip[192.168.0.44%enp67s0f5], port[60008] success, socketType[2].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.507.439 [topoinfo_exchange_dispatcher.cc:145] [618980][TopoInfoExchangeDispather][PrepareEpollResource]wake all workers.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.507.507 [api_error.cc:1278] 618983 HostFree: Free host memory succeed, host addr=0x12c0807f0000.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.507.523 [topoinfo_exchange_agent.cc:80] [618983]topo exchange client get rank basic info success.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.507.567 [topoinfo_exchange_server.cc:77] [618980]cluster topo exchange server completed, exit[0].
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.507.587 [topoinfo_detect.cc:303] [618983]topo detect completed. myrank[5], totalranks[8], myhost[192.168.0.44%enp67s0f5], totalservers[1].
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.507.584 [api_impl.cc:3419] 618980 DeviceReset: reset device, device_id=0.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.507.612 [config.cc:198] [618983]rank_table: "Unique deviceNum":"8", "Unique serverNum":"1", "para_plane_nic_location":"1", "para_plane_nic_num":"0";"para_plane_nic_name":[]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.507.620 [runtime.cc:3444] 618980 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x9, reset:0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.507.632 [api_impl.cc:3449] 618980 DeviceReset: Succ, userDeviceId=0.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.507.634 [config.cc:210] [618983]"device_information":{rankID[0],serverId[192.168.0.44],deviceId[0],deviceType[2],deviceIp[192.168.100.101],hostIp[192.168.0.44]},
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.507.624 [api_impl.cc:2096] 618986 HostMalloc: size=2485
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.507.650 [config.cc:210] [618983]{rankID[1],serverId[192.168.0.44],deviceId[1],deviceType[2],deviceIp[29.105.19.202],hostIp[192.168.0.44]},
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.507.663 [config.cc:210] [618983]{rankID[2],serverId[192.168.0.44],deviceId[2],deviceType[2],deviceIp[29.105.165.16],hostIp[192.168.0.44]},
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.507.675 [config.cc:210] [618983]{rankID[3],serverId[192.168.0.44],deviceId[3],deviceType[2],deviceIp[29.105.51.138],hostIp[192.168.0.44]},
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.507.666 [api_error.cc:1260] 618986 HostMalloc: Host memory malloc succeed,size=2485 , moduleId=3, host addr=0x12c0807f0000.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.507.689 [config.cc:210] [618983]{rankID[4],serverId[192.168.0.44],deviceId[4],deviceType[2],deviceIp[29.105.24.184],hostIp[192.168.0.44]},
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.507.679 [api_error.cc:1278] 618988 HostFree: Free host memory succeed, host addr=0x12c0807f0000.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.507.683 [api_impl.cc:2096] 618985 HostMalloc: size=2485
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.507.704 [config.cc:210] [618983]{rankID[5],serverId[192.168.0.44],deviceId[5],deviceType[2],deviceIp[29.105.72.114],hostIp[192.168.0.44]},
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.507.701 [topoinfo_exchange_agent.cc:80] [618988]topo exchange client get rank basic info success.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.507.727 [config.cc:210] [618983]{rankID[6],serverId[192.168.0.44],deviceId[6],deviceType[2],deviceIp[29.105.134.38],hostIp[192.168.0.44]},
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.507.723 [api_error.cc:1260] 618985 HostMalloc: Host memory malloc succeed,size=2485 , moduleId=3, host addr=0x12c0807f0000.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.507.741 [config.cc:210] [618983]{rankID[7],serverId[192.168.0.44],deviceId[7],deviceType[2],deviceIp[29.105.73.96],hostIp[192.168.0.44]},
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.507.757 [adapter_hccp.cc:1067] [618983]ra socket batch close fdhandle[0xfffe880fab50]
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.507.772 [ra_host.c:796]tid:618983,ra_socket_batch_close(796) : Input parameters: [0]th, phy_id[5], local_ip[192.168.0.44], cnt[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.507.778 [topoinfo_detect.cc:303] [618988]topo detect completed. myrank[2], totalranks[8], myhost[192.168.0.44%enp67s0f5], totalservers[1].
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.507.791 [rs_socket.c:1937]tid:618983,rs_socket_batch_close(1937) : conn node of IP(192.168.0.44) fd:52, state:9
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.507.810 [config.cc:198] [618988]rank_table: "Unique deviceNum":"8", "Unique serverNum":"1", "para_plane_nic_location":"1", "para_plane_nic_num":"0";"para_plane_nic_name":[]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.507.837 [config.cc:210] [618988]"device_information":{rankID[0],serverId[192.168.0.44],deviceId[0],deviceType[2],deviceIp[192.168.100.101],hostIp[192.168.0.44]},
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.507.855 [config.cc:210] [618988]{rankID[1],serverId[192.168.0.44],deviceId[1],deviceType[2],deviceIp[29.105.19.202],hostIp[192.168.0.44]},
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.507.868 [config.cc:210] [618988]{rankID[2],serverId[192.168.0.44],deviceId[2],deviceType[2],deviceIp[29.105.165.16],hostIp[192.168.0.44]},
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.507.895 [config.cc:210] [618988]{rankID[3],serverId[192.168.0.44],deviceId[3],deviceType[2],deviceIp[29.105.51.138],hostIp[192.168.0.44]},
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.507.908 [config.cc:210] [618988]{rankID[4],serverId[192.168.0.44],deviceId[4],deviceType[2],deviceIp[29.105.24.184],hostIp[192.168.0.44]},
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.507.924 [config.cc:210] [618988]{rankID[5],serverId[192.168.0.44],deviceId[5],deviceType[2],deviceIp[29.105.72.114],hostIp[192.168.0.44]},
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.507.938 [config.cc:210] [618988]{rankID[6],serverId[192.168.0.44],deviceId[6],deviceType[2],deviceIp[29.105.134.38],hostIp[192.168.0.44]},
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.507.954 [config.cc:210] [618988]{rankID[7],serverId[192.168.0.44],deviceId[7],deviceType[2],deviceIp[29.105.73.96],hostIp[192.168.0.44]},
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.507.970 [adapter_hccp.cc:1067] [618988]ra socket batch close fdhandle[0xfffe880fab50]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.507.982 [api_error.cc:1278] 618986 HostFree: Free host memory succeed, host addr=0x12c0807f0000.
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.507.989 [ra_host.c:796]tid:618988,ra_socket_batch_close(796) : Input parameters: [0]th, phy_id[2], local_ip[192.168.0.44], cnt[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.507.996 [api_error.cc:1278] 618985 HostFree: Free host memory succeed, host addr=0x12c0807f0000.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.507.992 [api_impl.cc:2096] 618982 HostMalloc: size=2485
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.508.001 [topoinfo_exchange_agent.cc:80] [618986]topo exchange client get rank basic info success.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.508.017 [topoinfo_exchange_agent.cc:80] [618985]topo exchange client get rank basic info success.
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.508.016 [rs_socket.c:1937]tid:618988,rs_socket_batch_close(1937) : conn node of IP(192.168.0.44) fd:52, state:9
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.508.032 [api_error.cc:1260] 618982 HostMalloc: Host memory malloc succeed,size=2485 , moduleId=3, host addr=0x12c0807f0000.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.508.025 [api_impl.cc:2096] 618984 HostMalloc: size=2485
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.508.060 [api_error.cc:1260] 618984 HostMalloc: Host memory malloc succeed,size=2485 , moduleId=3, host addr=0x12c0807f0000.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.508.063 [topoinfo_detect.cc:303] [618986]topo detect completed. myrank[6], totalranks[8], myhost[192.168.0.44%enp67s0f5], totalservers[1].
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.508.072 [topoinfo_detect.cc:303] [618985]topo detect completed. myrank[7], totalranks[8], myhost[192.168.0.44%enp67s0f5], totalservers[1].
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.508.093 [config.cc:198] [618986]rank_table: "Unique deviceNum":"8", "Unique serverNum":"1", "para_plane_nic_location":"1", "para_plane_nic_num":"0";"para_plane_nic_name":[]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.508.099 [config.cc:198] [618985]rank_table: "Unique deviceNum":"8", "Unique serverNum":"1", "para_plane_nic_location":"1", "para_plane_nic_num":"0";"para_plane_nic_name":[]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.508.118 [config.cc:210] [618986]"device_information":{rankID[0],serverId[192.168.0.44],deviceId[0],deviceType[2],deviceIp[192.168.100.101],hostIp[192.168.0.44]},
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.508.122 [config.cc:210] [618985]"device_information":{rankID[0],serverId[192.168.0.44],deviceId[0],deviceType[2],deviceIp[192.168.100.101],hostIp[192.168.0.44]},
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.508.134 [config.cc:210] [618986]{rankID[1],serverId[192.168.0.44],deviceId[1],deviceType[2],deviceIp[29.105.19.202],hostIp[192.168.0.44]},
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.508.132 [api_impl.cc:2096] 618981 HostMalloc: size=2485
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.508.140 [config.cc:210] [618985]{rankID[1],serverId[192.168.0.44],deviceId[1],deviceType[2],deviceIp[29.105.19.202],hostIp[192.168.0.44]},
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.508.149 [config.cc:210] [618986]{rankID[2],serverId[192.168.0.44],deviceId[2],deviceType[2],deviceIp[29.105.165.16],hostIp[192.168.0.44]},
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.508.185 [config.cc:210] [618986]{rankID[3],serverId[192.168.0.44],deviceId[3],deviceType[2],deviceIp[29.105.51.138],hostIp[192.168.0.44]},
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.508.167 [api_impl.cc:2096] 618987 HostMalloc: size=2485
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.508.169 [api_error.cc:1260] 618981 HostMalloc: Host memory malloc succeed,size=2485 , moduleId=3, host addr=0x12c0807f0000.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.508.155 [config.cc:210] [618985]{rankID[2],serverId[192.168.0.44],deviceId[2],deviceType[2],deviceIp[29.105.165.16],hostIp[192.168.0.44]},
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.508.189 [config.cc:210] [618985]{rankID[3],serverId[192.168.0.44],deviceId[3],deviceType[2],deviceIp[29.105.51.138],hostIp[192.168.0.44]},
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.508.205 [config.cc:210] [618986]{rankID[4],serverId[192.168.0.44],deviceId[4],deviceType[2],deviceIp[29.105.24.184],hostIp[192.168.0.44]},
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.508.221 [config.cc:210] [618986]{rankID[5],serverId[192.168.0.44],deviceId[5],deviceType[2],deviceIp[29.105.72.114],hostIp[192.168.0.44]},
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.508.216 [config.cc:210] [618985]{rankID[4],serverId[192.168.0.44],deviceId[4],deviceType[2],deviceIp[29.105.24.184],hostIp[192.168.0.44]},
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.508.232 [config.cc:210] [618985]{rankID[5],serverId[192.168.0.44],deviceId[5],deviceType[2],deviceIp[29.105.72.114],hostIp[192.168.0.44]},
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.508.244 [config.cc:210] [618985]{rankID[6],serverId[192.168.0.44],deviceId[6],deviceType[2],deviceIp[29.105.134.38],hostIp[192.168.0.44]},
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.508.235 [config.cc:210] [618986]{rankID[6],serverId[192.168.0.44],deviceId[6],deviceType[2],deviceIp[29.105.134.38],hostIp[192.168.0.44]},
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.508.249 [config.cc:210] [618986]{rankID[7],serverId[192.168.0.44],deviceId[7],deviceType[2],deviceIp[29.105.73.96],hostIp[192.168.0.44]},
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.508.259 [config.cc:210] [618985]{rankID[7],serverId[192.168.0.44],deviceId[7],deviceType[2],deviceIp[29.105.73.96],hostIp[192.168.0.44]},
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.508.263 [adapter_hccp.cc:1067] [618986]ra socket batch close fdhandle[0xfffea40fab50]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.508.274 [adapter_hccp.cc:1067] [618985]ra socket batch close fdhandle[0xfffe840fab50]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.508.248 [api_error.cc:1260] 618987 HostMalloc: Host memory malloc succeed,size=2485 , moduleId=3, host addr=0x12c0807f0000.
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.508.281 [ra_host.c:796]tid:618986,ra_socket_batch_close(796) : Input parameters: [0]th, phy_id[6], local_ip[192.168.0.44], cnt[0]
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.508.290 [ra_host.c:796]tid:618985,ra_socket_batch_close(796) : Input parameters: [0]th, phy_id[7], local_ip[192.168.0.44], cnt[0]
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.508.301 [rs_socket.c:1937]tid:618986,rs_socket_batch_close(1937) : conn node of IP(192.168.0.44) fd:52, state:9
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.508.309 [rs_socket.c:1937]tid:618985,rs_socket_batch_close(1937) : conn node of IP(192.168.0.44) fd:52, state:9
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.508.354 [api_error.cc:1278] 618982 HostFree: Free host memory succeed, host addr=0x12c0807f0000.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.508.381 [topoinfo_exchange_agent.cc:80] [618982]topo exchange client get rank basic info success.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.508.354 [api_error.cc:1278] 618984 HostFree: Free host memory succeed, host addr=0x12c0807f0000.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.508.378 [topoinfo_exchange_agent.cc:80] [618984]topo exchange client get rank basic info success.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.508.435 [topoinfo_detect.cc:303] [618984]topo detect completed. myrank[4], totalranks[8], myhost[192.168.0.44%enp67s0f5], totalservers[1].
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.508.444 [api_error.cc:1278] 618981 HostFree: Free host memory succeed, host addr=0x12c0807f0000.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.508.450 [topoinfo_detect.cc:303] [618982]topo detect completed. myrank[3], totalranks[8], myhost[192.168.0.44%enp67s0f5], totalservers[1].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.508.463 [topoinfo_exchange_agent.cc:80] [618981]topo exchange client get rank basic info success.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.508.462 [config.cc:198] [618984]rank_table: "Unique deviceNum":"8", "Unique serverNum":"1", "para_plane_nic_location":"1", "para_plane_nic_num":"0";"para_plane_nic_name":[]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.508.481 [config.cc:198] [618982]rank_table: "Unique deviceNum":"8", "Unique serverNum":"1", "para_plane_nic_location":"1", "para_plane_nic_num":"0";"para_plane_nic_name":[]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.508.486 [config.cc:210] [618984]"device_information":{rankID[0],serverId[192.168.0.44],deviceId[0],deviceType[2],deviceIp[192.168.100.101],hostIp[192.168.0.44]},
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.508.506 [config.cc:210] [618982]"device_information":{rankID[0],serverId[192.168.0.44],deviceId[0],deviceType[2],deviceIp[192.168.100.101],hostIp[192.168.0.44]},
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.508.516 [config.cc:210] [618984]{rankID[1],serverId[192.168.0.44],deviceId[1],deviceType[2],deviceIp[29.105.19.202],hostIp[192.168.0.44]},
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.508.517 [topoinfo_detect.cc:303] [618981]topo detect completed. myrank[0], totalranks[8], myhost[192.168.0.44%enp67s0f5], totalservers[1].
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.508.524 [config.cc:210] [618982]{rankID[1],serverId[192.168.0.44],deviceId[1],deviceType[2],deviceIp[29.105.19.202],hostIp[192.168.0.44]},
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.508.532 [config.cc:210] [618984]{rankID[2],serverId[192.168.0.44],deviceId[2],deviceType[2],deviceIp[29.105.165.16],hostIp[192.168.0.44]},
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.508.541 [config.cc:210] [618982]{rankID[2],serverId[192.168.0.44],deviceId[2],deviceType[2],deviceIp[29.105.165.16],hostIp[192.168.0.44]},
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.508.546 [topoinfo_detect.cc:242] [618981]topoExchangeServer[60008] compeleted.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.508.549 [config.cc:210] [618984]{rankID[3],serverId[192.168.0.44],deviceId[3],deviceType[2],deviceIp[29.105.51.138],hostIp[192.168.0.44]},
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.508.568 [config.cc:210] [618984]{rankID[4],serverId[192.168.0.44],deviceId[4],deviceType[2],deviceIp[29.105.24.184],hostIp[192.168.0.44]},
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.508.562 [config.cc:198] [618981]rank_table: "Unique deviceNum":"8", "Unique serverNum":"1", "para_plane_nic_location":"1", "para_plane_nic_num":"0";"para_plane_nic_name":[]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.508.558 [config.cc:210] [618982]{rankID[3],serverId[192.168.0.44],deviceId[3],deviceType[2],deviceIp[29.105.51.138],hostIp[192.168.0.44]},
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.508.583 [config.cc:210] [618981]"device_information":{rankID[0],serverId[192.168.0.44],deviceId[0],deviceType[2],deviceIp[192.168.100.101],hostIp[192.168.0.44]},
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.508.583 [config.cc:210] [618984]{rankID[5],serverId[192.168.0.44],deviceId[5],deviceType[2],deviceIp[29.105.72.114],hostIp[192.168.0.44]},
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.508.576 [api_error.cc:1278] 618987 HostFree: Free host memory succeed, host addr=0x12c0807f0000.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.508.589 [config.cc:210] [618982]{rankID[4],serverId[192.168.0.44],deviceId[4],deviceType[2],deviceIp[29.105.24.184],hostIp[192.168.0.44]},
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.508.600 [config.cc:210] [618981]{rankID[1],serverId[192.168.0.44],deviceId[1],deviceType[2],deviceIp[29.105.19.202],hostIp[192.168.0.44]},
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.508.599 [config.cc:210] [618984]{rankID[6],serverId[192.168.0.44],deviceId[6],deviceType[2],deviceIp[29.105.134.38],hostIp[192.168.0.44]},
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.508.615 [config.cc:210] [618984]{rankID[7],serverId[192.168.0.44],deviceId[7],deviceType[2],deviceIp[29.105.73.96],hostIp[192.168.0.44]},
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.508.600 [topoinfo_exchange_agent.cc:80] [618987]topo exchange client get rank basic info success.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.508.604 [config.cc:210] [618982]{rankID[5],serverId[192.168.0.44],deviceId[5],deviceType[2],deviceIp[29.105.72.114],hostIp[192.168.0.44]},
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.508.619 [config.cc:210] [618982]{rankID[6],serverId[192.168.0.44],deviceId[6],deviceType[2],deviceIp[29.105.134.38],hostIp[192.168.0.44]},
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.508.631 [config.cc:210] [618982]{rankID[7],serverId[192.168.0.44],deviceId[7],deviceType[2],deviceIp[29.105.73.96],hostIp[192.168.0.44]},
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.508.617 [config.cc:210] [618981]{rankID[2],serverId[192.168.0.44],deviceId[2],deviceType[2],deviceIp[29.105.165.16],hostIp[192.168.0.44]},
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.508.632 [config.cc:210] [618981]{rankID[3],serverId[192.168.0.44],deviceId[3],deviceType[2],deviceIp[29.105.51.138],hostIp[192.168.0.44]},
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.508.628 [adapter_hccp.cc:1067] [618984]ra socket batch close fdhandle[0xfffeb00fab50]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.508.650 [adapter_hccp.cc:1067] [618982]ra socket batch close fdhandle[0xfffeac0fab50]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.508.646 [config.cc:210] [618981]{rankID[4],serverId[192.168.0.44],deviceId[4],deviceType[2],deviceIp[29.105.24.184],hostIp[192.168.0.44]},
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.508.659 [config.cc:210] [618981]{rankID[5],serverId[192.168.0.44],deviceId[5],deviceType[2],deviceIp[29.105.72.114],hostIp[192.168.0.44]},
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.508.646 [ra_host.c:796]tid:618984,ra_socket_batch_close(796) : Input parameters: [0]th, phy_id[4], local_ip[192.168.0.44], cnt[0]
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.508.665 [rs_socket.c:1937]tid:618984,rs_socket_batch_close(1937) : conn node of IP(192.168.0.44) fd:52, state:9
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.508.670 [config.cc:210] [618981]{rankID[6],serverId[192.168.0.44],deviceId[6],deviceType[2],deviceIp[29.105.134.38],hostIp[192.168.0.44]},
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.508.663 [topoinfo_detect.cc:303] [618987]topo detect completed. myrank[1], totalranks[8], myhost[192.168.0.44%enp67s0f5], totalservers[1].
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.508.667 [ra_host.c:796]tid:618982,ra_socket_batch_close(796) : Input parameters: [0]th, phy_id[3], local_ip[192.168.0.44], cnt[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.508.683 [config.cc:210] [618981]{rankID[7],serverId[192.168.0.44],deviceId[7],deviceType[2],deviceIp[29.105.73.96],hostIp[192.168.0.44]},
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.508.690 [rs_socket.c:1937]tid:618982,rs_socket_batch_close(1937) : conn node of IP(192.168.0.44) fd:52, state:9
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.508.696 [adapter_hccp.cc:1067] [618981]ra socket batch close fdhandle[0xfffe700543a0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.508.692 [config.cc:198] [618987]rank_table: "Unique deviceNum":"8", "Unique serverNum":"1", "para_plane_nic_location":"1", "para_plane_nic_num":"0";"para_plane_nic_name":[]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.508.711 [ra_host.c:796]tid:618981,ra_socket_batch_close(796) : Input parameters: [0]th, phy_id[0], local_ip[192.168.0.44], cnt[0]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.508.725 [rs_socket.c:1937]tid:618981,rs_socket_batch_close(1937) : conn node of IP(192.168.0.44) fd:53, state:9
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.508.721 [config.cc:210] [618987]"device_information":{rankID[0],serverId[192.168.0.44],deviceId[0],deviceType[2],deviceIp[192.168.100.101],hostIp[192.168.0.44]},
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.508.758 [config.cc:210] [618987]{rankID[1],serverId[192.168.0.44],deviceId[1],deviceType[2],deviceIp[29.105.19.202],hostIp[192.168.0.44]},
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.508.772 [config.cc:210] [618987]{rankID[2],serverId[192.168.0.44],deviceId[2],deviceType[2],deviceIp[29.105.165.16],hostIp[192.168.0.44]},
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.508.787 [config.cc:210] [618987]{rankID[3],serverId[192.168.0.44],deviceId[3],deviceType[2],deviceIp[29.105.51.138],hostIp[192.168.0.44]},
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.508.804 [config.cc:210] [618987]{rankID[4],serverId[192.168.0.44],deviceId[4],deviceType[2],deviceIp[29.105.24.184],hostIp[192.168.0.44]},
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.508.821 [config.cc:210] [618987]{rankID[5],serverId[192.168.0.44],deviceId[5],deviceType[2],deviceIp[29.105.72.114],hostIp[192.168.0.44]},
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.508.838 [config.cc:210] [618987]{rankID[6],serverId[192.168.0.44],deviceId[6],deviceType[2],deviceIp[29.105.134.38],hostIp[192.168.0.44]},
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.508.852 [config.cc:210] [618987]{rankID[7],serverId[192.168.0.44],deviceId[7],deviceType[2],deviceIp[29.105.73.96],hostIp[192.168.0.44]},
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.508.868 [adapter_hccp.cc:1067] [618987]ra socket batch close fdhandle[0xfffeb80fab50]
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.508.886 [ra_host.c:796]tid:618987,ra_socket_batch_close(796) : Input parameters: [0]th, phy_id[1], local_ip[192.168.0.44], cnt[0]
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.508.907 [rs_socket.c:1937]tid:618987,rs_socket_batch_close(1937) : conn node of IP(192.168.0.44) fd:52, state:9
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:45.540.175 [trs_cb_event.c:119][ascend][curpid:618646,618836][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =64; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:45.540.182 [trs_cb_event.c:119][ascend][curpid:618646,618837][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =65; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:45.540.203 [trs_sqcq.c:1491][ascend][curpid:618646,618836][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:45.540.213 [trs_sqcq.c:1491][ascend][curpid:618646,618837][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:45.540.225 [npu_driver.cc:3833] 618836 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:45.540.240 [npu_driver.cc:3833] 618837 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:45.540.254 [api_impl.cc:5058] 618836 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:45.540.263 [api_impl.cc:5058] 618837 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:45.540.273 [callback.cpp:132]618836 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:45.540.281 [callback.cpp:132]618837 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:45.540.290 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:45.540.299 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.540.310 [npu_driver.cc:3828] 618836 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=64.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.540.319 [npu_driver.cc:3828] 618837 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=65.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.552.210 [adapter_hccp.cc:1099] [618983]ra socket batch close success,take time [44440]us
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.552.206 [adapter_hccp.cc:1099] [618988]ra socket batch close success,take time [44220]us
[WARNING] HCCL(618654,python3.9):2025-04-03-09:27:45.552.236 [hccl_socket.cc:232] [618988][Close] socket's fdHandle is null, do not need close.
[WARNING] HCCL(618666,python3.9):2025-04-03-09:27:45.552.238 [hccl_socket.cc:232] [618983][Close] socket's fdHandle is null, do not need close.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.552.256 [network_manager.cc:69] [618983]NetworkManager::GetInstance deviceLogicID[5].
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.552.261 [network_manager.cc:69] [618988]NetworkManager::GetInstance deviceLogicID[2].
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.552.276 [ra_host.c:404]tid:618983,ra_socket_deinit(404) : Input parameters: phy_id[5] family[2] local_ip[192.168.0.44]
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.552.284 [ra_host.c:404]tid:618988,ra_socket_deinit(404) : Input parameters: phy_id[2] family[2] local_ip[192.168.0.44]
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.552.296 [rs.c:1629]tid:618983,rs_socket_deinit(1629) : rs socket deinit start, phy_id:5
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.552.312 [rs.c:1641]tid:618983,rs_socket_deinit(1641) : socket deinit local IP is 0x2c00a8c0, ret:-1
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.552.304 [rs.c:1629]tid:618988,rs_socket_deinit(1629) : rs socket deinit start, phy_id:2
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.552.325 [rs.c:1641]tid:618988,rs_socket_deinit(1641) : socket deinit local IP is 0x2c00a8c0, ret:-1
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.552.330 [rs.c:1653]tid:618983,rs_socket_deinit(1653) : socket deinit success, phy_id:5, local_ip:192.168.0.44
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.552.346 [network_manager.cc:1233] [618983]ip[192.168.0.44%enp67s0f5] deinit success.
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.552.344 [rs.c:1653]tid:618988,rs_socket_deinit(1653) : socket deinit success, phy_id:2, local_ip:192.168.0.44
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.552.364 [network_manager.cc:1233] [618988]ip[192.168.0.44%enp67s0f5] deinit success.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.552.363 [network_manager.cc:69] [618983]NetworkManager::GetInstance deviceLogicID[5].
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.552.377 [ra_host.c:248]tid:618983,ra_deinit(248) : Input parameters: phy_id[5], nic_position:[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.552.381 [network_manager.cc:69] [618988]NetworkManager::GetInstance deviceLogicID[2].
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.552.391 [ra_peer.c:821]tid:618983,ra_peer_deinit(821) : [deinit][ra_peer]ra_peer_deinit phy_id[5] start
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.552.410 [rs.c:1783]tid:618983,rs_deinit(1783) : epoll wait up ok, rscb->conn_flag:1
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.552.399 [ra_host.c:248]tid:618988,ra_deinit(248) : Input parameters: phy_id[2], nic_position:[0]
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.552.418 [ra_peer.c:821]tid:618988,ra_peer_deinit(821) : [deinit][ra_peer]ra_peer_deinit phy_id[2] start
[WARNING] HCCP(618666,python3.9):2025-04-03-09:27:45.552.417 [rs_epoll.c:523]tid:618995,rs_epoll_handle(523) : <EPOLL> SHUT DOWN event!!! eventfd:50
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.552.442 [rs.c:1783]tid:618988,rs_deinit(1783) : epoll wait up ok, rscb->conn_flag:1
[WARNING] HCCP(618654,python3.9):2025-04-03-09:27:45.552.445 [rs_epoll.c:523]tid:618991,rs_epoll_handle(523) : <EPOLL> SHUT DOWN event!!! eventfd:50
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.552.448 [rs_epoll.c:544]tid:618995,rs_epoll_handle(544) : <EPOLL> QUIT thread_id:281468802690976, pid:618666, read num:8
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.552.471 [rs_epoll.c:544]tid:618991,rs_epoll_handle(544) : <EPOLL> QUIT thread_id:281469221728160, pid:618654, read num:8
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.556.198 [adapter_hccp.cc:1099] [618981]ra socket batch close success,take time [47488]us
[WARNING] HCCL(618646,python3.9):2025-04-03-09:27:45.556.225 [hccl_socket.cc:232] [618981][Close] socket's fdHandle is null, do not need close.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.556.194 [adapter_hccp.cc:1099] [618986]ra socket batch close success,take time [47915]us
[WARNING] HCCL(618670,python3.9):2025-04-03-09:27:45.556.218 [hccl_socket.cc:232] [618986][Close] socket's fdHandle is null, do not need close.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.556.198 [adapter_hccp.cc:1099] [618987]ra socket batch close success,take time [47314]us
[WARNING] HCCL(618650,python3.9):2025-04-03-09:27:45.556.222 [hccl_socket.cc:232] [618987][Close] socket's fdHandle is null, do not need close.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.556.196 [adapter_hccp.cc:1099] [618984]ra socket batch close success,take time [47552]us
[WARNING] HCCL(618662,python3.9):2025-04-03-09:27:45.556.220 [hccl_socket.cc:232] [618984][Close] socket's fdHandle is null, do not need close.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.556.236 [network_manager.cc:69] [618984]NetworkManager::GetInstance deviceLogicID[4].
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.556.196 [adapter_hccp.cc:1099] [618985]ra socket batch close success,take time [47907]us
[WARNING] HCCL(618674,python3.9):2025-04-03-09:27:45.556.228 [hccl_socket.cc:232] [618985][Close] socket's fdHandle is null, do not need close.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.556.209 [adapter_hccp.cc:1099] [618982]ra socket batch close success,take time [47545]us
[WARNING] HCCL(618658,python3.9):2025-04-03-09:27:45.556.232 [hccl_socket.cc:232] [618982][Close] socket's fdHandle is null, do not need close.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.556.236 [network_manager.cc:69] [618986]NetworkManager::GetInstance deviceLogicID[6].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.556.245 [network_manager.cc:69] [618981]NetworkManager::GetInstance deviceLogicID[0].
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.556.243 [network_manager.cc:69] [618987]NetworkManager::GetInstance deviceLogicID[1].
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.556.256 [ra_host.c:404]tid:618984,ra_socket_deinit(404) : Input parameters: phy_id[4] family[2] local_ip[192.168.0.44]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.556.250 [network_manager.cc:69] [618985]NetworkManager::GetInstance deviceLogicID[7].
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.556.267 [ra_host.c:404]tid:618985,ra_socket_deinit(404) : Input parameters: phy_id[7] family[2] local_ip[192.168.0.44]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.556.253 [network_manager.cc:69] [618982]NetworkManager::GetInstance deviceLogicID[3].
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.556.273 [ra_host.c:404]tid:618982,ra_socket_deinit(404) : Input parameters: phy_id[3] family[2] local_ip[192.168.0.44]
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.556.255 [ra_host.c:404]tid:618986,ra_socket_deinit(404) : Input parameters: phy_id[6] family[2] local_ip[192.168.0.44]
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.556.271 [rs.c:1629]tid:618986,rs_socket_deinit(1629) : rs socket deinit start, phy_id:6
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.556.283 [rs.c:1641]tid:618986,rs_socket_deinit(1641) : socket deinit local IP is 0x2c00a8c0, ret:-1
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.556.262 [network_manager.cc:69] [618981]NetworkManager::GetInstance deviceLogicID[0].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.556.274 [network_manager.cc:376] [618981]NetworkManager: deinit nic success, nicPosition[0] ref[1], skip.
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.556.260 [ra_host.c:404]tid:618987,ra_socket_deinit(404) : Input parameters: phy_id[1] family[2] local_ip[192.168.0.44]
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.556.278 [rs.c:1629]tid:618987,rs_socket_deinit(1629) : rs socket deinit start, phy_id:1
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.556.293 [rs.c:1641]tid:618987,rs_socket_deinit(1641) : socket deinit local IP is 0x2c00a8c0, ret:-1
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.556.272 [rs.c:1629]tid:618984,rs_socket_deinit(1629) : rs socket deinit start, phy_id:4
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.556.288 [rs.c:1641]tid:618984,rs_socket_deinit(1641) : socket deinit local IP is 0x2c00a8c0, ret:-1
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.556.301 [rs.c:1653]tid:618984,rs_socket_deinit(1653) : socket deinit success, phy_id:4, local_ip:192.168.0.44
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.556.280 [rs.c:1629]tid:618985,rs_socket_deinit(1629) : rs socket deinit start, phy_id:7
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.556.294 [rs.c:1641]tid:618985,rs_socket_deinit(1641) : socket deinit local IP is 0x2c00a8c0, ret:-1
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.556.311 [rs.c:1653]tid:618985,rs_socket_deinit(1653) : socket deinit success, phy_id:7, local_ip:192.168.0.44
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.556.291 [rs.c:1629]tid:618982,rs_socket_deinit(1629) : rs socket deinit start, phy_id:3
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.556.309 [rs.c:1641]tid:618982,rs_socket_deinit(1641) : socket deinit local IP is 0x2c00a8c0, ret:-1
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.556.300 [rs.c:1653]tid:618986,rs_socket_deinit(1653) : socket deinit success, phy_id:6, local_ip:192.168.0.44
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.556.314 [network_manager.cc:1233] [618986]ip[192.168.0.44%enp67s0f5] deinit success.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.556.327 [network_manager.cc:69] [618986]NetworkManager::GetInstance deviceLogicID[6].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.556.293 [network_manager.cc:69] [618981]NetworkManager::GetInstance deviceLogicID[0].
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.556.306 [ra_host.c:248]tid:618981,ra_deinit(248) : Input parameters: phy_id[0], nic_position:[1]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.556.320 [ra_hdc.c:651]tid:618981,ra_hdc_deinit(651) : hdc deinit start! phy_id[0]
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.556.340 [ra_host.c:248]tid:618986,ra_deinit(248) : Input parameters: phy_id[6], nic_position:[0]
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.556.355 [ra_peer.c:821]tid:618986,ra_peer_deinit(821) : [deinit][ra_peer]ra_peer_deinit phy_id[6] start
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.556.373 [rs.c:1783]tid:618986,rs_deinit(1783) : epoll wait up ok, rscb->conn_flag:1
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.556.308 [rs.c:1653]tid:618987,rs_socket_deinit(1653) : socket deinit success, phy_id:1, local_ip:192.168.0.44
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.556.325 [network_manager.cc:1233] [618987]ip[192.168.0.44%enp67s0f5] deinit success.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.556.337 [network_manager.cc:69] [618987]NetworkManager::GetInstance deviceLogicID[1].
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.556.348 [ra_host.c:248]tid:618987,ra_deinit(248) : Input parameters: phy_id[1], nic_position:[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.556.317 [network_manager.cc:1233] [618984]ip[192.168.0.44%enp67s0f5] deinit success.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.556.331 [network_manager.cc:69] [618984]NetworkManager::GetInstance deviceLogicID[4].
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.556.344 [ra_host.c:248]tid:618984,ra_deinit(248) : Input parameters: phy_id[4], nic_position:[0]
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.556.356 [ra_peer.c:821]tid:618984,ra_peer_deinit(821) : [deinit][ra_peer]ra_peer_deinit phy_id[4] start
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.556.326 [network_manager.cc:1233] [618985]ip[192.168.0.44%enp67s0f5] deinit success.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.556.340 [network_manager.cc:69] [618985]NetworkManager::GetInstance deviceLogicID[7].
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.556.350 [ra_host.c:248]tid:618985,ra_deinit(248) : Input parameters: phy_id[7], nic_position:[0]
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.556.362 [ra_peer.c:821]tid:618985,ra_peer_deinit(821) : [deinit][ra_peer]ra_peer_deinit phy_id[7] start
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.556.326 [rs.c:1653]tid:618982,rs_socket_deinit(1653) : socket deinit success, phy_id:3, local_ip:192.168.0.44
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.556.342 [network_manager.cc:1233] [618982]ip[192.168.0.44%enp67s0f5] deinit success.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.556.356 [network_manager.cc:69] [618982]NetworkManager::GetInstance deviceLogicID[3].
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.556.371 [ra_host.c:248]tid:618982,ra_deinit(248) : Input parameters: phy_id[3], nic_position:[0]
[WARNING] HCCP(618670,python3.9):2025-04-03-09:27:45.556.380 [rs_epoll.c:523]tid:618996,rs_epoll_handle(523) : <EPOLL> SHUT DOWN event!!! eventfd:50
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.556.359 [ra_peer.c:821]tid:618987,ra_peer_deinit(821) : [deinit][ra_peer]ra_peer_deinit phy_id[1] start
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.556.379 [rs.c:1783]tid:618987,rs_deinit(1783) : epoll wait up ok, rscb->conn_flag:1
[WARNING] HCCP(618650,python3.9):2025-04-03-09:27:45.556.388 [rs_epoll.c:523]tid:618989,rs_epoll_handle(523) : <EPOLL> SHUT DOWN event!!! eventfd:50
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.556.375 [rs.c:1783]tid:618984,rs_deinit(1783) : epoll wait up ok, rscb->conn_flag:1
[WARNING] HCCP(618662,python3.9):2025-04-03-09:27:45.556.381 [rs_epoll.c:523]tid:618992,rs_epoll_handle(523) : <EPOLL> SHUT DOWN event!!! eventfd:50
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.556.405 [rs_epoll.c:544]tid:618992,rs_epoll_handle(544) : <EPOLL> QUIT thread_id:281469892816800, pid:618662, read num:8
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.556.378 [rs.c:1783]tid:618985,rs_deinit(1783) : epoll wait up ok, rscb->conn_flag:1
[WARNING] HCCP(618674,python3.9):2025-04-03-09:27:45.556.383 [rs_epoll.c:523]tid:618999,rs_epoll_handle(523) : <EPOLL> SHUT DOWN event!!! eventfd:50
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.556.408 [rs_epoll.c:544]tid:618999,rs_epoll_handle(544) : <EPOLL> QUIT thread_id:281469163073440, pid:618674, read num:8
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.556.385 [ra_peer.c:821]tid:618982,ra_peer_deinit(821) : [deinit][ra_peer]ra_peer_deinit phy_id[3] start
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.556.410 [rs.c:1783]tid:618982,rs_deinit(1783) : epoll wait up ok, rscb->conn_flag:1
[WARNING] HCCP(618658,python3.9):2025-04-03-09:27:45.556.418 [rs_epoll.c:523]tid:619001,rs_epoll_handle(523) : <EPOLL> SHUT DOWN event!!! eventfd:50
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.556.408 [rs_epoll.c:544]tid:618996,rs_epoll_handle(544) : <EPOLL> QUIT thread_id:281469699944352, pid:618670, read num:8
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.556.417 [rs_epoll.c:544]tid:618989,rs_epoll_handle(544) : <EPOLL> QUIT thread_id:281470035488672, pid:618650, read num:8
[INFO] DRV(618646,python3.9):2025-04-03-09:27:45.556.455 [hdc_client.c:417][ascend][curpid:618646,618981][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4187)
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.556.445 [rs_epoll.c:544]tid:619001,rs_epoll_handle(544) : <EPOLL> QUIT thread_id:281469716852640, pid:618658, read num:8
[INFO] ROCE(618646,python3.9):2025-04-03-09:27:45.556.516 [dl_hal_function.c:199]dl_hal_deinit(199) : dl_hal_deinit success, no need to dlclose libascend_hal.so!
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:45.556.529 [ra_hdc.c:685]tid:618981,ra_hdc_deinit(685) : hdc deinit OK! phy_id[0]
[INFO] ROCE(618646,python3.9):2025-04-03-09:27:45.556.542 [dl_hal_function.c:199]dl_hal_deinit(199) : dl_hal_deinit success, no need to dlclose libascend_hal.so!
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.556.581 [tsd_client.cpp:189][TsdCapabilityGet][tid:618981] TsdCapabilityGet Begin.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.556.595 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618981] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.556.607 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618981] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.556.619 [process_mode_manager.cpp:1042][CapabilityGet][tid:618981] [ProcessModeManager] enter into CapabilityGet process deviceId[0] type[6]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.556.640 [adapter_tdt.cc:66] [618981]Get TsdCapability success. deviceLogicId[0]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.556.653 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618981] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.556.664 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618981] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.556.675 [process_mode_manager.cpp:1735][ProcessCloseSubProcList][tid:618981] enter ExcuteClosePidList cnt:1, tsdSupportLevel_:63
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.556.690 [process_mode_manager.cpp:1794][ExcuteClosePidList][tid:618981] add close subproc:31762, proctype:0
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.556.705 [version_verify.cpp:114][SpecialFeatureCheck][tid:618981] VersionVerify: previous type[60], supported
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.556.735 [hdc_client.cpp:154][TsdRecvData][tid:618981] recv timeout is:150000 ms
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:45.668.167 [trs_cb_event.c:119][ascend][curpid:618666,618808][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =64; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:45.668.170 [trs_cb_event.c:119][ascend][curpid:618666,618809][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =65; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:45.668.192 [trs_sqcq.c:1491][ascend][curpid:618666,618808][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:45.668.197 [trs_sqcq.c:1491][ascend][curpid:618666,618809][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:45.668.204 [npu_driver.cc:3833] 618808 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:45.668.209 [npu_driver.cc:3833] 618809 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:45.668.219 [api_impl.cc:5058] 618808 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:45.668.229 [api_impl.cc:5058] 618809 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:45.668.232 [callback.cpp:132]618808 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:45.668.240 [callback.cpp:132]618809 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:45.668.243 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:45.668.250 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.668.254 [npu_driver.cc:3828] 618808 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=64.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.668.262 [npu_driver.cc:3828] 618809 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=65.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:45.675.306 [awatchdog_monitor.c:160](tid:618680) thread 618980 not exist
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:45.700.165 [trs_cb_event.c:119][ascend][curpid:618658,618775][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =65; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:45.700.180 [trs_cb_event.c:119][ascend][curpid:618658,618774][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =64; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:45.700.184 [queue_client_comm.c:114][ascend][curpid:618658,618789][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:45.700.182 [queue_client_comm.c:114][ascend][curpid:618658,618783][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:45.700.184 [queue_client_comm.c:114][ascend][curpid:618658,618779][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:45.700.183 [queue_client_comm.c:114][ascend][curpid:618658,618781][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:45.700.188 [trs_sqcq.c:1491][ascend][curpid:618658,618775][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:45.700.186 [queue_client_comm.c:114][ascend][curpid:618658,618785][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:45.700.187 [queue_client_comm.c:114][ascend][curpid:618658,618787][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:45.700.205 [trs_sqcq.c:1491][ascend][curpid:618658,618774][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:45.700.276 [npu_driver.cc:3833] 618775 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:45.700.302 [npu_driver.cc:4338] 618789 MemQueuePeek: queue empty
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:45.700.313 [npu_driver.cc:3833] 618774 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:45.700.325 [api_impl.cc:5058] 618775 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:45.700.329 [npu_driver.cc:4338] 618783 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:45.700.334 [tensor_data_transfer.cpp:612]618789 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_histogram_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:45.700.364 [tensor_data_transfer.cpp:612]618783 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_tensor_summary
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:45.700.344 [api_impl.cc:5058] 618774 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:45.700.356 [callback.cpp:132]618775 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:45.700.363 [npu_driver.cc:4338] 618779 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:45.700.373 [tensor_data_transfer.cpp:1054]618789 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_histogram_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:45.700.382 [tensor_data_transfer.cpp:1054]618783 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_tensor_summary
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:45.700.390 [npu_driver.cc:4338] 618781 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:45.700.393 [callback.cpp:132]618774 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:45.700.403 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:45.700.413 [tensor_data_transfer.cpp:612]618779 acltdtReceiveTensorV2: queue is empty, device is 3, name is _npu_log
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:45.700.418 [tensor_data_transfer.cpp:1056]618789 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:45.700.417 [npu_driver.cc:4338] 618785 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:45.700.427 [tensor_data_transfer.cpp:1056]618783 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:45.700.437 [tensor_data_transfer.cpp:612]618781 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_tensor_dump
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:45.700.442 [npu_driver.cc:4338] 618787 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:45.700.446 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.700.459 [npu_driver.cc:3828] 618775 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=65.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:45.700.466 [tensor_data_transfer.cpp:1054]618779 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is _npu_log
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.700.478 [api_impl.cc:6121] 618789 MemQueuePeek: Start to peek queue on devId 3, qid is 5.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:45.700.503 [tensor_data_transfer.cpp:612]618785 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_image_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.700.515 [api_impl.cc:6121] 618783 MemQueuePeek: Start to peek queue on devId 3, qid is 2.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:45.700.521 [tensor_data_transfer.cpp:1054]618781 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_tensor_dump
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:45.700.533 [tensor_data_transfer.cpp:612]618787 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_scalar_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.700.545 [npu_driver.cc:3828] 618774 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=64.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:45.700.561 [tensor_data_transfer.cpp:1056]618779 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.700.571 [npu_driver.cc:4330] 618789 MemQueuePeek: peek mem queue, deviceId=3, qid=5, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.700.632 [api_impl.cc:6121] 618779 MemQueuePeek: Start to peek queue on devId 3, qid is 0.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:45.700.581 [tensor_data_transfer.cpp:1054]618785 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_image_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.700.592 [npu_driver.cc:4330] 618783 MemQueuePeek: peek mem queue, deviceId=3, qid=2, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:45.700.599 [tensor_data_transfer.cpp:1056]618781 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:45.700.610 [tensor_data_transfer.cpp:1054]618787 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_scalar_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.700.649 [npu_driver.cc:4330] 618779 MemQueuePeek: peek mem queue, deviceId=3, qid=0, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:45.700.659 [tensor_data_transfer.cpp:1056]618785 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.700.678 [api_impl.cc:6121] 618781 MemQueuePeek: Start to peek queue on devId 3, qid is 1.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:45.700.714 [tensor_data_transfer.cpp:1056]618787 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.700.736 [api_impl.cc:6121] 618785 MemQueuePeek: Start to peek queue on devId 3, qid is 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.700.746 [npu_driver.cc:4330] 618781 MemQueuePeek: peek mem queue, deviceId=3, qid=1, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.700.761 [npu_driver.cc:4330] 618785 MemQueuePeek: peek mem queue, deviceId=3, qid=3, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.700.756 [api_impl.cc:6121] 618787 MemQueuePeek: Start to peek queue on devId 3, qid is 4.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.700.812 [npu_driver.cc:4330] 618787 MemQueuePeek: peek mem queue, deviceId=3, qid=4, timeout=800.
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.712.586 [rs_epoll.c:679]tid:618994,rs_connect_handle(679) : <SOCKET> QUIT thread_id:281469473779616, pid:618662
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.712.872 [rs_epoll.c:679]tid:618998,rs_connect_handle(679) : <SOCKET> QUIT thread_id:281469691490208, pid:618670
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.713.001 [rs_epoll.c:679]tid:618990,rs_connect_handle(679) : <SOCKET> QUIT thread_id:281470027034528, pid:618650
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.713.068 [rs_epoll.c:679]tid:619002,rs_connect_handle(679) : <SOCKET> QUIT thread_id:281469708398496, pid:618658
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.713.435 [rs_epoll.c:679]tid:618993,rs_connect_handle(679) : <SOCKET> QUIT thread_id:281468802690976, pid:618654
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.713.634 [rs_epoll.c:679]tid:618997,rs_connect_handle(679) : <SOCKET> QUIT thread_id:281468794236832, pid:618666
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.714.812 [rs_epoll.c:679]tid:619000,rs_connect_handle(679) : <SOCKET> QUIT thread_id:281469154619296, pid:618674
[INFO] ROCE(618662,python3.9):2025-04-03-09:27:45.716.762 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.716.791 [rs.c:1810]tid:618984,rs_deinit(1810) : rs_deinit chip_id[4] ok
[INFO] ROCE(618650,python3.9):2025-04-03-09:27:45.716.764 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.716.804 [rs.c:1810]tid:618987,rs_deinit(1810) : rs_deinit chip_id[1] ok
[INFO] ROCE(618662,python3.9):2025-04-03-09:27:45.716.806 [dl_hal_function.c:199]dl_hal_deinit(199) : dl_hal_deinit success, no need to dlclose libascend_hal.so!
[INFO] ROCE(618650,python3.9):2025-04-03-09:27:45.716.820 [dl_hal_function.c:199]dl_hal_deinit(199) : dl_hal_deinit success, no need to dlclose libascend_hal.so!
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.716.821 [ra_peer.c:852]tid:618984,ra_peer_deinit(852) : [deinit][ra_peer]ra_peer_deinit phy_id[4] succ
[INFO] ROCE(618662,python3.9):2025-04-03-09:27:45.716.834 [dl_hal_function.c:199]dl_hal_deinit(199) : dl_hal_deinit success, no need to dlclose libascend_hal.so!
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.716.835 [ra_peer.c:852]tid:618987,ra_peer_deinit(852) : [deinit][ra_peer]ra_peer_deinit phy_id[1] succ
[INFO] ROCE(618670,python3.9):2025-04-03-09:27:45.716.825 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.716.846 [rs.c:1810]tid:618986,rs_deinit(1810) : rs_deinit chip_id[6] ok
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.716.857 [network_manager.cc:409] [618984]NetworkManager: deinit nic success, nicPosition[0] ref[0].
[INFO] ROCE(618650,python3.9):2025-04-03-09:27:45.716.849 [dl_hal_function.c:199]dl_hal_deinit(199) : dl_hal_deinit success, no need to dlclose libascend_hal.so!
[INFO] ROCE(618674,python3.9):2025-04-03-09:27:45.716.839 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.716.865 [rs.c:1810]tid:618985,rs_deinit(1810) : rs_deinit chip_id[7] ok
[INFO] ROCE(618670,python3.9):2025-04-03-09:27:45.716.859 [dl_hal_function.c:199]dl_hal_deinit(199) : dl_hal_deinit success, no need to dlclose libascend_hal.so!
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.716.873 [network_manager.cc:69] [618984]NetworkManager::GetInstance deviceLogicID[4].
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.716.876 [network_manager.cc:409] [618987]NetworkManager: deinit nic success, nicPosition[0] ref[0].
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.716.892 [network_manager.cc:69] [618987]NetworkManager::GetInstance deviceLogicID[1].
[INFO] ROCE(618674,python3.9):2025-04-03-09:27:45.716.881 [dl_hal_function.c:199]dl_hal_deinit(199) : dl_hal_deinit success, no need to dlclose libascend_hal.so!
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.716.895 [ra_peer.c:852]tid:618985,ra_peer_deinit(852) : [deinit][ra_peer]ra_peer_deinit phy_id[7] succ
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.716.885 [ra_peer.c:852]tid:618986,ra_peer_deinit(852) : [deinit][ra_peer]ra_peer_deinit phy_id[6] succ
[INFO] ROCE(618670,python3.9):2025-04-03-09:27:45.716.899 [dl_hal_function.c:199]dl_hal_deinit(199) : dl_hal_deinit success, no need to dlclose libascend_hal.so!
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.716.889 [ra_host.c:248]tid:618984,ra_deinit(248) : Input parameters: phy_id[4], nic_position:[1]
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.716.902 [ra_hdc.c:651]tid:618984,ra_hdc_deinit(651) : hdc deinit start! phy_id[4]
[INFO] ROCE(618658,python3.9):2025-04-03-09:27:45.716.885 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.716.913 [rs.c:1810]tid:618982,rs_deinit(1810) : rs_deinit chip_id[3] ok
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.716.906 [ra_host.c:248]tid:618987,ra_deinit(248) : Input parameters: phy_id[1], nic_position:[1]
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.716.918 [ra_hdc.c:651]tid:618987,ra_hdc_deinit(651) : hdc deinit start! phy_id[1]
[INFO] ROCE(618674,python3.9):2025-04-03-09:27:45.716.909 [dl_hal_function.c:199]dl_hal_deinit(199) : dl_hal_deinit success, no need to dlclose libascend_hal.so!
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.716.924 [network_manager.cc:409] [618986]NetworkManager: deinit nic success, nicPosition[0] ref[0].
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.716.952 [network_manager.cc:409] [618985]NetworkManager: deinit nic success, nicPosition[0] ref[0].
[INFO] ROCE(618658,python3.9):2025-04-03-09:27:45.716.931 [dl_hal_function.c:199]dl_hal_deinit(199) : dl_hal_deinit success, no need to dlclose libascend_hal.so!
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.716.945 [ra_peer.c:852]tid:618982,ra_peer_deinit(852) : [deinit][ra_peer]ra_peer_deinit phy_id[3] succ
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.716.939 [network_manager.cc:69] [618986]NetworkManager::GetInstance deviceLogicID[6].
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.716.953 [ra_host.c:248]tid:618986,ra_deinit(248) : Input parameters: phy_id[6], nic_position:[1]
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.716.967 [ra_hdc.c:651]tid:618986,ra_hdc_deinit(651) : hdc deinit start! phy_id[6]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.716.970 [network_manager.cc:69] [618985]NetworkManager::GetInstance deviceLogicID[7].
[INFO] ROCE(618658,python3.9):2025-04-03-09:27:45.716.959 [dl_hal_function.c:199]dl_hal_deinit(199) : dl_hal_deinit success, no need to dlclose libascend_hal.so!
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.716.986 [ra_host.c:248]tid:618985,ra_deinit(248) : Input parameters: phy_id[7], nic_position:[1]
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.716.998 [ra_hdc.c:651]tid:618985,ra_hdc_deinit(651) : hdc deinit start! phy_id[7]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.717.008 [network_manager.cc:409] [618982]NetworkManager: deinit nic success, nicPosition[0] ref[0].
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.717.025 [network_manager.cc:69] [618982]NetworkManager::GetInstance deviceLogicID[3].
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.717.039 [ra_host.c:248]tid:618982,ra_deinit(248) : Input parameters: phy_id[3], nic_position:[1]
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.717.054 [ra_hdc.c:651]tid:618982,ra_hdc_deinit(651) : hdc deinit start! phy_id[3]
[INFO] DRV(618662,python3.9):2025-04-03-09:27:45.717.055 [hdc_client.c:417][ascend][curpid:618662,618984][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4188)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:45.717.073 [hdc_client.c:417][ascend][curpid:618650,618987][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4189)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:45.717.117 [hdc_client.c:417][ascend][curpid:618670,618986][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4192)
[INFO] ROCE(618662,python3.9):2025-04-03-09:27:45.717.122 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] ROCE(618650,python3.9):2025-04-03-09:27:45.717.122 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:45.717.138 [ra_hdc.c:685]tid:618984,ra_hdc_deinit(685) : hdc deinit OK! phy_id[4]
[INFO] ROCE(618662,python3.9):2025-04-03-09:27:45.717.153 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] DRV(618674,python3.9):2025-04-03-09:27:45.717.144 [hdc_client.c:417][ascend][curpid:618674,618985][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4194)
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:45.717.140 [ra_hdc.c:685]tid:618987,ra_hdc_deinit(685) : hdc deinit OK! phy_id[1]
[INFO] ROCE(618650,python3.9):2025-04-03-09:27:45.717.154 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.717.175 [tsd_client.cpp:189][TsdCapabilityGet][tid:618984] TsdCapabilityGet Begin.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.717.177 [tsd_client.cpp:189][TsdCapabilityGet][tid:618987] TsdCapabilityGet Begin.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.717.192 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618987] [TsdClient] g_userDeviceInfo is empty.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:45.717.187 [hdc_client.c:417][ascend][curpid:618658,618982][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4190)
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.717.191 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618984] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.717.206 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618984] [TsdClient] g_userDeviceInfo is empty.
[INFO] ROCE(618670,python3.9):2025-04-03-09:27:45.717.182 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:45.717.210 [ra_hdc.c:685]tid:618986,ra_hdc_deinit(685) : hdc deinit OK! phy_id[6]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.717.207 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618987] [TsdClient] g_userDeviceInfo is empty.
[INFO] ROCE(618674,python3.9):2025-04-03-09:27:45.717.198 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:45.717.215 [ra_hdc.c:685]tid:618985,ra_hdc_deinit(685) : hdc deinit OK! phy_id[7]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.717.219 [process_mode_manager.cpp:1042][CapabilityGet][tid:618984] [ProcessModeManager] enter into CapabilityGet process deviceId[4] type[6]
[INFO] ROCE(618670,python3.9):2025-04-03-09:27:45.717.225 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.717.219 [process_mode_manager.cpp:1042][CapabilityGet][tid:618987] [ProcessModeManager] enter into CapabilityGet process deviceId[1] type[6]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.717.234 [adapter_tdt.cc:66] [618987]Get TsdCapability success. deviceLogicId[1]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.717.246 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618987] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.717.256 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618987] [TsdClient] g_userDeviceInfo is empty.
[INFO] ROCE(618674,python3.9):2025-04-03-09:27:45.717.229 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.717.252 [tsd_client.cpp:189][TsdCapabilityGet][tid:618985] TsdCapabilityGet Begin.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.717.265 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618985] [TsdClient] g_userDeviceInfo is empty.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.717.232 [adapter_tdt.cc:66] [618984]Get TsdCapability success. deviceLogicId[4]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.717.246 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618984] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.717.257 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618984] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.717.267 [process_mode_manager.cpp:1735][ProcessCloseSubProcList][tid:618984] enter ExcuteClosePidList cnt:1, tsdSupportLevel_:63
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.717.248 [tsd_client.cpp:189][TsdCapabilityGet][tid:618986] TsdCapabilityGet Begin.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.717.263 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618986] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.717.275 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618986] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.717.268 [process_mode_manager.cpp:1735][ProcessCloseSubProcList][tid:618987] enter ExcuteClosePidList cnt:1, tsdSupportLevel_:63
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.717.284 [process_mode_manager.cpp:1794][ExcuteClosePidList][tid:618987] add close subproc:30511, proctype:0
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.717.278 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618985] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.717.290 [process_mode_manager.cpp:1042][CapabilityGet][tid:618985] [ProcessModeManager] enter into CapabilityGet process deviceId[7] type[6]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.717.283 [process_mode_manager.cpp:1794][ExcuteClosePidList][tid:618984] add close subproc:29683, proctype:0
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.717.298 [version_verify.cpp:114][SpecialFeatureCheck][tid:618984] VersionVerify: previous type[60], supported
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.717.287 [process_mode_manager.cpp:1042][CapabilityGet][tid:618986] [ProcessModeManager] enter into CapabilityGet process deviceId[6] type[6]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.717.303 [adapter_tdt.cc:66] [618986]Get TsdCapability success. deviceLogicId[6]
[INFO] ROCE(618658,python3.9):2025-04-03-09:27:45.717.298 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.717.297 [version_verify.cpp:114][SpecialFeatureCheck][tid:618987] VersionVerify: previous type[60], supported
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.717.305 [adapter_tdt.cc:66] [618985]Get TsdCapability success. deviceLogicId[7]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.717.318 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618985] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.717.326 [hdc_client.cpp:154][TsdRecvData][tid:618984] recv timeout is:150000 ms
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.717.315 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618986] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.717.328 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618986] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.717.339 [process_mode_manager.cpp:1735][ProcessCloseSubProcList][tid:618986] enter ExcuteClosePidList cnt:1, tsdSupportLevel_:63
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.717.353 [process_mode_manager.cpp:1794][ExcuteClosePidList][tid:618986] add close subproc:29770, proctype:0
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:45.717.314 [ra_hdc.c:685]tid:618982,ra_hdc_deinit(685) : hdc deinit OK! phy_id[3]
[INFO] ROCE(618658,python3.9):2025-04-03-09:27:45.717.329 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.717.363 [tsd_client.cpp:189][TsdCapabilityGet][tid:618982] TsdCapabilityGet Begin.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.717.327 [hdc_client.cpp:154][TsdRecvData][tid:618987] recv timeout is:150000 ms
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.717.331 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618985] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.717.345 [process_mode_manager.cpp:1735][ProcessCloseSubProcList][tid:618985] enter ExcuteClosePidList cnt:1, tsdSupportLevel_:63
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.717.359 [process_mode_manager.cpp:1794][ExcuteClosePidList][tid:618985] add close subproc:29960, proctype:0
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.717.372 [version_verify.cpp:114][SpecialFeatureCheck][tid:618985] VersionVerify: previous type[60], supported
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.717.368 [version_verify.cpp:114][SpecialFeatureCheck][tid:618986] VersionVerify: previous type[60], supported
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.717.377 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618982] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.717.390 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618982] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.717.398 [hdc_client.cpp:154][TsdRecvData][tid:618985] recv timeout is:150000 ms
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.717.394 [hdc_client.cpp:154][TsdRecvData][tid:618986] recv timeout is:150000 ms
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.717.403 [process_mode_manager.cpp:1042][CapabilityGet][tid:618982] [ProcessModeManager] enter into CapabilityGet process deviceId[3] type[6]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.717.418 [adapter_tdt.cc:66] [618982]Get TsdCapability success. deviceLogicId[3]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.717.430 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618982] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.717.441 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618982] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.717.453 [process_mode_manager.cpp:1735][ProcessCloseSubProcList][tid:618982] enter ExcuteClosePidList cnt:1, tsdSupportLevel_:63
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.717.473 [process_mode_manager.cpp:1794][ExcuteClosePidList][tid:618982] add close subproc:30134, proctype:0
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.717.490 [version_verify.cpp:114][SpecialFeatureCheck][tid:618982] VersionVerify: previous type[60], supported
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.717.530 [hdc_client.cpp:154][TsdRecvData][tid:618982] recv timeout is:150000 ms
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:45.732.175 [trs_cb_event.c:119][ascend][curpid:618674,618819][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =65; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:45.732.179 [trs_cb_event.c:119][ascend][curpid:618674,618818][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =64; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:45.732.172 [trs_cb_event.c:119][ascend][curpid:618662,618817][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =833; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:45.732.172 [trs_cb_event.c:119][ascend][curpid:618662,618816][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =832; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:45.732.199 [trs_sqcq.c:1491][ascend][curpid:618662,618817][drv][WARNING] DRV(618674,python3.9):2025-04-03-09:27:45.732.206 [trs_sqcq.c:1491][ascend][curpid:618674,618819][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:45.732.218 [trs_sqcq.c:1491][ascend][curpid:618674,618818][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:45.732.229 [npu_driver.cc:3833] 618819 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=65, drvRetCode=16.
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:45.732.205 [trs_sqcq.c:1491][ascend][curpid:618662,618816][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:45.732.241 [npu_driver.cc:3833] 618817 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=833, drvRetCode=16.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:45.732.238 [npu_driver.cc:3833] 618818 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:45.732.252 [npu_driver.cc:3833] 618816 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=832, drvRetCode=16.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:45.732.260 [api_impl.cc:5058] 618817 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:45.732.248 [api_impl.cc:5058] 618819 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:45.732.266 [api_impl.cc:5058] 618816 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:45.732.272 [api_impl.cc:5058] 618818 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:45.732.275 [callback.cpp:132]618817 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:45.732.286 [callback.cpp:132]618816 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:45.732.283 [callback.cpp:132]618819 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:45.732.291 [callback.cpp:132]618818 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:45.732.295 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:45.732.301 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:45.732.302 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.732.313 [npu_driver.cc:3828] 618817 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=833.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.732.319 [npu_driver.cc:3828] 618816 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=832.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:45.732.313 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.732.326 [npu_driver.cc:3828] 618819 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=65.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.732.335 [npu_driver.cc:3828] 618818 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=64.
[INFO] ROCE(618666,python3.9):2025-04-03-09:27:45.732.891 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.732.911 [rs.c:1810]tid:618983,rs_deinit(1810) : rs_deinit chip_id[5] ok
[INFO] ROCE(618666,python3.9):2025-04-03-09:27:45.732.924 [dl_hal_function.c:199]dl_hal_deinit(199) : dl_hal_deinit success, no need to dlclose libascend_hal.so!
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.732.936 [ra_peer.c:852]tid:618983,ra_peer_deinit(852) : [deinit][ra_peer]ra_peer_deinit phy_id[5] succ
[INFO] ROCE(618654,python3.9):2025-04-03-09:27:45.732.923 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.732.945 [rs.c:1810]tid:618988,rs_deinit(1810) : rs_deinit chip_id[2] ok
[INFO] ROCE(618666,python3.9):2025-04-03-09:27:45.732.949 [dl_hal_function.c:199]dl_hal_deinit(199) : dl_hal_deinit success, no need to dlclose libascend_hal.so!
[INFO] ROCE(618654,[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.732.978 [network_manager.cc:409] [618983]NetworkManager: deinit nic success, nicPosition[0] ref[0].
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.732.994 [network_manager.cc:69] [618983]NetworkManager::GetInstance deviceLogicID[5].
python3.9):2025-04-03-09:27:45.732.964 [dl_hal_function.c:199]dl_hal_deinit(199) : dl_hal_deinit success, no need to dlclose libascend_hal.so!
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.733.008 [ra_peer.c:852]tid:618988,ra_peer_deinit(852) : [deinit][ra_peer]ra_peer_deinit phy_id[2] succ
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.733.010 [ra_host.c:248]tid:618983,ra_deinit(248) : Input parameters: phy_id[5], nic_position:[1]
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.733.022 [ra_hdc.c:651]tid:618983,ra_hdc_deinit(651) : hdc deinit start! phy_id[5]
[INFO] ROCE(618654,python3.9):2025-04-03-09:27:45.733.027 [dl_hal_function.c:199]dl_hal_deinit(199) : dl_hal_deinit success, no need to dlclose libascend_hal.so!
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.733.063 [network_manager.cc:409] [618988]NetworkManager: deinit nic success, nicPosition[0] ref[0].
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.733.083 [network_manager.cc:69] [618988]NetworkManager::GetInstance deviceLogicID[2].
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.733.101 [ra_host.c:248]tid:618988,ra_deinit(248) : Input parameters: phy_id[2], nic_position:[1]
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.733.118 [ra_hdc.c:651]tid:618988,ra_hdc_deinit(651) : hdc deinit start! phy_id[2]
[INFO] DRV(618666,python3.9):2025-04-03-09:27:45.733.165 [hdc_client.c:417][ascend][curpid:618666,618983][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4193)
[INFO] ROCE(618666,python3.9):2025-04-03-09:27:45.733.221 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:45.733.234 [ra_hdc.c:685]tid:618983,ra_hdc_deinit(685) : hdc deinit OK! phy_id[5]
[INFO] ROCE(618666,python3.9):2025-04-03-09:27:45.733.246 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.733.268 [tsd_client.cpp:189][TsdCapabilityGet][tid:618983] TsdCapabilityGet Begin.
[INFO] DRV(618654,python3.9):2025-04-03-09:27:45.733.262 [hdc_client.c:417][ascend][curpid:618654,618988][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4191)
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.733.283 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618983] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.733.295 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618983] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.733.306 [process_mode_manager.cpp:1042][CapabilityGet][tid:618983] [ProcessModeManager] enter into CapabilityGet process deviceId[5] type[6]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.733.319 [adapter_tdt.cc:66] [618983]Get TsdCapability success. deviceLogicId[5]
[INFO] ROCE(618654,python3.9):2025-04-03-09:27:45.733.312 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:45.733.330 [ra_hdc.c:685]tid:618988,ra_hdc_deinit(685) : hdc deinit OK! phy_id[2]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.733.333 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618983] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.733.353 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618983] [TsdClient] g_userDeviceInfo is empty.
[INFO] ROCE(618654,python3.9):2025-04-03-09:27:45.733.347 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.733.366 [process_mode_manager.cpp:1735][ProcessCloseSubProcList][tid:618983] enter ExcuteClosePidList cnt:1, tsdSupportLevel_:63
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.733.380 [process_mode_manager.cpp:1794][ExcuteClosePidList][tid:618983] add close subproc:30089, proctype:0
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.733.374 [tsd_client.cpp:189][TsdCapabilityGet][tid:618988] TsdCapabilityGet Begin.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.733.392 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618988] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.733.396 [version_verify.cpp:114][SpecialFeatureCheck][tid:618983] VersionVerify: previous type[60], supported
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.733.408 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618988] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.733.423 [hdc_client.cpp:154][TsdRecvData][tid:618983] recv timeout is:150000 ms
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.733.425 [process_mode_manager.cpp:1042][CapabilityGet][tid:618988] [ProcessModeManager] enter into CapabilityGet process deviceId[2] type[6]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.733.444 [adapter_tdt.cc:66] [618988]Get TsdCapability success. deviceLogicId[2]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.733.459 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618988] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.733.474 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618988] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.733.486 [process_mode_manager.cpp:1735][ProcessCloseSubProcList][tid:618988] enter ExcuteClosePidList cnt:1, tsdSupportLevel_:63
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.733.502 [process_mode_manager.cpp:1794][ExcuteClosePidList][tid:618988] add close subproc:5093, proctype:0
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.733.520 [version_verify.cpp:114][SpecialFeatureCheck][tid:618988] VersionVerify: previous type[60], supported
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.733.546 [hdc_client.cpp:154][TsdRecvData][tid:618988] recv timeout is:150000 ms
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.748.559 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618981] [ServerToClientMsgProc] [sessionID=1]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.748.579 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618981] [TsdClient] DeviceMsgProc recvMsg realDeviceId[0] msgType[61] localDevId[0] rspCode[0]heterogeneousSubPid[31762], tsdSupportLevel_[63]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.748.593 [hdc_client.cpp:172][TsdRecvData][tid:618981] [deviceId=0] the Tsd recv data already
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.748.604 [process_mode_manager.cpp:1809][ExcuteClosePidList][tid:618981] leave ExcuteClosePidList startindex:0, cnt:1
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.748.616 [process_mode_manager.cpp:1769][ProcessCloseSubProcList][tid:618981] ExcuteClosePidList success reserveCnt:1
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.748.628 [adapter_tdt.cc:52] [618981]Open TsdProcess success. deviceLogicId[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.748.639 [network_manager.cc:405] [618981][DeInit]finish CloseHccpProcess, phy_id[0], hdc_type[18], nicDeployment[1], hasBackup[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.748.651 [network_manager.cc:409] [618981]NetworkManager: deinit nic success, nicPosition[1] ref[0].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.748.662 [topoinfo_detect.cc:555] [618981]NetworkManager stop host net success! ip[192.168.0.44%enp67s0f5] 
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.748.673 [topoinfo_detect.cc:321] [618981]TopoInfoDetect TeardownAgent ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.748.685 [topoinfo_detect.cc:219] [618981]TopoInfoDetect TeardownServer ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.748.700 [rank_consistentcy_checker.cc:32] [618981][GetInstance] get deviceLogicId[0]
[WARNING] HCCL(618646,python3.9):2025-04-03-09:27:45.748.712 [rank_consistentcy_checker.cc:144] [618981][Record][CannVersion] version information str is empty.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.748.723 [op_base.cc:2231] [618981]rank table is null, rankTableCrc is 0.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.748.752 [op_base.cc:2219] [618981]params.id.internal [hccl-618646-0-1743643665-hccl_world_group]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.748.763 [op_base.cc:993] [618981]rootInfo[hccl-618646-0-1743643665-hccl_world_group], params.logiceDevice[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.748.775 [hccl_comm.cc:98] [618981]hcclComm init workmode [0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.748.787 [hccl_comm.cc:954] [618981]InitImpl Implementation isHeterogComm_[0] isHaveCpuRank_[0] deviceType[2] isSpecialType_[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.749.586 [hccl_comm.cc:1365] [618981]RegistTaskAbortHandler begin
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.749.602 [task_abort_handler.cc:126] [618981]TaskAbortHandler::Init commVector size is [0], ref_ count is [0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.749.617 [api_impl.cc:4192] 618981 SetTaskAbortCallBack: set task abort callback.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.749.632 [runtime.cc:4698] 618981 SetTaskAbortCallBack: SetTaskAbortCallBack finish, moduleName:HCCL.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.749.672 [adapter_rts.cc:42] [618981]open so: libruntime.so
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.749.939 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=1, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.749.970 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.749.984 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=2, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.000 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.012 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=3, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.027 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.040 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=4, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.054 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.066 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=5, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.080 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.092 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=6, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.106 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.118 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=7, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.132 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.144 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=2, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.158 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.170 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=3, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.184 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.195 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=4, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.209 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.221 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=5, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.241 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.253 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=6, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.267 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.279 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=7, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.293 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.305 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=3, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.319 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.331 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=4, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.345 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.357 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=5, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.370 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.382 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=6, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.396 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.408 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=7, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.421 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.433 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=4, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.448 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.459 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=5, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.473 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.485 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=6, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.498 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.510 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=7, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.524 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.536 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=5, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.554 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.566 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=6, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.580 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.592 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=7, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.606 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.618 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=6, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.632 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.644 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=7, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.656 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.668 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=7, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.682 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.741 [hccl_communicator_attrs.cc:407] [618981]module[0] contains [8]devices
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.755 [hccl_communicator_attrs.cc:411] [618981]moduleIdx[0] Info: rankId[0], serverId[192.168.0.44], serverIdx[0], devicePhyId[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.767 [hccl_communicator_attrs.cc:411] [618981]moduleIdx[0] Info: rankId[1], serverId[192.168.0.44], serverIdx[0], devicePhyId[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.779 [hccl_communicator_attrs.cc:411] [618981]moduleIdx[0] Info: rankId[2], serverId[192.168.0.44], serverIdx[0], devicePhyId[2]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.791 [hccl_communicator_attrs.cc:411] [618981]moduleIdx[0] Info: rankId[3], serverId[192.168.0.44], serverIdx[0], devicePhyId[3]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.802 [hccl_communicator_attrs.cc:411] [618981]moduleIdx[0] Info: rankId[4], serverId[192.168.0.44], serverIdx[0], devicePhyId[4]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.813 [hccl_communicator_attrs.cc:411] [618981]moduleIdx[0] Info: rankId[5], serverId[192.168.0.44], serverIdx[0], devicePhyId[5]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.824 [hccl_communicator_attrs.cc:411] [618981]moduleIdx[0] Info: rankId[6], serverId[192.168.0.44], serverIdx[0], devicePhyId[6]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.836 [hccl_communicator_attrs.cc:411] [618981]moduleIdx[0] Info: rankId[7], serverId[192.168.0.44], serverIdx[0], devicePhyId[7]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.847 [hccl_communicator_attrs.cc:425] [618981]different module contains different numbers of cards:[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.859 [hccl_communicator_attrs.cc:426] [618981]different module contains different type of cards:[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.915 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=1, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.936 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.954 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=2, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.750.976 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.750.990 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=3, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.006 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.018 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=4, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.033 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.045 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=5, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.059 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.071 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=6, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.085 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.097 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=7, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.111 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.123 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=0, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.137 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.149 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=2, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.164 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.177 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=3, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.191 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.203 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=4, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.219 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.231 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=5, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.245 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.257 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=6, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.271 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.283 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=7, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.297 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.312 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=0, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.327 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.339 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=1, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.354 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.367 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=3, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.381 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.393 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=4, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.405 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.417 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=5, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.431 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.443 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=6, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.457 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.469 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=7, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.483 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.495 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=0, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.509 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.521 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=1, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.535 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.547 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=2, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.561 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.573 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=4, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.587 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.599 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=5, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.613 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.631 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=6, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.646 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.658 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=7, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.673 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.685 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=0, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.698 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.711 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=1, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.725 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.737 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=2, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.751 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.763 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=3, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.777 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.790 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=5, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.804 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.816 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=6, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.830 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.842 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=7, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.856 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.868 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=0, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.882 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.894 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=1, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.908 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.920 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=2, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.934 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.946 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=3, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.966 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.751.978 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=4, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.751.992 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.005 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=6, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.019 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.031 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=7, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.045 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.056 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=0, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.069 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.081 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=1, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.095 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.108 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=2, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.122 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.134 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=3, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.148 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.181 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=4, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.198 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.210 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=5, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.225 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.237 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=7, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.251 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.263 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=0, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.277 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.290 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=1, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.304 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.320 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=2, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.335 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.347 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=3, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.361 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.373 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=4, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.387 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.400 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=5, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.412 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.424 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=6, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.438 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.456 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=1, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.471 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.482 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=2, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.496 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.508 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=3, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.522 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.534 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=4, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.547 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.559 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=5, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.573 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.584 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=6, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.598 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.610 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=7, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.624 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.637 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=2, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.655 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.667 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=3, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.680 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.692 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=4, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.706 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.718 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=5, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.732 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.744 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=6, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.757 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.769 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=7, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.783 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.795 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=3, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.808 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.820 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=4, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.834 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.845 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=5, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.859 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.871 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=6, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.885 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.896 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=7, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.910 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.922 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=4, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.935 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.947 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=5, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.965 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.752.977 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=6, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.752.991 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.753.003 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=7, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.016 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.753.029 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=5, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.043 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.753.055 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=6, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.068 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.753.079 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=7, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.093 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.753.105 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=6, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.119 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.753.131 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=7, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.145 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.753.156 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=7, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.170 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.212 [hccl_communicator_attrs.cc:156] [618981][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[0], nicIp[192.168.100.101], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.232 [hccl_communicator_attrs.cc:156] [618981][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[1], nicIp[29.105.19.202], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.248 [hccl_communicator_attrs.cc:156] [618981][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[2], nicIp[29.105.165.16], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.264 [hccl_communicator_attrs.cc:156] [618981][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[3], nicIp[29.105.51.138], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.279 [hccl_communicator_attrs.cc:156] [618981][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[4], nicIp[29.105.24.184], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.301 [hccl_communicator_attrs.cc:156] [618981][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[5], nicIp[29.105.72.114], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.316 [hccl_communicator_attrs.cc:156] [618981][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[6], nicIp[29.105.134.38], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.330 [hccl_communicator_attrs.cc:156] [618981][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[7], nicIp[29.105.73.96], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.353 [hccl_communicator_attrs.cc:1021] [618981][HcclCommunicatorAttrs][SetRanksPort] devicePortSwitchOn[0], isHaveCpuRank[0], isUseRankPort[0], nicRanksPort size[8], vnicRanksPort size[0].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.369 [hccl_communicator.cc:1440] [618981][TcpMode][3] [1:TCP, 2:RDMA, 3:RESERVED]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.379 [hccl_communicator.cc:1450] [618981][Init][TcpMode]isTcpMode[0] nicDeploy[1] hcclDeviceNicDisable[0] hcclHostRdmaEnable[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.392 [externalinput.cc:1445] [618981]InitParsesProtocol start.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.406 [externalinput.cc:1462] [618981]environmental variable HCCL_NPU_NET_PROTOCOL is not set
[WARNING] HCCL(618646,python3.9):2025-04-03-09:27:45.753.424 [externalinput.cc:1411] [618981]can't find HELPER_RES_CONFIG or HELPER_RES_FILE_PATH, get protocol type from default path [/usr/local/Ascend/latest/conf/resource.json]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.446 [externalinput.cc:1413] [618981]default resource file is not exist.RDMA is used by default.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.459 [externalinput.cc:1467] [618981]Protocol[2], remoteIsHdc[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.506 [config.cc:557] [618981][Config][SetRetryEnable]deviceType[2], superPodNum[0], serverNum[1], deviceNum[8],isDiffDeviceType[0], retryEnable[0].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.523 [hccl_communicator.cc:668] [618981][HcclCommunicator][SetRanksPort] devicePortSwitchOn[0], isHaveCpuRank[0], isUseRankPort[1], nicRanksPort size[8], vnicRanksPort size[0].
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.753.554 [api_impl.cc:3520] 618981 GetPhyDeviceInfo: get phy device info, phyId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.753.572 [api_impl.cc:3520] 618981 GetPhyDeviceInfo: get phy device info, phyId=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.753.586 [api_impl.cc:3168] 618981 EnableP2P: Enable P2P devIdDes=0, phyIdSrc=1.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:45.753.605 [devdrv_pcie.c:888][ascend][curpid:618646,618981][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=0; peer_phy_devid=1.)
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.618 [p2p_mgmt.cc:74] [618981]enable p2p: local logic id:0, remote physic id:1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.753.631 [api_impl.cc:3520] 618981 GetPhyDeviceInfo: get phy device info, phyId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.753.643 [api_impl.cc:3520] 618981 GetPhyDeviceInfo: get phy device info, phyId=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.753.655 [api_impl.cc:3168] 618981 EnableP2P: Enable P2P devIdDes=0, phyIdSrc=2.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:45.753.669 [devdrv_pcie.c:888][ascend][curpid:618646,618981][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=0; peer_phy_devid=2.)
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.681 [p2p_mgmt.cc:74] [618981]enable p2p: local logic id:0, remote physic id:2.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.753.698 [api_impl.cc:3520] 618981 GetPhyDeviceInfo: get phy device info, phyId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.753.710 [api_impl.cc:3520] 618981 GetPhyDeviceInfo: get phy device info, phyId=3
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.753.722 [api_impl.cc:3168] 618981 EnableP2P: Enable P2P devIdDes=0, phyIdSrc=3.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:45.753.736 [devdrv_pcie.c:888][ascend][curpid:618646,618981][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=0; peer_phy_devid=3.)
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.748 [p2p_mgmt.cc:74] [618981]enable p2p: local logic id:0, remote physic id:3.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.753.760 [api_impl.cc:3520] 618981 GetPhyDeviceInfo: get phy device info, phyId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.753.772 [api_impl.cc:3520] 618981 GetPhyDeviceInfo: get phy device info, phyId=4
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.753.783 [api_impl.cc:3168] 618981 EnableP2P: Enable P2P devIdDes=0, phyIdSrc=4.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:45.753.797 [devdrv_pcie.c:888][ascend][curpid:618646,618981][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=0; peer_phy_devid=4.)
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.809 [p2p_mgmt.cc:74] [618981]enable p2p: local logic id:0, remote physic id:4.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.753.820 [api_impl.cc:3520] 618981 GetPhyDeviceInfo: get phy device info, phyId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.753.832 [api_impl.cc:3520] 618981 GetPhyDeviceInfo: get phy device info, phyId=5
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.753.844 [api_impl.cc:3168] 618981 EnableP2P: Enable P2P devIdDes=0, phyIdSrc=5.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:45.753.857 [devdrv_pcie.c:888][ascend][curpid:618646,618981][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=0; peer_phy_devid=5.)
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.869 [p2p_mgmt.cc:74] [618981]enable p2p: local logic id:0, remote physic id:5.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.753.880 [api_impl.cc:3520] 618981 GetPhyDeviceInfo: get phy device info, phyId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.753.892 [api_impl.cc:3520] 618981 GetPhyDeviceInfo: get phy device info, phyId=6
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.753.904 [api_impl.cc:3168] 618981 EnableP2P: Enable P2P devIdDes=0, phyIdSrc=6.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:45.753.917 [devdrv_pcie.c:888][ascend][curpid:618646,618981][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=0; peer_phy_devid=6.)
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.929 [p2p_mgmt.cc:74] [618981]enable p2p: local logic id:0, remote physic id:6.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.753.940 [api_impl.cc:3520] 618981 GetPhyDeviceInfo: get phy device info, phyId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.753.952 [api_impl.cc:3520] 618981 GetPhyDeviceInfo: get phy device info, phyId=7
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:45.753.963 [api_impl.cc:3168] 618981 EnableP2P: Enable P2P devIdDes=0, phyIdSrc=7.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:45.753.977 [devdrv_pcie.c:888][ascend][curpid:618646,618981][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=0; peer_phy_devid=7.)
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.753.988 [p2p_mgmt.cc:74] [618981]enable p2p: local logic id:0, remote physic id:7.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.754.014 [adapter_hal.cc:298] [618981]Entry-hrtDrvGetPlatformInfo
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.754.033 [sal.cc:593] [618981]IsHostUseDevNic[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.754.079 [adapter_hal.cc:298] [618981]Entry-hrtDrvGetPlatformInfo
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.754.095 [sal.cc:593] [618981]IsHostUseDevNic[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.754.106 [network_manager.cc:69] [618981]NetworkManager::GetInstance deviceLogicID[0].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.754.122 [network_manager.cc:169] [618981]NetworkManager: devicePhyId[4294967295], devicePhyId_[0] deviceLogicId_[0], hasBackup[0]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.754.138 [tsd_client.cpp:189][TsdCapabilityGet][tid:618981] TsdCapabilityGet Begin.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.754.149 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618981] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.754.160 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618981] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.754.171 [process_mode_manager.cpp:1042][CapabilityGet][tid:618981] [ProcessModeManager] enter into CapabilityGet process deviceId[0] type[6]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.754.183 [adapter_tdt.cc:66] [618981]Get TsdCapability success. deviceLogicId[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.754.194 [network_manager.cc:175] [618981][NetworkManager][Init]supportMultiProcHCCP[1], hasBackup[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:45.754.211 [network_manager.cc:99] [618981][TsdProcessOpen]params: halAPIVersion[467736], BACKUP_DEVICE_LOG_DEV_VERSION[467736]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.754.227 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618981] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.754.238 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618981] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.754.248 [process_mode_manager.cpp:1434][ProcessOpenSubProc][tid:618981] enter into ProcessOpenSubProc subtype:0
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.754.260 [process_mode_manager.cpp:386][InitTsdClient][tid:618981] [TsdClient] tsd client has been inited before
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.754.273 [process_mode_manager.cpp:1363][SetCommonOpenParamList][tid:618981] cnt:0, extra parameters:--hdcType=18, len:12
[WARNING] TDT(618646,python3.9):2025-04-03-09:27:45.754.290 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618981] Get env[ASCEND_LATEST_INSTALL_PATH] failed
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.754.302 [process_mode_manager.cpp:1680][GetAscendLatestIntallPath][tid:618981] latest install path:/usr/local/Ascend/ascend-toolkit/latest
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.754.313 [process_mode_manager.cpp:1383][ConstructCommonOpenMsg][tid:618981] runtimePkgPath:/usr/local/Ascend/ascend-toolkit/latest
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.754.325 [process_mode_manager.cpp:1389][ConstructCommonOpenMsg][tid:618981] hostLibPath:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/lib:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/examples:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/tests/atbopstest:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64/plugin:/usr/local/Ascend/ascend-toolkit/latest/lib64:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/opskernel:/usr/local/Ascend/ascend-toolkit/
[INFO] TDT(618646,python3.9):2025-04-03-09:27:45.754.375 [hdc_client.cpp:154][TsdRecvData][tid:618981] recv timeout is:150000 ms
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:45.760.176 [queue_client_comm.c:114][ascend][curpid:618666,618841][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:45.760.178 [queue_client_comm.c:114][ascend][curpid:618666,618845][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:45.760.272 [npu_driver.cc:4338] 618841 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:45.760.289 [tensor_data_transfer.cpp:612]618841 acltdtReceiveTensorV2: queue is empty, device is 5, name is _npu_log
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:45.760.302 [npu_driver.cc:4338] 618845 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:45.760.305 [tensor_data_transfer.cpp:1054]618841 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is _npu_log
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:45.760.316 [tensor_data_transfer.cpp:612]618845 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_tensor_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:45.760.320 [tensor_data_transfer.cpp:1056]618841 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:45.760.331 [tensor_data_transfer.cpp:1054]618845 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_tensor_summary
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.760.337 [api_impl.cc:6121] 618841 MemQueuePeek: Start to peek queue on devId 5, qid is 0.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:45.760.343 [tensor_data_transfer.cpp:1056]618845 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.760.349 [npu_driver.cc:4330] 618841 MemQueuePeek: peek mem queue, deviceId=5, qid=0, timeout=800.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.760.355 [api_impl.cc:6121] 618845 MemQueuePeek: Start to peek queue on devId 5, qid is 2.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.760.368 [npu_driver.cc:4330] 618845 MemQueuePeek: peek mem queue, deviceId=5, qid=2, timeout=800.
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:45.764.169 [queue_client_comm.c:114][ascend][curpid:618666,618847][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:45.764.173 [queue_client_comm.c:114][ascend][curpid:618666,618849][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:45.764.172 [trs_cb_event.c:119][ascend][curpid:618670,618822][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =64; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:45.764.175 [trs_cb_event.c:119][ascend][curpid:618670,618823][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =65; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:45.764.194 [trs_sqcq.c:1491][ascend][curpid:618670,618822][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:45.764.171 [queue_client_comm.c:114][ascend][curpid:618666,618843][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:45.764.204 [trs_sqcq.c:1491][ascend][curpid:618670,618823][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:45.764.212 [npu_driver.cc:3833] 618822 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:45.764.222 [npu_driver.cc:3833] 618823 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:45.764.248 [api_impl.cc:5058] 618822 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:45.764.253 [api_impl.cc:5058] 618823 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.764.263 [callback.cpp:132]618822 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:45.764.174 [queue_client_comm.c:114][ascend][curpid:618666,618851][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.764.269 [callback.cpp:132]618823 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.764.276 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.764.285 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:45.764.286 [npu_driver.cc:4338] 618847 MemQueuePeek: queue empty
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.764.291 [npu_driver.cc:3828] 618822 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=64.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:45.764.304 [tensor_data_transfer.cpp:612]618847 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_image_summary
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:45.764.291 [npu_driver.cc:4338] 618849 MemQueuePeek: queue empty
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.764.301 [npu_driver.cc:3828] 618823 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=65.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:45.764.319 [npu_driver.cc:4338] 618843 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:45.764.320 [tensor_data_transfer.cpp:1054]618847 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_image_summary
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:45.764.343 [npu_driver.cc:4338] 618851 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:45.764.344 [tensor_data_transfer.cpp:612]618849 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_scalar_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:45.764.354 [tensor_data_transfer.cpp:612]618843 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_tensor_dump
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:45.764.356 [tensor_data_transfer.cpp:1056]618847 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:45.764.362 [tensor_data_transfer.cpp:612]618851 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_histogram_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:45.764.370 [tensor_data_transfer.cpp:1054]618849 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_scalar_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:45.764.378 [tensor_data_transfer.cpp:1054]618843 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_tensor_dump
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.764.382 [api_impl.cc:6121] 618847 MemQueuePeek: Start to peek queue on devId 5, qid is 3.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:45.764.385 [tensor_data_transfer.cpp:1054]618851 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_histogram_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:45.764.391 [tensor_data_transfer.cpp:1056]618849 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:45.764.398 [tensor_data_transfer.cpp:1056]618843 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.764.402 [npu_driver.cc:4330] 618847 MemQueuePeek: peek mem queue, deviceId=5, qid=3, timeout=800.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:45.764.406 [tensor_data_transfer.cpp:1056]618851 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.764.415 [api_impl.cc:6121] 618849 MemQueuePeek: Start to peek queue on devId 5, qid is 4.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.764.421 [api_impl.cc:6121] 618843 MemQueuePeek: Start to peek queue on devId 5, qid is 1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.764.428 [api_impl.cc:6121] 618851 MemQueuePeek: Start to peek queue on devId 5, qid is 5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.764.435 [npu_driver.cc:4330] 618849 MemQueuePeek: peek mem queue, deviceId=5, qid=4, timeout=800.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.764.442 [npu_driver.cc:4330] 618843 MemQueuePeek: peek mem queue, deviceId=5, qid=1, timeout=800.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.764.446 [npu_driver.cc:4330] 618851 MemQueuePeek: peek mem queue, deviceId=5, qid=5, timeout=800.
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:45.828.169 [queue_client_comm.c:114][ascend][curpid:618674,618884][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:45.828.175 [queue_client_comm.c:114][ascend][curpid:618674,618870][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:45.828.176 [queue_client_comm.c:114][ascend][curpid:618674,618866][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:45.828.168 [queue_client_comm.c:114][ascend][curpid:618662,618880][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:45.828.169 [queue_client_comm.c:114][ascend][curpid:618662,618872][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:45.828.170 [queue_client_comm.c:114][ascend][curpid:618662,618864][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:45.828.182 [queue_client_comm.c:114][ascend][curpid:618674,618878][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:45.828.184 [queue_client_comm.c:114][ascend][curpid:618674,618873][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:45.828.186 [queue_client_comm.c:114][ascend][curpid:618674,618881][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:45.828.176 [queue_client_comm.c:114][ascend][curpid:618662,618885][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:45.828.179 [queue_client_comm.c:114][ascend][curpid:618662,618868][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:45.828.181 [queue_client_comm.c:114][ascend][curpid:618662,618876][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:45.828.292 [npu_driver.cc:4338] 618884 MemQueuePeek: queue empty
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:45.828.268 [npu_driver.cc:4338] 618880 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:45.828.285 [tensor_data_transfer.cpp:612]618880 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_scalar_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:45.828.295 [tensor_data_transfer.cpp:1054]618880 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_scalar_summary
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:45.828.304 [npu_driver.cc:4338] 618872 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:45.828.307 [tensor_data_transfer.cpp:1056]618880 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:45.828.307 [npu_driver.cc:4338] 618870 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:45.828.310 [tensor_data_transfer.cpp:612]618884 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_histogram_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:45.828.317 [tensor_data_transfer.cpp:612]618872 acltdtReceiveTensorV2: queue is em[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:45.828.323 [tensor_data_transfer.cpp:612]618870 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_tensor_dump
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:45.828.327 [tensor_data_transfer.cpp:1054]618884 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_histogram_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:45.828.337 [tensor_data_transfer.cpp:1054]618870 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_tensor_dump
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:45.828.341 [tensor_data_transfer.cpp:1056]618884 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:45.828.350 [tensor_data_transfer.cpp:1056]618870 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.828.354 [api_impl.cc:6121] 618884 MemQueuePeek: Start to peek queue on devId 7, qid is 5.
pty, device is 4, name is ms_tensor_summary
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.828.324 [api_impl.cc:6121] 618880 MemQueuePeek: Start to peek queue on devId 4, qid is 4.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:45.828.331 [npu_driver.cc:4338] 618864 MemQueuePeek: queue empty
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.828.362 [api_[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:45.828.361 [tensor_data_transfer.cpp:1054]618872 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_tensor_summary
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:45.828.366 [npu_driver.cc:4338] 618885 MemQueuePeek: queue empty
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.828.367 [npu_driver.cc:4330] 618880 MemQueuePeek: peek mem queue, deviceId=4, qid=4, timeout=800.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:45.828.376 [tensor_data_transfer.cpp:612]618864 acltdtReceiveTensorV2: queue is empty, device is 4, name is _npu_log
impl.cc:6121] 618870 MemQueuePeek: Start to peek queue on devId 7, qid is 1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.828.365 [npu_driver.cc:4330] 618884 MemQueuePeek: peek mem queue, deviceId=7, qid=5, timeout=800.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:45.828.382 [tensor_data_transfer.cpp:1056]618872 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.828.395 [npu_driver.cc:4330] 618870 MemQueuePeek: peek mem queue, deviceId=7, qid=1, timeout=800.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:45.828.390 [tensor_data_transfer.cpp:612]618885 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_histogram_summary
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.828.412 [api_impl.cc:6121] 618872 MemQueuePeek: Start to peek queue on devId 4, qid is 2.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:45.828.380 [npu_driver.cc:4338] 618866 MemQueuePeek: queue empty
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:45.828.381 [npu_driver.cc:4338] 618878 MemQueuePeek: queue empty
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:45.828.421 [npu_driver.cc:4338] 618873 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:45.828.426 [tensor_data_transfer.cpp:612]618878 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_image_summary
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.828.427 [npu_driver.cc:4330] 618872 MemQueuePeek: peek mem queue, deviceId=4, qid=2, timeout=800.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:45.828.399 [npu_driver.cc:4338] 618868 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:45.828.444 [tensor_data_transfer.cpp:612]618873 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_tensor_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:45.828.403 [tensor_data_transfer.cpp:1054]618864 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is _npu_log
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:45.828.419 [tensor_data_transfer.cpp:1054]618885 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_histogram_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:45.828.458 [tensor_data_transfer.cpp:1056]618864 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:45.828.452 [npu_driver.cc:4338] 618881 MemQueuePeek: queue empty
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:45.828.439 [npu_driver.cc:4338] 618876 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:45.828.463 [tensor_data_transfer.cpp:1054]618873 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_tensor_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:45.828.420 [tensor_data_transfer.cpp:612]618866 acltdtReceiveTensorV2: queue is empty, device is 7, name is _npu_log
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:45.828.449 [tensor_data_transfer.cpp:1054]618878 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_image_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:45.828.473 [tensor_data_transfer.cpp:612]618881 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_scalar_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:45.828.479 [tensor_data_transfer.cpp:1056]618873 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:45.828.495 [tensor_data_transfer.cpp:1056]618878 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:45.828.452 [tensor_data_transfer.cpp:612]618868 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_tensor_dump
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:45.828.464 [tensor_data_transfer.cpp:1056]618885 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.828.473 [api_impl.cc:6121] 618864 MemQueuePeek: Start to peek queue on devId 4, qid is 0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.828.519 [api_impl.cc:6121] 618885 MemQueuePeek: Start to peek queue on devId 4, qid is 5.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.828.526 [npu_driver.cc:4330] 618864 MemQueuePeek: peek mem queue, deviceId=4, qid=0, timeout=800.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:45.828.490 [tensor_data_transfer.cpp:1054]618866 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is _npu_log
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:45.828.507 [tensor_data_transfer.cpp:1054]618881 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_scalar_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:45.828.487 [tensor_data_transfer.cpp:612]618876 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_image_summary
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.828.515 [api_impl.cc:6121] 618873 MemQueuePeek: Start to peek queue on devId 7, qid is 2.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.828.524 [api_impl.cc:6121] 618878 MemQueuePeek: Start to peek queue on devId 7, qid is 3.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:45.828.547 [tensor_data_transfer.cpp:1056]618866 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:45.828.557 [tensor_data_transfer.cpp:1056]618881 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:45.828.514 [tensor_data_transfer.cpp:1054]618868 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_tensor_dump
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.828.533 [npu_driver.cc:4330] 618885 MemQueuePeek: peek mem queue, deviceId=4, qid=5, timeout=800.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.828.566 [npu_driver.cc:4330] 618873 MemQueuePeek: peek mem queue, deviceId=7, qid=2, timeout=800.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:45.828.556 [tensor_data_transfer.cpp:1054]618876 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_image_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:45.828.586 [tensor_data_transfer.cpp:1056]618868 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.828.574 [npu_driver.cc:4330] 618878 MemQueuePeek: peek mem queue, deviceId=7, qid=3, timeout=800.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.828.580 [api_impl.cc:6121] 618866 MemQueuePeek: Start to peek queue on devId 7, qid is 0.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:45.828.603 [tensor_data_transfer.cpp:1056]618876 acltdtReceiveTenso[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.828.590 [api_impl.cc:6121] 618881 MemQueuePeek: Start to peek queue on devId 7, qid is 4.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.828.612 [npu_driver.cc:4330] 618866 MemQueuePeek: peek mem queue, deviceId=7, qid=0, timeout=800.
r: new process, use queue process
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.828.628 [api_impl.cc:6121] 618868 MemQueuePeek: Start to peek queue on devId 4, qid is 1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.828.622 [npu_driver.cc:4330] 618881 MemQueuePeek: peek mem queue, deviceId=7, q[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.828.644 [api_impl.cc:6121] 618876 MemQueuePeek: Start to peek queue on devId 4, qid is 3.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.828.660 [npu_driver.cc:4330] 618868 MemQueuePeek: peek mem queue, deviceId=4, qid=1, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.828.669 [npu_driver.cc:4330] 618876 MemQueuePeek: peek mem queue, deviceId=4, qid=3, timeout=800.
id=4, timeout=800.
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:45.860.166 [queue_client_comm.c:114][ascend][curpid:618670,618909][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:45.860.166 [queue_client_comm.c:114][ascend][curpid:618670,618911][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:45.860.172 [queue_client_comm.c:114][ascend][curpid:618670,618907][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:45.860.172 [queue_client_comm.c:114][ascend][curpid:618670,618905][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:45.860.175 [trs_cb_event.c:119][ascend][curpid:618650,618828][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =320; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:45.860.181 [trs_cb_event.c:119][ascend][curpid:618650,618829][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =321; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:45.860.203 [trs_sqcq.c:1491][ascend][curpid:618650,618828][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:45.860.176 [queue_client_comm.c:114][ascend][curpid:618670,618901][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:45.860.178 [queue_client_comm.c:114][ascend][curpid:618670,618903][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:45.860.209 [trs_sqcq.c:1491][ascend][curpid:618650,618829][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:45.860.216 [npu_driver.cc:3833] 618828 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=320, drvRetCode=16.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:45.860.235 [npu_driver.cc:3833] 618829 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:45.860.240 [api_impl.cc:5058] 618828 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:45.860.247 [api_impl.cc:5058] 618829 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.860.250 [callback.cpp:132]618828 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.860.256 [callback.cpp:132]618829 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.860.261 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.860.266 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.860.272 [npu_driver.cc:3828] 618828 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=320.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.860.276 [npu_driver.cc:3828] 618829 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=321.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:45.860.265 [npu_driver.cc:4338] 618909 MemQueuePeek: queue empty
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:45.860.275 [npu_driver.cc:4338] 618911 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.860.282 [tensor_data_transfer.cpp:612]618909 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_scalar_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.860.288 [tensor_data_transfer.cpp:612]618911 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_histogram_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.860.293 [tensor_data_transfer.cpp:1054]618909 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_scalar_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.860.300 [tensor_data_transfer.cpp:1054]618911 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_histogram_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.860.304 [tensor_data_transfer.cpp:1056]618909 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.860.309 [tensor_data_transfer.cpp:1056]618911 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.860.314 [api_impl.cc:6121] 618909 MemQueuePeek: Start to peek queue on devId 6, qid is 4.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:45.860.319 [npu_driver.cc:4338] 618907 MemQueuePeek: queue empty
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.860.329 [api_impl.cc:6121] 618911 MemQueuePeek: Start to peek queue on devId 6, qid is 5.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.860.333 [npu_driver.cc:4330] 618909 MemQueuePeek: peek mem queue, deviceId=6, qid=4, timeout=800.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.860.340 [tensor_data_transfer.cpp:612]618907 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_image_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.860.345 [npu_driver.cc:4330] 618911 MemQueuePeek: peek mem queue, deviceId=6, qid=5, timeout=800.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:45.860.352 [npu_driver.cc:4338] 618905 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.860.359 [tensor_data_transfer.cpp:1054]618907 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_image_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.860.372 [tensor_data_transfer.cpp:612]618905 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_tensor_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.860.377 [tensor_data_transfer.cpp:1056]618907 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:45.860.386 [npu_driver.cc:4338] 618901 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.860.389 [tensor_data_transfer.cpp:1054]618905 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_tensor_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.860.392 [api_impl.cc:6121] 618907 MemQueuePeek: Start to peek queue on devId 6, qid is 3.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.860.402 [tensor_data_transfer.cpp:612]618901 acltdtReceiveTensorV2: queue is empty, device is 6, name is _npu_log
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.860.407 [tensor_data_transfer.cpp:1056]618905 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.860.412 [npu_driver.cc:4330] 618907 MemQueuePeek: peek mem queue, deviceId=6, qid=3, timeout=800.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:45.860.416 [npu_driver.cc:4338] 618903 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.860.419 [tensor_data_transfer.cpp:1054]618901 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is _npu_log
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.860.423 [api_impl.cc:6121] 618905 MemQueuePeek: Start to peek queue on devId 6, qid is 2.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.860.434 [tensor_data_transfer.cpp:612]618903 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_tensor_dump
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.860.441 [tensor_data_transfer.cpp:1056]618901 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.860.447 [npu_driver.cc:4330] 618905 MemQueuePeek: peek mem queue, deviceId=6, qid=2, timeout=800.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.860.454 [tensor_data_transfer.cpp:1054]618903 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_tensor_dump
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.860.462 [api_impl.cc:6121] 618901 MemQueuePeek: Start to peek queue on devId 6, qid is 0.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:45.860.473 [tensor_data_transfer.cpp:1056]618903 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.860.477 [npu_driver.cc:4330] 618901 MemQueuePeek: peek mem queue, deviceId=6, qid=0, timeout=800.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.860.486 [api_impl.cc:6121] 618903 MemQueuePeek: Start to peek queue on devId 6, qid is 1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.860.517 [npu_driver.cc:4330] 618903 MemQueuePeek: peek mem queue, deviceId=6, qid=1, timeout=800.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.949.456 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618987] [ServerToClientMsgProc] [sessionID=1]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.949.480 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618987] [TsdClient] DeviceMsgProc recvMsg realDeviceId[1] msgType[61] localDevId[1] rspCode[0]heterogeneousSubPid[30511], tsdSupportLevel_[63]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.949.500 [hdc_client.cpp:172][TsdRecvData][tid:618987] [deviceId=1] the Tsd recv data already
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.949.513 [process_mode_manager.cpp:1809][ExcuteClosePidList][tid:618987] leave ExcuteClosePidList startindex:0, cnt:1
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.949.527 [process_mode_manager.cpp:1769][ProcessCloseSubProcList][tid:618987] ExcuteClosePidList success reserveCnt:1
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.949.543 [adapter_tdt.cc:52] [618987]Open TsdProcess success. deviceLogicId[1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.949.556 [network_manager.cc:405] [618987][DeInit]finish CloseHccpProcess, phy_id[1], hdc_type[18], nicDeployment[1], hasBackup[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.949.573 [network_manager.cc:409] [618987]NetworkManager: deinit nic success, nicPosition[1] ref[0].
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.949.586 [topoinfo_detect.cc:555] [618987]NetworkManager stop host net success! ip[192.168.0.44%enp67s0f5] 
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.949.602 [topoinfo_detect.cc:321] [618987]TopoInfoDetect TeardownAgent ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.949.615 [topoinfo_detect.cc:219] [618987]TopoInfoDetect TeardownServer ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.949.632 [rank_consistentcy_checker.cc:32] [618987][GetInstance] get deviceLogicId[1]
[WARNING] HCCL(618650,python3.9):2025-04-03-09:27:45.949.648 [rank_consistentcy_checker.cc:144] [618987][Record][CannVersion] version information str is empty.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.949.660 [op_base.cc:2231] [618987]rank table is null, rankTableCrc is 0.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.949.693 [op_base.cc:2219] [618987]params.id.internal [hccl-618650-0-1743643665-hccl_world_group]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.949.721 [op_base.cc:993] [618987]rootInfo[hccl-618650-0-1743643665-hccl_world_group], params.logiceDevice[1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.949.735 [hccl_comm.cc:98] [618987]hcclComm init workmode [0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.949.751 [hccl_comm.cc:954] [618987]InitImpl Implementation isHeterogComm_[0] isHaveCpuRank_[0] deviceType[2] isSpecialType_[0]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.949.808 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618986] [ServerToClientMsgProc] [sessionID=1]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.949.829 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618986] [TsdClient] DeviceMsgProc recvMsg realDeviceId[6] msgType[61] localDevId[6] rspCode[0]heterogeneousSubPid[29770], tsdSupportLevel_[63]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.949.846 [hdc_client.cpp:172][TsdRecvData][tid:618986] [deviceId=6] the Tsd recv data already
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.949.860 [process_mode_manager.cpp:1809][ExcuteClosePidList][tid:618986] leave ExcuteClosePidList startindex:0, cnt:1
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.949.876 [process_mode_manager.cpp:1769][ProcessCloseSubProcList][tid:618986] ExcuteClosePidList success reserveCnt:1
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.949.889 [adapter_tdt.cc:52] [618986]Open TsdProcess success. deviceLogicId[6]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.949.905 [network_manager.cc:405] [618986][DeInit]finish CloseHccpProcess, phy_id[6], hdc_type[18], nicDeployment[1], hasBackup[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.949.922 [network_manager.cc:409] [618986]NetworkManager: deinit nic success, nicPosition[1] ref[0].
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.949.934 [topoinfo_detect.cc:555] [618986]NetworkManager stop host net success! ip[192.168.0.44%enp67s0f5] 
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.949.948 [topoinfo_detect.cc:321] [618986]TopoInfoDetect TeardownAgent ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.949.963 [topoinfo_detect.cc:219] [618986]TopoInfoDetect TeardownServer ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.949.976 [rank_consistentcy_checker.cc:32] [618986][GetInstance] get deviceLogicId[6]
[WARNING] HCCL(618670,python3.9):2025-04-03-09:27:45.949.991 [rank_consistentcy_checker.cc:144] [618986][Record][CannVersion] version information str is empty.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.950.002 [op_base.cc:2231] [618986]rank table is null, rankTableCrc is 0.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.950.029 [op_base.cc:2219] [618986]params.id.internal [hccl-618670-0-1743643665-hccl_world_group]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.950.044 [op_base.cc:993] [618986]rootInfo[hccl-618670-0-1743643665-hccl_world_group], params.logiceDevice[6]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.950.058 [hccl_comm.cc:98] [618986]hcclComm init workmode [0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.950.073 [hccl_comm.cc:954] [618986]InitImpl Implementation isHeterogComm_[0] isHaveCpuRank_[0] deviceType[2] isSpecialType_[0]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.950.489 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618982] [ServerToClientMsgProc] [sessionID=1]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.950.529 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618982] [TsdClient] DeviceMsgProc recvMsg realDeviceId[3] msgType[61] localDevId[3] rspCode[0]heterogeneousSubPid[30134], tsdSupportLevel_[63]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.950.552 [hdc_client.cpp:172][TsdRecvData][tid:618982] [deviceId=3] the Tsd recv data already
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.950.576 [process_mode_manager.cpp:1809][ExcuteClosePidList][tid:618982] leave ExcuteClosePidList startindex:0, cnt:1
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.950.598 [process_mode_manager.cpp:1769][ProcessCloseSubProcList][tid:618982] ExcuteClosePidList success reserveCnt:1
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.950.617 [adapter_tdt.cc:52] [618982]Open TsdProcess success. deviceLogicId[3]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.950.635 [network_manager.cc:405] [618982][DeInit]finish CloseHccpProcess, phy_id[3], hdc_type[18], nicDeployment[1], hasBackup[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.950.653 [network_manager.cc:409] [618982]NetworkManager: deinit nic success, nicPosition[1] ref[0].
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.950.668 [topoinfo_detect.cc:555] [618982]NetworkManager stop host net success! ip[192.168.0.44%enp67s0f5] 
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.950.684 [topoinfo_detect.cc:321] [618982]TopoInfoDetect TeardownAgent ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.950.678 [hccl_comm.cc:1365] [618987]RegistTaskAbortHandler begin
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.950.702 [topoinfo_detect.cc:219] [618982]TopoInfoDetect TeardownServer ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.950.699 [task_abort_handler.cc:126] [618987]TaskAbortHandler::Init commVector size is [0], ref_ count is [0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.950.723 [api_impl.cc:4192] 618987 SetTaskAbortCallBack: set task abort callback.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.950.725 [rank_consistentcy_checker.cc:32] [618982][GetInstance] get deviceLogicId[3]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.950.741 [runtime.cc:4698] 618987 SetTaskAbortCallBack: SetTaskAbortCallBack finish, moduleName:HCCL.
[WARNING] HCCL(618658,python3.9):2025-04-03-09:27:45.950.743 [rank_consistentcy_checker.cc:144] [618982][Record][CannVersion] version information str is empty.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.950.762 [op_base.cc:2231] [618982]rank table is null, rankTableCrc is 0.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.950.798 [adapter_rts.cc:42] [618987]open so: libruntime.so
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.950.801 [op_base.cc:2219] [618982]params.id.internal [hccl-618658-0-1743643665-hccl_world_group]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.950.819 [op_base.cc:993] [618982]rootInfo[hccl-618658-0-1743643665-hccl_world_group], params.logiceDevice[3]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.950.833 [hccl_comm.cc:98] [618982]hcclComm init workmode [0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.950.848 [hccl_comm.cc:954] [618982]InitImpl Implementation isHeterogComm_[0] isHaveCpuRank_[0] deviceType[2] isSpecialType_[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.950.917 [hccl_comm.cc:1365] [618986]RegistTaskAbortHandler begin
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.950.936 [task_abort_handler.cc:126] [618986]TaskAbortHandler::Init commVector size is [0], ref_ count is [0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.950.951 [api_impl.cc:4192] 618986 SetTaskAbortCallBack: set task abort callback.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.950.970 [runtime.cc:4698] 618986 SetTaskAbortCallBack: SetTaskAbortCallBack finish, moduleName:HCCL.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.951.010 [adapter_rts.cc:42] [618986]open so: libruntime.so
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.951.137 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=1, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.951.176 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.951.195 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=2, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.951.216 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.951.233 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=3, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.951.250 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.951.255 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=1, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.951.267 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=4, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.951.292 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.951.292 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.951.309 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=5, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.951.320 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=2, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.951.330 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.951.342 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.951.345 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.951.360 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=3, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.951.366 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.951.380 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=7, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.951.380 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.951.398 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=4, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.951.401 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.951.417 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.951.418 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=2, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.951.433 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=5, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.951.442 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.951.457 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=3, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.951.453 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.951.467 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=6, infoType=0
[INFO] HCCL(618650,python3.9):2025-04[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.951.486 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.951.502 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=7, infoType=0
-03-09:27:45.951.476 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.951.506 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=4, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.951.519 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.951.529 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.951.536 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=2, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.951.546 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=5, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.951.556 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.951.569 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=3, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.951.566 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.951.583 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=6, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.951.590 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.951.605 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=4, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.951.603 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.951.620 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=7, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.951.626 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.951.642 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=5, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.951.640 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.951.659 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=3, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.951.661 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.951.678 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=6, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.951.679 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.951.697 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=4, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.951.699 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.951.715 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=7, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.951.717 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.951.734 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=5, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.951.733 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.951.747 [hccl_comm.cc:1365] [618982]RegistTaskAbortHandler begin
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.951.755 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[5] linkTypeRaw[0]
04-03-09:27:45.951.750 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=3, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.951.767 [task_abort_handler.cc:126] [618982]TaskAbortHandler::Init commVector size is [0], ref_ count is [0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.951.772 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=6, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.951.782 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.951.796 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=4, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.951.791 [api_impl.cc:4192] 618982 SetTaskAbortCallBack: set task abort callback.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.951.793 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.951.808 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=7, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.951.816 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.951.812 [runtime.cc:4698] 618982 SetTaskAbortCallBack: SetTaskAbortCallBack finish, moduleName:HCCL.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.951.828 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.951.830 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=5, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.951.845 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=4, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.951.850 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.951.867 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=6, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.951.864 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.951.868 [adapter_rts.cc:42] [618982]open so: libruntime.so
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.951.888 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.951.881 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=5, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.951.902 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=7, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.951.901 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.951.918 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=6, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.951.923 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.951.939 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=4, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.951.937 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.951.960 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.951.976 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=5, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.951.954 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=7, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.951.986 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.951.996 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.952.006 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=5, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.952.011 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=6, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.032 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.952.031 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.952.050 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.952.046 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=7, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.068 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.952.071 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.952.082 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=5, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.952.088 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=7, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.105 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.952.121 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=6, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.952.109 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.952.124 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=6, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.143 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.952.139 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.952.153 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.952.170 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=7, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.194 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.952.188 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.952.206 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.952.213 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=6, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.952.227 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.244 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.952.260 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.952.254 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=1, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.278 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.952.294 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=7, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.952.287 [hccl_communicator_attrs.cc:407] [618987]module[0] contains [8]devices
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.952.300 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[1] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.952.305 [hccl_communicator_attrs.cc:411] [618987]moduleIdx[0] Info: rankId[0], serverId[192.168.0.44], serverIdx[0], devicePhyId[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.314 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.952.324 [hccl_communicator_attrs.cc:411] [618987]moduleIdx[0] Info: rankId[1], serverId[192.168.0.44], serverIdx[0], devicePhyId[1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.952.340 [hccl_communicator_attrs.cc:411] [618987]moduleIdx[0] Info: rankId[2], serverId[192.168.0.44], serverIdx[0], devicePhyId[2]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.952.321 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=2, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.952.354 [hccl_communicator_attrs.cc:411] [618987]moduleIdx[0] Info: rankId[3], serverId[192.168.0.44], serverIdx[0], devicePhyId[3]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.952.366 [hccl_communicator_attrs.cc:411] [618987]moduleIdx[0] Info: rankId[4], serverId[192.168.0.44], serverIdx[0], devicePhyId[4]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.952.360 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.952.375 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=3, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.362 [hccl_communicator_attrs.cc:407] [618986]module[0] contains [8]devices
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.952.381 [hccl_communicator_attrs.cc:411] [618987]moduleIdx[0] Info: rankId[5], serverId[192.168.0.44], serverIdx[0], devicePhyId[5]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.379 [hccl_communicator_attrs.cc:411] [618986]moduleIdx[0] Info: rankId[0], serverId[192.168.0.44], serverIdx[0], devicePhyId[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.394 [hccl_communicator_attrs.cc:411] [618986]moduleIdx[0] Info: rankId[1], serverId[192.168.0.44], serverIdx[0], devicePhyId[1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.952.396 [hccl_communicator_attrs.cc:411] [618987]moduleIdx[0] Info: rankId[6], serverId[192.168.0.44], serverIdx[0], devicePhyId[6]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.407 [hccl_communicator_attrs.cc:411] [618986]moduleIdx[0] Info: rankId[2], serverId[192.168.0.44], serverIdx[0], devicePhyId[2]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.952.393 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.952.410 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=4, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.421 [hccl_communicator_attrs.cc:411] [618986]moduleIdx[0] Info: rankId[3], serverId[192.168.0.44], serverIdx[0], devicePhyId[3]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.952.411 [hccl_communicator_attrs.cc:411] [618987]moduleIdx[0] Info: rankId[7], serverId[192.168.0.44], serverIdx[0], devicePhyId[7]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.952.428 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.435 [hccl_communicator_attrs.cc:411] [618986]moduleIdx[0] Info: rankId[4], serverId[192.168.0.44], serverIdx[0], devicePhyId[4]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.952.429 [hccl_communicator_attrs.cc:425] [618987]different module contains different numbers of cards:[0]
[INFO] HCCL(618650,python3.9):2025-04-0[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.952.443 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=5, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.448 [hccl_communicator_attrs.cc:411] [618986]moduleIdx[0] Info: rankId[5], serverId[192.168.0.44], serverIdx[0], devicePhyId[5]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.461 [hccl_communicator_attrs.cc:411] [618986]moduleIdx[0] Info: rankId[6], serverId[192.168.0.44], serverIdx[0], devicePhyId[6]
3-09:27:45.952.444 [hccl_communicator_attrs.cc:426] [618987]different module contains different type of cards:[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.952.459 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.952.474 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=6, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.475 [hccl_communicator_attrs.cc:411] [618986]moduleIdx[0] Info: rankId[7], serverId[192.168.0.44], serverIdx[0], devicePhyId[7]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.952.490 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.952.503 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=7, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.489 [hccl_communicator_attrs.cc:425] [618986]different module contains different numbers of cards:[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.501 [hccl_communicator_attrs.cc:426] [618986]different module contains different type of cards:[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.952.519 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.952.519 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=1, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.952.535 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=2, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.952.548 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.952.550 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=1, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.952.556 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.952.572 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.952.570 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=2, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.579 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[1] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.952.594 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.952.610 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=4, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.952.599 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=2, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.952.598 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.952.617 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=3, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.625 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[2] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.952.631 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.952.646 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=5, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.952.638 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.952.642 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.952.656 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=4, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.663 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[3] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.952.667 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.952.684 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=6, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.952.679 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.952.677 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=4, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.698 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.952.704 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.952.694 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=5, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.952.714 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.952.712 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=5, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.952.716 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.952.729 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=6, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.740 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.952.735 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.952.750 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=3, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.952.752 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.952.756 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=6, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.952.769 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDe[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.952.768 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=7, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.780 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[6] linkTypeRaw[0]
vId[2] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.952.796 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=7, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.952.786 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.952.798 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=4, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.952.800 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=0, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.952.822 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[0] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.815 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.952.831 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=0, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.952.822 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.952.836 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=2, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.851 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.952.837 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=5, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.952.858 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.952.856 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.952.873 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.952.866 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=2, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.952.871 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=6, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.886 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.952.900 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=3, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.952.890 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.952.905 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=7, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.952.894 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.952.912 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=4, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.921 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[3] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.952.924 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.952.932 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.952.937 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=4, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.952.941 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=4, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.952.950 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=5, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.958 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.952.972 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=5, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.952.962 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.952.977 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=5, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.952.970 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.952.991 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.952.996 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.952.987 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.953.007 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.953.008 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=6, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.953.018 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.953.034 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=7, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.953.028 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.953.041 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=7, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.029 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.953.044 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=7, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.953.054 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.953.061 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.062 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.953.069 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=0, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.953.075 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=0, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.953.077 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=5, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.953.088 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[0] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.953.093 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[0] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.096 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.953.110 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.953.103 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=1, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.953.107 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=1, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.129 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.953.125 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.953.139 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=3, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.953.131 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.953.146 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.953.142 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=7, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.953.158 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[3] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.161 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.953.176 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.953.173 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=4, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.953.167 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.953.188 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=4, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.953.209 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.953.197 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.196 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.953.212 [api_error.cc:3478] 6189[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.953.223 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=5, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.953.216 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=5, infoType=0
82 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=7, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.953.243 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.953.238 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.953.253 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=6, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.244 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.953.259 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.953.260 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=7, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.953.273 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.953.280 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.282 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.953.291 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.953.293 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=7, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.953.311 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.953.314 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.953.328 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=0, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.953.325 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=0, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.953.345 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[0] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.953.349 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[0] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.360 [hccl_communicator_attrs.cc:407] [618982]module[0] contains [8]devices
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.953.365 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=1, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.953.362 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=1, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.953.383 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[1] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.378 [hccl_communicator_attrs.cc:411] [618982]moduleIdx[0] Info: rankId[0], serverId[192.168.0.44], serverIdx[0], devicePhyId[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.953.386 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.953.401 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=2, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.953.397 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=2, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.395 [hccl_communicator_attrs.cc:411] [618982]moduleIdx[0] Info: rankId[1], serverId[192.168.0.44], serverIdx[0], devicePhyId[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.410 [hccl_communicator_attrs.cc:411] [618982]moduleIdx[0] Info: rankId[2], serverId[192.168.0.44], serverIdx[0], devicePhyId[2]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.953.418 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[2] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.423 [hccl_communicator_attrs.cc:411] [618982]moduleIdx[0] Info: rankId[3], serverId[192.168.0.44], serverIdx[0], devicePhyId[3]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.953.422 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.953.431 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=4, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.439 [hccl_communicator_attrs.cc:411] [618982]moduleIdx[0] Info: rankId[4], serverId[192.168.0.44], serverIdx[0], devicePhyId[4]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.453 [hccl_communicator_attrs.cc:411] [618982]moduleIdx[0] Info: rankId[5], serverId[192.168.0.44], serverIdx[0], devicePhyId[5]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.953.441 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=4, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.953.457 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.953.471 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=5, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.469 [hccl_communicator_attrs.cc:411] [618982]moduleIdx[0] Info: rankId[6], serverId[192.168.0.44], serverIdx[0], devicePhyId[6]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.953.491 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.953.479 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.482 [hccl_communicator_attrs.cc:411] [618982]moduleIdx[0] Info: rankId[7], serverId[192.168.0.44], serverIdx[0], devicePhyId[7]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.496 [hccl_communicator_attrs.cc:425] [618982]different module contains different numbers of cards:[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.953.496 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=5, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.953.505 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=6, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.511 [hccl_communicator_attrs.cc:426] [618982]different module contains different type of cards:[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.953.518 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.953.528 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.953.534 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.953.544 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=7, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.953.557 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.953.566 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.953.574 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.953.574 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=1, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.953.582 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=0, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.953.595 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.604 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[1] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.953.605 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.953.630 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=1, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.953.612 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=0, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.953.632 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.953.627 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=2, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.953.648 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=1, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.651 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[2] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.953.653 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.953.666 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.953.670 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=2, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.953.669 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[1] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.686 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.953.689 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=2, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.953.691 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.953.708 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.953.705 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=4, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.953.717 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[2] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.953.729 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[3] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.727 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.953.742 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=5, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.953.732 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.953.743 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=5, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.761 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] ot[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.953.754 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.953.769 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=5, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.953.764 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.953.778 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=6, infoType=0
herPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.953.789 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.953.798 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.953.786 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=6, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.806 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.953.805 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.953.812 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.953.819 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=7, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.953.826 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.953.841 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=7, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.953.832 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.953.846 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=0, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.839 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.953.865 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.953.855 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=0, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.874 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[0] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.953.862 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.953.879 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=0, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.953.881 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=1, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.953.889 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=2, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.953.903 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[0] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.953.904 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.953.921 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=2, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.910 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.953.922 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=1, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.953.942 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.953.955 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.953.927 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=3, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.947 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[3] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.953.944 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.953.971 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=2, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.953.977 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.953.962 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=4, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.953.991 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=4, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.953.984 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.953.998 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=5, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.953.995 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.954.014 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=3, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.954.012 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.954.029 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=6, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.954.018 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.954.035 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=6, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.954.035 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[3] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.954.048 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.954.054 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=4, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.954.059 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.954.064 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=7, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.954.075 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.954.075 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=7, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.954.093 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.954.093 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=6, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.954.097 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.954.111 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=0, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.954.107 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=0, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.954.115 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.954.131 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=7, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.954.127 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.954.141 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=1, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.954.130 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[0] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.954.151 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.954.160 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.954.149 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=1, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.954.167 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=0, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.954.175 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=2, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.954.169 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.954.184 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=3, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.954.184 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[0] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.954.202 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[3] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.954.195 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.954.213 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.954.199 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=1, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.954.218 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=4, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.954.219 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.954.235 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=2, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.954.233 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[3] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.954.251 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.954.256 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.954.250 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=4, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.954.270 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.954.266 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=5, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.954.284 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=5, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.954.270 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=3, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.954.284 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.954.291 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.954.306 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=4, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.954.300 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=6, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.954.320 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.954.304 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.954.322 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=7, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.954.324 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.954.335 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.954.341 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=5, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.954.354 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.954.342 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.954.358 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=0, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.954.366 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=0, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.954.362 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.954.378 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.954.377 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=7, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.954.395 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.954.386 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.954.402 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=1, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.954.395 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=1, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.954.422 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.954.410 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=0, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.954.418 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.954.432 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=2, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.954.442 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.954.438 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=2, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.954.452 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.954.469 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.954.458 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=1, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.954.459 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[2] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.954.481 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.954.477 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=4, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.954.497 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.954.490 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.954.506 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=4, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.954.513 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=5, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.954.498 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=2, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.954.524 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[2] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.954.527 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.954.551 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=5, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.954.532 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.954.539 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.954.548 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=6, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.954.571 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.954.561 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.954.575 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=4, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.954.573 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.954.584 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.954.590 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=6, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.954.604 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.954.595 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.954.618 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=0, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.954.609 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.954.613 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=5, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.954.629 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=1, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.954.635 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.954.650 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=6, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.954.638 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[0] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.954.650 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.954.666 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=2, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.954.655 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=1, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.954.673 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.954.675 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.954.699 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=2, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.954.686 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.954.701 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.954.695 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=1, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.954.722 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[3] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.954.717 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.954.732 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=2, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.954.722 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.954.736 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=4, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.954.740 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=3, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.954.756 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.954.751 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[2] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.954.759 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.954.771 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=5, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.954.768 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.954.774 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=5, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.954.793 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.954.792 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.954.789 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.954.805 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=4, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.954.809 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.954.806 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=6, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.954.826 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.954.829 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.954.827 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.954.841 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.954.841 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=5, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.954.843 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=7, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.954.863 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.954.860 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.954.875 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=6, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.954.864 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.954.879 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=0, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.954.878 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=2, infoType=0
[INF[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.954.900 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[0] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.954.899 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.954.913 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.954.916 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=1, infoType=0
O] HCCL(618650,python3.9):2025-04-03-09:27:45.954.893 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.954.928 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=7, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.954.933 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.954.949 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=4, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.954.935 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.954.951 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=2, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.954.949 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.954.967 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=2, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.954.973 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[2] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.954.970 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[4] linkTypeRaw[0]
[INFO[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.954.989 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=3, infoType=0
] RUNTIME(618670,python3.9):2025-04-03-09:27:45.954.985 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=5, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.954.988 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[2] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.013 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.955.010 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.955.028 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=4, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.955.028 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.955.005 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=3, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.027 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.955.039 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=4, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.059 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.050 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.955.050 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.955.072 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=5, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.955.067 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.955.069 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=6, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.094 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.090 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.955.104 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=3, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.955.092 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.955.106 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.955.110 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=6, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.955.125 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.124 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.955.141 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=4, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.130 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNT[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.955.147 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=7, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.168 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.161 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[4] linkTypeRaw[0]
IME(618658,python3.9):2025-04-03-09:27:45.955.141 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=0, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.955.171 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.955.177 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=5, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.955.185 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=1, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.955.184 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=3, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.197 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.955.214 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=6, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.206 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[3] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.955.210 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.955.223 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=4, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.955.228 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=2, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.233 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.243 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.955.249 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=7, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.955.248 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.955.260 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=5, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.271 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.955.267 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=3, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.955.287 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[3] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.280 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.955.294 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.955.285 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=4, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.955.302 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=4, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.315 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.305 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.955.318 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=5, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.955.321 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.955.336 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=5, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.955.329 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=7, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.336 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.955.350 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=6, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.955.354 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.370 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.955.368 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=7, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.348 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.955.376 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=4, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.955.385 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=7, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.955.387 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.397 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.955.403 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=0, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.407 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.955.415 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=5, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.955.423 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=5, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.955.424 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[0] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.435 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.955.450 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.955.439 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=1, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.955.459 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[1] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.452 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.955.468 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=6, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.469 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.955.472 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=2, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.955.493 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[2] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.490 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.955.485 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=7, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.504 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.955.508 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.955.505 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.955.517 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=5, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.526 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.955.540 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=6, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.955.528 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[3] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.536 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.955.551 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=6, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.558 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.955.545 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=4, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.571 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.955.572 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.955.587 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=7, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.955.565 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.955.579 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=5, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.592 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.955.608 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=7, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.606 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.955.614 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.629 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.955.621 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.955.629 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=6, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.640 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.955.654 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=7, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.955.648 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.672 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.955.669 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=1, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.955.687 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=7, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.670 [hccl_communicator_attrs.cc:156] [618986][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[0], nicIp[192.168.100.101], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.955.688 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.955.705 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=2, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.694 [hccl_communicator_attrs.cc:156] [618986][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[1], nicIp[29.105.19.202], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.707 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.712 [hccl_communicator_attrs.cc:156] [618986][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[2], nicIp[29.105.165.16], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.955.726 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.955.741 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=3, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.733 [hccl_communicator_attrs.cc:156] [618986][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[3], nicIp[29.105.51.138], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.753 [hccl_communicator_attrs.cc:156] [618986][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[4], nicIp[29.105.24.184], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.955.758 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.955.775 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=4, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.759 [hccl_communicator_attrs.cc:156] [618987][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[0], nicIp[192.168.100.101], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.774 [hccl_communicator_attrs.cc:156] [618986][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[5], nicIp[29.105.72.114], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.784 [hccl_communicator_attrs.cc:156] [618987][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[1], nicIp[29.105.19.202], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.791 [hccl_communicator_attrs.cc:156] [618986][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[6], nicIp[29.105.134.38], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.955.793 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.955.810 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=5, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.809 [hccl_communicator_attrs.cc:156] [618986][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[7], nicIp[29.105.73.96], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.802 [hccl_communicator_attrs.cc:156] [618987][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[2], nicIp[29.105.165.16], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.955.828 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.955.843 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=6, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.831 [hccl_communicator_attrs.cc:156] [618987][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[3], nicIp[29.105.51.138], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.839 [hccl_communicator_attrs.cc:1021] [618986][HcclCommunicatorAttrs][SetRanksPort] devicePortSwitchOn[0], isHaveCpuRank[0], isUseRankPort[0], nicRanksPort size[8], vnicRanksPort size[0].
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.853 [hccl_communicator_attrs.cc:156] [618987][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[4], nicIp[29.105.24.184], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.955.860 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.955.876 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=7, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.866 [hccl_communicator.cc:1440] [618986][TcpMode][3] [1:TCP, 2:RDMA, 3:RESERVED]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.879 [hccl_communicator.cc:1450] [618986][Init][TcpMode]isTcpMode[0] nicDeploy[1] hcclDeviceNicDisable[0] hcclHostRdmaEnable[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.873 [hccl_communicator_attrs.cc:156] [618987][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[5], nicIp[29.105.72.114], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.895 [externalinput.cc:1445] [618986]InitParsesProtocol start.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.955.894 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.955.912 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=2, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.895 [hccl_communicator_attrs.cc:156] [618987][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[6], nicIp[29.105.134.38], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.910 [externalinput.cc:1462] [618986]environmental variable HCCL_NPU_NET_PROTOCOL is not set
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.913 [hccl_communicator_attrs.cc:156] [618987][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[7], nicIp[29.105.73.96], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[WARNING] HCCL(618670,python3.9):2025-04-03-09:27:45.955.926 [externalinput.cc:1411] [618986]can't find HELPER_RES_CONFIG or HELPER_RES_FILE_PATH, get protocol type from default path [/usr/local/Ascend/latest/conf/resource.json]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.955.930 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.955.946 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=3, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.937 [hccl_communicator_attrs.cc:1021] [618987][HcclCommunicatorAttrs][SetRanksPort] devicePortSwitchOn[0], isHaveCpuRank[0], isUseRankPort[0], nicRanksPort size[8], vnicRanksPort size[0].
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.951 [externalinput.cc:1413] [618986]default resource file is not exist.RDMA is used by default.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.955.963 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[3] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.955.968 [externalinput.cc:1467] [618986]Protocol[2], remoteIsHdc[1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.955 [hccl_communicator.cc:1440] [618987][TcpMode][3] [1:TCP, 2:RDMA, 3:RESERVED]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.968 [hccl_communicator.cc:1450] [618987][Init][TcpMode]isTcpMode[0] nicDeploy[1] hcclDeviceNicDisable[0] hcclHostRdmaEnable[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.955.977 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=4, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.955.984 [externalinput.cc:1445] [618987]InitParsesProtocol start.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.956.001 [externalinput.cc:1462] [618987]environmental variable HCCL_NPU_NET_PROTOCOL is not set
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.955.993 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.956.006 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=5, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.956.005 [config.cc:557] [618986][Config][SetRetryEnable]deviceType[2], superPodNum[0], serverNum[1], deviceNum[8],isDiffDeviceType[0], retryEnable[0].
[WARNING] HCCL(618650,python3.9):2025-04-03-09:27:45.956.018 [externalinput.cc:1411] [618987]can't find HELPER_RES_CONFIG or HELPER_RES_FILE_PATH, get protocol type from default path [/usr/local/Ascend/latest/conf/resource.json]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.956.025 [hccl_communicator.cc:668] [618986][HcclCommunicator][SetRanksPort] devicePortSwitchOn[0], isHaveCpuRank[0], isUseRankPort[1], nicRanksPort size[8], vnicRanksPort size[0].
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.023 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.956.048 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=6, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.956.047 [externalinput.cc:1413] [618987]default resource file is not exist.RDMA is used by default.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.956.051 [api_impl.cc:3520] 618986 GetPhyDeviceInfo: get phy device info, phyId=6
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.956.064 [externalinput.cc:1467] [618987]Protocol[2], remoteIsHdc[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.067 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.956.083 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.956.078 [api_impl.cc:3520] 618986 GetPhyDeviceInfo: get phy device info, phyId=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.956.096 [api_impl.cc:3168] 618986 EnableP2P: Enable P2P devIdDes=6, phyIdSrc=0.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.101 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.956.117 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=3, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.956.116 [config.cc:557] [618987][Config][SetRetryEnable]deviceType[2], superPodNum[0], serverNum[1], deviceNum[8],isDiffDeviceType[0], retryEnable[0].
[INFO] DRV(618670,python3.9):2025-04-03-09:27:45.956.120 [devdrv_pcie.c:888][ascend][curpid:618670,618986][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=6; peer_phy_devid=0.)
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.135 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.956.151 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=4, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.956.138 [p2p_mgmt.cc:74] [618986]enable p2p: local logic id:6, remote physic id:0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.956.154 [api_impl.cc:3520] 618986 GetPhyDeviceInfo: get phy device info, phyId=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.956.177 [api_impl.cc:3520] 618986 GetPhyDeviceInfo: get phy device info, phyId=1
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.956.137 [hccl_communicator.cc:668] [618987][HcclCommunicator][SetRanksPort] devicePortSwitchOn[0], isHaveCpuRank[0], isUseRankPort[1], nicRanksPort size[8], vnicRanksPort size[0].
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.183 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.956.193 [api_impl.cc:3168] 618986 EnableP2P: Enable P2P devIdDes=6, phyIdSrc=1.
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:45.956.173 [queue_client_comm.c:114][ascend][curpid:618650,618921][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.180 [api_impl.cc:3520] 618987 GetPhyDeviceInfo: get phy device info, phyId=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.956.201 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=5, infoType=0
[INFO] DRV(618670,python3.9):2025-04-03-09:27:45.956.210 [devdrv_pcie.c:888][ascend][curpid:618670,618986][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=6; peer_phy_devid=1.)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:45.956.169 [trs_cb_event.c:119][ascend][curpid:618654,618833][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =321; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:45.956.173 [trs_cb_event.c:119][ascend][curpid:618654,618832][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =320; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:45.956.203 [trs_sqcq.c:1491][ascend][curpid:618654,618833][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:45.956.213 [trs_sqcq.c:1491][ascend][curpid:618654,618832][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:45.956.181 [queue_client_comm.c:114][ascend][curpid:618650,618923][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:45.956.182 [queue_client_comm.c:114][ascend][curpid:618650,618927][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:45.956.183 [queu[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.218 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.956.232 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=6, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.956.225 [p2p_mgmt.cc:74] [618986]enable p2p: local logic id:6, remote physic id:1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.956.239 [api_impl.cc:3520] 618986 GetPhyDeviceInfo: get phy device info, phyId=6
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:45.956.222 [npu_driver.cc:3833] 618833 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:45.956.232 [npu_driver.cc:3833] 618832 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=320, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:45.956.254 [api_impl.cc:5058] 618833 ProcessReport: CqReportIrqWait, retCode=0x711000c
e_client_comm.c:114][ascend][curpid:618650,618925][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:45.956.193 [queue_client_comm.c:114][ascend][curpid:618650,618929][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.218 [api_impl.cc:3520] 618987 GetPhyDeviceInfo: get phy device info, phyId=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.246 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.956.261 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.956.252 [api_impl.cc:3520] 618986 GetPhyDeviceInfo: get phy device info, phyId=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.956.267 [api_impl.cc:3168] 618986 EnableP2P: Enable P2P devIdDes=6, phyIdSrc=2.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:45.956.263 [api_impl.cc:5058] 618832 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:45.956.276 [callback.cpp:132]618833 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:45.956.283 [callback.cpp:132]618832 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:45.956.220 [queue_client_comm.c:114][ascend][curpid:618650,618931][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.283 [api_impl.cc:3168] 618987 EnableP2P: Enable P2P devIdDes=1, phyIdSrc=0.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.278 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.956.292 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=4, infoType=0
[INFO] DRV(618670,python3.9):2025-04-03-09:27:45.956.283 [devdrv_pcie.c:888][ascend][curpid:618670,618986][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=6; peer_phy_devid=2.)
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.956.297 [p2p_mgmt.cc:74] [618986]enable p2p: local logic id:6, remote physic id:2.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.956.309 [api_impl.cc:3520] 618986 GetPhyDeviceInfo: get phy device info, phyId=6
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:45.956.292 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:45.956.302 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.956.309 [npu_driver.cc:3828] 618833 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=321.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.956.317 [npu_driver.cc:3828] 618832 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=320.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.292 [npu_driver.cc:4338] 618921 MemQueuePeek: queue empty
[INFO] DRV(618650,python3.9):2025-04-03-09:27:45.956.320 [devdrv_pcie.c:888][ascend][curpid:618650,618987][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=1; peer_phy_devid=0.)
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.956.321 [tensor_data_transfer.cpp:612]618921 acltdtReceiveTensorV2: queue is empty, device is 1, name is _npu_log
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.308 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.956.323 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=5, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.340 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.956.327 [api_impl.cc:3520] 618986 GetPhyDeviceInfo: get phy device info, phyId=3
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.956.349 [api_impl.cc:3168] 618986 EnableP2P: Enable P2P devIdDes=6, phyIdSrc=3.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.956.335 [p2p_mgmt.cc:74] [618987]enable p2p: local logic id:1, remote physic id:0.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.330 [npu_driver.cc:4338] 618923 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.956.344 [tensor_data_transfer.cpp:1054]618921 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is _npu_log
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.956.354 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=6, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.370 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[6] linkTypeRaw[0]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:45.956.367 [devdrv_pcie.c:888][ascend][curpid:618670,618986][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=6; peer_phy_devid=3.)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.353 [api_impl.cc:3520] 618987 GetPhyDeviceInfo: get phy device info, phyId=1
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.956.361 [tensor_data_transfer.cpp:612]618923 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_tensor_dump
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.365 [npu_driver.cc:4338] 618927 MemQueuePeek: queue empty
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.956.384 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=7, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.956.381 [p2p_mgmt.cc:74] [618986]enable p2p: local logic id:6, remote physic id:3.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.956.396 [api_impl.cc:3520] 618986 GetPhyDeviceInfo: get phy device info, phyId=6
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.956.372 [tensor_data_transfer.cpp:1056]618921 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.383 [api_impl.cc:3520] 618987 GetPhyDeviceInfo: get phy device info, phyId=2
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.956.388 [tensor_data_transfer.cpp:1054]618923 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_tensor_dump
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.402 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.956.416 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=5, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.956.410 [api_impl.cc:3520] 618986 GetPhyDeviceInfo: get phy device info, phyId=4
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.956.427 [api_impl.cc:3168] 618986 EnableP2P: Enable P2P devIdDes=6, phyIdSrc=4.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.396 [npu_driver.cc:4338] 618925 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.956.396 [tensor_data_transfer.cpp:612]618927 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_image_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.408 [api_impl.cc:6121] 618921 MemQueuePeek: Start to peek queue on devId 1, qid is 0.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.432 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[5] linkTypeRaw[0]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:45.956.444 [devdrv_pcie.c:888][ascend][curpid:618670,618986][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=6; peer_phy_devid=4.)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.417 [api_impl.cc:3168] 618987 EnableP2P: Enable P2P devIdDes=1, phyIdSrc=2.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.956.422 [tensor_data_transfer.cpp:1056]618923 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.430 [npu_driver.cc:4338] 618929 MemQueuePeek: queue empty
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.956.448 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=6, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.956.458 [p2p_mgmt.cc:74] [618986]enable p2p: local logic id:6, remote physic id:4.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.956.472 [api_impl.cc:3520] 618986 GetPhyDeviceInfo: get phy device info, phyId=6
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.956.430 [tensor_data_transfer.cpp:612]618925 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_tensor_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.956.435 [tensor_data_transfer.cpp:1054]618927 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_image_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.445 [npu_driver.cc:4330] 618921 MemQueuePeek: peek mem queue, deviceId=1, qid=0, timeout=800.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.476 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.956.486 [api_impl.cc:3520] 618986 GetPhyDeviceInfo: get phy device info, phyId=5
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.956.492 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=7, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.509 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[7] linkTypeRaw[0]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:45.956.458 [devdrv_pcie.c:888][ascend][curpid:618650,618987][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=1; peer_phy_devid=2.)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.463 [api_impl.cc:6121] 618923 MemQueuePeek: Start to peek queue on devId 1, qid is 1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.956.500 [api_impl.cc:3168] 618986 EnableP2P: Enable P2P devIdDes=6, phyIdSrc=5.
[INFO] DRV(618670,python3.9):2025-04-03-09:27:45.956.516 [devdrv_pcie.c:888][ascend][curpid:618670,618986][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=6; peer_phy_devid=5.)
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.956.470 [tensor_data_transfer.cpp:612]618929 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_scalar_summary
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.470 [npu_driver.cc:4338] 618931 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.956.477 [tensor_data_transfer.cpp:1054]618925 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_tensor_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.956.522 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=6, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.956.531 [p2p_mgmt.cc:74] [618986]enable p2p: local logic id:6, remote physic id:5.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.956.544 [api_impl.cc:3520] 618986 GetPhyDeviceInfo: get phy device info, phyId=6
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.956.480 [tensor_data_transfer.cpp:1056]618927 acltdtReceiveTensor: new process, use queue process
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.956.509 [p2p_mgmt.cc:74] [618987]enable p2p: local logic id:1, remote physic id:2.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.544 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.956.559 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.956.559 [api_impl.cc:3520] 618986 GetPhyDeviceInfo: get phy device info, phyId=7
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.519 [npu_driver.cc:4330] 618923 MemQueuePeek: peek mem queue, deviceId=1, qid=1, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.956.525 [tensor_data_transfer.cpp:1054]618929 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_scalar_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.956.543 [tensor_data_transfer.cpp:612]618931 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_histogram_summary
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.578 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:45.956.578 [api_impl.cc:3168] 618986 EnableP2P: Enable P2P devIdDes=6, phyIdSrc=7.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.956.547 [tensor_data_transfer.cpp:1056]618925 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.956.592 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=7, infoType=0
[INFO] DRV(618670,python3.9):2025-04-03-09:27:45.956.594 [devdrv_pcie.c:888][ascend][curpid:618670,618986][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=6; peer_phy_devid=7.)
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.956.608 [p2p_mgmt.cc:74] [618986]enable p2p: local logic id:6, remote physic id:7.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.554 [api_impl.cc:6121] 618927 MemQueuePeek: Start to peek queue on devId 1, qid is 3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.565 [api_impl.cc:3520] 618987 GetPhyDeviceInfo: get phy device info, phyId=1
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.956.580 [tensor_data_transfer.cpp:1056]618929 acltdtReceiveTensor: new process, use queue process
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.606 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.956.634 [adapter_hal.cc:298] [618986]Entry-hrtDrvGetPlatformInfo
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.956.596 [tensor_data_transfer.cpp:1054]618931 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_histogram_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.601 [api_impl.cc:6121] 618925 MemQueuePeek: Start to peek queue on devId 1, qid is 2.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.606 [npu_driver.cc:4330] 618927 MemQueuePeek: peek mem queue, deviceId=1, qid=3, timeout=800.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.620 [api_impl.cc:3520] 618987 GetPhyDeviceInfo: get phy device info, phyId=3
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.956.655 [sal.cc:593] [618986]IsHostUseDevNic[1]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.626 [api_impl.cc:6121] 618929 MemQueuePeek: Start to peek queue on devId 1, qid is 4.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:45.956.636 [tensor_data_transfer.cpp:1056]618931 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.647 [npu_driver.cc:4330] 618925 MemQueuePeek: peek mem queue, deviceId=1, qid=2, timeout=800.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.665 [hccl_communicator_attrs.cc:156] [618982][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[0], nicIp[192.168.100.101], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.664 [api_impl.cc:3168] 618987 EnableP2P: Enable P2P devIdDes=1, phyIdSrc=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.672 [npu_driver.cc:4330] 618929 MemQueuePeek: peek mem queue, deviceId=1, qid=4, timeout=800.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.685 [api_impl.cc:6121] 618931 MemQueuePeek: Start to peek queue on devId 1, qid is 5.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.689 [hccl_communicator_attrs.cc:156] [618982][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[1], nicIp[29.105.19.202], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.956.699 [adapter_hal.cc:298] [618986]Entry-hrtDrvGetPlatformInfo
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.711 [hccl_communicator_attrs.cc:156] [618982][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[2], nicIp[29.105.165.16], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:45.956.706 [devdrv_pcie.c:888][ascend][curpid:618650,618987][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=1; peer_phy_devid=3.)
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.956.720 [sal.cc:593] [618986]IsHostUseDevNic[1]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.727 [npu_driver.cc:4330] 618931 MemQueuePeek: peek mem queue, deviceId=1, qid=5, timeout=800.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.956.738 [p2p_mgmt.cc:74] [618987]enable [INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.730 [hccl_communicator_attrs.cc:156] [618982][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[3], nicIp[29.105.51.138], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.956.733 [network_manager.cc:69] [618986]NetworkManager::GetInstance deviceLogicID[6].
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.956.747 [network_manager.cc:169] [618986]NetworkManager: devicePhyId[4294967295], devicePhyId_[6] deviceLogicId_[6], hasBackup[0]
p2p: local logic id:1, remote physic id:3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.771 [api_impl.cc:3520] 618987 GetPhyDeviceInfo: get phy device info, phyId=1
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.751 [hccl_communicator_attrs.cc:156] [618982][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[4], nicIp[29.105.24.184], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.770 [hccl_communicator_attrs.cc:156] [618982][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[5], nicIp[29.105.72.114], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.956.763 [tsd_client.cpp:189][TsdCapabilityGet][tid:618986] TsdCapabilityGet Begin.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.956.776 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618986] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.956.787 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618986] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.786 [api_impl.cc:3520] 618987 GetPhyDeviceInfo: get phy device info, phyId=4
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.785 [hccl_communicator_attrs.cc:156] [618982][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[6], nicIp[29.105.134.38], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.956.800 [process_mode_manager.cpp:1042][CapabilityGet][tid:618986] [ProcessModeManager] enter into CapabilityGet process deviceId[6] type[6]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.803 [hccl_communicator_attrs.cc:156] [618982][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[7], nicIp[29.105.73.96], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.798 [api_impl.cc:3168] 618987 EnableP2P: Enable P2P devIdDes=1, phyIdSrc=4.
[INFO] DRV(618650,python3.9):2025-04-03-09:27:45.956.816 [devdrv_pcie.c:888][ascend][curpid:618650,618987][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=1; peer_phy_devid=4.)
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.956.815 [adapter_tdt.cc:66] [618986]Get TsdCapability success. deviceLogicId[6]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.956.832 [p2p_mgmt.cc:74] [618987]enable p2p: local logic id:1, remote physic id:4.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.844 [api_impl.cc:3520] 618987 GetPhyDeviceInfo: get phy device info, phyId=1
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.956.836 [network_manager.cc:175] [618986][NetworkManager][Init]supportMultiProcHCCP[1], hasBackup[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.836 [hccl_communicator_attrs.cc:1021] [618982][HcclCommunicatorAttrs][SetRanksPort] devicePortSwitchOn[0], isHaveCpuRank[0], isUseRankPort[0], nicRanksPort size[8], vnicRanksPort size[0].
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:45.956.854 [network_manager.cc:99] [618986][TsdProcessOpen]params: halAPIVersion[467736], BACKUP_DEVICE_LOG_DEV_VERSION[467736]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.860 [api_impl.cc:3520] 618987 GetPhyDeviceInfo: get phy device info, phyId=5
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.857 [hccl_communicator.cc:1440] [618982][TcpMode][3] [1:TCP, 2:RDMA, 3:RESERVED]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.882 [hccl_communicator.cc:1450] [618982][Init][TcpMode]isTcpMode[0] nicDeploy[1] hcclDeviceNicDisable[0] hcclHostRdmaEnable[0]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.956.871 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618986] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.956.888 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618986] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.877 [api_impl.cc:3168] 618987 EnableP2P: Enable P2P devIdDes=1, phyIdSrc=5.
[INFO] DRV(618650,python3.9):2025-04-03-09:27:45.956.894 [devdrv_pcie.c:888][ascend][curpid:618650,618987][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=1; peer_phy_devid=5.)
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.898 [externalinput.cc:1445] [618982]InitParsesProtocol start.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.956.901 [process_mode_manager.cpp:1434][ProcessOpenSubProc][tid:618986] enter into ProcessOpenSubProc subtype:0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.956.909 [p2p_mgmt.cc:74] [618987]enable p2p: local logic id:1, remote physic id:5.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.916 [externalinput.cc:1462] [618982]environmental variable HCCL_NPU_NET_PROTOCOL is not set
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.956.917 [process_mode_manager.cpp:386][InitTsdClient][tid:618986] [TsdClient] tsd client has been inited before
[WARNING] HCCL(618658,python3.9):2025-04-03-09:27:45.956.935 [externalinput.cc:1411] [618982]can't find HELPER_RES_CONFIG or HELPER_RES_FILE_PATH, get protocol type from default path [/usr/local/Ascend/latest/conf/resource.json]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.923 [api_impl.cc:3520] 618987 GetPhyDeviceInfo: get phy device info, phyId=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.939 [api_impl.cc:3520] 618987 GetPhyDeviceInfo: get phy device info, phyId=6
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.956.933 [process_mode_manager.cpp:1363][SetCommonOpenParamList][tid:618986] cnt:0, extra parameters:--hdcType=18, len:12
[WARNING] TDT(618670,python3.9):2025-04-03-09:27:45.956.949 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618986] Get env[ASCEND_LATEST_INSTALL_PATH] failed
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.955 [api_impl.cc:3168] 618987 EnableP2P: Enable P2P devIdDes=1, phyIdSrc=6.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.956.963 [process_mode_manager.cpp:1680][GetAscendLatestIntallPath][tid:618986] latest install path:/usr/local/Ascend/ascend-toolkit/latest
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.956.976 [process_mode_manager.cpp:1383][ConstructCommonOpenMsg][tid:618986] runtimePkgPath:/usr/local/Ascend/ascend-toolkit/latest
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.962 [externalinput.cc:1413] [618982]default resource file is not exist.RDMA is used by default.
[INFO] DRV(618650,python3.9):2025-04-03-09:27:45.956.969 [devdrv_pcie.c:888][ascend][curpid:618650,618987][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=1; peer_phy_devid=6.)
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.956.980 [externalinput.cc:1467] [618982]Protocol[2], remoteIsHdc[1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.956.983 [p2p_mgmt.cc:74] [618987]enable p2p: local logic id:1, remote physic id:6.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.956.998 [api_impl.cc:3520] 618987 GetPhyDeviceInfo: get phy device info, phyId=1
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.956.990 [process_mode_manager.cpp:1389][ConstructCommonOpenMsg][tid:618986] hostLibPath:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/lib:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/examples:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/tests/atbopstest:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64/plugin:/usr/local/Ascend/ascend-toolkit/latest/lib64:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/opskernel:/usr/local/Ascend/ascend-toolkit/
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.957.014 [api_impl.cc:3520] 618987 GetPhyDeviceInfo: get phy device info, phyId=7
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:45.957.029 [api_impl.cc:3168] 618987 EnableP2P: Enable P2P devIdDes=1, phyIdSrc=7.
[INFO] DRV(618650,python3.9):2025-04-03-09:27:45.957.044 [devdrv_pcie.c:888][ascend][curpid:618650,618987][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=1; peer_phy_devid=7.)
[INFO] TDT(618670,python3.9):2025-04-03-09:27:45.957.033 [hdc_client.cpp:154][TsdRecvData][tid:618986] recv timeout is:150000 ms
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.957.034 [config.cc:557] [618982][Config][SetRetryEnable]deviceType[2], superPodNum[0], serverNum[1], deviceNum[8],isDiffDeviceType[0], retryEnable[0].
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.957.054 [hccl_communicator.cc:668] [618982][HcclCommunicator][SetRanksPort] devicePortSwitchOn[0], isHaveCpuRank[0], isUseRankPort[1], nicRanksPort size[8], vnicRanksPort size[0].
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.957.059 [p2p_mgmt.cc:74] [618987]enable p2p: local logic id:1, remote physic id:7.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.957.090 [api_impl.cc:3520] 618982 GetPhyDeviceInfo: get phy device info, phyId=3
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.957.091 [adapter_hal.cc:298] [618987]Entry-hrtDrvGetPlatformInfo
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.957.115 [api_impl.cc:3520] 618982 GetPhyDeviceInfo: get phy device info, phyId=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.957.117 [sal.cc:593] [618987]IsHostUseDevNic[1]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.957.135 [api_impl.cc:3168] 618982 EnableP2P: Enable P2P devIdDes=3, phyIdSrc=0.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:45.957.163 [devdrv_pcie.c:888][ascend][curpid:618658,618982][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=3; peer_phy_devid=0.)
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.957.168 [adapter_hal.cc:298] [618987]Entry-hrtDrvGetPlatformInfo
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.957.181 [p2p_mgmt.cc:74] [618982]enable p2p: local logic id:3, remote physic id:0.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.957.190 [sal.cc:593] [618987]IsHostUseDevNic[1]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.957.202 [api_impl.cc:3520] 618982 GetPhyDeviceInfo: get phy device info, phyId=3
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.957.206 [network_manager.cc:69] [618987]NetworkManager::GetInstance deviceLogicID[1].
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.957.216 [api_impl.cc:3520] 618982 GetPhyDeviceInfo: get phy device info, phyId=1
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.957.221 [network_manager.cc:169] [618987]NetworkManager: devicePhyId[4294967295], devicePhyId_[1] deviceLogicId_[1], hasBackup[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.957.231 [api_impl.cc:3168] 618982 EnableP2P: Enable P2P devIdDes=3, phyIdSrc=1.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.957.239 [tsd_client.cpp:189][TsdCapabilityGet][tid:618987] TsdCapabilityGet Begin.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:45.957.248 [devdrv_pcie.c:888][ascend][curpid:618658,618982][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=3; peer_phy_devid=1.)
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.957.253 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618987] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.957.268 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618987] [TsdClient] g_userDeviceIn[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.957.262 [p2p_mgmt.cc:74] [618982]enable p2p: local logic id:3, remote physic id:1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.957.276 [api_impl.cc:3520] 618982 GetPhyDeviceInfo: get phy device info, phyId=3
fo is empty.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.957.290 [process_mode_manager.cpp:1042][CapabilityGet][tid:618987] [ProcessModeManager] enter into CapabilityGet process deviceId[1] type[6]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.957.293 [api_impl.cc:3520] 618982 GetPhyDeviceInfo: get phy device info, phyId=2
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.957.306 [adapter_tdt.cc:66] [618987]Get TsdCapability success. deviceLogicId[1]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.957.308 [api_impl.cc:3168] 618982 EnableP2P: Enable P2P devIdDes=3, phyIdSrc=2.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.957.319 [network_manager.cc:175] [618987][NetworkManager][Init]supportMultiProcHCCP[1], hasBackup[0]
[INFO] DRV(618658,python3.9):2025-04-03-09:27:45.957.325 [devdrv_pcie.c:888][ascend][curpid:618658,618982][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=3; peer_phy_devid=2.)
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.957.339 [p2p_mgmt.cc:74] [618982]enable p2p: local logic id:3, remote physic id:2.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.957.353 [api_impl.cc:3520] 618982 GetPhyDeviceInfo: get phy device info, phyId=3
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:45.957.339 [network_manager.cc:99] [618987][TsdProcessOpen]params: halAPIVersion[467736], BACKUP_DEVICE_LOG_DEV_VERSION[467736]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.957.360 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618987] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.957.367 [api_impl.cc:3520] 618982 GetPhyDeviceInfo: get phy device info, phyId=4
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.957.375 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618987] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.957.384 [api_impl.cc:3168] 618982 EnableP2P: Enable P2P devIdDes=3, phyIdSrc=4.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.957.391 [process_mode_manager.cpp:1434][ProcessOpenSubProc][tid:618987] enter into ProcessOpenSubProc subtype:0
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.957.406 [process_mode_manager.cpp:386][InitTsdClient][tid:618987] [TsdClient] tsd client has been inited before
[INFO] DRV(618658,python3.9):2025-04-03-09:27:45.957.401 [devdrv_pcie.c:888][ascend][curpid:618658,618982][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=3; peer_phy_devid=4.)
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.957.430 [p2p_mgmt.cc:74] [618982]enable p2p: local logic id:3, remote physic id:4.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.957.421 [process_mode_manager.cpp:1363][SetCommonOpenParamList][tid:618987] cnt:0, extra parameters:--hdcType=18, len:12
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.957.445 [api_impl.cc:3520] 618982 GetPhyDeviceInfo: get phy device info, phyId=3
[WARNING] TDT(618650,python3.9):2025-04-03-09:27:45.957.442 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618987] Get env[ASCEND_LATEST_INSTALL_PATH] failed
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.957.460 [api_impl.cc:3520] 618982 GetPhyDeviceInfo: get phy device info, phyId=5
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.957.456 [process_mode_manager.cpp:1680][GetAscendLatestIntallPath][tid:618987] latest install path:/usr/local/Ascend/ascend-toolkit/latest
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.957.471 [process_mode_manager.cpp:1383][ConstructCommonOpenMsg][tid:618987] runtimePkgPath:/usr/local/Ascend/ascend-toolkit/latest
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.957.474 [api_impl.cc:3168] 618982 EnableP2P: Enable P2P devIdDes=3, phyIdSrc=5.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:45.957.490 [devdrv_pcie.c:888][ascend][curpid:618658,618982][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=3; peer_phy_devid=5.)
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.957.504 [p2p_mgmt.cc:74] [618982]enable p2p: local logic id:3, remote physic id:5.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.957.487 [process_mode_manager.cpp:1389][ConstructCommonOpenMsg][tid:618987] hostLibPath:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/lib:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/examples:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/tests/atbopstest:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64/plugin:/usr/local/Ascend/ascend-toolkit/latest/lib64:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/opskernel:/usr/local/Ascend/ascend-toolkit/
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.957.518 [api_impl.cc:3520] 618982 GetPhyDeviceInfo: get phy device info, phyId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.957.532 [api_impl.cc:3520] 618982 GetPhyDeviceInfo: get phy device info, phyId=6
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.957.545 [api_impl.cc:3168] 618982 EnableP2P: Enable P2P devIdDes=3, phyIdSrc=6.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:45.957.536 [hdc_client.cpp:154][TsdRecvData][tid:618987] recv timeout is:150000 ms
[INFO] DRV(618658,python3.9):2025-04-03-09:27:45.957.562 [devdrv_pcie.c:888][ascend][curpid:618658,618982][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=3; peer_phy_devid=6.)
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.957.578 [p2p_mgmt.cc:74] [618982]enable p2p: local logic id:3, remote physic id:6.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.957.590 [api_impl.cc:3520] 618982 GetPhyDeviceInfo: get phy device info, phyId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.957.603 [api_impl.cc:3520] 618982 GetPhyDeviceInfo: get phy device info, phyId=7
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:45.957.620 [api_impl.cc:3168] 618982 EnableP2P: Enable P2P devIdDes=3, phyIdSrc=7.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:45.957.639 [devdrv_pcie.c:888][ascend][curpid:618658,618982][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=3; peer_phy_devid=7.)
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.957.655 [p2p_mgmt.cc:74] [618982]enable p2p: local logic id:3, remote physic id:7.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.957.693 [adapter_hal.cc:298] [618982]Entry-hrtDrvGetPlatformInfo
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.957.718 [sal.cc:593] [618982]IsHostUseDevNic[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.957.785 [adapter_hal.cc:298] [618982]Entry-hrtDrvGetPlatformInfo
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.957.807 [sal.cc:593] [618982]IsHostUseDevNic[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.957.821 [network_manager.cc:69] [618982]NetworkManager::GetInstance deviceLogicID[3].
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.957.835 [network_manager.cc:169] [618982]NetworkManager: devicePhyId[4294967295], devicePhyId_[3] deviceLogicId_[3], hasBackup[0]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.957.860 [tsd_client.cpp:189][TsdCapabilityGet][tid:618982] TsdCapabilityGet Begin.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.957.876 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618982] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.957.888 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618982] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.957.902 [process_mode_manager.cpp:1042][CapabilityGet][tid:618982] [ProcessModeManager] enter into CapabilityGet process deviceId[3] type[6]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.957.917 [adapter_tdt.cc:66] [618982]Get TsdCapability success. deviceLogicId[3]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.957.932 [network_manager.cc:175] [618982][NetworkManager][Init]supportMultiProcHCCP[1], hasBackup[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:45.957.950 [network_manager.cc:99] [618982][TsdProcessOpen]params: halAPIVersion[467736], BACKUP_DEVICE_LOG_DEV_VERSION[467736]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.957.976 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618982] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.957.992 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618982] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.958.003 [process_mode_manager.cpp:1434][ProcessOpenSubProc][tid:618982] enter into ProcessOpenSubProc subtype:0
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.958.017 [process_mode_manager.cpp:386][InitTsdClient][tid:618982] [TsdClient] tsd client has been inited before
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.958.037 [process_mode_manager.cpp:1363][SetCommonOpenParamList][tid:618982] cnt:0, extra parameters:--hdcType=18, len:12
[WARNING] TDT(618658,python3.9):2025-04-03-09:27:45.958.058 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618982] Get env[ASCEND_LATEST_INSTALL_PATH] failed
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.958.076 [process_mode_manager.cpp:1680][GetAscendLatestIntallPath][tid:618982] latest install path:/usr/local/Ascend/ascend-toolkit/latest
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.958.093 [process_mode_manager.cpp:1383][ConstructCommonOpenMsg][tid:618982] runtimePkgPath:/usr/local/Ascend/ascend-toolkit/latest
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.958.111 [process_mode_manager.cpp:1389][ConstructCommonOpenMsg][tid:618982] hostLibPath:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/lib:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/examples:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/tests/atbopstest:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64/plugin:/usr/local/Ascend/ascend-toolkit/latest/lib64:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/opskernel:/usr/local/Ascend/ascend-toolkit/
[INFO] TDT(618658,python3.9):2025-04-03-09:27:45.958.178 [hdc_client.cpp:154][TsdRecvData][tid:618982] recv timeout is:150000 ms
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.965.950 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618988] [ServerToClientMsgProc] [sessionID=1]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.965.975 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618988] [TsdClient] DeviceMsgProc recvMsg realDeviceId[2] msgType[61] localDevId[2] rspCode[0]heterogeneousSubPid[5093], tsdSupportLevel_[63]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.965.970 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618983] [ServerToClientMsgProc] [sessionID=1]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.965.996 [hdc_client.cpp:172][TsdRecvData][tid:618988] [deviceId=2] the Tsd recv data already
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.965.994 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618983] [TsdClient] DeviceMsgProc recvMsg realDeviceId[5] msgType[61] localDevId[5] rspCode[0]heterogeneousSubPid[30089], tsdSupportLevel_[63]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.966.020 [hdc_client.cpp:172][TsdRecvData][tid:618983] [deviceId=5] the Tsd recv data already
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.966.013 [process_mode_manager.cpp:1809][ExcuteClosePidList][tid:618988] leave ExcuteClosePidList startindex:0, cnt:1
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.966.032 [process_mode_manager.cpp:1809][ExcuteClosePidList][tid:618983] leave ExcuteClosePidList startindex:0, cnt:1
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.966.031 [process_mode_manager.cpp:1769][ProcessCloseSubProcList][tid:618988] ExcuteClosePidList success reserveCnt:1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.966.047 [adapter_tdt.cc:52] [618988]Open TsdProcess success. deviceLogicId[2]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.966.045 [process_mode_manager.cpp:1769][ProcessCloseSubProcList][tid:618983] ExcuteClosePidList success reserveCnt:1
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.966.058 [adapter_tdt.cc:52] [618983]Open TsdProcess success. deviceLogicId[5]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.966.071 [network_manager.cc:405] [618983][DeInit]finish CloseHccpProcess, phy_id[5], hdc_type[18], nicDeployment[1], hasBackup[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.966.062 [network_manager.cc:405] [618988][DeInit]finish CloseHccpProcess, phy_id[2], hdc_type[18], nicDeployment[1], hasBackup[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.966.086 [network_manager.cc:409] [618988]NetworkManager: deinit nic success, nicPosition[1] ref[0].
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.966.087 [network_manager.cc:409] [618983]NetworkManager: deinit nic success, nicPosition[1] ref[0].
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.966.100 [topoinfo_detect.cc:555] [618983]NetworkManager stop host net success! ip[192.168.0.44%enp67s0f5] 
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.966.101 [topoinfo_detect.cc:555] [618988]NetworkManager stop host net success! ip[192.168.0.44%enp67s0f5] 
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.966.118 [topoinfo_detect.cc:321] [618988]TopoInfoDetect TeardownAgent ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.966.112 [topoinfo_detect.cc:321] [618983]TopoInfoDetect TeardownAgent ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.966.125 [topoinfo_detect.cc:219] [618983]TopoInfoDetect TeardownServer ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.966.138 [rank_consistentcy_checker.cc:32] [618983][GetInstance] get deviceLogicId[5]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.966.132 [topoinfo_detect.cc:219] [618988]TopoInfoDetect TeardownServer ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[WARNING] HCCL(618666,python3.9):2025-04-03-09:27:45.966.152 [rank_consistentcy_checker.cc:144] [618983][Record][CannVersion] version information str is empty.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.966.163 [op_base.cc:2231] [618983]rank table is null, rankTableCrc is 0.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.966.159 [rank_consistentcy_checker.cc:32] [618988][GetInstance] get deviceLogicId[2]
[WARNING] HCCL(618654,python3.9):2025-04-03-09:27:45.966.178 [rank_consistentcy_checker.cc:144] [618988][Record][CannVersion] version information str is empty.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.966.197 [op_base.cc:2219] [618983]params.id.internal [hccl-618666-0-1743643665-hccl_world_group]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.966.192 [op_base.cc:2231] [618988]rank table is null, rankTableCrc is 0.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.966.211 [op_base.cc:993] [618983]rootInfo[hccl-618666-0-1743643665-hccl_world_group], params.logiceDevice[5]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.966.222 [hccl_comm.cc:98] [618983]hcclComm init workmode [0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.966.231 [hccl_comm.cc:954] [618983]InitImpl Implementation isHeterogComm_[0] isHaveCpuRank_[0] deviceType[2] isSpecialType_[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.966.222 [op_base.cc:2219] [618988]params.id.internal [hccl-618654-0-1743643665-hccl_world_group]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.966.240 [op_base.cc:993] [618988]rootInfo[hccl-618654-0-1743643665-hccl_world_group], params.logiceDevice[2]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.966.277 [hccl_comm.cc:98] [618988]hcclComm init workmode [0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.966.289 [hccl_comm.cc:954] [618988]InitImpl Implementation isHeterogComm_[0] isHaveCpuRank_[0] deviceType[2] isSpecialType_[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.967.047 [hccl_comm.cc:1365] [618983]RegistTaskAbortHandler begin
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.967.064 [task_abort_handler.cc:126] [618983]TaskAbortHandler::Init commVector size is [0], ref_ count is [0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.967.077 [api_impl.cc:4192] 618983 SetTaskAbortCallBack: set task abort callback.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.967.094 [runtime.cc:4698] 618983 SetTaskAbortCallBack: SetTaskAbortCallBack finish, moduleName:HCCL.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.967.137 [adapter_rts.cc:42] [618983]open so: libruntime.so
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.967.131 [hccl_comm.cc:1365] [618988]RegistTaskAbortHandler begin
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.967.154 [task_abort_handler.cc:126] [618988]TaskAbortHandler::Init commVector size is [0], ref_ count is [0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.967.173 [api_impl.cc:4192] 618988 SetTaskAbortCallBack: set task abort callback.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.967.191 [runtime.cc:4698] 618988 SetTaskAbortCallBack: SetTaskAbortCallBack finish, moduleName:HCCL.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.967.240 [adapter_rts.cc:42] [618988]open so: libruntime.so
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.967.418 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=1, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.967.453 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.967.467 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=2, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.967.484 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.967.496 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.967.501 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=1, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.967.519 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.967.533 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=4, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.967.537 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.967.556 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=2, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.967.550 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.967.564 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=5, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.967.581 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.967.579 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.967.599 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.967.596 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=6, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.967.611 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.967.624 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=7, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.967.620 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.967.639 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=4, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.967.644 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.967.660 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=2, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.967.661 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.967.678 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=5, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.967.676 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.967.690 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=3, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.967.707 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[3] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.967.700 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.967.717 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.967.721 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=4, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.967.740 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.967.739 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.967.757 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.967.757 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=5, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.967.771 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.967.784 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=6, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.967.778 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.967.795 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=2, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.967.802 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.967.816 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=7, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.967.816 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.967.833 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=3, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.967.831 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.967.845 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=3, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.967.862 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[3] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.967.854 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.967.871 [api_error.cc:3[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.967.877 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=4, infoType=0
478] 618988 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=4, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.967.893 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.967.911 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=5, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.967.905 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.967.922 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=5, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.967.930 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.967.944 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=6, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.967.943 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.967.961 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=6, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.967.962 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.967.976 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=7, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.967.983 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.968.000 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=7, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.967.994 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.968.007 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=4, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.023 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.020 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.968.037 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.968.038 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=5, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.054 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.968.067 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=6, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.059 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.968.076 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=4, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.085 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.968.098 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=7, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.097 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.968.115 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=5, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.115 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.968.130 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=5, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.140 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.148 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.968.174 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.968.170 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=6, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.191 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.968.204 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=7, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.202 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.968.221 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=7, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.223 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.968.237 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=6, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.241 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.968.258 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=4, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.254 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.968.267 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=7, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.284 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.279 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.968.295 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=5, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.968.298 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=7, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.323 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.318 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.968.335 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=6, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.357 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.968.374 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=7, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.370 [hccl_communicator_attrs.cc:407] [618983]module[0] contains [8]devices
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.385 [hccl_communicator_attrs.cc:411] [618983]moduleIdx[0] Info: rankId[0], serverId[192.168.0.44], serverIdx[0], devicePhyId[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.398 [hccl_communicator_attrs.cc:411] [618983]moduleIdx[0] Info: rankId[1], serverId[192.168.0.44], serverIdx[0], devicePhyId[1]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.411 [hccl_communicator_attrs.cc:411] [618983]moduleIdx[0] Info: rankId[2], serverId[192.168.0.44], serverIdx[0], devicePhyId[2]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.392 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.968.419 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=5, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.425 [hccl_communicator_attrs.cc:411] [618983]moduleIdx[0] Info: rankId[3], serverId[192.168.0.44], serverIdx[0], devicePhyId[3]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.438 [hccl_communicator_attrs.cc:411] [618983]moduleIdx[0] Info: rankId[4], serverId[192.168.0.44], serverIdx[0], devicePhyId[4]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.437 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.968.456 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=6, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.452 [hccl_communicator_attrs.cc:411] [618983]moduleIdx[0] Info: rankId[5], serverId[192.168.0.44], serverIdx[0], devicePhyId[5]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.464 [hccl_communicator_attrs.cc:411] [618983]moduleIdx[0] Info: rankId[6], serverId[192.168.0.44], serverIdx[0], devicePhyId[6]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.476 [hccl_communicator_attrs.cc:411] [618983]moduleIdx[0] Info: rankId[7], serverId[192.168.0.44], serverIdx[0], devicePhyId[7]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.475 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.968.494 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=7, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.491 [hccl_communicator_attrs.cc:425] [618983]different module contains different numbers of cards:[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.503 [hccl_communicator_attrs.cc:426] [618983]different module contains different type of cards:[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.512 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.968.529 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=6, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.545 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.968.561 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.968.551 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=1, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.576 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[1] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.582 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.968.599 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.968.593 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=2, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.617 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[2] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.620 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.968.631 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=3, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.651 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.968.664 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=4, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.670 [hccl_communicator_attrs.cc:407] [618988]module[0] contains [8]devices
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.679 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.687 [hccl_communicator_attrs.cc:411] [618988]moduleIdx[0] Info: rankId[0], serverId[192.168.0.44], serverIdx[0], devicePhyId[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.968.694 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=5, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.708 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.703 [hccl_communicator_attrs.cc:411] [618988]moduleIdx[0] Info: rankId[1], serverId[192.168.0.44], serverIdx[0], devicePhyId[1]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.721 [hccl_communicator_attrs.cc:411] [618988]moduleIdx[0] Info: rankId[2], serverId[192.168.0.44], serverIdx[0], devicePhyId[2]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.968.723 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=6, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.739 [hccl_communicator_attrs.cc:411] [618988]moduleIdx[0] Info: rankId[3], serverId[192.168.0.44], serverIdx[0], devicePhyId[3]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.755 [hccl_communicator_attrs.cc:411] [618988]moduleIdx[0] Info: rankId[4], serverId[192.168.0.44], serverIdx[0], devicePhyId[4]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.744 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.968.765 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=7, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.770 [hccl_communicator_attrs.cc:411] [618988]moduleIdx[0] Info: rankId[5], serverId[192.168.0.44], serverIdx[0], devicePhyId[5]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.786 [hccl_communicator_attrs.cc:411] [618988]moduleIdx[0] Info: rankId[6], serverId[192.168.0.44], serverIdx[0], devicePhyId[6]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.782 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.968.795 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=0, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.811 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[0] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.802 [hccl_communicator_attrs.cc:411] [618988]moduleIdx[0] Info: rankId[7], serverId[192.168.0.44], serverIdx[0], devicePhyId[7]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.819 [hccl_communicator_attrs.cc:425] [618988]different module contains different numbers of cards:[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.968.825 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=2, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.833 [hccl_communicator_attrs.cc:426] [618988]different module contains different type of cards:[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.842 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.968.856 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=3, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.871 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.968.883 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=4, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.901 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.968.881 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=1, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.968.916 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=5, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.920 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[1] linkTypeRaw[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.934 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.968.941 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=2, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.968.948 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=6, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.966 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.968.965 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.968.983 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.968.978 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=7, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.968.994 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.005 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=0, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.969.005 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.969.023 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=4, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.022 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.036 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=1, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.969.046 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.969.064 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=5, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.058 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.073 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=3, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.969.084 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.969.103 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=6, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.096 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.111 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=4, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.130 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.969.123 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.969.140 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.144 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=5, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.969.163 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.969.180 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=0, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.175 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.190 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=6, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.211 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.969.201 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.969.219 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=2, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.225 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=7, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.244 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.969.242 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.969.261 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.261 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=0, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.275 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.288 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=1, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.969.284 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.969.305 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=4, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.309 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.325 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=2, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.969.327 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.969.344 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=5, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.342 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.356 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=4, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.374 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.969.364 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.969.383 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.388 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=5, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.407 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.423 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=6, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.969.405 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.969.431 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=7, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.439 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.453 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=7, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.969.452 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.969.470 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=0, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.469 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.484 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=0, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.969.491 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[0] linkTypeRaw[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.502 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.969.508 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=1, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.516 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=1, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.532 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[1] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.969.529 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.969.547 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.548 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=2, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.565 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[2] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.969.569 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.969.588 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=4, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.585 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=3, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.604 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.617 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=5, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.969.609 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.969.626 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=5, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.634 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.647 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=6, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.969.647 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.969.665 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=6, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.665 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.683 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=7, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.969.687 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.969.705 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=7, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.700 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.714 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=0, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.730 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[0] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.969.724 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.969.741 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=0, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.745 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=1, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.765 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[1] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.969.763 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.969.783 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=1, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.779 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=2, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.795 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.809 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=3, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.969.803 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.969.822 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=2, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.829 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.843 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=4, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.969.843 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.969.860 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=4, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.859 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.874 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=6, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.892 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.969.882 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[4] linkTypeRaw[0]
[I[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.906 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=7, infoType=0
NFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.969.900 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=5, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.923 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.936 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=0, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.969.931 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.969.951 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=6, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.957 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.969.977 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=1, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.969.973 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.969.991 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=7, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.969.999 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.013 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=2, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.970.012 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.970.031 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=0, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.031 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.046 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=3, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.970.052 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.970.071 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=1, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.064 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.078 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=4, infoType=0
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.970.051 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618985] [ServerToClientMsgProc] [sessionID=1]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.970.078 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618985] [TsdClient] DeviceMsgProc recvMsg realDeviceId[7] msgType[61] localDevId[7] rspCode[0]heterogeneousSubPid[29960], tsdSupportLevel_[63]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.095 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[4] linkTypeRaw[0]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.970.097 [hdc_client.cpp:172][TsdRecvData][tid:618985] [deviceId=7] the Tsd recv data already
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.970.092 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.970.110 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=2, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.110 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=5, infoType=0
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.970.113 [process_mode_manager.cpp:1809][ExcuteClosePidList][tid:618985] leave ExcuteClosePidList startindex:0, cnt:1
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.126 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[5] linkTypeRaw[0]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.970.127 [process_mode_manager.cpp:1769][ProcessCloseSubProcList][tid:618985] ExcuteClosePidList success reserveCnt:1
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.970.142 [adapter_tdt.cc:52] [618985]Open TsdProcess success. deviceLogicId[7]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.139 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=7, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.970.131 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[2] linkTypeRaw[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.156 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.970.147 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=3, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.970.156 [network_manager.cc:405] [618985][DeInit]finish CloseHccpProcess, phy_id[7], hdc_type[18], nicDeployment[1], hasBackup[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.970.175 [network_manager.cc:409] [618985]NetworkManager: deinit nic success, nicPosition[1] ref[0].
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.169 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=0, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.970.168 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[3] linkTypeRaw[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.188 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.970.183 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=5, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.970.189 [topoinfo_detect.cc:555] [618985]NetworkManager stop host net success! ip[192.168.0.44%enp67s0f5] 
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.203 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=1, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.970.202 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.970.219 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=6, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.970.206 [topoinfo_detect.cc:321] [618985]TopoInfoDetect TeardownAgent ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.970.221 [topoinfo_detect.cc:219] [618985]TopoInfoDetect TeardownServer ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.224 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[1] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.970.236 [rank_consistentcy_checker.cc:32] [618985][GetInstance] get deviceLogicId[7]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.239 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=2, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.970.241 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.970.259 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=7, infoType=0
[WARNING] HCCL(618674,python3.9):2025-04-03-09:27:45.970.252 [rank_consistentcy_checker.cc:144] [618985][Record][CannVersion] version information str is empty.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.970.267 [op_base.cc:2231] [618985]rank table is null, rankTableCrc is 0.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.262 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.278 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=3, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.970.282 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.295 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.970.299 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=0, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.308 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=4, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.970.304 [op_base.cc:2219] [618985]params.id.internal [hccl-618674-0-1743643665-hccl_world_group]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.970.320 [op_base.cc:993] [618985]rootInfo[hccl-618674-0-1743643665-hccl_world_group], params.logiceDevice[7]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.325 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.970.320 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.970.337 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=1, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.340 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=5, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.970.343 [hccl_comm.cc:98] [618985]hcclComm init workmode [0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.361 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.970.360 [hccl_comm.cc:954] [618985]InitImpl Implementation isHeterogComm_[0] isHaveCpuRank_[0] deviceType[2] isSpecialType_[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.970.359 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.970.376 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic de[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.379 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=6, infoType=0
vId=5, input physic otherDevId=2, infoType=0
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.970.351 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618984] [ServerToClientMsgProc] [sessionID=1]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.970.389 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618984] [TsdClient] DeviceMsgProc recvMsg realDeviceId[4] msgType[61] localDevId[4] rspCode[0]heterogeneousSubPid[29683], tsdSupportLevel_[63]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.403 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[6] linkTypeRaw[0]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.970.410 [hdc_client.cpp:172][TsdRecvData][tid:618984] [deviceId=4] the Tsd recv data already
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.970.408 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.970.426 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.422 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=1, infoType=0
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.970.423 [process_mode_manager.cpp:1809][ExcuteClosePidList][tid:618984] leave ExcuteClosePidList startindex:0, cnt:1
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.970.442 [process_mode_manager.cpp:1769][ProcessCloseSubProcList][tid:618984] ExcuteClosePidList success reserveCnt:1
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.440 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.453 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=2, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.970.447 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.970.464 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=4, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.970.458 [adapter_tdt.cc:52] [618984]Open TsdProcess success. deviceLogicId[4]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.471 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.485 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=3, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.970.474 [network_manager.cc:405] [618984][DeInit]finish CloseHccpProcess, phy_id[4], hdc_type[18], nicDeployment[1], hasBackup[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.970.485 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.970.503 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=6, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.970.493 [network_manager.cc:409] [618984]NetworkManager: deinit nic success, nicPosition[1] ref[0].
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.502 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[3] linkTypeRaw[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.970.509 [topoinfo_detect.cc:555] [618984]NetworkManager stop host net success! ip[192.168.0.44%enp67s0f5] 
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.970.523 [topoinfo_detect.cc:321] [618984]TopoInfoDetect TeardownAgent ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.516 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=4, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.970.537 [topoinfo_detect.cc:219] [618984]TopoInfoDetect TeardownServer ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.532 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.970.524 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.970.541 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.544 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=5, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.559 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.970.554 [rank_consistentcy_checker.cc:32] [618984][GetInstance] get deviceLogicId[4]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.970.562 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.970.579 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=0, infoType=0
[WARNING] HCCL(618662,python3.9):2025-04-03-09:27:45.970.570 [rank_consistentcy_checker.cc:144] [618984][Record][CannVersion] version information str is empty.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.970.585 [op_base.cc:2231] [618984]rank table is null, rankTableCrc is 0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.573 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=6, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.593 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.607 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=7, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.970.600 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.970.618 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=1, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.625 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.970.624 [op_base.cc:2219] [618984]params.id.internal [hccl-618662-0-1743643665-hccl_world_group]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.970.641 [op_base.cc:993] [618984]rootInfo[hccl-618662-0-1743643665-hccl_world_group], params.logiceDevice[4]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.642 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=2, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.970.639 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.970.657 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=2, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.661 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[2] linkTypeRaw[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.970.657 [hccl_comm.cc:98] [618984]hcclComm init workmode [0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.970.676 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.675 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=3, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.690 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[3] linkTypeRaw[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.970.673 [hccl_comm.cc:954] [618984]InitImpl Implementation isHeterogComm_[0] isHaveCpuRank_[0] deviceType[2] isSpecialType_[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.970.689 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.704 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=4, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.721 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.970.712 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.970.730 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=4, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.735 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=5, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.754 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.970.751 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.769 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.970.769 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=5, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.784 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.803 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=7, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.970.795 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.970.812 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=7, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.822 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.835 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=3, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.970.834 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.970.851 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=0, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.851 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.866 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=4, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.882 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.970.871 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.970.901 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=1, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.896 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=5, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.912 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.925 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=6, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.970.921 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.970.940 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=2, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.945 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.959 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=7, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.970.961 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.970.978 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=3, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.970.976 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.970.989 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=4, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.008 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.970.998 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.971.017 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=4, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.971.022 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=5, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.041 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.971.038 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.971.057 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=5, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.971.056 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=6, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.070 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.971.081 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=7, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.971.078 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.971.095 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=6, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.100 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.971.114 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=5, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.971.115 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.131 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.971.144 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.971.137 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=1, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.163 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.971.159 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.971.177 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=2, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.971.178 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=7, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.202 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.971.199 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.971.215 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.971.217 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=6, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.971.211 [hccl_comm.cc:1365] [618985]RegistTaskAbortHandler begin
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.233 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.971.234 [task_abort_handler.cc:126] [618985]TaskAbortHandler::Init commVector size is [0], ref_ count is [0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.971.236 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.971.253 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=4, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.971.246 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.971.252 [api_impl.cc:4192] 618985 SetTaskAbortCallBack: set task abort callback.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.265 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.971.271 [runtime.cc:4698] 618985 SetTaskAbortCallBack: SetTaskAbortCallBack finish, moduleName:HCCL.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.971.277 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=7, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.971.272 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.971.289 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=5, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.294 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.971.313 [adapter_rts.cc:42] [618985]open so: libruntime.so
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.971.310 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.971.326 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=6, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.329 [hccl_communicator_attrs.cc:156] [618983][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[0], nicIp[192.168.100.101], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.971.343 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.350 [hccl_communicator_attrs.cc:156] [618983][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[1], nicIp[29.105.19.202], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.367 [hccl_communicator_attrs.cc:156] [618983][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[2], nicIp[29.105.165.16], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.971.359 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=7, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.386 [hccl_communicator_attrs.cc:156] [618983][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[3], nicIp[29.105.51.138], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.971.387 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.971.405 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=2, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.404 [hccl_communicator_attrs.cc:156] [618983][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[4], nicIp[29.105.24.184], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.423 [hccl_communicator_attrs.cc:156] [618983][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[5], nicIp[29.105.72.114], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.971.424 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.971.443 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=3, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.440 [hccl_communicator_attrs.cc:156] [618983][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[6], nicIp[29.105.134.38], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.457 [hccl_communicator_attrs.cc:156] [618983][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[7], nicIp[29.105.73.96], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.971.461 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.971.478 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=4, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.477 [hccl_communicator_attrs.cc:1021] [618983][HcclCommunicatorAttrs][SetRanksPort] devicePortSwitchOn[0], isHaveCpuRank[0], isUseRankPort[0], nicRanksPort size[8], vnicRanksPort size[0].
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.494 [hccl_communicator.cc:1440] [618983][TcpMode][3] [1:TCP, 2:RDMA, 3:RESERVED]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.971.489 [hccl_comm.cc:1365] [618984]RegistTaskAbortHandler begin
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.971.511 [task_abort_handler.cc:126] [618984]TaskAbortHandler::Init commVector size is [0], ref_ count is [0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.971.497 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.971.513 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=5, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.508 [hccl_communicator.cc:1450] [618983][Init][TcpMode]isTcpMode[0] nicDeploy[1] hcclDeviceNicDisable[0] hcclHostRdmaEnable[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.522 [externalinput.cc:1445] [618983]InitParsesProtocol start.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.971.531 [api_impl.cc:4192] 618984 SetTaskAbortCallBack: set task abort callback.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.539 [externalinput.cc:1462] [618983]environmental variable HCCL_NPU_NET_PROTOCOL is not set
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.971.531 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.971.549 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=6, infoType=0
[WARNING] HCCL(618666,python3.9):2025-04-03-09:27:45.971.555 [externalinput.cc:1411] [618983]can't find HELPER_RES_CONFIG or HELPER_RES_FILE_PATH, get protocol type from default path [/usr/local/Ascend/latest/conf/resource.json]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.971.551 [runtime.cc:4698] 618984 SetTaskAbortCallBack: SetTaskAbortCallBack finish, moduleName:HCCL.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.579 [externalinput.cc:1413] [618983]default resource file is not exist.RDMA is used by default.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.971.568 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.971.585 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.971.580 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=1, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.592 [externalinput.cc:1467] [618983]Protocol[2], remoteIsHdc[1]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.971.601 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.971.581 [adapter_rts.cc:42] [618984]open so: libruntime.so
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.971.615 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=3, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.971.614 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[1] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.971.632 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.971.632 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=2, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.637 [config.cc:557] [618983][Config][SetRetryEnable]deviceType[2], superPodNum[0], serverNum[1], deviceNum[8],isDiffDeviceType[0], retryEnable[0].
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.971.646 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=4, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.653 [hccl_communicator.cc:668] [618983][HcclCommunicator][SetRanksPort] devicePortSwitchOn[0], isHaveCpuRank[0], isUseRankPort[1], nicRanksPort size[8], vnicRanksPort size[0].
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.971.665 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.971.684 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=5, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.971.651 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.971.683 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.971.680 [api_impl.cc:3520] 618983 GetPhyDeviceInfo: get phy device info, phyId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.971.699 [api_impl.cc:3520] 618983 GetPhyDeviceInfo: get phy device info, phyId=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.971.704 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[3] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.971.703 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.971.720 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.971.715 [api_impl.cc:3168] 618983 EnableP2P: Enable P2P devIdDes=5, phyIdSrc=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.971.720 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=4, infoType=0
[INFO] DRV(618666,python3.9):2025-04-03-09:27:45.971.734 [devdrv_pcie.c:888][ascend][curpid:618666,618983][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=5; peer_phy_devid=0.)
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.746 [p2p_mgmt.cc:74] [618983]enable p2p: local logic id:5, remote physic id:0.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.971.740 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.971.757 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=5, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.971.740 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.971.758 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.971.759 [api_impl.cc:3520] 618983 GetPhyDeviceInfo: get phy device info, phyId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.971.774 [api_impl.cc:3520] 618983 GetPhyDeviceInfo: get phy device info, phyId=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.971.787 [api_impl.cc:3168] 618983 EnableP2P: Enable P2P devIdDes=5, phyIdSrc=1.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.971.778 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.971.795 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=6, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.971.777 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.971.796 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=4, infoTyp[INFO] DRV(618666,python3.9):2025-04-03-09:27:45.971.801 [devdrv_pcie.c:888][ascend][curpid:618666,618983][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=5; peer_phy_devid=1.)
e=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.816 [p2p_mgmt.cc:74] [618983]enable p2p: local logic id:5, remote physic id:1.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.971.814 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.971.830 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.971.831 [api_impl.cc:3520] 618983 GetPhyDeviceInfo: get phy device info, phyId=5
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.971.824 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.971.841 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=5, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.971.847 [api_impl.cc:3520] 618983 GetPhyDeviceInfo: get phy device info, phyId=2
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.971.851 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.971.868 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=2, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.971.862 [api_impl.cc:3168] 618983 EnableP2P: Enable P2P devIdDes=5, phyIdSrc=2.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.971.859 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.971.876 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=6, infoType=0
[INFO] DRV(618666,python3.9):2025-04-03-09:27:45.971.880 [devdrv_pcie.c:888][ascend][curpid:618666,618983][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=5; peer_phy_devid=2.)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.971.872 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=1, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.894 [p2p_mgmt.cc:74] [618983]enable p2p: local logic id:5, remote physic id:2.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.971.887 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.971.904 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=3, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.971.894 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.971.911 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.971.907 [api_impl.cc:3520] 618983 GetPhyDeviceInfo: get phy device info, phyId=5
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.971.904 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[1] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.971.929 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.971.924 [api_impl.cc:3520] 618983 GetPhyDeviceInfo: get phy device info, phyId=3
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.971.923 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=2, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.971.925 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.971.942 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=4, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.971.937 [api_impl.cc:3168] 618983 EnableP2P: Enable P2P devIdDes=5, phyIdSrc=3.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.971.943 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=5, infoType=0
[INFO] DRV(618666,python3.9):2025-04-03-09:27:45.971.953 [devdrv_pcie.c:888][ascend][curpid:618666,618983][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=5; peer_phy_devid=3.)
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.971.945 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.971.961 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=3, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.971.962 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.971.965 [p2p_mgmt.cc:74] [618983]enable p2p: local logic id:5, remote physic id:3.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.971.977 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=6, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.971.961 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.971.979 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=5, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.971.981 [api_impl.cc:3520] 618983 GetPhyDeviceInfo: get phy device info, phyId=5
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.971.981 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.971.997 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=4, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.971.998 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.972.005 [api_impl.cc:3520] 618983 GetPhyDeviceInfo: get phy device info, phyId=4
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.971.996 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.972.012 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.972.020 [api_impl.cc:3168] 618983 EnableP2P: Enable P2P devIdDes=5, phyIdSrc=4.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.972.013 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=7, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.972.032 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.016 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.972.032 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=5, infoType=0
[INFO] DRV(618666,python3.9):2025-04-03-09:27:45.972.037 [devdrv_pcie.c:888][ascend][curpid:618666,618983][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=5; peer_phy_devid=4.)
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.031 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.972.049 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.972.047 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=6, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.050 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.972.051 [p2p_mgmt.cc:74] [618983]enable p2p: local logic id:5, remote physic id:4.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.067 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.972.064 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.972.066 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.972.065 [api_impl.cc:3520] 618983 GetPhyDeviceInfo: get phy device info, phyId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.972.080 [api_impl.cc:3520] 618983 GetPhyDeviceInfo: get phy device info, phyId=6
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.972.082 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.972.080 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=7, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.084 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.972.098 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.972.093 [api_impl.cc:3168] 618983 EnableP2P: Enable P2P devIdDes=5, phyIdSrc=6.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.972.099 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.972.113 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=7, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.115 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[7] linkTypeRaw[0]
[INFO] DRV(618666,python3.9):2025-04-03-09:27:45.972.107 [devdrv_pcie.c:888][ascend][curpid:618666,618983][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=5; peer_phy_devid=6.)
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.972.119 [p2p_mgmt.cc:74] [618983]enable p2p: local logic id:5, remote physic id:6.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.099 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.972.125 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=4, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.972.128 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.972.130 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=2, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.972.131 [api_impl.cc:3520] 618983 GetPhyDeviceInfo: get phy device info, phyId=5
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.145 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.972.149 [api_impl.cc:3520] 618983 GetPhyDeviceInfo: get phy device info, phyId=7
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:45.972.171 [api_impl.cc:3168] 618983 EnableP2P: Enable P2P devIdDes=5, phyIdSrc=7.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.151 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.972.172 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=5, infoType=0
[INFO] DRV(618666,python3.9):2025-04-03-09:27:45.972.190 [devdrv_pcie.c:888][ascend][curpid:618666,618983][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=5; peer_phy_devid=7.)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.972.189 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=3, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.972.183 [hccl_communicator_attrs.cc:156] [618988][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[0], nicIp[192.168.100.101], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.199 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.972.205 [p2p_mgmt.cc:74] [618983]enable p2p: local logic id:5, remote physic id:7.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.210 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[3] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.972.212 [hccl_communicator_attrs.cc:156] [618988][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[1], nicIp[29.105.19.202], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.972.213 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=6, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.230 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.972.231 [adapter_hal.cc:298] [618983]Entry-hrtDrvGetPlatformInfo
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.972.225 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=4, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.243 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.972.231 [hccl_communicator_attrs.cc:156] [618988][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[2], nicIp[29.105.165.16], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.972.250 [hccl_communicator_attrs.cc:156] [618988][Get][NicInfo]serv[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.972.245 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=7, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.972.251 [sal.cc:593] [618983]IsHostUseDevNic[1]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.972.255 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=5, infoType=0
erId[192.168.0.44], serverIdx[0], rankIndex[3], nicIp[29.105.51.138], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.261 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.972.276 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=4, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.273 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.972.288 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=6, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.302 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.972.297 [adapter_hal.cc:298] [618983]Entry-hrtDrvGetPlatformInfo
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.972.276 [hccl_communicator_attrs.cc:156] [618988][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[4], nicIp[29.105.24.184], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.972.296 [hccl_communicator_attrs.cc:156] [618988][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[5], nicIp[29.105.72.114], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.291 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.972.304 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=5, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.317 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.972.316 [sal.cc:593] [618983]IsHostUseDevNic[1]
[INFO] RUNTIME(618662,python3.9):2025[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.972.316 [hccl_communicator_attrs.cc:156] [618988][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[6], nicIp[29.105.134.38], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.972.332 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=6, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.972.328 [network_manager.cc:69] [618983]NetworkManager::GetInstance deviceLogicID[5].
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.972.339 [network_manager.cc:169] [618983]NetworkManager: devicePhyId[4294967295], devicePhyId_[5] deviceLogicId_[5], hasBackup[0]
-04-03-09:27:45.972.316 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=7, infoType=0
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.972.355 [tsd_client.cpp:189][TsdCapabilityGet][tid:618983] TsdCapabilityGet Begin.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.972.333 [hccl_communicator_attrs.cc:156] [618988][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[7], nicIp[29.105.73.96], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.348 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.352 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[7] linkTypeRaw[0]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.972.369 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618983] [TsdClient] g_userDeviceInfo is empty.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.972.356 [hccl_communicator_attrs.cc:1021] [618988][HcclCommunicatorAttrs][SetRanksPort] devicePortSwitchOn[0], isHaveCpuRank[0], isUseRankPort[0], nicRanksPort size[8], vnicRanksPort size[0].
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.972.374 [hccl_communicator.cc:1440] [618988][TcpMode][3] [1:TCP, 2:RDMA, 3:RESERVED]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.972.369 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=3, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.387 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.972.398 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=4, infoType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.972.365 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=7, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.382 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[7] linkTypeRaw[0]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.972.380 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618983] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.972.392 [process_mode_manager.cpp:1042][CapabilityGet][tid:618983] [ProcessModeManager] enter into CapabilityGet process deviceId[5] type[6]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.972.385 [hccl_communicator.cc:1450] [618988][Init][TcpMode]isTcpMode[0] nicDeploy[1] hcclDeviceNicDisable[0] hcclHostRdmaEnable[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.972.399 [externalinput.cc:1445] [618988]InitParsesProtocol start.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.972.396 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=5, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.412 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.972.403 [adapter_tdt.cc:66] [618983]Get TsdCapability success. deviceLogicId[5]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.972.414 [network_manager.cc:175] [618983][NetworkManager][Init]supportMultiProcHCCP[1], hasBackup[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.972.412 [externalinput.cc:1462] [618988]environmental variable HCCL_NPU_NET_PROTOCOL is not set
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.972.428 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=6, infoType=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:45.972.433 [network_manager.cc:99] [618983][TsdProcessOpen]params: halAPIVersion[467736], BACKUP_DEVICE_LOG_DEV_VERSION[467736]
[WARNING] HCCL(618654,python3.9):2025-04-03-09:27:45.972.430 [externalinput.cc:1411] [618988]can't find HELPER_RES_CONFIG or HELPER_RES_FILE_PATH, get protocol type from default path [/usr/local/Ascend/latest/conf/resource.json]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.416 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.972.435 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=5, infoType=0
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.972.452 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618983] [TsdClient] g_userDeviceInfo is empty.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.444 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.972.460 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=7, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.972.458 [externalinput.cc:1413] [618988]default resource file is not exist.RDMA is used by default.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.972.474 [externalinput.cc:1467] [618988]Protocol[2], remoteIsHdc[1]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.972.464 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618983] [TsdClient] g_userDeviceInfo is empty.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.452 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.972.467 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=6, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.483 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.476 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.972.488 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=6, infoType=0
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.972.484 [process_mode_manager.cpp:1434][ProcessOpenSubProc][tid:618983] enter into ProcessOpenSubProc subtype:0
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.972.499 [process_mode_manager.cpp:386][InitTsdClient][tid:618983] [TsdClient] tsd client has been inited before
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.972.499 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=7, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.507 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.972.520 [api_error.cc:3478] 618985 GetPairPhyDevi[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.972.512 [process_mode_manager.cpp:1363][SetCommonOpenParamList][tid:618983] cnt:0, extra parameters:--hdcType=18, len:12
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.516 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.972.531 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=4, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.972.519 [config.cc:557] [618988][Config][SetRetryEnable]deviceType[2], superPodNum[0], serverNum[1], deviceNum[8],isDiffDeviceType[0], retryEnable[0].
[WARNING] TDT(618666,python3.9):2025-04-03-09:27:45.972.528 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618983] Get env[ASCEND_LATEST_INSTALL_PATH] failed
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.972.541 [process_mode_manager.cpp:1680][GetAscendLatestIntallPath][tid:618983] latest install path:/usr/local/Ascend/ascend-toolkit/latest
cesInfo: input physic devId=5, input physic otherDevId=7, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.972.540 [hccl_communicator.cc:668] [618988][HcclCommunicator][SetRanksPort] devicePortSwitchOn[0], isHaveCpuRank[0], isUseRankPort[1], nicRanksPort size[8], vnicRanksPort size[0].
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.972.553 [process_mode_manager.cpp:1383][ConstructCommonOpenMsg][tid:618983] runtimePkgPath:/usr/local/Ascend/ascend-toolkit/latest
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.548 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.972.565 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=5, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.552 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.972.567 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=7, infoType=0
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.972.566 [process_mode_manager.cpp:1389][ConstructCommonOpenMsg][tid:618983] hostLibPath:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/lib:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/examples:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/tests/atbopstest:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64/plugin:/usr/local/Ascend/ascend-toolkit/latest/lib64:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/opskernel:/usr/local/Ascend/ascend-toolkit/
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.582 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.972.567 [api_impl.cc:3520] 618988 GetPhyDeviceInfo: get phy device info, phyId=2
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.585 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.972.596 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.972.591 [api_impl.cc:3520] 618988 GetPhyDeviceInfo: get phy device info, phyId=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.972.608 [api_impl.cc:3168] 618988 EnableP2P: Enable P2P devIdDes=2, phyIdSrc=0.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:45.972.606 [hdc_client.cpp:154][TsdRecvData][tid:618983] recv timeout is:150000 ms
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.611 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.972.625 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=7, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.629 [hccl_communicator_attrs.cc:407] [618985]module[0] contains [8]devices
[INFO] DRV(618654,python3.9):2025-04-03-09:27:45.972.629 [devdrv_pcie.c:888][ascend][curpid:618654,618988][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=2; peer_phy_devid=0.)
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.645 [hccl_communicator_attrs.cc:411] [618985]moduleIdx[0] Info: rankId[0], serverId[192.168.0.44], serverIdx[0], devicePhyId[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.642 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.972.646 [p2p_mgmt.cc:74] [618988]enable p2p: local logic id:2, remote physic id:0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.972.662 [api_impl.cc:3520] 618988 GetPhyDeviceInfo: get phy device info, phyId=2
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.660 [hccl_communicator_attrs.cc:411] [618985]moduleIdx[0] Info: rankId[1], serverId[192.168.0.44], serverIdx[0], devicePhyId[1]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.972.658 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=5, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.676 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.972.675 [api_impl.cc:3520] 618988 GetPhyDeviceInfo: get phy device info, phyId=1
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.673 [hccl_communicator_attrs.cc:411] [618985]moduleIdx[0] Info: rankId[2], serverId[192.168.0.44], serverIdx[0], devicePhyId[2]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.687 [hccl_communicator_attrs.cc:411] [618985]moduleIdx[0] Info: rankId[3], serverId[192.168.0.44], serverIdx[0], devicePhyId[3]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.972.689 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.972.690 [api_impl.cc:3168] 618988 EnableP2P: Enable P2P devIdDes=2, phyIdSrc=1.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.700 [hccl_communicator_attrs.cc:411] [618985]moduleIdx[0] Info: rankId[4], serverId[192.168.0.44], serverIdx[0], devicePhyId[4]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.712 [hccl_communicator_attrs.cc:411] [618985]moduleIdx[0] Info: rankId[5], serverId[192.168.0.44], serverIdx[0], devicePhyId[5]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:45.972.718 [devdrv_pcie.c:888][ascend][curpid:618654,618988][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=2; peer_phy_devid=1.)
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.726 [hccl_communicator_attrs.cc:411] [618985]moduleIdx[0] Info: rankId[6], serverId[192.168.0.44], serverIdx[0], devicePhyId[6]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.705 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.972.719 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=7, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.972.733 [p2p_mgmt.cc:74] [618988]enable p2p: local logic id:2, remote physic id:1.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.741 [hccl_communicator_attrs.cc:411] [618985]moduleIdx[0] Info: rankId[7], serverId[192.168.0.44], serverIdx[0], devicePhyId[7]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.745 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.972.747 [api_impl.cc:3520] 618988 GetPhyDeviceInfo: get phy device info, phyId=2
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.757 [hccl_communicator_attrs.cc:425] [618985]different module contains different numbers of cards:[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.972.759 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.972.762 [api_impl.cc:3520] 618988 GetPhyDeviceInfo: get phy device info, phyId=3
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.972.776 [api_impl.cc:3168] 618988 EnableP2P: Enable P2P devIdDes=2, phyIdSrc=3.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.772 [hccl_communicator_attrs.cc:426] [618985]different module contains different type of cards:[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.775 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.972.788 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=7, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.805 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[7] linkTypeRaw[0]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:45.972.793 [devdrv_pcie.c:888][ascend][curpid:618654,618988][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=2; peer_phy_devid=3.)
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.972.810 [p2p_mgmt.cc:74] [618988]enable p2p: local logic id:2, remote physic id:3.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.972.818 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.972.822 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=1, infoType=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.972.825 [api_impl.cc:3520] 618988 GetPhyDeviceInfo: get phy device info, phyId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.972.841 [api_impl.cc:3520] 618988 GetPhyDeviceInfo: get phy device info, phyId=4
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.847 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.972.863 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=2, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.837 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.972.855 [api_impl.cc:3168] 618988 EnableP2P: Enable P2P devIdDes=2, phyIdSrc=4.
[INFO] DRV(618654,python3.9):2025-04-03-09:27:45.972.870 [devdrv_pcie.c:888][ascend][curpid:618654,618988][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=2; peer_phy_devid=4.)
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.972.884 [p2p_mgmt.cc:74] [618988]enable p2p: local logic id:2, remote physic id:4.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.883 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.972.898 [api_impl.cc:3520] 618988 GetPhyDeviceInfo: get phy device info, phyId=2
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.883 [hccl_communicator_attrs.cc:407] [618984]module[0] contains [8]devices
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.972.900 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.972.913 [api_impl.cc:3520] 618988 GetPhyDeviceInfo: get phy device info, phyId=5
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.900 [hccl_communicator_attrs.cc:411] [618984]moduleIdx[0] Info: rankId[0], serverId[192.168.0.44], serverIdx[0], devicePhyId[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.915 [hccl_communicator_attrs.cc:411] [618984]moduleIdx[0] Info: rankId[1], serverId[192.168.0.44], serverIdx[0], devicePhyId[1]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.972.928 [api_impl.cc:3168] 618988 EnableP2P: Enable P2P devIdDes=2, phyIdSrc=5.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.918 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[3] linkTypeRaw[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.928 [hccl_communicator_attrs.cc:411] [618984]moduleIdx[0] Info: rankId[2], serverId[192.168.0.44], serverIdx[0], devicePhyId[2]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.972.935 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=4, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.942 [hccl_communicator_attrs.cc:411] [618984]moduleIdx[0] Info: rankId[3], serverId[192.168.0.44], serverIdx[0], devicePhyId[3]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.955 [hccl_communicator_attrs.cc:411] [618984]moduleIdx[0] Info: rankId[4], serverId[192.168.0.44], serverIdx[0], devicePhyId[4]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:45.972.944 [devdrv_pcie.c:888][ascend][curpid:618654,618988][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=2; peer_phy_devid=5.)
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.972.961 [p2p_mgmt.cc:74] [618988]enable p2p: local logic id:2, remote physic id:5.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.953 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.968 [hccl_communicator_attrs.cc:411] [618984]moduleIdx[0] Info: rankId[5], serverId[192.168.0.44], serverIdx[0], devicePhyId[5]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.972.976 [api_impl.cc:3520] 618988 GetPhyDeviceInfo: get phy device info, phyId=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.972.969 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=5, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.983 [hccl_communicator_attrs.cc:411] [618984]moduleIdx[0] Info: rankId[6], serverId[192.168.0.44], serverIdx[0], devicePhyId[6]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.972.995 [hccl_communicator_attrs.cc:411] [618984]moduleIdx[0] Info: rankId[7], serverId[192.168.0.44], serverIdx[0], devicePhyId[7]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.972.991 [api_impl.cc:3520] 618988 GetPhyDeviceInfo: get phy device info, phyId=6
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.972.986 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.009 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=6, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.009 [hccl_communicator_attrs.cc:425] [618984]different module contains different numbers of cards:[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.973.004 [api_impl.cc:3168] 618988 EnableP2P: Enable P2P devIdDes=2, phyIdSrc=6.
[INFO] DRV(618654,python3.9):2025-04-03-09:27:45.973.020 [devdrv_pcie.c:888][ascend][curpid:618654,618988][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=2; peer_phy_devid=6.)
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.021 [hccl_communicator_attrs.cc:426] [618984]different module contains different type of cards:[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.027 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.973.033 [p2p_mgmt.cc:74] [618988]enable p2p: local logic id:2, remote physic id:6.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.043 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.973.048 [api_impl.cc:3520] 618988 GetPhyDeviceInfo: get phy device info, phyId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.973.063 [api_impl.cc:3520] 618988 GetPhyDeviceInfo: get phy device info, phyId=7
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.060 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.076 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=0, infoType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.973.068 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=1, infoType=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:45.973.077 [api_impl.cc:3168] 618988 EnableP2P: Enable P2P devIdDes=2, phyIdSrc=7.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.093 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[1] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.094 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.110 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=2, infoType=0
[INFO] DRV(618654,python3.9):2025-04-03-09:27:45.973.096 [devdrv_pcie.c:888][ascend][curpid:618654,618988][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=2; peer_phy_devid=7.)
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.973.114 [p2p_mgmt.cc:74] [618988]enable p2p: local logic id:2, remote physic id:7.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.127 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.973.113 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=2, infoType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.141 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=3, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.136 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.973.150 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=3, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.973.139 [adapter_hal.cc:298] [618988]Entry-hrtDrvGetPlatformInfo
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.158 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[3] linkTypeRaw[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.166 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.172 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=4, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.973.163 [sal.cc:593] [618988]IsHostUseDevNic[1]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.187 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.203 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=5, infoType=0
:27:45.973.182 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=4, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.216 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.220 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.236 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=6, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.973.223 [adapter_hal.cc:298] [618988]Entry-hrtDrvGetPlatformInfo
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.973.233 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=5, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.973.244 [sal.cc:593] [618988]IsHostUseDevNic[1]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.973.257 [network_manager.cc:69] [618988]NetworkManager::GetInstance deviceLogicID[2].
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.250 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.254 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.973.265 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.270 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=7, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.973.270 [network_manager.cc:169] [618988]NetworkManager: devicePhyId[4294967295], devicePhyId_[2] deviceLogicId_[2], hasBackup[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.287 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.300 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=0, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.285 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.317 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.973.302 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=7, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.321 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[7] linkTypeRaw[0]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.973.290 [tsd_client.cpp:189][TsdCapabilityGet][tid:618988] TsdCapabilityGet Begin.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.973.304 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618988] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.331 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=1, infoType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.973.334 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=0, infoType=0
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.973.319 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618988] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.973.331 [process_mode_manager.cpp:1042][CapabilityGet][tid:618988] [ProcessModeManager] enter into CapabilityGet process deviceId[2] type[6]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.973.344 [adapter_tdt.cc:66] [618988]Get TsdCapability success. deviceLogicId[2]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.347 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[1] linkTypeRaw[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.352 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[0] linkTypeRaw[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.973.357 [network_manager.cc:175] [618988][NetworkManager][Init]supportMultiProcHCCP[1], hasBackup[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.362 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.973.367 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=2, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:45.973.373 [network_manager.cc:99] [618988][TsdProcessOpen]params: halAPIVersion[467736], BACKUP_DEVICE_LOG_DEV_VERSION[467736]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.378 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[3] linkTypeRaw[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.384 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[2] linkTypeRaw[0]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.973.390 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618988] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.973.398 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.394 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=4, infoType=0
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.973.403 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618988] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.973.416 [process_mode_manager.cpp:1434][ProcessOpenSubProc][tid:618988] enter into ProcessOpenSubProc subtype:0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.426 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.415 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[3] linkTypeRaw[0]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.973.429 [process_mode_manager.cpp:386][InitTsdClient][tid:618988] [TsdClient] tsd client has been inited before
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.440 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=5, infoType=0
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.973.442 [process_mode_manager.cpp:1363][SetCommonOpenParamList][tid:618988] cnt:0, extra parameters:--hdcType=18, len:12
[WARNING] TDT(618654,python3.9):2025-04-03-09:27:45.973.458 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618988] Get env[ASCEND_LATEST_INSTALL_PATH] failed
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.973.432 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=4, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.450 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.973.462 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=5, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.455 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.468 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=6, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.479 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[5] linkTypeRaw[0]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.973.470 [process_mode_manager.cpp:1680][GetAscendLatestIntallPath][tid:618988] latest install path:/usr/local/Ascend/ascend-toolkit/latest
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.484 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.973.492 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.498 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=7, infoType=0
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.973.483 [process_mode_manager.cpp:1383][ConstructCommonOpenMsg][tid:618988] runtimePkgPath:/usr/local/Ascend/ascend-toolkit/latest
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.973.499 [process_mode_manager.cpp:1389][ConstructCommonOpenMsg][tid:618988] hostLibPath:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/lib:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/examples:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/tests/atbopstest:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64/plugin:/usr/local/Ascend/ascend-toolkit/latest/lib64:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/opskernel:/usr/local/Ascend/ascend-toolkit/
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.510 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.973.526 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=7, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.514 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.530 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=0, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.542 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.546 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.973.556 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=0, infoType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.561 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=1, infoType=0
[INFO] TDT(618654,python3.9):2025-04-03-09:27:45.973.541 [hdc_client.cpp:154][TsdRecvData][tid:618988] recv timeout is:150000 ms
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.572 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[0] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.578 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.593 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=2, infoType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.973.586 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=1, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.614 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[1] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.608 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.625 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=4, infoType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.973.628 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=3, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.643 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.658 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=5, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.647 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.973.664 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=4, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.675 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.682 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.973.697 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=5, infoType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.691 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=6, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.707 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.716 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.973.732 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.721 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=7, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.749 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.740 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.754 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=0, infoType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.973.763 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=7, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.768 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.783 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=1, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.781 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.973.796 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=0, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.812 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[0] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.801 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.824 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=2, infoType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.973.825 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=1, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.843 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[2] linkTypeRaw[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.844 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.858 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.973.860 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=2, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.876 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.892 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=5, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.878 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.973.895 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=4, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.909 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.913 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.925 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.973.929 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=5, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.941 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.955 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=7, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.947 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.973.961 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=6, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.973.972 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.973.988 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=0, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.973.978 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.973.993 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=7, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.004 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.020 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=1, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.011 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.032 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=0, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.037 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.053 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=2, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.050 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.066 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=1, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.070 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.086 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=3, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.084 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.101 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=2, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.103 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.119 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=4, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.120 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.136 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=3, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.135 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.152 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=6, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.153 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.168 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=5, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.170 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.185 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=7, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.184 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.201 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=6, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.202 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.218 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.236 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.217 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=0, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.244 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[0] linkTypeRaw[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.252 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.268 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=0, infoType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.259 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=1, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.278 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[1] linkTypeRaw[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.285 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.301 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=1, infoType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.292 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=2, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.311 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[2] linkTypeRaw[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.318 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.333 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=2, infoType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.324 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=3, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.343 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[3] linkTypeRaw[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.350 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.357 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=4, infoType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.366 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=3, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.374 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.388 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=5, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.383 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.399 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=4, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.404 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.420 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=7, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.417 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.432 [api_error.cc:3478] 618984[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.436 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.451 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=0, infoType=0
 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=6, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.460 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.467 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.483 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=1, infoType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.477 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=7, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.495 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.500 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.511 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=0, infoType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.515 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=2, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.528 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[0] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.532 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.549 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.544 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=1, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.561 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[1] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.567 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.583 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=4, infoType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.576 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=2, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.596 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[2] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.599 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.614 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=7, input physic otherD[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.612 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=3, infoType=0
evId=5, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.630 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.646 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=4, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.642 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.658 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=6, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.663 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.676 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.679 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=5, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.697 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.696 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=1, infoType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.712 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=7, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.715 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.731 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=2, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.731 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.748 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=0, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.749 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.765 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=3, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.766 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.782 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=1, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.783 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.799 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=4, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.801 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.816 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=2, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.816 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.833 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=5, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.834 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.852 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=3, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.851 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.866 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=6, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.869 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.892 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=4, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.884 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.900 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=7, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.909 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.917 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.933 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=2, infoType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.925 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=5, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.944 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.960 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=6, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.951 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.966 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=3, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.974.977 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.974.983 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.974.999 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=4, infoType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.974.997 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=1, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.016 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.014 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.975.029 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=2, infoType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.975.030 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=5, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.047 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.975.063 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=3, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.049 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.975.070 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=6, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.079 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.975.096 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=4, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.088 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.975.103 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=7, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.112 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.975.127 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=5, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.121 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.975.136 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=3, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.145 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.975.160 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=6, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.154 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.975.169 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=4, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.177 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.975.193 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=7, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.186 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.975.201 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=5, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.209 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.218 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.975.222 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=2, infoType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.975.232 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=6, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.239 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.975.254 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=3, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.249 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.975.264 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=7, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.270 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[3] linkTypeRaw[0]
[INF[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.281 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.975.296 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=4, infoType=0
O] RUNTIME(618662,python3.9):2025-04-03-09:27:45.975.286 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=4, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.313 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.317 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.975.329 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=5, infoType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.975.334 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=5, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.346 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.975.362 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=6, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.352 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.975.368 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=6, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.378 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.975.394 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=7, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.386 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.410 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.975.402 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=7, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.420 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.975.424 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=5, infoType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.975.433 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=3, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.441 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.975.457 [api_err[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.450 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.975.465 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=4, infoType=0
or.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=6, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.482 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.487 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.975.504 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.975.498 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=5, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.515 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.521 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.975.532 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=6, infoType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.975.536 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=6, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.549 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.553 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.975.569 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.975.565 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=7, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.582 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.587 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.975.598 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=4, infoType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.975.602 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=7, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.614 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.619 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.975.628 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=5, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.646 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.975.662 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=6, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.656 [hccl_communicator_attrs.cc:156] [618985][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[0], nicIp[192.168.100.101], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.678 [hccl_communicator_attrs.cc:156] [618985][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[1], nicIp[29.105.19.202], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.680 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.975.696 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devI[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.699 [hccl_communicator_attrs.cc:156] [618985][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[2], nicIp[29.105.165.16], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
d=3, input physic otherDevId=7, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.724 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.720 [hccl_communicator_attrs.cc:156] [618985][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[3], nicIp[29.105.51.138], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.975.739 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=5, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.739 [hccl_communicator_attrs.cc:156] [618985][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[4], nicIp[29.105.24.184], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.757 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.761 [hccl_communicator_attrs.cc:156] [618985][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[5], nicIp[29.105.72.114], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.975.773 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=6, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.781 [hccl_communicator_attrs.cc:156] [618985][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[6], nicIp[29.105.134.38], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.790 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.797 [hccl_communicator_attrs.cc:156] [618985][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[7], nicIp[29.105.73.96], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.975.807 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=7, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.824 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.820 [hccl_communicator_attrs.cc:1021] [618985][HcclCommunicatorAttrs][SetRanksPort] devicePortSwitchOn[0], isHaveCpuRank[0], isUseRankPort[0], nicRanksPort size[8], vnicRanksPort size[0].
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.975.838 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=6, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.838 [hccl_communicator.cc:1440] [618985][TcpMode][3] [1:TCP, 2:RDMA, 3:RESERVED]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.861 [hccl_communicator.cc:1450] [618985][Init][TcpMode]isTcpMode[0] nicDeploy[1] hcclDeviceNicDisable[0] hcclHostRdmaEnable[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.856 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.876 [externalinput.cc:1445] [618985]InitParsesProtocol start.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.975.872 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=7, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.891 [externalinput.cc:1462] [618985]environmental variable HCCL_NPU_NET_PROTOCOL is not set
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.890 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.975.906 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=7, infoType=0
[WARNING] HCCL(618674,python3.9):2025-04-03-09:27:45.975.908 [externalinput.cc:1411] [618985]can't find HELPER_RES_CONFIG or HELPER_RES_FILE_PATH, get protocol type from default path [/usr/local/Ascend/latest/conf/resource.json]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.924 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.933 [externalinput.cc:1413] [618985]default resource file is not exist.RDMA is used by default.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.950 [externalinput.cc:1467] [618985]Protocol[2], remoteIsHdc[1]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.961 [hccl_communicator_attrs.cc:156] [618984][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[0], nicIp[192.168.100.101], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.978 [config.cc:557] [618985][Config][SetRetryEnable]deviceType[2], superPodNum[0], serverNum[1], deviceNum[8],isDiffDeviceType[0], retryEnable[0].
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.975.984 [hccl_communicator_attrs.cc:156] [618984][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[1], nicIp[29.105.19.202], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.975.996 [hccl_communicator.cc:668] [618985][HcclCommunicator][SetRanksPort] devicePortSwitchOn[0], isHaveCpuRank[0], isUseRankPort[1], nicRanksPort size[8], vnicRanksPort size[0].
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.976.005 [hccl_communicator_attrs.cc:156] [618984][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[2], nicIp[29.105.165.16], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.976.025 [api_impl.cc:3520] 618985 GetPhyDeviceInfo: get phy device info, phyId=7
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.976.025 [hccl_communicator_attrs.cc:156] [618984][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[3], nicIp[29.105.51.138], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.976.042 [hccl_communicator_attrs.cc:156] [618984][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[4], nicIp[29.105.24.184], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.976.046 [api_impl.cc:3520] 618985 GetPhyDeviceInfo: get phy device info, phyId=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.976.064 [api_impl.cc:3168] 618985 EnableP2P: Enable P2P devIdDes=7, phyIdSrc=0.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.976.062 [hccl_communicator_attrs.cc:156] [618984][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[5], nicIp[29.105.72.114], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] DRV(618674,python3.9):2025-04-03-09:27:45.976.085 [devdrv_pcie.c:888][ascend][curpid:618674,618985][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=7; peer_phy_devid=0.)
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.976.103 [p2p_mgmt.cc:74] [618985]enable p2p: local logic id:7, remote physic id:0.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.976.081 [hccl_communicator_attrs.cc:156] [618984][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[6], nicIp[29.105.134.38], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.976.108 [hccl_communicator_attrs.cc:156] [618984][Get][NicInfo]serverId[192.168.0.44], serverIdx[0], rankIndex[7], nicIp[29.105.73.96], backupNicIp[0.0.0.0], deviceNicPort[65536], deviceVnicPort[65536], backupDevicePort[65536]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.976.117 [api_impl.cc:3520] 618985 GetPhyDeviceInfo: get phy device info, phyId=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.976.134 [api_impl.cc:3520] 618985 GetPhyDeviceInfo: get phy device info, phyId=1
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.976.128 [hccl_communicator_attrs.cc:1021] [618984][HcclCommunicatorAttrs][SetRanksPort] devicePortSwitchOn[0], isHaveCpuRank[0], isUseRankPort[0], nicRanksPort size[8], vnicRanksPort size[0].
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.976.148 [api_impl.cc:3168] 618985 EnableP2P: Enable P2P devIdDes=7, phyIdSrc=1.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.976.146 [hccl_communicator.cc:1440] [618984][TcpMode][3] [1:TCP, 2:RDMA, 3:RESERVED]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.976.174 [hccl_communicator.cc:1450] [618984][Init][TcpMode]isTcpMode[0] nicDeploy[1] hcclDeviceNicDisable[0] hcclHostRdmaEnable[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.976.192 [externalinput.cc:1445] [618984]InitParsesProtocol start.
[INFO] DRV(618674,python3.9):2025-04-03-09:27:45.976.179 [devdrv_pcie.c:888][ascend][curpid:618674,618985][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=7; peer_phy_devid=1.)
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.976.204 [p2p_mgmt.cc:74] [618985]enable p2p: local logic id:7, remote physic id:1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.976.218 [api_impl.cc:3520] 618985 GetPhyDeviceInfo: get phy device info, phyId=7
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.976.208 [externalinput.cc:1462] [618984]environmental variable HCCL_NPU_NET_PROTOCOL is not set
[WARNING] HCCL(618662,python3.9):2025-04-03-09:27:45.976.225 [externalinput.cc:1411] [618984]can't find HELPER_RES_CONFIG or HELPER_RES_FILE_PATH, get protocol type from default path [/usr/local/Ascend/latest/conf/resource.json]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.976.233 [api_impl.cc:3520] 618985 GetPhyDeviceInfo: get phy device info, phyId=2
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.976.247 [externalinput.cc:1413] [618984]default resource file is not exist.RDMA is used by default.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.976.250 [api_impl.cc:3168] 618985 EnableP2P: Enable P2P devIdDes=7, phyIdSrc=2.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.976.261 [externalinput.cc:1467] [618984]Protocol[2], remoteIsHdc[1]
[INFO] DRV(618674,python3.9):2025-04-03-09:27:45.976.266 [devdrv_pcie.c:888][ascend][curpid:618674,618985][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=7; peer_phy_devid=2.)
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.976.283 [p2p_mgmt.cc:74] [618985]enable p2p: local logic id:7, remote physic id:2.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.976.297 [api_impl.cc:3520] 618985 GetPhyDeviceInfo: get phy device info, phyId=7
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.976.300 [config.cc:557] [618984][Config][SetRetryEnable]deviceType[2], superPodNum[0], serverNum[1], deviceNum[8],isDiffDeviceType[0], retryEnable[0].
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.976.313 [api_impl.cc:3520] 618985 GetPhyDeviceInfo: get phy device info, phyId=3
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.976.318 [hccl_communicator.cc:668] [618984][HcclCommunicator][SetRanksPort] devicePortSwitchOn[0], isHaveCpuRank[0], isUseRankPort[1], nicRanksPort size[8], vnicRanksPort size[0].
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.976.330 [api_impl.cc:3168] 618985 EnableP2P: Enable P2P devIdDes=7, phyIdSrc=3.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.976.344 [api_impl.cc:3520] 618984 GetPhyDeviceInfo: get phy device info, phyId=4
[INFO] DRV(618674,python3.9):2025-04-03-09:27:45.976.350 [devdrv_pcie.c:888][ascend][curpid:618674,618985][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=7; peer_phy_devid=3.)
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.976.373 [p2p_mgmt.cc:74] [618985]enable p2p: local logic id:7, remote physic id:3.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.976.364 [api_impl.cc:3520] 618984 GetPhyDeviceInfo: get phy device info, phyId=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.976.387 [api_impl.cc:3520] 618985 GetPhyDeviceInfo: get phy device info, phyId=7
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.976.382 [api_impl.cc:3168] 618984 EnableP2P: Enable P2P devIdDes=4, phyIdSrc=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.976.402 [api_impl.cc:3520] 618985 GetPhyDeviceInfo: get phy device info, phyId=4
[INFO] DRV(618662,python3.9):2025-04-03-09:27:45.976.400 [devdrv_pcie.c:888][ascend][curpid:618662,618984][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=4; peer_phy_devid=0.)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.976.417 [api_impl.cc:3168] 618985 EnableP2P: Enable P2P devIdDes=7, phyIdSrc=4.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.976.417 [p2p_mgmt.cc:74] [618984]enable p2p: local logic id:4, remote physic id:0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.976.431 [api_impl.cc:3520] 618984 GetPhyDeviceInfo: get phy device info, phyId=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.976.444 [api_impl.cc:3520] 618984 GetPhyDeviceInfo: get phy device info, phyId=1
[INFO] DRV(618674,python3.9):2025-04-03-09:27:45.976.433 [devdrv_pcie.c:888][ascend][curpid:618674,618985][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=7; peer_phy_devid=4.)
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.976.449 [p2p_mgmt.cc:74] [618985]enable p2p: local logic id:7, remote physic id:4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.976.458 [api_impl.cc:3168] 618984 EnableP2P: Enable P2P devIdDes=4, phyIdSrc=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.976.463 [api_impl.cc:3520] 618985 GetPhyDeviceInfo: get phy device info, phyId=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.976.478 [api_impl.cc:3520] 618985 GetPhyDeviceInfo: get phy device info, phyId=5
[INFO] DRV(618662,python3.9):2025-04-03-09:27:45.976.476 [devdrv_pcie.c:888][ascend][curpid:618662,618984][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=4; peer_phy_devid=1.)
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.976.492 [p2p_mgmt.cc:74] [618984]enable p2p: local logic id:4, remote physic id:1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.976.493 [api_impl.cc:3168] 618985 EnableP2P: Enable P2P devIdDes=7, phyIdSrc=5.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.976.506 [api_impl.cc:3520] 618984 GetPhyDeviceInfo: get phy device info, phyId=4
[INFO] DRV(618674,python3.9):2025-04-03-09:27:45.976.509 [devdrv_pcie.c:888][ascend][curpid:618674,618985][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=7; peer_phy_devid=5.)
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.976.522 [p2p_mgmt.cc:74] [618985]enable p2p: local logic id:7, remote physic id:5.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.976.536 [api_impl.cc:3520] 618985 GetPhyDeviceInfo: get phy device info, phyId=7
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.976.520 [api_impl.cc:3520] 618984 GetPhyDeviceInfo: get phy device info, phyId=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.976.536 [api_impl.cc:3168] 618984 EnableP2P: Enable P2P devIdDes=4, phyIdSrc=2.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.976.551 [api_impl.cc:3520] 618985 GetPhyDeviceInfo: get phy device info, phyId=6
[INFO] DRV(618662,python3.9):2025-04-03-09:27:45.976.553 [devdrv_pcie.c:888][ascend][curpid:618662,618984][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=4; peer_phy_devid=2.)
[INFO] HCCL(618662,py[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:45.976.567 [api_impl.cc:3168] 618985 EnableP2P: Enable P2P devIdDes=7, phyIdSrc=6.
thon3.9):2025-04-03-09:27:45.976.568 [p2p_mgmt.cc:74] [618984]enable p2p: local logic id:4, remote physic id:2.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.976.594 [api_impl.cc:3520] 618984 GetPhyDeviceInfo: get phy device info, phyId=4
[INFO] DRV(618674,python3.9):2025-04-03-09:27:45.976.582 [devdrv_pcie.c:888][ascend][curpid:618674,618985][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=7; peer_phy_devid=6.)
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.976.598 [p2p_mgmt.cc:74] [618985]enable p2p: local logic id:7, remote physic id:6.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.976.608 [api_impl.cc:3520] 618984 GetPhyDeviceInfo: get phy device info, phyId=3
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.976.623 [api_impl.cc:3168] 618984 EnableP2P: Enable P2P devIdDes=4, phyIdSrc=3.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.976.624 [adapter_hal.cc:298] [618985]Entry-hrtDrvGetPlatformInfo
[INFO] DRV(618662,python3.9):2025-04-03-09:27:45.976.641 [devdrv_pcie.c:888][ascend][curpid:618662,618984][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=4; peer_phy_devid=3.)
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.976.647 [sal.cc:593] [618985]IsHostUseDevNic[1]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.976.657 [p2p_mgmt.cc:74] [618984]enable p2p: local logic id:4, remote physic id:3.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.976.672 [api_impl.cc:3520] 618984 GetPhyDeviceInfo: get phy device info, phyId=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.976.686 [api_impl.cc:3520] 618984 GetPhyDeviceInfo: get phy device info, phyId=5
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.976.696 [adapter_hal.cc:298] [618985]Entry-hrtDrvGetPlatformInfo
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.976.703 [api_impl.cc:3168] 618984 EnableP2P: Enable P2P devIdDes=4, phyIdSrc=5.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.976.717 [sal.cc:593] [618985]IsHostUseDevNic[1]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.976.732 [network_manager.cc:69] [618985]NetworkManager::GetInstance deviceLogicID[7].
[INFO] DRV(618662,python3.9):2025-04-03-09:27:45.976.721 [devdrv_pcie.c:888][ascend][curpid:618662,618984][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=4; peer_phy_devid=5.)
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.976.738 [p2p_mgmt.cc:74] [618984]enable p2p: local logic id:4, remote physic id:5.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.976.752 [api_impl.cc:3520] 618984 GetPhyDeviceInfo: get phy device info, phyId=4
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.976.745 [network_manager.cc:169] [618985]NetworkManager: devicePhyId[4294967295], devicePhyId_[7] deviceLogicId_[7], hasBackup[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.976.766 [api_impl.cc:3520] 618984 GetPhyDeviceInfo: get phy device info, phyId=6
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.976.765 [tsd_client.cpp:189][TsdCapabilityGet][tid:618985] TsdCapabilityGet Begin.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.976.781 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618985] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.976.780 [api_impl.cc:3168] 618984 EnableP2P: Enable P2P devIdDes=4, phyIdSrc=6.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.976.795 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618985] [TsdClient] g_userDeviceInfo is empty.
[INFO] DRV(618662,python3.9):2025-04-03-09:27:45.976.799 [devdrv_pcie.c:888][ascend][curpid:618662,618984][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=4; peer_phy_devid=6.)
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.976.815 [p2p_mgmt.cc:74] [618984]enable p2p: local logic id:4, remote physic id:6.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.976.810 [process_mode_manager.cpp:1042][CapabilityGet][tid:618985] [ProcessModeManager] enter into CapabilityGet process deviceId[7] type[6]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.976.828 [adapter_tdt.cc:66] [618985]Get TsdCapability success. deviceLogicId[7]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.976.829 [api_impl.cc:3520] 618984 GetPhyDeviceInfo: get phy device info, phyId=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.976.844 [api_impl.cc:3520] 618984 GetPhyDeviceInfo: get phy device info, phyId=7
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.976.842 [network_manager.cc:175] [618985][NetworkManager][Init]supportMultiProcHCCP[1], hasBackup[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:45.976.857 [api_impl.cc:3168] 618984 EnableP2P: Enable P2P devIdDes=4, phyIdSrc=7.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:45.976.862 [network_manager.cc:99] [618985][TsdProcessOpen]params: halAPIVersion[467736], BACKUP_DEVICE_LOG_DEV_VERSION[467736]
[INFO] DRV(618662,python3.9):2025-04-03-09:27:45.976.876 [devdrv_pcie.c:888][ascend][curpid:618662,618984][drv][devmng][drvP2PAttrOp]Enable P2P. (logic_devid=4; peer_phy_devid=7.)
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.976.892 [p2p_mgmt.cc:74] [618984]enable p2p: local logic id:4, remote physic id:7.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.976.886 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618985] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.976.900 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618985] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.976.913 [process_mode_manager.cpp:1434][ProcessOpenSubProc][tid:618985] enter into ProcessOpenSubProc subtype:0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.976.917 [adapter_hal.cc:298] [618984]Entry-hrtDrvGetPlatformInfo
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.976.926 [process_mode_manager.cpp:386][InitTsdClient][tid:618985] [TsdClient] tsd client has been inited before
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.976.940 [sal.cc:593] [618984]IsHostUseDevNic[1]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.976.942 [process_mode_manager.cpp:1363][SetCommonOpenParamList][tid:618985] cnt:0, extra parameters:--hdcType=18, len:12
[WARNING] TDT(618674,python3.9):2025-04-03-09:27:45.976.961 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618985] Get env[ASCEND_LATEST_INSTALL_PATH] failed
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.976.975 [process_mode_manager.cpp:1680][GetAscendLatestIntallPath][tid:618985] latest install path:/usr/local/Ascend/ascend-toolkit/latest
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.976.990 [process_mode_manager.cpp:1383][ConstructCommonOpenMsg][tid:618985] runtimePkgPath:/usr/local/Ascend/ascend-toolkit/latest
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.976.986 [adapter_hal.cc:298] [618984]Entry-hrtDrvGetPlatformInfo
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.977.004 [process_mode_manager.cpp:1389][ConstructCommonOpenMsg][tid:618985] hostLibPath:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/lib:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/examples:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/tests/atbopstest:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64/plugin:/usr/local/Ascend/ascend-toolkit/latest/lib64:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/opskernel:/usr/local/Ascend/ascend-toolkit/
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.977.007 [sal.cc:593] [618984]IsHostUseDevNic[1]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.977.023 [network_manager.cc:69] [618984]NetworkManager::GetInstance deviceLogicID[4].
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.977.037 [network_manager.cc:169] [618984]NetworkManager: devicePhyId[4294967295], devicePhyId_[4] deviceLogicId_[4], hasBackup[0]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:45.977.047 [hdc_client.cpp:154][TsdRecvData][tid:618985] recv timeout is:150000 ms
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.977.056 [tsd_client.cpp:189][TsdCapabilityGet][tid:618984] TsdCapabilityGet Begin.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.977.072 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618984] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.977.086 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618984] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.977.114 [process_mode_manager.cpp:1042][CapabilityGet][tid:618984] [ProcessModeManager] enter into CapabilityGet process deviceId[4] type[6]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.977.128 [adapter_tdt.cc:66] [618984]Get TsdCapability success. deviceLogicId[4]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.977.141 [network_manager.cc:175] [618984][NetworkManager][Init]supportMultiProcHCCP[1], hasBackup[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:45.977.162 [network_manager.cc:99] [618984][TsdProcessOpen]params: halAPIVersion[467736], BACKUP_DEVICE_LOG_DEV_VERSION[467736]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.977.180 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618984] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.977.195 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618984] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.977.207 [process_mode_manager.cpp:1434][ProcessOpenSubProc][tid:618984] enter into ProcessOpenSubProc subtype:0
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.977.220 [process_mode_manager.cpp:386][InitTsdClient][tid:618984] [TsdClient] tsd client has been inited before
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.977.236 [process_mode_manager.cpp:1363][SetCommonOpenParamList][tid:618984] cnt:0, extra parameters:--hdcType=18, len:12
[WARNING] TDT(618662,python3.9):2025-04-03-09:27:45.977.254 [env_internal_api.cpp:22][GetEnvFromMmSys][tid:618984] Get env[ASCEND_LATEST_INSTALL_PATH] failed
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.977.270 [process_mode_manager.cpp:1680][GetAscendLatestIntallPath][tid:618984] latest install path:/usr/local/Ascend/ascend-toolkit/latest
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.977.282 [process_mode_manager.cpp:1383][ConstructCommonOpenMsg][tid:618984] runtimePkgPath:/usr/local/Ascend/ascend-toolkit/latest
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.977.296 [process_mode_manager.cpp:1389][ConstructCommonOpenMsg][tid:618984] hostLibPath:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/lib:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/examples:/usr/local/Ascend/nnal/atb/latest/atb/cxx_abi_0/tests/atbopstest:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64:/usr/local/Ascend/ascend-toolkit/latest/tools/aml/lib64/plugin:/usr/local/Ascend/ascend-toolkit/latest/lib64:/usr/local/Ascend/ascend-toolkit/latest/lib64/plugin/opskernel:/usr/local/Ascend/ascend-toolkit/
[INFO] TDT(618662,python3.9):2025-04-03-09:27:45.977.339 [hdc_client.cpp:154][TsdRecvData][tid:618984] recv timeout is:150000 ms
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:46.052.174 [queue_client_comm.c:114][ascend][curpid:618654,618949][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:46.052.175 [queue_client_comm.c:114][ascend][curpid:618654,618947][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:46.052.175 [queue_client_comm.c:114][ascend][curpid:618654,618943][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:46.052.176 [queue_client_comm.c:114][ascend][curpid:618654,618945][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:46.052.175 [queue_client_comm.c:114][ascend][curpid:618654,618941][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:46.052.177 [queue_client_comm.c:114][ascend][curpid:618654,618951][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:46.052.168 [trs_cb_event.c:119][ascend][curpid:618646,618837][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =65; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:46.052.180 [trs_cb_event.c:119][ascend][curpid:618646,618836][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =64; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:46.052.189 [trs_sqcq.c:1491][ascend][curpid:618646,618837][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:46.052.227 [trs_sqcq.c:1491][ascend][curpid:618646,618836][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:46.052.235 [npu_driver.cc:3833] 618837 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:46.052.246 [npu_driver.cc:3833] 618836 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:46.052.257 [api_impl.cc:5058] 618837 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:46.052.265 [api_impl.cc:5058] 618836 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.052.277 [callback.cpp:132]618837 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.052.285 [callback.cpp:132]618836 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.052.299 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.052.309 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:46.052.293 [npu_driver.cc:4338] 618949 MemQueuePeek: queue empty
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.052.321 [npu_driver.cc:3828] 618837 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=65.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.052.315 [tensor_data_transfer.cpp:612]618949 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_scalar_summary
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:46.052.329 [npu_driver.cc:4338] 618947 MemQueuePeek: queue empty
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.052.330 [npu_driver.cc:3828] 618836 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=64.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.052.331 [tensor_data_transfer.cpp:1054]618949 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_scalar_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.052.351 [tensor_data_transfer.cpp:612]618947 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_image_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.052.355 [tensor_data_transfer.cpp:1056]618949 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:46.052.364 [npu_driver.cc:4338] 618943 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.052.370 [tensor_data_transfer.cpp:1054]618947 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_image_summary
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.052.375 [api_impl.cc:6121] 618949 MemQueuePeek: Start to peek queue on devId 2, qid is 4.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.052.383 [tensor_data_transfer.cpp:612]618943 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_tensor_dump
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.052.389 [tensor_data_transfer.cpp:1056]618947 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.052.399 [npu_driver.cc:4330] 618949 MemQueuePeek: peek mem queue, deviceId=2, qid=4, timeout=800.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:46.052.404 [npu_driver.cc:4338] 618945 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.052.407 [tensor_data_transfer.cpp:1054]618943 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_tensor_dump
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.052.414 [api_impl.cc:6121] 618947 MemQueuePeek: Start to peek queue on devId 2, qid is 3.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.052.427 [tensor_data_transfer.cpp:612]618945 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_tensor_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.052.434 [tensor_data_transfer.cpp:1056]618943 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:46.052.436 [npu_driver.cc:4338] 618941 MemQueuePeek: queue empty
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.052.475 [api_impl.cc:6121] 618943 MemQueuePeek: Start to peek queue on devId 2, qid is 1.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.052.446 [tensor_data_transfer.cpp:1054]618945 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_tensor_summary
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:46.052.476 [npu_driver.cc:4338] 618951 MemQueuePeek: queue empty
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.052.439 [npu_driver.cc:4330] 618947 MemQueuePeek: peek mem queue, deviceId=2, qid=3, timeout=800.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.052.491 [tensor_data_transfer.cpp:612]618941 acltdtReceiveTensorV2: queue is empty, device is 2, name is _npu_log
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.052.495 [npu_driver.cc:4330] 618943 MemQueuePeek: peek mem queue, deviceId=2, qid=1, timeout=800.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.052.503 [tensor_data_transfer.cpp:1056]618945 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.052.511 [tensor_data_transfer.cpp:612]618951 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_histogram_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.052.524 [tensor_data_transfer.cpp:1054]618941 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is _npu_log
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.052.536 [api_impl.cc:6121] 618945 MemQueuePeek: Start to peek queue on devId 2, qid is 2.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.052.543 [tensor_data_transfer.cpp:1054]618951 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_histogram_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.052.547 [tensor_data_transfer.cpp:1056]618941 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.052.554 [npu_driver.cc:4330] 618945 MemQueuePeek: peek mem queue, deviceId=2, qid=2, timeout=800.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.052.560 [tensor_data_transfer.cpp:1056]618951 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.052.570 [api_impl.cc:6121] 618941 MemQueuePeek: Start to peek queue on devId 2, qid is 0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.052.582 [api_impl.cc:6121] 618951 MemQueuePeek: Start to peek queue on devId 2, qid is 5.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.052.588 [npu_driver.cc:4330] 618941 MemQueuePeek: peek mem queue, deviceId=2, qid=0, timeout=800.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.052.596 [npu_driver.cc:4330] 618951 MemQueuePeek: peek mem queue, deviceId=2, qid=5, timeout=800.
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:46.116.184 [queue_client_comm.c:114][ascend][curpid:618646,618961][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:46.116.189 [queue_client_comm.c:114][ascend][curpid:618646,618963][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:46.116.189 [queue_client_comm.c:114][ascend][curpid:618646,618965][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:46.116.314 [npu_driver.cc:4338] 618961 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.116.330 [tensor_data_transfer.cpp:612]618961 acltdtReceiveTensorV2: queue is empty, device is 0, name is _npu_log
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:46.116.342 [npu_driver.cc:4338] 618963 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.116.344 [tensor_data_transfer.cpp:1054]618961 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is _npu_log
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.116.377 [tensor_data_transfer.cpp:612]618963 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_tensor_dump
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:46.116.383 [npu_driver.cc:4338] 618965 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.116.386 [tensor_data_transfer.cpp:1056]618961 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.116.398 [tensor_data_transfer.cpp:1054]618963 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_tensor_dump
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.116.407 [tensor_data_transfer.cpp:612]618965 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_tensor_summary
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.116.412 [api_impl.cc:6121] 618961 MemQueuePeek: Start to peek queue on devId 0, qid is 0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.116.421 [tensor_data_transfer.cpp:1056]618963 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.116.448 [tensor_data_transfer.cpp:1054]618965 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_tensor_summary
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.116.452 [npu_driver.cc:4330] 618961 MemQueuePeek: peek mem queue, deviceId=0, qid=0, timeout=800.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.116.462 [api_impl.cc:6121] 618963 MemQueuePeek: Start to peek queue on devId 0, qid is 1.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.116.470 [tensor_data_transfer.cpp:1056]618965 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.116.484 [npu_driver.cc:4330] 618963 MemQueuePeek: peek mem queue, deviceId=0, qid=1, timeout=800.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.116.493 [api_impl.cc:6121] 618965 MemQueuePeek: Start to peek queue on devId 0, qid is 2.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.116.531 [npu_driver.cc:4330] 618965 MemQueuePeek: peek mem queue, deviceId=0, qid=2, timeout=800.
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:46.148.174 [queue_client_comm.c:114][ascend][curpid:618646,618967][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:46.148.176 [queue_client_comm.c:114][ascend][curpid:618646,618969][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:46.148.210 [queue_client_comm.c:114][ascend][curpid:618646,618971][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:46.148.315 [npu_driver.cc:4338] 618967 MemQueuePeek: queue empty
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:46.148.326 [npu_driver.cc:4338] 618969 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.148.333 [tensor_data_transfer.cpp:612]618967 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_image_summary
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:46.148.335 [npu_driver.cc:4338] 618971 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.148.341 [tensor_data_transfer.cpp:612]618969 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_scalar_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.148.346 [tensor_data_transfer.cpp:1054]618967 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_image_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.148.358 [tensor_data_transfer.cpp:612]618971 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_histogram_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.148.367 [tensor_data_transfer.cpp:1054]618969 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_scalar_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.148.369 [tensor_data_transfer.cpp:1056]618967 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.148.381 [tensor_data_transfer.cpp:1054]618971 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_histogram_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.148.387 [tensor_data_transfer.cpp:1056]618969 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.148.392 [api_impl.cc:6121] 618967 MemQueuePeek: Start to peek queue on devId 0, qid is 3.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.148.401 [tensor_data_transfer.cpp:1056]618971 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.148.412 [api_impl.cc:6121] 618969 MemQueuePeek: Start to peek queue on devId 0, qid is 4.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.148.427 [npu_driver.cc:4330] 618967 MemQueuePeek: peek mem queue, deviceId=0, qid=3, timeout=800.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.148.441 [api_impl.cc:6121] 618971 MemQueuePeek: Start to peek queue on devId 0, qid is 5.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.148.448 [npu_driver.cc:4330] 618969 MemQueuePeek: peek mem queue, deviceId=0, qid=4, timeout=800.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.148.462 [npu_driver.cc:4330] 618971 MemQueuePeek: peek mem queue, deviceId=0, qid=5, timeout=800.
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:46.180.169 [trs_cb_event.c:119][ascend][curpid:618666,618809][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =65; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:46.180.169 [trs_cb_event.c:119][ascend][curpid:618666,618808][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =64; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:46.180.188 [trs_sqcq.c:1491][ascend][curpid:618666,618809][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:46.180.194 [trs_sqcq.c:1491][ascend][curpid:618666,618808][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:46.180.200 [npu_driver.cc:3833] 618809 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:46.180.205 [npu_driver.cc:3833] 618808 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:46.180.211 [api_impl.cc:5058] 618809 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:46.180.216 [api_impl.cc:5058] 618808 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:46.180.223 [callback.cpp:132]618809 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:46.180.226 [callback.cpp:132]618808 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:46.180.237 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:46.180.239 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:46.180.260 [npu_driver.cc:3828] 618809 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=65.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:46.180.261 [npu_driver.cc:3828] 618808 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=64.
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:46.212.175 [trs_cb_event.c:119][ascend][curpid:618658,618774][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =64; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:46.212.182 [trs_cb_event.c:119][ascend][curpid:618658,618775][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =65; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:46.212.203 [trs_sqcq.c:1491][ascend][curpid:618658,618774][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:46.212.214 [trs_sqcq.c:1491][ascend][curpid:618658,618775][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:46.212.225 [npu_driver.cc:3833] 618774 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:46.212.234 [npu_driver.cc:3833] 618775 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:46.212.244 [api_impl.cc:5058] 618774 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:46.212.254 [api_impl.cc:5058] 618775 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:46.212.264 [callback.cpp:132]618774 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:46.212.275 [callback.cpp:132]618775 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:46.212.303 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:46.212.314 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:46.212.327 [npu_driver.cc:3828] 618774 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=64.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:46.212.338 [npu_driver.cc:3828] 618775 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=65.
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:46.244.167 [trs_cb_event.c:119][ascend][curpid:618674,618819][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =65; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:46.244.174 [trs_cb_event.c:119][ascend][curpid:618674,618818][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =64; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:46.244.201 [trs_sqcq.c:1491][ascend][curpid:618674,618819][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:46.244.167 [trs_cb_event.c:119][ascend][curpid:618662,618816][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =832; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:46.244.168 [trs_cb_event.c:119][ascend][curpid:618662,618817][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =833; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:46.244.196 [trs_sqcq.c:1491][ascend][curpid:618662,618816][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:46.244.203 [trs_sqcq.c:1491][ascend][curpid:618662,618817][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:46.244.212 [trs_sqcq.c:1491][ascend][curpid:618674,618818][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:46.244.212 [npu_driver.cc:3833] 618816 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=832, drvRetCode=16.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:46.244.223 [npu_driver.cc:3833] 618819 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:46.244.232 [npu_driver.cc:3833] 618818 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:46.244.221 [npu_driver.cc:3833] 618817 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=833, drvRetCode=16.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:46.244.245 [api_impl.cc:5058] 618816 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:46.244.242 [api_impl.cc:5058] 618819 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:46.244.252 [api_impl.cc:5058] 618817 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:46.244.260 [callback.cpp:132]618816 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:46.244.266 [callback.cpp:132]618817 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:46.244.254 [api_impl.cc:5058] 618818 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:46.244.265 [callback.cpp:132]618[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:46.244.276 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:46.244.282 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:46.244.295 [npu_driver.cc:3828] 618816 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=832.
819 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:46.244.275 [callback.cpp:132]618818 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:46.244.306 [npu_driver.cc:3828] 618817 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=833.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:46.244.303 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:46.244.313 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:46.244.327 [npu_driver.cc:3828] 618819 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=65.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:46.244.335 [npu_driver.cc:3828] 618818 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=64.
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:46.276.163 [trs_cb_event.c:119][ascend][curpid:618670,618822][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =64; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:46.276.165 [trs_cb_event.c:119][ascend][curpid:618670,618823][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =65; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:46.276.186 [trs_sqcq.c:1491][ascend][curpid:618670,618822][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:46.276.190 [trs_sqcq.c:1491][ascend][curpid:618670,618823][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:46.276.197 [npu_driver.cc:3833] 618822 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:46.276.202 [npu_driver.cc:3833] 618823 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:46.276.213 [api_impl.cc:5058] 618822 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:46.276.218 [api_impl.cc:5058] 618823 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:46.276.234 [callback.cpp:132]618822 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:46.276.242 [callback.cpp:132]618823 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:46.276.247 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:46.276.256 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:46.276.262 [npu_driver.cc:3828] 618822 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=64.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:46.276.270 [npu_driver.cc:3828] 618823 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=65.
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:46.372.181 [trs_cb_event.c:119][ascend][curpid:618650,618829][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =321; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:46.372.183 [trs_cb_event.c:119][ascend][curpid:618650,618828][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =320; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:46.372.208 [trs_sqcq.c:1491][ascend][curpid:618650,618829][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:46.372.225 [trs_sqcq.c:1491][ascend][curpid:618650,618828][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:46.372.227 [npu_driver.cc:3833] 618829 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:46.372.243 [api_impl.cc:5058] 618829 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:46.372.241 [npu_driver.cc:3833] 618828 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=320, drvRetCode=16.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:46.372.265 [callback.cpp:132]618829 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:46.372.268 [api_impl.cc:5058] 618828 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:46.372.278 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:46.372.285 [callback.cpp:132]618828 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:46.372.292 [npu_driver.cc:3828] 618829 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=321.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:46.372.299 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:46.372.315 [npu_driver.cc:3828] 618828 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=320.
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:46.468.178 [trs_cb_event.c:119][ascend][curpid:618654,618833][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =321; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:46.468.179 [trs_cb_event.c:119][ascend][curpid:618654,618832][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =320; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:46.468.206 [trs_sqcq.c:1491][ascend][curpid:618654,618833][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:46.468.216 [trs_sqcq.c:1491][ascend][curpid:618654,618832][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:46.468.225 [npu_driver.cc:3833] 618833 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:46.468.234 [npu_driver.cc:3833] 618832 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=320, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:46.468.240 [api_impl.cc:5058] 618833 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:46.468.249 [api_impl.cc:5058] 618832 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.468.278 [callback.cpp:132]618833 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.468.288 [callback.cpp:132]618832 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.468.293 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.468.304 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.468.313 [npu_driver.cc:3828] 618833 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=321.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.468.322 [npu_driver.cc:3828] 618832 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=320.
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:46.532.173 [queue_client_comm.c:114][ascend][curpid:618658,618785][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:46.532.178 [queue_client_comm.c:114][ascend][curpid:618658,618787][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:46.532.186 [queue_client_comm.c:114][ascend][curpid:618658,618779][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:46.532.186 [queue_client_comm.c:114][ascend][curpid:618658,618781][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:46.532.187 [queue_client_comm.c:114][ascend][curpid:618658,618789][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:46.532.190 [queue_client_comm.c:114][ascend][curpid:618658,618783][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:46.532.296 [npu_driver.cc:4338] 618785 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:46.532.315 [tensor_data_transfer.cpp:612]618785 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_image_summary
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:46.532.317 [npu_driver.cc:4338] 618787 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:46.532.329 [tensor_data_transfer.cpp:1054]618785 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_image_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:46.532.342 [tensor_data_transfer.cpp:1056]618785 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:46.532.333 [tensor_data_transfer.cpp:612]618787 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_scalar_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:46.532.355 [api_impl.cc:6121] 618785 MemQueuePeek: Start to peek queue on devId 3, qid is 3.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:46.532.361 [tensor_data_transfer.cpp:1054]618787 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_scalar_summary
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:46.532.365 [npu_driver.cc:4338] 618779 MemQueuePeek: queue empty
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:46.532.368 [npu_driver.cc:4330] 618785 MemQueuePeek: peek mem queue, deviceId=3, qid=3, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:46.532.373 [tensor_data_transfer.cpp:1056]618787 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:46.532.388 [tensor_data_transfer.cpp:612]618779 acltdtReceiveTensorV2: queue is empty, device is 3, name is _npu_log
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:46.532.398 [npu_driver.cc:4338] 618781 MemQueuePeek: queue empty
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:46.532.400 [api_impl.cc:6121] 618787 MemQueuePeek: Start to peek queue on devId 3, qid is 4.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:46.532.434 [tensor_data_transfer.cpp:1054]618779 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is _npu_log
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:46.532.439 [tensor_data_transfer.cpp:612]618781 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_tensor_dump
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:46.532.441 [npu_driver.cc:4338] 618789 MemQueuePeek: queue empty
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:46.532.472 [npu_driver.cc:4338] 618783 MemQueuePeek: queue empty
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:46.532.482 [npu_driver.cc:4330] 618787 MemQueuePeek: peek mem queue, deviceId=3, qid=4, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:46.532.493 [tensor_data_transfer.cpp:1056]618779 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:46.532.501 [tensor_data_transfer.cpp:1054]618781 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_tensor_dump
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:46.532.513 [tensor_data_transfer.cpp:612]618789 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_histogram_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:46.532.524 [tensor_data_transfer.cpp:612]618783 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_tensor_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:46.532.554 [api_impl.cc:6121] 618779 MemQueuePeek: Start to peek queue on devId 3, qid is 0.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:46.532.559 [tensor_data_transfer.cpp:1056]618781 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:46.532.567 [tensor_data_transfer.cpp:1054]618789 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_histogram_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:46.532.573 [tensor_data_transfer.cpp:1054]618783 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_tensor_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:46.532.580 [npu_driver.cc:4330] 618779 MemQueuePeek: peek mem queue, deviceId=3, qid=0, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:46.532.587 [api_impl.cc:6121] 618781 MemQueuePeek: Start to peek queue on devId 3, qid is 1.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:46.532.595 [tensor_data_transfer.cpp:1056]618789 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:46.532.600 [tensor_data_transfer.cpp:1056]618783 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:46.532.611 [npu_driver.cc:4330] 618781 MemQueuePeek: peek mem queue, deviceId=3, qid=1, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:46.532.620 [api_impl.cc:6121] 618789 MemQueuePeek: Start to peek queue on devId 3, qid is 5.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:46.532.625 [api_impl.cc:6121] 618783 MemQueuePeek: Start to peek queue on devId 3, qid is 2.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:46.532.641 [npu_driver.cc:4330] 618789 MemQueuePeek: peek mem queue, deviceId=3, qid=5, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:46.532.648 [npu_driver.cc:4330] 618783 MemQueuePeek: peek mem queue, deviceId=3, qid=2, timeout=800.
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:46.564.176 [trs_cb_event.c:119][ascend][curpid:618646,618837][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =65; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:46.564.176 [trs_cb_event.c:119][ascend][curpid:618646,618836][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =64; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:46.564.199 [trs_sqcq.c:1491][ascend][curpid:618646,618837][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:46.564.218 [trs_sqcq.c:1491][ascend][curpid:618646,618836][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:46.564.225 [npu_driver.cc:3833] 618837 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:46.564.241 [npu_driver.cc:3833] 618836 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:46.564.249 [api_impl.cc:5058] 618837 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:46.564.260 [api_impl.cc:5058] 618836 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.564.268 [callback.cpp:132]618837 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.564.281 [callback.cpp:132]618836 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.564.285 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.564.299 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.564.309 [npu_driver.cc:3828] 618837 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=65.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.564.321 [npu_driver.cc:3828] 618836 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=64.
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:46.596.172 [queue_client_comm.c:114][ascend][curpid:618666,618847][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:46.596.173 [queue_client_comm.c:114][ascend][curpid:618666,618843][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:46.596.174 [queue_client_comm.c:114][ascend][curpid:618666,618851][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:46.596.180 [queue_client_comm.c:114][ascend][curpid:618666,618841][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:46.596.182 [queue_client_comm.c:114][ascend][curpid:618666,618845][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:46.596.182 [queue_client_comm.c:114][ascend][curpid:618666,618849][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:46.596.283 [npu_driver.cc:4338] 618847 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:46.596.300 [tensor_data_transfer.cpp:612]618847 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_image_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:46.596.314 [tensor_data_transfer.cpp:1054]618847 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_image_summary
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:46.596.318 [npu_driver.cc:4338] 618843 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:46.596.325 [tensor_data_transfer.cpp:1056]618847 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:46.596.331 [tensor_data_transfer.cpp:612]618843 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_tensor_dump
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:46.596.336 [api_impl.cc:6121] 618847 MemQueuePeek: Start to peek queue on devId 5, qid is 3.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:46.596.346 [tensor_data_transfer.cpp:1054]618843 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_tensor_dump
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:46.596.349 [npu_driver.cc:4330] 618847 MemQueuePeek: peek mem queue, deviceId=5, qid=3, timeout=800.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:46.596.357 [tensor_data_transfer.cpp:1056]618843 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:46.596.362 [npu_driver.cc:4338] 618851 MemQueuePeek: queue empty
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:46.596.368 [api_impl.cc:6121] 618843 MemQueuePeek: Start to peek queue on devId 5, qid is 1.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:46.596.380 [tensor_data_transfer.cpp:612]618851 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_histogram_summary
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:46.596.382 [npu_driver.cc:4330] 618843 MemQueuePeek: peek mem queue, deviceId=5, qid=1, timeout=800.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:46.596.393 [npu_driver.cc:4338] 618841 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:46.596.393 [tensor_data_transfer.cpp:1054]618851 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_histogram_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:46.596.422 [tensor_data_transfer.cpp:612]618841 acltdtReceiveTensorV2: queue is empty, device is 5, name is _npu_log
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:46.596.428 [tensor_data_transfer.cpp:1056]618851 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:46.596.432 [npu_driver.cc:4338] 618845 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:46.596.439 [tensor_data_transfer.cpp:1054]618841 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is _npu_log
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:46.596.447 [api_impl.cc:6121] 618851 MemQueuePeek: Start to peek queue on devId 5, qid is 5.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:46.596.456 [tensor_data_transfer.cpp:612]618845 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_tensor_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:46.596.459 [tensor_data_transfer.cpp:1056]618841 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:46.596.467 [npu_driver.cc:4330] 618851 MemQueuePeek: peek mem queue, deviceId=5, qid=5, timeout=800.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:46.596.475 [tensor_data_transfer.cpp:1054]618845 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_tensor_summary
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:46.596.480 [api_impl.cc:6121] 618841 MemQueuePeek: Start to peek queue on devId 5, qid is 0.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:46.596.491 [npu_driver.cc:4338] 618849 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:46.596.493 [tensor_data_transfer.cpp:1056]618845 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:46.596.499 [npu_driver.cc:4330] 618841 MemQueuePeek: peek mem queue, deviceId=5, qid=0, timeout=800.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:46.596.513 [api_impl.cc:6121] 618845 MemQueuePeek: Start to peek queue on devId 5, qid is 2.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:46.596.507 [tensor_data_transfer.cpp:612]618849 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_scalar_summary
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:46.596.526 [npu_driver.cc:4330] 618845 MemQueuePeek: peek mem queue, deviceId=5, qid=2, timeout=800.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:46.596.551 [tensor_data_transfer.cpp:1054]618849 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_scalar_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:46.596.566 [tensor_data_transfer.cpp:1056]618849 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:46.596.607 [api_impl.cc:6121] 618849 MemQueuePeek: Start to peek queue on devId 5, qid is 4.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:46.596.648 [npu_driver.cc:4330] 618849 MemQueuePeek: peek mem queue, deviceId=5, qid=4, timeout=800.
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:46.660.179 [queue_client_comm.c:114][ascend][curpid:618674,618884][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:46.660.182 [queue_client_comm.c:114][ascend][curpid:618674,618878][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:46.660.185 [queue_client_comm.c:114][ascend][curpid:618674,618866][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:46.660.173 [queue_client_comm.c:114][ascend][curpid:618662,618868][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:46.660.174 [queue_client_comm.c:114][ascend][curpid:618662,618885][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:46.660.174 [queue_client_comm.c:114][ascend][curpid:618662,618864][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:46.660.175 [queue_client_comm.c:114][ascend][curpid:618662,618872][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:46.660.180 [queue_client_comm.c:114][ascend][curpid:618662,618876][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:46.660.186 [queue_client_comm.c:114][ascend][curpid:618674,618870][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:46.660.184 [queue_client_comm.c:114][ascend][curpid:618662,618880][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:46.660.183 [queue_client_comm.c:114][ascend][curpid:618674,618873][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:46.660.187 [queue_client_comm.c:114][ascend][curpid:618674,618881][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:46.660.291 [npu_driver.cc:4338] 618884 MemQueuePeek: queue empty
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:46.660.288 [npu_driver.cc:4338] 618868 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:46.660.309 [tensor_data_transfer.cpp:612]618884 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_histogram_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:46.660.319 [tensor_data_transfer.cpp:1054]618884 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_histogram_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:46.660.305 [tensor_data_transfer.cpp:612]618868 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_tensor_dump
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:46.660.331 [npu_driver.cc:4338] 618885 MemQueuePeek: queue empty
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:46.660.326 [npu_driver.cc:4338] 618878 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:46.660.329 [tensor_data_transfer.cpp:1056]618884 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:46.660.340 [tensor_data_transfer.cpp:612]618878 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_image_summary
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:46.660.346 [api_impl.cc:6121] 618884 MemQueuePeek: Start to peek queue on devId 7, qid is 5.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:46.660.352 [tensor_data_transfer.cpp:1054]618878 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_image_summary
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:46.660.356 [npu_driver.cc:4330] 618884 MemQueuePeek: peek mem queue, deviceId=7, qid=5, timeout=800.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:46.660.363 [tensor_data_transfer.cpp:1056]618878 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:46.660.365 [npu_driver.cc:4338] 618866 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:46.660.334 [tensor_data_transfer.cpp:1054]618868 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_tensor_dump
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:46.660.346 [tensor_data_transfer.cpp:612]618885 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_histogram_summary
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:46.660.364 [npu_driver.cc:4338] 618864 MemQueuePeek: queue empty
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:46.660.375 [api_impl.cc:6121] 618878 MemQueuePeek: Start to peek queue on devId 7, qid is 3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:46.660.386 [npu_driver.cc:4330] 618878 MemQueuePeek: peek mem queue, deviceId=7, qid=3, timeout=800.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:46.660.393 [tensor_data_transfer.cpp:612]618866 acltdtReceiveTensorV2: queue is empty, device is 7, name is _npu_log
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:46.660.368 [tensor_data_transfer.cpp:1056]618868 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:46.660.375 [tensor_data_transfer.cpp:1054]618885 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_histogram_summary
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:46.660.397 [npu_driver.cc:4338] 618870 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:46.660.384 [tensor_data_transfer.cpp:612]618864 acltdtReceiveTensorV2: queue is empty, device is 4, name is _npu_log
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:46.660.405 [npu_driver.cc:4338] 618872 MemQueuePeek: queue empty
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:46.660.408 [api_impl.cc:6121] 618868 MemQueuePeek: Start to peek queue on devId 4, qid is 1.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:46.660.440 [tensor_data_transfer.cpp:1054]618866 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is _npu_log
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:46.660.436 [tensor_data_transfer.cpp:1056]618885 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:46.660.444 [tensor_data_transfer.cpp:1054]618864 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is _npu_log
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:46.660.446 [npu_driver.cc:4338] 618876 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:46.660.447 [tensor_data_transfer.cpp:612]618870 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_tensor_dump
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:46.660.449 [tensor_data_transfer.cpp:612]618872 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_tensor_summary
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:46.660.446 [npu_driver.cc:4338] 618873 MemQueuePeek: queue empty
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:46.660.470 [npu_driver.cc:4330] 618868 MemQueuePeek: peek mem queue, deviceId=4, qid=1, timeout=800.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:46.660.473 [npu_driver.cc:4338] 618880 MemQueuePeek: queue empty
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:46.660.475 [npu_driver.cc:4338] 618881 MemQueuePeek: queue empty
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:46.660.477 [api_impl.cc:6121] 618885 MemQueuePeek: Start to peek queue on devId 4, qid is 5.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:46.660.518 [tensor_data_transfer.cpp:612]618880 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_scalar_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:46.660.482 [tensor_data_transfer.cpp:1056]618864 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:46.660.517 [tensor_data_transfer.cpp:612]618873 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_tensor_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:46.660.495 [tensor_data_transfer.cpp:1056]618866 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:46.660.530 [tensor_data_transfer.cpp:1054]618880 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_scalar_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:46.660.499 [tensor_data_transfer.cpp:612]618876 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_image_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:46.660.505 [tensor_data_transfer.cpp:1054]618872 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_tensor_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:46.660.501 [tensor_data_transfer.cpp:1054]618870 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_tensor_dump
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:46.660.526 [npu_driver.cc:4330] 618885 MemQueuePeek: peek mem queue, deviceId=4, qid=5, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:46.660.538 [api_impl.cc:6121] 618864 MemQueuePeek: Start to peek queue on devId 4, qid is 0.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:46.660.526 [tensor_data_transfer.cpp:612]618881 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_scalar_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:46.660.544 [tensor_data_transfer.cpp:1056]618880 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:46.660.579 [npu_driver.cc:4330] 618864 MemQueuePeek: peek mem queue, deviceId=4, qid=0, timeout=800.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:46.660.539 [tensor_data_transfer.cpp:1054]618873 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_tensor_summary
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:46.660.562 [api_impl.cc:6121] 618866 MemQueuePeek: Start to peek queue on devId 7, qid is 0.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:46.660.557 [tensor_data_transfer.cpp:1054]618876 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_image_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:46.660.568 [tensor_data_transfer.cpp:1056]618870 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:46.660.598 [npu_driver.cc:4330] 618866 MemQueuePeek: peek mem queue, deviceId=7, qid=0, timeout=800.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:46.660.565 [tensor_data_transfer.cpp:1056]618872 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:46.660.586 [api_impl.cc:6121] 618880 MemQueuePeek: Start to peek queue on devId 4, qid is 4.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:46.660.604 [tensor_data_transfer.cpp:1056]618876 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:46.660.582 [tensor_data_transfer.cpp:1054]618881 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_scalar_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:46.660.588 [tensor_data_transfer.cpp:1056]618873 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:46.660.615 [api_impl.cc:6121] 618872 MemQueuePeek: Start to peek queue on devId 4, qid is 2.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:46.660.605 [api_impl.cc:6121] 618870 MemQueuePeek: Start to peek queue on devId 7, qid is 1.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:46.660.620 [tensor_data_transfer.cpp:1056]618881 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:46.660.622 [npu_driver.cc:4330] 618880 MemQueuePeek: peek mem queue, deviceId=4, qid=4, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:46.660.633 [api_impl.cc:6121] 618876 MemQueuePeek: Start to peek queue on devId 4, qid is 3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:46.660.630 [api_impl.cc:6121] 618873 MemQueuePeek: Start to peek queue on devId 7, qid is 2.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:46.660.637 [npu_driver.cc:4330] 618870 MemQueuePeek: peek mem queue, deviceId=7, qid=1, timeout=800.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:46.660.648 [api_impl.cc:6121] 618881 MemQueuePeek: Start to peek queue on devId 7, qid is 4.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:46.660.658 [npu_driver.cc:4330] 618873 MemQueuePeek: peek mem queue, deviceId=7, qid=2, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:46.660.641 [npu_driver.cc:4330] 618872 MemQueuePeek: peek mem queue, deviceId=4, qid=2, timeout=800.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:46.660.678 [npu_driver.cc:4330] 618881 MemQueuePeek: peek mem queue, deviceId=7, qid=4, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:46.660.662 [npu_driver.cc:4330] 618876 MemQueuePeek: peek mem queue, deviceId=4, qid=3, timeout=800.
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:46.692.172 [trs_cb_event.c:119][ascend][curpid:618666,618808][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =64; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:46.692.174 [trs_cb_event.c:119][ascend][curpid:618666,618809][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =65; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:46.692.197 [trs_sqcq.c:1491][ascend][curpid:618666,618808][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:46.692.169 [queue_client_comm.c:114][ascend][curpid:618670,618907][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:46.692.169 [queue_client_comm.c:114][ascend][curpid:618670,618905][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:46.692.172 [queue_client_comm.c:114][ascend][curpid:618670,618909][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:46.692.172 [queue_client_comm.c:114][ascend][curpid:618670,618911][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:46.692.176 [queue_client_comm.c:114][ascend][curpid:618670,618903][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:46.692.179 [queue_client_comm.c:114][ascend][curpid:618670,618901][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:46.692.271 [npu_driver.cc:4338] 618907 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:46.692.286 [tensor_data_transfer.cpp:612]618907 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_image_summary
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:46.692.204 [trs_sqcq.c:1491][ascend][curpid:618666,618809][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:46.692.297 [tensor_data_transfer.cpp:1054]618907 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_image_summary
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:46.692.209 [npu_driver.cc:3833] 618808 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:46.692.300 [npu_driver.cc:3833] 618809 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:46.692.304 [api_impl.cc:5058] 618808 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:46.692.314 [api_impl.cc:5058] 618809 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:46.692.301 [npu_driver.cc:4338] 618905 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:46.692.311 [tensor_data_transfer.cpp:1056]618907 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:46.692.319 [callback.cpp:132]618808 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:46.692.321 [tensor_data_transfer.cpp:612]618905 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_tensor_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:46.692.326 [api_impl.cc:6121] 618907 MemQueuePeek: Start to peek queue on devId 6, qid is 3.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:46.692.327 [callback.cpp:132]618809 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:46.692.334 [tensor_data_transfer.cpp:1054]618905 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_tensor_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:46.692.329 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:46.692.341 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:46.692.341 [npu_driver.cc:4330] 618907 MemQueuePeek: peek mem queue, deviceId=6, qid=3, timeout=800.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:46.692.350 [tensor_data_transfer.cpp:1056]618905 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:46.692.346 [npu_driver.cc:3828] 618808 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=64.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:46.692.357 [npu_driver.cc:3828] 618809 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=65.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:46.692.357 [npu_driver.cc:4338] 618909 MemQueuePeek: queue empty
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:46.692.364 [api_impl.cc:6121] 618905 MemQueuePeek: Start to peek queue on devId 6, qid is 2.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:46.692.392 [tensor_data_transfer.cpp:612]618909 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_scalar_summary
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:46.692.393 [npu_driver.cc:4338] 618911 MemQueuePeek: queue empty
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:46.692.397 [npu_driver.cc:4330] 618905 MemQueuePeek: peek mem queue, deviceId=6, qid=2, timeout=800.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:46.692.407 [tensor_data_transfer.cpp:1054]618909 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_scalar_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:46.692.413 [tensor_data_transfer.cpp:612]618911 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_histogram_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:46.692.422 [tensor_data_transfer.cpp:1056]618909 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:46.692.428 [npu_driver.cc:4338] 618903 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:46.692.432 [tensor_data_transfer.cpp:1054]618911 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_histogram_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:46.692.437 [api_impl.cc:6121] 618909 MemQueuePeek: Start to peek queue on devId 6, qid is 4.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:46.692.444 [tensor_data_transfer.cpp:612]618903 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_tensor_dump
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:46.692.449 [tensor_data_transfer.cpp:1056]618911 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:46.692.455 [npu_driver.cc:4330] 618909 MemQueuePeek: peek mem queue, deviceId=6, qid=4, timeout=800.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:46.692.465 [npu_driver.cc:4338] 618901 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:46.692.460 [tensor_data_transfer.cpp:1054]618903 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_tensor_dump
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:46.692.467 [api_impl.cc:6121] 618911 MemQueuePeek: Start to peek queue on devId 6, qid is 5.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:46.692.481 [tensor_data_transfer.cpp:612]618901 acltdtReceiveTensorV2: queue is empty, device is 6, name is _npu_log
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:46.692.484 [tensor_data_transfer.cpp:1056]618903 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:46.692.491 [npu_driver.cc:4330] 618911 MemQueuePeek: peek mem queue, deviceId=6, qid=5, timeout=800.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:46.692.497 [tensor_data_transfer.cpp:1054]618901 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is _npu_log
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:46.692.503 [api_impl.cc:6121] 618903 MemQueuePeek: Start to peek queue on devId 6, qid is 1.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:46.692.516 [tensor_data_transfer.cpp:1056]618901 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:46.692.520 [npu_driver.cc:4330] 618903 MemQueuePeek: peek mem queue, deviceId=6, qid=1, timeout=800.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:46.692.528 [api_impl.cc:6121] 618901 MemQueuePeek: Start to peek queue on devId 6, qid is 0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:46.692.541 [npu_driver.cc:4330] 618901 MemQueuePeek: peek mem queue, deviceId=6, qid=0, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:46.700.653 [runtime.cc:5239] 618814 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:46.700.683 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618814] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:46.700.700 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618814] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:46.700.716 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618814] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:46.700.714 [runtime.cc:5239] 618826 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:46.700.746 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618826] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:46.700.717 [runtime.cc:5239] 618772 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:46.700.743 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618772] [TsdClient] g_userDeviceInfo is emp[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.700.721 [runtime.cc:5239] 618834 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:46.700.751 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618834] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.700.723 [runtime.cc:5239] 618830 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:46.700.758 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618830] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:46.700.762 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618826] [TsdClient] g_userDeviceInfo is empty.
ty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:46.700.784 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618772] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:46.700.772 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618834] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:46.700.785 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618834] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:46.700.776 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618830] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:46.700.791 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618830] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:46.700.776 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618826] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:46.700.801 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618772] [TsdClient] g_userDeviceInfo is empty.
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:46.724.179 [trs_cb_event.c:119][ascend][curpid:618658,618775][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =65; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:46.724.181 [trs_cb_event.c:119][ascend][curpid:618658,618774][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =64; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:46.724.207 [trs_sqcq.c:1491][ascend][curpid:618658,618775][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:46.724.218 [trs_sqcq.c:1491][ascend][curpid:618658,618774][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:46.724.233 [npu_driver.cc:3833] 618775 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:46.724.243 [npu_driver.cc:3833] 618774 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:46.724.256 [api_impl.cc:5058] 618775 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:46.724.266 [api_impl.cc:5058] 618774 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:46.724.279 [callback.cpp:132]618775 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:46.724.287 [callback.cpp:132]618774 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:46.724.299 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:46.724.306 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:46.724.320 [npu_driver.cc:3828] 618775 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=65.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:46.724.328 [npu_driver.cc:3828] 618774 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=64.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:46.732.718 [runtime.cc:5239] 618812 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:46.732.741 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618812] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:46.732.703 [runtime.cc:5239] 618820 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:46.732.736 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618820] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:46.732.724 [runtime.cc:5239] 618806 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:46.732.752 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618820] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:46.732.766 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618820] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:46.732.754 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618812] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:46.732.749 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618806] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:46.732.763 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618806] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:46.732.773 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618806] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:46.732.782 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618812] [TsdClient] g_userDeviceInfo is empty.
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:46.756.172 [trs_cb_event.c:119][ascend][curpid:618674,618819][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =65; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:46.756.174 [trs_cb_event.c:119][ascend][curpid:618674,618818][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =64; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:46.756.174 [trs_cb_event.c:119][ascend][curpid:618662,618817][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =833; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:46.756.174 [trs_cb_event.c:119][ascend][curpid:618662,618816][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =832; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:46.756.202 [trs_sqcq.c:1491][ascend][curpid:618662,618817][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:46.756.208 [trs_sqcq.c:1491][ascend][curpid:618674,618819][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:46.756.218 [trs_sqcq.c:1491][ascend][curpid:618674,618818][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:46.756.210 [trs_sqcq.c:1491][ascend][curpid:618662,618816][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:46.756.223 [npu_driver.cc:3833] 618817 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=833, drvRetCode=16.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:46.756.231 [npu_driver.cc:3833] 618816 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=832, drvRetCode=16.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:46.756.237 [api_impl.cc:5058] 618817 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:46.756.245 [api_impl.cc:5058] 618816 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:46.756.252 [callback.cpp:132]618817 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:46.756.230 [npu_driver.cc:3833] 618819 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:46.756.241 [npu_driver.cc:3833] 618818 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:46.756.251 [api_impl.cc:5058] 618819 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:46.756.260 [api_impl.cc:5058] 618818 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:46.756.259 [callback.cpp:132]618816 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:46.756.270 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:46.756.280 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:46.756.287 [npu_driver.cc:3828] 618817 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=833.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:46.756.273 [callback.cpp:132]618819 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:46.756.280 [callback.cpp:132]618818 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:46.756.297 [npu_driver.cc:3828] 618816 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=832.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:46.756.296 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:46.756.304 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:46.756.319 [npu_driver.cc:3828] 618819 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=65.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:46.756.325 [npu_driver.cc:3828] 618818 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=64.
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:46.788.165 [trs_cb_event.c:119][ascend][curpid:618670,618823][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =65; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:46.788.169 [trs_cb_event.c:119][ascend][curpid:618670,618822][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =64; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:46.788.187 [trs_sqcq.c:1491][ascend][curpid:618670,618823][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:46.788.195 [trs_sqcq.c:1491][ascend][curpid:618670,618822][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:46.788.201 [npu_driver.cc:3833] 618823 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:46.788.210 [npu_driver.cc:3833] 618822 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=64, drvRetCode=16.
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:46.788.172 [queue_client_comm.c:114][ascend][curpid:618650,618931][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:46.788.169 [queue_client_comm.c:114][ascend][curpid:618650,618923][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:46.788.170 [queue_client_comm.c:114][ascend][curpid:618650,618925][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:46.788.217 [api_impl.cc:5058] 618823 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:46.788.224 [api_impl.cc:5058] 618822 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:46.788.173 [queue_client_comm.c:114][ascend][curpid:618650,618927][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:46.788.175 [queue_client_comm.c:114][ascend][curpid:618650,618921][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:46.788.175 [queue_client_comm.c:114][ascend][curpid:618650,618929][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:46.788.231 [callback.cpp:132]618823 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:46.788.237 [callback.cpp:132]618822 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:46.788.245 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:46.788.250 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:46.788.259 [npu_driver.cc:3828] 618823 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=65.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:46.788.265 [npu_driver.cc:3828] 618822 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=64.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:46.788.281 [npu_driver.cc:4338] 618931 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:46.788.300 [tensor_data_transfer.cpp:612]618931 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_histogram_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:46.788.312 [tensor_data_transfer.cpp:1054]618931 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_histogram_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:46.788.324 [tensor_data_transfer.cpp:1056]618931 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:46.788.333 [api_impl.cc:6121] 618931 MemQueuePeek: Start to peek queue on devId 1, qid is 5.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:46.788.334 [npu_driver.cc:4338] 618923 MemQueuePeek: queue empty
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:46.788.366 [npu_driver.cc:4338] 618925 MemQueuePeek: queue empty
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:46.788.372 [npu_driver.cc:4330] 618931 MemQueuePeek: peek mem queue, deviceId=1, qid=5, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:46.788.384 [tensor_data_transfer.cpp:612]618923 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_tensor_dump
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:46.788.390 [tensor_data_transfer.cpp:612]618925 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_tensor_summary
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:46.788.398 [npu_driver.cc:4338] 618927 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:46.788.408 [tensor_data_transfer.cpp:1054]618923 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_tensor_dump
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:46.788.412 [tensor_data_transfer.cpp:1054]618925 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_tensor_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:46.788.416 [tensor_data_transfer.cpp:612]618927 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_image_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:46.788.419 [tensor_data_transfer.cpp:1056]618923 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:46.788.423 [tensor_data_transfer.cpp:1056]618925 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:46.788.427 [tensor_data_transfer.cpp:1054]618927 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_image_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:46.788.431 [api_impl.cc:6121] 618923 MemQueuePeek: Start to peek queue on devId 1, qid is 1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:46.788.435 [api_impl.cc:6121] 618925 MemQueuePeek: Start to peek queue on devId 1, qid is 2.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:46.788.437 [tensor_data_transfer.cpp:1056]618927 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:46.788.442 [npu_driver.cc:4330] 618923 MemQueuePeek: peek mem queue, deviceId=1, qid=1, timeout=800.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:46.788.440 [npu_driver.cc:4338] 618921 MemQueuePeek: queue empty
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:46.788.445 [npu_driver.cc:4330] 618925 MemQueuePeek: peek mem queue, deviceId=1, qid=2, timeout=800.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:46.788.450 [api_impl.cc:6121] 618927 MemQueuePeek: Start to peek queue on devId 1, qid is 3.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:46.788.469 [tensor_data_transfer.cpp:612]618921 acltdtReceiveTensorV2: queue is empty, device is 1, name is _npu_log
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:46.788.471 [npu_driver.cc:4338] 618929 MemQueuePeek: queue empty
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:46.788.478 [npu_driver.cc:4330] 618927 MemQueuePeek: peek mem queue, deviceId=1, qid=3, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:46.788.493 [tensor_data_transfer.cpp:1054]618921 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is _npu_log
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:46.788.502 [tensor_data_transfer.cpp:612]618929 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_scalar_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:46.788.515 [tensor_data_transfer.cpp:1056]618921 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:46.788.525 [tensor_data_transfer.cpp:1054]618929 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_scalar_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:46.788.537 [api_impl.cc:6121] 618921 MemQueuePeek: Start to peek queue on devId 1, qid is 0.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:46.788.557 [tensor_data_transfer.cpp:1056]618929 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:46.788.569 [npu_driver.cc:4330] 618921 MemQueuePeek: peek mem queue, deviceId=1, qid=0, timeout=800.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:46.788.579 [api_impl.cc:6121] 618929 MemQueuePeek: Start to peek queue on devId 1, qid is 4.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:46.788.596 [npu_driver.cc:4330] 618929 MemQueuePeek: peek mem queue, deviceId=1, qid=4, timeout=800.
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:46.884.173 [trs_cb_event.c:119][ascend][curpid:618650,618828][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =320; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:46.884.175 [trs_cb_event.c:119][ascend][curpid:618650,618829][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =321; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:46.884.170 [queue_client_comm.c:114][ascend][curpid:618654,618947][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:46.884.170 [queue_client_comm.c:114][ascend][curpid:618654,618941][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:46.884.171 [queue_client_comm.c:114][ascend][curpid:618654,618943][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:46.884.204 [trs_sqcq.c:1491][ascend][curpid:618650,618828][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:46.884.211 [trs_sqcq.c:1491][ascend][curpid:618650,618829][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:46.884.173 [queue_client_comm.c:114][ascend][curpid:618654,618949][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:46.884.175 [queue_client_comm.c:114][ascend][curpid:618654,618945][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:46.884.221 [npu_driver.cc:3833] 618828 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=320, drvRetCode=16.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:46.884.226 [npu_driver.cc:3833] 618829 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:46.884.236 [api_impl.cc:5058] 618828 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:46.884.178 [queue_client_comm.c:114][ascend][curpid:618654,618951][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:46.884.240 [api_impl.cc:5058] 618829 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:46.884.255 [callback.cpp:132]618829 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:46.884.267 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:46.884.269 [callback.cpp:132]618828 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:46.884.280 [npu_driver.cc:3828] 618829 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=321.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:46.884.275 [npu_driver.cc:4338] 618947 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:46.884.298 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.884.296 [tensor_data_transfer.cpp:612]618947 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_image_summary
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:46.884.299 [npu_driver.cc:4338] 618941 MemQueuePeek: queue empty
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:46.884.326 [npu_driver.cc:3828] 618828 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=320.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.884.315 [tensor_data_transfer.cpp:1054]618947 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_image_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.884.321 [tensor_data_transfer.cpp:612]618941 acltdtReceiveTensorV2: queue is empty, device is 2, name is _npu_log
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.884.330 [tensor_data_transfer.cpp:1056]618947 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:46.884.329 [npu_driver.cc:4338] 618943 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.884.337 [tensor_data_transfer.cpp:1054]618941 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is _npu_log
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.884.358 [api_impl.cc:6121] 618947 MemQueuePeek: Start to peek queue on devId 2, qid is 3.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:46.884.362 [npu_driver.cc:4338] 618949 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.884.367 [tensor_data_transfer.cpp:612]618943 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_tensor_dump
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.884.371 [tensor_data_transfer.cpp:1056]618941 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.884.376 [npu_driver.cc:4330] 618947 MemQueuePeek: peek mem queue, deviceId=2, qid=3, timeout=800.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.884.386 [tensor_data_transfer.cpp:612]618949 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_scalar_summary
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:46.884.389 [npu_driver.cc:4338] 618945 MemQueuePeek: queue empty
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.884.398 [api_impl.cc:6121] 618941 MemQueuePeek: Start to peek queue on devId 2, qid is 0.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.884.393 [tensor_data_transfer.cpp:1054]618943 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_tensor_dump
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.884.410 [tensor_data_transfer.cpp:1054]618949 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_scalar_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.884.417 [tensor_data_transfer.cpp:612]618945 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_tensor_summary
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.884.421 [npu_driver.cc:4330] 618941 MemQueuePeek: peek mem queue, deviceId=2, qid=0, timeout=800.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:46.884.425 [npu_driver.cc:4338] 618951 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.884.426 [tensor_data_transfer.cpp:1056]618943 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.884.434 [tensor_data_transfer.cpp:1056]618949 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.884.441 [tensor_data_transfer.cpp:1054]618945 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_tensor_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.884.453 [tensor_data_transfer.cpp:612]618951 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_histogram_summary
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.884.460 [api_impl.cc:6121] 618943 MemQueuePeek: Start to peek queue on devId 2, qid is 1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.884.467 [api_impl.cc:6121] 618949 MemQueuePeek: Start to peek queue on devId 2, qid is 4.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.884.470 [tensor_data_transfer.cpp:1056]618945 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.884.477 [tensor_data_transfer.cpp:1054]618951 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_histogram_summary
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.884.481 [npu_driver.cc:4330] 618943 MemQueuePeek: peek mem queue, deviceId=2, qid=1, timeout=800.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.884.486 [npu_driver.cc:4330] 618949 MemQueuePeek: peek mem queue, deviceId=2, qid=4, timeout=800.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.884.494 [api_impl.cc:6121] 618945 MemQueuePeek: Start to peek queue on devId 2, qid is 2.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.884.498 [tensor_data_transfer.cpp:1056]618951 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.884.529 [npu_driver.cc:4330] 618945 MemQueuePeek: peek mem queue, deviceId=2, qid=2, timeout=800.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.884.538 [api_impl.cc:6121] 618951 MemQueuePeek: Start to peek queue on devId 2, qid is 5.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.884.553 [npu_driver.cc:4330] 618951 MemQueuePeek: peek mem queue, deviceId=2, qid=5, timeout=800.
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:46.948.169 [queue_client_comm.c:114][ascend][curpid:618646,618961][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:46.948.171 [queue_client_comm.c:114][ascend][curpid:618646,618965][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:46.948.179 [queue_client_comm.c:114][ascend][curpid:618646,618963][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:46.948.291 [npu_driver.cc:4338] 618961 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.948.309 [tensor_data_transfer.cpp:612]618961 acltdtReceiveTensorV2: queue is empty, device is 0, name is _npu_log
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:46.948.313 [npu_driver.cc:4338] 618965 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.948.322 [tensor_data_transfer.cpp:1054]618961 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is _npu_log
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.948.327 [tensor_data_transfer.cpp:612]618965 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_tensor_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.948.333 [tensor_data_transfer.cpp:1056]618961 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.948.339 [tensor_data_transfer.cpp:1054]618965 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_tensor_summary
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:46.948.342 [npu_driver.cc:4338] 618963 MemQueuePeek: queue empty
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.948.344 [api_impl.cc:6121] 618961 MemQueuePeek: Start to peek queue on devId 0, qid is 0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.948.350 [tensor_data_transfer.cpp:1056]618965 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.948.365 [tensor_data_transfer.cpp:612]618963 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_tensor_dump
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.948.371 [npu_driver.cc:4330] 618961 MemQueuePeek: peek mem queue, deviceId=0, qid=0, timeout=800.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.948.377 [api_impl.cc:6121] 618965 MemQueuePeek: Start to peek queue on devId 0, qid is 2.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.948.387 [tensor_data_transfer.cpp:1054]618963 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_tensor_dump
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.948.398 [npu_driver.cc:4330] 618965 MemQueuePeek: peek mem queue, deviceId=0, qid=2, timeout=800.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.948.407 [tensor_data_transfer.cpp:1056]618963 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.948.466 [api_impl.cc:6121] 618963 MemQueuePeek: Start to peek queue on devId 0, qid is 1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.948.481 [npu_driver.cc:4330] 618963 MemQueuePeek: peek mem queue, deviceId=0, qid=1, timeout=800.
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:46.980.168 [queue_client_comm.c:114][ascend][curpid:618646,618967][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:46.980.178 [queue_client_comm.c:114][ascend][curpid:618646,618971][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:46.980.177 [trs_cb_event.c:119][ascend][curpid:618654,618833][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =321; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:46.980.178 [trs_cb_event.c:119][ascend][curpid:618654,618832][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =320; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:46.980.206 [trs_sqcq.c:1491][ascend][curpid:618654,618833][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:46.980.217 [trs_sqcq.c:1491][ascend][curpid:618654,618832][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:46.980.223 [npu_driver.cc:3833] 618833 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:46.980.235 [npu_driver.cc:3833] 618832 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=320, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:46.980.240 [api_impl.cc:5058] 618833 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:46.980.205 [queue_client_comm.c:114][ascend][curpid:618646,618969][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:46.980.252 [api_impl.cc:5058] 618832 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.980.262 [callback.cpp:132]618833 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.980.267 [callback.cpp:132]618832 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.980.277 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:46.980.283 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.980.294 [npu_driver.cc:3828] 618833 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=321.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:46.980.285 [npu_driver.cc:4338] 618967 MemQueuePeek: queue empty
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:46.980.300 [npu_driver.cc:3828] 618832 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=320.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:46.980.306 [npu_driver.cc:4338] 618971 MemQueuePeek: queue empty
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:46.980.311 [npu_driver.cc:4338] 618969 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.980.311 [tensor_data_transfer.cpp:612]618967 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_image_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.980.327 [tensor_data_transfer.cpp:612]618971 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_histogram_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.980.337 [tensor_data_transfer.cpp:612]618969 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_scalar_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.980.341 [tensor_data_transfer.cpp:1054]618967 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_image_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.980.352 [tensor_data_transfer.cpp:1054]618971 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_histogram_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.980.362 [tensor_data_transfer.cpp:1054]618969 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_scalar_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.980.366 [tensor_data_transfer.cpp:1056]618967 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.980.376 [tensor_data_transfer.cpp:1056]618971 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:46.980.385 [tensor_data_transfer.cpp:1056]618969 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.980.390 [api_impl.cc:6121] 618967 MemQueuePeek: Start to peek queue on devId 0, qid is 3.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.980.399 [api_impl.cc:6121] 618971 MemQueuePeek: Start to peek queue on devId 0, qid is 5.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.980.407 [api_impl.cc:6121] 618969 MemQueuePeek: Start to peek queue on devId 0, qid is 4.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.980.411 [npu_driver.cc:4330] 618967 MemQueuePeek: peek mem queue, deviceId=0, qid=3, timeout=800.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.980.420 [npu_driver.cc:4330] 618971 MemQueuePeek: peek mem queue, deviceId=0, qid=5, timeout=800.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:46.980.428 [npu_driver.cc:4330] 618969 MemQueuePeek: peek mem queue, deviceId=0, qid=4, timeout=800.
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:47.076.182 [trs_cb_event.c:119][ascend][curpid:618646,618837][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =65; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:47.076.193 [trs_cb_event.c:119][ascend][curpid:618646,618836][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =64; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:47.076.206 [trs_sqcq.c:1491][ascend][curpid:618646,618837][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:47.076.220 [trs_sqcq.c:1491][ascend][curpid:618646,618836][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:47.076.227 [npu_driver.cc:3833] 618837 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:47.076.245 [npu_driver.cc:3833] 618836 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:47.076.254 [api_impl.cc:5058] 618837 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:47.076.265 [api_impl.cc:5058] 618836 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.076.274 [callback.cpp:132]618837 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.076.285 [callback.cpp:132]618836 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.076.304 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.076.315 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.076.325 [npu_driver.cc:3828] 618837 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=65.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.076.336 [npu_driver.cc:3828] 618836 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=64.
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:47.204.167 [trs_cb_event.c:119][ascend][curpid:618666,618809][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =65; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:47.204.168 [trs_cb_event.c:119][ascend][curpid:618666,618808][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =64; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:47.204.189 [trs_sqcq.c:1491][ascend][curpid:618666,618809][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:47.204.195 [trs_sqcq.c:1491][ascend][curpid:618666,618808][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:47.204.202 [npu_driver.cc:3833] 618809 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:47.204.207 [npu_driver.cc:3833] 618808 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:47.204.214 [api_impl.cc:5058] 618809 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:47.204.218 [api_impl.cc:5058] 618808 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.204.224 [callback.cpp:132]618809 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.204.229 [callback.cpp:132]618808 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.204.238 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.204.240 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.204.259 [npu_driver.cc:3828] 618809 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=65.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.204.262 [npu_driver.cc:3828] 618808 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=64.
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:47.236.175 [trs_cb_event.c:119][ascend][curpid:618658,618775][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =65; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:47.236.196 [trs_cb_event.c:119][ascend][curpid:618658,618774][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =64; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:47.236.202 [trs_sqcq.c:1491][ascend][curpid:618658,618775][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:47.236.220 [trs_sqcq.c:1491][ascend][curpid:618658,618774][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:47.236.231 [npu_driver.cc:3833] 618775 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:47.236.239 [npu_driver.cc:3833] 618774 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:47.236.249 [api_impl.cc:5058] 618775 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:47.236.259 [api_impl.cc:5058] 618774 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.236.271 [callback.cpp:132]618775 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.236.279 [callback.cpp:132]618774 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.236.312 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.236.323 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.236.336 [npu_driver.cc:3828] 618775 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=65.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.236.345 [npu_driver.cc:3828] 618774 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=64.
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:47.268.173 [trs_cb_event.c:119][ascend][curpid:618674,618819][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =65; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:47.268.177 [trs_cb_event.c:119][ascend][curpid:618674,618818][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =64; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:47.268.207 [trs_sqcq.c:1491][ascend][curpid:618674,618819][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:47.268.175 [trs_cb_event.c:119][ascend][curpid:618662,618816][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =832; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:47.268.176 [trs_cb_event.c:119][ascend][curpid:618662,618817][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =833; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:47.268.201 [trs_sqcq.c:1491][ascend][curpid:618662,618816][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:47.268.208 [trs_sqcq.c:1491][ascend][curpid:618662,618817][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:47.268.216 [npu_driver.cc:3833] 6[WARNING] DRV(618674,python3.9):2025-04-03-09:27:47.268.218 [trs_sqcq.c:1491][ascend][curpid:618674,618818][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:47.268.228 [npu_driver.cc:3833] 618819 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=65, drvRetCode=16.
18816 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=832, drvRetCode=16.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:47.268.236 [npu_driver.cc:3833] 618818 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:47.268.247 [api_impl.cc:5058] 618819 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:47.268.225 [npu_driver.cc:3833] 618817 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=833, drvRetCode=16.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:47.268.256 [api_impl.cc:5058] 618816 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:47.268.262 [api_impl.cc:5058] 618817 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.268.274 [callback.cpp:132]618816 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.268.277 [callback.cpp:132]618817 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.268.290 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:47.268.257 [api_impl.cc:5058] 618818 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.268.269 [callback.cpp:132]618819 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.268.297 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.268.276 [callback.cpp:132]618818 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.268.310 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.268.305 [npu_driver.cc:3828] 618816 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=832.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.268.312 [npu_driver.cc:3828] 618817 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=833.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.268.317 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.268.332 [npu_driver.cc:3828] 618819 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=65.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.268.338 [npu_driver.cc:3828] 618818 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=64.
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:47.300.165 [trs_cb_event.c:119][ascend][curpid:618670,618822][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =64; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:47.300.170 [trs_cb_event.c:119][ascend][curpid:618670,618823][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =65; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:47.300.184 [trs_sqcq.c:1491][ascend][curpid:618670,618822][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:47.300.189 [trs_sqcq.c:1491][ascend][curpid:618670,618823][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:47.300.197 [npu_driver.cc:3833] 618822 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:47.300.201 [npu_driver.cc:3833] 618823 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:47.300.212 [api_impl.cc:5058] 618822 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:47.300.217 [api_impl.cc:5058] 618823 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.300.240 [callback.cpp:132]618822 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.300.244 [callback.cpp:132]618823 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.300.253 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.300.256 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.300.266 [npu_driver.cc:3828] 618822 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=64.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.300.271 [npu_driver.cc:3828] 618823 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=65.
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:47.364.172 [queue_client_comm.c:114][ascend][curpid:618658,618785][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:47.364.173 [queue_client_comm.c:114][ascend][curpid:618658,618787][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:47.364.176 [queue_client_comm.c:114][ascend][curpid:618658,618779][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:47.364.176 [queue_client_comm.c:114][ascend][curpid:618658,618781][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:47.364.178 [queue_client_comm.c:114][ascend][curpid:618658,618789][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:47.364.194 [queue_client_comm.c:114][ascend][curpid:618658,618783][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:47.364.300 [npu_driver.cc:4338] 618785 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.364.318 [tensor_data_transfer.cpp:612]618785 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_image_summary
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:47.364.307 [npu_driver.cc:4338] 618787 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.364.330 [tensor_data_transfer.cpp:1054]618785 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_image_summary
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:47.364.334 [npu_driver.cc:4338] 618779 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.364.344 [tensor_data_transfer.cpp:1056]618785 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.364.336 [tensor_data_transfer.cpp:612]618787 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_scalar_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.364.356 [tensor_data_transfer.cpp:612]618779 acltdtReceiveTensorV2: queue is empty, device is 3, name is _npu_log
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:47.364.363 [npu_driver.cc:4338] 618781 MemQueuePeek: queue empty
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.364.365 [api_impl.cc:6121] 618785 MemQueuePeek: Start to peek queue on devId 3, qid is 3.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.364.385 [tensor_data_transfer.cpp:1054]618779 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is _npu_log
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.364.389 [tensor_data_transfer.cpp:1054]618787 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_scalar_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.364.392 [tensor_data_transfer.cpp:612]618781 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_tensor_dump
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:47.364.399 [npu_driver.cc:4338] 618789 MemQueuePeek: queue empty
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.364.403 [npu_driver.cc:4330] 618785 MemQueuePeek: peek mem queue, deviceId=3, qid=3, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.364.416 [tensor_data_transfer.cpp:1056]618779 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:47.364.425 [npu_driver.cc:4338] 618783 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.364.465 [tensor_data_transfer.cpp:1056]618787 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.364.478 [tensor_data_transfer.cpp:1054]618781 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_tensor_dump
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.364.489 [tensor_data_transfer.cpp:612]618789 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_histogram_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.364.509 [api_impl.cc:6121] 618779 MemQueuePeek: Start to peek queue on devId 3, qid is 0.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.364.522 [tensor_data_transfer.cpp:612]618783 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_tensor_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.364.547 [api_impl.cc:6121] 618787 MemQueuePeek: Start to peek queue on devId 3, qid is 4.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.364.557 [tensor_data_transfer.cpp:1056]618781 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.364.568 [tensor_data_transfer.cpp:1054]618789 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_histogram_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.364.574 [npu_driver.cc:4330] 618779 MemQueuePeek: peek mem queue, deviceId=3, qid=0, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.364.582 [tensor_data_transfer.cpp:1054]618783 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_tensor_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.364.602 [npu_driver.cc:4330] 618787 MemQueuePeek: peek mem queue, deviceId=3, qid=4, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.364.613 [api_impl.cc:6121] 618781 MemQueuePeek: Start to peek queue on devId 3, qid is 1.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.364.620 [tensor_data_transfer.cpp:1056]618789 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.364.634 [tensor_data_transfer.cpp:1056]618783 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.364.656 [npu_driver.cc:4330] 618781 MemQueuePeek: peek mem queue, deviceId=3, qid=1, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.364.664 [api_impl.cc:6121] 618789 MemQueuePeek: Start to peek queue on devId 3, qid is 5.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.364.674 [api_impl.cc:6121] 618783 MemQueuePeek: Start to peek queue on devId 3, qid is 2.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.364.688 [npu_driver.cc:4330] 618789 MemQueuePeek: peek mem queue, deviceId=3, qid=5, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.364.693 [npu_driver.cc:4330] 618783 MemQueuePeek: peek mem queue, deviceId=3, qid=2, timeout=800.
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:47.396.168 [trs_cb_event.c:119][ascend][curpid:618650,618829][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =321; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:47.396.170 [trs_cb_event.c:119][ascend][curpid:618650,618828][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =320; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:47.396.187 [trs_sqcq.c:1491][ascend][curpid:618650,618829][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:47.396.195 [trs_sqcq.c:1491][ascend][curpid:618650,618828][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:47.396.198 [npu_driver.cc:3833] 618829 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:47.396.208 [npu_driver.cc:3833] 618828 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=320, drvRetCode=16.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:47.396.266 [api_impl.cc:5058] 618829 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:47.396.270 [api_impl.cc:5058] 618828 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.396.276 [callback.cpp:132]618829 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.396.281 [callback.cpp:132]618828 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.396.286 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.396.292 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.396.296 [npu_driver.cc:3828] 618829 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=321.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.396.304 [npu_driver.cc:3828] 618828 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=320.
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:47.428.178 [queue_client_comm.c:114][ascend][curpid:618666,618849][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:47.428.179 [queue_client_comm.c:114][ascend][curpid:618666,618845][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:47.428.181 [queue_client_comm.c:114][ascend][curpid:618666,618851][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:47.428.182 [queue_client_comm.c:114][ascend][curpid:618666,618841][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:47.428.182 [queue_client_comm.c:114][ascend][curpid:618666,618847][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:47.428.184 [queue_client_comm.c:114][ascend][curpid:618666,618843][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:47.428.294 [npu_driver.cc:4338] 618845 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.428.312 [tensor_data_transfer.cpp:612]618845 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_tensor_summary
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:47.428.296 [npu_driver.cc:4338] 618849 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.428.326 [tensor_data_transfer.cpp:1054]618845 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_tensor_summary
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:47.428.330 [npu_driver.cc:4338] 618851 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.428.341 [tensor_data_transfer.cpp:1056]618845 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.428.332 [tensor_data_transfer.cpp:612]618849 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_scalar_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.428.350 [tensor_data_transfer.cpp:612]618851 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_histogram_summary
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:47.428.355 [npu_driver.cc:4338] 618841 MemQueuePeek: queue empty
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.428.358 [api_impl.cc:6121] 618845 MemQueuePeek: Start to peek queue on devId 5, qid is 2.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.428.370 [tensor_data_transfer.cpp:1054]618851 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_histogram_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.428.363 [tensor_data_transfer.cpp:1054]618849 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_scalar_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.428.378 [tensor_data_transfer.cpp:612]618841 acltdtReceiveTensorV2: queue is empty, device is 5, name is _npu_log
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.428.384 [npu_driver.cc:4330] 618845 MemQueuePeek: peek mem queue, deviceId=5, qid=2, timeout=800.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.428.391 [tensor_data_transfer.cpp:1056]618851 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:47.428.392 [npu_driver.cc:4338] 618847 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.428.414 [tensor_data_transfer.cpp:1056]618849 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:47.428.420 [npu_driver.cc:4338] 618843 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.428.423 [tensor_data_transfer.cpp:1054]618841 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is _npu_log
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.428.472 [tensor_data_transfer.cpp:612]618843 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_tensor_dump
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.428.451 [api_impl.cc:6121] 618851 MemQueuePeek: Start to peek queue on devId 5, qid is 5.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.428.457 [tensor_data_transfer.cpp:612]618847 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_image_summary
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.428.478 [api_impl.cc:6121] 618849 MemQueuePeek: Start to peek queue on devId 5, qid is 4.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.428.480 [tensor_data_transfer.cpp:1056]618841 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.428.489 [tensor_data_transfer.cpp:1054]618843 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_tensor_dump
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.428.492 [npu_driver.cc:4330] 618851 MemQueuePeek: peek mem queue, deviceId=5, qid=5, timeout=800.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.428.496 [tensor_data_transfer.cpp:1054]618847 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_image_summary
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.428.504 [npu_driver.cc:4330] 618849 MemQueuePeek: peek mem queue, deviceId=5, qid=4, timeout=800.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.428.510 [api_impl.cc:6121] 618841 MemQueuePeek: Start to peek queue on devId 5, qid is 0.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.428.517 [tensor_data_transfer.cpp:1056]618843 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.428.525 [tensor_data_transfer.cpp:1056]618847 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.428.541 [npu_driver.cc:4330] 618841 MemQueuePeek: peek mem queue, deviceId=5, qid=0, timeout=800.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.428.550 [api_impl.cc:6121] 618843 MemQueuePeek: Start to peek queue on devId 5, qid is 1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.428.553 [api_impl.cc:6121] 618847 MemQueuePeek: Start to peek queue on devId 5, qid is 3.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.428.566 [npu_driver.cc:4330] 618843 MemQueuePeek: peek mem queue, deviceId=5, qid=1, timeout=800.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.428.570 [npu_driver.cc:4330] 618847 MemQueuePeek: peek mem queue, deviceId=5, qid=3, timeout=800.
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:47.492.167 [queue_client_comm.c:114][ascend][curpid:618662,618880][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:47.492.167 [queue_client_comm.c:114][ascend][curpid:618662,618864][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:47.492.167 [queue_client_comm.c:114][ascend][curpid:618662,618885][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:47.492.169 [queue_client_comm.c:114][ascend][curpid:618662,618868][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:47.492.174 [queue_client_comm.c:114][ascend][curpid:618674,618878][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:47.492.187 [queue_client_comm.c:114][ascend][curpid:618674,618884][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:47.492.184 [queue_client_comm.c:114][ascend][curpid:618674,618873][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:47.492.169 [queue_client_comm.c:114][ascend][curpid:618662,618872][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:47.492.183 [queue_client_comm.c:114][ascend][curpid:618662,618876][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:47.492.190 [queue_client_comm.c:114][ascend][curpid:618674,618881][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:47.492.193 [queue_client_comm.c:114][ascend][curpid:618674,618866][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:47.492.181 [trs_cb_event.c:119][ascend][curpid:618654,618832][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =320; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:47.492.182 [trs_cb_event.c:119][ascend][curpid:618654,618833][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =321; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:47.492.214 [trs_sqcq.c:1491][ascend][curpid:618654,618832][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:47.492.225 [trs_sqcq.c:1491][ascend][curpid:618654,618833][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:47.492.197 [queue_client_comm.c:114][ascend][curpid:618674,618870][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:47.492.251 [npu_driver.cc:4338] 618880 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.492.268 [tensor_data_transfer.cpp:612]618880 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_scalar_summary
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:47.492.235 [npu_driver.cc:3833] 618832 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=320, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:47.492.245 [npu_driver.cc:3833] 618833 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:47.492.253 [api_impl.cc:5058] 618832 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:47.492.274 [api_impl.cc:5058] 618833 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.492.279 [callback.cpp:132]618832 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:47.492.268 [npu_driver.cc:4338] 618878 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.492.285 [tensor_data_transfer.cpp:612]618878 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_image_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.492.282 [tensor_data_transfer.cpp:1054]618880 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_scalar_summary
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:47.492.283 [npu_driver.cc:4338] 618864 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.492.294 [tensor_data_transfer.cpp:1056]618880 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.492.289 [callback.cpp:132]618833 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.492.293 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:47.492.291 [npu_driver.cc:4338] 618884 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.492.298 [tensor_data_transfer.cpp:1054]618878 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_image_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.492.305 [tensor_data_transfer.cpp:612]618884 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_histogram_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.492.303 [tensor_data_transfer.cpp:612]618864 acltdtReceiveTensorV2: queue is empty, device is 4, name is _npu_log
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:47.492.306 [npu_driver.cc:4338] 618885 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.492.307 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.492.316 [npu_driver.cc:3828] 618832 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=320.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.492.311 [tensor_data_transfer.cpp:1056]618878 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.492.319 [tensor_data_transfer.cpp:1054]618884 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_histogram_summary
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.492.325 [api_impl.cc:6121] 618878 MemQueuePeek: Start to peek queue on devId 7, qid is 3.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.492.324 [npu_driver.cc:3828] 618833 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=321.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.492.309 [api_impl.cc:6121] 618880 MemQueuePeek: Start to peek queue on devId 4, qid is 4.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.492.317 [tensor_data_transfer.cpp:1054]618864 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is _npu_log
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:47.492.332 [npu_driver.cc:4338] 618873 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.492.334 [tensor_data_transfer.cpp:1056]618884 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.492.325 [tensor_data_transfer.cpp:612]618885 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_histogram_summary
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.492.332 [npu_driver.cc:4330] 618880 MemQueuePeek: peek mem queue, deviceId=4, qid=4, timeout=800.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:47.492.341 [npu_driver.cc:4338] 618868 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.492.357 [tensor_data_transfer.cpp:1056]618864 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.492.365 [tensor_data_transfer.cpp:1054]618885 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_histogram_summary
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:47.492.374 [npu_driver.cc:4338] 618872 MemQueuePeek: queue empty
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.492.342 [npu_driver.cc:4330] 618878 MemQueuePeek: peek mem queue, deviceId=7, qid=3, timeout=800.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.492.355 [tensor_data_transfer.cpp:612]618873 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_tensor_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.492.396 [tensor_data_transfer.cpp:612]618872 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_tensor_summary
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.492.363 [api_impl.cc:6121] 618884 MemQueuePeek: Start to peek queue on devId 7, qid is 5.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:47.492.362 [npu_driver.cc:4338] 618881 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.492.376 [tensor_data_transfer.cpp:612]618868 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_tensor_dump
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.492.382 [api_impl.cc:6121] 618864 MemQueuePeek: Start to peek queue on devId 4, qid is 0.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.492.388 [tensor_data_transfer.cpp:1056]618885 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:47.492.393 [npu_driver.cc:4338] 618870 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.492.412 [tensor_data_transfer.cpp:1054]618872 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_tensor_summary
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:47.492.431 [npu_driver.cc:4338] 618866 MemQueuePeek: queue empty
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:47.492.412 [npu_driver.cc:4338] 618876 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.492.404 [tensor_data_transfer.cpp:1054]618873 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_tensor_summary
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.492.414 [npu_driver.cc:4330] 618884 MemQueuePeek: peek mem queue, deviceId=7, qid=5, timeout=800.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.492.428 [tensor_data_transfer.cpp:612]618881 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_scalar_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.492.439 [tensor_data_transfer.cpp:612]618870 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_tensor_dump
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.492.417 [tensor_data_transfer.cpp:1054]618868 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_tensor_dump
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.492.425 [npu_driver.cc:4330] 618864 MemQueuePeek: peek mem queue, deviceId=4, qid=0, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.492.431 [api_impl.cc:6121] 618885 MemQueuePeek: Start to peek queue on devId 4, qid is 5.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.492.444 [tensor_data_transfer.cpp:612]618866 acltdtReceiveTensorV2: queue is empty, device is 7, name is _npu_log
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.492.439 [tensor_data_transfer.cpp:1056]618872 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.492.452 [tensor_data_transfer.cpp:612]618876 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_image_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.492.453 [tensor_data_transfer.cpp:1056]618873 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.492.476 [tensor_data_transfer.cpp:1054]618881 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_scalar_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.492.486 [tensor_data_transfer.cpp:1054]618870 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_tensor_dump
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.492.505 [tensor_data_transfer.cpp:1054]618866 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is _npu_log
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.492.508 [tensor_data_transfer.cpp:1054]618876 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_image_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.492.476 [tensor_data_transfer.cpp:1056]618868 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.492.515 [api_impl.cc:6121] 618873 MemQueuePeek: Start to peek queue on devId 7, qid is 2.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.492.521 [tensor_data_transfer.cpp:1056]618881 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.492.490 [npu_driver.cc:4330] 618885 MemQueuePeek: peek mem queue, deviceId=4, qid=5, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.492.496 [api_impl.cc:6121] 618872 MemQueuePeek: Start to peek queue on devId 4, qid is 2.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.492.526 [tensor_data_transfer.cpp:1056]618876 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.492.530 [tensor_data_transfer.cpp:1056]618870 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.492.561 [api_impl.cc:6121] 618876 MemQueuePeek: Start to peek queue on devId 4, qid is 3.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.492.536 [tensor_data_transfer.cpp:1056]618866 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.492.547 [npu_driver.cc:4330] 618873 MemQueuePeek: peek mem queue, deviceId=7, qid=2, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.492.577 [npu_driver.cc:4330] 618876 MemQueuePeek: peek mem queue, deviceId=4, qid=3, timeout=800.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.492.556 [api_impl.cc:6121] 618881 MemQueuePeek: Start to peek queue on devId 7, qid is 4.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.492.565 [api_impl.cc:6121] 618870 MemQueuePeek: Start to peek queue on devId 7, qid is 1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.492.570 [api_impl.cc:6121] 618866 MemQueuePeek: Start to peek queue on devId 7, qid is 0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.492.586 [npu_driver.cc:4330] 618881 MemQueuePeek: peek mem queue, deviceId=7, qid=4, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.492.536 [api_impl.cc:6121] 618868 MemQueuePeek: Start to peek queue on devId 4, qid is 1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.492.595 [npu_driver.cc:4330] 618870 MemQueuePeek: peek mem queue, deviceId=7, qid=1, timeout=800.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.492.601 [npu_driver.cc:4330] 618866 MemQueuePeek: peek mem queue, deviceId=7, qid=0, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.492.549 [npu_driver.cc:4330] 618872 MemQueuePeek: peek mem queue, deviceId=4, qid=2, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.492.615 [npu_driver.cc:4330] 618868 MemQueuePeek: peek mem queue, deviceId=4, qid=1, timeout=800.
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:47.520.168 [queue_client_comm.c:114][ascend][curpid:618670,618911][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:47.520.169 [queue_client_comm.c:114][ascend][curpid:618670,618909][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:47.520.251 [npu_driver.cc:4338] 618911 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.520.268 [tensor_data_transfer.cpp:612]618911 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_histogram_summary
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:47.520.275 [npu_driver.cc:4338] 618909 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.520.280 [tensor_data_transfer.cpp:1054]618911 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_histogram_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.520.287 [tensor_data_transfer.cpp:612]618909 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_scalar_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.520.292 [tensor_data_transfer.cpp:1056]618911 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.520.300 [tensor_data_transfer.cpp:1054]618909 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_scalar_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.520.305 [api_impl.cc:6121] 618911 MemQueuePeek: Start to peek queue on devId 6, qid is 5.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.520.313 [tensor_data_transfer.cpp:1056]618909 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.520.318 [npu_driver.cc:4330] 618911 MemQueuePeek: peek mem queue, deviceId=6, qid=5, timeout=800.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.520.325 [api_impl.cc:6121] 618909 MemQueuePeek: Start to peek queue on devId 6, qid is 4.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.520.339 [npu_driver.cc:4330] 618909 MemQueuePeek: peek mem queue, deviceId=6, qid=4, timeout=800.
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:47.524.172 [queue_client_comm.c:114][ascend][curpid:618670,618905][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:47.524.177 [queue_client_comm.c:114][ascend][curpid:618670,618901][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:47.524.178 [queue_client_comm.c:114][ascend][curpid:618670,618907][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:47.524.183 [queue_client_comm.c:114][ascend][curpid:618670,618903][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:47.524.247 [npu_driver.cc:4338] 618905 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.524.262 [tensor_data_transfer.cpp:612]618905 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_tensor_summary
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:47.524.269 [npu_driver.cc:4338] 618901 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.524.274 [tensor_data_transfer.cpp:1054]618905 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_tensor_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.524.281 [tensor_data_transfer.cpp:612]618901 acltdtReceiveTensorV2: queue is empty, device is 6, name is _npu_log
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.524.285 [tensor_data_transfer.cpp:1056]618905 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.524.295 [tensor_data_transfer.cpp:1054]618901 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is _npu_log
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:47.524.300 [npu_driver.cc:4338] 618907 MemQueuePeek: queue empty
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.524.299 [api_impl.cc:6121] 618905 MemQueuePeek: Start to peek queue on devId 6, qid is 2.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.524.308 [tensor_data_transfer.cpp:1056]618901 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.524.315 [tensor_data_transfer.cpp:612]618907 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_image_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.524.320 [npu_driver.cc:4330] 618905 MemQueuePeek: peek mem queue, deviceId=6, qid=2, timeout=800.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.524.326 [api_impl.cc:6121] 618901 MemQueuePeek: Start to peek queue on devId 6, qid is 0.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:47.524.327 [npu_driver.cc:4338] 618903 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.524.332 [tensor_data_transfer.cpp:1054]618907 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_image_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.524.340 [npu_driver.cc:4330] 618901 MemQueuePeek: peek mem queue, deviceId=6, qid=0, timeout=800.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.524.348 [tensor_data_transfer.cpp:612]618903 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_tensor_dump
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.524.353 [tensor_data_transfer.cpp:1056]618907 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.524.364 [tensor_data_transfer.cpp:1054]618903 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_tensor_dump
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.524.369 [api_impl.cc:6121] 618907 MemQueuePeek: Start to peek queue on devId 6, qid is 3.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.524.377 [tensor_data_transfer.cpp:1056]618903 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.524.384 [npu_driver.cc:4330] 618907 MemQueuePeek: peek mem queue, deviceId=6, qid=3, timeout=800.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.524.390 [api_impl.cc:6121] 618903 MemQueuePeek: Start to peek queue on devId 6, qid is 1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.524.402 [npu_driver.cc:4330] 618903 MemQueuePeek: peek mem queue, deviceId=6, qid=1, timeout=800.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:47.551.198 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618981] [ServerToClientMsgProc] [sessionID=1]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.551.206 [runtime.cc:3077] 618834 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=0, devId=0, tdt status=0
[INFO] TDT(618646,python3.9):2025-04-03-09:27:47.551.223 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618981] [TsdClient] DeviceMsgProc recvMsg realDeviceId[0] msgType[49] localDevId[0] rspCode[0]heterogeneousSubPid[31799], tsdSupportLevel_[63]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:47.551.240 [hdc_client.cpp:172][TsdRecvData][tid:618981] [deviceId=0] the Tsd recv data already
[INFO] TDT(618646,python3.9):2025-04-03-09:27:47.551.251 [process_mode_manager.cpp:1461][ProcessOpenSubProc][tid:618981] OpenSubProc success stype:0, pid:31799
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.551.265 [adapter_tdt.cc:39] [618981]Open TsdProcess success. deviceLogicId[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.551.275 [network_manager.cc:118] [618981][TsdProcessOpen]hrtTsdProcessOpen success, subPid[31799], devicePhyId_[0], deviceLogicId_[0], hasBackup[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.551.288 [network_manager.cc:180] [618981][NetworkManager][Init]open tsd by process success, devicePhyId[0], deviceLogicId_[0].
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.551.289 [npu_driver.cc:551] 618834 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:47.551.341 [ra_host.c:205]tid:618981,ra_init(205) : Input parameters: phy_id[0], nic_position:[1] hdc_type:[18]
[INFO] ROCE(618646,python3.9):2025-04-03-09:27:47.551.360 [dl_hal_function.c:218]dl_hal_init(218) : dl_hal_init success, no need to dlopen libascend_hal.so!
[INFO] DRV(618646,python3.9):2025-04-03-09:27:47.551.375 [devdrv_hccl.c:103][ascend][curpid:618646,618981][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618646)
[INFO] ROCE(618646,python3.9):2025-04-03-09:27:47.551.389 [dl_hal_function.c:218]dl_hal_init(218) : dl_hal_init success, no need to dlopen libascend_hal.so!
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:47.551.401 [ra_hdc.c:580]tid:618981,ra_hdc_init(580) : hdc init start! logic id is 0, phy id is 0, hdc_type is 18
[INFO] DRV(618646,python3.9):2025-04-03-09:27:47.551.554 [hdc_core.c:1982][ascend][curpid:618646,618981][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4195; pid=618646)
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:47.551.913 [ra_hdc.c:616]tid:618981,ra_hdc_init(616) : hdc init OK! phy_id[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.555.430 [adapter_hccp.cc:583] [618981]init ra success.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.555.443 [network_manager.cc:222] [618981]NetworkManager nicDeploy[1] deviceLogicId_[0] devicePhyId_[0] init ra OK, nicSocketMap size[1], isHostUseDevNic[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.555.461 [hccl_communicator_attrs.cc:1307] [618981][HcclCommunicator]IsSupportEnableRoce
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.555.483 [hccl_communicator_attrs.cc:1275] [618981]IsEnableRoce ret: 0, interServer_: 0, isInterServerVnic: 0, roceSwitch: 0, isSingleMeshAggregation_: 1
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.555.499 [hccl_communicator.cc:2259] [618981][HcclCommunicator][GetLocalNicPort] nicType[0], devicePortSwitchOn[0], isUseRankPort[1], get port[16666], devId[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.555.522 [adapter_hccp.cc:1650] [618981]hrtRaGetInterfaceVersion phyId[0], opCode[55], version[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.555.707 [adapter_hccp.cc:2343] [618981]Get available Vnic info success, deviceIdType[0] deviceId[0x0] Vnic ip[192.168.2.199]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.555.751 [network_manager.cc:69] [618981]NetworkManager::GetInstance deviceLogicID[0].
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:47.555.766 [ra_host.c:280]tid:618981,ra_socket_init(280) : socket init:mode=1 phy_id=0 family=2 ip=192.168.2.199
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.555.781 [adapter_hccp.cc:806] [618981]socket init success, ip[3338840256] device id[0], socketHandle[0xfffe7007c2c0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.555.793 [network_manager.cc:692] [618981]devicePhyId[0], ip[192.168.2.199] socket init OK
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.555.803 [network_manager.cc:432] [618981][Start][Vnic]trying to listen on ip[192.168.2.199] port[16666].
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:47.555.817 [ra_host.c:875]tid:618981,ra_socket_listen_start(875) : Input parameters: [0]th, phy_id[0], local_ip[192.168.2.199], port[16666]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.556.125 [network_manager.cc:448] [618981][Start][Vnic]Listen on ip[192.168.2.199], port[16666] sucess, devPhyId[0], devLogicId[0], isAutoPort[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.556.140 [network_manager.cc:451] [618981]NetworkManager devicePhyId_[0] port[16666] start vnic OK. refCount[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.556.152 [network_manager.cc:69] [618981]NetworkManager::GetInstance deviceLogicID[0].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.556.173 [hccl_socket.cc:106] [618981][HcclSocket][Listen] device[0] listens on ip[192.168.2.199] port[16666] success, socketType[0].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.556.186 [hccl_socket_manager.cc:56] [618981][Init][Server]ip[192.168.2.199] port[16666]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.556.205 [hccl_communicator.cc:1548] [618981][HcclCommunicator][InitRaResource] init vnic with ip[192.168.2.199] port[16666] success
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.556.218 [hccl_communicator_attrs.cc:1307] [618981][HcclCommunicator]IsSupportEnableRoce
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.556.227 [hccl_communicator_attrs.cc:1275] [618981]IsEnableRoce ret: 0, interServer_: 0, isInterServerVnic: 0, roceSwitch: 0, isSingleMeshAggregation_: 1
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.556.239 [hccl_communicator.cc:1565] [618981]isUsedRdmaLevel0_[0] nicNum[1] hostIP[192.168.0.44], nicDeployment[1].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.556.252 [network_manager.cc:69] [618981]NetworkManager::GetInstance deviceLogicID[0].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.556.264 [hccl_communicator.cc:2028] [618981]profiling config information:options[], mode[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.556.393 [adapter_trace.cc:21] [618981]Call TraceCreate, return value[0]
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:47.556.411 [atrace_api.c:61](tid:618981) AtraceCreateWithAttr start.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:47.556.500 [trace_rb_log.c:45](tid:618981) init ring buffer time finished, realTime 1743643667556492281, monotonicTime 4163676713201, freq 99974 kHz, minutesWest 480 minutes
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:47.556.515 [trace_rb_log.c:137](tid:618981) [HCCL_618981_0] create ring buffer success, msgSize 128 bytes, msgTxtSize 112 bytes, bufferSize 1024 bytes, msg space 128 bytes, total space 131568 bytes
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:47.556.538 [tracer_mgr_operate.c:66](tid:618981) create object HCCL_618981_0 success, exitSave(true), noLock(false).
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:47.556.550 [atrace_api.c:63](tid:618981) AtraceCreateWithAttr end.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.556.559 [adapter_trace.cc:70] [618981]Call TraceCreateWithAttr, return value[0xaaaaf6110be8], Params: objName[HCCL_618981_0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.556.612 [rank_consistentcy_checker.cc:32] [618981][GetInstance] get deviceLogicId[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.556.651 [api_impl.cc:1486] 618981 GetMaxStreamAndTask: maxTaskNum:2013, maxStrCount:2016.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.556.675 [npu_driver.cc:4604] 618981 GetMaxStreamAndTask: deviceId=0, tsId=0, streamCount=1984.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.556.688 [task_exception_handler.cc:1212] [618981]get from RTS the max stream count[1984] the max task count[65535]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.556.707 [hccl_communicator_attrs.cc:1099] [618981][Set][HcclCommunicatorAttrs][MeshAggregationRankSize]set MeshAggregationRankSize[8].
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.556.765 [api_impl.cc:4219] 618981 RegProfCtrlCallback: Reg profiling callback, moduleId=3.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.556.782 [command_handle.cc:25] [618981][Profiling][CommandHandle] CommandHandle's rtType is 2.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.556.794 [command_handle.cc:99] [618981][Check][Param]SetMsprofReporterCallback.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.556.888 [profiler_manager_impl.cc:76] [618981][ProfilerManager][InitProfiler]Register CtrlCallBack success
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.556.903 [hccl_communicator.cc:2193] [618981][BASE][InitProfiler]Register CtrlCallBack success.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.556.915 [hccl_communicator.cc:803] [618981]Will use ffts mode.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.556.940 [api_impl.cc:3138] 618981 GetDeviceIndexByPhyId: get Index by PhyId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.556.954 [api_impl.cc:3149] 618981 GetDeviceIndexByPhyId: GetDeviceIndexByPhyId, device_mode=0, phyId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.556.965 [api_impl.cc:3157] 618981 GetDeviceIndexByPhyId: cloud v2, device_mode=0, device_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.556.976 [runtime.cc:5239] 618981 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.558.382 [api_impl.cc:3476] 618981 GetDeviceInfo: get device info, deviceId=0
[WARNING] HCCL(618646,python3.9):2025-04-03-09:27:47.558.432 [tbe_vector_reduce.cc:508] [618981]ENV:LD_LIBRARY_PATH lack fwkacllib/lib64
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.559.465 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.559.621 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.559.637 [dispatcher.cc:157] [618981][GetNotifyMaxWaitTime] notifyMaxWaitTime_ is 2147483647s
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.559.654 [api_impl.cc:3138] 618981 GetDeviceIndexByPhyId: get Index by PhyId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.559.666 [api_impl.cc:3149] 618981 GetDeviceIndexByPhyId: GetDeviceIndexByPhyId, device_mode=0, phyId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.559.677 [api_impl.cc:3157] 618981 GetDeviceIndexByPhyId: cloud v2, device_mode=0, device_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.559.687 [runtime.cc:5239] 618981 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.559.708 [api_impl.cc:1990] 618981 DevMalloc: size=4, type=16, moduleId=3.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.560.566 [api_error.cc:1218] 618981 DevMalloc: device malloc Succ, size=4, type=16, moduleId=3, start ptr=0x12c280000000, end ptr=0x12c280000004
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.560.622 [api_impl.cc:1990] 618981 DevMalloc: size=4, type=16, moduleId=3.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.560.645 [api_error.cc:1218] 618981 DevMalloc: device malloc Succ, size=4, type=16, moduleId=3, start ptr=0x12c280001000, end ptr=0x12c280001004
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.560.674 [api_impl.cc:1990] 618981 DevMalloc: size=4, type=16, moduleId=3.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.560.690 [api_error.cc:1218] 618981 DevMalloc: device malloc Succ, size=4, type=16, moduleId=3, start ptr=0x12c280002000, end ptr=0x12c280002004
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.560.718 [opexecounter.cc:71] [618981]alloc counter mem resource.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.560.754 [hccl_communicator_attrs.cc:1368] [618981][CollectAlgoAttr]:isUsedRdmaLevel0:[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.560.801 [alg_configurator.cc:68] [618981][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.560.821 [alg_configurator.cc:241] [618981][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.560.843 [alg_configurator.cc:134] [618981]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.560.857 [alg_configurator.cc:68] [618981][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.560.870 [alg_configurator.cc:241] [618981][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.560.881 [alg_configurator.cc:134] [618981]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.560.894 [alg_configurator.cc:68] [618981][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.560.907 [alg_configurator.cc:241] [618981][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.560.919 [alg_configurator.cc:134] [618981]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[2]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.560.931 [alg_configurator.cc:68] [618981][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.560.944 [alg_configurator.cc:241] [618981][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.560.955 [alg_configurator.cc:134] [618981]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[3]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.560.968 [alg_configurator.cc:68] [618981][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.560.980 [alg_configurator.cc:241] [618981][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.560.992 [alg_configurator.cc:134] [618981]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[4]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.004 [alg_configurator.cc:68] [618981][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.024 [alg_configurator.cc:241] [618981][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.036 [alg_configurator.cc:134] [618981]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[5]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.049 [alg_configurator.cc:68] [618981][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.061 [alg_configurator.cc:241] [618981][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.072 [alg_configurator.cc:134] [618981]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[6]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.085 [alg_configurator.cc:68] [618981][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.097 [alg_configurator.cc:241] [618981][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.108 [alg_configurator.cc:134] [618981]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[7]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.119 [alg_configurator.cc:68] [618981][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.133 [alg_configurator.cc:241] [618981][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.143 [alg_configurator.cc:134] [618981]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[8]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.155 [alg_configurator.cc:68] [618981][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.168 [alg_configurator.cc:241] [618981][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.179 [alg_configurator.cc:134] [618981]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[9]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.191 [alg_configurator.cc:68] [618981][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.204 [alg_configurator.cc:241] [618981][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.216 [alg_configurator.cc:134] [618981]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[10]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.228 [alg_configurator.cc:68] [618981][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.241 [alg_configurator.cc:241] [618981][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.252 [alg_configurator.cc:134] [618981]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[11]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.264 [alg_configurator.cc:68] [618981][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.277 [alg_configurator.cc:241] [618981][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.287 [alg_configurator.cc:134] [618981]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[12]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.303 [alg_configurator.cc:68] [618981][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.316 [alg_configurator.cc:241] [618981][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.328 [alg_configurator.cc:134] [618981]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[13]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.340 [alg_configurator.cc:68] [618981][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.354 [alg_configurator.cc:241] [618981][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.366 [alg_configurator.cc:134] [618981]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[14]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.378 [alg_configurator.cc:68] [618981][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.391 [alg_configurator.cc:241] [618981][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.402 [alg_configurator.cc:134] [618981]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[15]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.414 [alg_configurator.cc:68] [618981][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.427 [alg_configurator.cc:241] [618981][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.439 [alg_configurator.cc:134] [618981]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[16]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.452 [alg_configurator.cc:68] [618981][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.465 [alg_configurator.cc:241] [618981][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.476 [alg_configurator.cc:134] [618981]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[17]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.488 [alg_configurator.cc:68] [618981][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.500 [alg_configurator.cc:241] [618981][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.512 [alg_configurator.cc:134] [618981]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[18]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.533 [alg_configurator.cc:449] [618981][AlgConfigurator][GetTopoTypeByAlgType]algtype[level0:fullmesh,level1:ring,level2:H-D], devicetype[2],topotype[8] is selected
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.546 [alg_configurator.cc:42] [618981]alg configurator init success.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.585 [topo_info_extractor.cc:66] [618981]factory init:collective id[192.168.0.44%enp67s0f5_60008_0_1743643662827273], user rank[0], user rank size[8], topo type[8], device Type[2], meshAggregationRankSize[8]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.610 [topo_info_extractor.cc:155] [618981][SetRankInfo]rankData_: userRank[0], devicePhyId[0], serverIdx[0], superPodId[], superPodIdx[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.561.651 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=1, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.681 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.561.700 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=2, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.717 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.561.731 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=3, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.746 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.561.775 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=4, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.792 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.561.806 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=5, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.820 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.561.834 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=6, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.850 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.561.863 [api_error.cc:3478] 618981 GetPairPhyDevicesInfo: input physic devId=0, input physic otherDevId=7, infoType=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.878 [adapter_rts.cc:940] [618981][hrtGetPairDeviceLinkTypeRaw]phyDevId[0] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.561.896 [topo_info_extractor.cc:348] [618981]check server info:server rank size[8], expected value[8], topo type[8]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.033 [topo_info_extractor.cc:888] [618981]SetTopoInfoForLevel0: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[0], userRankSize[8], topoRankInfo[userRank/devicePhyId: 0/0; 1/1; 2/2; 3/3; 4/4; 5/5; 6/6; 7/7; ]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.062 [topo_info_extractor.cc:585] [618981][Set][TopoInfoForLevel1] topoType_[8] ringSize[8]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.084 [topo_info_extractor.cc:646] [618981][Set][TopoInfoForLevel1] calc subGroup superPodId[] subIndex[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.100 [topo_info_extractor.cc:685] [618981]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 0, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 0/192.168.0.44/0/192.168.100.101/1; ]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.116 [topo_info_extractor.cc:685] [618981]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 1, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 1/192.168.0.44/1/29.105.19.202/0; ]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.132 [topo_info_extractor.cc:685] [618981]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 2, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 2/192.168.0.44/2/29.105.165.16/0; ]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.147 [topo_info_extractor.cc:685] [618981]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 3, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 3/192.168.0.44/3/29.105.51.138/0; ]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.162 [topo_info_extractor.cc:685] [618981]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 4, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 4/192.168.0.44/4/29.105.24.184/0; ]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.181 [topo_info_extractor.cc:685] [618981]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 5, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 5/192.168.0.44/5/29.105.72.114/0; ]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.197 [topo_info_extractor.cc:685] [618981]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 6, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 6/192.168.0.44/6/29.105.134.38/0; ]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.211 [topo_info_extractor.cc:685] [618981]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 7, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 7/192.168.0.44/7/29.105.73.96/0; ]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.222 [topo_info_extractor.cc:689] [618981]SetTopoInfoForLevel1: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[0], userRankSize[8], plane size[8]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.235 [topo_info_extractor.cc:697] [618981][Set][TopoInfoForLevel2] select origin proc
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.249 [topo_info_extractor.cc:734] [618981]SetTopoInfoForLevel2: topoRankInfo[userRank/devicePhyId/serverIdx/superPodId: 0/0/0/; ]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.259 [topo_info_extractor.cc:739] [618981]SetTopoInfoForLevel2: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[0], userRankSize[8], plane size[1]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.270 [topo_info_extractor.cc:585] [618981][Set][TopoInfoForLevel1] topoType_[8] ringSize[8]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.284 [topo_info_extractor.cc:646] [618981][Set][TopoInfoForLevel1] calc subGroup superPodId[] subIndex[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.297 [topo_info_extractor.cc:685] [618981]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 0, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 0/192.168.0.44/0/192.168.100.101/1; ]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.312 [topo_info_extractor.cc:685] [618981]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 1, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 1/192.168.0.44/1/29.105.19.202/0; ]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.331 [topo_info_extractor.cc:685] [618981]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 2, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 2/192.168.0.44/2/29.105.165.16/0; ]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.346 [topo_info_extractor.cc:685] [618981]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 3, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 3/192.168.0.44/3/29.105.51.138/0; ]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.361 [topo_info_extractor.cc:685] [618981]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 4, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 4/192.168.0.44/4/29.105.24.184/0; ]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.376 [topo_info_extractor.cc:685] [618981]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 5, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 5/192.168.0.44/5/29.105.72.114/0; ]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.390 [topo_info_extractor.cc:685] [618981]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 6, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 6/192.168.0.44/6/29.105.134.38/0; ]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.404 [topo_info_extractor.cc:685] [618981]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 7, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 7/192.168.0.44/7/29.105.73.96/0; ]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.415 [topo_info_extractor.cc:689] [618981]SetTopoInfoForLevel1: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[0], userRankSize[8], plane size[8]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.447 [topo_info_extractor.cc:790] [618981]SetTopoInfoForMeshL1: topoRankInfo[userRank/devicePhyId0/0; ]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.473 [topo_info_extractor.cc:519] [618981]plane info:topo type[8], device type[2], COMM_COMBINE size[1], COMM_LEVEL0 size[7], COMM_LEVEL1 size[8], COMM_LEVEL2 size[1], COMM_MESH_L0 size[1], COMM_MESH_L1 size[1]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.562.601 [api_impl.cc:1990] 618981 DevMalloc: size=32, type=16, moduleId=3.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.562.627 [api_error.cc:1218] 618981 DevMalloc: device malloc Succ, size=32, type=16, moduleId=3, start ptr=0x12c280003000, end ptr=0x12c280003020
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.679 [hccl_impl.cc:59] [618981]start hccl resources build:get deviceLogicId[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.562.802 [hccl_impl.cc:177] [618981]hcclImpl init success.
[WARNING] HCCL(618646,python3.9):2025-04-03-09:27:47.562.829 [hccl_aiv.cc:279] [618981][AIV][GetAivOpBinaryPath]ENV:LD_LIBRARY_PATH lack fwkacllib/lib64
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.565.687 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.565.740 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.565.845 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.565.862 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_float.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.565.881 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_reduce_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.565.904 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.565.924 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.018 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.031 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_half.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.044 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_reduce_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.060 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.080 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.175 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.188 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_int16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.201 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_reduce_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.215 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.235 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.322 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.335 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_int32_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.346 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_reduce_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.369 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.388 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.475 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.488 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_int8_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.501 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_reduce_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.515 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.534 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.622 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.635 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_bfloat16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.648 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_reduce_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.660 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.679 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.765 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.777 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_half.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.790 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_vc_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.803 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.821 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.906 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.919 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_int16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.931 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_vc_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.945 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.566.964 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.050 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.063 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_uint16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.075 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_vc_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.089 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.107 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.201 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.214 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_float.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.230 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_vc_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.244 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.263 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.351 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.363 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_int32_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.375 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_vc_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.389 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.407 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.498 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.511 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_uint32_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.523 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_vc_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.537 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.556 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.642 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.655 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_int8_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.667 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_vc_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.681 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.699 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.786 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.798 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_uint8_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.814 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_vc_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.828 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.846 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.934 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.952 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_bfloat16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.967 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_vc_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.567.982 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.001 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.089 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.101 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_half.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.114 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_v_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.127 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.146 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.241 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.257 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_int16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.269 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_v_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.283 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.302 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.390 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.403 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_uint16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.416 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_v_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.430 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.448 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.534 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.546 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_float.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.559 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_v_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.572 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.591 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.676 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.688 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_int32_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.700 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_v_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.723 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.742 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.830 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.843 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_uint32_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.856 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_v_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.870 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.888 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.975 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.987 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_int8_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.568.999 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_v_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.012 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.030 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.116 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.129 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_uint8_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.142 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_v_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.155 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.173 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.259 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.272 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_bfloat16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.284 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_v_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.298 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.316 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.403 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.415 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_half.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.428 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.441 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.465 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.551 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.564 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_int16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.576 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.590 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.608 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.695 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.708 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_uint16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.721 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.733 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.751 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.843 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.855 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_float.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.868 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.881 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.899 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.569.988 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.000 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_int32_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.013 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.027 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.045 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.131 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.144 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_uint32_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.156 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.169 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.188 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.277 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.290 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_int8_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.303 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.317 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.335 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.421 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.434 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_uint8_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.447 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.461 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.477 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.565 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.578 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_bfloat16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.591 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.605 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.623 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.709 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.722 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_half.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.734 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.748 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.766 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.853 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.865 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_int16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.878 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.892 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.910 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.570.995 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.008 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_uint16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.029 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.044 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.062 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.149 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.161 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_float.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.174 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.189 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.207 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.294 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.306 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_int32_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.319 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.334 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.353 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.439 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.452 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_uint32_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.464 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.478 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.497 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.584 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.597 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_int8_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.609 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.623 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.641 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.727 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.740 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_uint8_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.752 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.771 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.790 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.875 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.888 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_bfloat16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.900 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_to_all_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.914 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.571.932 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.022 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.035 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_float.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.046 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_reduce_scatter_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.059 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.077 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.179 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.193 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_half.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.205 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_reduce_scatter_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.221 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.241 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.328 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.341 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_int16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.353 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_reduce_scatter_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.368 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.386 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.473 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.485 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_int32_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.497 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_reduce_scatter_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.511 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.535 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.622 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.635 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_int8_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.647 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_reduce_scatter_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.661 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.679 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.768 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.781 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_bfloat16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.794 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_reduce_scatter_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.806 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.823 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.910 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.923 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_float.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.936 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.950 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.572.968 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.054 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.067 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_half.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.079 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.093 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.111 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.198 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.211 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_int16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.224 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.238 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.256 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.343 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.360 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_int32_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.373 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.387 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.405 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.491 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.506 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_int8_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.518 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.532 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.550 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.636 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.648 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_bfloat16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.661 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.674 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.692 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.780 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.794 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_half.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.806 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_gather_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.820 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.839 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.925 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.937 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_int16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.950 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_gather_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.964 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.573.982 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.067 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.080 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_uint16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.097 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_gather_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.112 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.130 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.217 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.230 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_float.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.242 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_gather_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.256 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.274 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.365 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.378 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_int32_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.391 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_gather_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.405 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.423 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.511 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.523 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_uint32_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.536 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_gather_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.550 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.568 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.655 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.668 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_int8_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.681 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_gather_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.694 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.712 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.798 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.811 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_uint8_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.824 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_gather_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.836 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.860 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.948 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.961 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_bfloat16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.974 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_gather_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.574.987 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.006 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.091 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.104 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_half.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.117 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_gather_v_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.129 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.147 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.234 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.247 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_int16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.260 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_gather_v_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.273 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.292 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.380 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.393 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_uint16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.406 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_gather_v_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.420 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.438 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.524 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.536 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_float.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.549 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_gather_v_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.563 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.581 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.673 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.686 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_int32_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.699 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_gather_v_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.713 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.732 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.818 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.831 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_uint32_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.844 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_gather_v_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.858 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.875 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.962 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.974 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_int8_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.575.987 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_gather_v_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.576.000 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.576.017 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.576.103 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.576.116 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_uint8_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.576.129 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_gather_v_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.576.141 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.576.183 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.576.273 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.576.286 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_bfloat16_t.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.576.299 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=aiv_all_gather_v_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.576.313 [runtime.cc:1673] 618981 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.576.331 [elf.cc:566] 618981 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.576.417 [runtime.cc:1688] 618981 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.576.430 [runtime.cc:1953] 618981 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=hccl_aiv_sync.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.576.446 [runtime.cc:1897] 618981 KernelSetDfx: kernel_name=hccl_aiv_sync, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] DRV(618646,python3.9):2025-04-03-09:27:47.576.469 [devmm_svm.c:1972][ascend][curpid:618646,618981][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0x2; out_feature=0x2)
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.576.485 [hdc.cc:83] [618981][HDCommunicate]supportDevMemReg_ 1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.576.497 [api_impl.cc:1990] 618981 DevMalloc: size=659456, type=16, moduleId=3.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.576.521 [api_error.cc:1218] 618981 DevMalloc: device malloc Succ, size=659456, type=16, moduleId=3, start ptr=0x12c280004000, end ptr=0x12c2800a5000
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.577.008 [api_impl.cc:1990] 618981 DevMalloc: size=659456, type=16, moduleId=3.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.577.026 [api_error.cc:1218] 618981 DevMalloc: device malloc Succ, size=659456, type=16, moduleId=3, start ptr=0x12c2800a5000, end ptr=0x12c280146000
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.577.043 [api_impl.cc:2664] 618981 MemSetSync: destMax=659456, value=0, count=659456
[INFO] DRV(618646,python3.9):2025-04-03-09:27:47.577.206 [devmm_svm.c:1972][ascend][curpid:618646,618981][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0x2; out_feature=0x2)
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.577.221 [hdc.cc:83] [618981][HDCommunicate]supportDevMemReg_ 1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.577.231 [api_impl.cc:1990] 618981 DevMalloc: size=4096, type=16, moduleId=3.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.577.246 [api_error.cc:1218] 618981 DevMalloc: device malloc Succ, size=4096, type=16, moduleId=3, start ptr=0x12c280146000, end ptr=0x12c280147000
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.577.265 [api_impl.cc:2096] 618981 HostMalloc: size=4096
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.577.283 [api_error.cc:1260] 618981 HostMalloc: Host memory malloc succeed,size=4096 , moduleId=3, host addr=0x12c0807f0000.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.577.446 [api_impl.cc:1990] 618981 DevMalloc: size=2100520, type=16, moduleId=3.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.577.519 [api_error.cc:1218] 618981 DevMalloc: device malloc Succ, size=2100520, type=16, moduleId=3, start ptr=0x12c100c00000, end ptr=0x12c100e00d28
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.577.536 [api_impl.cc:2664] 618981 MemSetSync: destMax=2100520, value=0, count=2100520
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.577.671 [api_impl.cc:1990] 618981 DevMalloc: size=32, type=16, moduleId=3.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.577.688 [api_error.cc:1218] 618981 DevMalloc: device malloc Succ, size=32, type=16, moduleId=3, start ptr=0x12c280147000, end ptr=0x12c280147020
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.577.703 [api_impl.cc:2664] 618981 MemSetSync: destMax=32, value=0, count=32
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.577.729 [peterson_lock.cc:69] [618981][PetersonLock][AllocDeviceMem] Type[Host] alloc memSize[32 Byte]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.577.742 [peterson_lock.cc:47] [618981][PetersonLock][Init] type [Host] init success, memSize [32 Byte] timeout[60 s]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.577.771 [hccl_comm.cc:129] [618981]hcclCommInitInfo:commId[hccl-618646-0-1743643665-hccl_world_group], rank[0], totalRanks[8], serverId[192.168.0.44%enp67s0f5], deviceType[2],logicDevId[0], identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.577.792 [hccl_comm.cc:175] [618981][SetQpQosAttr]The TC and SL do not use the config configuration. It will use environment variables to configure. TC[132], SL[4]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.577.816 [topo_matcher.cc:528] [618981][SetAivMode]AivMode is set to [0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.577.829 [topo_matcher.cc:540] [618981][SetAicpuMode]Aicpu is set to [0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.577.847 [hcom_plugin.cc:349] [618981][Set][GroupTopoInfo]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] rankSize[8].
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.577.883 [runtime.cc:5239] 618981 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.577.895 [adapter_rts.cc:198] [618981][hrtGetDeviceRefresh]deviceLogicId[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.577.913 [hcom_common.cc:85] [618981][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[0] 
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.577.930 [op_base.cc:128] [618981][HcclGetDeviceId] deviceLogicId[0] 
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.577.944 [hccl_comm.cc:1296] [618981]HCCL_KEY_INFO: GetTopoDesc topoDescs[0xfffe867cccb8] topoSize[2]
[INFO] GE(618646,python3.9):2025-04-03-09:27:47.577.963 [hcom_topo_info.cc:24]618981 SetGroupTopoInfo:Add group 192.168.0.44%enp67s0f5_60008_0_1743643662827273 successfully.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.577.977 [hcom_plugin.cc:371] [618981][Set][GroupTopoInfo]SetGroupTopoInfo group set success
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.577.996 [topoinfo_detect.cc:555] [618981]NetworkManager stop host net success! ip[192.168.0.44%enp67s0f5] 
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.578.008 [topoinfo_detect.cc:321] [618981]TopoInfoDetect TeardownAgent ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.578.018 [topoinfo_detect.cc:219] [618981]TopoInfoDetect TeardownServer ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.578.039 [op_base.cc:1050] [618981][InitCommRootInfo]Init success, rankNum[8], rank[0], rootInfo identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], server[192.168.0.44%enp67s0f5], logicDevId[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.578.056 [profiler_base.cc:342] [618981]AddGroupUdi: group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] udi[] deviceLogicId[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.578.071 [op_base.cc:1107] [618981][HCCL_TRACE]HcclCommInitRootInfoInner success, take time [4282456]us, rankNum[8], rank[0]
[WARNING] DEVICE(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.578.131 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:157] InitializeByRootInfoConfig] End to initialize communicator by HcclCommInitRootInfo for hccl_world_group
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.578.155 [op_base.cc:853] [618981]HcclGetCommName input handle=0xfffe70022f40 commName=192.168.0.44%enp67s0f5_60008_0_1743643662827273
[INFO] DEVICE(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.578.181 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:93] Initialize] Start initializing hccl watchdog on device side for group: hccl_world_group, rank: 0
[INFO] DEVICE(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.578.200 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:77] Initialize] Initialize hccl watch dog handler. rank id: 0, group name: hccl_world_group
[INFO] DEVICE(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.578.297 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:98] Initialize] hccl watchdog on device side is successfully initialized.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.578.312 [device.cpp:183]618981 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 0.
[INFO] DEVICE(618646,fffe85fbefa0,python3.9):2025-04-03-09:27:47.578.324 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:155] WatchDogProcess] WatchDogProcess start, rank id: 0, group name: hccl_world_group
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.578.330 [api_impl.cc:3419] 618981 DeviceReset: reset device, device_id=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.578.350 [runtime.cc:3444] 618981 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x8, reset:0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.578.362 [api_impl.cc:3449] 618981 DeviceReset: Succ, userDeviceId=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.578.371 [device.cpp:189]618981 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 0.
[INFO] DEVICE(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.578.391 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_communication_group.cc:58] Initialize] Successfully initialize HCCL group hccl_world_group
[INFO] DISTRIBUTED(618646,fffea8f9efa0,python3.9):2025-04-03-09:27:47.578.470 [mindspore/ccsrc/distributed/collective/collective_manager.cc:824] CreateDeviceCommunicator] [PROF]InitDeviceCommunicator costs 4750.76 msec.
[WARNING] DISTRIBUTED(618646,fffea8f9efa0,python3.9):2025-04-03-09:27:47.578.503 [mindspore/ccsrc/distributed/collective/collective_manager.cc:828] CreateDeviceCommunicator] End initialize communication group on the device side: hccl_world_group
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.578.560 [mindspore/ccsrc/distributed/collective/collective_manager.cc:404] CreateCommunicationGroup] [PROF]distributed_create_group costs 4756.85 msec.
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.578.584 [mindspore/ccsrc/distributed/collective/collective_manager.cc:225] Initialize] [PROF]CreateGlobalCommunicationGroup costs 4756.89 msec.
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.578.599 [mindspore/ccsrc/distributed/collective/collective_manager.cc:228] Initialize] End initializing collective communication for backend: Ascend
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.578.619 [mindspore/ccsrc/distributed/init.cc:62] Initialize] [PROF]distributed_collective_init costs 8879.17 msec.
[INFO] PIPELINE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.578.645 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:254] RecordInitStatus] Status record: system init.
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:47.584.180 [trs_cb_event.c:119][ascend][curpid:618646,618837][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =65; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:47.584.205 [trs_sqcq.c:1491][ascend][curpid:618646,618837][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:47.584.218 [npu_driver.cc:3833] 618837 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:47.584.233 [api_impl.cc:5058] 618837 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.584.248 [callback.cpp:132]618837 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.584.263 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.584.279 [npu_driver.cc:3828] 618837 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=65.
=================================================================================================================== test session starts ====================================================================================================================
platform linux -- Python 3.9.19, pytest-6.2.5, py-1.11.0, pluggy-1.5.0
rootdir: /home/jenkins/mindspore/testcases/testcases/tests/st/lccl
plugins: requests-mock-1.12.1, hydra-core-1.3.2, mock-3.14.0, forked-1.6.0, xdist-1.32.0
collected 1 item

test_lccl_allreduce.py [WARNING] DRV(618646,python3.9):2025-04-03-09:27:47.588.183 [trs_cb_event.c:119][ascend][curpid:618646,618836][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =64; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:47.588.222 [trs_sqcq.c:1491][ascend][curpid:618646,618836][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:47.588.242 [npu_driver.cc:3833] 618836 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:47.588.257 [api_impl.cc:5058] 618836 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.588.271 [callback.cpp:132]618836 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.588.288 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.588.305 [npu_driver.cc:3828] 618836 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=64.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:47.591.528 [awatchdog_monitor.c:160](tid:618680) thread 618981 not exist
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.592.337 [device.cpp:143]618646 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.592.372 [api_impl.cc:2999] 618646 SetDevice: device_id=0, deviceMode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.592.385 [device.cc:306] 618646 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.592.397 [runtime.cc:3393] 618646 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x9
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.592.412 [runtime.cc:3560] 618646 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.592.425 [api_impl.cc:2987] 618646 NewDevice: SetCurRef = 0xaaab06c88220,userDeviceId=0,deviceId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.592.438 [runtime.cc:5239] 618646 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.592.457 [api_impl.cc:2992] 618646 NewDevice: New device success, user_device_id=0, die_num=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.592.473 [api_impl.cc:3025] 618646 SetDevice: SetDevice success, curCtx=0xaaab06c88220, user_device_id=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.592.486 [acl.cpp:115]618646 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.592.498 [acl.cpp:121]618646 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.592.512 [device.cpp:154]618646 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 0
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.592.548 [mindspore/ccsrc/plugin/res_manager/ascend/ascend_res_manager.cc:496] SetDeterministic] Set kernel deterministic value: 0
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.592.564 [context.cpp:174]618646 aclrtCtxSetSysParamOpt: start to execute aclrtCtxSetSysParamOpt, opt = 0, value = 0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.592.582 [api_impl.cc:6913] 618646 CtxSetSysParamOpt: curCtx = 0xaaab06c88220, configOpt=0, configVal=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.592.611 [context.cpp:158]618646 SetSysParamOpt: successfully execute aclrtCtxSetSysParamOpt
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.593.192 [op_base.cc:1214] [618646][HcclSetConfig] Set HCCL_DETERMINISTIC is false
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.593.211 [op_base.cc:128] [618646][HcclGetDeviceId] deviceLogicId[0] 
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.593.247 [context.cpp:72]618646 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.593.262 [api_impl.cc:3717] 618646 ContextSetCurrent: set context=aaab06c88220, flag=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.593.289 [context.cpp:80]618646 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.593.323 [mindspore/ccsrc/common/amp/amp.cc:149] GetCurrentAmpStrategy] amp strategy stack is empty
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.593.714 [mindspore/ccsrc/runtime/pynative/op_compiler.cc:179] Compile] Run Op cache miss Ascend_0_AllReducehccl_world_group0sumtrue03-1-3-343_0
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.594.022 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:151] CommonUnifyMindIR] start common unify mindir opt graph:4000000000
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.594.074 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: conv_transpose_to_conv_backprop_input
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.594.189 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_0_conv_transpose_to_conv_backprop_input in 113.47 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.594.218 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: custom_op_reg_info_to_attr
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.594.255 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_1_custom_op_reg_info_to_attr in 33.55 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.594.274 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Custom not exist in name to cnode
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.594.291 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_2_inplace_assign_for_custom_op in 17.45 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.594.308 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: convert_attr_to_unify_mindir
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.594.353 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_3_convert_attr_to_unify_mindir in 42.22 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.594.385 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:164] CommonUnifyMindIR] [PROF]CommonUnifyMindIR costs 0.365 msec.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.594.453 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:191] EliminateIllegalDataTypePass] Start eliminate illegal data type for kernel graph id:4000000000
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.594.501 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_eliminate_illegal_data_type_pm_0_convert_list_to_tuple in 5.06 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.594.556 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_eliminate_illegal_data_type_pm_1_eliminate_func_type in 34.76 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.594.593 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:204] EliminateIllegalDataTypePass] [PROF]EliminateIllegalDataTypePass costs 0.137 msec.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.594.615 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:151] CommonUnifyMindIR] start common unify mindir opt graph:4000000000
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.594.647 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: conv_transpose_to_conv_backprop_input
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.594.688 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_0_conv_transpose_to_conv_backprop_input in 38.371 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.594.717 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: custom_op_reg_info_to_attr
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.594.747 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_1_custom_op_reg_info_to_attr in 28.63 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.594.764 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Custom not exist in name to cnode
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.594.781 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_2_inplace_assign_for_custom_op in 15.41 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.594.796 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: convert_attr_to_unify_mindir
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.594.826 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_3_convert_attr_to_unify_mindir in 27.08 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.594.866 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:164] CommonUnifyMindIR] [PROF]CommonUnifyMindIR costs 0.247 msec.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.594.893 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:81] BackendCommonOptimization] Status record: start common optimization. graph id: 4000000000
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.594.980 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: convert_dynamic_broadcast_to
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.595.045 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_0_convert_dynamic_broadcast_to in 62.11 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.595.096 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_1_convert_const_input_to_attr in 28 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.595.135 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_2_custom_op_const_input_to_attr in 18.41 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.595.177 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_3_convert_const_input_to_tensor_input in 22.43 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.595.228 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_4_convert_const_input_to_tensor_input_for_print in 31.39 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.595.335 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_5_convert_tuple_output_to_maketuple in 84.271 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.595.358 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_6_convert_unused_tuple_para_to_make_tuple in 1.82 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.595.374 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_common_pm_7_flatten_concat_fission is enabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.595.434 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_common_pm_7_flatten_concat_fission in 41.81 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.595.478 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_8_inset_input_structural_for_py_execute in 23.23 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.595.505 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_common_pm_9_broadcast_to_fusion is enabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.595.561 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_common_pm_9_broadcast_to_fusion in 37.13 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.595.866 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_10_add_attr_to_node in 280.94 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.595.886 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_common_pm_11_replace_addn is enabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.595.938 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_common_pm_11_replace_addn in 33.32 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.595.979 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:93] BackendCommonOptimization] [PROF]BackendCommonOptimization costs 1.081 msec.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.595.995 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:100] BackendCommonOptimization] Status record: end common optimization. graph id: 4000000000
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.596.038 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:258] OptimizationWithoutBackend] [PROF]OptimizationWithoutBackend costs 1.583 msec.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.596.410 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_0_renorm_split in 39.96 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.596.435 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: reduce_axis_update
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.596.508 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_1_reduce_axis_update in 68.91 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.596.527 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: space_to_batch_nd_attr_update
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.596.573 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_2_space_to_batch_nd_attr_update in 41.79 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.596.591 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: batch_to_space_nd_attr_update
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.596.620 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_3_batch_to_space_nd_attr_update in 26.35 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.596.648 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AdamWeightDecay not exist in name to cnode
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.596.666 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_4_adam_weight_decay_unify_mindir in 27.801 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.596.699 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_5_add_depend_for_adamw in 15.59 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.596.737 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SparseSoftmaxCrossEntropyWithLogits not exist in name to cnode
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.596.756 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_6_pynative_grad_sparse_softmax_cross_entropy_with_logits_unify_mindir_v2 in 35.87 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.596.783 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SparseSoftmaxCrossEntropyWithLogits not exist in name to cnode
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.596.800 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_7_pynative_grad_sparse_softmax_cross_entropy_with_logits_unify_mindir in 16.82 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.596.816 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SparseSoftmaxCrossEntropyWithLogits not exist in name to cnode
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.596.833 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_8_pynative_sparse_softmax_cross_entropy_with_logits_unify_mindir in 15.15 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.596.859 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim DropoutExt not exist in name to cnode
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.596.875 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_9_dropout_ext_unify_mindir1 in 25.25 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.596.899 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim DropoutGradExt not exist in name to cnode
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.596.917 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_10_dropoutgrad_ext_unify_mindir in 24.67 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.596.933 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Dropout not exist in name to cnode
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.596.949 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_11_dropout_unify_mindir1 in 14.85 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.596.965 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: dropoutgrad_unify_mindir
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.002 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_12_dropoutgrad_unify_mindir in 34.62 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.039 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim NeighborExchange not exist in name to cnode
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.057 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_13_neighbor_exchange_unify_mindir in 34.59 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.073 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim NeighborExchangeV2 not exist in name to cnode
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.089 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_14_neighbor_exchange_v2_unify_mindir in 15.18 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.105 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim NeighborExchangeV2Grad not exist in name to cnode
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.121 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_15_neighbor_exchange_v2_grad_unify_mindir in 14.53 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.137 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AlltoAll not exist in name to cnode
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.160 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_16_all_to_all_unify_mindir in 21.64 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.185 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AlltoAllV not exist in name to cnode
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.201 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_17_all_to_all_v_unify_mindir in 23.91 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.227 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNorm not exist in name to cnode
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.243 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_18_bn_split in 24.07 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.259 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: bn_grad_unify_mindir
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.317 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_19_bn_grad_unify_mindir in 55.42 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.345 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNormGrad not exist in name to cnode
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.362 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_20_bn_grad_split in 25.15 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.378 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNormGrad not exist in name to cnode
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.394 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_21_batchnormgrad_to_bninfergrad in 14.61 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.409 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNormGrad not exist in name to cnode
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.425 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_22_batch_norm_grad_infer_fission in 14.29 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.441 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNorm not exist in name to cnode
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.457 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_23_batchnorm_to_bninfer in 14.47 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.472 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Print not exist in name to cnode
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.488 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_24_print_insert_placeholder_for_tensor_name in 14.53 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.513 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim GetNext not exist in name to cnode
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.529 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_25_getnext_for_ge in 24.37 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.556 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SyncBatchNorm not exist in name to cnode
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.573 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_26_sync_bn_split in 26.05 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.605 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SyncBatchNormGrad not exist in name to cnode
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.622 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_27_sync_bn_grad_split in 23.32 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.645 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AvgPoolGrad not exist in name to cnode
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.662 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_28_avg_pool_grad_for_ge in 22.89 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.738 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_29_add_attr_to_dump in 56.66 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.898 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_30_ascend_mindir_op_adapter in 135.83 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.917 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_0_clip_by_norm_fission is enabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.966 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_0_clip_by_norm_fission in 29.62 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.597.984 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_1_cdist_fission is enabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.598.037 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_1_cdist_fission in 35.42 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.598.055 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_2_cdist_grad_fission is enabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.598.099 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_2_cdist_grad_fission in 26.02 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.598.116 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_3_batchmatmul_reducescatter_alltoall_fusion is enabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.598.152 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_3_batchmatmul_reducescatter_alltoall_fusion in 17.66 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.598.168 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_4_alltoall_allgather_batch_matmul_fusion is enabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.598.198 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_4_alltoall_allgather_batch_matmul_fusion in 13.79 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.598.214 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_5_lamb_fission_ge is enabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.598.277 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_5_lamb_fission_ge in 44.75 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.598.294 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_6_adaptive_max_pool2d_ge_fusion is enabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.598.357 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_6_adaptive_max_pool2d_ge_fusion in 36.81 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.598.374 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_7_matmul_reduce_scatter_fusion is enabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.598.446 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_7_matmul_reduce_scatter_fusion in 53.38 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.598.463 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_8_allgather_matmul_fusion is enabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.598.532 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_8_allgather_matmul_fusion in 51.42 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.598.549 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_9_FlashAttentionFusionV1 is enabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.598.567 [mindspore/ccsrc/plugin/device/ascend/optimizer/ir_fusion/flash_attention_fusion.cc:270] DefineFlashAttentionPattern] Do FlashAttentionPattern V1.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.598.679 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_9_FlashAttentionFusionV1 in 112.251 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.598.697 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_10_FlashAttentionFusionV2 is enabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.598.714 [mindspore/ccsrc/plugin/device/ascend/optimizer/ir_fusion/flash_attention_fusion.cc:384] DefineFlashAttentionPattern] Do FlashAttentionPattern V2.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.598.823 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_10_FlashAttentionFusionV2 in 107.56 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.598.841 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_11_quantbatchmatmul_reduce_fusion is enabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.598.923 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_11_quantbatchmatmul_reduce_fusion in 63.56 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.598.940 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_12_MatMulAllReduce is enabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.599.015 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_12_MatMulAllReduce in 56.23 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.599.033 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_13_grouped_matmul_assignadd_fusion is disabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.599.049 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_14_MatMulAllReduceAddRmsNorm is disabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.599.064 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_15_add_layer_norm_fusion is disabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.599.087 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_16_add_layer_norm_v3_fusion is disabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.599.102 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_17_add_layer_norm_ext_fusion is disabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.599.117 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_18_inference_qbmm_add_fusion is disabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.599.131 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_19_inference_swiglu_fusion is disabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.599.145 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_20_inference_matmul_split_fusion is disabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.599.160 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_21_add_rms_norm_dynamic_quant_fusion is disabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.599.175 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_22_add_rms_norm_quant_fusion is disabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.599.187 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_23_add_cast_rms_norm_cast_quant_fusion is disabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.599.202 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_24_rms_norm_quant_fusion is disabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.599.217 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_25_add_cast_rms_norm_cast_fusion is disabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.599.231 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_26_shape_reshape is disabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.599.245 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_27_split_concat_fusion is enabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.599.474 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_27_split_concat_fusion in 207.811 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.599.494 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_28_matmul_sigmoid_add_fusion is disabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.599.509 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_29_matmul_sigmoid_cast_add_fusion is disabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.599.525 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_30_matmul_elemwise_fusion is disabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.599.539 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_31_qbmm_allreduce_convert_bias is disabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.599.554 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_32_inference_qbmm_allreduce_add_fusion is enabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.599.649 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_32_inference_qbmm_allreduce_add_fusion in 68.08 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.599.667 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_33_remove_fa_tensor_to_tuple_ops is disabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.599.682 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_34_transpose_batch_matmul_transpose_fusion is disabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.599.697 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_35_add_rms_norm_fusion is enabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.599.762 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_35_add_rms_norm_fusion in 47.06 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.599.807 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:203] GEUnifyMindIR] [PROF]GEUnifyMindIR costs 3.728 msec.
[INFO] SESSION(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.600.098 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.600.218 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_graph_optimization.cc:40] MarkRefGraph] Mark graph is ref graph: 4000000000
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.600.429 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unfold_inputs_for_special_nodes_pm_0_ascend_convert_tuple_input_to_dynamic_input in 152.96 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.600.538 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_0_process_call_inline in 28.02 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.600.633 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_1_seed_adapter in 66.72 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.600.669 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_2_insert_tensor_move_for_communication in 11.85 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.600.715 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_3_process partial inline in 24.66 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.600.803 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_4_expander_fallback in 65.31 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.600.849 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_5_convert_pad_v3_paddings in 24.85 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.600.892 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_6_convert_pad_v3_grad_paddings in 21.96 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.600.950 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_7_resize_bilinear_add_attr in 36.69 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.600.974 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_8_backend_custom_depend in 5.65 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.601.013 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:120] GEBackendOptimizeACL] [PROF]GEBackendOptimizeACL costs 0.527 msec.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.601.069 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_graph_optimization.cc:131] OptimizeACLGraph] [PROF]OptimizeACLGraph costs 0.851 msec.
[INFO] SESSION(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.601.114 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.601.398 [mindspore/ccsrc/plugin/device/ascend/hal/device/kernel_select_ascend.cc:624] CollectOpSelectedType] AllReduce select hccl kernel
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.601.431 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:315] SelectKernel] [PROF]SelectKernel costs 0.336 msec.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.601.447 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:319] PrintOpSelectedNum] Number of GE_KERNEL, INTERNAL_KERNEL, OPAPI_KERNEL, ACL_KERNEL, ATB_KERNEL, HCCL_KERNEL, HOST_KERNEL:
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.601.463 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:327] PrintOpSelectedNum] 0 0 0 0 0 1 0 
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.601.558 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_0_set_fracz_group_attr in 34.53 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.601.635 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_1_insert_identity in 51.8 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.601.697 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_2_erase_visit_attr in 38.26 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.601.778 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_3_deal_ref_output in 60.01 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.601.797 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_opt_acl_after_kernel_select_pm_4_shape_reshape is disabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.601.812 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_opt_acl_after_kernel_select_pm_5_shape_reshape_direct is enabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.601.865 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_opt_acl_after_kernel_select_pm_5_shape_reshape_direct in 34.92 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.601.898 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_6_graph_view_replace in 12.37 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.601.917 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_7_label_1f1b_overlap_node in 0.63 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.601.955 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:173] GEBackendOptimizeACLAfterKernelSelect] [PROF]GEBackendOptimizeACLAfterKernelSelect costs 0.472 msec.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.601.998 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_graph_optimization.cc:166] OptimizeACLGraphAfterKernelSelect] [PROF]OptimizeACLGraphAfterKernelSelect costs 0.515 msec.
[INFO] SESSION(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.602.033 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.602.132 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_after_inline_pm_0_DropoutGenMask is enabled.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.602.166 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_after_inline_pm_0_DropoutGenMask in 0.69 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.602.205 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_1_cse in 18.64 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.602.228 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_2_eliminate_maketuple_getitem in 4.45 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.602.245 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_3_insert_move_to in 0.52 us
[INFO] SESSION(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.602.273 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.602.344 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_4_insert_pre_fetch_depend in 79.88 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.602.362 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_5_overlap_1b1f in 0.74 us
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.602.384 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:242] GEAfterInlineOptimize] [PROF]GEAfterInlineOptimize costs 0.275 msec.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.602.426 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:437] InlineCallGraph] [PROF]InlineCallGraph costs 0.405 msec.
[INFO] SESSION(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.602.455 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.602.527 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:912] InlineSwitchGraph] [PROF]InlineSwitchGraph costs 0.08 msec.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.602.846 [context.cpp:72]618646 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.602.871 [api_impl.cc:3717] 618646 ContextSetCurrent: set context=aaab06c88220, flag=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.602.886 [context.cpp:80]618646 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] KERNEL(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.602.921 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hccl_kernel_build.cc:32] HcclOpBuild] Build hccl op [AllReduce]
[INFO] KERNEL(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.603.136 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hccl_kernel.cc:211] CalLoopSize] Get Hccl Kernel: AllReduce, output size: 1
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.603.176 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:198] GenerateKernelMod] kernel opname:AllReduce, kernel type:hccl_kernel
[INFO] SESSION(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.603.243 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.603.338 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1179] OptimizeExecutionOrder] [PROF]OptimizeExecutionOrder costs 0.102 msec.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.603.399 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1214] ResetNodeIds] Start reset node id
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.603.441 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1234] ResetNodeIds] End reset node id
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.603.471 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1123] DoStreamAssign] Status record: start stream assign, pynative_kernel_graph4000000000
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.603.488 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/acl_stream_assign.cc:151] AssignStream] Not stream assign when pynative forward.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.603.503 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1139] DoStreamAssign] Status record: end stream assign, pynative_kernel_graph4000000000
[INFO] SESSION(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.603.522 [mindspore/ccsrc/backend/common/session/kernel_graph.cc:944] PrintGraphExecuteOrder] Graph 4000000000 execution order:
[INFO] SESSION(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.603.564 [mindspore/ccsrc/backend/common/session/kernel_graph.cc:984] PrintGraphExecuteOrder] Index[0], node name[Default/AllReduce-op0], logic id[4294967295], stream id[0], node info[@pynative_kernel_graph4000000000:CNode_1{[0]: ValueNode<Primitive> AllReduce, [1]: param_Parameter_2}], group[hccl_world_group]
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.603.780 [context.cpp:72]619007 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.603.813 [api_impl.cc:3717] 619007 ContextSetCurrent: set context=aaab06c88220, flag=0.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:47.603.832 [awatchdog_core.c:175](tid:619007) create watchdog for id : 65543, tid : 619007, timeout : 300s
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.603.838 [mindspore/ccsrc/common/amp/amp.cc:149] GetCurrentAmpStrategy] amp strategy stack is empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.603.845 [context.cpp:80]619007 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] PRE_ACT(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.603.904 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:704] GenerateAllocator] Generate allocator, is persistent : 1, stream id : 0.
[INFO] PRE_ACT(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.603.948 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:716] operator()] Malloc mem block, is enable eager free : 0, is enable vmm : 1, size : 512, block size : 1073741824.
[INFO] DEVICE(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.603.967 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.cc:204] AllocDeviceMem] VMM AllocDeviceMem size:61025026048, align_size:61025026048
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.605.343 [api_impl.cc:7115] 619007 ReserveMemAddress: device malloc Succ, size=61025026048(bytes) start ptr=0x12c2c0000000, end ptr=0x12d0f5600000
[INFO] PRE_ACT(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.611.603 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:736] operator()] Malloc mem block : {"addr_":0x12c2c0000000,"size_":61025026048,"stream_id_":0,"min_addr_":0,"max_addr_":0}.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.611.639 [api_impl.cc:7129] 619007 MallocPhysical: Start to MallocPhysical
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.611.754 [api_impl.cc:7145] 619007 MapMem: device malloc Succ, size=2097152(bytes), start ptr=0x12c2c0000000, end ptr=0x12c2c0200000
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.611.834 [device.cpp:143]619007 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.611.854 [api_impl.cc:2999] 619007 SetDevice: device_id=0, deviceMode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.611.866 [device.cc:306] 619007 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.611.879 [runtime.cc:3393] 619007 PrimaryContextRetain: Context inc ref, ts_id=0, count=0xa
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.611.903 [runtime.cc:3560] 619007 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.611.915 [api_impl.cc:2987] 619007 NewDevice: SetCurRef = 0xaaab06c88220,userDeviceId=0,deviceId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.611.928 [runtime.cc:5239] 619007 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.611.942 [api_impl.cc:2992] 619007 NewDevice: New device success, user_device_id=0, die_num=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.611.957 [api_impl.cc:3025] 619007 SetDevice: SetDevice success, curCtx=0xaaab06c88220, user_device_id=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.611.969 [acl.cpp:115]619007 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.611.980 [acl.cpp:121]619007 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.611.994 [device.cpp:154]619007 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 0
[INFO] DEVICE(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.612.025 [mindspore/ccsrc/plugin/res_manager/ascend/ascend_res_manager.cc:496] SetDeterministic] Set kernel deterministic value: 0
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.612.042 [context.cpp:174]619007 aclrtCtxSetSysParamOpt: start to execute aclrtCtxSetSysParamOpt, opt = 0, value = 0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.612.058 [api_impl.cc:6913] 619007 CtxSetSysParamOpt: curCtx = 0xaaab06c88220, configOpt=0, configVal=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.612.071 [context.cpp:158]619007 SetSysParamOpt: successfully execute aclrtCtxSetSysParamOpt
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.612.143 [op_base.cc:1214] [619007][HcclSetConfig] Set HCCL_DETERMINISTIC is false
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.612.173 [runtime.cc:5239] 619007 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.612.190 [adapter_rts.cc:234] [619007][hrtGetDevice]deviceLogicId[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:47.612.200 [op_base.cc:128] [619007][HcclGetDeviceId] deviceLogicId[0] 
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.612.254 [context.cpp:72]619007 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.612.268 [api_impl.cc:3717] 619007 ContextSetCurrent: set context=aaab06c88220, flag=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.612.281 [context.cpp:80]619007 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.612.303 [api_error.cc:1807] 619007 MemcpyAsyncCheckKindAndLocation: src pointer loc type=1, dst pointer loc type=2, kind=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.612.333 [memory_task.cc:342] 619007 ConvertCpyType: MemcpyAsyncTask::ConvertCpyType MEMCPY_HOST_TO_DEVICE, direct=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.612.346 [memory_task.cc:473] 619007 MemcpyAsyncTaskInitV3: Init qos=0, partId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.612.356 [memory_task.cc:518] 619007 MemcpyAsyncTaskInitV3: CopyType=0: use virtual address directly.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.612.383 [task_res.cc:380] 619007 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=0, stream_id=2, taskResId=0, taskResHead_=0, taskResTail_=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.612.405 [memory_task.cc:1007] 619007 ConstructPcieDmaSqe: stream_id=2, task_id=0, copyType=0, src=0xaaab12893e90, dst=0x12c2c0000000, len=0x6c
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.612.418 [memory_task.cc:1166] 619007 ConstructSqeForMemcpyAsyncTask: MemcpyAsyncTask, stream_id=2, task_id=0, copyType=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.612.450 [stream.cc:1400] 619007 AddTaskToList: public task, stream_id=2, task_id=0, task_type=5 (MEMCPY_ASYNC), head=0, tail=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.612.464 [stream.cc:2595] 619007 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=0, type=5(MEMCPY_ASYNC), head=0, tail=1, sqe_num=1, lastTail=0, device_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.612.494 [task_submit.cc:573] 619007 AllocTaskAndSendStars: device_id=0, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=0, task_type=5(MEMCPY_ASYNC).
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.612.510 [stream.cc:1494] 619007 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.612.528 [callback.cpp:97]619007 aclrtLaunchCallback: start to execute aclrtLaunchCallback.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.612.555 [task_res.cc:380] 619007 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=0, stream_id=2, taskResId=1, taskResHead_=0, taskResTail_=2.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.612.571 [task_info.cc:521] 619007 ConstructSqeForCallbackLaunchTask: CallbackLaunch,topic_type=4,stream_id=2,task_id=1,eventId=65535,isBlock=0,pid=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.612.585 [stream.cc:1400] 619007 AddTaskToList: public task, stream_id=2, task_id=1, task_type=72 (HOSTFUNC_CALLBACK), head=0, tail=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.612.596 [stream.cc:2595] 619007 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=1, type=72(HOSTFUNC_CALLBACK), head=0, tail=2, sqe_num=1, lastTail=1, device_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.612.610 [task_submit.cc:573] 619007 AllocTaskAndSendStars: device_id=0, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=1, task_type=72(HOSTFUNC_CALLBACK).
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.612.622 [stream.cc:1494] 619007 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=1.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.612.631 [callback.cpp:109]619007 aclrtLaunchCallback: successfully execute aclrtLaunchCallback
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.612.670 [npu_driver.cc:3844] 618836 CqReportGet: cq report get start, device_id=0, tsId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.612.694 [npu_driver.cc:3851] 618836 CqReportGet: halCqReportGet count=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.612.706 [api_impl.cc:5087] 618836 ProcessReport: report[0], sqid=12291, streamId=2, taskId=1, eventId=65535, isBlock=0
[INFO] PRE_ACT(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.612.713 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:704] GenerateAllocator] Generate allocator, is persistent : 0, stream id : 0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.612.730 [callback.cpp:138]618836 aclrtProcessReport: successfully aclrtProcessReport, timeout is 500ms.
[INFO] PRE_ACT(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.612.746 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:716] operator()] Malloc mem block, is enable eager free : 0, is enable vmm : 1, size : 512, block size : 1073741824.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.612.750 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] DEVICE(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.612.768 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.cc:204] AllocDeviceMem] VMM AllocDeviceMem size:61025026048, align_size:61025026048
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.612.771 [npu_driver.cc:3828] 618836 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=64.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.614.090 [api_impl.cc:7115] 619007 ReserveMemAddress: device malloc Succ, size=61025026048(bytes) start ptr=0x12d100000000, end ptr=0x12df35600000
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:47.620.169 [queue_client_comm.c:114][ascend][curpid:618650,618931][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:47.620.178 [queue_client_comm.c:114][ascend][curpid:618650,618929][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:47.620.186 [queue_client_comm.c:114][ascend][curpid:618650,618923][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:47.620.184 [queue_client_comm.c:114][ascend][curpid:618650,618921][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:47.620.188 [queue_client_comm.c:114][ascend][curpid:618650,618927][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:47.620.189 [queue_client_comm.c:114][ascend][curpid:618650,618925][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:47.620.312 [npu_driver.cc:4338] 618929 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.620.327 [tensor_data_transfer.cpp:612]618929 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_scalar_summary
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:47.620.310 [npu_driver.cc:4338] 618931 MemQueuePeek: queue empty
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:47.620.337 [npu_driver.cc:4338] 618923 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.620.338 [tensor_data_transfer.cpp:1054]618929 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_scalar_summary
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:47.620.373 [npu_driver.cc:4338] 618921 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.620.390 [tensor_data_transfer.cpp:612]618923 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_tensor_dump
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.620.396 [tensor_data_transfer.cpp:1056]618929 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:47.620.403 [npu_driver.cc:4338] 618927 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.620.407 [tensor_data_transfer.cpp:612]618921 acltdtReceiveTensorV2: queue is empty, device is 1, name is _npu_log
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.620.415 [tensor_data_transfer.cpp:1054]618923 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_tensor_dump
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.620.402 [tensor_data_transfer.cpp:612]618931 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_histogram_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.620.419 [api_impl.cc:6121] 618929 MemQueuePeek: Start to peek queue on devId 1, qid is 4.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:47.620.433 [npu_driver.cc:4338] 618925 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.620.446 [tensor_data_transfer.cpp:612]618927 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_image_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.620.457 [tensor_data_transfer.cpp:1054]618921 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is _npu_log
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.620.466 [tensor_data_transfer.cpp:1056]618923 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.620.482 [tensor_data_transfer.cpp:1054]618931 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_histogram_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.620.486 [npu_driver.cc:4330] 618929 MemQueuePeek: peek mem queue, deviceId=1, qid=4, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.620.493 [tensor_data_transfer.cpp:612]618925 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_tensor_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.620.497 [tensor_data_transfer.cpp:1054]618927 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_image_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.620.507 [tensor_data_transfer.cpp:1056]618921 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.620.516 [api_impl.cc:6121] 618923 MemQueuePeek: Start to peek queue on devId 1, qid is 1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.620.563 [npu_driver.cc:4330] 618923 MemQueuePeek: peek mem queue, deviceId=1, qid=1, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.620.526 [tensor_data_transfer.cpp:1056]618931 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.620.540 [tensor_data_transfer.cpp:1054]618925 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_tensor_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.620.543 [tensor_data_transfer.cpp:1056]618927 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.620.554 [api_impl.cc:6121] 618921 MemQueuePeek: Start to peek queue on devId 1, qid is 0.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.620.593 [tensor_data_transfer.cpp:1056]618925 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.620.598 [api_impl.cc:6121] 618927 MemQueuePeek: Start to peek queue on devId 1, qid is 3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.620.588 [api_impl.cc:6121] 618931 MemQueuePeek: Start to peek queue on devId 1, qid is 5.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.620.609 [npu_driver.cc:4330] 618921 MemQueuePeek: peek mem queue, deviceId=1, qid=0, timeout=800.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.620.618 [api_impl.cc:6121] 618925 MemQueuePeek: Start to peek queue on devId 1, qid is 2.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.620.622 [npu_driver.cc:4330] 618927 MemQueuePeek: peek mem queue, deviceId=1, qid=3, timeout=800.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.620.651 [npu_driver.cc:4330] 618931 MemQueuePeek: peek mem queue, deviceId=1, qid=5, timeout=800.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.620.669 [npu_driver.cc:4330] 618925 MemQueuePeek: peek mem queue, deviceId=1, qid=2, timeout=800.
[INFO] PRE_ACT(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.621.352 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:736] operator()] Malloc mem block : {"addr_":0x12d100000000,"size_":61025026048,"stream_id_":0,"min_addr_":0,"max_addr_":0}.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.621.396 [api_impl.cc:7129] 619007 MallocPhysical: Start to MallocPhysical
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.621.485 [api_impl.cc:7145] 619007 MapMem: device malloc Succ, size=2097152(bytes), start ptr=0x12d100000000, end ptr=0x12d100200000
mki_log log dir:/home/jenkins/atb/log exist
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.622.212 [device.cpp:231]619007 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.622.232 [runtime.cc:5239] 619007 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.622.263 [acl.cpp:802]619007 aclGetRecentErrMsg: start to execute aclGetRecentErrMsg.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.622.369 [npu_driver.cc:404] 619007 StreamIdAlloc: stream id alloc begin, device_id=0, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.622.406 [stream.cc:2246] 619007 AllocExecutedTimesSvm: stream_id=6.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.622.439 [stream_sqcq_manage.cc:147] 619007 Alloc: deviceId=0, tsId=0, drvFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.622.453 [npu_driver.cc:882] 619007 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.622.899 [npu_driver.cc:6125] 619007 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.622.943 [npu_driver.cc:6137] 619007 LogicCqAllocateV2: success: deviceId=0, tsId=0, cqId=493, streamId=6, logicCq=493, cqeDepth=4096
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.622.966 [npu_driver.cc:6189] 619007 StreamBindLogicCq: success: deviceId=0, tsId=0, streamId=6, logicCq=493.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.622.983 [npu_driver.cc:5916] 619007 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=c00ca000, addr=dfffc00ca000size=4096
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.622.996 [stream.cc:653] 619007 Setup: Success to get sq=6 sq reg virtual addr length=4096.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.623.037 [stream.cc:276] 619007 CreateStreamTaskRes: Normal STREAM Setup stream_id=6 flags_=0x0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.623.051 [stream.cc:688] 619007 Setup: stream setup end, stream_id=6, IsTaskSink=0, sqId=6, cqId=6, deviceId=0, streamResId=65534
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.623.065 [acl_resource_manager.cpp:814]619007 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.623.077 [acl_resource_manager.cpp:816]619007 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.623.226 [engine.cc:188] 619007 SubmitTaskNormal: stream_id=6,task_id=0,task_type=87 (GET_DEVICE_MSG).
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.623.246 [npu_driver.cc:5547] 619007 GetSqHead: deviceId=0, tsId=0, sqId=6, head=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.623.263 [task_info.cc:409] 619007 ConstructSqeForGetDevMsgTask: stream_id:6, task_id:0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.623.274 [stream.cc:1400] 619007 AddTaskToList: public task, stream_id=6, task_id=0, task_type=87 (GET_DEVICE_MSG), head=0, tail=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.623.286 [stream.cc:2595] 619007 StarsAddTaskToStream: single-operator flow stream, stream_id=6, task_id=0, type=87(GET_DEVICE_MSG), head=0, tail=1, sqe_num=1, lastTail=0, device_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.623.302 [npu_driver.cc:751] 619007 SqTaskSend: device_id=0, ts_id=0, sq_id=6, sqe_num=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.623.314 [stars_engine.cc:893] 619007 SendTask: Sq task send finished, device_id=0, ts_id=0, sq_id=6, cq_id=6, stream_id=6, task_id=0, task_type=87(GET_DEVICE_MSG).
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.623.335 [stream.cc:1494] 619007 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.623.349 [npu_driver.cc:5547] 619007 GetSqHead: deviceId=0, tsId=0, sqId=6, head=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.623.363 [task.cc:185] 619007 GetTask: this stream no taskRes, stream_id=6
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.623.376 [task.cc:185] 619007 GetTask: this stream no taskRes, stream_id=6
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.623.388 [logger.cc:152] 619007 TaskFinished: device_id=0, stream_id=6, task_id=0, task_type=87 (GET_DEVICE_MSG), task_finish_num=6
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.623.406 [stars_engine.cc:437] 619007 FinishedTaskReclaim: recycle task, stream_id=6, limited=0, taskHead=0, sqHead=1, endTaskId=0, recycleTaskId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.623.419 [stream.cc:2886] 619007 StarsWaitForTask: No.0 stream_id=6, taskId=0, currentId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.623.432 [stream.cc:852] 619007 TearDown: stream_id=6, sqId=6, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.623.446 [stream.cc:938] 619007 TearDown: stream_id=6, delay recycle task num=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.623.458 [stream.cc:1507] 619007 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.623.482 [stream_sqcq_manage.cc:451] 619007 FreeLogicCq: Return(0), threadIdentifier(281468643110816), devId(0), tsId(0), cqId(493), isFastCq(0).
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.623.499 [npu_driver.cc:6163] 619007 StreamUnBindLogicCq: success: deviceId=0, tsId=0, streamId=6, logicCq=493.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.623.529 [npu_driver.cc:1180] 619007 LogicCqFree: Succ:device_id=0,ts_id=0,type=2,logic_cq_id=493, drvFlag=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.623.543 [stream.cc:237] 619007 FreeStreamId: Free stream_id=6.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.623.553 [stream_sqcq_manage.cc:216] 619007 DeAllocStreamSqCq: deviceId=0, tsId=0, drvFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.623.564 [npu_driver.cc:966] 619007 NormalSqCqFree: Normal sqcq free, sqId=6, cqId=6, device_id=0, tsId=0, drvFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.624.074 [npu_driver.cc:974] 619007 NormalSqCqFree: Normal sqcq free success, sqId=6, cqId=6, device_id=0, tsId=0, drvFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.624.090 [stream_sqcq_manage.cc:228] 619007 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=6, cq_id=6, stream_id=6, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.624.104 [npu_driver.cc:432] 619007 StreamIdFree: stream id free begin, device_id=0, stream_id=6, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.624.121 [npu_driver.cc:441] 619007 StreamIdFree: Stream id free success, stream_id=6, device_id=0, tsId=0, streamFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.624.137 [device_msg_handler.cc:110] 619007 HandleMsg: Begin to process device errMessage.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.624.829 [device_msg_handler.cc:127] 619007 HandleMsg: Finished to process device errInfo, retCode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.624.883 [runtime.cc:5239] 619007 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.624.913 [npu_driver.cc:500] 619007 GetFaultEvent: get fault event, device_id=0, filterFlag=8, outputLen=128.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.624.976 [acl.cpp:782]619007 GetFaultEventInfo: can not get fault event of device 0, runtime errorCode is 0
[INFO] GE(618646,python3.9):2025-04-03-09:27:47.625.006 [error_manager.cc:989]619007 GetRawErrorMessages:current work_stream_id:0
[CRITICAL] KERNEL(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.625.335 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
[INFO] DEBUG(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.625.373 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
[INFO] DEBUG(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.625.392 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
[INFO] DEBUG(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.625.406 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
[INFO] RUNTIME_FRAMEWORK(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.625.629 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.

----------------------------------------------------
- C++ Call Stack: (For framework developers)
----------------------------------------------------
mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.625.716 [context.cpp:72]619007 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.625.738 [api_impl.cc:3717] 619007 ContextSetCurrent: set context=aaab06c88220, flag=0.
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:47.625.749 [mindspore/ccsrc/common/amp/amp.cc:149] GetCurrentAmpStrategy] amp strategy stack is empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.625.752 [context.cpp:80]619007 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.625.780 [api_error.cc:1807] 619007 MemcpyAsyncCheckKindAndLocation: src pointer loc type=1, dst pointer loc type=2, kind=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.625.795 [memory_task.cc:342] 619007 ConvertCpyType: MemcpyAsyncTask::ConvertCpyType MEMCPY_HOST_TO_DEVICE, direct=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.625.807 [memory_task.cc:473] 619007 MemcpyAsyncTaskInitV3: Init qos=0, partId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.625.816 [memory_task.cc:518] 619007 MemcpyAsyncTaskInitV3: CopyType=0: use virtual address directly.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.625.827 [task_res.cc:380] 619007 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=0, stream_id=2, taskResId=2, taskResHead_=0, taskResTail_=3.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.625.841 [memory_task.cc:1007] 619007 ConstructPcieDmaSqe: stream_id=2, task_id=2, copyType=0, src=0xaaab12894920, dst=0x12c2c0000000, len=0x6c
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.625.854 [memory_task.cc:1166] 619007 ConstructSqeForMemcpyAsyncTask: MemcpyAsyncTask, stream_id=2, task_id=2, copyType=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.625.864 [stream.cc:1400] 619007 AddTaskToList: public task, stream_id=2, task_id=2, task_type=5 (MEMCPY_ASYNC), head=0, tail=3
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.625.876 [stream.cc:2595] 619007 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=2, type=5(MEMCPY_ASYNC), head=0, tail=3, sqe_num=1, lastTail=2, device_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.625.892 [task_submit.cc:573] 619007 AllocTaskAndSendStars: device_id=0, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=2, task_type=5(MEMCPY_ASYNC).
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.625.905 [stream.cc:1494] 619007 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=2.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.625.921 [callback.cpp:97]619007 aclrtLaunchCallback: start to execute aclrtLaunchCallback.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.625.965 [task_res.cc:380] 619007 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=0, stream_id=2, taskResId=3, taskResHead_=0, taskResTail_=4.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.625.981 [task_info.cc:521] 619007 ConstructSqeForCallbackLaunchTask: CallbackLaunch,topic_type=4,stream_id=2,task_id=3,eventId=65535,isBlock=0,pid=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.625.994 [stream.cc:1400] 619007 AddTaskToList: public task, stream_id=2, task_id=3, task_type=72 (HOSTFUNC_CALLBACK), head=0, tail=4
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.006 [stream.cc:2595] 619007 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=3, type=72(HOSTFUNC_CALLBACK), head=0, tail=4, sqe_num=1, lastTail=3, device_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.021 [task_submit.cc:573] 619007 AllocTaskAndSendStars: device_id=0, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=3, task_type=72(HOSTFUNC_CALLBACK).
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.033 [stream.cc:1494] 619007 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=3.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.626.042 [callback.cpp:109]619007 aclrtLaunchCallback: successfully execute aclrtLaunchCallback
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.050 [npu_driver.cc:3844] 618836 CqReportGet: cq report get start, device_id=0, tsId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.075 [npu_driver.cc:3851] 618836 CqReportGet: halCqReportGet count=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.086 [api_impl.cc:5087] 618836 ProcessReport: report[0], sqid=12291, streamId=2, taskId=3, eventId=65535, isBlock=0
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.626.102 [callback.cpp:138]618836 aclrtProcessReport: successfully aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.626.118 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.626.118 [device.cpp:231]619007 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.134 [npu_driver.cc:3828] 618836 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=64.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.142 [runtime.cc:5239] 619007 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.626.158 [acl.cpp:802]619007 aclGetRecentErrMsg: start to execute aclGetRecentErrMsg.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.186 [npu_driver.cc:404] 619007 StreamIdAlloc: stream id alloc begin, device_id=0, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.213 [stream.cc:2246] 619007 AllocExecutedTimesSvm: stream_id=7.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.246 [stream_sqcq_manage.cc:147] 619007 Alloc: deviceId=0, tsId=0, drvFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.259 [npu_driver.cc:882] 619007 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.536 [npu_driver.cc:6125] 619007 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.575 [npu_driver.cc:6137] 619007 LogicCqAllocateV2: success: deviceId=0, tsId=0, cqId=494, streamId=7, logicCq=494, cqeDepth=4096
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.592 [npu_driver.cc:6189] 619007 StreamBindLogicCq: success: deviceId=0, tsId=0, streamId=7, logicCq=494.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.606 [npu_driver.cc:5916] 619007 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=c00ca000, addr=dfffc00ca000size=4096
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.618 [stream.cc:653] 619007 Setup: Success to get sq=7 sq reg virtual addr length=4096.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.660 [stream.cc:276] 619007 CreateStreamTaskRes: Normal STREAM Setup stream_id=7 flags_=0x0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.673 [stream.cc:688] 619007 Setup: stream setup end, stream_id=7, IsTaskSink=0, sqId=7, cqId=7, deviceId=0, streamResId=65534
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.626.688 [acl_resource_manager.cpp:814]619007 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.626.699 [acl_resource_manager.cpp:816]619007 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.741 [engine.cc:188] 619007 SubmitTaskNormal: stream_id=7,task_id=0,task_type=87 (GET_DEVICE_MSG).
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.756 [npu_driver.cc:5547] 619007 GetSqHead: deviceId=0, tsId=0, sqId=7, head=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.770 [task_info.cc:409] 619007 ConstructSqeForGetDevMsgTask: stream_id:7, task_id:0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.780 [stream.cc:1400] 619007 AddTaskToList: public task, stream_id=7, task_id=0, task_type=87 (GET_DEVICE_MSG), head=0, tail=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.792 [stream.cc:2595] 619007 StarsAddTaskToStream: single-operator flow stream, stream_id=7, task_id=0, type=87(GET_DEVICE_MSG), head=0, tail=1, sqe_num=1, lastTail=0, device_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.807 [npu_driver.cc:751] 619007 SqTaskSend: device_id=0, ts_id=0, sq_id=7, sqe_num=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.818 [stars_engine.cc:893] 619007 SendTask: Sq task send finished, device_id=0, ts_id=0, sq_id=7, cq_id=7, stream_id=7, task_id=0, task_type=87(GET_DEVICE_MSG).
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.831 [stream.cc:1494] 619007 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.842 [npu_driver.cc:5547] 619007 GetSqHead: deviceId=0, tsId=0, sqId=7, head=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.854 [task.cc:185] 619007 GetTask: this stream no taskRes, stream_id=7
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.865 [task.cc:185] 619007 GetTask: this stream no taskRes, stream_id=7
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.876 [logger.cc:152] 619007 TaskFinished: device_id=0, stream_id=7, task_id=0, task_type=87 (GET_DEVICE_MSG), task_finish_num=7
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.890 [stars_engine.cc:437] 619007 FinishedTaskReclaim: recycle task, stream_id=7, limited=0, taskHead=0, sqHead=1, endTaskId=0, recycleTaskId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.901 [stream.cc:2886] 619007 StarsWaitForTask: No.0 stream_id=7, taskId=0, currentId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.912 [stream.cc:852] 619007 TearDown: stream_id=7, sqId=7, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.924 [stream.cc:938] 619007 TearDown: stream_id=7, delay recycle task num=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.934 [stream.cc:1507] 619007 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.953 [stream_sqcq_manage.cc:451] 619007 FreeLogicCq: Return(0), threadIdentifier(281468643110816), devId(0), tsId(0), cqId(494), isFastCq(0).
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.969 [npu_driver.cc:6163] 619007 StreamUnBindLogicCq: success: deviceId=0, tsId=0, streamId=7, logicCq=494.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.626.992 [npu_driver.cc:1180] 619007 LogicCqFree: Succ:device_id=0,ts_id=0,type=2,logic_cq_id=494, drvFlag=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.627.005 [stream.cc:237] 619007 FreeStreamId: Free stream_id=7.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.627.015 [stream_sqcq_manage.cc:216] 619007 DeAllocStreamSqCq: deviceId=0, tsId=0, drvFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.627.031 [npu_driver.cc:966] 619007 NormalSqCqFree: Normal sqcq free, sqId=7, cqId=7, device_id=0, tsId=0, drvFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.627.467 [npu_driver.cc:974] 619007 NormalSqCqFree: Normal sqcq free success, sqId=7, cqId=7, device_id=0, tsId=0, drvFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.627.482 [stream_sqcq_manage.cc:228] 619007 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=7, cq_id=7, stream_id=7, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.627.496 [npu_driver.cc:432] 619007 StreamIdFree: stream id free begin, device_id=0, stream_id=7, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.627.511 [npu_driver.cc:441] 619007 StreamIdFree: Stream id free success, stream_id=7, device_id=0, tsId=0, streamFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.627.525 [device_msg_handler.cc:110] 619007 HandleMsg: Begin to process device errMessage.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.627.830 [device_msg_handler.cc:127] 619007 HandleMsg: Finished to process device errInfo, retCode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.627.859 [runtime.cc:5239] 619007 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.627.878 [npu_driver.cc:500] 619007 GetFaultEvent: get fault event, device_id=0, filterFlag=8, outputLen=128.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.627.927 [acl.cpp:782]619007 GetFaultEventInfo: can not get fault event of device 0, runtime errorCode is 0
[INFO] GE(618646,python3.9):2025-04-03-09:27:47.627.941 [error_manager.cc:989]619007 GetRawErrorMessages:current work_stream_id:0
[CRITICAL] KERNEL(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.628.245 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
[INFO] DEBUG(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.628.276 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
[INFO] DEBUG(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.628.296 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
[INFO] DEBUG(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.628.309 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
[INFO] RUNTIME_FRAMEWORK(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.628.373 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.

----------------------------------------------------
- C++ Call Stack: (For framework developers)
----------------------------------------------------
mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.628.444 [context.cpp:72]619007 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.628.463 [api_impl.cc:3717] 619007 ContextSetCurrent: set context=aaab06c88220, flag=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.628.476 [context.cpp:80]619007 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.628.492 [api_error.cc:1807] 619007 MemcpyAsyncCheckKindAndLocation: src pointer loc type=1, dst pointer loc type=2, kind=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.628.506 [memory_task.cc:342] 619007 ConvertCpyType: MemcpyAsyncTask::ConvertCpyType MEMCPY_HOST_TO_DEVICE, direct=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.628.518 [memory_task.cc:473] 619007 MemcpyAsyncTaskInitV3: Init qos=0, partId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.628.526 [memory_task.cc:518] 619007 MemcpyAsyncTaskInitV3: CopyType=0: use virtual address directly.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.628.550 [task_res.cc:380] 619007 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=0, stream_id=2, taskResId=4, taskResHead_=0, taskResTail_=5.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.628.565 [memory_task.cc:1007] 619007 ConstructPcieDmaSqe: stream_id=2, task_id=4, copyType=0, src=0xaaab12895390, dst=0x12c2c0000000, len=0x6c
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.628.577 [memory_task.cc:1166] 619007 ConstructSqeForMemcpyAsyncTask: MemcpyAsyncTask, stream_id=2, task_id=4, copyType=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.628.587 [stream.cc:1400] 619007 AddTaskToList: public task, stream_id=2, task_id=4, task_type=5 (MEMCPY_ASYNC), head=0, tail=5
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.628.599 [stream.cc:2595] 619007 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=4, type=5(MEMCPY_ASYNC), head=0, tail=5, sqe_num=1, lastTail=4, device_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.628.615 [task_submit.cc:573] 619007 AllocTaskAndSendStars: device_id=0, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=4, task_type=5(MEMCPY_ASYNC).
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.628.627 [stream.cc:1494] 619007 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=4.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.628.642 [callback.cpp:97]619007 aclrtLaunchCallback: start to execute aclrtLaunchCallback.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.628.660 [task_res.cc:380] 619007 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=0, stream_id=2, taskResId=5, taskResHead_=0, taskResTail_=6.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.628.674 [task_info.cc:521] 619007 ConstructSqeForCallbackLaunchTask: CallbackLaunch,topic_type=4,stream_id=2,task_id=5,eventId=65535,isBlock=0,pid=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.628.686 [stream.cc:1400] 619007 AddTaskToList: public task, stream_id=2, task_id=5, task_type=72 (HOSTFUNC_CALLBACK), head=0, tail=6
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.628.698 [stream.cc:2595] 619007 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=5, type=72(HOSTFUNC_CALLBACK), head=0, tail=6, sqe_num=1, lastTail=5, device_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.628.712 [task_submit.cc:573] 619007 AllocTaskAndSendStars: device_id=0, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=5, task_type=72(HOSTFUNC_CALLBACK).
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.628.724 [stream.cc:1494] 619007 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=5.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.628.733 [callback.cpp:109]619007 aclrtLaunchCallback: successfully execute aclrtLaunchCallback
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.628.738 [npu_driver.cc:3844] 618836 CqReportGet: cq report get start, device_id=0, tsId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.628.759 [npu_driver.cc:3851] 618836 CqReportGet: halCqReportGet count=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.628.771 [api_impl.cc:5087] 618836 ProcessReport: report[0], sqid=12291, streamId=2, taskId=5, eventId=65535, isBlock=0
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.628.789 [callback.cpp:138]618836 aclrtProcessReport: successfully aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.628.798 [device.cpp:231]619007 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.628.806 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.628.818 [runtime.cc:5239] 619007 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.628.827 [npu_driver.cc:3828] 618836 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=64.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.628.833 [acl.cpp:802]619007 aclGetRecentErrMsg: start to execute aclGetRecentErrMsg.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.628.888 [npu_driver.cc:404] 619007 StreamIdAlloc: stream id alloc begin, device_id=0, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.628.913 [stream.cc:2246] 619007 AllocExecutedTimesSvm: stream_id=8.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.628.945 [stream_sqcq_manage.cc:147] 619007 Alloc: deviceId=0, tsId=0, drvFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.628.958 [npu_driver.cc:882] 619007 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.190 [npu_driver.cc:6125] 619007 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.226 [npu_driver.cc:6137] 619007 LogicCqAllocateV2: success: deviceId=0, tsId=0, cqId=495, streamId=8, logicCq=495, cqeDepth=4096
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.244 [npu_driver.cc:6189] 619007 StreamBindLogicCq: success: deviceId=0, tsId=0, streamId=8, logicCq=495.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.257 [npu_driver.cc:5916] 619007 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=c00ca000, addr=dfffc00ca000size=4096
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.269 [stream.cc:653] 619007 Setup: Success to get sq=8 sq reg virtual addr length=4096.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.300 [stream.cc:276] 619007 CreateStreamTaskRes: Normal STREAM Setup stream_id=8 flags_=0x0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.313 [stream.cc:688] 619007 Setup: stream setup end, stream_id=8, IsTaskSink=0, sqId=8, cqId=8, deviceId=0, streamResId=65534
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.629.326 [acl_resource_manager.cpp:814]619007 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.629.337 [acl_resource_manager.cpp:816]619007 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.374 [engine.cc:188] 619007 SubmitTaskNormal: stream_id=8,task_id=0,task_type=87 (GET_DEVICE_MSG).
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.389 [npu_driver.cc:5547] 619007 GetSqHead: deviceId=0, tsId=0, sqId=8, head=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.402 [task_info.cc:409] 619007 ConstructSqeForGetDevMsgTask: stream_id:8, task_id:0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.411 [stream.cc:1400] 619007 AddTaskToList: public task, stream_id=8, task_id=0, task_type=87 (GET_DEVICE_MSG), head=0, tail=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.422 [stream.cc:2595] 619007 StarsAddTaskToStream: single-operator flow stream, stream_id=8, task_id=0, type=87(GET_DEVICE_MSG), head=0, tail=1, sqe_num=1, lastTail=0, device_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.436 [npu_driver.cc:751] 619007 SqTaskSend: device_id=0, ts_id=0, sq_id=8, sqe_num=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.448 [stars_engine.cc:893] 619007 SendTask: Sq task send finished, device_id=0, ts_id=0, sq_id=8, cq_id=8, stream_id=8, task_id=0, task_type=87(GET_DEVICE_MSG).
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.460 [stream.cc:1494] 619007 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.471 [npu_driver.cc:5547] 619007 GetSqHead: deviceId=0, tsId=0, sqId=8, head=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.483 [task.cc:185] 619007 GetTask: this stream no taskRes, stream_id=8
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.494 [task.cc:185] 619007 GetTask: this stream no taskRes, stream_id=8
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.505 [logger.cc:152] 619007 TaskFinished: device_id=0, stream_id=8, task_id=0, task_type=87 (GET_DEVICE_MSG), task_finish_num=8
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.527 [stars_engine.cc:437] 619007 FinishedTaskReclaim: recycle task, stream_id=8, limited=0, taskHead=0, sqHead=1, endTaskId=0, recycleTaskId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.539 [stream.cc:2886] 619007 StarsWaitForTask: No.0 stream_id=8, taskId=0, currentId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.550 [stream.cc:852] 619007 TearDown: stream_id=8, sqId=8, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.563 [stream.cc:938] 619007 TearDown: stream_id=8, delay recycle task num=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.572 [stream.cc:1507] 619007 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.591 [stream_sqcq_manage.cc:451] 619007 FreeLogicCq: Return(0), threadIdentifier(281468643110816), devId(0), tsId(0), cqId(495), isFastCq(0).
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.607 [npu_driver.cc:6163] 619007 StreamUnBindLogicCq: success: deviceId=0, tsId=0, streamId=8, logicCq=495.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.629 [npu_driver.cc:1180] 619007 LogicCqFree: Succ:device_id=0,ts_id=0,type=2,logic_cq_id=495, drvFlag=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.642 [stream.cc:237] 619007 FreeStreamId: Free stream_id=8.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.651 [stream_sqcq_manage.cc:216] 619007 DeAllocStreamSqCq: deviceId=0, tsId=0, drvFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.629.662 [npu_driver.cc:966] 619007 NormalSqCqFree: Normal sqcq free, sqId=8, cqId=8, device_id=0, tsId=0, drvFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.630.150 [npu_driver.cc:974] 619007 NormalSqCqFree: Normal sqcq free success, sqId=8, cqId=8, device_id=0, tsId=0, drvFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.630.164 [stream_sqcq_manage.cc:228] 619007 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=8, cq_id=8, stream_id=8, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.630.178 [npu_driver.cc:432] 619007 StreamIdFree: stream id free begin, device_id=0, stream_id=8, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.630.192 [npu_driver.cc:441] 619007 StreamIdFree: Stream id free success, stream_id=8, device_id=0, tsId=0, streamFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.630.205 [device_msg_handler.cc:110] 619007 HandleMsg: Begin to process device errMessage.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.630.508 [device_msg_handler.cc:127] 619007 HandleMsg: Finished to process device errInfo, retCode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.630.537 [runtime.cc:5239] 619007 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.630.556 [npu_driver.cc:500] 619007 GetFaultEvent: get fault event, device_id=0, filterFlag=8, outputLen=128.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.630.605 [acl.cpp:782]619007 GetFaultEventInfo: can not get fault event of device 0, runtime errorCode is 0
[INFO] GE(618646,python3.9):2025-04-03-09:27:47.630.620 [error_manager.cc:989]619007 GetRawErrorMessages:current work_stream_id:0
[CRITICAL] KERNEL(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.630.908 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
[INFO] DEBUG(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.630.937 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
[INFO] DEBUG(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.630.953 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
[INFO] DEBUG(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.630.967 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
[INFO] RUNTIME_FRAMEWORK(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.631.038 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.

----------------------------------------------------
- C++ Call Stack: (For framework developers)
----------------------------------------------------
mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

[WARNING] DRV(618666,python3.9):2025-04-03-09:27:47.716.175 [trs_cb_event.c:119][ascend][curpid:618666,618808][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =64; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:47.716.183 [trs_cb_event.c:119][ascend][curpid:618666,618809][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =65; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:47.716.204 [trs_sqcq.c:1491][ascend][curpid:618666,618808][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:47.716.170 [queue_client_comm.c:114][ascend][curpid:618654,618951][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:47.716.172 [queue_client_comm.c:114][ascend][curpid:618654,618943][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:47.716.172 [queue_client_comm.c:114][ascend][curpid:618654,618947][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:47.716.175 [queue_client_comm.c:114][ascend][curpid:618654,618945][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:47.716.177 [queue_client_comm.c:114][ascend][curpid:618654,618949][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:47.716.215 [trs_sqcq.c:1491][ascend][curpid:618666,618809][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:47.716.179 [queue_client_comm.c:114][ascend][curpid:618654,618941][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:47.716.220 [npu_driver.cc:3833] 618808 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:47.716.244 [npu_driver.cc:3833] 618809 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:47.716.258 [npu_driver.cc:4338] 618951 MemQueuePeek: queue empty
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:47.716.250 [api_impl.cc:5058] 618808 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:47.716.258 [api_impl.cc:5058] 618809 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.716.261 [callback.cpp:132]618808 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.716.270 [callback.cpp:132]618809 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.716.276 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.716.281 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.716.274 [tensor_data_transfer.cpp:612]618951 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_histogram_summary
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:47.716.284 [npu_driver.cc:4338] 618943 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.716.292 [tensor_data_transfer.cpp:1054]618951 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_histogram_summary
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.716.292 [npu_driver.cc:3828] 618808 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=64.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.716.297 [npu_driver.cc:3828] 618809 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=65.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.716.301 [tensor_data_transfer.cpp:612]618943 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_tensor_dump
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.716.307 [tensor_data_transfer.cpp:1056]618951 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:47.716.311 [npu_driver.cc:4338] 618947 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.716.317 [tensor_data_transfer.cpp:1054]618943 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_tensor_dump
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.716.325 [api_impl.cc:6121] 618951 MemQueuePeek: Start to peek queue on devId 2, qid is 5.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.716.331 [tensor_data_transfer.cpp:612]618947 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_image_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.716.335 [tensor_data_transfer.cpp:1056]618943 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.716.342 [npu_driver.cc:4330] 618951 MemQueuePeek: peek mem queue, deviceId=2, qid=5, timeout=800.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:47.716.342 [npu_driver.cc:4338] 618945 MemQueuePeek: queue empty
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:47.716.369 [npu_driver.cc:4338] 618949 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.716.372 [tensor_data_transfer.cpp:1054]618947 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_image_summary
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.716.375 [api_impl.cc:6121] 618943 MemQueuePeek: Start to peek queue on devId 2, qid is 1.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.716.390 [tensor_data_transfer.cpp:612]618945 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_tensor_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.716.397 [tensor_data_transfer.cpp:612]618949 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_scalar_summary
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:47.716.404 [npu_driver.cc:4338] 618941 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.716.405 [tensor_data_transfer.cpp:1056]618947 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.716.410 [npu_driver.cc:4330] 618943 MemQueuePeek: peek mem queue, deviceId=2, qid=1, timeout=800.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.716.416 [tensor_data_transfer.cpp:1054]618945 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_tensor_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.716.422 [tensor_data_transfer.cpp:1054]618949 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_scalar_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.716.429 [tensor_data_transfer.cpp:612]618941 acltdtReceiveTensorV2: queue is empty, device is 2, name is _npu_log
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.716.434 [api_impl.cc:6121] 618947 MemQueuePeek: Start to peek queue on devId 2, qid is 3.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.716.445 [tensor_data_transfer.cpp:1056]618945 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.716.455 [tensor_data_transfer.cpp:1056]618949 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.716.464 [tensor_data_transfer.cpp:1054]618941 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is _npu_log
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.716.469 [npu_driver.cc:4330] 618947 MemQueuePeek: peek mem queue, deviceId=2, qid=3, timeout=800.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.716.476 [api_impl.cc:6121] 618945 MemQueuePeek: Start to peek queue on devId 2, qid is 2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.716.482 [api_impl.cc:6121] 618949 MemQueuePeek: Start to peek queue on devId 2, qid is 4.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.716.488 [tensor_data_transfer.cpp:1056]618941 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.716.501 [npu_driver.cc:4330] 618945 MemQueuePeek: peek mem queue, deviceId=2, qid=2, timeout=800.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.716.506 [npu_driver.cc:4330] 618949 MemQueuePeek: peek mem queue, deviceId=2, qid=4, timeout=800.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.716.514 [api_impl.cc:6121] 618941 MemQueuePeek: Start to peek queue on devId 2, qid is 0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.716.529 [npu_driver.cc:4330] 618941 MemQueuePeek: peek mem queue, deviceId=2, qid=0, timeout=800.
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:47.748.169 [trs_cb_event.c:119][ascend][curpid:618658,618775][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =65; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:47.748.173 [trs_cb_event.c:119][ascend][curpid:618658,618774][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =64; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:47.748.196 [trs_sqcq.c:1491][ascend][curpid:618658,618775][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:47.748.226 [trs_sqcq.c:1491][ascend][curpid:618658,618774][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:47.748.240 [npu_driver.cc:3833] 618775 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:47.748.249 [npu_driver.cc:3833] 618774 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:47.748.260 [api_impl.cc:5058] 618775 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:47.748.269 [api_impl.cc:5058] 618774 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.748.280 [callback.cpp:132]618775 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.748.288 [callback.cpp:132]618774 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.748.298 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.748.307 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.748.321 [npu_driver.cc:3828] 618775 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=65.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.748.329 [npu_driver.cc:3828] 618774 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=64.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:47.753.715 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618986] [ServerToClientMsgProc] [sessionID=1]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.753.716 [runtime.cc:3077] 618820 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=6, devId=6, tdt status=0
[INFO] TDT(618670,python3.9):2025-04-03-09:27:47.753.747 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618986] [TsdClient] DeviceMsgProc recvMsg realDeviceId[6] msgType[49] localDevId[6] rspCode[0]heterogeneousSubPid[29795], tsdSupportLevel_[63]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:47.753.762 [hdc_client.cpp:172][TsdRecvData][tid:618986] [deviceId=6] the Tsd recv data already
[INFO] TDT(618670,python3.9):2025-04-03-09:27:47.753.778 [process_mode_manager.cpp:1461][ProcessOpenSubProc][tid:618986] OpenSubProc success stype:0, pid:29795
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.753.790 [adapter_tdt.cc:39] [618986]Open TsdProcess success. deviceLogicId[6]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.753.795 [npu_driver.cc:551] 618820 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.753.802 [network_manager.cc:118] [618986][TsdProcessOpen]hrtTsdProcessOpen success, subPid[29795], devicePhyId_[6], deviceLogicId_[6], hasBackup[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.753.817 [network_manager.cc:180] [618986][NetworkManager][Init]open tsd by process success, devicePhyId[6], deviceLogicId_[6].
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:47.753.867 [ra_host.c:205]tid:618986,ra_init(205) : Input parameters: phy_id[6], nic_position:[1] hdc_type:[18]
[INFO] ROCE(618670,python3.9):2025-04-03-09:27:47.753.926 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] DRV(618670,python3.9):2025-04-03-09:27:47.753.947 [devdrv_hccl.c:103][ascend][curpid:618670,618986][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618670)
[INFO] ROCE(618670,python3.9):2025-04-03-09:27:47.753.984 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:47.754.000 [ra_hdc.c:580]tid:618986,ra_hdc_init(580) : hdc init start! logic id is 6, phy id is 6, hdc_type is 18
[INFO] DRV(618670,python3.9):2025-04-03-09:27:47.754.197 [hdc_core.c:1982][ascend][curpid:618670,618986][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4196; pid=618670)
[INFO] TDT(618650,python3.9):2025-04-03-09:27:47.754.206 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618987] [ServerToClientMsgProc] [sessionID=1]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.754.211 [runtime.cc:3077] 618826 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=1, devId=1, tdt status=0
[INFO] TDT(618650,python3.9):2025-04-03-09:27:47.754.239 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618987] [TsdClient] DeviceMsgProc recvMsg realDeviceId[1] msgType[49] localDevId[1] rspCode[0]heterogeneousSubPid[30534], tsdSupportLevel_[63]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:47.754.262 [hdc_client.cpp:172][TsdRecvData][tid:618987] [deviceId=1] the Tsd recv data already
[INFO] TDT(618650,python3.9):2025-04-03-09:27:47.754.275 [process_mode_manager.cpp:1461][ProcessOpenSubProc][tid:618987] OpenSubProc success stype:0, pid:30534
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.754.292 [adapter_tdt.cc:39] [618987]Open TsdProcess success. deviceLogicId[1]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.754.302 [npu_driver.cc:551] 618826 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.754.290 [runtime.cc:3077] 618772 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=3, devId=3, tdt status=0
[INFO] TDT(618658,python3.9):2025-04-03-09:27:47.754.295 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618982] [ServerToClientMsgProc] [sessionID=1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.754.306 [network_manager.cc:118] [618987][TsdProcessOpen]hrtTsdProcessOpen success, subPid[30534], devicePhyId_[1], deviceLogicId_[1], hasBackup[0]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:47.754.332 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618982] [TsdClient] DeviceMsgProc recvMsg realDeviceId[3] msgType[49] localDevId[3] rspCode[0]heterogeneousSubPid[30159], tsdSupportLevel_[63]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.754.338 [network_manager.cc:180] [618987][NetworkManager][Init]open tsd by process success, devicePhyId[1], deviceLogicId_[1].
[INFO] TDT(618658,python3.9):2025-04-03-09:27:47.754.352 [hdc_client.cpp:172][TsdRecvData][tid:618982] [deviceId=3] the Tsd recv data already
[INFO] TDT(618658,python3.9):2025-04-03-09:27:47.754.370 [process_mode_manager.cpp:1461][ProcessOpenSubProc][tid:618982] OpenSubProc success stype:0, pid:30159
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.754.386 [adapter_tdt.cc:39] [618982]Open TsdProcess success. deviceLogicId[3]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.754.390 [npu_driver.cc:551] 618772 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:47.754.395 [ra_host.c:205]tid:618987,ra_init(205) : Input parameters: phy_id[1], nic_position:[1] hdc_type:[18]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.754.401 [network_manager.cc:118] [618982][TsdProcessOpen]hrtTsdProcessOpen success, subPid[30159], devicePhyId_[3], deviceLogicId_[3], hasBackup[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.754.424 [network_manager.cc:180] [618982][NetworkManager][Init]open tsd by process success, devicePhyId[3], deviceLogicId_[3].
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:47.754.481 [ra_host.c:205]tid:618982,ra_init(205) : Input parameters: phy_id[3], nic_position:[1] hdc_type:[18]
[INFO] ROCE(618650,python3.9):2025-04-03-09:27:47.754.500 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] DRV(618650,python3.9):2025-04-03-09:27:47.754.524 [devdrv_hccl.c:103][ascend][curpid:618650,618987][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618650)
[INFO] ROCE(618650,python3.9):2025-04-03-09:27:47.754.565 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] ROCE(618658,python3.9):2025-04-03-09:27:47.754.582 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:47.754.583 [ra_hdc.c:580]tid:618987,ra_hdc_init(580) : hdc init start! logic id is 1, phy id is 1, hdc_type is 18
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:47.754.597 [ra_hdc.c:616]tid:618986,ra_hdc_init(616) : hdc init OK! phy_id[6]
[INFO] DRV(618658,python3.9):2025-04-03-09:27:47.754.611 [devdrv_hccl.c:103][ascend][curpid:618658,618982][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618658)
[INFO] ROCE(618658,python3.9):2025-04-03-09:27:47.754.653 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:47.754.686 [ra_hdc.c:580]tid:618982,ra_hdc_init(580) : hdc init start! logic id is 3, phy id is 3, hdc_type is 18
[INFO] DRV(618650,python3.9):2025-04-03-09:27:47.754.755 [hdc_core.c:1982][ascend][curpid:618650,618987][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4197; pid=618650)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:47.754.960 [hdc_core.c:1982][ascend][curpid:618658,618982][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4198; pid=618658)
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:47.754.978 [ra_hdc.c:616]tid:618987,ra_hdc_init(616) : hdc init OK! phy_id[1]
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:47.755.221 [ra_hdc.c:616]tid:618982,ra_hdc_init(616) : hdc init OK! phy_id[3]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.758.064 [adapter_hccp.cc:583] [618986]init ra success.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.758.081 [network_manager.cc:222] [618986]NetworkManager nicDeploy[1] deviceLogicId_[6] devicePhyId_[6] init ra OK, nicSocketMap size[0], isHostUseDevNic[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.758.099 [hccl_communicator_attrs.cc:1307] [618986][HcclCommunicator]IsSupportEnableRoce
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.758.112 [hccl_communicator_attrs.cc:1275] [618986]IsEnableRoce ret: 0, interServer_: 0, isInterServerVnic: 0, roceSwitch: 0, isSingleMeshAggregation_: 1
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.758.135 [hccl_communicator.cc:2259] [618986][HcclCommunicator][GetLocalNicPort] nicType[0], devicePortSwitchOn[0], isUseRankPort[1], get port[16666], devId[6]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.758.160 [adapter_hccp.cc:1650] [618986]hrtRaGetInterfaceVersion phyId[0], opCode[55], version[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.758.357 [adapter_hccp.cc:2343] [618986]Get available Vnic info success, deviceIdType[0] deviceId[0x6] Vnic ip[192.168.2.193]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.758.398 [network_manager.cc:69] [618986]NetworkManager::GetInstance deviceLogicID[6].
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:47.758.417 [ra_host.c:280]tid:618986,ra_socket_init(280) : socket init:mode=1 phy_id=6 family=2 ip=192.168.2.193
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.758.433 [adapter_hccp.cc:806] [618986]socket init success, ip[3238176960] device id[6], socketHandle[0xfffea40ff5b0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.758.458 [network_manager.cc:692] [618986]devicePhyId[6], ip[192.168.2.193] socket init OK
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.758.469 [network_manager.cc:432] [618986][Start][Vnic]trying to listen on ip[192.168.2.193] port[16666].
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:47.758.484 [ra_host.c:875]tid:618986,ra_socket_listen_start(875) : Input parameters: [0]th, phy_id[6], local_ip[192.168.2.193], port[16666]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.758.794 [network_manager.cc:448] [618986][Start][Vnic]Listen on ip[192.168.2.193], port[16666] sucess, devPhyId[6], devLogicId[6], isAutoPort[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.758.812 [network_manager.cc:451] [618986]NetworkManager devicePhyId_[6] port[16666] start vnic OK. refCount[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.758.824 [network_manager.cc:69] [618986]NetworkManager::GetInstance deviceLogicID[6].
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.758.836 [hccl_socket.cc:106] [618986][HcclSocket][Listen] device[6] listens on ip[192.168.2.193] port[16666] success, socketType[0].
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.758.852 [hccl_socket_manager.cc:56] [618986][Init][Server]ip[192.168.2.193] port[16666]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.758.846 [adapter_hccp.cc:583] [618987]init ra success.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.758.865 [network_manager.cc:222] [618987]NetworkManager nicDeploy[1] deviceLogicId_[1] devicePhyId_[1] init ra OK, nicSocketMap size[0], isHostUseDevNic[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.758.873 [hccl_communicator.cc:1548] [618986][HcclCommunicator][InitRaResource] init vnic with ip[192.168.2.193] port[16666] success
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.758.887 [hccl_communicator_attrs.cc:1307] [618987][HcclCommunicator]IsSupportEnableRoce
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.758.887 [hccl_communicator_attrs.cc:1307] [618986][HcclCommunicator]IsSupportEnableRoce
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.758.904 [hccl_communicator_attrs.cc:1275] [618987]IsEnableRoce ret: 0, interServer_: 0, isInterServerVnic: 0, roceSwitch: 0, isSingleMeshAggregation_: 1
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.758.899 [hccl_communicator_attrs.cc:1275] [618986]IsEnableRoce ret: 0, interServer_: 0, isInterServerVnic: 0, roceSwitch: 0, isSingleMeshAggregation_: 1
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.758.913 [hccl_communicator.cc:1565] [618986]isUsedRdmaLevel0_[0] nicNum[1] hostIP[192.168.0.44], nicDeployment[1].
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.758.886 [adapter_hccp.cc:583] [618982]init ra success.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.758.909 [network_manager.cc:222] [618982]NetworkManager nicDeploy[1] deviceLogicId_[3] devicePhyId_[3] init ra OK, nicSocketMap size[0], isHostUseDevNic[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.758.927 [network_manager.cc:69] [618986]NetworkManager::GetInstance deviceLogicID[6].
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.758.932 [hccl_communicator_attrs.cc:1307] [618982][HcclCommunicator]IsSupportEnableRoce
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.758.941 [hccl_communicator.cc:2028] [618986]profiling config information:options[], mode[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.758.925 [hccl_communicator.cc:2259] [618987][HcclCommunicator][GetLocalNicPort] nicType[0], devicePortSwitchOn[0], isUseRankPort[1], get port[16666], devId[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.758.947 [hccl_communicator_attrs.cc:1275] [618982]IsEnableRoce ret: 0, interServer_: 0, isInterServerVnic: 0, roceSwitch: 0, isSingleMeshAggregation_: 1
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.758.954 [adapter_hccp.cc:1650] [618987]hrtRaGetInterfaceVersion phyId[0], opCode[55], version[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.758.976 [hccl_communicator.cc:2259] [618982][HcclCommunicator][GetLocalNicPort] nicType[0], devicePortSwitchOn[0], isUseRankPort[1], get port[16666], devId[3]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.759.008 [adapter_hccp.cc:1650] [618982]hrtRaGetInterfaceVersion phyId[0], opCode[55], version[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.759.052 [adapter_trace.cc:21] [618986]Call TraceCreate, return value[0]
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:47.759.074 [atrace_api.c:61](tid:618986) AtraceCreateWithAttr start.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.759.136 [adapter_hccp.cc:2343] [618987]Get available Vnic info success, deviceIdType[0] deviceId[0x1] Vnic ip[192.168.2.198]
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:47.759.147 [trace_rb_log.c:45](tid:618986) init ring buffer time finished, realTime 1743643667759141340, monotonicTime 4163696978076, freq 99996 kHz, minutesWest 480 minutes
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:47.759.165 [trace_rb_log.c:137](tid:618986) [HCCL_618986_6] create ring buffer success, msgSize 128 bytes, msgTxtSize 112 bytes, bufferSize 1024 bytes, msg space 128 bytes, total space 131568 bytes
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:47.759.182 [tracer_mgr_operate.c:66](tid:618986) create object HCCL_618986_6 success, exitSave(true), noLock(false).
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:47.759.198 [atrace_api.c:63](tid:618986) AtraceCreateWithAttr end.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.759.183 [network_manager.cc:69] [618987]NetworkManager::GetInstance deviceLogicID[1].
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.759.207 [adapter_hccp.cc:2343] [618982]Get available Vnic info success, deviceIdType[0] deviceId[0x3] Vnic ip[192.168.2.196]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.759.210 [adapter_trace.cc:70] [618986]Call TraceCreateWithAttr, return value[0xaaaac8e04558], Params: objName[HCCL_618986_6]
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:47.759.220 [ra_host.c:280]tid:618987,ra_socket_init(280) : socket init:mode=1 phy_id=1 family=2 ip=192.168.2.198
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.759.237 [adapter_hccp.cc:806] [618987]socket init success, ip[3322063040] device id[1], socketHandle[0xfffeb80ff5b0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.759.253 [network_manager.cc:692] [618987]devicePhyId[1], ip[192.168.2.198] socket init OK
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.759.254 [rank_consistentcy_checker.cc:32] [618986][GetInstance] get deviceLogicId[6]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.759.264 [network_manager.cc:432] [618987][Start][Vnic]trying to listen on ip[192.168.2.198] port[16666].
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:47.759.282 [ra_host.c:875]tid:618987,ra_socket_listen_start(875) : Input parameters: [0]th, phy_id[1], local_ip[192.168.2.198], port[16666]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.759.293 [api_impl.cc:1486] 618986 GetMaxStreamAndTask: maxTaskNum:2013, maxStrCount:2016.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.759.290 [network_manager.cc:69] [618982]NetworkManager::GetInstance deviceLogicID[3].
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.759.322 [npu_driver.cc:4604] 618986 GetMaxStreamAndTask: deviceId=6, tsId=0, streamCount=1984.
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:47.759.324 [ra_host.c:280]tid:618982,ra_socket_init(280) : socket init:mode=1 phy_id=3 family=2 ip=192.168.2.196
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.759.339 [task_exception_handler.cc:1212] [618986]get from RTS the max stream count[1984] the max task count[65535]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.759.346 [adapter_hccp.cc:806] [618982]socket init success, ip[3288508608] device id[3], socketHandle[0xfffeac0ff5b0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.759.364 [network_manager.cc:692] [618982]devicePhyId[3], ip[192.168.2.196] socket init OK
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.759.378 [network_manager.cc:432] [618982][Start][Vnic]trying to listen on ip[192.168.2.196] port[16666].
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.759.371 [hccl_communicator_attrs.cc:1099] [618986][Set][HcclCommunicatorAttrs][MeshAggregationRankSize]set MeshAggregationRankSize[8].
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:47.759.396 [ra_host.c:875]tid:618982,ra_socket_listen_start(875) : Input parameters: [0]th, phy_id[3], local_ip[192.168.2.196], port[16666]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.759.438 [api_impl.cc:4219] 618986 RegProfCtrlCallback: Reg profiling callback, moduleId=3.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.759.462 [command_handle.cc:25] [618986][Profiling][CommandHandle] CommandHandle's rtType is 2.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.759.478 [command_handle.cc:99] [618986][Check][Param]SetMsprofReporterCallback.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.759.571 [profiler_manager_impl.cc:76] [618986][ProfilerManager][InitProfiler]Register CtrlCallBack success
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.759.589 [hccl_communicator.cc:2193] [618986][BASE][InitProfiler]Register CtrlCallBack success.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.759.602 [hccl_communicator.cc:803] [618986]Will use ffts mode.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.759.595 [network_manager.cc:448] [618987][Start][Vnic]Listen on ip[192.168.2.198], port[16666] sucess, devPhyId[1], devLogicId[1], isAutoPort[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.759.614 [network_manager.cc:451] [618987]NetworkManager devicePhyId_[1] port[16666] start vnic OK. refCount[1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.759.630 [network_manager.cc:69] [618987]NetworkManager::GetInstance deviceLogicID[1].
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.759.628 [api_impl.cc:3138] 618986 GetDeviceIndexByPhyId: get Index by PhyId=6.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.759.642 [hccl_socket.cc:106] [618987][HcclSocket][Listen] device[1] listens on ip[192.168.2.198] port[16666] success, socketType[0].
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.759.648 [api_impl.cc:3149] 618986 GetDeviceIndexByPhyId: GetDeviceIndexByPhyId, device_mode=0, phyId=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.759.661 [api_impl.cc:3157] 618986 GetDeviceIndexByPhyId: cloud v2, device_mode=0, device_id=6
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.759.660 [hccl_socket_manager.cc:56] [618987][Init][Server]ip[192.168.2.198] port[16666]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.759.672 [runtime.cc:5239] 618986 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.759.680 [hccl_communicator.cc:1548] [618987][HcclCommunicator][InitRaResource] init vnic with ip[192.168.2.198] port[16666] success
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.759.695 [hccl_communicator_attrs.cc:1307] [618987][HcclCommunicator]IsSupportEnableRoce
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.759.709 [hccl_communicator_attrs.cc:1275] [618987]IsEnableRoce ret: 0, interServer_: 0, isInterServerVnic: 0, roceSwitch: 0, isSingleMeshAggregation_: 1
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.759.724 [hccl_communicator.cc:1565] [618987]isUsedRdmaLevel0_[0] nicNum[1] hostIP[192.168.0.44], nicDeployment[1].
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.759.719 [network_manager.cc:448] [618982][Start][Vnic]Listen on ip[192.168.2.196], port[16666] sucess, devPhyId[3], devLogicId[3], isAutoPort[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.759.738 [network_manager.cc:451] [618982]NetworkManager devicePhyId_[3] port[16666] start vnic OK. refCount[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.759.755 [network_manager.cc:69] [618982]NetworkManager::GetInstance deviceLogicID[3].
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.759.740 [network_manager.cc:69] [618987]NetworkManager::GetInstance deviceLogicID[1].
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.759.759 [hccl_communicator.cc:2028] [618987]profiling config information:options[], mode[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.759.770 [hccl_socket.cc:106] [618982][HcclSocket][Listen] device[3] listens on ip[192.168.2.196] port[16666] success, socketType[0].
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.759.787 [hccl_socket_manager.cc:56] [618982][Init][Server]ip[192.168.2.196] port[16666]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.759.807 [hccl_communicator.cc:1548] [618982][HcclCommunicator][InitRaResource] init vnic with ip[192.168.2.196] port[16666] success
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.759.825 [hccl_communicator_attrs.cc:1307] [618982][HcclCommunicator]IsSupportEnableRoce
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.759.837 [hccl_communicator_attrs.cc:1275] [618982]IsEnableRoce ret: 0, interServer_: 0, isInterServerVnic: 0, roceSwitch: 0, isSingleMeshAggregation_: 1
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.759.855 [hccl_communicator.cc:1565] [618982]isUsedRdmaLevel0_[0] nicNum[1] hostIP[192.168.0.44], nicDeployment[1].
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.759.883 [network_manager.cc:69] [618982]NetworkManager::GetInstance deviceLogicID[3].
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.759.897 [hccl_communicator.cc:2028] [618982]profiling config information:options[], mode[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.759.883 [adapter_trace.cc:21] [618987]Call TraceCreate, return value[0]
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:47.759.909 [atrace_api.c:61](tid:618987) AtraceCreateWithAttr start.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:47.759.991 [trace_rb_log.c:45](tid:618987) init ring buffer time finished, realTime 1743643667759983061, monotonicTime 4163697062251, freq 99994 kHz, minutesWest 480 minutes
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:47.760.010 [trace_rb_log.c:137](tid:618987) [HCCL_618987_1] create ring buffer success, msgSize 128 bytes, msgTxtSize 112 bytes, bufferSize 1024 bytes, msg space 128 bytes, total space 131568 bytes
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.760.019 [adapter_trace.cc:21] [618982]Call TraceCreate, return value[0]
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:47.760.029 [tracer_mgr_operate.c:66](tid:618987) create object HCCL_618987_1 success, exitSave(true), noLock(false).
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:47.760.047 [atrace_api.c:63](tid:618987) AtraceCreateWithAttr end.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:47.760.046 [atrace_api.c:61](tid:618982) AtraceCreateWithAttr start.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.760.060 [adapter_trace.cc:70] [618987]Call TraceCreateWithAttr, return value[0xaaab20732988], Params: objName[HCCL_618987_1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.760.099 [rank_consistentcy_checker.cc:32] [618987][GetInstance] get deviceLogicId[1]
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:47.760.129 [trace_rb_log.c:45](tid:618982) init ring buffer time finished, realTime 1743643667760122642, monotonicTime 4163697076211, freq 99993 kHz, minutesWest 480 minutes
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.760.143 [api_impl.cc:1486] 618987 GetMaxStreamAndTask: maxTaskNum:2013, maxStrCount:2016.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:47.760.148 [trace_rb_log.c:137](tid:618982) [HCCL_618982_3] create ring buffer success, msgSize 128 bytes, msgTxtSize 112 bytes, bufferSize 1024 bytes, msg space 128 bytes, total space 131568 bytes
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:47.760.202 [tracer_mgr_operate.c:66](tid:618982) create object HCCL_618982_3 success, exitSave(true), noLock(false).
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:47.760.217 [atrace_api.c:63](tid:618982) AtraceCreateWithAttr end.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.760.202 [npu_driver.cc:4604] 618987 GetMaxStreamAndTask: deviceId=1, tsId=0, streamCount=1984.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.760.224 [task_exception_handler.cc:1212] [618987]get from RTS the max stream count[1984] the max task count[65535]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.760.229 [adapter_trace.cc:70] [618982]Call TraceCreateWithAttr, return value[0xaaaaf9f43558], Params: objName[HCCL_618982_3]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.760.246 [hccl_communicator_attrs.cc:1099] [618987][Set][HcclCommunicatorAttrs][MeshAggregationRankSize]set MeshAggregationRankSize[8].
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.760.270 [rank_consistentcy_checker.cc:32] [618982][GetInstance] get deviceLogicId[3]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.760.308 [api_impl.cc:4219] 618987 RegProfCtrlCallback: Reg profiling callback, moduleId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.760.321 [api_impl.cc:1486] 618982 GetMaxStreamAndTask: maxTaskNum:2013, maxStrCount:2016.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.760.333 [command_handle.cc:25] [618987][Profiling][CommandHandle] CommandHandle's rtType is 2.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.760.350 [command_handle.cc:99] [618987][Check][Param]SetMsprofReporterCallback.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.760.351 [npu_driver.cc:4604] 618982 GetMaxStreamAndTask: deviceId=3, tsId=0, streamCount=1984.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.760.370 [task_exception_handler.cc:1212] [618982]get from RTS the max stream count[1984] the max task count[65535]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.760.391 [hccl_communicator_attrs.cc:1099] [618982][Set][HcclCommunicatorAttrs][MeshAggregationRankSize]set MeshAggregationRankSize[8].
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.760.440 [profiler_manager_impl.cc:76] [618987][ProfilerManager][InitProfiler]Register CtrlCallBack success
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.760.459 [hccl_communicator.cc:2193] [618987][BASE][InitProfiler]Register CtrlCallBack success.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.760.472 [hccl_communicator.cc:803] [618987]Will use ffts mode.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.760.460 [api_impl.cc:4219] 618982 RegProfCtrlCallback: Reg profiling callback, moduleId=3.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.760.484 [command_handle.cc:25] [618982][Profiling][CommandHandle] CommandHandle's rtType is 2.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.760.500 [command_handle.cc:99] [618982][Check][Param]SetMsprofReporterCallback.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.760.499 [api_impl.cc:3138] 618987 GetDeviceIndexByPhyId: get Index by PhyId=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.760.520 [api_impl.cc:3149] 618987 GetDeviceIndexByPhyId: GetDeviceIndexByPhyId, device_mode=0, phyId=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.760.534 [api_impl.cc:3157] 618987 GetDeviceIndexByPhyId: cloud v2, device_mode=0, device_id=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.760.545 [runtime.cc:5239] 618987 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.760.620 [profiler_manager_impl.cc:76] [618982][ProfilerManager][InitProfiler]Register CtrlCallBack success
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.760.638 [hccl_communicator.cc:2193] [618982][BASE][InitProfiler]Register CtrlCallBack success.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.760.652 [hccl_communicator.cc:803] [618982]Will use ffts mode.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.760.679 [api_impl.cc:3138] 618982 GetDeviceIndexByPhyId: get Index by PhyId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.760.696 [api_impl.cc:3149] 618982 GetDeviceIndexByPhyId: GetDeviceIndexByPhyId, device_mode=0, phyId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.760.708 [api_impl.cc:3157] 618982 GetDeviceIndexByPhyId: cloud v2, device_mode=0, device_id=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.760.721 [runtime.cc:5239] 618982 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.760.720 [api_impl.cc:3476] 618986 GetDeviceInfo: get device info, deviceId=6
[WARNING] HCCL(618670,python3.9):2025-04-03-09:27:47.760.777 [tbe_vector_reduce.cc:508] [618986]ENV:LD_LIBRARY_PATH lack fwkacllib/lib64
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.761.565 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.761.572 [api_impl.cc:3476] 618987 GetDeviceInfo: get device info, deviceId=1
[WARNING] HCCL(618650,python3.9):2025-04-03-09:27:47.761.633 [tbe_vector_reduce.cc:508] [618987]ENV:LD_LIBRARY_PATH lack fwkacllib/lib64
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.761.734 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.761.754 [dispatcher.cc:157] [618986][GetNotifyMaxWaitTime] notifyMaxWaitTime_ is 2147483647s
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.761.773 [api_impl.cc:3138] 618986 GetDeviceIndexByPhyId: get Index by PhyId=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.761.789 [api_impl.cc:3149] 618986 GetDeviceIndexByPhyId: GetDeviceIndexByPhyId, device_mode=0, phyId=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.761.801 [api_impl.cc:3157] 618986 GetDeviceIndexByPhyId: cloud v2, device_mode=0, device_id=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.761.812 [runtime.cc:5239] 618986 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.761.837 [api_impl.cc:1990] 618986 DevMalloc: size=4, type=16, moduleId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.762.046 [api_impl.cc:3476] 618982 GetDeviceInfo: get device info, deviceId=3
[WARNING] HCCL(618658,python3.9):2025-04-03-09:27:47.762.103 [tbe_vector_reduce.cc:508] [618982]ENV:LD_LIBRARY_PATH lack fwkacllib/lib64
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.762.696 [api_error.cc:1218] 618986 DevMalloc: device malloc Succ, size=4, type=16, moduleId=3, start ptr=0x12c280000000, end ptr=0x12c280000004
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.762.697 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.762.758 [api_impl.cc:1990] 618986 DevMalloc: size=4, type=16, moduleId=3.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.762.782 [api_error.cc:1218] 618986 DevMalloc: device malloc Succ, size=4, type=16, moduleId=3, start ptr=0x12c280001000, end ptr=0x12c280001004
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.762.816 [api_impl.cc:1990] 618986 DevMalloc: size=4, type=16, moduleId=3.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.762.836 [api_error.cc:1218] 618986 DevMalloc: device malloc Succ, size=4, type=16, moduleId=3, start ptr=0x12c280002000, end ptr=0x12c280002004
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.762.861 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.762.868 [opexecounter.cc:71] [618986]alloc counter mem resource.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.762.884 [dispatcher.cc:157] [618987][GetNotifyMaxWaitTime] notifyMaxWaitTime_ is 2147483647s
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.762.903 [api_impl.cc:3138] 618987 GetDeviceIndexByPhyId: get Index by PhyId=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.762.917 [api_impl.cc:3149] 618987 GetDeviceIndexByPhyId: GetDeviceIndexByPhyId, device_mode=0, phyId=1
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.762.910 [hccl_communicator_attrs.cc:1368] [618986][CollectAlgoAttr]:isUsedRdmaLevel0:[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.762.931 [api_impl.cc:3157] 618987 GetDeviceIndexByPhyId: cloud v2, device_mode=0, device_id=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.762.948 [runtime.cc:5239] 618987 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.762.960 [alg_configurator.cc:68] [618986][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.762.982 [alg_configurator.cc:241] [618986][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.762.976 [api_impl.cc:1990] 618987 DevMalloc: size=4, type=16, moduleId=3.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.004 [alg_configurator.cc:134] [618986]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.021 [alg_configurator.cc:68] [618986][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.034 [alg_configurator.cc:241] [618986][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.047 [alg_configurator.cc:134] [618986]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.064 [alg_configurator.cc:68] [618986][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.077 [alg_configurator.cc:241] [618986][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.090 [alg_configurator.cc:134] [618986]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[2]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.104 [alg_configurator.cc:68] [618986][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.118 [alg_configurator.cc:241] [618986][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.133 [alg_configurator.cc:134] [618986]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[3]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.146 [alg_configurator.cc:68] [618986][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.163 [alg_configurator.cc:241] [618986][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.763.157 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.177 [alg_configurator.cc:134] [618986]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[4]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.196 [alg_configurator.cc:68] [618986][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.211 [alg_configurator.cc:241] [618986][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.223 [alg_configurator.cc:134] [618986]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[5]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.240 [alg_configurator.cc:68] [618986][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.253 [alg_configurator.cc:241] [618986][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.266 [alg_configurator.cc:134] [618986]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[6]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.282 [alg_configurator.cc:68] [618986][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.306 [alg_configurator.cc:241] [618986][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.318 [alg_configurator.cc:134] [618986]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[7]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.763.327 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.333 [alg_configurator.cc:68] [618986][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.349 [alg_configurator.cc:241] [618986][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.763.348 [dispatcher.cc:157] [618982][GetNotifyMaxWaitTime] notifyMaxWaitTime_ is 2147483647s
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.364 [alg_configurator.cc:134] [618986]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[8]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.763.368 [api_impl.cc:3138] 618982 GetDeviceIndexByPhyId: get Index by PhyId=3.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.380 [alg_configurator.cc:68] [618986][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.763.386 [api_impl.cc:3149] 618982 GetDeviceIndexByPhyId: GetDeviceIndexByPhyId, device_mode=0, phyId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.763.399 [api_impl.cc:3157] 618982 GetDeviceIndexByPhyId: cloud v2, device_mode=0, device_id=3
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.395 [alg_configurator.cc:241] [618986][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.763.411 [runtime.cc:5239] 618982 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.409 [alg_configurator.cc:134] [618986]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[9]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.427 [alg_configurator.cc:68] [618986][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.763.438 [api_impl.cc:1990] 618982 DevMalloc: size=4, type=16, moduleId=3.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.442 [alg_configurator.cc:241] [618986][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.458 [alg_configurator.cc:134] [618986]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[10]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.473 [alg_configurator.cc:68] [618986][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.486 [alg_configurator.cc:241] [618986][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.501 [alg_configurator.cc:134] [618986]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[11]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.514 [alg_configurator.cc:68] [618986][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.529 [alg_configurator.cc:241] [618986][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.545 [alg_configurator.cc:134] [618986]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[12]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.558 [alg_configurator.cc:68] [618986][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.575 [alg_configurator.cc:241] [618986][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.587 [alg_configurator.cc:134] [618986]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[13]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.601 [alg_configurator.cc:68] [618986][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.618 [alg_configurator.cc:241] [618986][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.630 [alg_configurator.cc:134] [618986]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[14]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.654 [alg_configurator.cc:68] [618986][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.668 [alg_configurator.cc:241] [618986][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.682 [alg_configurator.cc:134] [618986]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[15]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.695 [alg_configurator.cc:68] [618986][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.712 [alg_configurator.cc:241] [618986][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.724 [alg_configurator.cc:134] [618986]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[16]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.737 [alg_configurator.cc:68] [618986][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.754 [alg_configurator.cc:241] [618986][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.765 [alg_configurator.cc:134] [618986]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[17]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.779 [alg_configurator.cc:68] [618986][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.795 [alg_configurator.cc:241] [618986][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.807 [alg_configurator.cc:134] [618986]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[18]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.827 [alg_configurator.cc:449] [618986][AlgConfigurator][GetTopoTypeByAlgType]algtype[level0:fullmesh,level1:ring,level2:H-D], devicetype[2],topotype[8] is selected
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.844 [alg_configurator.cc:42] [618986]alg configurator init success.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.763.822 [api_error.cc:1218] 618987 DevMalloc: device malloc Succ, size=4, type=16, moduleId=3, start ptr=0x12c280000000, end ptr=0x12c280000004
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.883 [topo_info_extractor.cc:66] [618986]factory init:collective id[192.168.0.44%enp67s0f5_60008_0_1743643662827273], user rank[6], user rank size[8], topo type[8], device Type[2], meshAggregationRankSize[8]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.763.887 [api_impl.cc:1990] 618987 DevMalloc: size=4, type=16, moduleId=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.763.912 [api_error.cc:1218] 618987 DevMalloc: device malloc Succ, size=4, type=16, moduleId=3, start ptr=0x12c280001000, end ptr=0x12c280001004
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.909 [topo_info_extractor.cc:155] [618986][SetRankInfo]rankData_: userRank[6], devicePhyId[6], serverIdx[0], superPodId[], superPodIdx[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.763.936 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=0, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.763.946 [api_impl.cc:1990] 618987 DevMalloc: size=4, type=16, moduleId=3.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.763.969 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.763.966 [api_error.cc:1218] 618987 DevMalloc: device malloc Succ, size=4, type=16, moduleId=3, start ptr=0x12c280002000, end ptr=0x12c280002004
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.764.002 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=1, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.014 [opexecounter.cc:71] [618987]alloc counter mem resource.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.026 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.764.045 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=2, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.057 [hccl_communicator_attrs.cc:1368] [618987][CollectAlgoAttr]:isUsedRdmaLevel0:[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.064 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.764.082 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=3, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.108 [alg_configurator.cc:68] [618987][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.111 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[3] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.133 [alg_configurator.cc:241] [618987][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.764.147 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=4, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.169 [alg_configurator.cc:134] [618987]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.190 [alg_configurator.cc:68] [618987][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.184 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.208 [alg_configurator.cc:241] [618987][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.764.201 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=5, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.223 [alg_configurator.cc:134] [618987]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.218 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.238 [alg_configurator.cc:68] [618987][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.764.235 [api_error.cc:3478] 618986 GetPairPhyDevicesInfo: input physic devId=6, input physic otherDevId=7, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.254 [alg_configurator.cc:241] [618987][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.253 [adapter_rts.cc:940] [618986][hrtGetPairDeviceLinkTypeRaw]phyDevId[6] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.267 [alg_configurator.cc:134] [618987]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[2]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.273 [topo_info_extractor.cc:348] [618986]check server info:server rank size[8], expected value[8], topo type[8]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.282 [alg_configurator.cc:68] [618987][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.300 [alg_configurator.cc:241] [618987][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.764.295 [api_error.cc:1218] 618982 DevMalloc: device malloc Succ, size=4, type=16, moduleId=3, start ptr=0x12c280000000, end ptr=0x12c280000004
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.317 [alg_configurator.cc:134] [618987]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[3]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.333 [alg_configurator.cc:68] [618987][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.346 [alg_configurator.cc:241] [618987][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.361 [alg_configurator.cc:134] [618987]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[4]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.376 [alg_configurator.cc:68] [618987][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.764.363 [api_impl.cc:1990] 618982 DevMalloc: size=4, type=16, moduleId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.764.390 [api_error.cc:1218] 618982 DevMalloc: device malloc Succ, size=4, type=16, moduleId=3, start ptr=0x12c280001000, end ptr=0x12c280001004
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.392 [alg_configurator.cc:241] [618987][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.411 [alg_configurator.cc:134] [618987]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[5]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.426 [alg_configurator.cc:68] [618987][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.441 [alg_configurator.cc:241] [618987][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.764.426 [api_impl.cc:1990] 618982 DevMalloc: size=4, type=16, moduleId=3.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.428 [topo_info_extractor.cc:888] [618986]SetTopoInfoForLevel0: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[6], userRankSize[8], topoRankInfo[userRank/devicePhyId: 0/0; 1/1; 2/2; 3/3; 4/4; 5/5; 6/6; 7/7; ]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.455 [alg[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.764.448 [api_error.cc:1218] 618982 DevMalloc: device malloc Succ, size=4, type=16, moduleId=3, start ptr=0x12c280002000, end ptr=0x12c280002004
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.458 [topo_info_extractor.cc:585] [618986][Set][TopoInfoForLevel1] topoType_[8] ringSize[8]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.478 [opexecounter.cc:71] [618982]alloc counter mem resource.
_configurator.cc:134] [618987]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[6]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.481 [topo_info_extractor.cc:646] [618986][Set][TopoInfoForLevel1] calc subGroup superPodId[] subIndex[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.491 [alg_configurator.cc:68] [618987][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.507 [alg_configurator.cc:241] [618987][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.499 [topo_info_extractor.cc:685] [618986]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 0, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 0/192.168.0.44/0/192.168.100.101/0; ]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.518 [topo_info_extractor.cc:685] [618986]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 1, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 1/192.168.0.44/1/29.105.19.202/0; ]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.520 [alg_configurator.cc:134] [618987]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[7]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.519 [hccl_communicator_attrs.cc:1368] [618982][CollectAlgoAttr]:isUsedRdmaLevel0:[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.535 [topo_info_extractor.cc:685] [618986]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 2, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 2/192.168.0.44/2/29.105.165.16/0; ]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.535 [alg_configurator.cc:68] [618987][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.550 [alg_configurator.cc:241] [618987][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.551 [topo_info_extractor.cc:685] [618986]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 3, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 3/192.168.0.44/3/29.105.51.138/0; ]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.563 [alg_configurator.cc:134] [618987]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[8]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.561 [alg_configurator.cc:68] [618982][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.569 [topo_info_extractor.cc:685] [618986]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 4, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 4/192.168.0.44/4/29.105.24.184/0; ]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.578 [alg_configurator.cc:68] [618987][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.587 [alg_configurator.cc:241] [618982][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.585 [topo_info_extractor.cc:685] [618986]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 5, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 5/192.168.0.44/5/29.105.72.114/0; ]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.601 [topo_info_extractor.cc:685] [618986]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 6, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 6/192.168.0.44/6/29.105.134.38/1; ]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.594 [alg_configurator.cc:241] [618987][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.609 [alg_configurator.cc:134] [618987]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[9]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.616 [topo_info_extractor.cc:685] [618986]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 7, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 7/192.168.0.44/7/29.105.73.96/0; ]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.611 [alg_configurator.cc:134] [618982]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.624 [alg_configurator.cc:68] [618987][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.630 [alg_configurator.cc:68] [618982][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.646 [alg_configurator.cc:241] [618982][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.630 [topo_info_extractor.cc:689] [618986]SetTopoInfoForLevel1: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[6], userRankSize[8], plane size[8]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.657 [topo_info_extractor.cc:697] [618986][Set][TopoInfoForLevel2] select origin proc
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.638 [alg_configurator.cc:241] [618987][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.653 [alg_configurator.cc:134] [618987]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[10]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.658 [alg_configurator.cc:134] [618982]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.673 [alg_configurator.cc:68] [618982][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.673 [topo_info_extractor.cc:734] [618986]SetTopoInfoForLevel2: topoRankInfo[userRank/devicePhyId/serverIdx/superPodId: 6/6/0/; ]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.688 [alg_configurator.cc:241] [618982][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.668 [alg_configurator.cc:68] [618987][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.682 [alg_configurator.cc:241] [618987][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.686 [topo_info_extractor.cc:739] [618986]SetTopoInfoForLevel2: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[6], userRankSize[8], plane size[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.700 [topo_info_extractor.cc:585] [618986][Set][TopoInfoForLevel1] topoType_[8] ringSize[8]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.702 [alg_configurator.cc:134] [618982]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[2]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.694 [alg_configurator.cc:134] [618987]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[11]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.709 [alg_configurator.cc:68] [618987][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.722 [alg_configurator.cc:241] [618987][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.719 [topo_info_extractor.cc:646] [618986][Set][TopoInfoForLevel1] calc subGroup superPodId[] subIndex[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.721 [alg_configurator.cc:68] [618982][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.740 [alg_configurator.cc:134] [618987]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[12]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.735 [topo_info_extractor.cc:685] [618986]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 0, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 0/192.168.0.44/0/192.168.100.101/0; ]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.752 [topo_info_extractor.cc:685] [618986]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 1, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 1/192.168.0.44/1/29.105.19.202/0; ]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.756 [alg_configurator.cc:68] [618987][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.737 [alg_configurator.cc:241] [618982][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.767 [alg_configurator.cc:134] [618982]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[3]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.769 [topo_info_extractor.cc:685] [618986]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 2, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 2/192.168.0.44/2/29.105.165.16/0; ]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.770 [alg_configurator.cc:241] [618987][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.786 [alg_configurator.cc:134] [618987]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[13]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.799 [alg_configurator.cc:68] [618987][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMod[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.784 [alg_configurator.cc:68] [618982][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.799 [alg_configurator.cc:241] [618982][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.791 [topo_info_extractor.cc:685] [618986]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 3, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 3/192.168.0.44/3/29.105.51.138/0; ]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.808 [topo_info_extractor.cc:685] [618986]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 4, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 4/192.168.0.44/4/29.105.24.184/0; ]
e[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.824 [alg_configurator.cc:241] [618987][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.811 [alg_configurator.cc:134] [618982]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[4]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.825 [alg_configurator.cc:68] [618982][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.823 [topo_info_extractor.cc:685] [618986]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 5, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 5/192.168.0.44/5/29.105.72.114/0; ]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.839 [topo_info_extractor.cc:685] [618986]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 6, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 6/192.168.0.44/6/29.105.134.38/1; ]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.841 [alg_configurator.cc:134] [618987]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[14]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.839 [alg_configurator.cc:241] [618982][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.855 [topo_info_extractor.cc:685] [618986]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 7, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 7/192.168.0.44/7/29.105.73.96/0; ]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.856 [alg_configurator.cc:68] [618987][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.871 [alg_configurator.cc:241] [618987][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.853 [alg_configurator.cc:134] [618982]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[5]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.869 [alg_configurator.cc:68] [618982][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.867 [topo_info_extractor.cc:689] [618986]SetTopoInfoForLevel1: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[6], userRankSize[8], plane size[8]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.886 [alg_configurator.cc:134] [618987]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[15]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.882 [alg_configurator.cc:241] [618982][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.896 [alg_configurator.cc:134] [618982]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[6]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.909 [alg_configurator.cc:68] [618982][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.902 [topo_info_extractor.cc:790] [618986]SetTopoInfoForMeshL1: topoRankInfo[userRank/devicePhyId6/6; ]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.922 [alg_configurator.cc:241] [618982][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.935 [alg_configurator.cc:134] [618982]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[7]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.901 [alg_configurator.cc:68] [618987][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.917 [alg_configurator.cc:241] [618987][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.929 [alg_configurator.cc:134] [618987]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[16]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.764.925 [topo_info_extractor.cc:519] [618986]plane info:topo type[8], device type[2], COMM_COMBINE size[1], COMM_LEVEL0 size[7], COMM_LEVEL1 size[8], COMM_LEVEL2 size[1], COMM_MESH_L0 size[1], COMM_MESH_L1 size[1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.946 [alg_configurator.cc:68] [618987][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.950 [alg_configurator.cc:68] [618982][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.960 [alg_configurator.cc:241] [618987][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.967 [alg_configurator.cc:241] [618982][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.981 [alg_configurator.cc:134] [618982]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[8]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.975 [alg_configurator.cc:134] [618987]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[17]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.764.991 [alg_configurator.cc:68] [618987][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.764.995 [alg_configurator.cc:68] [618982][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.007 [alg_configurator.cc:241] [618987][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.009 [alg_configurator.cc:241] [618982][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.022 [alg_configurator.cc:134] [618987]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[18]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.024 [alg_configurator.cc:134] [618982]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[9]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.038 [alg_configurator.cc:68] [618982][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.050 [alg_configurator.cc:241] [618982][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.042 [alg_configurator.cc:449] [618987][AlgConfigurator][GetTopoTypeByAlgType]algtype[level0:fullmesh,level1:ring,level2:H-D], devicetype[2],topotype[8] is selected
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.060 [alg_configurator.cc:42] [618987]alg configurator init success.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.765.049 [api_impl.cc:1990] 618986 DevMalloc: size=32, type=16, moduleId=3.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.065 [alg_configurator.cc:134] [618982]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[10]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.765.080 [api_error.cc:1218] 618986 DevMalloc: device malloc Succ, size=32, type=16, moduleId=3, start ptr=0x12c280003000, end ptr=0x12c280003020
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.093 [alg_configurator.cc:68] [618982][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.108 [alg_configurator.cc:241] [618982][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.121 [alg_configurator.cc:134] [618982]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[11]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.111 [topo_info_extractor.cc:66] [618987]factory init:collective id[192.168.0.44%enp67s0f5_60008_0_1743643662827273], user rank[1], user rank size[8], topo type[8], device Type[2], meshAggregationRankSize[8]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.136 [alg_configurator.cc:68] [618982][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.765.129 [hccl_impl.cc:59] [618986]start hccl resources build:get deviceLogicId[6]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.149 [alg_configurator.cc:241] [618982][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.139 [topo_info_extractor.cc:155] [618987][SetRankInfo]rankData_: userRank[1], devicePhyId[1], serverIdx[0], superPodId[], superPodIdx[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.163 [alg_configurator.cc:134] [618982]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[12]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.765.166 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=0, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.177 [alg_configurator.cc:68] [618982][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.192 [alg_configurator.cc:241] [618982][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.203 [alg_configurator.cc:134] [618982]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[13]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.201 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[0] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.217 [alg_configurator.cc:68] [618982][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.231 [alg_configurator.cc:241] [618982][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.243 [alg_configurator.cc:134] [618982]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[14]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.257 [alg_configurator.cc:68] [618982][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.765.242 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=2, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.765.261 [hccl_impl.cc:177] [618986]hcclImpl init success.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.268 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[2] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.273 [alg_configurator.cc:241] [618982][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.290 [alg_configurator.cc:134] [618982]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[15]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.304 [alg_configurator.cc:68] [618982][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.765.284 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=3, infoType=0
[WARNING] HCCL(618670,python3.9):2025-04-03-09:27:47.765.296 [hccl_aiv.cc:279] [618986][AIV][GetAivOpBinaryPath]ENV:LD_LIBRARY_PATH lack fwkacllib/lib64
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.318 [alg_configurator.cc:241] [618982][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.315 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[3] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.334 [alg_configurator.cc:134] [618982]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[16]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.346 [alg_configurator.cc:68] [618982][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.359 [alg_configurator.cc:241] [618982][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.765.351 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=4, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.372 [alg_configurator.cc:134] [618982]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[17]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.374 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.765.394 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=5, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.388 [alg_configurator.cc:68] [618982][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.403 [alg_configu[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.413 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[5] linkTypeRaw[0]
rator.cc:241] [618982][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.437 [alg_configurator.cc:134] [618982]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[18]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.765.434 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=6, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.452 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.461 [alg_configurator.cc:449] [618982][AlgConfigurator][GetTopoTypeByAlgType]algtype[level0:fullmesh,level1:ring,level2:H-D], devicetype[2],topotype[8] is selected
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.480 [alg_configurator.cc:42] [618982]alg configurator init success.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.765.471 [api_error.cc:3478] 618987 GetPairPhyDevicesInfo: input physic devId=1, input physic otherDevId=7, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.493 [adapter_rts.cc:940] [618987][hrtGetPairDeviceLinkTypeRaw]phyDevId[1] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.518 [topo_info_extractor.cc:348] [618987]check server info:server rank size[8], expected value[8], topo type[8]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.536 [topo_info_extractor.cc:66] [618982]factory init:collective id[192.168.0.44%enp67s0f5_60008_0_1743643662827273], user rank[3], user rank size[8], topo type[8], device Type[2], meshAggregationRankSize[8]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.563 [topo_info_extractor.cc:155] [618982][SetRankInfo]rankData_: userRank[3], devicePhyId[3], serverIdx[0], superPodId[], superPodIdx[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.765.591 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=0, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.625 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.765.657 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=1, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.678 [topo_info_extractor.cc:888] [618987]SetTopoInfoForLevel0: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[1], userRankSize[8], topoRankInfo[userRank/devicePhyId: 0/0; 1/1; 2/2; 3/3; 4/4; 5/5; 6/6; 7/7; ]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.682 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.765.705 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=2, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.722 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[2] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.711 [topo_info_extractor.cc:585] [618987][Set][TopoInfoForLevel1] topoType_[8] ringSize[8]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.738 [topo_info_extractor.cc:646] [618987][Set][TopoInfoForLevel1] calc subGroup superPodId[] subIndex[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.759 [topo_info_extractor.cc:685] [618987]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 0, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 0/192.168.0.44/0/192.168.100.101/0; ]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.765.759 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=4, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.781 [topo_info_extractor.cc:685] [618987]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 1, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 1/192.168.0.44/1/29.105.19.202/1; ]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.783 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.765.799 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=5, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.798 [topo_info_extractor.cc:685] [618987]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 2, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 2/192.168.0.44/2/29.105.165.16/0; ]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.817 [topo_info_extractor.cc:685] [618987]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 3, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 3/192.168.0.44/3/29.105.51.138/0; ]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.830 [topo_info_extractor.cc:685] [618987]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 4, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 4/192.168.0.44/4/29.105.24.184/0; ]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.815 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.765.831 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=6, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.845 [topo_info_extractor.cc:685] [618987]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 5, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 5/192.168.0.44/5/29.105.72.114/0; ]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.847 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.863 [topo_info_extractor.cc:685] [618987]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 6, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 6/192.168.0.44/6/29.105.134.38/0; ]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.765.864 [api_error.cc:3478] 618982 GetPairPhyDevicesInfo: input physic devId=3, input physic otherDevId=7, infoType=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.883 [adapter_rts.cc:940] [618982][hrtGetPairDeviceLinkTypeRaw]phyDevId[3] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.883 [topo_info_extractor.cc:685] [618987]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 7, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 7/192.168.0.44/7/29.105.73.96/0; ]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.912 [topo_info_extractor.cc:689] [618987]SetTopoInfoForLevel1: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[1], userRankSize[8], plane size[8]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.765.904 [topo_info_extractor.cc:348] [618982]check server info:server rank size[8], expected value[8], topo type[8]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.929 [topo_info_extractor.cc:697] [618987][Set][TopoInfoForLevel2] select origin proc
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.944 [topo_info_extractor.cc:734] [618987]SetTopoInfoForLevel2: topoRankInfo[userRank/devicePhyId/serverIdx/superPodId: 1/1/0/; ]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.959 [topo_info_extractor.cc:739] [618987]SetTopoInfoForLevel2: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[1], userRankSize[8], plane size[1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.973 [topo_info_extractor.cc:585] [618987][Set][TopoInfoForLevel1] topoType_[8] ringSize[8]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.765.989 [topo_info_extractor.cc:646] [618987][Set][TopoInfoForLevel1] calc subGroup superPodId[] subIndex[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.766.007 [topo_info_extractor.cc:685] [618987]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 0, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 0/192.168.0.44/0/192.168.100.101/0; ]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.766.022 [topo_info_extractor.cc:685] [618987]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 1, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 1/192.168.0.44/1/29.105.19.202/1; ]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.766.039 [topo_info_extractor.cc:685] [618987]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 2, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 2/192.168.0.44/2/29.105.165.16/0; ]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.766.063 [topo_info_extractor.cc:685] [618987]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 3, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 3/192.168.0.44/3/29.105.51.138/0; ]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.063 [topo_info_extractor.cc:888] [618982]SetTopoInfoForLevel0: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[3], userRankSize[8], topoRankInfo[userRank/devicePhyId: 0/0; 1/1; 2/2; 3/3; 4/4; 5/5; 6/6; 7/7; ]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.766.083 [topo_info_extractor.cc:685] [618987]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 4, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 4/192.168.0.44/4/29.105.24.184/0; ]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.097 [topo_info_extractor.cc:585] [618982][Set][TopoInfoForLevel1] topoType_[8] ringSize[8]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.766.101 [topo_info_extractor.cc:685] [618987]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 5, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 5/192.168.0.44/5/29.105.72.114/0; ]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.766.121 [topo_info_extractor.cc:685] [618987]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 6, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 6/192.168.0.44/6/29.105.134.38/0; ]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.766.137 [topo_info_extractor.cc:685] [618987]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 7, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 7/192.168.0.44/7/29.105.73.96/0; ]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.122 [topo_info_extractor.cc:646] [618982][Set][TopoInfoForLevel1] calc subGroup superPodId[] subIndex[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.152 [topo_info_extractor.cc:685] [618982]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 0, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 0/192.168.0.44/0/192.168.100.101/0; ]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.766.151 [topo_info_extractor.cc:689] [618987]SetTopoInfoForLevel1: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[1], userRankSize[8], plane size[8]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.173 [topo_info_extractor.cc:685] [618982]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 1, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 1/192.168.0.44/1/29.105.19.202/0; ]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.193 [topo_info_extractor.cc:685] [618982]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 2, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 2/192.168.0.44/2/29.105.165.16/0; ]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.766.190 [topo_info_extractor.cc:790] [618987]SetTopoInfoForMeshL1: topoRankInfo[userRank/devicePhyId1/1; ]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.210 [topo_info_extractor.cc:685] [618982]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 3, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 3/192.168.0.44/3/29.105.51.138/1; ]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.766.215 [topo_info_extractor.cc:519] [618987]plane info:topo type[8], device type[2], COMM_COMBINE size[1], COMM_LEVEL0 size[7], COMM_LEVEL1 size[8], COMM_LEVEL2 size[1], COMM_MESH_L0 size[1], COMM_MESH_L1 size[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.229 [topo_info_extractor.cc:685] [618982]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 4, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 4/192.168.0.44/4/29.105.24.184/0; ]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.247 [topo_info_extractor.cc:685] [618982]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 5, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 5/192.168.0.44/5/29.105.72.114/0; ]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.264 [topo_info_extractor.cc:685] [618982]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 6, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 6/192.168.0.44/6/29.105.134.38/0; ]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.280 [topo_info_extractor.cc:685] [618982]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 7, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 7/192.168.0.44/7/29.105.73.96/0; ]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.295 [topo_info_extractor.cc:689] [618982]SetTopoInfoForLevel1: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[3], userRankSize[8], plane size[8]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.308 [topo_info_extractor.cc:697] [618982][Set][TopoInfoForLevel2] select origin proc
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.325 [topo_info_extractor.cc:734] [618982]SetTopoInfoForLevel2: topoRankInfo[userRank/devicePhyId/serverIdx/superPodId: 3/3/0/; ]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.340 [topo_info_extractor.cc:739] [618982]SetTopoInfoForLevel2: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[3], userRankSize[8], plane size[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.354 [topo_info_extractor.cc:585] [618982][Set][TopoInfoForLevel1] topoType_[8] ringSize[8]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.766.353 [api_impl.cc:1990] 618987 DevMalloc: size=32, type=16, moduleId=3.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.371 [topo_info_extractor.cc:646] [618982][Set][TopoInfoForLevel1] calc subGroup superPodId[] subIndex[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.389 [topo_info_extractor.cc:685] [618982]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 0, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 0/192.168.0.44/0/192.168.100.101/0; ]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.766.385 [api_error.cc:1218] 618987 DevMalloc: device malloc Succ, size=32, type=16, moduleId=3, start ptr=0x12c280003000, end ptr=0x12c280003020
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.407 [topo_info_extractor.cc:685] [618982]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 1, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 1/192.168.0.44/1/29.105.19.202/0; ]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.427 [topo_info_extractor.cc:685] [618982]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 2, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 2/192.168.0.44/2/29.105.165.16/0; ]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.447 [topo_info_extractor.cc:685] [618982]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 3, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 3/192.168.0.44/3/29.105.51.138/1; ]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.766.450 [hccl_impl.cc:59] [618987]start hccl resources build:get deviceLogicId[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.466 [topo_info_extractor.cc:685] [618982]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 4, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 4/192.168.0.44/4/29.105.24.184/0; ]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.492 [topo_info_extractor.cc:685] [618982]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 5, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 5/192.168.0.44/5/29.105.72.114/0; ]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.509 [topo_info_extractor.cc:685] [618982]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 6, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 6/192.168.0.44/6/29.105.134.38/0; ]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.527 [topo_info_extractor.cc:685] [618982]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 7, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 7/192.168.0.44/7/29.105.73.96/0; ]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.544 [topo_info_extractor.cc:689] [618982]SetTopoInfoForLevel1: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[3], userRankSize[8], plane size[8]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.578 [topo_info_extractor.cc:790] [618982]SetTopoInfoForMeshL1: topoRankInfo[userRank/devicePhyId3/3; ]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.766.583 [hccl_impl.cc:177] [618987]hcclImpl init success.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.603 [topo_info_extractor.cc:519] [618982]plane info:topo type[8], device type[2], COMM_COMBINE size[1], COMM_LEVEL0 size[7], COMM_LEVEL1 size[8], COMM_LEVEL2 size[1], COMM_MESH_L0 size[1], COMM_MESH_L1 size[1]
[WARNING] HCCL(618650,python3.9):2025-04-03-09:27:47.766.617 [hccl_aiv.cc:279] [618987][AIV][GetAivOpBinaryPath]ENV:LD_LIBRARY_PATH lack fwkacllib/lib64
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.766.734 [api_impl.cc:1990] 618982 DevMalloc: size=32, type=16, moduleId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.766.763 [api_error.cc:1218] 618982 DevMalloc: device malloc Succ, size=32, type=16, moduleId=3, start ptr=0x12c280003000, end ptr=0x12c280003020
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.810 [hccl_impl.cc:59] [618982]start hccl resources build:get deviceLogicId[3]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.766.932 [hccl_impl.cc:177] [618982]hcclImpl init success.
[WARNING] HCCL(618658,python3.9):2025-04-03-09:27:47.766.966 [hccl_aiv.cc:279] [618982][AIV][GetAivOpBinaryPath]ENV:LD_LIBRARY_PATH lack fwkacllib/lib64
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.767.498 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.767.572 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.767.685 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.767.705 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_float.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.767.724 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_reduce_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.767.749 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.767.774 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.767.872 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.767.889 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_half.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.767.902 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_reduce_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.767.923 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.767.946 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.046 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.063 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_int16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.078 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_reduce_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.097 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.120 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.226 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.244 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_int32_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.261 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_reduce_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.277 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.300 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.392 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.408 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_int8_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.427 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_reduce_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.442 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.465 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.568 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.584 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_bfloat16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.597 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_reduce_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.614 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.637 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.731 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.747 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_half.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.762 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_vc_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.779 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.802 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.893 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.909 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_int16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.924 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_vc_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.942 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.768.965 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.056 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.073 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_uint16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.089 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_vc_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.104 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.128 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.221 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.237 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_float.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.251 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_vc_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.266 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.288 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.383 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.400 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_int32_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.423 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_vc_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.437 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.460 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] TDT(618666,python3.9):2025-04-03-09:27:47.769.481 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618983] [ServerToClientMsgProc] [sessionID=1]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.769.487 [runtime.cc:3077] 618806 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=5, devId=5, tdt status=0
[INFO] TDT(618666,python3.9):2025-04-03-09:27:47.769.502 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618983] [TsdClient] DeviceMsgProc recvMsg realDeviceId[5] msgType[49] localDevId[5] rspCode[0]heterogeneousSubPid[30114], tsdSupportLevel_[63]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:47.769.516 [hdc_client.cpp:172][TsdRecvData][tid:618983] [deviceId=5] the Tsd recv data already
[INFO] TDT(618666,python3.9):2025-04-03-09:27:47.769.530 [process_mode_manager.cpp:1461][ProcessOpenSubProc][tid:618983] OpenSubProc success stype:0, pid:30114
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.769.544 [adapter_tdt.cc:39] [618983]Open TsdProcess success. deviceLogicId[5]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.552 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.769.556 [network_manager.cc:118] [618983][TsdProcessOpen]hrtTsdProcessOpen success, subPid[30114], devicePhyId_[5], deviceLogicId_[5], hasBackup[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.769.572 [network_manager.cc:180] [618983][NetworkManager][Init]open tsd by process success, devicePhyId[5], deviceLogicId_[5].
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.568 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_uint32_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.769.579 [npu_driver.cc:551] 618806 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.587 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_vc_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.603 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.769.596 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.623 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:47.769.647 [ra_host.c:205]tid:618983,ra_init(205) : Input parameters: phy_id[5], nic_position:[1] hdc_type:[18]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.769.667 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.717 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.733 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_int8_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.747 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_vc_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] ROCE(618666,python3.9):2025-04-03-09:27:47.769.742 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] DRV(618666,python3.9):2025-04-03-09:27:47.769.764 [devdrv_hccl.c:103][ascend][curpid:618666,618983][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618666)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.762 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.769.776 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.785 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.769.799 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_float.
[INFO] ROCE(618666,python3.9):2025-04-03-09:27:47.769.806 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:47.769.822 [ra_hdc.c:580]tid:618983,ra_hdc_init(580) : hdc init start! logic id is 5, phy id is 5, hdc_type is 18
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.769.819 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_reduce_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.769.844 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.769.870 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.884 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.901 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_uint8_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.917 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_vc_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.934 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.769.957 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.769.971 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.769.989 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_half.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.769.977 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.770.009 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_reduce_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.770.029 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] DRV(618666,python3.9):2025-04-03-09:27:47.770.020 [hdc_core.c:1982][ascend][curpid:618666,618983][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4199; pid=618666)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.770.050 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.770.035 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.052 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.069 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_bfloat16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.084 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_vc_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.099 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.121 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.770.144 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.770.153 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.770.164 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_float.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.770.171 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_int16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.770.182 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_reduce_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.770.188 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_reduce_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.770.210 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.215 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.770.208 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.231 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_half.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.770.233 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.770.235 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.247 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_v_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.274 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:47.770.288 [ra_hdc.c:616]tid:618983,ra_hdc_init(616) : hdc init OK! phy_id[5]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.295 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.770.333 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.770.333 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.770.351 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_half.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.770.352 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_int32_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.770.370 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_reduce_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.770.368 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_reduce_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.770.387 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.770.387 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.392 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.409 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_int16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.424 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_v_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.770.412 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.770.411 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.439 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.461 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.770.511 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.770.511 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.770.531 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_int8_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.770.547 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_reduce_int8_t, dfxAddr=0, dfxSize=0, [INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.770.528 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_int16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.770.557 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_reduce_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.558 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.573 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_uint16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.770.580 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.770.577 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.591 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_v_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.770.603 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.770.601 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] TDT(618654,python3.9):2025-04-03-09:27:47.770.587 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618988] [ServerToClientMsgProc] [sessionID=1]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.770.589 [runtime.cc:3077] 618830 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=2, devId=2, tdt status=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.609 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.629 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] TDT(618654,python3.9):2025-04-03-09:27:47.770.624 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618988] [TsdClient] DeviceMsgProc recvMsg realDeviceId[2] msgType[49] localDevId[2] rspCode[0]heterogeneousSubPid[5116], tsdSupportLevel_[63]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:47.770.646 [hdc_client.cpp:172][TsdRecvData][tid:618988] [deviceId=2] the Tsd recv data already
[INFO] TDT(618654,python3.9):2025-04-03-09:27:47.770.658 [process_mode_manager.cpp:1461][ProcessOpenSubProc][tid:618988] OpenSubProc success stype:0, pid:5116
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.770.674 [adapter_tdt.cc:39] [618988]Open TsdProcess success. deviceLogicId[2]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.770.695 [network_manager.cc:118] [618988][TsdProcessOpen]hrtTsdProcessOpen success, subPid[5116], devicePhyId_[2], deviceLogicId_[2], hasBackup[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.770.695 [npu_driver.cc:551] 618830 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.770.710 [network_manager.cc:180] [618988][NetworkManager][Init]open tsd by process success, devicePhyId[2], deviceLogicId_[2].
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.770.698 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.770.702 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.770.715 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_int32_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.770.731 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_reduce_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.721 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.770.720 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_bfloat16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.770.738 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_reduce_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.738 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_float.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.753 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_v_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.770.756 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.770.747 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:47.770.765 [ra_host.c:205]tid:618988,ra_init(205) : Input parameters: phy_id[2], nic_position:[1] hdc_type:[18]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.770.770 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.769 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.770.777 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.792 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] ROCE(618654,python3.9):2025-04-03-09:27:47.770.855 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.770.862 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.770.879 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_int8_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.770.877 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] DRV(618654,python3.9):2025-04-03-09:27:47.770.876 [devdrv_hccl.c:103][ascend][curpid:618654,618988][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618654)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.885 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.770.895 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_reduce_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.770.896 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_half.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.770.913 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_vc_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.901 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_int32_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.916 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_v_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] ROCE(618654,python3.9):2025-04-03-09:27:47.770.918 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.770.915 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.770.937 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.770.929 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.933 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.770.953 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:47.770.937 [ra_hdc.c:580]tid:618988,ra_hdc_init(580) : hdc init start! logic id is 2, phy id is 2, hdc_type is 18
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.770.949 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.029 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.042 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.045 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_bfloat16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.046 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.059 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_int16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.062 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_reduce_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.080 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.063 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_uint32_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.080 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_v_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.077 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_vc_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.095 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.101 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.094 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.123 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.115 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] DRV(618654,python3.9):2025-04-03-09:27:47.771.137 [hdc_core.c:1982][ascend][curpid:618654,618988][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4200; pid=618654)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.194 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.211 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_half.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.224 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_vc_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.217 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.224 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.240 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_int8_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.235 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_uint16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.242 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.258 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_v_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.255 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_vc_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.265 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.273 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.274 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.294 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.297 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.354 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.370 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_int16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.383 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_vc_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.387 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.411 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.392 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.404 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_uint8_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.410 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_float.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.428 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_vc_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:47.771.420 [ra_hdc.c:616]tid:618988,ra_hdc_init(616) : hdc init OK! phy_id[2]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.420 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_v_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.437 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.435 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.442 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.458 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.467 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.529 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.545 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_uint16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.558 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_vc_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.552 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.569 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_bfloat16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.573 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.574 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.586 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_v_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.593 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_int32_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.610 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_vc_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.598 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.604 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.627 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.624 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.647 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.692 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.708 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_float.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.721 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_vc_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.716 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.733 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_half.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.735 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.740 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.758 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_uint32_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.748 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.760 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.768 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.776 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_vc_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.788 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.795 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.819 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.852 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.868 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_int32_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.880 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_vc_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.886 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.895 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.902 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_int16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.915 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.917 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.771.918 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.932 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_int8_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.947 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_vc_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.937 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.771.958 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.961 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.771.983 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.011 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.027 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_uint32_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.040 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_vc_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.055 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.051 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.075 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_uint16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.092 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.078 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.772.076 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.772.095 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_uint8_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.772.113 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_vc_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.108 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.130 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.772.128 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.772.153 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.180 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.199 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_int8_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.217 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_vc_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.232 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.239 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.260 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_float.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.265 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.279 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.772.267 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.296 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.772.288 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_bfloat16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.772.304 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_vc_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.772.322 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.319 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.772.343 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.356 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.373 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_uint8_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.389 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_vc_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.408 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.418 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.431 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.434 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_int32_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.451 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.772.439 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.772.466 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_half.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.467 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.772.484 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_v_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.491 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.772.501 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.525 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.772.523 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.542 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_bfloat16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.555 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_vc_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.569 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.587 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.589 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.605 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_uint32_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.620 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.772.620 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.640 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.772.640 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_int16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.663 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.772.657 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_v_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.772.674 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.681 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.772.693 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.699 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_half.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.714 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_v_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.728 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.751 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.758 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.775 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_int8_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.792 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.772.789 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.809 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.772.806 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_uint16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.772.822 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_v_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.832 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.772.838 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.845 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.772.858 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.861 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_int16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.876 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_v_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.890 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.772.911 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.927 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.772.950 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.944 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_uint8_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.971 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.772.967 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_float.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.772.988 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.772.984 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_v_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.773.000 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.001 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.773.010 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.773.021 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.018 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_uint16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.032 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_v_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.047 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.067 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.773.111 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.773.117 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.773.128 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_bfloat16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.773.135 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_int32_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.773.144 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.773.161 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.773.153 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_v_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.773.169 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.157 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.182 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_float.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.773.181 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.197 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_v_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.773.190 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.215 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.237 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.773.275 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.773.289 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.773.292 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_half.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:47.773.255 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618984] [ServerToClientMsgProc] [sessionID=1]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.773.258 [runtime.cc:3077] 618814 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=4, devId=4, tdt status=0
[INFO] TDT(618662,python3.9):2025-04-03-09:27:47.773.286 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618984] [TsdClient] DeviceMsgProc recvMsg realDeviceId[4] msgType[49] localDevId[4] rspCode[0]heterogeneousSubPid[29706], tsdSupportLevel_[63]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:47.773.301 [hdc_client.cpp:172][TsdRecvData][tid:618984] [deviceId=4] the Tsd recv data already
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.773.305 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_uint32_t.
[INFO] RUNTIME(618650,python3.9):2025[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.773.308 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.773.325 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] TDT(618662,python3.9):2025-04-03-09:27:47.773.319 [process_mode_manager.cpp:1461][ProcessOpenSubProc][tid:618984] OpenSubProc success stype:0, pid:29706
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.773.333 [adapter_tdt.cc:39] [618984]Open TsdProcess success. deviceLogicId[4]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.773.339 [npu_driver.cc:551] 618814 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
-04-03-09:27:47.773.320 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_v_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.773.346 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.336 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.773.345 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.773.344 [network_manager.cc:118] [618984][TsdProcessOpen]hrtTsdProcessOpen success, subPid[29706], devicePhyId_[4], deviceLogicId_[4], hasBackup[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.773.374 [network_manager.cc:180] [618984][NetworkManager][Init]open tsd by process success, devicePhyId[4], deviceLogicId_[4].
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.773.369 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.352 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_int32_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.368 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_v_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.383 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.400 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:47.773.427 [ra_host.c:205]tid:618984,ra_init(205) : Input parameters: phy_id[4], nic_position:[1] hdc_type:[18]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.773.439 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.773.456 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_int16_t.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:47.773.426 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618985] [ServerToClientMsgProc] [sessionID=1]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.773.431 [runtime.cc:3077] 618812 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=7, devId=7, tdt status=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.773.463 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.773.471 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] TDT(618674,python3.9):2025-04-03-09:27:47.773.458 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618985] [TsdClient] DeviceMsgProc recvMsg realDeviceId[7] msgType[49] localDevId[7] rspCode[0]heterogeneousSubPid[29983], tsdSupportLevel_[63]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.773.481 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_int8_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.773.496 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_v_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.773.490 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.492 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] TDT(618674,python3.9):2025-04-03-09:27:47.773.493 [hdc_client.cpp:172][TsdRecvData][tid:618985] [deviceId=7] the Tsd recv data already
[INFO] TDT(618674,python3.9):2025-04-03-09:27:47.773.508 [process_mode_manager.cpp:1461][ProcessOpenSubProc][tid:618985] OpenSubProc success stype:0, pid:29983
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.773.513 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.773.510 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] ROCE(618662,python3.9):2025-04-03-09:27:47.773.518 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.510 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_uint32_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.527 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_v_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.773.517 [npu_driver.cc:551] 618812 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.773.521 [adapter_tdt.cc:39] [618985]Open TsdProcess success. deviceLogicId[7]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.773.547 [network_manager.cc:118] [618985][TsdProcessOpen]hrtTsdProcessOpen success, subPid[29983], devicePhyId_[7], deviceLogicId_[7], hasBackup[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.773.534 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] DRV(618662,python3.9):2025-04-03-09:27:47.773.542 [devdrv_hccl.c:103][ascend][curpid:618662,618984][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618662)
[INFO] ROCE(618662,python3.9):2025-04-03-09:27:47.773.579 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.541 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.561 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.773.562 [network_manager.cc:180] [618985][NetworkManager][Init]open tsd by process success, devicePhyId[7], deviceLogicId_[7].
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:47.773.593 [ra_hdc.c:580]tid:618984,ra_hdc_init(580) : hdc init start! logic id is 4, phy id is 4, hdc_type is 18
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.773.603 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.773.619 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_uint16_t.
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:47.773.613 [ra_host.c:205]tid:618985,ra_init(205) : Input parameters: phy_id[7], nic_position:[1] hdc_type:[18]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.773.627 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.773.635 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.773.645 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_uint8_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.649 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.773.653 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.667 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_int8_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.681 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_v_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.773.661 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_v_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.773.674 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.773.687 [adapter_hccp.cc:583] [618983]init ra success.
[INFO] ROCE(618674,python3.9):2025-04-03-09:27:47.773.691 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.697 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.773.678 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.773.699 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.773.703 [network_manager.cc:222] [618983]NetworkManager nicDeploy[1] deviceLogicId_[5] devicePhyId_[5] init ra OK, nicSocketMap size[0], isHostUseDevNic[1]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.773.721 [hccl_communicator_attrs.cc:1307] [618983][HcclCommunicator]IsSupportEnableRoce
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.773.734 [hccl_communicator_attrs.cc:1275] [618983]IsEnableRoce ret: 0, interServer_: 0, isInterServerVnic: 0, roceSwitch: 0, isSingleMeshAggregation_: 1
[INFO] DRV(618674,python3.9):2025-04-03-09:27:47.773.712 [devdrv_hccl.c:103][ascend][curpid:618674,618985][drv][devmng][drvGetProcessSign]Process sign list add success.(tgid=618674)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.723 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.773.751 [hccl_communicator.cc:2259] [618983][HcclCommunicator][GetLocalNicPort] nicType[0], devicePortSwitchOn[0], isUseRankPort[1], get port[16666], devId[5]
[INFO] ROCE(618674,python3.9):2025-04-03-09:27:47.773.748 [dl_hal_function.c:233]dl_hal_init(233) : dl_hal_init success!
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:47.773.763 [ra_hdc.c:580]tid:618985,ra_hdc_init(580) : hdc init start! logic id is 7, phy id is 7, hdc_type is 18
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.773.776 [adapter_hccp.cc:1650] [618983]hrtRaGetInterfaceVersion phyId[0], opCode[55], version[1]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.773.769 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] DRV(618662,python3.9):2025-04-03-09:27:47.773.785 [hdc_core.c:1982][ascend][curpid:618662,618984][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4201; pid=618662)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.773.795 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.773.786 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_float.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.773.802 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.773.813 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_bfloat16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.816 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.773.828 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.773.833 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_v_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.834 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_uint8_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.849 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_v_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.773.849 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.773.855 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.866 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.773.881 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.886 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.773.947 [adapter_hccp.cc:2343] [618983]Get available Vnic info success, deviceIdType[0] deviceId[0x5] Vnic ip[192.168.2.194]
[INFO] DRV(618674,python3.9):2025-04-03-09:27:47.773.963 [hdc_core.c:1982][ascend][curpid:618674,618985][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4202; pid=618674)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.773.973 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.977 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.773.978 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.773.991 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_int32_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.773.994 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_bfloat16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.774.021 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_v_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.773.997 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_half.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.774.014 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.008 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.024 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.774.033 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.773.993 [network_manager.cc:69] [618983]NetworkManager::GetInstance deviceLogicID[5].
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:47.774.012 [ra_host.c:280]tid:618983,ra_socket_init(280) : socket init:mode=1 phy_id=5 family=2 ip=192.168.2.194
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.774.028 [adapter_hccp.cc:806] [618983]socket init success, ip[3254954176] device id[5], socketHandle[0xfffe880ff5b0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.774.040 [network_manager.cc:692] [618983]devicePhyId[5], ip[192.168.2.194] socket init OK
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.044 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.774.040 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.774.055 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.774.051 [network_manager.cc:432] [618983][Start][Vnic]trying to listen on ip[192.168.2.194] port[16666].
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:47.774.067 [ra_host.c:875]tid:618983,ra_socket_listen_start(875) : Input parameters: [0]th, phy_id[5], local_ip[192.168.2.194], port[16666]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.774.064 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:47.774.076 [ra_hdc.c:616]tid:618984,ra_hdc_init(616) : hdc init OK! phy_id[4]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.139 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.774.150 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.155 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_uint32_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.774.156 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.774.168 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_int16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.171 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.188 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.774.175 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_half.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.774.189 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.209 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.774.203 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.774.184 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.774.200 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.774.224 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:47.774.232 [ra_hdc.c:616]tid:618985,ra_hdc_init(616) : hdc init OK! phy_id[7]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.774.236 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.304 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.774.316 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.321 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_int8_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.774.331 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.337 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.774.334 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_int16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.355 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.774.348 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_uint16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.774.364 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.774.352 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.774.369 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.376 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.774.380 [network_manager.cc:448] [618983][Start][Vnic]Listen on ip[192.168.2.194], port[16666] sucess, devPhyId[5], devLogicId[5], isAutoPort[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.774.381 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.774.404 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.774.389 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.774.399 [network_manager.cc:451] [618983]NetworkManager devicePhyId_[5] port[16666] start vnic OK. refCount[1]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.774.413 [network_manager.cc:69] [618983]NetworkManager::GetInstance deviceLogicID[5].
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.774.425 [hccl_socket.cc:106] [618983][HcclSocket][Listen] device[5] listens on ip[192.168.2.194] port[16666] success, socketType[0].
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.774.439 [hccl_socket_manager.cc:56] [618983][Init][Server]ip[192.168.2.194] port[16666]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.774.455 [hccl_communicator.cc:1548] [618983][HcclCommunicator][InitRaResource] init vnic with ip[192.168.2.194] port[16666] success
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.774.468 [hccl_communicator_attrs.cc:1307] [618983][HcclCommunicator]IsSupportEnableRoce
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.774.477 [hccl_communicator_attrs.cc:1275] [618983]IsEnableRoce ret: 0, interServer_: 0, isInterServerVnic: 0, roceSwitch: 0, isSingleMeshAggregation_: 1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.474 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.774.478 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.774.494 [hccl_communicator.cc:1565] [618983]isUsedRdmaLevel0_[0] nicNum[1] hostIP[192.168.0.44], nicDeployment[1].
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.492 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_uint8_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.506 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.774.498 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_uint16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.774.496 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.774.509 [network_manager.cc:69] [618983]NetworkManager::GetInstance deviceLogicID[5].
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.774.514 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.522 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.774.515 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_float.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.774.532 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.774.523 [hccl_communicator.cc:2028] [618983]profiling config information:options[], mode[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.774.531 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.774.553 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.545 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.774.551 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.774.573 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.640 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.774.642 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.657 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_bfloat16_t.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.774.657 [adapter_trace.cc:21] [618983]Call TraceCreate, return value[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.774.663 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_float.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.774.665 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.673 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_to_all_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.774.679 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:47.774.681 [atrace_api.c:61](tid:618983) AtraceCreateWithAttr start.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.774.684 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_int32_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.774.700 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.691 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.774.697 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.774.717 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.774.718 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.712 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.774.738 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:47.774.770 [trace_rb_log.c:45](tid:618983) init ring buffer time finished, realTime 1743643667774764349, monotonicTime 4163698540374, freq 99977 kHz, minutesWest 480 minutes
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:47.774.787 [trace_rb_log.c:137](tid:618983) [HCCL_618983_5] create ring buffer success, msgSize 128 bytes, msgTxtSize 112 bytes, bufferSize 1024 bytes, msg space 128 bytes, total space 131568 bytes
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:47.774.802 [tracer_mgr_operate.c:66](tid:618983) create object HCCL_618983_5 success, exitSave(true), noLock(false).
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:47.774.812 [atrace_api.c:63](tid:618983) AtraceCreateWithAttr end.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.774.821 [adapter_trace.cc:70] [618983]Call TraceCreateWithAttr, return value[0xaaaae62b46b8], Params: objName[HCCL_618983_5]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.815 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.774.812 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.832 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_float.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.774.831 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.774.831 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_int32_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.774.849 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.774.849 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_uint32_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.848 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_reduce_scatter_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.774.856 [rank_consistentcy_checker.cc:32] [618983][GetInstance] get deviceLogicId[5]
[INFO] RUNTIME(618658[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.774.866 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.868 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
,python3.9):2025-04-03-09:27:47.774.866 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.774.895 [api_impl.cc:1486] 618983 GetMaxStreamAndTask: maxTaskNum:2013, maxStrCount:2016.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.774.884 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.774.906 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.890 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.774.902 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.774.919 [npu_driver.cc:4604] 618983 GetMaxStreamAndTask: deviceId=5, tsId=0, streamCount=1984.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.774.932 [task_exception_handler.cc:1212] [618983]get from RTS the max stream count[1984] the max task count[65535]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.774.950 [hccl_communicator_attrs.cc:1099] [618983][Set][HcclCommunicatorAttrs][MeshAggregationRankSize]set MeshAggregationRankSize[8].
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.774.988 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.774.991 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.009 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_uint32_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.775.002 [api_impl.cc:4219] 618983 RegProfCtrlCallback: Reg profiling callback, moduleId=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.000 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.004 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_half.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.024 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.775.022 [command_handle.cc:25] [618983][Profiling][CommandHandle] CommandHandle's rtType is 2.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.775.035 [command_handle.cc:99] [618983][Check][Param]SetMsprofReporterCallback.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.041 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.061 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.018 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_int8_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.035 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.050 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.023 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_reduce_scatter_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.040 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.059 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.072 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.775.120 [profiler_manager_impl.cc:76] [618983][ProfilerManager][InitProfiler]Register CtrlCallBack success
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.775.137 [hccl_communicator.cc:2193] [618983][BASE][InitProfiler]Register CtrlCallBack success.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.775.148 [hccl_communicator.cc:803] [618983]Will use ffts mode.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.154 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.157 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.775.172 [api_impl.cc:3138] 618983 GetDeviceIndexByPhyId: get Index by PhyId=5.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.173 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.174 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_int16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.191 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_reduce_scatter_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.172 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_int8_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.775.190 [api_impl.cc:3149] 618983 GetDeviceIndexByPhyId: GetDeviceIndexByPhyId, device_mode=0, phyId=5
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.192 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_uint8_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.206 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.192 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.209 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.775.202 [api_impl.cc:3157] 618983 GetDeviceIndexByPhyId: cloud v2, device_mode=0, device_id=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.775.213 [runtime.cc:5239] 618983 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.209 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.226 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.244 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.227 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.228 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.319 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.325 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.337 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_uint8_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.341 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_int32_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.341 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.352 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.357 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_reduce_scatter_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.361 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_bfloat16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.377 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.372 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.376 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.395 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.392 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.399 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.416 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.775.456 [adapter_hccp.cc:583] [618988]init ra success.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.775.474 [network_manager.cc:222] [618988]NetworkManager nicDeploy[1] deviceLogicId_[2] devicePhyId_[2] init ra OK, nicSocketMap size[0], isHostUseDevNic[1]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.484 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.492 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.775.495 [hccl_communicator_attrs.cc:1307] [618988][HcclCommunicator]IsSupportEnableRoce
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.501 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_bfloat16_t.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.775.509 [hccl_communicator_attrs.cc:1275] [618988]IsEnableRoce ret: 0, interServer_: 0, isInterServerVnic: 0, roceSwitch: 0, isSingleMeshAggregation_: 1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.509 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.508 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_int8_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.527 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_reduce_scatter_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.520 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.529 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_half.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.545 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.775.533 [hccl_communicator.cc:2259] [618988][HcclCommunicator][GetLocalNicPort] nicType[0], devicePortSwitchOn[0], isUseRankPort[1], get port[16666], devId[2]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.543 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.541 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.562 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.563 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.775.561 [adapter_hccp.cc:1650] [618988]hrtRaGetInterfaceVersion phyId[0], opCode[55], version[1]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.565 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.586 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.651 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.660 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.668 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_half.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.678 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.683 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.676 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_bfloat16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.703 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_reduce_scatter_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.697 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_int16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.703 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.720 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.713 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.731 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.725 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.739 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.775.746 [adapter_hccp.cc:2343] [618988]Get available Vnic info success, deviceIdType[0] deviceId[0x2] Vnic ip[192.168.2.197]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.750 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.775.791 [network_manager.cc:69] [618988]NetworkManager::GetInstance deviceLogicID[2].
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.828 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.836 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:47.775.811 [ra_host.c:280]tid:618988,ra_socket_init(280) : socket init:mode=1 phy_id=2 family=2 ip=192.168.2.197
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.775.847 [adapter_hccp.cc:806] [618988]socket init success, ip[3305285824] device id[2], socketHandle[0xfffe880ff5b0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.842 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.846 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_int16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.853 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_float.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.775.864 [network_manager.cc:692] [618988]devicePhyId[2], ip[192.168.2.197] socket init OK
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.859 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_uint16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.874 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.863 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.881 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.868 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.884 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.775.879 [network_manager.cc:432] [618988][Start][Vnic]trying to listen on ip[192.168.2.197] port[16666].
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:47.775.898 [ra_host.c:875]tid:618988,ra_socket_listen_start(875) : Input parameters: [0]th, phy_id[2], local_ip[192.168.2.197], port[16666]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.888 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.775.909 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.901 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.904 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.775.993 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.775.996 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.003 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.011 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_uint16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.013 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_half.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.028 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.027 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.043 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.021 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_float.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.045 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.048 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.066 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.065 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.063 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.088 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.165 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.184 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_float.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.179 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.197 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_int16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.201 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.219 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.213 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.203 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.227 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_int32_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.233 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.241 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.776.225 [network_manager.cc:448] [618988][Start][Vnic]Listen on ip[192.168.2.197], port[16666] sucess, devPhyId[2], devLogicId[2], isAutoPort[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.776.247 [network_manager.cc:451] [618988]NetworkManager devicePhyId_[2] port[16666] start vnic OK. refCount[1]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.245 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.261 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.255 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.776.268 [network_manager.cc:69] [618988]NetworkManager::GetInstance deviceLogicID[2].
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.776.281 [hccl_socket.cc:106] [618988][HcclSocket][Listen] device[2] listens on ip[192.168.2.197] port[16666] success, socketType[0].
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.283 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.776.296 [hccl_socket_manager.cc:56] [618988][Init][Server]ip[192.168.2.197] port[16666]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.776.315 [hccl_communicator.cc:1548] [618988][HcclCommunicator][InitRaResource] init vnic with ip[192.168.2.197] port[16666] success
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.776.331 [hccl_communicator_attrs.cc:1307] [618988][HcclCommunicator]IsSupportEnableRoce
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.776.342 [hccl_communicator_attrs.cc:1275] [618988]IsEnableRoce ret: 0, interServer_: 0, isInterServerVnic: 0, roceSwitch: 0, isSingleMeshAggregation_: 1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.334 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.353 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_int32_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.350 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.776.357 [hccl_communicator.cc:1565] [618988]isUsedRdmaLevel0_[0] nicNum[1] hostIP[192.168.0.44], nicDeployment[1].
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.776.374 [network_manager.cc:69] [618988]NetworkManager::GetInstance deviceLogicID[2].
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.368 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_int32_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.368 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.376 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.383 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.389 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.776.390 [hccl_communicator.cc:2028] [618988]profiling config information:options[], mode[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.393 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_uint32_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.408 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.403 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.415 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.426 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.445 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.424 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.510 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.527 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_uint32_t.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.776.518 [adapter_trace.cc:21] [618988]Call TraceCreate, return value[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.520 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.542 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.542 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:47.776.542 [atrace_api.c:61](tid:618988) AtraceCreateWithAttr start.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.538 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_int8_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.552 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.561 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_int8_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.563 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.585 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.575 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.596 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.577 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.595 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.776.595 [api_impl.cc:3476] 618983 GetDeviceInfo: get device info, deviceId=5
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.615 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:47.776.617 [trace_rb_log.c:45](tid:618988) init ring buffer time finished, realTime 1743643667776608996, monotonicTime 4163698724839, freq 99991 kHz, minutesWest 480 minutes
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:47.776.637 [trace_rb_log.c:137](tid:618988) [HCCL_618988_2] create ring buffer success, msgSize 128 bytes, msgTxtSize 112 bytes, bufferSize 1024 bytes, msg space 128 bytes, total space 131568 bytes
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:47.776.656 [tracer_mgr_operate.c:66](tid:618988) create object HCCL_618988_2 success, exitSave(true), noLock(false).
[WARNING] HCCL(618666,python3.9):2025-04-03-09:27:47.776.652 [tbe_vector_reduce.cc:508] [618983]ENV:LD_LIBRARY_PATH lack fwkacllib/lib64
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:47.776.669 [atrace_api.c:63](tid:618988) AtraceCreateWithAttr end.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.776.683 [adapter_trace.cc:70] [618988]Call TraceCreateWithAttr, return value[0xaaaae450a6b8], Params: objName[HCCL_618988_2]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.675 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.693 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.710 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_bfloat16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.694 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_int8_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.719 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.719 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.726 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.776.725 [rank_consistentcy_checker.cc:32] [618988][GetInstance] get deviceLogicId[2]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.738 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_uint8_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.741 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.745 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.776.757 [api_impl.cc:1486] 618988 GetMaxStreamAndTask: maxTaskNum:2013, maxStrCount:2016.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.753 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.770 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.764 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.765 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.776.783 [npu_driver.cc:4604] 618988 GetMaxStreamAndTask: deviceId=2, tsId=0, streamCount=1984.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.791 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.776.798 [task_exception_handler.cc:1212] [618988]get from RTS the max stream count[1984] the max task count[65535]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.776.827 [hccl_communicator_attrs.cc:1099] [618988][Set][HcclCommunicatorAttrs][MeshAggregationRankSize]set MeshAggregationRankSize[8].
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.857 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.862 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.874 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_uint8_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.890 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.878 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_half.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.892 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_gather_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.884 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.776.889 [api_impl.cc:4219] 618988 RegProfCtrlCallback: Reg profiling callback, moduleId=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.903 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_bfloat16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.919 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_to_all_b[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.908 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.910 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.776.914 [command_handle.cc:25] [618988][Profiling][CommandHandle] CommandHandle's rtType is 2.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.776.928 [command_handle.cc:99] [618988][Check][Param]SetMsprofReporterCallback.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.776.934 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
float16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.776.931 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.945 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.776.966 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.022 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.026 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.777.020 [profiler_manager_impl.cc:76] [618988][ProfilerManager][InitProfiler]Register CtrlCallBack success
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.777.040 [hccl_communicator.cc:2193] [618988][BASE][InitProfiler]Register CtrlCallBack success.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.040 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_bfloat16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.044 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_int16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.059 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_gather_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.777.058 [hccl_communicator.cc:803] [618988]Will use ffts mode.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.058 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_to_all_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.057 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.076 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.078 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.098 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.777.084 [api_impl.cc:3138] 618988 GetDeviceIndexByPhyId: get Index by PhyId=2.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.077 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_float.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.094 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_reduce_scatter_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.101 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.777.101 [api_impl.cc:3149] 618988 GetDeviceIndexByPhyId: GetDeviceIndexByPhyId, device_mode=0, phyId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.777.117 [api_impl.cc:3157] 618988 GetDeviceIndexByPhyId: cloud v2, device_mode=0, device_id=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.777.127 [runtime.cc:5239] 618988 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.108 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.129 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.188 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.195 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.205 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_float.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.220 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_reduce_scatter_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.211 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_uint16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.226 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_gather_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.220 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.237 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.239 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_half.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.255 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_reduce_scatter_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.242 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.260 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.270 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.266 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.292 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.356 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.359 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.373 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_half.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.376 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_float.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.392 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_gather_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.388 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_reduce_scatter_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.387 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.405 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.407 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_int16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.408 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.428 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.427 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_reduce_scatter_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.445 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.439 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.466 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.777.478 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.518 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.535 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_int16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.535 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.559 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.553 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_int32_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.571 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_gather_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.552 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_reduce_scatter_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.588 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.576 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_int32_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.610 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.579 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.601 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.592 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_reduce_scatter_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.608 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.629 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.777.635 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.777.654 [dispatcher.cc:157] [618983][GetNotifyMaxWaitTime] notifyMaxWaitTime_ is 2147483647s
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.777.677 [api_impl.cc:3138] 618983 GetDeviceIndexByPhyId: get Index by PhyId=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.777.691 [api_impl.cc:3149] 618983 GetDeviceIndexByPhyId: GetDeviceIndexByPhyId, device_mode=0, phyId=5
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.692 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.777.701 [api_impl.cc:3157] 618983 GetDeviceIndexByPhyId: cloud v2, device_mode=0, device_id=5
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.707 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.710 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_int32_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.777.714 [runtime.cc:5239] 618983 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.723 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_uint32_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.718 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.724 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_reduce_scatter_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.777.737 [api_impl.cc:1990] 618983 DevMalloc: size=4, type=16, moduleId=3.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.739 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_gather_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.737 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_int8_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.754 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_reduce_scatter_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.741 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.763 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.759 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.780 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.770 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.790 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.852 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.868 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_int8_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.881 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_reduce_scatter_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.872 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.890 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_int8_t.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.777.874 [adapter_hccp.cc:583] [618984]init ra success.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.777.897 [network_manager.cc:222] [618984]NetworkManager nicDeploy[1] deviceLogicId_[4] devicePhyId_[4] init ra OK, nicSocketMap size[0], isHostUseDevNic[1]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.894 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.898 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.905 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_gather_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.777.919 [hccl_communicator_attrs.cc:1307] [618984][HcclCommunicator]IsSupportEnableRoce
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.913 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_bfloat16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.929 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_reduce_scatter_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.777.922 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.925 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.777.945 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.777.933 [hccl_communicator_attrs.cc:1275] [618984]IsEnableRoce ret: 0, interServer_: 0, isInterServerVnic: 0, roceSwitch: 0, isSingleMeshAggregation_: 1
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.777.949 [hccl_communicator.cc:2259] [618984][HcclCommunicator][GetLocalNicPort] nicType[0], devicePortSwitchOn[0], isUseRankPort[1], get port[16666], devId[4]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.944 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.777.965 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.777.981 [adapter_hccp.cc:1650] [618984]hrtRaGetInterfaceVersion phyId[0], opCode[55], version[1]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.011 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.029 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_bfloat16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.040 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.043 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_reduce_scatter_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.057 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_uint8_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.061 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.083 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.072 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_gather_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.088 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.059 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.078 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_float.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.095 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.110 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.108 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.131 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.171 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.778.159 [adapter_hccp.cc:2343] [618984]Get available Vnic info success, deviceIdType[0] deviceId[0x4] Vnic ip[192.168.2.195]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.188 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_float.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.778.188 [adapter_hccp.cc:583] [618985]init ra success.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.778.209 [network_manager.cc:222] [618985]NetworkManager nicDeploy[1] deviceLogicId_[7] devicePhyId_[7] init ra OK, nicSocketMap size[0], isHostUseDevNic[1]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.206 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.210 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.778.213 [network_manager.cc:69] [618984]NetworkManager::GetInstance deviceLogicID[4].
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.778.230 [hccl_communicator_attrs.cc:1307] [618985][HcclCommunicator]IsSupportEnableRoce
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.225 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.226 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.227 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_bfloat16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.243 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_gather_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:47.778.232 [ra_host.c:280]tid:618984,ra_socket_init(280) : socket init:mode=1 phy_id=4 family=2 ip=192.168.2.195
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.778.247 [adapter_hccp.cc:806] [618984]socket init success, ip[3271731392] device id[4], socketHandle[0xfffeb00ff5b0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.778.244 [hccl_communicator_attrs.cc:1275] [618985]IsEnableRoce ret: 0, interServer_: 0, isInterServerVnic: 0, roceSwitch: 0, isSingleMeshAggregation_: 1
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.778.261 [hccl_communicator.cc:2259] [618985][HcclCommunicator][GetLocalNicPort] nicType[0], devicePortSwitchOn[0], isUseRankPort[1], get port[16666], devId[7]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.778.259 [network_manager.cc:692] [618984]devicePhyId[4], ip[192.168.2.195] socket init OK
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.778.274 [network_manager.cc:432] [618984][Start][Vnic]trying to listen on ip[192.168.2.195] port[16666].
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:47.778.288 [ra_host.c:875]tid:618984,ra_socket_listen_start(875) : Input parameters: [0]th, phy_id[4], local_ip[192.168.2.195], port[16666]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.243 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_half.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.260 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.249 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.258 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.280 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.778.285 [adapter_hccp.cc:1650] [618985]hrtRaGetInterfaceVersion phyId[0], opCode[55], version[1]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.275 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.295 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.339 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.356 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_half.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.371 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.383 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.374 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.385 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.400 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_int16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.405 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_half.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.421 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_gather_v_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.416 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.417 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.435 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.438 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.454 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.778.458 [adapter_hccp.cc:2343] [618985]Get available Vnic info success, deviceIdType[0] deviceId[0x7] Vnic ip[192.168.2.192]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.459 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.778.500 [network_manager.cc:69] [618985]NetworkManager::GetInstance deviceLogicID[7].
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.514 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:47.778.519 [ra_host.c:280]tid:618985,ra_socket_init(280) : socket init:mode=1 phy_id=7 family=2 ip=192.168.2.192
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.532 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_int16_t.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.778.537 [adapter_hccp.cc:806] [618985]socket init success, ip[3221399744] device id[7], socketHandle[0xfffe840ff5b0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.547 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.548 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.555 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.565 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.567 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_int32_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.583 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.778.552 [network_manager.cc:692] [618985]devicePhyId[7], ip[192.168.2.192] socket init OK
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.778.582 [network_manager.cc:432] [618985][Start][Vnic]trying to listen on ip[192.168.2.192] port[16666].
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.573 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_int16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.588 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_gather_v_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.778.579 [api_error.cc:1218] 618983 DevMalloc: device malloc Succ, size=4, type=16, moduleId=3, start ptr=0x12c280000000, end ptr=0x12c280000004
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.778.577 [api_impl.cc:3476] 618988 GetDeviceInfo: get device info, deviceId=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.589 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.602 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:47.778.601 [ra_host.c:875]tid:618985,ra_socket_listen_start(875) : Input parameters: [0]th, phy_id[7], local_ip[192.168.2.192], port[16666]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.778.592 [network_manager.cc:448] [618984][Start][Vnic]Listen on ip[192.168.2.195], port[16666] sucess, devPhyId[4], devLogicId[4], isAutoPort[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.778.611 [network_manager.cc:451] [618984]NetworkManager devicePhyId_[4] port[16666] start vnic OK. refCount[1]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.604 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.624 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[WARNING] HCCL(618654,python3.9):2025-04-03-09:27:47.778.629 [tbe_vector_reduce.cc:508] [618988]ENV:LD_LIBRARY_PATH lack fwkacllib/lib64
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.778.642 [api_impl.cc:1990] 618983 DevMalloc: size=4, type=16, moduleId=3.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.778.627 [network_manager.cc:69] [618984]NetworkManager::GetInstance deviceLogicID[4].
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.778.639 [hccl_socket.cc:106] [618984][HcclSocket][Listen] device[4] listens on ip[192.168.2.195] port[16666] success, socketType[0].
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.778.652 [hccl_socket_manager.cc:56] [618984][Init][Server]ip[192.168.2.195] port[16666]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.624 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.683 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.778.665 [api_error.cc:1218] 618983 DevMalloc: device malloc Succ, size=4, type=16, moduleId=3, start ptr=0x12c280001000, end ptr=0x12c280001004
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.778.695 [api_impl.cc:1990] 618983 DevMalloc: size=4, type=16, moduleId=3.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.778.667 [hccl_communicator.cc:1548] [618984][HcclCommunicator][InitRaResource] init vnic with ip[192.168.2.195] port[16666] success
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.778.682 [hccl_communicator_attrs.cc:1307] [618984][HcclCommunicator]IsSupportEnableRoce
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.778.693 [hccl_communicator_attrs.cc:1275] [618984]IsEnableRoce ret: 0, interServer_: 0, isInterServerVnic: 0, roceSwitch: 0, isSingleMeshAggregation_: 1
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.778.708 [hccl_communicator.cc:1565] [618984]isUsedRdmaLevel0_[0] nicNum[1] hostIP[192.168.0.44], nicDeployment[1].
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.701 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_int32_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.715 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.778.713 [api_error.cc:1218] 618983 DevMalloc: device malloc Succ, size=4, type=16, moduleId=3, start ptr=0x12c280002000, end ptr=0x12c280002004
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.778.723 [network_manager.cc:69] [618984]NetworkManager::GetInstance deviceLogicID[4].
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.731 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.724 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.752 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.717 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.778.738 [hccl_communicator.cc:2028] [618984]profiling config information:options[], mode[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.778.742 [opexecounter.cc:71] [618983]alloc counter mem resource.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.742 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_uint16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.759 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_gather_v_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.745 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_int8_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.761 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.778.785 [hccl_communicator_attrs.cc:1368] [618983][CollectAlgoAttr]:isUsedRdmaLevel0:[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.777 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.798 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.778 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.800 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.778.838 [alg_configurator.cc:68] [618983][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.841 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.778.861 [alg_configurator.cc:241] [618983][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.860 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_int8_t.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.778.869 [adapter_trace.cc:21] [618984]Call TraceCreate, return value[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.875 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.778.883 [alg_configurator.cc:134] [618983]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.891 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.892 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.778.898 [alg_configurator.cc:68] [618983][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:47.778.893 [atrace_api.c:61](tid:618984) AtraceCreateWithAttr start.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.893 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.908 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_float.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.778.903 [network_manager.cc:448] [618985][Start][Vnic]Listen on ip[192.168.2.192], port[16666] sucess, devPhyId[7], devLogicId[7], isAutoPort[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.778.922 [network_manager.cc:451] [618985]NetworkManager devicePhyId_[7] port[16666] start vnic OK. refCount[1]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.778.911 [alg_configurator.cc:241] [618983][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.778.924 [alg_configurator.cc:134] [618983]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[1]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.778.914 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.913 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_bfloat16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.931 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.945 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.926 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_gather_v_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.943 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.778.938 [network_manager.cc:69] [618985]NetworkManager::GetInstance deviceLogicID[7].
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.778.951 [hccl_socket.cc:106] [618985][HcclSocket][Listen] device[7] listens on ip[192.168.2.192] port[16666] success, socketType[0].
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.778.939 [alg_configurator.cc:68] [618983][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.778.952 [alg_configurator.cc:241] [618983][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:47.778.970 [trace_rb_log.c:45](tid:618984) init ring buffer time finished, realTime 1743643667778963010, monotonicTime 4163698960241, freq 99994 kHz, minutesWest 480 minutes
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.778.967 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.778.964 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.778.966 [hccl_socket_manager.cc:56] [618985][Init][Server]ip[192.168.2.192] port[16666]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.778.985 [hccl_communicator.cc:1548] [618985][HcclCommunicator][InitRaResource] init vnic with ip[192.168.2.192] port[16666] success
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.778.998 [hccl_communicator_attrs.cc:1307] [618985][HcclCommunicator]IsSupportEnableRoce
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.779.009 [hccl_communicator_attrs.cc:1275] [618985]IsEnableRoce ret: 0, interServer_: 0, isInterServerVnic: 0, roceSwitch: 0, isSingleMeshAggregation_: 1
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.778.965 [alg_configurator.cc:134] [618983]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[2]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.778.981 [alg_configurator.cc:68] [618983][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.778.995 [alg_configurator.cc:241] [618983][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.008 [alg_configurator.cc:134] [618983]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[3]
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:47.778.989 [trace_rb_log.c:137](tid:618984) [HCCL_618984_4] create ring buffer success, msgSize 128 bytes, msgTxtSize 112 bytes, bufferSize 1024 bytes, msg space 128 bytes, total space 131568 bytes
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:47.779.006 [tracer_mgr_operate.c:66](tid:618984) create object HCCL_618984_4 success, exitSave(true), noLock(false).
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:47.779.017 [atrace_api.c:63](tid:618984) AtraceCreateWithAttr end.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.010 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.779.027 [hccl_communicator.cc:1565] [618985]isUsedRdmaLevel0_[0] nicNum[1] hostIP[192.168.0.44], nicDeployment[1].
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.779.040 [network_manager.cc:69] [618985]NetworkManager::GetInstance deviceLogicID[7].
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.021 [alg_configurator.cc:68] [618983][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.045 [alg_configurator.cc:241] [618983][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.779.028 [adapter_trace.cc:70] [618984]Call TraceCreateWithAttr, return value[0xaaaaf7a97b08], Params: objName[HCCL_618984_4]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.029 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_bfloat16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.045 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.060 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.057 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.080 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.059 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.779.053 [hccl_communicator.cc:2028] [618985]profiling config information:options[], mode[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.058 [alg_configurator.cc:134] [618983]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[4]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.074 [alg_configurator.cc:68] [618983][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.779.066 [rank_consistentcy_checker.cc:32] [618984][GetInstance] get deviceLogicId[4]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.074 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_int32_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.091 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_gather_v_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.080 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_half.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.097 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_gather_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.113 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.088 [alg_configurator.cc:241] [618983][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.100 [alg_configurator.cc:134] [618983]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[5]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.112 [alg_configurator.cc:68] [618983][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.126 [alg_configurator.cc:241] [618983][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.779.104 [api_impl.cc:1486] 618984 GetMaxStreamAndTask: maxTaskNum:2013, maxStrCount:2016.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.105 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.126 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.131 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.138 [alg_configurator.cc:134] [618983]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[6]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.151 [alg_configurator.cc:68] [618983][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.779.138 [npu_driver.cc:4604] 618984 GetMaxStreamAndTask: deviceId=4, tsId=0, streamCount=1984.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.779.154 [task_exception_handler.cc:1212] [618984]get from RTS the max stream count[1984] the max task count[65535]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.170 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.163 [alg_configurator.cc:241] [618983][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.174 [alg_configurator.cc:134] [618983]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[7]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.188 [alg_configurator.cc:68] [618983][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.779.177 [adapter_trace.cc:21] [618985]Call TraceCreate, return value[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.779.175 [hccl_communicator_attrs.cc:1099] [618984][Set][HcclCommunicatorAttrs][MeshAggregationRankSize]set MeshAggregationRankSize[8].
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.188 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_half.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.204 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_gather_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.200 [alg_configurator.cc:241] [618983][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:47.779.200 [atrace_api.c:61](tid:618985) AtraceCreateWithAttr start.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.220 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.216 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.211 [alg_configurator.cc:134] [618983]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[8]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.224 [alg_configurator.cc:68] [618983][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.779.223 [api_impl.cc:4219] 618984 RegProfCtrlCallback: Reg profiling callback, moduleId=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.231 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.240 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.233 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_uint32_t.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.236 [alg_configurator.cc:241] [618983][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.248 [alg_configurator.cc:134] [618983]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[9]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.779.245 [command_handle.cc:25] [618984][Profiling][CommandHandle] CommandHandle's rtType is 2.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.779.259 [command_handle.cc:99] [618984][Check][Param]SetMsprofReporterCallback.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:47.779.279 [trace_rb_log.c:45](tid:618985) init ring buffer time finished, realTime 1743643667779272785, monotonicTime 4163698991217, freq 99994 kHz, minutesWest 480 minutes
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.250 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_int16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.266 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_gather_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.257 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_gather_v_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.274 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.779.263 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.262 [alg_configurator.cc:68] [618983][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.274 [alg_configurator.cc:241] [618983][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.286 [alg_configurator.cc:134] [618983]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[10]
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:47.779.299 [trace_rb_log.c:137](tid:618985) [HCCL_618985_7] create ring buffer success, msgSize 128 bytes, msgTxtSize 112 bytes, bufferSize 1024 bytes, msg space 128 bytes, total space 131568 bytes
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.282 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.304 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.295 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.298 [alg_configurator.cc:68] [618983][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.311 [alg_configurator.cc:241] [618983][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.328 [alg_configurator.cc:134] [618983]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[11]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.340 [alg_configurator.cc:68] [618983][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:47.779.318 [tracer_mgr_operate.c:66](tid:618985) create object HCCL_618985_7 success, exitSave(true), noLock(false).
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:47.779.331 [atrace_api.c:63](tid:618985) AtraceCreateWithAttr end.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.779.343 [adapter_trace.cc:70] [618985]Call TraceCreateWithAttr, return value[0xaaaaf04c3c38], Params: objName[HCCL_618985_7]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.333 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.354 [alg_configurator.cc:241] [618983][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.366 [alg_configurator.cc:134] [618983]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[12]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.779.351 [profiler_manager_impl.cc:76] [618984][ProfilerManager][InitProfiler]Register CtrlCallBack success
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.779.370 [hccl_communicator.cc:2193] [618984][BASE][InitProfiler]Register CtrlCallBack success.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.361 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_int16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.377 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_gather_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.779.378 [rank_consistentcy_checker.cc:32] [618985][GetInstance] get deviceLogicId[7]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.380 [alg_configurator.cc:68] [618983][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.394 [alg_configurator.cc:241] [618983][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.779.384 [hccl_communicator.cc:803] [618984]Will use ffts mode.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.393 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.397 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.406 [alg_configurator.cc:134] [618983]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[13]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.419 [alg_configurator.cc:68] [618983][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.402 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.421 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_uint16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.779.408 [api_impl.cc:3138] 618984 GetDeviceIndexByPhyId: get Index by PhyId=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.779.424 [api_impl.cc:3149] 618984 GetDeviceIndexByPhyId: GetDeviceIndexByPhyId, device_mode=0, phyId=4
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.415 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.779.418 [api_impl.cc:1486] 618985 GetMaxStreamAndTask: maxTaskNum:2013, maxStrCount:2016.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.415 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_int8_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.431 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_gather_v_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.434 [alg_configurator.cc:241] [618983][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.779.428 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.438 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_gather_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.454 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.779.436 [api_impl.cc:3157] 618984 GetDeviceIndexByPhyId: cloud v2, device_mode=0, device_id=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.779.450 [runtime.cc:5239] 618984 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.779.445 [npu_driver.cc:4604] 618985 GetMaxStreamAndTask: deviceId=7, tsId=0, streamCount=1984.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.779.460 [task_exception_handler.cc:1212] [618985]get from RTS the max stream count[1984] the max task count[65535]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.446 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.468 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.447 [alg_configurator.cc:134] [618983]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[14]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.461 [alg_configurator.cc:68] [618983][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.475 [alg_configurator.cc:241] [618983][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.779.449 [dispatcher.cc:157] [618988][GetNotifyMaxWaitTime] notifyMaxWaitTime_ is 2147483647s
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.779.469 [api_impl.cc:3138] 618988 GetDeviceIndexByPhyId: get Index by PhyId=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.779.482 [api_impl.cc:3149] 618988 GetDeviceIndexByPhyId: GetDeviceIndexByPhyId, device_mode=0, phyId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.779.492 [api_impl.cc:3157] 618988 GetDeviceIndexByPhyId: cloud v2, device_mode=0, device_id=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.475 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.505 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.779.478 [hccl_communicator_attrs.cc:1099] [618985][Set][HcclCommunicatorAttrs][MeshAggregationRankSize]set MeshAggregationRankSize[8].
[INFO] RUNTIME(61[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.489 [alg_configurator.cc:134] [618983]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[15]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.501 [alg_configurator.cc:68] [618983][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.514 [alg_configurator.cc:241] [618983][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.524 [alg_configurator.cc:134] [618983]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[16]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.535 [alg_configurator.cc:68] [618983][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.779.506 [runtime.cc:5239] 618988 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.779.529 [api_impl.cc:1990] 618988 DevMalloc: size=4, type=16, moduleId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.525 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_uint16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.543 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_gather_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.558 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
8674,python3.9):2025-04-03-09:27:47.779.526 [api_impl.cc:4219] 618985 RegProfCtrlCallback: Reg profiling callback, moduleId=3.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.779.556 [command_handle.cc:25] [618985][Profiling][CommandHandle] CommandHandle's rtType is 2.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.547 [alg_configurator.cc:241] [618983][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.559 [alg_configurator.cc:134] [618983]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[17]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.560 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.569 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.579 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.779.571 [command_handle.cc:99] [618985][Check][Param]SetMsprofReporterCallback.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.573 [alg_configurator.cc:68] [618983][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.586 [alg_configurator.cc:241] [618983][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.597 [alg_configurator.cc:134] [618983]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[18]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.578 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_uint8_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.593 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_gather_v_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.608 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.588 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_float.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.614 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_gather_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.629 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.615 [alg_configurator.cc:449] [618983][AlgConfigurator][GetTopoTypeByAlgType]algtype[level0:fullmesh,level1:ring,level2:H-D], devicetype[2],topotype[8] is selected
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.640 [alg_configurator.cc:42] [618983]alg configurator init success.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.627 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.651 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.668 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.779.664 [profiler_manager_impl.cc:76] [618985][ProfilerManager][InitProfiler]Register CtrlCallBack success
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.779.683 [hccl_communicator.cc:2193] [618985][BASE][InitProfiler]Register CtrlCallBack success.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.681 [topo_info_extractor.cc:66] [618983]factory init:collective id[192.168.0.44%enp67s0f5_60008_0_1743643662827273], user rank[5], user rank size[8], topo type[8], device Type[2], meshAggregationRankSize[8]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.685 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_float.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.701 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_gather_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.779.700 [hccl_communicator.cc:803] [618985]Will use ffts mode.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.708 [topo_info_extractor.cc:155] [618983][SetRankInfo]rankData_: userRank[5], devicePhyId[5], serverIdx[0], superPodId[], superPodIdx[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.719 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.779.727 [api_impl.cc:3138] 618985 GetDeviceIndexByPhyId: get Index by PhyId=7.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.720 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.739 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.779.734 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=0, infoType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.779.742 [api_impl.cc:3149] 618985 GetDeviceIndexByPhyId: GetDeviceIndexByPhyId, device_mode=0, phyId=7
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.743 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.738 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_bfloat16_t.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.755 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=aiv_all_gather_v_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.779.759 [api_impl.cc:3157] 618985 GetDeviceIndexByPhyId: cloud v2, device_mode=0, device_id=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.779.774 [runtime.cc:5239] 618985 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.769 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.762 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_int32_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.778 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_gather_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.771 [runtime.cc:1673] 618986 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.791 [elf.cc:566] 618986 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.779.799 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=1, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.792 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.815 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.819 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.779.836 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=2, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.834 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.853 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.852 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_int32_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.779.870 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.871 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_gather_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.885 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.885 [runtime.cc:1688] 618986 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.890 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.902 [runtime.cc:1953] 618986 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=hccl_aiv_sync.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.909 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.916 [runtime.cc:1897] 618986 KernelSetDfx: kernel_name=hccl_aiv_sync, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.779.915 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.779.919 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=4, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.927 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_uint32_t.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.939 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.779.955 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=6, infoType=0
[INFO] DRV(618670,python3.9):2025-04-03-09:27:47.779.941 [devmm_svm.c:1972][ascend][curpid:618670,618986][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0x2; out_feature=0x2)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.944 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_gather_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.964 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.779.971 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.779.962 [hdc.cc:83] [618986][HDCommunicate]supportDevMemReg_ 1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.779.980 [api_impl.cc:1990] 618986 DevMalloc: size=659456, type=16, moduleId=3.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.779.985 [api_error.cc:3478] 618983 GetPairPhyDevicesInfo: input physic devId=5, input physic otherDevId=7, infoType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.779.985 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.004 [adapter_rts.cc:940] [618983][hrtGetPairDeviceLinkTypeRaw]phyDevId[5] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.007 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.780.008 [api_error.cc:1218] 618986 DevMalloc: device malloc Succ, size=659456, type=16, moduleId=3, start ptr=0x12c280004000, end ptr=0x12c2800a5000
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.025 [topo_info_extractor.cc:348] [618983]check server info:server rank size[8], expected value[8], topo type[8]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.025 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_uint32_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.042 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_gather_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.064 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.077 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.083 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.096 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_int8_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.114 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_gather_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.131 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.153 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.173 [topo_info_extractor.cc:888] [618983]SetTopoInfoForLevel0: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[5], userRankSize[8], topoRankInfo[userRank/devicePhyId: 0/0; 1/1; 2/2; 3/3; 4/4; 5/5; 6/6; 7/7; ]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.206 [topo_info_extractor.cc:585] [618983][Set][TopoInfoForLevel1] topoType_[8] ringSize[8]
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:47.780.179 [trs_cb_event.c:119][ascend][curpid:618662,618817][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =833; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:47.780.178 [trs_cb_event.c:119][ascend][curpid:618662,618816][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =832; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:47.780.210 [trs_sqcq.c:1491][ascend][curpid:618662,618817][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.185 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.212 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, f[WARNING] DRV(618674,python3.9):2025-04-03-09:27:47.780.185 [trs_cb_event.c:119][ascend][curpid:618674,618818][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =64; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:47.780.187 [trs_cb_event.c:119][ascend][curpid:618674,618819][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =65; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:47.780.181 [queue_client_comm.c:114][ascend][curpid:618646,618961][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:47.780.181 [queue_client_comm.c:114][ascend][curpid:618646,618965][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:47.780.189 [queue_client_comm.c:114][ascend][curpid:618646,618963][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:47.780.218 [trs_sqcq.c:1491][ascend][curpid:618662,618816][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:47.780.232 [npu_driver.cc:3833] 618817 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=833, drvRetCode=16.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.228 [topo_info_extractor.cc:646] [618983][Set][TopoInfoForLevel1] calc subGroup superPodId[] subIndex[0]
uncMode=0, kernelInfoExt=aiv_all_gather_int8_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.241 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_gather_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:47.780.218 [trs_sqcq.c:1491][ascend][curpid:618674,618818][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:47.780.235 [trs_sqcq.c:1491][ascend][curpid:618674,618819][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:47.780.241 [npu_driver.cc:3833] 618816 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=832, drvRetCode=16.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:47.780.249 [api_impl.cc:5058] 618817 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:47.780.257 [api_impl.cc:5058] 618816 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.780.266 [callback.cpp:132]618817 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.780.270 [callback.cpp:132]618816 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.247 [topo_info_extractor.cc:685] [618983]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 0, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 0/192.168.0.44/0/192.168.100.101/0; ]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.263 [topo_info_extractor.cc:685] [618983]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 1, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 1/192.168.0.44/1/29.105.19.202/0; ]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.262 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.259 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.280 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:47.780.247 [npu_driver.cc:3833] 618818 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:47.780.258 [npu_driver.cc:3833] 618819 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:47.780.268 [api_impl.cc:5058] 618818 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:47.780.280 [api_impl.cc:5058] 618819 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.780.289 [callback.cpp:132]618818 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.297 [topo_info_extractor.cc:685] [618983]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 2, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 2/192.168.0.44/2/29.105.165.16/0; ]
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.780.281 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.780.293 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.285 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_uint8_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.303 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_gather_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.318 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:47.780.311 [npu_driver.cc:4338] 618961 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.780.299 [callback.cpp:132]618819 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.780.308 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.780.320 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.313 [topo_info_extractor.cc:685] [618983]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 3, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 3/192.168.0.44/3/29.105.51.138/0; ]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.328 [topo_info_extractor.cc:685] [618983]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 4, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 4/192.168.0.44/4/29.105.24.184/0; ]
,python3.9):2025-04-03-09:27:47.780.303 [npu_driver.cc:3828] 618817 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=833.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.780.306 [npu_driver.cc:3828] 618816 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=832.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.340 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.780.333 [tensor_data_transfer.cpp:612]618961 acltdtReceiveTensorV2: queue is empty, device is 0, name is _npu_log
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:47.780.335 [npu_driver.cc:4338] 618965 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.780.347 [tensor_data_transfer.cpp:1054]618961 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is _npu_log
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.780.356 [tensor_data_transfer.cpp:612]618965 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_tensor_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.780.362 [tensor_data_transfer.cpp:1056]618961 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:47.780.364 [npu_driver.cc:4338] 618963 MemQueuePeek: queue empty
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.780.348 [api_error.cc:1218] 618988 DevMalloc: device malloc Succ, size=4, type=16, moduleId=3, start ptr=0x12c280000000, end ptr=0x12c280000004
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.780.331 [npu_driver.cc:3828] 618818 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=64.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.780.345 [npu_driver.cc:3828] 618819 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=65.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.344 [topo_info_extractor.cc:685] [618983]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 5, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 5/192.168.0.44/5/29.105.72.114/1; ]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.359 [topo_info_extractor.cc:685] [618983]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 6, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 6/192.168.0.44/6/29.105.134.38/0; ]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.376 [topo_info_extractor.cc:685] [618983]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 7, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 7/192.168.0.44/7/29.105.73.96/0; ]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.381 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.780.375 [tensor_data_transfer.cpp:1054]618965 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_tensor_summary
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.780.381 [api_impl.cc:6121] 618961 MemQueuePeek: Start to peek queue on devId 0, qid is 0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.780.393 [tensor_data_transfer.cpp:612]618963 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_tensor_dump
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.390 [topo_info_extractor.cc:689] [618983]SetTopoInfoForLevel1: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[5], userRankSize[8], plane size[8]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.401 [topo_info_extractor.cc:697] [618983][Set][TopoInfoForLevel2] select origin proc
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.414 [topo_info_extractor.cc:734] [618983]SetTopoInfoForLevel2: topoRankInfo[userRank/devicePhyId/serverIdx/superPodId: 5/5/0/; ]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.780.408 [api_impl.cc:1990] 618988 DevMalloc: size=4, type=16, moduleId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.400 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_uint8_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.416 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_gather_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.432 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.780.399 [tensor_data_transfer.cpp:1056]618965 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.780.407 [npu_driver.cc:4330] 618961 MemQueuePeek: peek mem queue, deviceId=0, qid=0, timeout=800.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.780.419 [tensor_data_transfer.cpp:1054]618963 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_tensor_dump
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.780.429 [api_impl.cc:6121] 618965 MemQueuePeek: Start to peek queue on devId 0, qid is 2.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.430 [topo_info_extractor.cc:739] [618983]SetTopoInfoForLevel2: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[5], userRankSize[8], plane size[1]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.445 [topo_info_extractor.cc:585] [618983][Set][TopoInfoForLevel1] topoType_[8] ringSize[8]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.434 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.780.438 [api_error.cc:1218] 618988 DevMalloc: device malloc Succ, size=4, type=16, moduleId=3, start ptr=0x12c280001000, end ptr=0x12c280001004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.780.442 [tensor_data_transfer.cpp:1056]618963 acltdtReceiveTensor: new process, use queue process
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.460 [topo_info_extractor.cc:646] [618983][Set][TopoInfoForLevel1] calc subGroup superPodId[] subIndex[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.453 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.453 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_bfloat16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.470 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_gather_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.780.472 [api_impl.cc:1990] 618988 DevMalloc: size=4, type=16, moduleId=3.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.780.452 [npu_driver.cc:4330] 618965 MemQueuePeek: peek mem queue, deviceId=0, qid=2, timeout=800.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.780.482 [api_impl.cc:6121] 618963 MemQueuePeek: Start to peek queue on devId 0, qid is 1.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.473 [topo_info_extractor.cc:685] [618983]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 0, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 0/192.168.0.44/0/192.168.100.101/0; ]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.489 [topo_info_extractor.cc:685] [618983]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 1, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 1/192.168.0.44/1/29.105.19.202/0; ]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.780.481 [api_impl.cc:3476] 618984 GetDeviceInfo: get device info, deviceId=4
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.485 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.780.492 [api_error.cc:1218] 618988 DevMalloc: device malloc Succ, size=4, type=16, moduleId=3, start ptr=0x12c280002000, end ptr=0x12c280002004
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.780.504 [npu_driver.cc:4330] 618963 MemQueuePeek: peek mem queue, deviceId=0, qid=1, timeout=800.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.506 [topo_info_extractor.cc:685] [618983]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 2, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 2/192.168.0.44/2/29.105.165.16/0; ]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.527 [topo_info_extractor.cc:685] [618983]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 3, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 3/192.168.0.44/3/29.105.51.138/0; ]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.543 [topo_info_extractor.cc:685] [618983]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 4, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 4/192.168.0.44/4/29.105.24.184/0; ]
[WARNING] HCCL(618662,python3.9):2025-04-03-09:27:47.780.536 [tbe_vector_reduce.cc:508] [618984]ENV:LD_LIBRARY_PATH lack fwkacllib/lib64
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.516 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.547 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.780.523 [opexecounter.cc:71] [618988]alloc counter mem resource.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.558 [topo_info_extractor.cc:685] [618983]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 5, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 5/192.168.0.44/5/29.105.72.114/1; ]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.573 [topo_info_extractor.cc:685] [618983]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 6, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 6/192.168.0.44/6/29.105.134.38/0; ]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.566 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_bfloat16_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.583 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_gather_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.597 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.780.572 [hccl_communicator_attrs.cc:1368] [618988][CollectAlgoAttr]:isUsedRdmaLevel0:[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.597 [topo_info_extractor.cc:685] [618983]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 7, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 7/192.168.0.44/7/29.105.73.96/0; ]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.609 [topo_info_extractor.cc:689] [618983]SetTopoInfoForLevel1: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[5], userRankSize[8], plane size[8]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.609 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.617 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.780.610 [alg_configurator.cc:68] [618988][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.780.637 [alg_configurator.cc:241] [618988][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.646 [topo_info_extractor.cc:790] [618983]SetTopoInfoForMeshL1: topoRankInfo[userRank/devicePhyId5/5; ]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.629 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_half.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.647 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_gather_v_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.780.658 [alg_configurator.cc:134] [618988]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.780.674 [alg_configurator.cc:68] [618988][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.674 [topo_info_extractor.cc:519] [618983]plane info:topo type[8], device type[2], COMM_COMBINE size[1], COMM_LEVEL0 size[7], COMM_LEVEL1 size[8], COMM_LEVEL2 size[1], COMM_MESH_L0 size[1], COMM_MESH_L1 size[1]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.780.645 [api_impl.cc:1990] 618986 DevMalloc: size=659456, type=16, moduleId=3.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.780.681 [api_error.cc:1218] 618986 DevMalloc: device malloc Succ, size=659456, type=16, moduleId=3, start ptr=0x12c2800a5000, end ptr=0x12c280146000
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.663 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.684 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.780.689 [alg_configurator.cc:241] [618988][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.780.703 [alg_configurator.cc:134] [618988]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[1]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.780.704 [api_impl.cc:2664] 618986 MemSetSync: destMax=659456, value=0, count=659456
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.709 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.780.720 [alg_configurator.cc:68] [618988][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.727 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_half.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.780.735 [alg_configurator.cc:241] [618988][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.745 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_gather_v_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.780.750 [alg_configurator.cc:134] [618988]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[2]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.780.768 [alg_configurator.cc:68] [618988][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.765 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.778 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.789 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.780.785 [alg_configurator.cc:241] [618988][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.780.802 [alg_configurator.cc:134] [618988]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[3]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.796 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_int16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.780.802 [api_impl.cc:1990] 618983 DevMalloc: size=32, type=16, moduleId=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.814 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_gather_v_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.780.821 [alg_configurator.cc:68] [618988][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.780.839 [alg_configurator.cc:241] [618988][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.780.830 [api_error.cc:1218] 618983 DevMalloc: device malloc Succ, size=32, type=16, moduleId=3, start ptr=0x12c280003000, end ptr=0x12c280003020
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.834 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.780.853 [alg_configurator.cc:134] [618988]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[4]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.856 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.780.867 [alg_configurator.cc:68] [618988][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.780.880 [alg_configurator.cc:241] [618988][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:47.780.870 [devmm_svm.c:1972][ascend][curpid:618670,618986][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0x2; out_feature=0x2)
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.780.888 [hdc.cc:83] [618986][HDCommunicate]supportDevMemReg_ 1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.879 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.780.887 [hccl_impl.cc:59] [618983]start hccl resources build:get deviceLogicId[5]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.897 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_int16_t.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.780.896 [alg_configurator.cc:134] [618988]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[5]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.780.903 [api_impl.cc:1990] 618986 DevMalloc: size=4096, type=16, moduleId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.916 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_gather_v_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.780.916 [alg_configurator.cc:68] [618988][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.780.934 [alg_configurator.cc:241] [618988][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.780.922 [api_error.cc:1218] 618986 DevMalloc: device malloc Succ, size=4096, type=16, moduleId=3, start ptr=0x12c280146000, end ptr=0x12c280147000
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.935 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.780.945 [api_impl.cc:2096] 618986 HostMalloc: size=4096
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.780.962 [api_error.cc:1260] 618986 HostMalloc: Host memory malloc succeed,size=4096 , moduleId=3, host addr=0x12c0807f0000.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.949 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.780.947 [alg_configurator.cc:134] [618988]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[6]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.780.961 [alg_configurator.cc:68][INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.780.959 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.966 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_uint16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.982 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_gather_v_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
 [618988][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.780.991 [alg_configurator.cc:241] [618988][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.780.997 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.005 [alg_configurator.cc:134] [618988]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[7]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.021 [alg_configurator.cc:68] [618988][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.018 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.781.021 [hccl_impl.cc:177] [618983]hcclImpl init success.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.037 [alg_configurator.cc:241] [618988][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.051 [alg_configurator.cc:134] [618988]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[8]
[WARNING] HCCL(618666,python3.9):2025-04-03-09:27:47.781.052 [hccl_aiv.cc:279] [618983][AIV][GetAivOpBinaryPath]ENV:LD_LIBRARY_PATH lack fwkacllib/lib64
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.051 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.781.056 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.071 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_uint16_t.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.069 [alg_configurator.cc:68] [618988][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.088 [alg_configurator.cc:241] [618988][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.103 [alg_configurator.cc:134] [618988]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[9]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.090 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_gather_v_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.111 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.117 [alg_configurator.cc:68] [618988][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.112 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.128 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_float.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.143 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_gather_v_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.781.121 [api_impl.cc:3476] 618985 GetDeviceInfo: get device info, deviceId=7
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.134 [alg_configurator.cc:241] [618988][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.142 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.150 [alg_configurator.cc:134] [618988]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[10]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.165 [alg_configurator.cc:68] [618988][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.178 [alg_configurator.cc:241] [618988][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.161 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.190 [alg_configurator.cc:134] [618988]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[11]
[WARNING] HCCL(618674,python3.9):2025-04-03-09:27:47.781.178 [tbe_vector_reduce.cc:508] [618985]ENV:LD_LIBRARY_PATH lack fwkacllib/lib64
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.781.180 [api_impl.cc:1990] 618986 DevMalloc: size=2100520, type=16, moduleId=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.183 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.207 [alg_configurator.cc:68] [618988][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.781.214 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.221 [alg_configurator.cc:241] [618988][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.233 [alg_configurator.cc:134] [618988]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[12]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.781.233 [dispatcher.cc:157] [618984][GetNotifyMaxWaitTime] notifyMaxWaitTime_ is 2147483647s
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.238 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.245 [alg_configurator.cc:68] [618988][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.263 [alg_configurator.cc:241] [618988][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.781.252 [api_impl.cc:3138] 618984 GetDeviceIndexByPhyId: get Index by PhyId=4.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.781.255 [api_error.cc:1218] 618986 DevMalloc: device malloc Succ, size=2100520, type=16, moduleId=3, start ptr=0x12c100c00000, end ptr=0x12c100e00d28
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.258 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_float.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.277 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_gather_v_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.278 [alg_configurator.cc:134] [618988]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[13]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.781.268 [api_impl.cc:3149] 618984 GetDeviceIndexByPhyId: GetDeviceIndexByPhyId, device_mode=0, phyId=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.781.283 [api_impl.cc:3157] 618984 GetDeviceIndexByPhyId: cloud v2, device_mode=0, device_id=4
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.277 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.781.278 [api_impl.cc:2664] 618986 MemSetSync: destMax=2100520, value=0, count=2100520
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.297 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.294 [alg_configurator.cc:68] [618988][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.309 [alg_configurator.cc:241] [618988][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.781.296 [runtime.cc:5239] 618984 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.298 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_int32_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.314 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_gather_v_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.328 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.318 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.322 [alg_configurator.cc:134] [618988]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[14]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.341 [alg_configurator.cc:68] [618988][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.781.321 [api_impl.cc:1990] 618984 DevMalloc: size=4, type=16, moduleId=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.348 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.356 [alg_configurator.cc:241] [618988][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.368 [alg_configurator.cc:134] [618988]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[15]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.382 [alg_configurator.cc:68] [618988][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.398 [alg_configurator.cc:241] [618988][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.406 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.412 [alg_configurator.cc:134] [618988]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[16]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.427 [alg_configurator.cc:68] [618988][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.781.419 [api_impl.cc:1990] 618986 DevMalloc: size=32, type=16, moduleId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.425 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_int32_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.441 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_gather_v_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.447 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.781.441 [api_error.cc:1218] 618986 DevMalloc: device malloc Succ, size=32, type=16, moduleId=3, start ptr=0x12c280147000, end ptr=0x12c280147020
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.781.461 [api_impl.cc:2664] 618986 MemSetSync: destMax=32, value=0, count=32
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.443 [alg_configurator.cc:241] [618988][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.462 [alg_configurator.cc:134] [618988]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[17]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.458 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.465 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_uint32_t.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.479 [alg_configurator.cc:68] [618988][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.494 [alg_configurator.cc:241] [618988][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.481 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.781.491 [peterson_lock.cc:69] [618986][PetersonLock][AllocDeviceMem] Type[Host] alloc memSize[32 Byte]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.481 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_gather_v_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.503 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.508 [alg_configurator.cc:134] [618988]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[18]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.781.508 [peterson_lock.cc:47] [618986][PetersonLock][Init] type [Host] init success, memSize [32 Byte] timeout[60 s]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.533 [alg_configurator.cc:449] [618988][AlgConfigurator][GetTopoTypeByAlgType]algtype[level0:fullmesh,level1:ring,level2:H-D], devicetype[2],topotype[8] is selected
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.521 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.548 [alg_configurator.cc:42] [618988]alg configurator init success.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.781.540 [hccl_comm.cc:129] [618986]hcclCommInitInfo:commId[hccl-618670-0-1743643665-hccl_world_group], rank[6], totalRanks[8], serverId[192.168.0.44%enp67s0f5], deviceType[2],logicDevId[6], identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.573 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.781.563 [hccl_comm.cc:175] [618986][SetQpQosAttr]The TC and SL do not use the config configuration. It will use environment variables to configure. TC[132], SL[4]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.781.580 [topo_matcher.cc:528] [618986][SetAivMode]AivMode is set to [0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.781.594 [topo_matcher.cc:540] [618986][SetAicpuMode]Aicpu is set to [0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.590 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_uint32_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.608 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_gather_v_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.602 [topo_info_extractor.cc:66] [618988]factory init:collective id[192.168.0.44%enp67s0f5_60008_0_1743643662827273], user rank[2], user rank size[8], topo type[8], device Type[2], meshAggregationRankSize[8]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.781.611 [hcom_plugin.cc:349] [618986][Set][GroupTopoInfo]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] rankSize[8].
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.613 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.626 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.630 [topo_info_extractor.cc:155] [618988][SetRankInfo]rankData_: userRank[2], devicePhyId[2], serverIdx[0], superPodId[], superPodIdx[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.650 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.781.637 [runtime.cc:5239] 618986 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.781.655 [adapter_rts.cc:198] [618986][hrtGetDeviceRefresh]deviceLogicId[6]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.634 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_int8_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.649 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_gather_v_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.781.658 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=0, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.781.669 [hcom_common.cc:85] [618986][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[6] 
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.665 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.686 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.686 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[0] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.781.686 [op_base.cc:128] [618986][HcclGetDeviceId] deviceLogicId[6] 
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.781.701 [hccl_comm.cc:1296] [618986]HCCL_KEY_INFO: GetTopoDesc topoDescs[0xfffec5fbccb8] topoSize[2]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.781.720 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=1, infoType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.781.718 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.744 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.745 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] GE(618670,python3.9):2025-04-03-09:27:47.781.741 [hcom_topo_info.cc:24]618986 SetGroupTopoInfo:Add group 192.168.0.44%enp67s0f5_60008_0_1743643662827273 successfully.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.781.760 [hcom_plugin.cc:371] [618986][Set][GroupTopoInfo]SetGroupTopoInfo group set success
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.781.768 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.765 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_int8_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.780 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_gather_v_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.778 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.781.782 [topoinfo_detect.cc:555] [618986]NetworkManager stop host net success! ip[192.168.0.44%enp67s0f5] 
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.781.796 [topoinfo_detect.cc:321] [618986]TopoInfoDetect TeardownAgent ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.797 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.788 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.819 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.797 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_uint8_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.814 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_gather_v_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.781.808 [topoinfo_detect.cc:219] [618986]TopoInfoDetect TeardownServer ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.831 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.781.834 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=4, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.781.829 [op_base.cc:1050] [618986][InitCommRootInfo]Init success, rankNum[8], rank[6], rootInfo identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], server[192.168.0.44%enp67s0f5], logicDevId[6]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.781.848 [profiler_base.cc:342] [618986]AddGroupUdi: group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] udi[] deviceLogicId[6]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.854 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.856 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[4] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.781.872 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=5, infoType=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.781.863 [op_base.cc:1107] [618986][HCCL_TRACE]HcclCommInitRootInfoInner success, take time [4484822]us, rankNum[8], rank[6]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.781.889 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.888 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[5] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.781.908 [dispatcher.cc:157] [618985][GetNotifyMaxWaitTime] notifyMaxWaitTime_ is 2147483647s
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.781.926 [api_impl.cc:3138] 618985 GetDeviceIndexByPhyId: get Index by PhyId=7.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.913 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.781.905 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=6, infoType=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.922 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.781.936 [api_error.cc:3478] 618988 GetPairPhyDevicesInfo: input physic devId=2, input physic otherDevId=7, infoType=0
[WARNING] DEVICE(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.781.918 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:157] InitializeByRootInfoConfig] End to initialize communicator by HcclCommInitRootInfo for hccl_world_group
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.781.941 [api_impl.cc:3149] 618985 GetDeviceIndexByPhyId: GetDeviceIndexByPhyId, device_mode=0, phyId=7
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.931 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_uint8_t.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.946 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_gather_v_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.954 [adapter_rts.cc:940] [618988][hrtGetPairDeviceLinkTypeRaw]phyDevId[2] otherPhyDevId[7] linkTypeRaw[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.781.943 [op_base.cc:853] [618986]HcclGetCommName input handle=0xfffea4022f40 commName=192.168.0.44%enp67s0f5_60008_0_1743643662827273
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.950 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.781.954 [api_impl.cc:3157] 618985 GetDeviceIndexByPhyId: cloud v2, device_mode=0, device_id=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.781.965 [runtime.cc:5239] 618985 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.961 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.781.975 [topo_info_extractor.cc:348] [618988]check server info:server rank size[8], expected value[8], topo type[8]
[INFO] DEVICE(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.781.974 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:93] Initialize] Start initializing hccl watchdog on device side for group: hccl_world_group, rank: 6
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.969 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_bfloat16_t.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.781.985 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=aiv_all_gather_v_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.782.001 [runtime.cc:1673] 618987 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.781.989 [api_impl.cc:1990] 618985 DevMalloc: size=4, type=16, moduleId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.781.982 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] DEVICE(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.781.998 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:77] Initialize] Initialize hccl watch dog handler. rank id: 6, group name: hccl_world_group
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.782.022 [elf.cc:566] 618987 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.782.083 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.782.101 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_bfloat16_t.
[INFO] DEVICE(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.782.101 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:98] Initialize] hccl watchdog on device side is successfully initialized.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.782.115 [runtime.cc:1688] 618987 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.782.116 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=aiv_all_gather_v_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.782.123 [device.cpp:183]618986 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 6.
[INFO] DEVICE(618670,fffec4f9efa0,python3.9):2025-04-03-09:27:47.782.137 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:155] WatchDogProcess] WatchDogProcess start, rank id: 6, group name: hccl_world_group
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.782.137 [runtime.cc:1673] 618982 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.782.158 [elf.cc:566] 618982 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.124 [topo_info_extractor.cc:888] [618988]SetTopoInfoForLevel0: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[2], userRankSize[8], topoRankInfo[userRank/devicePhyId: 0/0; 1/1; 2/2; 3/3; 4/4; 5/5; 6/6; 7/7; ]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.782.134 [runtime.cc:1953] 618987 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=hccl_aiv_sync.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.782.147 [api_impl.cc:3419] 618986 DeviceReset: reset device, device_id=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.782.164 [runtime.cc:3444] 618986 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x8, reset:0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.782.149 [api_error.cc:1218] 618984 DevMalloc: device malloc Succ, size=4, type=16, moduleId=3, start ptr=0x12c280000000, end ptr=0x12c280000004
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.158 [topo_info_extractor.cc:585] [618988][Set][TopoInfoForLevel1] topoType_[8] ringSize[8]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.782.150 [runtime.cc:1897] 618987 KernelSetDfx: kernel_name=hccl_aiv_sync, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] DRV(618650,python3.9):2025-04-03-09:27:47.782.177 [devmm_svm.c:1972][ascend][curpid:618650,618987][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0x2; out_feature=0x2)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.782.178 [api_impl.cc:3449] 618986 DeviceReset: Succ, userDeviceId=6.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.782.189 [device.cpp:189]618986 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 6.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.182 [topo_info_extractor.cc:646] [618988][Set][TopoInfoForLevel1] calc subGroup superPodId[] subIndex[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.199 [topo_info_extractor.cc:685] [618988]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 0, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 0/192.168.0.44/0/192.168.100.101/0; ]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.782.193 [hdc.cc:83] [618987][HDCommunicate]supportDevMemReg_ 1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.782.210 [api_impl.cc:1990] 618987 DevMalloc: size=659456, type=16, moduleId=3.
[INFO] DEVICE(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.782.213 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_communication_group.cc:58] Initialize] Successfully initialize HCCL group hccl_world_group
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.782.235 [api_error.cc:1218] 618987 DevMalloc: device malloc Succ, size=659456, type=16, moduleId=3, start ptr=0x12c280004000, end ptr=0x12c2800a5000
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.782.209 [api_impl.cc:1990] 618984 DevMalloc: size=4, type=16, moduleId=3.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.217 [topo_info_extractor.cc:685] [618988]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 1, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 1/192.168.0.44/1/29.105.19.202/0; ]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.235 [topo_info_extractor.cc:685] [618988]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 2, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 2/192.168.0.44/2/29.105.165.16/1; ]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.782.248 [runtime.cc:1688] 618982 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.782.232 [api_error.cc:1218] 618984 DevMalloc: device malloc Succ, size=4, type=16, moduleId=3, start ptr=0x12c280001000, end ptr=0x12c280001004
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.782.263 [api_impl.cc:1990] 618984 DevMalloc: size=4, type=16, moduleId=3.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.782.279 [api_error.cc:1218] 618984 DevMalloc: device malloc Succ, size=4, type=16, moduleId=3, start ptr=0x12c280002000, end ptr=0x12c280002004
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.250 [topo_info_extractor.cc:685] [618988]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 3, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 3/192.168.0.44/3/29.105.51.138/0; ]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.269 [topo_info_extractor.cc:685] [618988]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 4, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 4/192.168.0.44/4/29.105.24.184/0; ]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.285 [topo_info_extractor.cc:685] [618988]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 5, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 5/192.168.0.44/5/29.105.72.114/0; ]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.299 [topo_info_extractor.cc:685] [618988]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 6, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 6/192.168.0.44/6/29.105.134.38/0; ]
[INFO] DISTRIBUTED(618670,fffec67cefa0,python3.9):2025-04-03-09:27:47.782.269 [mindspore/ccsrc/distributed/collective/collective_manager.cc:824] CreateDeviceCommunicator] [PROF]InitDeviceCommunicator costs 4718.78 msec.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.782.266 [runtime.cc:1953] 618982 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=hccl_aiv_sync.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.782.282 [runtime.cc:1897] 618982 KernelSetDfx: kernel_name=hccl_aiv_sync, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] DRV(618658,python3.9):2025-04-03-09:27:47.782.305 [devmm_svm.c:1972][ascend][curpid:618658,618982][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0x2; out_feature=0x2)
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.314 [topo_info_extractor.cc:685] [618988]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 7, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 7/192.168.0.44/7/29.105.73.96/0; ]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.310 [opexecounter.cc:71] [618984]alloc counter mem resource.
[WARNING] DISTRIBUTED(618670,fffec67cefa0,python3.9):2025-04-03-09:27:47.782.321 [mindspore/ccsrc/distributed/collective/collective_manager.cc:828] CreateDeviceCommunicator] End initialize communication group on the device side: hccl_world_group
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.782.322 [hdc.cc:83] [618982][HDCommunicate]supportDevMemReg_ 1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.328 [topo_info_extractor.cc:689] [618988]SetTopoInfoForLevel1: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[2], userRankSize[8], plane size[8]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.355 [topo_info_extractor.cc:697] [618988][Set][TopoInfoForLevel2] select origin proc
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.782.338 [api_impl.cc:1990] 618982 DevMalloc: size=659456, type=16, moduleId=3.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.349 [hccl_communicator_attrs.cc:1368] [618984][CollectAlgoAttr]:isUsedRdmaLevel0:[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.782.365 [api_error.cc:1218] 618982 DevMalloc: device malloc Succ, size=659456, type=16, moduleId=3, start ptr=0x12c280004000, end ptr=0x12c2800a5000
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.373 [topo_info_extractor.cc:734] [618988]SetTopoInfoForLevel2: topoRankInfo[userRank/devicePhyId/serverIdx/superPodId: 2/2/0/; ]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.390 [topo_info_extractor.cc:739] [618988]SetTopoInfoForLevel2: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[2], userRankSize[8], plane size[1]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.404 [topo_info_extractor.cc:585] [618988][Set][TopoInfoForLevel1] topoType_[8] ringSize[8]
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.782.391 [mindspore/ccsrc/distributed/collective/collective_manager.cc:404] CreateCommunicationGroup] [PROF]distributed_create_group costs 5220.44 msec.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.399 [alg_configurator.cc:68] [618984][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.422 [alg_configurator.cc:241] [618984][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.422 [topo_info_extractor.cc:646] [618988][Set][TopoInfoForLevel1] calc subGroup superPodId[] subIndex[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.441 [topo_info_extractor.cc:685] [618988]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 0, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 0/192.168.0.44/0/192.168.100.101/0; ]
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.782.435 [mindspore/ccsrc/distributed/collective/collective_manager.cc:225] Initialize] [PROF]CreateGlobalCommunicationGroup costs 5220.51 msec.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.442 [alg_configurator.cc:134] [618984]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[0]
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.782.456 [mindspore/ccsrc/distributed/collective/collective_manager.cc:228] Initialize] End initializing collective communication for backend: Ascend
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.460 [topo_info_extractor.cc:685] [618988]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 1, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 1/192.168.0.44/1/29.105.19.202/0; ]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.459 [alg_configurator.cc:68] [618984][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.478 [alg_configurator.cc:241] [618984][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.480 [topo_info_extractor.cc:685] [618988]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 2, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 2/192.168.0.44/2/29.105.165.16/1; ]
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.782.484 [mindspore/ccsrc/distributed/init.cc:62] Initialize] [PROF]distributed_collective_init costs 9375.1 msec.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.492 [alg_configurator.cc:134] [618984]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[1]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.506 [topo_info_extractor.cc:685] [618988]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 3, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 3/192.168.0.44/3/29.105.51.138/0; ]
[INFO] PIPELINE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.782.524 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:254] RecordInitStatus] Status record: system init.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.510 [alg_configurator.cc:68] [618984][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.537 [alg_configurator.cc:241] [618984][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.526 [topo_info_extractor.cc:685] [618988]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 4, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 4/192.168.0.44/4/29.105.24.184/0; ]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.553 [alg_configurator.cc:134] [618984]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[2]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.547 [topo_info_extractor.cc:685] [618988]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 5, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 5/192.168.0.44/5/29.105.72.114/0; ]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.563 [topo_info_extractor.cc:685] [618988]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 6, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 6/192.168.0.44/6/29.105.134.38/0; ]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.568 [alg_configurator.cc:68] [618984][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.585 [alg_configurator.cc:241] [618984][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.581 [topo_info_extractor.cc:685] [618988]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 7, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 7/192.168.0.44/7/29.105.73.96/0; ]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.596 [topo_info_extractor.cc:689] [618988]SetTopoInfoForLevel1: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[2], userRankSize[8], plane size[8]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.598 [alg_configurator.cc:134] [618984]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[3]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.615 [alg_configurator.cc:68] [618984][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.632 [alg_configurator.cc:241] [618984][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.632 [topo_info_extractor.cc:790] [618988]SetTopoInfoForMeshL1: topoRankInfo[userRank/devicePhyId2/2; ]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.645 [alg_configurator.cc:134] [618984]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[4]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.662 [alg_configurator.cc:68] [618984][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.655 [topo_info_extractor.cc:519] [618988]plane info:topo type[8], device type[2], COMM_COMBINE size[1], COMM_LEVEL0 size[7], COMM_LEVEL1 size[8], COMM_LEVEL2 size[1], COMM_MESH_L0 size[1], COMM_MESH_L1 size[1]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.677 [alg_configurator.cc:241] [618984][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.693 [alg_configurator.cc:134] [618984]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[5]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.710 [alg_configurator.cc:68] [618984][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.724 [alg_configurator.cc:241] [618984][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.739 [alg_configurator.cc:134] [618984]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[6]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.756 [alg_configurator.cc:68] [618984][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.771 [alg_configurator.cc:241] [618984][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.786 [alg_configurator.cc:134] [618984]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[7]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.782.786 [api_impl.cc:1990] 618988 DevMalloc: size=32, type=16, moduleId=3.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.801 [alg_configurator.cc:68] [618984][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.818 [alg_configurator.cc:241] [618984][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.782.817 [api_error.cc:1218] 618988 DevMalloc: device malloc Succ, size=32, type=16, moduleId=3, start ptr=0x12c280003000, end ptr=0x12c280003020
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.782.817 [api_error.cc:1218] 618985 DevMalloc: device malloc Succ, size=4, type=16, moduleId=3, start ptr=0x12c280000000, end ptr=0x12c280000004
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.833 [alg_configurator.cc:134] [618984]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[8]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.850 [alg_configurator.cc:68] [618984][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.864 [alg_configurator.cc:241] [618984][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.782.861 [api_impl.cc:1990] 618982 DevMalloc: size=659456, type=16, moduleId=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.782.866 [api_impl.cc:1990] 618987 DevMalloc: size=659456, type=16, moduleId=3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.782.874 [api_impl.cc:1990] 618985 DevMalloc: size=4, type=16, moduleId=3.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.782.872 [hccl_impl.cc:59] [618988]start hccl resources build:get deviceLogicId[2]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.782.884 [api_error.cc:1218] 618982 DevMalloc: device malloc Succ, size=659456, type=16, moduleId=3, start ptr=0x12c2800a5000, end ptr=0x12c280146000
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.782.886 [api_error.cc:1218] 618987 DevMalloc: device malloc Succ, size=659456, type=16, moduleId=3, start ptr=0x12c2800a5000, end ptr=0x12c280146000
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.880 [alg_configurator.cc:134] [618984]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[9]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.904 [alg_configurator.cc:68] [618984][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.782.896 [api_error.cc:1218] 618985 DevMalloc: device malloc Succ, size=4, type=16, moduleId=3, start ptr=0x12c280001000, end ptr=0x12c280001004
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.782.907 [api_impl.cc:2664] 618982 MemSetSync: destMax=659456, value=0, count=659456
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.782.907 [api_impl.cc:2664] 618987 MemSetSync: destMax=659456, value=0, count=659456
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.919 [alg_configurator.cc:241] [618984][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.933 [alg_configurator.cc:134] [618984]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[10]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.946 [alg_configurator.cc:68] [618984][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.782.928 [api_impl.cc:1990] 618985 DevMalloc: size=4, type=16, moduleId=3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.782.945 [api_error.cc:1218] 618985 DevMalloc: device malloc Succ, size=4, type=16, moduleId=3, start ptr=0x12c280002000, end ptr=0x12c280002004
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.959 [alg_configurator.cc:241] [618984][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.973 [alg_configurator.cc:134] [618984]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[11]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.985 [alg_configurator.cc:68] [618984][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.782.975 [opexecounter.cc:71] [618985]alloc counter mem resource.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.782.998 [alg_configurator.cc:241] [618984][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.011 [alg_configurator.cc:134] [618984]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[12]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.008 [hccl_communicator_attrs.cc:1368] [618985][CollectAlgoAttr]:isUsedRdmaLevel0:[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.783.006 [hccl_impl.cc:177] [618988]hcclImpl init success.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.025 [alg_configurator.cc:68] [618984][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.040 [alg_configurator.cc:241] [618984][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.053 [alg_configurator.cc:134] [618984]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[13]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.052 [alg_configurator.cc:68] [618985][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[WARNING] HCCL(618654,python3.9):2025-04-03-09:27:47.783.037 [hccl_aiv.cc:279] [618988][AIV][GetAivOpBinaryPath]ENV:LD_LIBRARY_PATH lack fwkacllib/lib64
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.067 [alg_configurator.cc:68] [618984][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.072 [alg_configurator.cc:241] [618985][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] DRV(618658,python3.9):2025-04-03-09:27:47.783.063 [devmm_svm.c:1972][ascend][curpid:618658,618982][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0x2; out_feature=0x2)
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.783.087 [hdc.cc:83] [618982][HDCommunicate]supportDevMemReg_ 1
[INFO] DRV(618650,python3.9):2025-04-03-09:27:47.783.073 [devmm_svm.c:1972][ascend][curpid:618650,618987][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0x2; out_feature=0x2)
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.783.092 [hdc.cc:83] [618987][HDCommunicate]supportDevMemReg_ 1
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.085 [alg_configurator.cc:241] [618984][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.095 [alg_configurator.cc:134] [618985]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.783.104 [api_impl.cc:1990] 618982 DevMalloc: size=4096, type=16, moduleId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.783.120 [api_error.cc:1218] 618982 DevMalloc: device malloc Succ, size=4096, type=16, moduleId=3, start ptr=0x12c280146000, end ptr=0x12c280147000
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.783.108 [api_impl.cc:1990] 618987 DevMalloc: size=4096, type=16, moduleId=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.783.123 [api_error.cc:1218] 618987 DevMalloc: device malloc Succ, size=4096, type=16, moduleId=3, start ptr=0x12c280146000, end ptr=0x12c280147000
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.100 [alg_configurator.cc:134] [618984]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[14]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.114 [alg_configurator.cc:68] [618984][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.126 [alg_configurator.cc:241] [618984][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.138 [alg_configurator.cc:134] [618984]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[15]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.113 [alg_configurator.cc:68] [618985][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.128 [alg_configurator.cc:241] [618985][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.140 [alg_configurator.cc:134] [618985]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[1]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.783.146 [api_impl.cc:2096] 618982 HostMalloc: size=4096
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.783.145 [api_impl.cc:2096] 618987 HostMalloc: size=4096
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.153 [alg_configurator.cc:68] [618984][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.167 [alg_configurator.cc:241] [618984][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.155 [alg_configurator.cc:68] [618985][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.168 [alg_configurator.cc:241] [618985][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.783.168 [api_error.cc:1260] 618982 HostMalloc: Host memory malloc succeed,size=4096 , moduleId=3, host addr=0x12c0807f0000.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.783.164 [api_error.cc:1260] 618987 HostMalloc: Host memory malloc succeed,size=4096 , moduleId=3, host addr=0x12c0807f0000.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.180 [alg_configurator.cc:134] [618984]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[16]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.195 [alg_configurator.cc:68] [618984][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.180 [alg_configurator.cc:134] [618985]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[2]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.196 [alg_configurator.cc:68] [618985][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.208 [alg_[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.209 [alg_configurator.cc:241] [618984][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.228 [alg_configurator.cc:134] [618984]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[17]
configurator.cc:241] [618985][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.233 [alg_configurator.cc:134] [618985]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[3]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.245 [alg_configurator.cc:68] [618985][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.244 [alg_configurator.cc:68] [618984][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.261 [alg_configurator.cc:241] [618984][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.260 [alg_configurator.cc:241] [618985][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.275 [alg_configurator.cc:134] [618984]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[18]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.275 [alg_configurator.cc:134] [618985]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[4]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.294 [alg_configurator.cc:68] [618985][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.309 [alg_configurator.cc:241] [618985][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.297 [alg_configurator.cc:449] [618984][AlgConfigurator][GetTopoTypeByAlgType]algtype[level0:fullmesh,level1:ring,level2:H-D], devicetype[2],topotype[8] is selected
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.315 [alg_configurator.cc:42] [618984]alg configurator init success.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.322 [alg_configurator.cc:134] [618985]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[5]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.340 [alg_configurator.cc:68] [618985][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.783.341 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.345 [topo_info_extractor.cc:66] [618984]factory init:collective id[192.168.0.44%enp67s0f5_60008_0_1743643662827273], user rank[4], user rank size[8], topo type[8], device Type[2], meshAggregationRankSize[8]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.354 [alg_configurator.cc:241] [618985][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.371 [topo_info_extractor.cc:155] [618984][SetRankInfo]rankData_: userRank[4], devicePhyId[4], serverIdx[0], superPodId[], superPodIdx[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.372 [alg_configurator.cc:134] [618985]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[6]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.387 [alg_configurator.cc:68] [618985][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.400 [alg_configurator.cc:241] [618985][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.783.397 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=0, infoType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.783.403 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.413 [alg_configurator.cc:134] [618985]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[7]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.783.407 [api_impl.cc:1990] 618987 DevMalloc: size=2100520, type=16, moduleId=3.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.429 [alg_configurator.cc:68] [618985][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.429 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.783.431 [api_impl.cc:1990] 618982 DevMalloc: size=2100520, type=16, moduleId=3.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.446 [alg_configurator.cc:241] [618985][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.461 [alg_configurator.cc:134] [618985]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[8]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.783.461 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=1, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.474 [alg_configurator.cc:68] [618985][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.485 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[1] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.491 [alg_configurator.cc:241] [618985][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.783.488 [api_error.cc:1218] 618987 DevMalloc: device malloc Succ, size=2100520, type=16, moduleId=3, start ptr=0x12c100c00000, end ptr=0x12c100e00d28
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.783.508 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.504 [alg_configurator.cc:134] [618985]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[9]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.519 [alg_configurator.cc:68] [618985][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.783.507 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=2, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.783.507 [api_error.cc:1218] 618982 DevMalloc: device malloc Succ, size=2100520, type=16, moduleId=3, start ptr=0x12c100c00000, end ptr=0x12c100e00d28
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.783.510 [api_impl.cc:2664] 618987 MemSetSync: destMax=2100520, value=0, count=2100520
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.783.527 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_float.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.533 [alg_configurator.cc:241] [618985][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.532 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.783.549 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=3, infoType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.783.531 [api_impl.cc:2664] 618982 MemSetSync: destMax=2100520, value=0, count=2100520
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.783.544 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_reduce_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.783.565 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.783.586 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.546 [alg_configurator.cc:134] [618985]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[10]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.561 [alg_configurator.cc:68] [618985][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.583 [alg_configurator.cc:241] [618985][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.595 [alg_configurator.cc:134] [618985]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[11]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.566 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[3] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.783.598 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=5, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.609 [alg_configurator.cc:68] [618985][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.616 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.783.635 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=6, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.624 [alg_configurator.cc:241] [618985][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.640 [alg_configurator.cc:134] [618985]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[12]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.655 [alg_configurator.cc:68] [618985][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.783.653 [api_impl.cc:1990] 618987 DevMalloc: size=32, type=16, moduleId=3.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.668 [alg_configurator.cc:241] [618985][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.654 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[6] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.783.681 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.682 [alg_configurator.cc:134] [618985]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[13]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.783.673 [api_impl.cc:1990] 618982 DevMalloc: size=32, type=16, moduleId=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.783.673 [api_error.cc:1218] 618987 DevMalloc: device malloc Succ, size=32, type=16, moduleId=3, start ptr=0x12c280147000, end ptr=0x12c280147020
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.783.673 [api_error.cc:3478] 618984 GetPairPhyDevicesInfo: input physic devId=4, input physic otherDevId=7, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.691 [adapter_rts.cc:940] [618984][hrtGetPairDeviceLinkTypeRaw]phyDevId[4] otherPhyDevId[7] linkTypeRaw[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.783.696 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_half.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.698 [alg_configurator.cc:68] [618985][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.713 [alg_configurator.cc:241] [618985][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.783.695 [api_error.cc:1218] 618982 DevMalloc: device malloc Succ, size=32, type=16, moduleId=3, start ptr=0x12c280147000, end ptr=0x12c280147020
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.783.693 [api_impl.cc:2664] 618987 MemSetSync: destMax=32, value=0, count=32
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.783.724 [peterson_lock.cc:69] [618987][PetersonLock][AllocDeviceMem] Type[Host] alloc memSize[32 Byte]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.709 [topo_info_extractor.cc:348] [618984]check server info:server rank size[8], expected value[8], topo type[8]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.783.712 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_reduce_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.783.729 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.730 [alg_configurator.cc:134] [618985]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[14]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.744 [alg_configurator.cc:68] [618985][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.757 [alg_configurator.cc:241] [618985][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.783.729 [api_impl.cc:2664] 618982 MemSetSync: destMax=32, value=0, count=32
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.783.760 [peterson_lock.cc:69] [618982][PetersonLock][AllocDeviceMem] Type[Host] alloc memSize[32 Byte]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.783.737 [peterson_lock.cc:47] [618987][PetersonLock][Init] type [Host] init success, memSize [32 Byte] timeout[60 s]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.783.749 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.772 [alg_configurator.cc:134] [618985]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[15]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.789 [alg_configurator.cc:68] [618985][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.783.776 [peterson_lock.cc:47] [618982][PetersonLock][Init] type [Host] init success, memSize [32 Byte] timeout[60 s]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.804 [alg_configurator.cc:241] [618985][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.817 [alg_configurator.cc:134] [618985]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[16]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.783.771 [hccl_comm.cc:129] [618987]hcclCommInitInfo:commId[hccl-618650-0-1743643665-hccl_world_group], rank[1], totalRanks[8], serverId[192.168.0.44%enp67s0f5], deviceType[2],logicDevId[1], identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.783.794 [hccl_comm.cc:175] [618987][SetQpQosAttr]The TC and SL do not use the config configuration. It will use environment variables to configure. TC[132], SL[4]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.783.809 [hccl_comm.cc:129] [618982]hcclCommInitInfo:commId[hccl-618658-0-1743643665-hccl_world_group], rank[3], totalRanks[8], serverId[192.168.0.44%enp67s0f5], deviceType[2],logicDevId[3], identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.832 [alg_configurator.cc:68] [618985][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.783.808 [topo_matcher.cc:528] [618987][SetAivMode]AivMode is set to [0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.783.823 [topo_matcher.cc:540] [618987][SetAicpuMode]Aicpu is set to [0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.783.839 [hcom_plugin.cc:349] [618987][Set][GroupTopoInfo]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] rankSize[8].
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.783.845 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.783.830 [hccl_comm.cc:175] [618982][SetQpQosAttr]The TC and SL do not use the config configuration. It will use environment variables to configure. TC[132], SL[4]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.783.848 [topo_matcher.cc:528] [618982][SetAivMode]AivMode is set to [0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.846 [alg_configurator.cc:241] [618985][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.861 [alg_configurator.cc:134] [618985]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[17]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.854 [topo_info_extractor.cc:888] [618984]SetTopoInfoForLevel0: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[4], userRankSize[8], topoRankInfo[userRank/devicePhyId: 0/0; 1/1; 2/2; 3/3; 4/4; 5/5; 6/6; 7/7; ]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.783.860 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_int16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.783.876 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_reduce_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.783.861 [topo_matcher.cc:540] [618982][SetAicpuMode]Aicpu is set to [0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.783.882 [hcom_plugin.cc:349] [618982][Set][GroupTopoInfo]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] rankSize[8].
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.878 [alg_configurator.cc:68] [618985][Set][AlgType] isConfigAHC[0] isConfigNULL[0] multiModuleDiffDeviceNumMode[0] multiSuperPodDiffServerNumMode[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.783.879 [runtime.cc:5239] 618987 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.783.890 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.886 [topo_info_extractor.cc:585] [618984][Set][TopoInfoForLevel1] topoType_[8] ringSize[8]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.896 [alg_configurator.cc:241] [618985][AlgConfigurator][GetDefaultAlgoLevel1V1] algType[2], moduleNum[1]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.783.923 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.783.898 [adapter_rts.cc:198] [618987][hrtGetDeviceRefresh]deviceLogicId[1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.783.924 [hcom_co[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.783.915 [runtime.cc:5239] 618982 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.783.933 [adapter_rts.cc:198] [618982][hrtGetDeviceRefresh]deviceLogicId[3]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.913 [topo_info_extractor.cc:646] [618984][Set][TopoInfoForLevel1] calc subGroup superPodId[] subIndex[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.930 [topo_info_extractor.cc:685] [618984]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 0, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 0/192.168.0.44/0/192.168.100.101/0; ]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.917 [alg_configurator.cc:134] [618985]Device Type[2], average device count[8], HccsNum[8], SIONum[0], HCCS_SW_NUM[0], optype[18]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.940 [alg_configurator.cc:449] [618985][AlgConfigurator][GetTopoTypeByAlgType]algtype[level0:fullmesh,level1:ring,level2:H-D], devicetype[2],topotype[8] is selected
mmon.cc:85] [618987][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[1] 
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.783.954 [op_base.cc:128] [618987][HcclGetDeviceId] deviceLogicId[1] 
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.783.949 [hcom_common.cc:85] [618982][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[3] 
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.783.966 [op_base.cc:128] [618982][HcclGetDeviceId] deviceLogicId[3] 
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.948 [topo_info_extractor.cc:685] [618984]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 1, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 1/192.168.0.44/1/29.105.19.202/0; ]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.968 [topo_info_extractor.cc:685] [618984]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 2, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 2/192.168.0.44/2/29.105.165.16/0; ]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.954 [alg_configurator.cc:42] [618985]alg configurator init success.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.783.978 [topo_info_extractor.cc:66] [618985]factory init:collective id[192.168.0.44%enp67s0f5_60008_0_1743643662827273], user rank[7], user rank size[8], topo type[8], device Type[2], meshAggregationRankSize[8]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.783.968 [hccl_comm.cc:1296] [618987]HCCL_KEY_INFO: GetTopoDesc topoDescs[0xfffed9fbccb8] topoSize[2]
[INFO] GE(618650,python3.9):2025-04-03-09:27:47.783.993 [hcom_topo_info.cc:24]618987 SetGroupTopoInfo:Add group 192.168.0.44%enp67s0f5_60008_0_1743643662827273 successfully.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.783.979 [hccl_comm.cc:1296] [618982]HCCL_KEY_INFO: GetTopoDesc topoDescs[0xfffec6fdccb8] topoSize[2]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.783.984 [topo_info_extractor.cc:685] [618984]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 3, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 3/192.168.0.44/3/29.105.51.138/0; ]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.784.001 [topo_info_extractor.cc:685] [618984]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 4, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 4/192.168.0.44/4/29.105.24.184/1; ]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.002 [topo_info_extractor.cc:155] [618985][SetRankInfo]rankData_: userRank[7], devicePhyId[7], serverIdx[0], superPodId[], superPodIdx[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.784.007 [hcom_plugin.cc:371] [618987][Set][GroupTopoInfo]SetGroupTopoInfo group set success
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.015 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] GE(618658,python3.9):2025-04-03-09:27:47.784.005 [hcom_topo_info.cc:24]618982 SetGroupTopoInfo:Add group 192.168.0.44%enp67s0f5_60008_0_1743643662827273 successfully.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.784.022 [hcom_plugin.cc:371] [618982][Set][GroupTopoInfo]SetGroupTopoInfo group set success
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.784.017 [topo_info_extractor.cc:685] [618984]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 5, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 5/192.168.0.44/5/29.105.72.114/0; ]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.784.035 [topo_info_extractor.cc:685] [618984]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 6, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 6/192.168.0.44/6/29.105.134.38/0; ]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.784.024 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=0, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.784.031 [topoinfo_detect.cc:555] [618987]NetworkManager stop host net success! ip[192.168.0.44%enp67s0f5] 
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.784.047 [topoinfo_detect.cc:321] [618987]TopoInfoDetect TeardownAgent ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.784.059 [topoinfo_detect.cc:219] [618987]TopoInfoDetect TeardownServer ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.031 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_int32_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.045 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_reduce_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.062 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.784.047 [topoinfo_detect.cc:555] [618982]NetworkManager stop host net success! ip[192.168.0.44%enp67s0f5] 
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.784.064 [topoinfo_detect.cc:321] [618982]TopoInfoDetect TeardownAgent ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.784.078 [topoinfo_detect.cc:219] [618982]TopoInfoDetect TeardownServer ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.784.050 [topo_info_extractor.cc:685] [618984]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 7, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 7/192.168.0.44/7/29.105.73.96/0; ]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.784.063 [topo_info_extractor.cc:689] [618984]SetTopoInfoForLevel1: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[4], userRankSize[8], plane size[8]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.784.077 [topo_info_extractor.cc:697] [618984][Set][TopoInfoForLevel2] select origin proc
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.053 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[0] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.784.083 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=1, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.784.080 [op_base.cc:1050] [618987][InitCommRootInfo]Init success, rankNum[8], rank[1], rootInfo identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], server[192.168.0.44%enp67s0f5], logicDevId[1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.784.099 [profiler_base.cc:342] [618987]AddGroupUdi: group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] udi[] deviceLogicId[1]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.081 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.784.107 [op_base.cc:1050] [618982][InitCommRootInfo]Init success, rankNum[8], rank[3], rootInfo identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], server[192.168.0.44%enp67s0f5], logicDevId[3]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.784.090 [topo_info_extractor.cc:734] [618984]SetTopoInfoForLevel2: topoRankInfo[userRank/devicePhyId/serverIdx/superPodId: 4/4/0/; ]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.784.103 [topo_info_extractor.cc:739] [618984]SetTopoInfoForLevel2: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[4], userRankSize[8], plane size[1]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.784.116 [topo_info_extractor.cc:585] [618984][Set][TopoInfoForLevel1] topoType_[8] ringSize[8]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.101 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[1] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.784.120 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=2, infoType=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.784.115 [op_base.cc:1107] [618987][HCCL_TRACE]HcclCommInitRootInfoInner success, take time [4488086]us, rankNum[8], rank[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.784.124 [profiler_base.cc:342] [618982]AddGroupUdi: group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] udi[] deviceLogicId[3]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.784.141 [op_base.cc:1107] [618982][HCCL_TRACE]HcclCommInitRootInfoInner success, take time [4486777]us, rankNum[8], rank[3]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.784.134 [topo_info_extractor.cc:646] [618984][Set][TopoInfoForLevel1] calc subGroup superPodId[] subIndex[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.784.150 [topo_info_extractor.cc:685] [618984]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 0, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 0/192.168.0.44/0/192.168.100.101/0; ]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.136 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[2] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.784.153 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=3, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.184 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[3] linkTypeRaw[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.784.191 [topo_info_extractor.cc:685] [618984]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 1, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 1/192.168.0.44/1/29.105.19.202/0; ]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.180 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.196 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_int8_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.210 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_reduce_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.223 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.784.218 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=4, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.784.213 [topo_info_extractor.cc:685] [618984]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 2, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 2/192.168.0.44/2/29.105.165.16/0; ]
[WARNING] DEVICE(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.784.211 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:157] InitializeByRootInfoConfig] End to initialize communicator by HcclCommInitRootInfo for hccl_world_group
[WARNING] DEVICE(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.784.212 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:157] InitializeByRootInfoConfig] End to initialize communicator by HcclCommInitRootInfo for hccl_world_group
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.248 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.241 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[4] linkTypeRaw[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.784.253 [topo_info_extractor.cc:685] [618984]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 3, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 3/192.168.0.44/3/29.105.51.138/0; ]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.784.251 [op_base.cc:853] [618982]HcclGetCommName input handle=0xfffeac022f40 commName=192.168.0.44%enp67s0f5_60008_0_1743643662827273
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.784.249 [op_base.cc:853] [618987]HcclGetCommName input handle=0xfffeb8022f40 commName=192.168.0.44%enp67s0f5_60008_0_1743643662827273
[INFO] DEVICE(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.784.283 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:93] Initialize] Start initializing hccl watchdog on device side for group: hccl_world_group, rank: 1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.784.261 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=5, infoType=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.279 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[5] linkTypeRaw[0]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.784.293 [api_error.cc:3478] 618985 GetPairPhyDevicesInfo: input physic devId=7, input physic otherDevId=6, infoType=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.784.274 [topo_info_extractor.cc:685] [618984]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 4, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 4/192.168.0.44/4/29.105.24.184/1; ]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.784.291 [topo_info_extractor.cc:685] [618984]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 5, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 5/192.168.0.44/5/29.105.72.114/0; ]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.784.306 [topo_info_extractor.cc:685] [618984]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 6, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 6/192.168.0.44/6/29.105.134.38/0; ]
[INFO] DEVICE(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.784.285 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:93] Initialize] Start initializing hccl watchdog on device side for group: hccl_world_group, rank: 3
[INFO] DEVICE(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.784.304 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:77] Initialize] Initialize hccl watch dog handler. rank id: 1, group name: hccl_world_group
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.310 [adapter_rts.cc:940] [618985][hrtGetPairDeviceLinkTypeRaw]phyDevId[7] otherPhyDevId[6] linkTypeRaw[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.330 [topo_info_extractor.cc:348] [618985]check server info:server rank size[8], expected value[8], topo type[8]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.784.321 [topo_info_extractor.cc:685] [618984]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 7, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 7/192.168.0.44/7/29.105.73.96/0; ]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.784.334 [topo_info_extractor.cc:689] [618984]SetTopoInfoForLevel1: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[4], userRankSize[8], plane size[8]
[INFO] DEVICE(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.784.323 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:77] Initialize] Initialize hccl watch dog handler. rank id: 3, group name: hccl_world_group
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.341 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.356 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_bfloat16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.369 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_reduce_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.381 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.784.368 [topo_info_extractor.cc:790] [618984]SetTopoInfoForMeshL1: topoRankInfo[userRank/devicePhyId4/4; ]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.399 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.784.393 [topo_info_extractor.cc:519] [618984]plane info:topo type[8], device type[2], COMM_COMBINE size[1], COMM_LEVEL0 size[7], COMM_LEVEL1 size[8], COMM_LEVEL2 size[1], COMM_MESH_L0 size[1], COMM_MESH_L1 size[1]
[INFO] DEVICE(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.784.427 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:98] Initialize] hccl watchdog on device side is successfully initialized.
[INFO] DEVICE(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.784.450 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:98] Initialize] hccl watchdog on device side is successfully initialized.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.784.449 [device.cpp:183]618987 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 1.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.464 [topo_info_extractor.cc:888] [618985]SetTopoInfoForLevel0: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[7], userRankSize[8], topoRankInfo[userRank/devicePhyId: 0/0; 1/1; 2/2; 3/3; 4/4; 5/5; 6/6; 7/7; ]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.784.474 [api_impl.cc:3419] 618987 DeviceReset: reset device, device_id=1.
[INFO] DEVICE(618650,fffed8f9efa0,python3.9):2025-04-03-09:27:47.784.480 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:155] WatchDogProcess] WatchDogProcess start, rank id: 1, group name: hccl_world_group
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.784.473 [device.cpp:183]618982 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 3.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.489 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.493 [topo_info_extractor.cc:585] [618985][Set][TopoInfoForLevel1] topoType_[8] ringSize[8]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.784.489 [runtime.cc:3444] 618987 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x8, reset:0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.784.497 [api_impl.cc:3419] 618982 DeviceReset: reset device, device_id=3.
[INFO] DEVICE(618658,fffec5fbefa0,python3.9):2025-04-03-09:27:47.784.505 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:155] WatchDogProcess] WatchDogProcess start, rank id: 3, group name: hccl_world_group
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.506 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_half.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.519 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_vc_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.784.514 [api_impl.cc:3449] 618987 DeviceReset: Succ, userDeviceId=1.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.784.529 [device.cpp:189]618987 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.784.512 [runtime.cc:3444] 618982 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x8, reset:0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.784.537 [api_impl.cc:3449] 618982 DeviceReset: Succ, userDeviceId=3.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.514 [topo_info_extractor.cc:646] [618985][Set][TopoInfoForLevel1] calc subGroup superPodId[] subIndex[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.535 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.784.538 [api_impl.cc:1990] 618984 DevMalloc: size=32, type=16, moduleId=3.
[INFO] DEVICE(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.784.551 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_communication_group.cc:58] Initialize] Successfully initialize HCCL group hccl_world_group
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.784.549 [device.cpp:189]618982 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 3.
[INFO] DEVICE(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.784.574 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_communication_group.cc:58] Initialize] Successfully initialize HCCL group hccl_world_group
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.548 [topo_info_extractor.cc:685] [618985]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 0, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 0/192.168.0.44/0/192.168.100.101/0; ]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.566 [topo_info_extractor.cc:685] [618985]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 1, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 1/192.168.0.44/1/29.105.19.202/0; ]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.581 [topo_info_extractor.cc:685] [618985]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 2, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 2/192.168.0.44/2/29.105.165.16/0; ]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.553 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.784.568 [api_error.cc:1218] 618984 DevMalloc: device malloc Succ, size=32, type=16, moduleId=3, start ptr=0x12c280003000, end ptr=0x12c280003020
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.597 [topo_info_extractor.cc:685] [618985]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 3, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 3/192.168.0.44/3/29.105.51.138/0; ]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.613 [topo_info_extractor.cc:685] [618985]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 4, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 4/192.168.0.44/4/29.105.24.184/0; ]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.784.618 [hccl_impl.cc:59] [618984]start hccl resources build:get deviceLogicId[4]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.627 [topo_info_extractor.cc:685] [618985]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 5, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 5/192.168.0.44/5/29.105.72.114/0; ]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.643 [topo_info_extractor.cc:685] [618985]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 6, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 6/192.168.0.44/6/29.105.134.38/0; ]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.645 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.661 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_int16_t.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.660 [topo_info_extractor.cc:685] [618985]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 7, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 7/192.168.0.44/7/29.105.73.96/1; ]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.678 [topo_info_extractor.cc:689] [618985]SetTopoInfoForLevel1: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[7], userRankSize[8], plane size[8]
[INFO] DISTRIBUTED(618650,fffeda7cefa0,python3.9):2025-04-03-09:27:47.784.651 [mindspore/ccsrc/distributed/collective/collective_manager.cc:824] CreateDeviceCommunicator] [PROF]InitDeviceCommunicator costs 4650.55 msec.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.679 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_vc_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] DISTRIBUTED(618658,fffec77eefa0,python3.9):2025-04-03-09:27:47.784.671 [mindspore/ccsrc/distributed/collective/collective_manager.cc:824] CreateDeviceCommunicator] [PROF]InitDeviceCommunicator costs 4893.09 msec.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.694 [topo_info_extractor.cc:697] [618985][Set][TopoInfoForLevel2] select origin proc
[WARNING] DISTRIBUTED(618658,fffec77eefa0,python3.9):2025-04-03-09:27:47.784.716 [mindspore/ccsrc/distributed/collective/collective_manager.cc:828] CreateDeviceCommunicator] End initialize communication group on the device side: hccl_world_group
[WARNING] DISTRIBUTED(618650,fffeda7cefa0,python3.9):2025-04-03-09:27:47.784.696 [mindspore/ccsrc/distributed/collective/collective_manager.cc:828] CreateDeviceCommunicator] End initialize communication group on the device side: hccl_world_group
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.696 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.717 [elf.cc:566] 618983 ParaseKernelMetaData: d[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.709 [topo_info_extractor.cc:734] [618985]SetTopoInfoForLevel2: topoRankInfo[userRank/devicePhyId/serverIdx/superPodId: 7/7/0/; ]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.723 [topo_info_extractor.cc:739] [618985]SetTopoInfoForLevel2: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[7], userRankSize[8], plane size[1]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.735 [topo_info_extractor.cc:585] [618985][Set][TopoInfoForLevel1] topoType_[8] ringSize[8]
ataFlag=1
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.784.742 [hccl_impl.cc:177] [618984]hcclImpl init success.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.752 [topo_info_extractor.cc:646] [618985][Set][TopoInfoForLevel1] calc subGroup superPodId[] subIndex[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.767 [topo_info_extractor.cc:685] [618985]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 0, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 0/192.168.0.44/0/192.168.100.101/0; ]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.784 [topo_info_extractor.cc:685] [618985]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 1, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 1/192.168.0.44/1/29.105.19.202/0; ]
[WARNING] HCCL(618662,python3.9):2025-04-03-09:27:47.784.771 [hccl_aiv.cc:279] [618984][AIV][GetAivOpBinaryPath]ENV:LD_LIBRARY_PATH lack fwkacllib/lib64
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.784.772 [mindspore/ccsrc/distributed/collective/collective_manager.cc:404] CreateCommunicationGroup] [PROF]distributed_create_group costs 5151.96 msec.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.802 [topo_info_extractor.cc:685] [618985]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 2, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 2/192.168.0.44/2/29.105.165.16/0; ]
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.784.810 [mindspore/ccsrc/distributed/collective/collective_manager.cc:225] Initialize] [PROF]CreateGlobalCommunicationGroup costs 5152.02 msec.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.820 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.784.803 [mindspore/ccsrc/distributed/collective/collective_manager.cc:404] CreateCommunicationGroup] [PROF]distributed_create_group costs 7895.83 msec.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.826 [topo_info_extractor.cc:685] [618985]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 3, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 3/192.168.0.44/3/29.105.51.138/0; ]
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.784.835 [mindspore/ccsrc/distributed/collective/collective_manager.cc:228] Initialize] End initializing collective communication for backend: Ascend
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.784.853 [mindspore/ccsrc/distributed/collective/collective_manager.cc:225] Initialize] [PROF]CreateGlobalCommunicationGroup costs 7895.9 msec.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.836 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_uint16_t.
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.784.861 [mindspore/ccsrc/distributed/init.cc:62] Initialize] [PROF]distributed_collective_init costs 9284.14 msec.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.846 [topo_info_extractor.cc:685] [618985]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 4, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 4/192.168.0.44/4/29.105.24.184/0; ]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.849 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_vc_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.865 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.884 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.784.878 [mindspore/ccsrc/distributed/collective/collective_manager.cc:228] Initialize] End initializing collective communication for backend: Ascend
[INFO] PIPELINE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.784.900 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:254] RecordInitStatus] Status record: system init.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.882 [topo_info_extractor.cc:685] [618985]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 5, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 5/192.168.0.44/5/29.105.72.114/0; ]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.901 [topo_info_extractor.cc:685] [618985]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 6, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 6/192.168.0.44/6/29.105.134.38/0; ]
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.784.910 [mindspore/ccsrc/distributed/init.cc:62] Initialize] [PROF]distributed_collective_init costs 9016.29 msec.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.919 [topo_info_extractor.cc:685] [618985]SetTopoInfoForLevel1: topoRankInfo[ ringIndex: 7, userRank/serverId/devicePhyId/nicIp/isBridgeRank: 7/192.168.0.44/7/29.105.73.96/1; ]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.932 [topo_info_extractor.cc:689] [618985]SetTopoInfoForLevel1: identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], userRank[7], userRankSize[8], plane size[8]
[INFO] PIPELINE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.784.951 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:254] RecordInitStatus] Status record: system init.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.965 [topo_info_extractor.cc:790] [618985]SetTopoInfoForMeshL1: topoRankInfo[userRank/devicePhyId7/7; ]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.975 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.784.989 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_float.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.784.987 [topo_info_extractor.cc:519] [618985]plane info:topo type[8], device type[2], COMM_COMBINE size[1], COMM_LEVEL0 size[7], COMM_LEVEL1 size[8], COMM_LEVEL2 size[1], COMM_MESH_L0 size[1], COMM_MESH_L1 size[1]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.001 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_vc_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.017 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.037 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.785.110 [api_impl.cc:1990] 618985 DevMalloc: size=32, type=16, moduleId=3.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.130 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.145 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_int32_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.785.141 [api_error.cc:1218] 618985 DevMalloc: device malloc Succ, size=32, type=16, moduleId=3, start ptr=0x12c280003000, end ptr=0x12c280003020
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.159 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_vc_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.173 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.192 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.785.185 [hccl_impl.cc:59] [618985]start hccl resources build:get deviceLogicId[7]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.785.186 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.785.254 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.287 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.301 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_uint32_t.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.785.306 [hccl_impl.cc:177] [618985]hcclImpl init success.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.315 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_vc_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.330 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[WARNING] HCCL(618674,python3.9):2025-04-03-09:27:47.785.336 [hccl_aiv.cc:279] [618985][AIV][GetAivOpBinaryPath]ENV:LD_LIBRARY_PATH lack fwkacllib/lib64
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.348 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.785.368 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.785.390 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_float.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.785.411 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_reduce_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.438 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.785.435 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.453 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_int8_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.464 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_vc_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.785.463 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.482 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.499 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.785.571 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.586 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.785.591 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_half.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.601 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_uint8_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.785.611 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_reduce_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.620 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_vc_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.636 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.785.632 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.657 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.785.657 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.744 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.758 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_bfloat16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.771 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_vc_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.785.759 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.785.777 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_int16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.785 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.804 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.785.793 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_reduce_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.785.813 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.785.839 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.900 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.916 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_half.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.929 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_v_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.945 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.785.936 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.785.965 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.785.956 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_int32_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.785.972 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_reduce_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.785.989 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.786.013 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.054 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.069 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_int16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.081 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_v_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.094 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.112 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.786.110 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.786.129 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_int8_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.786.148 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_reduce_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.786.164 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.786.185 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.201 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.216 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_uint16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.228 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_v_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.241 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.260 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.786.292 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.786.311 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_bfloat16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.786.325 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_reduce_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.786.342 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.348 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.786.365 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.363 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_float.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.374 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_v_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.394 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.412 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.786.403 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.786.462 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.786.467 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.786.479 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_half.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.500 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.786.494 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_vc_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.515 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_int32_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.786.514 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.533 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_v_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.547 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.786.539 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.566 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.786.575 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.786.595 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_float.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.786.615 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_reduce_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.786.638 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.786.633 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.786.651 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_int16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.655 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.786.666 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_vc_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.670 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_uint32_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.786.664 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.685 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_v_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.786.683 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.701 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.786.707 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.720 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.786.775 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.786.792 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_half.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.809 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.786.802 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.786.818 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_uint16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.824 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_int8_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.786.832 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_vc_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.786.811 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_reduce_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.838 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_v_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.786.847 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.786.845 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.853 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.873 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.786.868 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.786.870 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.786.894 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.786.954 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.966 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.786.970 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.786.967 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.786.986 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_float.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.981 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_uint8_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.786.987 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_int16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.786.995 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_v_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.009 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.005 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_reduce_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.004 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_vc_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.023 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.028 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.021 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.046 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.044 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.057 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.075 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_float.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.096 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_reduce_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.121 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.119 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.139 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_bfloat16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.140 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.150 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_v_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.144 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.157 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_int32_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.141 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.168 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_int32_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.164 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.173 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_reduce_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.186 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_vc_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.191 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.189 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.200 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.211 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.221 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.244 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.261 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_half.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.282 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.278 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_reduce_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.297 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_half.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.297 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.309 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.306 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.323 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.311 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.319 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.322 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_int8_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.329 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_uint32_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.344 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_vc_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.342 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.339 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_reduce_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.357 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.359 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.376 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.380 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.417 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.433 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.448 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_int16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.434 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_int16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.464 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.463 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_reduce_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.483 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.472 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.478 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.479 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.497 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_int8_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.488 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_bfloat16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.504 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_reduce_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.496 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.504 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.515 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_vc_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.519 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.533 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.542 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.553 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.591 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.604 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_uint16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.601 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.619 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.619 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_int32_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.632 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.634 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_reduce_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.637 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.651 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.645 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.650 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.654 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_half.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.669 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_vc_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.663 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_uint8_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.678 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_vc_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.675 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.685 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.692 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.714 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.713 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.741 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.755 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_float.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.768 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.766 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.783 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.785 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_int8_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.804 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_reduce_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.803 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.805 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.822 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_bfloat16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.820 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.803 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.820 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_int16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.834 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_vc_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.837 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_vc_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.849 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.842 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.856 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.869 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.877 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.892 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.905 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_int32_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.918 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.932 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.933 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.787.950 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.950 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_reduce_bfloat16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.969 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_reduce_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.961 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.977 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_uint16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.969 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.787.993 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_vc_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.787.984 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.787.988 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_half.
[INFO] RUNTIME[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.008 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.008 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
(618654,python3.9):2025-04-03-09:27:47.788.003 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_v_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.030 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.039 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.788.041 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.063 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_uint32_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.788.066 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.076 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.090 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.107 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.100 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.118 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_half.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.133 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_vc_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.124 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.141 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_float.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.167 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_vc_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.148 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.190 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.183 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.788.177 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.788.200 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_int16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.210 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.788.218 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_v_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.218 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.240 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_int8_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.788.238 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.255 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.270 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.788.264 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.277 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.294 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_int16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.290 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.300 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.310 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_vc_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.318 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_int32_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.334 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_vc_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.336 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.348 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.357 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.788.359 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.369 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.788.376 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_uint16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.382 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.397 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_uint8_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.788.391 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_v_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.411 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.788.412 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.425 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.444 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.788.437 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.448 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.466 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_uint16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.459 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.475 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_uint32_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.480 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_vc_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.491 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_vc_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.506 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.497 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.519 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.534 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.788.531 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.527 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.548 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_bfloat16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.788.547 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_float.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.561 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.575 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.788.565 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_v_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.788.586 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.594 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.788.607 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.612 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.628 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_float.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.642 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_vc_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.620 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.646 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_int8_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.658 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.662 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_vc_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.680 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.685 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.680 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.700 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_half.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.701 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.711 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.788.703 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.726 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.788.720 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_int32_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.788.735 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_v_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.746 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.788.753 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.788.773 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.777 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.793 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_int32_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.807 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_vc_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.791 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.808 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_uint8_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.823 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_vc_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.823 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.835 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.838 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.846 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.850 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_int16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.868 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.862 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.788.872 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.884 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.788.890 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_uint32_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.904 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.788.910 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_v_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.935 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.788.928 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.952 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_uint32_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.968 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_vc_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.788.960 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.959 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.975 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_bfloat16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.788.985 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.788.992 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.004 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.788.991 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_vc_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.008 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_uint16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.006 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.026 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.024 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.038 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.057 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.052 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.069 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_int8_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.085 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_v_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.093 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.103 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.109 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_int8_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.116 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.124 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.128 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_vc_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.132 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_half.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.146 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_v_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.149 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.144 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.162 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.164 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_float.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.182 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.164 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.181 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.198 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.216 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.216 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.234 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_uint8_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.249 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_v_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.264 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.268 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.276 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.280 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_uint8_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.294 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_vc_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.293 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.292 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_int16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.307 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_v_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.310 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.307 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.325 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.330 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.323 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_int32_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.334 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.349 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.347 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.368 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.388 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.406 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_bfloat16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.419 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_v_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.421 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.437 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_vc_bfloat16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.437 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.449 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.456 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.455 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_vc_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.461 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.473 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_uint32_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.477 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.486 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.466 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_uint16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.495 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_v_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.500 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.498 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.512 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.519 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.533 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.556 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.573 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_half.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.587 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.591 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.603 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.609 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_half.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.613 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.626 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.625 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.625 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_v_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.643 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.629 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_int8_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.643 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.644 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_float.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.664 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.657 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.658 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_v_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.676 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.682 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.695 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.719 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.736 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_int16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.750 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.753 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.769 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_int16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.772 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.766 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.789 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_uint8_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.785 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_v_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.790 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.803 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.803 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.789 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.807 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_int32_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.822 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_v_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.821 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.825 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.838 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.840 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.860 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.897 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.914 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_uint16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.927 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.920 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.938 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_uint16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.936 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.951 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_bfloat16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.943 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.953 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.953 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_v_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.963 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_to_all_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.789.966 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.971 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_uint32_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.973 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.979 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.789.998 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.789.986 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_v_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.003 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.789.994 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.022 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.068 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.086 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.081 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.085 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_float.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.102 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_float.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.106 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_float.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.121 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_v_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.111 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.105 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.123 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.116 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_reduce_scatter_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.128 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_int8_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.143 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_v_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.145 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.131 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.151 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.141 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.159 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.165 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.183 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.239 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.236 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.254 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_half.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.255 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.269 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_reduce_scatter_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.253 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_int32_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.273 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.273 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_int32_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.283 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.275 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.292 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.289 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_v_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.305 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.291 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_uint8_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.305 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_v_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.328 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.301 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.310 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.326 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.350 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.391 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.405 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_int16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.400 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.413 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.420 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_reduce_scatter_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.419 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_uint32_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.431 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_uint32_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.435 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.436 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.454 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.444 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.445 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_v_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.461 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.455 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.460 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_bfloat16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.474 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_v_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.480 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.474 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.491 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.510 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.555 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.570 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_int32_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.569 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.587 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_reduce_scatter_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.570 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.588 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_int8_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.600 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.597 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.588 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_int8_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.603 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.603 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_v_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.619 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.621 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.615 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_half.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.630 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.618 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.638 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.639 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.646 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.665 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.711 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.725 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_int8_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.736 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_reduce_scatter_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.727 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.745 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_uint8_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.731 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.752 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.762 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_v_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.757 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.749 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_uint8_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.772 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.773 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.777 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.775 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_int16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.790 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.790 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.796 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.806 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.810 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.826 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.867 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.881 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_bfloat16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.884 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.894 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_reduce_scatter_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.908 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.901 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_bfloat16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.906 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.923 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_bfloat16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.917 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.790.928 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.920 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_v_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.939 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.934 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_uint16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.949 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.945 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.790.965 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.954 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.790.974 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.964 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.790.984 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.020 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.034 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_float.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.046 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.052 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.060 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.065 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.070 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_half.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.080 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.074 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.083 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_half.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.084 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.101 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.090 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_float.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.104 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.117 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.099 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.117 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.120 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.136 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.136 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.168 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.182 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_half.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.193 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.206 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.218 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.225 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.227 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.236 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.235 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_int16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.245 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_int16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.260 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.251 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.267 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.254 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_int32_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.272 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.288 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.278 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.287 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.301 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.307 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.314 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.329 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_int16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.346 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.362 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.380 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.378 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.392 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.398 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_uint16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.397 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.412 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.427 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.410 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_uint16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.425 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.414 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_uint32_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.429 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.442 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.442 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.446 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.463 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.470 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.465 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.485 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_int32_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.496 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.510 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.528 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.536 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.555 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_float.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.554 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.560 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.571 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.571 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_int8_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.585 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.577 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_float.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.590 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.602 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.592 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.621 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.613 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.617 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.619 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.632 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_int8_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.645 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.645 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.660 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.679 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.703 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.713 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.720 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_int32_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.728 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_uint8_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.734 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.743 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.741 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.749 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.758 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.766 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.759 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_int32_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.774 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.778 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.780 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_bfloat16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.778 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.790 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.794 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.810 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.809 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.826 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.870 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.872 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.888 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_bfloat16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.903 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.887 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_uint32_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.902 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.907 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.914 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.921 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_uint32_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.918 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.924 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.930 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_half.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.935 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.791.940 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.791.945 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.944 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_gather_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.959 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.953 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.791.974 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.791.978 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.037 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.036 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.061 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_half.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.054 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_int8_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.069 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.077 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.071 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.070 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.086 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.094 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.107 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.089 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_int16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.104 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_gather_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.088 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_int8_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.103 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.117 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.113 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.132 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.138 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.151 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.205 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.225 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_uint8_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.216 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.233 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_int16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.244 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.252 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.240 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.249 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.261 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_uint8_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.266 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_uint16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.261 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.270 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.279 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_gather_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.276 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.284 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.293 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.295 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.297 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.314 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.318 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.373 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.382 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.390 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_v_sp_bfloat16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.398 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_uint16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.407 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.405 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_v_sp_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.412 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.414 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.430 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.424 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_float.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.422 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.444 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.429 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_bfloat16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.445 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_to_all_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.449 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.439 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_gather_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.455 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.472 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.459 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.493 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.536 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.535 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.561 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.553 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_half.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.554 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_float.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.568 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.576 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_int32_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.571 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.588 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.584 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
=================================================================================================================== test session starts ====================================================================================================================
platform linux -- Python 3.9.19, pytest-6.2.5, py-1.11.0, pluggy-1.5.0
rootdir: /home/jenkins/mindspore/testcases/testcases/tests/st/lccl
plugins: requests-mock-1.12.1, hydra-core-1.3.2, mock-3.14.0, forked-1.6.0, xdist-1.32.0
collected 1 item

test_lccl_allreduce.py [INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.590 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_gather_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.591 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.609 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_float.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.605 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.607 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.626 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.624 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_reduce_scatter_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.609 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.639 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.663 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.694 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.717 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.711 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_int32_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.711 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.729 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.733 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_uint32_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.729 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_int16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.744 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.747 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_gather_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.747 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.760 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.763 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.760 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.782 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.771 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.782 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.778 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_half.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.793 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_reduce_scatter_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.807 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.828 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.864 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.871 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.873 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.886 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_int8_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.900 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_gather_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.881 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_uint32_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.895 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.891 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_uint16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.908 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.920 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.915 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.916 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.935 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_int16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.926 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.792.941 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.792.942 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.792.949 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.951 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_reduce_scatter_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.969 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.792.989 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.033 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.036 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.041 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.048 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_uint8_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.054 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_int8_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.058 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_float.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.074 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.063 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_gather_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.073 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.078 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.081 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.099 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_int32_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.097 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.092 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.094 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.115 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.117 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.116 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_reduce_scatter_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.135 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.157 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.187 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.203 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_bfloat16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.207 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.206 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.215 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_gather_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.224 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_uint8_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.225 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_int32_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.241 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.231 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.239 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.250 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.257 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.252 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.256 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.277 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.270 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_int8_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.286 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_reduce_scatter_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.276 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.302 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.324 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.344 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.359 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_half.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.372 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_gather_v_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.363 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.367 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.382 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_uint32_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.387 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.384 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_bfloat16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.399 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_to_all_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.397 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.408 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.413 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.415 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.415 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.442 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_bfloat16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.434 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.434 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.458 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_reduce_scatter_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.476 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.497 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.500 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.513 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_int16_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.527 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_gather_v_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.524 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.525 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.543 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.544 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_float.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.561 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_reduce_scatter_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.562 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.544 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_int8_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.572 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.574 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.592 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.598 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.599 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.616 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_float.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.615 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.632 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.650 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.648 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.667 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_uint16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.672 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.680 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_gather_v_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.695 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.689 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.707 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_half.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.716 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.708 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.722 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_reduce_scatter_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.726 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_uint8_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.742 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.760 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.762 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.741 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.775 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.778 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_half.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.793 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.782 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.804 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.810 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.829 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_float.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.834 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.842 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_gather_v_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.858 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.864 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.875 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.879 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.882 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_int16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.898 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_reduce_scatter_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.897 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_to_all_bfloat16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.912 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_to_all_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.913 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.793.933 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.930 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.930 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.793.952 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.947 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_int16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.962 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.967 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.977 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.983 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_int32_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.793.997 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_gather_v_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.793.998 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.794.013 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.794.033 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.025 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.042 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_int32_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.040 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.058 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_float.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.059 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_reduce_scatter_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.076 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.073 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_reduce_scatter_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.096 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.095 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.091 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.111 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.794.122 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.113 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_int32_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.128 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.794.137 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_uint32_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.143 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.794.150 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_gather_v_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.794.166 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.165 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.794.188 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.184 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.202 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_int8_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.196 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.213 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_half.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.228 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_reduce_scatter_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.218 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_reduce_scatter_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.235 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.244 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.257 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.255 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.267 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.794.278 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.274 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_int8_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.299 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.794.293 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_int8_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.317 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.794.308 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_gather_v_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.794.322 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.794.341 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.338 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.347 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.358 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.364 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_bfloat16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.378 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_reduce_scatter_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.376 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_int16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.394 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.391 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_reduce_scatter_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.414 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.418 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.794.433 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.439 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.435 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.794.447 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_uint8_t.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.794.462 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_gather_v_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.453 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_bfloat16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.469 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.794.476 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.487 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.794.496 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.511 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.526 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.509 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.541 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_int32_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.529 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_float.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.545 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.558 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.556 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_reduce_scatter_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.576 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.578 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.794.591 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.597 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.794.608 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_bfloat16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.611 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.794.629 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=aiv_all_gather_v_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.629 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_half.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.794.643 [runtime.cc:1673] 618983 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.645 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_gather_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.794.663 [elf.cc:566] 618983 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.665 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.686 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.690 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.676 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.699 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_half.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.704 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_int8_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.712 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.727 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.719 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_reduce_scatter_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.734 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.745 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.752 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.794.752 [runtime.cc:1688] 618983 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.794.768 [runtime.cc:1953] 618983 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=hccl_aiv_sync.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.794.782 [runtime.cc:1897] 618983 KernelSetDfx: kernel_name=hccl_aiv_sync, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.784 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.803 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_int16_t.
[INFO] DRV(618666,python3.9):2025-04-03-09:27:47.794.813 [devmm_svm.c:1972][ascend][curpid:618666,618983][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0x2; out_feature=0x2)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.818 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_gather_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.794.830 [hdc.cc:83] [618983][HDCommunicate]supportDevMemReg_ 1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.834 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.794.843 [api_impl.cc:1990] 618983 DevMalloc: size=659456, type=16, moduleId=3.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.838 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.841 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.850 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_int16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.861 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.859 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_bfloat16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.872 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_reduce_scatter_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.794.872 [api_error.cc:1218] 618983 DevMalloc: device malloc Succ, size=659456, type=16, moduleId=3, start ptr=0x12c280004000, end ptr=0x12c2800a5000
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.886 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.868 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.884 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.904 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.905 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.950 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.967 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_uint16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.981 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_gather_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.794.990 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.794.996 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.794.996 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.007 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_int32_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.012 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_float.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.026 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.019 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
=================================================================================================================== test session starts ====================================================================================================================
platform linux -- Python 3.9.19, pytest-6.2.5, py-1.11.0, pluggy-1.5.0
rootdir: /home/jenkins/mindspore/testcases/testcases/tests/st/lccl
plugins: requests-mock-1.12.1, hydra-core-1.3.2, mock-3.14.0, forked-1.6.0, xdist-1.32.0
collected 1 item

test_lccl_allreduce.py [INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.021 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.037 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.042 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.057 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.063 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.107 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.125 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_float.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.138 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_gather_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.145 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.153 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.162 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_int8_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.169 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_half.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.153 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.177 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.184 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.187 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.192 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.213 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
=================================================================================================================== test session starts ====================================================================================================================
platform linux -- Python 3.9.19, pytest-6.2.5, py-1.11.0, pluggy-1.5.0
rootdir: /home/jenkins/mindspore/testcases/testcases/tests/st/lccl
plugins: requests-mock-1.12.1, hydra-core-1.3.2, mock-3.14.0, forked-1.6.0, xdist-1.32.0
collected 1 item

test_lccl_allreduce.py [INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.199 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.229 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.279 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.296 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_int32_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.309 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_gather_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.302 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.318 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_bfloat16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.317 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.325 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.333 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.334 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_int16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.348 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.347 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.350 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.364 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.384 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.374 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.795.429 [api_impl.cc:1990] 618983 DevMalloc: size=659456, type=16, moduleId=3.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.795.448 [api_error.cc:1218] 618983 DevMalloc: device malloc Succ, size=659456, type=16, moduleId=3, start ptr=0x12c2800a5000, end ptr=0x12c280146000
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.443 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.795.467 [api_impl.cc:2664] 618983 MemSetSync: destMax=659456, value=0, count=659456
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.462 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_uint32_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.478 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_gather_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.465 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.473 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.492 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_int32_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.506 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.481 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_half.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.507 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_gather_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.494 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.524 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.516 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.521 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.543 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.543 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.606 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] DRV(618666,python3.9):2025-04-03-09:27:47.795.619 [devmm_svm.c:1972][ascend][curpid:618666,618983][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0x2; out_feature=0x2)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.624 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_int8_t.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.795.637 [hdc.cc:83] [618983][HDCommunicate]supportDevMemReg_ 1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.632 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.635 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.643 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_gather_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.795.651 [api_impl.cc:1990] 618983 DevMalloc: size=4096, type=16, moduleId=3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.651 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_int8_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.650 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_int16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.668 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_gather_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.662 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.795.668 [api_error.cc:1218] 618983 DevMalloc: device malloc Succ, size=4096, type=16, moduleId=3, start ptr=0x12c280146000, end ptr=0x12c280147000
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.669 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.684 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.683 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.703 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.682 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.795.691 [api_impl.cc:2096] 618983 HostMalloc: size=4096
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.795.706 [api_error.cc:1260] 618983 HostMalloc: Host memory malloc succeed,size=4096 , moduleId=3, host addr=0x12c0807f0000.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.703 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.774 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.790 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.790 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.792 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_uint8_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.807 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_gather_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.806 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_reduce_scatter_v_bfloat16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.807 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_uint16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.822 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_gather_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.825 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.821 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_reduce_scatter_v_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.837 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.838 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.845 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.858 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.858 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.795.886 [api_impl.cc:1990] 618983 DevMalloc: size=2100520, type=16, moduleId=3.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.934 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.948 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.951 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.952 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_bfloat16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.967 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_gather_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.795.958 [api_error.cc:1218] 618983 DevMalloc: device malloc Succ, size=2100520, type=16, moduleId=3, start ptr=0x12c100c00000, end ptr=0x12c100e00d28
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.965 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_half.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.967 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_float.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.981 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_gather_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.795.984 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.795.977 [api_impl.cc:2664] 618983 MemSetSync: destMax=2100520, value=0, count=2100520
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.795.983 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_gather_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.000 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.795.997 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796.002 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.018 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.018 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796.103 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.107 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.796.115 [api_impl.cc:1990] 618983 DevMalloc: size=32, type=16, moduleId=3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.107 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.126 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_int32_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796.121 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_half.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.796.134 [api_error.cc:1218] 618983 DevMalloc: device malloc Succ, size=32, type=16, moduleId=3, start ptr=0x12c280147000, end ptr=0x12c280147020
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.130 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_int16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.146 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_gather_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.140 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_gather_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796.140 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_gather_v_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796.169 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.796.150 [api_impl.cc:2664] 618983 MemSetSync: destMax=32, value=0, count=32
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.174 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.168 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.198 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796.200 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.796.190 [peterson_lock.cc:69] [618983][PetersonLock][AllocDeviceMem] Type[Host] alloc memSize[32 Byte]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.201 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.796.218 [peterson_lock.cc:47] [618983][PetersonLock][Init] type [Host] init success, memSize [32 Byte] timeout[60 s]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.796.240 [hccl_comm.cc:129] [618983]hcclCommInitInfo:commId[hccl-618666-0-1743643665-hccl_world_group], rank[5], totalRanks[8], serverId[192.168.0.44%enp67s0f5], deviceType[2],logicDevId[5], identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.796.263 [hccl_comm.cc:175] [618983][SetQpQosAttr]The TC and SL do not use the config configuration. It will use environment variables to configure. TC[132], SL[4]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.796.279 [topo_matcher.cc:528] [618983][SetAivMode]AivMode is set to [0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.796.293 [topo_matcher.cc:540] [618983][SetAicpuMode]Aicpu is set to [0]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.288 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.291 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796.292 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.308 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_uint32_t.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.796.315 [hcom_plugin.cc:349] [618983][Set][GroupTopoInfo]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] rankSize[8].
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.308 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_uint16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.325 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_gather_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796.313 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_int16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796.330 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_gather_v_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.323 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_gather_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.340 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796.345 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.352 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.373 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.796.364 [runtime.cc:5239] 618983 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.360 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796.366 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.796.379 [adapter_rts.cc:198] [618983][hrtGetDeviceRefresh]deviceLogicId[5]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.796.393 [hcom_common.cc:85] [618983][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[5] 
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.796.418 [op_base.cc:128] [618983][HcclGetDeviceId] deviceLogicId[5] 
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.796.432 [hccl_comm.cc:1296] [618983]HCCL_KEY_INFO: GetTopoDesc topoDescs[0xfffeb0f9ccb8] topoSize[2]
[INFO] GE(618666,python3.9):2025-04-03-09:27:47.796.452 [hcom_topo_info.cc:24]618983 SetGroupTopoInfo:Add group 192.168.0.44%enp67s0f5_60008_0_1743643662827273 successfully.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.454 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.796.464 [hcom_plugin.cc:371] [618983][Set][GroupTopoInfo]SetGroupTopoInfo group set success
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796.460 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.464 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.473 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_float.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.491 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_gather_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796.477 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_uint16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796.492 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_gather_v_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.796.490 [topoinfo_detect.cc:555] [618983]NetworkManager stop host net success! ip[192.168.0.44%enp67s0f5] 
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.483 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_int8_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.498 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_gather_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.508 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796.508 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.796.503 [topoinfo_detect.cc:321] [618983]TopoInfoDetect TeardownAgent ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.796.516 [topoinfo_detect.cc:219] [618983]TopoInfoDetect TeardownServer ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.512 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.530 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796.529 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.796.537 [op_base.cc:1050] [618983][InitCommRootInfo]Init success, rankNum[8], rank[5], rootInfo identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], server[192.168.0.44%enp67s0f5], logicDevId[5]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.532 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.796.553 [profiler_base.cc:342] [618983]AddGroupUdi: group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] udi[] deviceLogicId[5]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.796.568 [op_base.cc:1107] [618983][HCCL_TRACE]HcclCommInitRootInfoInner success, take time [4499718]us, rankNum[8], rank[5]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.617 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[WARNING] DEVICE(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.796.618 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:157] InitializeByRootInfoConfig] End to initialize communicator by HcclCommInitRootInfo for hccl_world_group
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796.621 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.620 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.636 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_uint8_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.635 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_int32_t.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.796.642 [op_base.cc:853] [618983]HcclGetCommName input handle=0xfffe88022f40 commName=192.168.0.44%enp67s0f5_60008_0_1743643662827273
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796.638 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_float.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796.653 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_gather_v_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.650 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_gather_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.650 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_gather_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.668 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] DEVICE(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.796.668 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:93] Initialize] Start initializing hccl watchdog on device side for group: hccl_world_group, rank: 5
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796.668 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.667 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.688 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.688 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796.690 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] DEVICE(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.796.689 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:77] Initialize] Initialize hccl watch dog handler. rank id: 5, group name: hccl_world_group
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.779 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796.783 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.779 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.797 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_bfloat16_t.
[INFO] DEVICE(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.796.795 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:98] Initialize] hccl watchdog on device side is successfully initialized.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.796 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_uint32_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796.800 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_int32_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796.816 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_gather_v_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.812 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_gather_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.828 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.796.813 [device.cpp:183]618983 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.796.835 [api_impl.cc:3419] 618983 DeviceReset: reset device, device_id=5.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.812 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_gather_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.829 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.847 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796.832 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796.851 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.847 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] DEVICE(618666,fffe8f7eefa0,python3.9):2025-04-03-09:27:47.796.844 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:155] WatchDogProcess] WatchDogProcess start, rank id: 5, group name: hccl_world_group
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.796.850 [runtime.cc:3444] 618983 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x8, reset:0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.796.872 [api_impl.cc:3449] 618983 DeviceReset: Succ, userDeviceId=5.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.796.881 [device.cpp:189]618983 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 5.
[INFO] DEVICE(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.796.902 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_communication_group.cc:58] Initialize] Successfully initialize HCCL group hccl_world_group
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.937 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.938 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796.941 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.956 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_half.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.971 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_gather_v_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] DISTRIBUTED(618666,fffeb17aefa0,python3.9):2025-04-03-09:27:47.796.967 [mindspore/ccsrc/distributed/collective/collective_manager.cc:824] CreateDeviceCommunicator] [PROF]InitDeviceCommunicator costs 4852.78 msec.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.956 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_int8_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.796.984 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_gather_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
.958 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_uint32_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.796.990 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_gather_v_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[WARNING] DISTRIBUTED(618666,fffeb17aefa0,python3.9):2025-04-03-09:27:47.796.995 [mindspore/ccsrc/distributed/collective/collective_manager.cc:828] CreateDeviceCommunicator] End initialize communication group on the device side: hccl_world_group
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.796.990 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.001 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.797.010 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.016 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.024 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.797.033 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.797.073 [mindspore/ccsrc/distributed/collective/collective_manager.cc:404] CreateCommunicationGroup] [PROF]distributed_create_group costs 5354.29 msec.
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.797.111 [mindspore/ccsrc/distributed/collective/collective_manager.cc:225] Initialize] [PROF]CreateGlobalCommunicationGroup costs 5354.36 msec.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.114 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.797.126 [mindspore/ccsrc/distributed/collective/collective_manager.cc:228] Initialize] End initializing collective communication for backend: Ascend
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.113 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.132 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_int16_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.797.127 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.133 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_uint8_t.
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.797.148 [mindspore/ccsrc/distributed/init.cc:62] Initialize] [PROF]distributed_collective_init costs 9483.27 msec.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.147 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_gather_v_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.797.146 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_int8_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.797.163 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_gather_v_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.147 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_gather_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.166 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] PIPELINE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.797.175 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:254] RecordInitStatus] Status record: system init.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.797.178 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.184 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.797.200 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.165 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.184 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.272 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.290 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_bfloat16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.289 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.797.289 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.304 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_gather_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.797.308 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_uint8_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.797.322 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_gather_v_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.306 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_uint16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.320 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_gather_v_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.321 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.797.338 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.336 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.342 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.797.358 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.356 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.428 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.446 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_half.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.797.447 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.444 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.460 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_float.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.463 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_gather_v_half, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.797.467 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_bfloat16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.475 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_gather_v_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.797.482 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=aiv_all_gather_v_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.482 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.492 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.505 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.797.499 [runtime.cc:1673] 618988 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.797.523 [elf.cc:566] 618988 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.515 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.595 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.614 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_int16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.609 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.625 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_int32_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.797.618 [runtime.cc:1688] 618988 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.629 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_gather_v_int16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.642 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_gather_v_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.797.635 [runtime.cc:1953] 618988 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=hccl_aiv_sync.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.647 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.797.650 [runtime.cc:1897] 618988 KernelSetDfx: kernel_name=hccl_aiv_sync, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.658 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.671 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.678 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] DRV(618654,python3.9):2025-04-03-09:27:47.797.684 [devmm_svm.c:1972][ascend][curpid:618654,618988][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0x2; out_feature=0x2)
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.797.704 [hdc.cc:83] [618988][HDCommunicate]supportDevMemReg_ 1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.797.720 [api_impl.cc:1990] 618988 DevMalloc: size=659456, type=16, moduleId=3.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.797.753 [api_error.cc:1218] 618988 DevMalloc: device malloc Succ, size=659456, type=16, moduleId=3, start ptr=0x12c280004000, end ptr=0x12c2800a5000
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.764 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.769 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.780 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_uint16_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.785 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_uint32_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.795 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_gather_v_uint16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.800 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_gather_v_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.811 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.816 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.838 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.841 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.934 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.931 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.948 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_int8_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.962 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_gather_v_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.952 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_float.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.969 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_gather_v_float, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.977 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.797.988 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.797.997 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.011 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.797.986 [device.cpp:143]618670 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.798.024 [api_impl.cc:2999] 618670 SetDevice: device_id=6, deviceMode=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.798.042 [device.cc:306] 618670 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.798.058 [runtime.cc:3393] 618670 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x9
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.798.076 [runtime.cc:3560] 618670 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.798.091 [api_impl.cc:2987] 618670 NewDevice: SetCurRef = 0xaaaad9a630c0,userDeviceId=6,deviceId=6
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.098 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.798.088 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.798.108 [runtime.cc:5239] 618670 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.116 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_int32_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.798.115 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_uint8_t.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.798.131 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_gather_v_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.798.129 [api_impl.cc:2992] 618670 NewDevice: New device success, user_device_id=6, die_num=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.134 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_gather_v_int32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.150 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.798.148 [api_impl.cc:3025] 618670 SetDevice: SetDevice success, curCtx=0xaaaad9a630c0, user_device_id=6.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.798.148 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.798.165 [acl.cpp:115]618670 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.798.180 [acl.cpp:121]618670 GetSocVersion: socVersion is Ascend910B3
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.171 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.798.167 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.798.194 [device.cpp:154]618670 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 6
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.798.245 [mindspore/ccsrc/plugin/res_manager/ascend/ascend_res_manager.cc:496] SetDeterministic] Set kernel deterministic value: 0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.798.257 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.259 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.798.269 [context.cpp:174]618670 aclrtCtxSetSysParamOpt: start to execute aclrtCtxSetSysParamOpt, opt = 0, value = 0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.798.274 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_bfloat16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.276 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_uint32_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.292 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_gather_v_uint32_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.798.292 [api_impl.cc:6913] 618670 CtxSetSysParamOpt: curCtx = 0xaaaad9a630c0, configOpt=0, configVal=0.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:2[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.798.293 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=aiv_all_gather_v_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.798.311 [runtime.cc:1673] 618984 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.308 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.798.330 [elf.cc:566] 618984 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.327 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
7:47.798.309 [context.cpp:158]618670 SetSysParamOpt: successfully execute aclrtCtxSetSysParamOpt
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.798.390 [api_impl.cc:1990] 618988 DevMalloc: size=659456, type=16, moduleId=3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.416 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.798.421 [api_error.cc:1218] 618988 DevMalloc: device malloc Succ, size=659456, type=16, moduleId=3, start ptr=0x12c2800a5000, end ptr=0x12c280146000
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.798.422 [runtime.cc:1688] 618984 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.798.438 [runtime.cc:1953] 618984 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=hccl_aiv_sync.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.433 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_int8_t.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.798.445 [api_impl.cc:2664] 618988 MemSetSync: destMax=659456, value=0, count=659456
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.450 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_gather_v_int8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.466 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.798.453 [runtime.cc:1897] 618984 KernelSetDfx: kernel_name=hccl_aiv_sync, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] DRV(618662,python3.9):2025-04-03-09:27:47.798.478 [devmm_svm.c:1972][ascend][curpid:618662,618984][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0x2; out_feature=0x2)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.485 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.798.496 [hdc.cc:83] [618984][HDCommunicate]supportDevMemReg_ 1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.798.514 [api_impl.cc:1990] 618984 DevMalloc: size=659456, type=16, moduleId=3.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.798.547 [api_error.cc:1218] 618984 DevMalloc: device malloc Succ, size=659456, type=16, moduleId=3, start ptr=0x12c280004000, end ptr=0x12c2800a5000
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.576 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.594 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_uint8_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.609 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_gather_v_uint8_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] DRV(618654,python3.9):2025-04-03-09:27:47.798.611 [devmm_svm.c:1972][ascend][curpid:618654,618988][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0x2; out_feature=0x2)
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.798.629 [hdc.cc:83] [618988][HDCommunicate]supportDevMemReg_ 1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.624 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.798.642 [api_impl.cc:1990] 618988 DevMalloc: size=4096, type=16, moduleId=3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.646 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.798.659 [api_error.cc:1218] 618988 DevMalloc: device malloc Succ, size=4096, type=16, moduleId=3, start ptr=0x12c280146000, end ptr=0x12c280147000
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.798.684 [api_impl.cc:2096] 618988 HostMalloc: size=4096
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.798.705 [api_error.cc:1260] 618988 HostMalloc: Host memory malloc succeed,size=4096 , moduleId=3, host addr=0x12c0807f0000.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.744 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.763 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=aiv_all_gather_v_bfloat16_t.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.777 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=aiv_all_gather_v_bfloat16_t, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.796 [runtime.cc:1673] 618985 MallocProgramAndReg: MAGIC_ELF_AIVEC new ElfProgram ok, Runtime_alloc_size 288
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.818 [elf.cc:566] 618985 ParaseKernelMetaData: dataFlag=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.798.885 [api_impl.cc:1990] 618988 DevMalloc: size=2100520, type=16, moduleId=3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.913 [runtime.cc:1688] 618985 MallocProgramAndReg: isSupportMix=0, kernelType=2
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.798.916 [op_base.cc:1214] [618670][HcclSetConfig] Set HCCL_DETERMINISTIC is false
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.930 [runtime.cc:1953] 618985 KernelRegister: Runtime_alloc_size 232, type=2, funcMode=0, kernelInfoExt=hccl_aiv_sync.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.798.944 [runtime.cc:1897] 618985 KernelSetDfx: kernel_name=hccl_aiv_sync, dfxAddr=0, dfxSize=0, elfDataFlag=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.798.940 [op_base.cc:128] [618670][HcclGetDeviceId] deviceLogicId[6] 
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.798.957 [api_error.cc:1218] 618988 DevMalloc: device malloc Succ, size=2100520, type=16, moduleId=3, start ptr=0x12c100c00000, end ptr=0x12c100e00d28
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.798.970 [context.cpp:72]618670 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] DRV(618674,python3.9):2025-04-03-09:27:47.798.978 [devmm_svm.c:1972][ascend][curpid:618674,618985][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0x2; out_feature=0x2)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.798.979 [api_impl.cc:2664] 618988 MemSetSync: destMax=2100520, value=0, count=2100520
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.798.988 [api_impl.cc:3717] 618670 ContextSetCurrent: set context=aaaad9a630c0, flag=0.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.798.997 [hdc.cc:83] [618985][HDCommunicate]supportDevMemReg_ 1
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.799.008 [context.cpp:80]618670 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.799.014 [api_impl.cc:1990] 618985 DevMalloc: size=659456, type=16, moduleId=3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.799.041 [api_error.cc:1218] 618985 DevMalloc: device malloc Succ, size=659456, type=16, moduleId=3, start ptr=0x12c280004000, end ptr=0x12c2800a5000
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.799.053 [mindspore/ccsrc/common/amp/amp.cc:149] GetCurrentAmpStrategy] amp strategy stack is empty
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.799.115 [api_impl.cc:1990] 618984 DevMalloc: size=659456, type=16, moduleId=3.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.799.123 [api_impl.cc:1990] 618988 DevMalloc: size=32, type=16, moduleId=3.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.799.137 [api_error.cc:1218] 618984 DevMalloc: device malloc Succ, size=659456, type=16, moduleId=3, start ptr=0x12c2800a5000, end ptr=0x12c280146000
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.799.143 [api_error.cc:1218] 618988 DevMalloc: device malloc Succ, size=32, type=16, moduleId=3, start ptr=0x12c280147000, end ptr=0x12c280147020
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.799.163 [api_impl.cc:2664] 618988 MemSetSync: destMax=32, value=0, count=32
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.799.159 [api_impl.cc:2664] 618984 MemSetSync: destMax=659456, value=0, count=659456
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.799.191 [peterson_lock.cc:69] [618988][PetersonLock][AllocDeviceMem] Type[Host] alloc memSize[32 Byte]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.799.209 [peterson_lock.cc:47] [618988][PetersonLock][Init] type [Host] init success, memSize [32 Byte] timeout[60 s]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.799.241 [hccl_comm.cc:129] [618988]hcclCommInitInfo:commId[hccl-618654-0-1743643665-hccl_world_group], rank[2], totalRanks[8], serverId[192.168.0.44%enp67s0f5], deviceType[2],logicDevId[2], identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.799.265 [hccl_comm.cc:175] [618988][SetQpQosAttr]The TC and SL do not use the config configuration. It will use environment variables to configure. TC[132], SL[4]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.799.284 [topo_matcher.cc:528] [618988][SetAivMode]AivMode is set to [0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.799.296 [topo_matcher.cc:540] [618988][SetAicpuMode]Aicpu is set to [0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.799.315 [hcom_plugin.cc:349] [618988][Set][GroupTopoInfo]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] rankSize[8].
[INFO] DRV(618662,python3.9):2025-04-03-09:27:47.799.328 [devmm_svm.c:1972][ascend][curpid:618662,618984][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0x2; out_feature=0x2)
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.799.348 [hdc.cc:83] [618984][HDCommunicate]supportDevMemReg_ 1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.799.347 [runtime.cc:5239] 618988 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.799.363 [adapter_rts.cc:198] [618988][hrtGetDeviceRefresh]deviceLogicId[2]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.799.358 [api_impl.cc:1990] 618984 DevMalloc: size=4096, type=16, moduleId=3.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.799.377 [hcom_common.cc:85] [618988][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[2] 
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.799.377 [api_error.cc:1218] 618984 DevMalloc: device malloc Succ, size=4096, type=16, moduleId=3, start ptr=0x12c280146000, end ptr=0x12c280147000
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.799.395 [op_base.cc:128] [618988][HcclGetDeviceId] deviceLogicId[2] 
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.799.402 [api_impl.cc:2096] 618984 HostMalloc: size=4096
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.799.421 [api_error.cc:1260] 618984 HostMalloc: Host memory malloc succeed,size=4096 , moduleId=3, host addr=0x12c0807f0000.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.799.415 [hccl_comm.cc:1296] [618988]HCCL_KEY_INFO: GetTopoDesc topoDescs[0xfffea97accb8] topoSize[2]
[INFO] GE(618654,python3.9):2025-04-03-09:27:47.799.452 [hcom_topo_info.cc:24]618988 SetGroupTopoInfo:Add group 192.168.0.44%enp67s0f5_60008_0_1743643662827273 successfully.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.799.469 [hcom_plugin.cc:371] [618988][Set][GroupTopoInfo]SetGroupTopoInfo group set success
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.799.492 [topoinfo_detect.cc:555] [618988]NetworkManager stop host net success! ip[192.168.0.44%enp67s0f5] 
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.799.508 [topoinfo_detect.cc:321] [618988]TopoInfoDetect TeardownAgent ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.799.521 [topoinfo_detect.cc:219] [618988]TopoInfoDetect TeardownServer ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.799.544 [op_base.cc:1050] [618988][InitCommRootInfo]Init success, rankNum[8], rank[2], rootInfo identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], server[192.168.0.44%enp67s0f5], logicDevId[2]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.799.564 [profiler_base.cc:342] [618988]AddGroupUdi: group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] udi[] deviceLogicId[2]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.799.585 [op_base.cc:1107] [618988][HCCL_TRACE]HcclCommInitRootInfoInner success, take time [4503206]us, rankNum[8], rank[2]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.799.606 [api_impl.cc:1990] 618984 DevMalloc: size=2100520, type=16, moduleId=3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.799.624 [api_impl.cc:1990] 618985 DevMalloc: size=659456, type=16, moduleId=3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.799.645 [api_error.cc:1218] 618985 DevMalloc: device malloc Succ, size=659456, type=16, moduleId=3, start ptr=0x12c2800a5000, end ptr=0x12c280146000
[WARNING] DEVICE(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.799.653 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:157] InitializeByRootInfoConfig] End to initialize communicator by HcclCommInitRootInfo for hccl_world_group
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.799.666 [api_impl.cc:2664] 618985 MemSetSync: destMax=659456, value=0, count=659456
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.799.679 [op_base.cc:853] [618988]HcclGetCommName input handle=0xfffe88022f40 commName=192.168.0.44%enp67s0f5_60008_0_1743643662827273
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.799.692 [api_error.cc:1218] 618984 DevMalloc: device malloc Succ, size=2100520, type=16, moduleId=3, start ptr=0x12c100c00000, end ptr=0x12c100e00d28
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.799.714 [api_impl.cc:2664] 618984 MemSetSync: destMax=2100520, value=0, count=2100520
[INFO] DEVICE(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.799.711 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:93] Initialize] Start initializing hccl watchdog on device side for group: hccl_world_group, rank: 2
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.799.706 [mindspore/ccsrc/runtime/pynative/op_compiler.cc:179] Compile] Run Op cache miss Ascend_0_AllReducehccl_world_group0sumtrue03-1-3-343_0
[INFO] DEVICE(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.799.734 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:77] Initialize] Initialize hccl watch dog handler. rank id: 2, group name: hccl_world_group
[INFO] DEVICE(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.799.826 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:98] Initialize] hccl watchdog on device side is successfully initialized.
[INFO] DRV(618674,python3.9):2025-04-03-09:27:47.799.823 [devmm_svm.c:1972][ascend][curpid:618674,618985][drv][devmm][devmm_ctrl_support_feature]RTS note drv support feature. (in_feature=0x2; out_feature=0x2)
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.799.841 [hdc.cc:83] [618985][HDCommunicate]supportDevMemReg_ 1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.799.853 [api_impl.cc:1990] 618985 DevMalloc: size=4096, type=16, moduleId=3.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.799.847 [device.cpp:183]618988 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 2.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.799.856 [api_impl.cc:1990] 618984 DevMalloc: size=32, type=16, moduleId=3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.799.871 [api_error.cc:1218] 618985 DevMalloc: device malloc Succ, size=4096, type=16, moduleId=3, start ptr=0x12c280146000, end ptr=0x12c280147000
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.799.871 [api_impl.cc:3419] 618988 DeviceReset: reset device, device_id=2.
[INFO] DEVICE(618654,fffe8fffefa0,python3.9):2025-04-03-09:27:47.799.875 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:155] WatchDogProcess] WatchDogProcess start, rank id: 2, group name: hccl_world_group
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.799.877 [api_error.cc:1218] 618984 DevMalloc: device malloc Succ, size=32, type=16, moduleId=3, start ptr=0x12c280147000, end ptr=0x12c280147020
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.799.895 [api_impl.cc:2664] 618984 MemSetSync: destMax=32, value=0, count=32
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.799.890 [runtime.cc:3444] 618988 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x8, reset:0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.799.910 [api_impl.cc:3449] 618988 DeviceReset: Succ, userDeviceId=2.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.799.896 [api_impl.cc:2096] 618985 HostMalloc: size=4096
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.799.917 [api_error.cc:1260] 618985 HostMalloc: Host memory malloc succeed,size=4096 , moduleId=3, host addr=0x12c0807f0000.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.799.922 [device.cpp:189]618988 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 2.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.799.926 [peterson_lock.cc:69] [618984][PetersonLock][AllocDeviceMem] Type[Host] alloc memSize[32 Byte]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.799.942 [peterson_lock.cc:47] [618984][PetersonLock][Init] type [Host] init success, memSize [32 Byte] timeout[60 s]
[INFO] DEVICE(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.799.947 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_communication_group.cc:58] Initialize] Successfully initialize HCCL group hccl_world_group
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.799.970 [hccl_comm.cc:129] [618984]hcclCommInitInfo:commId[hccl-618662-0-1743643665-hccl_world_group], rank[4], totalRanks[8], serverId[192.168.0.44%enp67s0f5], deviceType[2],logicDevId[4], identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.799.994 [hccl_comm.cc:175] [618984][SetQpQosAttr]The TC and SL do not use the config configuration. It will use environment variables to configure. TC[132], SL[4]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.800.013 [topo_matcher.cc:528] [618984][SetAivMode]AivMode is set to [0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.800.026 [topo_matcher.cc:540] [618984][SetAicpuMode]Aicpu is set to [0]
[INFO] DISTRIBUTED(618654,fffea9fbefa0,python3.9):2025-04-03-09:27:47.800.014 [mindspore/ccsrc/distributed/collective/collective_manager.cc:824] CreateDeviceCommunicator] [PROF]InitDeviceCommunicator costs 4542.27 msec.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.800.045 [hcom_plugin.cc:349] [618984][Set][GroupTopoInfo]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] rankSize[8].
[WARNING] DISTRIBUTED(618654,fffea9fbefa0,python3.9):2025-04-03-09:27:47.800.064 [mindspore/ccsrc/distributed/collective/collective_manager.cc:828] CreateDeviceCommunicator] End initialize communication group on the device side: hccl_world_group
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.800.087 [runtime.cc:5239] 618984 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.800.104 [adapter_rts.cc:198] [618984][hrtGetDeviceRefresh]deviceLogicId[4]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.800.114 [api_impl.cc:1990] 618985 DevMalloc: size=2100520, type=16, moduleId=3.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.800.123 [hcom_common.cc:85] [618984][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[4] 
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.800.144 [op_base.cc:128] [618984][HcclGetDeviceId] deviceLogicId[4] 
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.800.169 [hccl_comm.cc:1296] [618984]HCCL_KEY_INFO: GetTopoDesc topoDescs[0xfffed17accb8] topoSize[2]
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.800.166 [mindspore/ccsrc/distributed/collective/collective_manager.cc:404] CreateCommunicationGroup] [PROF]distributed_create_group costs 5043.86 msec.
[INFO] GE(618662,python3.9):2025-04-03-09:27:47.800.198 [hcom_topo_info.cc:24]618984 SetGroupTopoInfo:Add group 192.168.0.44%enp67s0f5_60008_0_1743643662827273 successfully.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.800.215 [hcom_plugin.cc:371] [618984][Set][GroupTopoInfo]SetGroupTopoInfo group set success
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.800.189 [api_error.cc:1218] 618985 DevMalloc: device malloc Succ, size=2100520, type=16, moduleId=3, start ptr=0x12c100c00000, end ptr=0x12c100e00d28
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.800.217 [api_impl.cc:2664] 618985 MemSetSync: destMax=2100520, value=0, count=2100520
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.800.209 [mindspore/ccsrc/distributed/collective/collective_manager.cc:225] Initialize] [PROF]CreateGlobalCommunicationGroup costs 5043.95 msec.
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.800.232 [mindspore/ccsrc/distributed/collective/collective_manager.cc:228] Initialize] End initializing collective communication for backend: Ascend
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.800.241 [topoinfo_detect.cc:555] [618984]NetworkManager stop host net success! ip[192.168.0.44%enp67s0f5] 
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.800.257 [topoinfo_detect.cc:321] [618984]TopoInfoDetect TeardownAgent ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.800.229 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:151] CommonUnifyMindIR] start common unify mindir opt graph:4000000000
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.800.272 [topoinfo_detect.cc:219] [618984]TopoInfoDetect TeardownServer ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.800.262 [mindspore/ccsrc/distributed/init.cc:62] Initialize] [PROF]distributed_collective_init costs 9198.04 msec.
[INFO] PIPELINE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.800.295 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:254] RecordInitStatus] Status record: system init.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.800.295 [op_base.cc:1050] [618984][InitCommRootInfo]Init success, rankNum[8], rank[4], rootInfo identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], server[192.168.0.44%enp67s0f5], logicDevId[4]
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.800.309 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: conv_transpose_to_conv_backprop_input
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.800.313 [profiler_base.cc:342] [618984]AddGroupUdi: group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] udi[] deviceLogicId[4]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.800.330 [op_base.cc:1107] [618984][HCCL_TRACE]HcclCommInitRootInfoInner success, take time [4503725]us, rankNum[8], rank[4]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.800.365 [api_impl.cc:1990] 618985 DevMalloc: size=32, type=16, moduleId=3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.800.385 [api_error.cc:1218] 618985 DevMalloc: device malloc Succ, size=32, type=16, moduleId=3, start ptr=0x12c280147000, end ptr=0x12c280147020
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.800.414 [api_impl.cc:2664] 618985 MemSetSync: destMax=32, value=0, count=32
[WARNING] DEVICE(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.800.410 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:157] InitializeByRootInfoConfig] End to initialize communicator by HcclCommInitRootInfo for hccl_world_group
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.800.432 [op_base.cc:853] [618984]HcclGetCommName input handle=0xfffeb0022f40 commName=192.168.0.44%enp67s0f5_60008_0_1743643662827273
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.800.443 [peterson_lock.cc:69] [618985][PetersonLock][AllocDeviceMem] Type[Host] alloc memSize[32 Byte]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.800.460 [peterson_lock.cc:47] [618985][PetersonLock][Init] type [Host] init success, memSize [32 Byte] timeout[60 s]
[INFO] DEVICE(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.800.462 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:93] Initialize] Start initializing hccl watchdog on device side for group: hccl_world_group, rank: 4
[INFO] DEVICE(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.800.485 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:77] Initialize] Initialize hccl watch dog handler. rank id: 4, group name: hccl_world_group
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.800.480 [hccl_comm.cc:129] [618985]hcclCommInitInfo:commId[hccl-618674-0-1743643665-hccl_world_group], rank[7], totalRanks[8], serverId[192.168.0.44%enp67s0f5], deviceType[2],logicDevId[7], identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273]
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.800.497 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_0_conv_transpose_to_conv_backprop_input in 197.78 us
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.800.503 [hccl_comm.cc:175] [618985][SetQpQosAttr]The TC and SL do not use the config configuration. It will use environment variables to configure. TC[132], SL[4]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.800.522 [topo_matcher.cc:528] [618985][SetAivMode]AivMode is set to [0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.800.536 [topo_matcher.cc:540] [618985][SetAicpuMode]Aicpu is set to [0]
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.800.537 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: custom_op_reg_info_to_attr
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.800.555 [hcom_plugin.cc:349] [618985][Set][GroupTopoInfo]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] rankSize[8].
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.800.583 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_1_custom_op_reg_info_to_attr in 43.04 us
[INFO] DEVICE(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.800.584 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:98] Initialize] hccl watchdog on device side is successfully initialized.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.800.583 [runtime.cc:5239] 618985 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.800.600 [adapter_rts.cc:198] [618985][hrtGetDeviceRefresh]deviceLogicId[7]
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.800.567 [device.cpp:143]618658 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 3.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.800.608 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Custom not exist in name to cnode
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.800.605 [device.cpp:183]618984 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 4.
[INFO] DEVICE(618662,fffeb7ffefa0,python3.9):2025-04-03-09:27:47.800.617 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:155] WatchDogProcess] WatchDogProcess start, rank id: 4, group name: hccl_world_group
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.800.615 [hcom_common.cc:85] [618985][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[7] 
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.800.630 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_2_inplace_assign_for_custom_op in 23.62 us
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.800.612 [api_impl.cc:2999] 618658 SetDevice: device_id=3, deviceMode=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.800.628 [api_impl.cc:3419] 618984 DeviceReset: reset device, device_id=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.800.645 [runtime.cc:3444] 618984 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x8, reset:0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.800.658 [api_impl.cc:3449] 618984 DeviceReset: Succ, userDeviceId=4.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.800.642 [op_base.cc:128] [618985][HcclGetDeviceId] deviceLogicId[7] 
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.800.658 [hccl_comm.cc:1296] [618985]HCCL_KEY_INFO: GetTopoDesc topoDescs[0xfffea5fbccb8] topoSize[2]
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.800.650 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: convert_attr_to_unify_mindir
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.800.649 [device.cc:306] 618658 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.800.668 [runtime.cc:3393] 618658 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x9
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.800.671 [device.cpp:189]618984 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 4.
[INFO] GE(618674,python3.9):2025-04-03-09:27:47.800.679 [hcom_topo_info.cc:24]618985 SetGroupTopoInfo:Add group 192.168.0.44%enp67s0f5_60008_0_1743643662827273 successfully.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.800.686 [runtime.cc:3560] 618658 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=3
[INFO] DEVICE(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.800.692 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_communication_group.cc:58] Initialize] Successfully initialize HCCL group hccl_world_group
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.800.693 [hcom_plugin.cc:371] [618985][Set][GroupTopoInfo]SetGroupTopoInfo group set success
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.800.701 [api_impl.cc:2987] 618658 NewDevice: SetCurRef = 0xaaab0b9e09a0,userDeviceId=3,deviceId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.800.718 [runtime.cc:5239] 618658 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.800.714 [topoinfo_detect.cc:555] [618985]NetworkManager stop host net success! ip[192.168.0.44%enp67s0f5] 
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.800.730 [topoinfo_detect.cc:321] [618985]TopoInfoDetect TeardownAgent ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.800.740 [api_impl.cc:2992] 618658 NewDevice: New device success, user_device_id=3, die_num=1.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.800.729 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_3_convert_attr_to_unify_mindir in 75.851 us
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.800.744 [topoinfo_detect.cc:219] [618985]TopoInfoDetect TeardownServer ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.800.762 [api_impl.cc:3025] 618658 SetDevice: SetDevice success, curCtx=0xaaab0b9e09a0, user_device_id=3.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.800.778 [acl.cpp:115]618658 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.800.765 [op_base.cc:1050] [618985][InitCommRootInfo]Init success, rankNum[8], rank[7], rootInfo identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273], server[192.168.0.44%enp67s0f5], logicDevId[7]
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.800.771 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:164] CommonUnifyMindIR] [PROF]CommonUnifyMindIR costs 0.546 msec.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.800.784 [profiler_base.cc:342] [618985]AddGroupUdi: group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] udi[] deviceLogicId[7]
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.800.794 [acl.cpp:121]618658 GetSocVersion: socVersion is Ascend910B3
[INFO] DISTRIBUTED(618662,fffed1fbefa0,python3.9):2025-04-03-09:27:47.800.769 [mindspore/ccsrc/distributed/collective/collective_manager.cc:824] CreateDeviceCommunicator] [PROF]InitDeviceCommunicator costs 4772.76 msec.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.800.812 [device.cpp:154]618658 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 3
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.800.769 [device.cpp:143]618650 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 1.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.800.803 [op_base.cc:1107] [618985][HCCL_TRACE]HcclCommInitRootInfoInner success, take time [4503774]us, rankNum[8], rank[7]
[WARNING] DISTRIBUTED(618662,fffed1fbefa0,python3.9):2025-04-03-09:27:47.800.805 [mindspore/ccsrc/distributed/collective/collective_manager.cc:828] CreateDeviceCommunicator] End initialize communication group on the device side: hccl_world_group
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.800.811 [api_impl.cc:2999] 618650 SetDevice: device_id=1, deviceMode=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.800.829 [device.cc:306] 618650 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.800.844 [runtime.cc:3393] 618650 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x9
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.800.860 [runtime.cc:3560] 618650 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.800.872 [api_impl.cc:2987] 618650 NewDevice: SetCurRef = 0xaaab312ab590,userDeviceId=1,deviceId=1
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.800.861 [mindspore/ccsrc/distributed/collective/collective_manager.cc:404] CreateCommunicationGroup] [PROF]distributed_create_group costs 5274.36 msec.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.800.859 [mindspore/ccsrc/plugin/res_manager/ascend/ascend_res_manager.cc:496] SetDeterministic] Set kernel deterministic value: 0
[WARNING] DEVICE(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.800.862 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:157] InitializeByRootInfoConfig] End to initialize communicator by HcclCommInitRootInfo for hccl_world_group
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.800.890 [mindspore/ccsrc/distributed/collective/collective_manager.cc:225] Initialize] [PROF]CreateGlobalCommunicationGroup costs 5274.4 msec.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.800.885 [runtime.cc:5239] 618650 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.800.886 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:191] EliminateIllegalDataTypePass] Start eliminate illegal data type for kernel graph id:4000000000
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.800.882 [context.cpp:174]618658 aclrtCtxSetSysParamOpt: start to execute aclrtCtxSetSysParamOpt, opt = 0, value = 0.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.800.887 [op_base.cc:853] [618985]HcclGetCommName input handle=0xfffe84022f40 commName=192.168.0.44%enp67s0f5_60008_0_1743643662827273
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.800.910 [mindspore/ccsrc/distributed/collective/collective_manager.cc:228] Initialize] End initializing collective communication for backend: Ascend
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.800.902 [api_impl.cc:2992] 618650 NewDevice: New device success, user_device_id=1, die_num=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.800.920 [api_impl.cc:3025] 618650 SetDevice: SetDevice success, curCtx=0xaaab312ab590, user_device_id=1.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.800.934 [acl.cpp:115]618650 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.800.907 [api_impl.cc:6913] 618658 CtxSetSysParamOpt: curCtx = 0xaaab0b9e09a0, configOpt=0, configVal=0.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.800.924 [context.cpp:158]618658 SetSysParamOpt: successfully execute aclrtCtxSetSysParamOpt
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.800.951 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_eliminate_illegal_data_type_pm_0_convert_list_to_tuple in 8.62 us
[INFO] DEVICE(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.800.915 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:93] Initialize] Start initializing hccl watchdog on device side for group: hccl_world_group, rank: 7
[INFO] DEVICE(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.800.948 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:77] Initialize] Initialize hccl watch dog handler. rank id: 7, group name: hccl_world_group
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.800.933 [mindspore/ccsrc/distributed/init.cc:62] Initialize] [PROF]distributed_collective_init costs 9412.44 msec.
[INFO] PIPELINE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.800.962 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:254] RecordInitStatus] Status record: system init.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.800.946 [acl.cpp:121]618650 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.800.962 [device.cpp:154]618650 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 1
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.801.004 [mindspore/ccsrc/plugin/res_manager/ascend/ascend_res_manager.cc:496] SetDeterministic] Set kernel deterministic value: 0
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.801.030 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_eliminate_illegal_data_type_pm_1_eliminate_func_type in 53.49 us
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.801.024 [context.cpp:174]618650 aclrtCtxSetSysParamOpt: start to execute aclrtCtxSetSysParamOpt, opt = 0, value = 0.
[INFO] DEVICE(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.801.038 [mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.cc:98] Initialize] hccl watchdog on device side is successfully initialized.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.801.059 [api_impl.cc:6913] 618650 CtxSetSysParamOpt: curCtx = 0xaaab312ab590, configOpt=0, configVal=0.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.801.059 [device.cpp:183]618985 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.801.078 [api_impl.cc:3419] 618985 DeviceReset: reset device, device_id=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.801.092 [runtime.cc:3444] 618985 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x8, reset:0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.801.092 [context.cpp:158]618650 SetSysParamOpt: successfully execute aclrtCtxSetSysParamOpt
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.801.075 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:204] EliminateIllegalDataTypePass] [PROF]EliminateIllegalDataTypePass costs 0.186 msec.
[INFO] DEVICE(618674,fffea4f9efa0,python3.9):2025-04-03-09:27:47.801.095 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:155] WatchDogProcess] WatchDogProcess start, rank id: 7, group name: hccl_world_group
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.801.109 [api_impl.cc:3449] 618985 DeviceReset: Succ, userDeviceId=7.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.801.126 [device.cpp:189]618985 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 7.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.801.123 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:151] CommonUnifyMindIR] start common unify mindir opt graph:4000000000
[INFO] DEVICE(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.801.147 [mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_communication_group.cc:58] Initialize] Successfully initialize HCCL group hccl_world_group
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.801.164 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: conv_transpose_to_conv_backprop_input
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.801.218 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_0_conv_transpose_to_conv_backprop_input in 50.07 us
[INFO] DISTRIBUTED(618674,fffea67cefa0,python3.9):2025-04-03-09:27:47.801.219 [mindspore/ccsrc/distributed/collective/collective_manager.cc:824] CreateDeviceCommunicator] [PROF]InitDeviceCommunicator costs 4773.19 msec.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.801.239 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: custom_op_reg_info_to_attr
[WARNING] DISTRIBUTED(618674,fffea67cefa0,python3.9):2025-04-03-09:27:47.801.251 [mindspore/ccsrc/distributed/collective/collective_manager.cc:828] CreateDeviceCommunicator] End initialize communication group on the device side: hccl_world_group
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.801.274 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_1_custom_op_reg_info_to_attr in 32.47 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.801.295 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Custom not exist in name to cnode
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.801.316 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_2_inplace_assign_for_custom_op in 19.96 us
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.801.316 [mindspore/ccsrc/distributed/collective/collective_manager.cc:404] CreateCommunicationGroup] [PROF]distributed_create_group costs 5274.86 msec.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.801.336 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: convert_attr_to_unify_mindir
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.801.351 [mindspore/ccsrc/distributed/collective/collective_manager.cc:225] Initialize] [PROF]CreateGlobalCommunicationGroup costs 5274.91 msec.
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.801.371 [mindspore/ccsrc/distributed/collective/collective_manager.cc:228] Initialize] End initializing collective communication for backend: Ascend
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.801.374 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_3_convert_attr_to_unify_mindir in 34.901 us
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.801.403 [mindspore/ccsrc/distributed/init.cc:62] Initialize] [PROF]distributed_collective_init costs 9420.05 msec.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.801.416 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:164] CommonUnifyMindIR] [PROF]CommonUnifyMindIR costs 0.29 msec.
[INFO] PIPELINE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.801.434 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:254] RecordInitStatus] Status record: system init.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.801.450 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:81] BackendCommonOptimization] Status record: start common optimization. graph id: 4000000000
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.801.569 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: convert_dynamic_broadcast_to
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.801.588 [op_base.cc:1214] [618658][HcclSetConfig] Set HCCL_DETERMINISTIC is false
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.801.614 [op_base.cc:128] [618658][HcclGetDeviceId] deviceLogicId[3] 
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.801.645 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_0_convert_dynamic_broadcast_to in 73.95 us
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.801.644 [context.cpp:72]618658 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.801.667 [api_impl.cc:3717] 618658 ContextSetCurrent: set context=aaab0b9e09a0, flag=0.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.801.688 [context.cpp:80]618658 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.801.707 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_1_convert_const_input_to_attr in 35.29 us
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.801.708 [op_base.cc:1214] [618650][HcclSetConfig] Set HCCL_DETERMINISTIC is false
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.801.730 [op_base.cc:128] [618650][HcclGetDeviceId] deviceLogicId[1] 
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.801.731 [mindspore/ccsrc/common/amp/amp.cc:149] GetCurrentAmpStrategy] amp strategy stack is empty
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.801.750 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_2_custom_op_const_input_to_attr in 18.56 us
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.801.772 [context.cpp:72]618650 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.801.791 [api_impl.cc:3717] 618650 ContextSetCurrent: set context=aaab312ab590, flag=0.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.801.809 [context.cpp:80]618650 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.801.822 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_3_convert_const_input_to_tensor_input in 47.79 us
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.801.850 [mindspore/ccsrc/common/amp/amp.cc:149] GetCurrentAmpStrategy] amp strategy stack is empty
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.801.879 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_4_convert_const_input_to_tensor_input_for_print in 32.55 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.802.030 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_5_convert_tuple_output_to_maketuple in 123.221 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.802.063 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_6_convert_unused_tuple_para_to_make_tuple in 2.9 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.802.094 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_common_pm_7_flatten_concat_fission is enabled.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.802.177 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_common_pm_7_flatten_concat_fission in 58.39 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.802.232 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_8_inset_input_structural_for_py_execute in 29.52 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.802.255 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_common_pm_9_broadcast_to_fusion is enabled.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.802.324 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_common_pm_9_broadcast_to_fusion in 47.06 us
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.802.381 [mindspore/ccsrc/runtime/pynative/op_compiler.cc:179] Compile] Run Op cache miss Ascend_0_AllReducehccl_world_group0sumtrue03-1-3-343_0
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.802.514 [mindspore/ccsrc/runtime/pynative/op_compiler.cc:179] Compile] Run Op cache miss Ascend_0_AllReducehccl_world_group0sumtrue03-1-3-343_0
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.802.843 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_10_add_attr_to_node in 489.211 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.802.867 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_common_pm_11_replace_addn is enabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.802.906 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:151] CommonUnifyMindIR] start common unify mindir opt graph:4000000000
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.802.927 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_common_pm_11_replace_addn in 37.5 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.802.980 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:93] BackendCommonOptimization] [PROF]BackendCommonOptimization costs 1.525 msec.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.802.999 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:100] BackendCommonOptimization] Status record: end common optimization. graph id: 4000000000
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.802.993 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: conv_transpose_to_conv_backprop_input
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.803.054 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:258] OptimizationWithoutBackend] [PROF]OptimizationWithoutBackend costs 2.167 msec.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.803.072 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:151] CommonUnifyMindIR] start common unify mindir opt graph:4000000000
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.803.171 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: conv_transpose_to_conv_backprop_input
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.803.178 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_0_conv_transpose_to_conv_backprop_input in 199.5 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.803.226 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: custom_op_reg_info_to_attr
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.803.271 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_1_custom_op_reg_info_to_attr in 42.98 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.803.309 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Custom not exist in name to cnode
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.803.332 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_2_inplace_assign_for_custom_op in 24.47 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.803.349 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_0_conv_transpose_to_conv_backprop_input in 190.91 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.803.354 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: convert_attr_to_unify_mindir
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.803.392 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: custom_op_reg_info_to_attr
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.803.435 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_1_custom_op_reg_info_to_attr in 41.21 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.803.437 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_3_convert_attr_to_unify_mindir in 80.371 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.803.456 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Custom not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.803.475 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_2_inplace_assign_for_custom_op in 19.89 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.803.481 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:164] CommonUnifyMindIR] [PROF]CommonUnifyMindIR costs 0.579 msec.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.803.493 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: convert_attr_to_unify_mindir
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.803.484 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_0_renorm_split in 59.93 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.803.513 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: reduce_axis_update
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.803.558 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_3_convert_attr_to_unify_mindir in 62.62 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.803.600 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_1_reduce_axis_update in 80.37 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.803.596 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:191] EliminateIllegalDataTypePass] Start eliminate illegal data type for kernel graph id:4000000000
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.803.604 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:164] CommonUnifyMindIR] [PROF]CommonUnifyMindIR costs 0.533 msec.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.803.625 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: space_to_batch_nd_attr_update
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.803.660 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_eliminate_illegal_data_type_pm_0_convert_list_to_tuple in 7.67 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.803.683 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_2_space_to_batch_nd_attr_update in 54.9 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.803.706 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: batch_to_space_nd_attr_update
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.803.731 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:191] EliminateIllegalDataTypePass] Start eliminate illegal data type for kernel graph id:4000000000
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.803.743 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_3_batch_to_space_nd_attr_update in 34.36 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.803.740 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_eliminate_illegal_data_type_pm_1_eliminate_func_type in 52.18 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.803.787 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AdamWeightDecay not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.803.795 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_eliminate_illegal_data_type_pm_0_convert_list_to_tuple in 8.22 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.803.787 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:204] EliminateIllegalDataTypePass] [PROF]EliminateIllegalDataTypePass costs 0.188 msec.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.803.820 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:151] CommonUnifyMindIR] start common unify mindir opt graph:4000000000
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.803.810 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_4_adam_weight_decay_unify_mindir in 41.34 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.803.850 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_5_add_depend_for_adamw in 7.92 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.803.859 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: conv_transpose_to_conv_backprop_input
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.803.874 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_eliminate_illegal_data_type_pm_1_eliminate_func_type in 53.8 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.803.912 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SparseSoftmaxCrossEntropyWithLogits not exist in name to cnode
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.803.911 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_0_conv_transpose_to_conv_backprop_input in 50.36 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.803.935 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_6_pynative_grad_sparse_softmax_cross_entropy_with_logits_unify_mindir_v2 in 61.1 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.803.940 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:204] EliminateIllegalDataTypePass] [PROF]EliminateIllegalDataTypePass costs 0.204 msec.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.803.938 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: custom_op_reg_info_to_attr
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.803.959 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SparseSoftmaxCrossEntropyWithLogits not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.803.970 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:151] CommonUnifyMindIR] start common unify mindir opt graph:4000000000
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.803.977 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_7_pynative_grad_sparse_softmax_cross_entropy_with_logits_unify_mindir in 19.67 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.803.995 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SparseSoftmaxCrossEntropyWithLogits not exist in name to cnode
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.803.975 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_1_custom_op_reg_info_to_attr in 34.72 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.803.997 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Custom not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.804.008 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: conv_transpose_to_conv_backprop_input
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.013 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_8_pynative_sparse_softmax_cross_entropy_with_logits_unify_mindir in 17.08 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.804.017 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_2_inplace_assign_for_custom_op in 19.01 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.804.039 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: convert_attr_to_unify_mindir
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.053 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim DropoutExt not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.804.062 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_0_conv_transpose_to_conv_backprop_input in 51.711 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.074 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_9_dropout_ext_unify_mindir1 in 39.73 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.804.084 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: custom_op_reg_info_to_attr
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.804.076 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_3_convert_attr_to_unify_mindir in 33.89 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.096 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim DropoutGradExt not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.804.118 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_1_custom_op_reg_info_to_attr in 31.72 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.116 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_10_dropoutgrad_ext_unify_mindir in 20.44 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.804.139 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Custom not exist in name to cnode
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.804.121 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:164] CommonUnifyMindIR] [PROF]CommonUnifyMindIR costs 0.298 msec.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.136 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Dropout not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.804.167 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_2_inplace_assign_for_custom_op in 19.18 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.804.190 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: convert_attr_to_unify_mindir
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.154 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_11_dropout_unify_mindir1 in 17.82 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.221 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: dropoutgrad_unify_mindir
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.804.225 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_3_convert_attr_to_unify_mindir in 31.92 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.804.268 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:164] CommonUnifyMindIR] [PROF]CommonUnifyMindIR costs 0.295 msec.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.270 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_12_dropoutgrad_unify_mindir in 45.62 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.804.303 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:81] BackendCommonOptimization] Status record: start common optimization. graph id: 4000000000
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.358 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim NeighborExchange not exist in name to cnode
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.381 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_13_neighbor_exchange_unify_mindir in 86.11 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.402 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim NeighborExchangeV2 not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.804.424 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: convert_dynamic_broadcast_to
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.422 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_14_neighbor_exchange_v2_unify_mindir in 19.65 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.453 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim NeighborExchangeV2Grad not exist in name to cnode
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.474 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_15_neighbor_exchange_v2_grad_unify_mindir in 20.75 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.804.486 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_0_convert_dynamic_broadcast_to in 59.28 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.495 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AlltoAll not exist in name to cnode
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.515 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_16_all_to_all_unify_mindir in 19.6 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.533 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AlltoAllV not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.804.545 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_1_convert_const_input_to_attr in 35.26 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.552 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_17_all_to_all_v_unify_mindir in 18.78 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.804.587 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_2_custom_op_const_input_to_attr in 20.07 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.592 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNorm not exist in name to cnode
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.613 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_18_bn_split in 38.64 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.632 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: bn_grad_unify_mindir
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.804.663 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_3_convert_const_input_to_tensor_input in 53.51 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.703 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_19_bn_grad_unify_mindir in 67.201 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.804.725 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_4_convert_const_input_to_tensor_input_for_print in 38.731 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.727 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNormGrad not exist in name to cnode
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.748 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_20_bn_grad_split in 21.51 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.767 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNormGrad not exist in name to cnode
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.786 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_21_batchnormgrad_to_bninfergrad in 18.96 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.805 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNormGrad not exist in name to cnode
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.826 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_22_batch_norm_grad_infer_fission in 19.53 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.846 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNorm not exist in name to cnode
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.866 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_23_batchnorm_to_bninfer in 19.02 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.804.865 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_5_convert_tuple_output_to_maketuple in 114.85 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.887 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Print not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.804.906 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_6_convert_unused_tuple_para_to_make_tuple in 2.71 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.907 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_24_print_insert_placeholder_for_tensor_name in 19.63 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.804.923 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_common_pm_7_flatten_concat_fission is enabled.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.946 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim GetNext not exist in name to cnode
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.804.974 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_25_getnext_for_ge in 45.91 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.804.999 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_common_pm_7_flatten_concat_fission in 57.64 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.805.010 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SyncBatchNorm not exist in name to cnode
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.805.032 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_26_sync_bn_split in 38.52 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.805.052 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SyncBatchNormGrad not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.805.055 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_8_inset_input_structural_for_py_execute in 30.6 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.805.077 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_common_pm_9_broadcast_to_fusion is enabled.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.805.072 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_27_sync_bn_grad_split in 19.56 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.805.093 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AvgPoolGrad not exist in name to cnode
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.805.114 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_28_avg_pool_grad_for_ge in 20.64 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.805.144 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_common_pm_9_broadcast_to_fusion in 49.3 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.805.214 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_29_add_attr_to_dump in 75.82 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.805.445 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_30_ascend_mindir_op_adapter in 202.201 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.805.470 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_0_clip_by_norm_fission is enabled.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.805.543 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_0_clip_by_norm_fission in 50.25 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.805.565 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_1_cdist_fission is enabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.805.641 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_10_add_attr_to_node in 468.071 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.805.651 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_1_cdist_fission in 63.77 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.805.666 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_common_pm_11_replace_addn is enabled.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.805.674 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_2_cdist_grad_fission is enabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.805.724 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_common_pm_11_replace_addn in 39.75 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.805.726 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_2_cdist_grad_fission in 28.53 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.805.749 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_3_batchmatmul_reducescatter_alltoall_fusion is enabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.805.777 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:93] BackendCommonOptimization] [PROF]BackendCommonOptimization costs 1.468 msec.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.805.769 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:81] BackendCommonOptimization] Status record: start common optimization. graph id: 4000000000
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.805.798 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:100] BackendCommonOptimization] Status record: end common optimization. graph id: 4000000000
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.805.804 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_3_batchmatmul_reducescatter_alltoall_fusion in 35.63 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.805.826 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_4_alltoall_allgather_batch_matmul_fusion is enabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.805.851 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:258] OptimizationWithoutBackend] [PROF]OptimizationWithoutBackend costs 2.118 msec.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.805.872 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_4_alltoall_allgather_batch_matmul_fusion in 24.42 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.805.900 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_5_lamb_fission_ge is enabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.805.934 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: convert_dynamic_broadcast_to
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.805.980 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_5_lamb_fission_ge in 60.43 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.806.002 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_6_adaptive_max_pool2d_ge_fusion is enabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.806.029 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_0_convert_dynamic_broadcast_to in 92.541 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.806.055 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_6_adaptive_max_pool2d_ge_fusion in 30.811 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.806.076 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_7_matmul_reduce_scatter_fusion is enabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.806.098 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_1_convert_const_input_to_attr in 39.33 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.806.144 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_2_custom_op_const_input_to_attr in 19.4 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.806.186 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_7_matmul_reduce_scatter_fusion in 86.53 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.806.209 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_8_allgather_matmul_fusion is enabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.806.216 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_3_convert_const_input_to_tensor_input in 46.76 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.806.271 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_0_renorm_split in 58.24 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.806.277 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_4_convert_const_input_to_tensor_input_for_print in 33.98 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.806.284 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_8_allgather_matmul_fusion in 52.66 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.806.299 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: reduce_axis_update
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:47.806.274 [awatchdog_monitor.c:160](tid:618689) thread 618984 not exist
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.806.306 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_9_FlashAttentionFusionV1 is enabled.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.806.327 [mindspore/ccsrc/plugin/device/ascend/optimizer/ir_fusion/flash_attention_fusion.cc:270] DefineFlashAttentionPattern] Do FlashAttentionPattern V1.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.806.382 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_1_reduce_axis_update in 80.43 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.806.406 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: space_to_batch_nd_attr_update
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.806.421 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_5_convert_tuple_output_to_maketuple in 113.9 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.806.451 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_6_convert_unused_tuple_para_to_make_tuple in 3.16 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.806.453 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_9_FlashAttentionFusionV1 in 125.22 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.806.466 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_2_space_to_batch_nd_attr_update in 57.52 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.806.474 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_common_pm_7_flatten_concat_fission is enabled.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.806.478 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_10_FlashAttentionFusionV2 is enabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.806.488 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: batch_to_space_nd_attr_update
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.806.505 [mindspore/ccsrc/plugin/device/ascend/optimizer/ir_fusion/flash_attention_fusion.cc:384] DefineFlashAttentionPattern] Do FlashAttentionPattern V2.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.806.523 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_3_batch_to_space_nd_attr_update in 33.01 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.806.551 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_common_pm_7_flatten_concat_fission in 51.51 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.806.563 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AdamWeightDecay not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.806.596 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_4_adam_weight_decay_unify_mindir in 50.27 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.806.607 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_8_inset_input_structural_for_py_execute in 26.69 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.806.628 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_10_FlashAttentionFusionV2 in 128.39 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.806.638 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_5_add_depend_for_adamw in 22.19 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.806.630 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_common_pm_9_broadcast_to_fusion is enabled.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.806.652 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_11_quantbatchmatmul_reduce_fusion is enabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.806.690 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SparseSoftmaxCrossEntropyWithLogits not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.806.711 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_6_pynative_grad_sparse_softmax_cross_entropy_with_logits_unify_mindir_v2 in 51.601 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.806.702 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_common_pm_9_broadcast_to_fusion in 46.861 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.806.731 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SparseSoftmaxCrossEntropyWithLogits not exist in name to cnode
=================================================================================================================== test session starts ====================================================================================================================
platform linux -- Python 3.9.19, pytest-6.2.5, py-1.11.0, pluggy-1.5.0
rootdir: /home/jenkins/mindspore/testcases/testcases/tests/st/lccl
plugins: requests-mock-1.12.1, hydra-core-1.3.2, mock-3.14.0, forked-1.6.0, xdist-1.32.0
collected 1 item

test_lccl_allreduce.py [INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.806.746 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_11_quantbatchmatmul_reduce_fusion in 70.151 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.806.751 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_7_pynative_grad_sparse_softmax_cross_entropy_with_logits_unify_mindir in 20.3 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.806.770 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_12_MatMulAllReduce is enabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.806.769 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SparseSoftmaxCrossEntropyWithLogits not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.806.786 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_8_pynative_sparse_softmax_cross_entropy_with_logits_unify_mindir in 16.22 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.806.823 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim DropoutExt not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.806.840 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_9_dropout_ext_unify_mindir1 in 37.39 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.806.849 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_12_MatMulAllReduce in 58.06 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.806.875 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim DropoutGradExt not exist in name to cnode
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.806.873 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_13_grouped_matmul_assignadd_fusion is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.806.895 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_10_dropoutgrad_ext_unify_mindir in 36.67 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.806.903 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_14_MatMulAllReduceAddRmsNorm is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.806.913 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Dropout not exist in name to cnode
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.806.922 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_15_add_layer_norm_fusion is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.806.929 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_11_dropout_unify_mindir1 in 15.03 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.806.940 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_16_add_layer_norm_v3_fusion is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.806.945 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: dropoutgrad_unify_mindir
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.806.957 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_17_add_layer_norm_ext_fusion is disabled.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.806.974 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_18_inference_qbmm_add_fusion is disabled.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.806.988 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_19_inference_swiglu_fusion is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.806.987 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_12_dropoutgrad_unify_mindir in 39.22 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.807.006 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_20_inference_matmul_split_fusion is disabled.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.807.025 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_21_add_rms_norm_dynamic_quant_fusion is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.042 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim NeighborExchange not exist in name to cnode
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.807.041 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_22_add_rms_norm_quant_fusion is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.064 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_13_neighbor_exchange_unify_mindir in 54.85 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.807.060 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_23_add_cast_rms_norm_cast_quant_fusion is disabled.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.807.077 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_24_rms_norm_quant_fusion is disabled.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.807.093 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_25_add_cast_rms_norm_cast_fusion is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.084 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim NeighborExchangeV2 not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.112 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_14_neighbor_exchange_v2_unify_mindir in 27.33 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.807.111 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_26_shape_reshape is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.132 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim NeighborExchangeV2Grad not exist in name to cnode
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.807.129 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_27_split_concat_fusion is enabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.807.136 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_10_add_attr_to_node in 403.18 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.151 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_15_neighbor_exchange_v2_grad_unify_mindir in 17.91 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.807.162 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_common_pm_11_replace_addn is enabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.169 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AlltoAll not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.185 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_16_all_to_all_unify_mindir in 16.02 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.202 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AlltoAllV not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.217 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_17_all_to_all_v_unify_mindir in 15.14 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.807.221 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_common_pm_11_replace_addn in 36.79 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.249 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNorm not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.268 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_18_bn_split in 35.14 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.285 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: bn_grad_unify_mindir
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.807.277 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:93] BackendCommonOptimization] [PROF]BackendCommonOptimization costs 1.519 msec.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.807.301 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:100] BackendCommonOptimization] Status record: end common optimization. graph id: 4000000000
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.352 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_19_bn_grad_unify_mindir in 62.49 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.807.376 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:258] OptimizationWithoutBackend] [PROF]OptimizationWithoutBackend costs 3.778 msec.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.387 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNormGrad not exist in name to cnode
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.807.390 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_27_split_concat_fusion in 236.891 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.406 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_20_bn_grad_split in 32.71 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.807.417 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_28_matmul_sigmoid_add_fusion is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.424 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNormGrad not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.439 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_21_batchnormgrad_to_bninfergrad in 15.14 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.807.435 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_29_matmul_sigmoid_cast_add_fusion is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.456 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNormGrad not exist in name to cnode
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.807.453 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_30_matmul_elemwise_fusion is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.472 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_22_batch_norm_grad_infer_fission in 15.88 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.807.481 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_31_qbmm_allreduce_convert_bias is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.489 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNorm not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.504 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_23_batchnorm_to_bninfer in 15.2 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.807.499 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_32_inference_qbmm_allreduce_add_fusion is enabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.537 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Print not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.556 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_24_print_insert_placeholder_for_tensor_name in 34.87 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.602 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim GetNext not exist in name to cnode
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.807.599 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_32_inference_qbmm_allreduce_add_fusion in 76.56 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.621 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_25_getnext_for_ge in 35.67 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.807.623 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_33_remove_fa_tensor_to_tuple_ops is disabled.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.807.644 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_34_transpose_batch_matmul_transpose_fusion is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.654 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SyncBatchNorm not exist in name to cnode
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.807.661 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_35_add_rms_norm_fusion is enabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.672 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_26_sync_bn_split in 33.71 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.690 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SyncBatchNormGrad not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.705 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_27_sync_bn_grad_split in 14.94 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.736 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AvgPoolGrad not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.753 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_28_avg_pool_grad_for_ge in 32.01 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.807.746 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_35_add_rms_norm_fusion in 62.05 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.807.804 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:203] GEUnifyMindIR] [PROF]GEUnifyMindIR costs 4.687 msec.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.807.813 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_0_renorm_split in 52.73 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.807.845 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: reduce_axis_update
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.807.849 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_29_add_attr_to_dump in 73.81 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.807.939 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_1_reduce_axis_update in 91.43 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.807.965 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: space_to_batch_nd_attr_update
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.023 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_2_space_to_batch_nd_attr_update in 53.1 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.047 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: batch_to_space_nd_attr_update
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.082 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_3_batch_to_space_nd_attr_update in 32.57 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.808.091 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_30_ascend_mindir_op_adapter in 212.981 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.808.115 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_0_clip_by_norm_fission is enabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.121 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AdamWeightDecay not exist in name to cnode
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.144 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_4_adam_weight_decay_unify_mindir in 37.99 us
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:47.808.181 [trs_cb_event.c:119][ascend][curpid:618670,618823][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =65; ret=16)
[INFO] SESSION(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.808.197 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:47.808.208 [trs_sqcq.c:1491][ascend][curpid:618670,618823][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.200 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_5_add_depend_for_adamw in 10.18 us
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:47.808.228 [npu_driver.cc:3833] 618823 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=65, drvRetCode=16.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.808.204 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_0_clip_by_norm_fission in 67.25 us
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:47.808.245 [api_impl.cc:5058] 618823 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.808.234 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_1_cdist_fission is enabled.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.808.260 [callback.cpp:132]618823 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.808.274 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.808.289 [npu_driver.cc:3828] 618823 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=65.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.288 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SparseSoftmaxCrossEntropyWithLogits not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.808.307 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_1_cdist_fission in 52.78 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.313 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_6_pynative_grad_sparse_softmax_cross_entropy_with_logits_unify_mindir_v2 in 84.33 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.808.331 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_2_cdist_grad_fission is enabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.336 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SparseSoftmaxCrossEntropyWithLogits not exist in name to cnode
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.808.339 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_graph_optimization.cc:40] MarkRefGraph] Mark graph is ref graph: 4000000000
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.360 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_7_pynative_grad_sparse_softmax_cross_entropy_with_logits_unify_mindir in 25.88 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.808.381 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_2_cdist_grad_fission in 27.04 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.383 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SparseSoftmaxCrossEntropyWithLogits not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.808.404 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_3_batchmatmul_reducescatter_alltoall_fusion is enabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.407 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_8_pynative_sparse_softmax_cross_entropy_with_logits_unify_mindir in 22.86 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.808.454 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_3_batchmatmul_reducescatter_alltoall_fusion in 30.4 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.451 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim DropoutExt not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.808.474 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_4_alltoall_allgather_batch_matmul_fusion is enabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.473 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_9_dropout_ext_unify_mindir1 in 42 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.513 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim DropoutGradExt not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.808.527 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_4_alltoall_allgather_batch_matmul_fusion in 23.49 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.533 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_10_dropoutgrad_ext_unify_mindir in 20.19 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.808.547 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_5_lamb_fission_ge is enabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.555 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Dropout not exist in name to cnode
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.577 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_11_dropout_unify_mindir1 in 21.77 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.597 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: dropoutgrad_unify_mindir
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.808.640 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_5_lamb_fission_ge in 74.02 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.643 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_12_dropoutgrad_unify_mindir in 43.67 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.808.662 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_6_adaptive_max_pool2d_ge_fusion is enabled.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.808.686 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unfold_inputs_for_special_nodes_pm_0_ascend_convert_tuple_input_to_dynamic_input in 275.35 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.692 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim NeighborExchange not exist in name to cnode
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.715 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_13_neighbor_exchange_unify_mindir in 46.871 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.808.736 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_6_adaptive_max_pool2d_ge_fusion in 52.991 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.735 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim NeighborExchangeV2 not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.808.760 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_7_matmul_reduce_scatter_fusion is enabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.757 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_14_neighbor_exchange_v2_unify_mindir in 21.01 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.777 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim NeighborExchangeV2Grad not exist in name to cnode
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.796 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_15_neighbor_exchange_v2_grad_unify_mindir in 17.69 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.814 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AlltoAll not exist in name to cnode
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.808.825 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_0_process_call_inline in 37.09 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.835 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_16_all_to_all_unify_mindir in 20.48 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.856 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AlltoAllV not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.808.873 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_7_matmul_reduce_scatter_fusion in 90.55 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.878 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_17_all_to_all_v_unify_mindir in 20.56 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.808.895 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_8_allgather_matmul_fusion is enabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.923 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNorm not exist in name to cnode
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.945 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_18_bn_split in 44.43 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.808.964 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: bn_grad_unify_mindir
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.808.971 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_8_allgather_matmul_fusion in 55.57 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.808.955 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_1_seed_adapter in 96.63 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.808.993 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_9_FlashAttentionFusionV1 is enabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.809.013 [mindspore/ccsrc/plugin/device/ascend/optimizer/ir_fusion/flash_attention_fusion.cc:270] DefineFlashAttentionPattern] Do FlashAttentionPattern V1.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.809.013 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_2_insert_tensor_move_for_communication in 17.15 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.809.031 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_19_bn_grad_unify_mindir in 64.49 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.809.056 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNormGrad not exist in name to cnode
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.809.071 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_3_process partial inline in 29.83 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.809.087 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_20_bn_grad_split in 30.62 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.809.110 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNormGrad not exist in name to cnode
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.809.132 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_21_batchnormgrad_to_bninfergrad in 21.27 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.809.144 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_9_FlashAttentionFusionV1 in 131.39 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.809.153 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNormGrad not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.809.167 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_10_FlashAttentionFusionV2 is enabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.809.176 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_22_batch_norm_grad_infer_fission in 21.46 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.809.187 [mindspore/ccsrc/plugin/device/ascend/optimizer/ir_fusion/flash_attention_fusion.cc:384] DefineFlashAttentionPattern] Do FlashAttentionPattern V2.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.809.178 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_4_expander_fallback in 80.57 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.809.195 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNorm not exist in name to cnode
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.809.217 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_23_batchnorm_to_bninfer in 20.77 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.809.234 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_5_convert_pad_v3_paddings in 29.76 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.809.238 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Print not exist in name to cnode
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.809.260 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_24_print_insert_placeholder_for_tensor_name in 21.52 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.809.285 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_6_convert_pad_v3_grad_paddings in 24.57 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.809.296 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim GetNext not exist in name to cnode
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.809.319 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_10_FlashAttentionFusionV2 in 130.07 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.809.319 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_25_getnext_for_ge in 38.19 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.809.344 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_11_quantbatchmatmul_reduce_fusion is enabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.809.356 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SyncBatchNorm not exist in name to cnode
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.809.375 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_7_resize_bilinear_add_attr in 64.091 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.809.380 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_26_sync_bn_split in 37.921 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.809.399 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SyncBatchNormGrad not exist in name to cnode
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.809.409 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_8_backend_custom_depend in 8.51 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.809.419 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_27_sync_bn_grad_split in 18.23 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.809.435 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_11_quantbatchmatmul_reduce_fusion in 73 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.809.440 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AvgPoolGrad not exist in name to cnode
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.809.462 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_28_avg_pool_grad_for_ge in 21.29 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.809.461 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:120] GEBackendOptimizeACL] [PROF]GEBackendOptimizeACL costs 0.703 msec.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.809.459 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_12_MatMulAllReduce is enabled.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.809.522 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_graph_optimization.cc:131] OptimizeACLGraph] [PROF]OptimizeACLGraph costs 1.183 msec.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.809.553 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_12_MatMulAllReduce in 61.66 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.809.560 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_29_add_attr_to_dump in 72.04 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.809.576 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_13_grouped_matmul_assignadd_fusion is disabled.
[INFO] SESSION(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.809.580 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.809.593 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_14_MatMulAllReduceAddRmsNorm is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.809.609 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_15_add_layer_norm_fusion is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.809.623 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_16_add_layer_norm_v3_fusion is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.809.638 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_17_add_layer_norm_ext_fusion is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.809.653 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_18_inference_qbmm_add_fusion is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.809.666 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_19_inference_swiglu_fusion is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.809.679 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_20_inference_matmul_split_fusion is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.809.694 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_21_add_rms_norm_dynamic_quant_fusion is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.809.708 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_22_add_rms_norm_quant_fusion is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.809.723 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_23_add_cast_rms_norm_cast_quant_fusion is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.809.738 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_24_rms_norm_quant_fusion is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.809.753 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_25_add_cast_rms_norm_cast_fusion is disabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.809.749 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_30_ascend_mindir_op_adapter in 157.71 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.809.768 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_26_shape_reshape is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.809.785 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_27_split_concat_fusion is enabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.809.778 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_0_clip_by_norm_fission is enabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.809.869 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_0_clip_by_norm_fission in 53.13 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.809.893 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_1_cdist_fission is enabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.809.974 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_1_cdist_fission in 56.94 us
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.809.973 [mindspore/ccsrc/plugin/device/ascend/hal/device/kernel_select_ascend.cc:624] CollectOpSelectedType] AllReduce select hccl kernel
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.809.996 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_2_cdist_grad_fission is enabled.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.810.013 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:315] SelectKernel] [PROF]SelectKernel costs 0.448 msec.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.810.036 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:319] PrintOpSelectedNum] Number of GE_KERNEL, INTERNAL_KERNEL, OPAPI_KERNEL, ACL_KERNEL, ATB_KERNEL, HCCL_KERNEL, HOST_KERNEL:
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.810.048 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_2_cdist_grad_fission in 28.49 us
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.810.054 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:327] PrintOpSelectedNum] 0 0 0 0 0 1 0 
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.810.052 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_27_split_concat_fusion in 243.751 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.810.072 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_3_batchmatmul_reducescatter_alltoall_fusion is enabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.810.079 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_28_matmul_sigmoid_add_fusion is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.810.109 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_29_matmul_sigmoid_cast_add_fusion is disabled.
=================================================================================================================== test session starts ====================================================================================================================
platform linux -- Python 3.9.19, pytest-6.2.5, py-1.11.0, pluggy-1.5.0
rootdir: /home/jenkins/mindspore/testcases/testcases/tests/st/lccl
plugins: requests-mock-1.12.1, hydra-core-1.3.2, mock-3.14.0, forked-1.6.0, xdist-1.32.0
collected 1 item

test_lccl_allreduce.py [INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.810.129 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_30_matmul_elemwise_fusion is disabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.810.124 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_3_batchmatmul_reducescatter_alltoall_fusion in 27.03 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.810.146 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_31_qbmm_allreduce_convert_bias is disabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.810.145 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_4_alltoall_allgather_batch_matmul_fusion is enabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.810.162 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_32_inference_qbmm_allreduce_add_fusion is enabled.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.810.178 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_0_set_fracz_group_attr in 48.23 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.810.190 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_4_alltoall_allgather_batch_matmul_fusion in 22.7 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.810.212 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_5_lamb_fission_ge is enabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.810.265 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_32_inference_qbmm_allreduce_add_fusion in 79.63 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.810.276 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_1_insert_identity in 66.45 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.810.288 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_33_remove_fa_tensor_to_tuple_ops is disabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.810.294 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_5_lamb_fission_ge in 57.74 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.810.304 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_34_transpose_batch_matmul_transpose_fusion is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.810.320 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_35_add_rms_norm_fusion is enabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.810.317 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_6_adaptive_max_pool2d_ge_fusion is enabled.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.810.348 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_2_erase_visit_attr in 45.1 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.810.375 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_6_adaptive_max_pool2d_ge_fusion in 33.37 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.810.398 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_7_matmul_reduce_scatter_fusion is enabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.810.406 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_35_add_rms_norm_fusion in 65.04 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.810.444 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_3_deal_ref_output in 69.55 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.810.463 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:203] GEUnifyMindIR] [PROF]GEUnifyMindIR costs 4.559 msec.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.810.468 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_opt_acl_after_kernel_select_pm_4_shape_reshape is disabled.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.810.499 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_opt_acl_after_kernel_select_pm_5_shape_reshape_direct is enabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.810.507 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_7_matmul_reduce_scatter_fusion in 84.26 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.810.531 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_8_allgather_matmul_fusion is enabled.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.810.559 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_opt_acl_after_kernel_select_pm_5_shape_reshape_direct in 39.96 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.810.600 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_6_graph_view_replace in 15.94 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.810.609 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_8_allgather_matmul_fusion in 53.76 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.810.623 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_7_label_1f1b_overlap_node in 1.33 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.810.632 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_9_FlashAttentionFusionV1 is enabled.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.810.668 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:173] GEBackendOptimizeACLAfterKernelSelect] [PROF]GEBackendOptimizeACLAfterKernelSelect costs 0.587 msec.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.810.669 [mindspore/ccsrc/plugin/device/ascend/optimizer/ir_fusion/flash_attention_fusion.cc:270] DefineFlashAttentionPattern] Do FlashAttentionPattern V1.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.810.726 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_graph_optimization.cc:166] OptimizeACLGraphAfterKernelSelect] [PROF]OptimizeACLGraphAfterKernelSelect costs 0.645 msec.
[INFO] SESSION(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.810.768 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.810.802 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_9_FlashAttentionFusionV1 in 134.761 us
[INFO] SESSION(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.810.813 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.810.826 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_10_FlashAttentionFusionV2 is enabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.810.850 [mindspore/ccsrc/plugin/device/ascend/optimizer/ir_fusion/flash_attention_fusion.cc:384] DefineFlashAttentionPattern] Do FlashAttentionPattern V2.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.810.881 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_after_inline_pm_0_DropoutGenMask is enabled.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.810.907 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_after_inline_pm_0_DropoutGenMask in 1.33 us
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.810.946 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_graph_optimization.cc:40] MarkRefGraph] Mark graph is ref graph: 4000000000
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.810.963 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_1_cse in 33.12 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.810.971 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_10_FlashAttentionFusionV2 in 120.28 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.810.992 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_2_eliminate_maketuple_getitem in 5.39 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.810.994 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_11_quantbatchmatmul_reduce_fusion is enabled.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.811.015 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_3_insert_move_to in 0.73 us
[INFO] SESSION(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.811.049 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
=================================================================================================================== test session starts ====================================================================================================================
platform linux -- Python 3.9.19, pytest-6.2.5, py-1.11.0, pluggy-1.5.0
rootdir: /home/jenkins/mindspore/testcases/testcases/tests/st/lccl
plugins: requests-mock-1.12.1, hydra-core-1.3.2, mock-3.14.0, forked-1.6.0, xdist-1.32.0
collected 1 item

test_lccl_allreduce.py [INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.811.096 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_11_quantbatchmatmul_reduce_fusion in 76.8 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.811.117 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_12_MatMulAllReduce is enabled.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.811.129 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_4_insert_pre_fetch_depend in 90.61 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.811.155 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_5_overlap_1b1f in 1.68 us
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.811.182 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:242] GEAfterInlineOptimize] [PROF]GEAfterInlineOptimize costs 0.33 msec.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.811.202 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_12_MatMulAllReduce in 59.5 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.811.225 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unfold_inputs_for_special_nodes_pm_0_ascend_convert_tuple_input_to_dynamic_input in 213.23 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.811.226 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_13_grouped_matmul_assignadd_fusion is disabled.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.811.239 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:437] InlineCallGraph] [PROF]InlineCallGraph costs 0.486 msec.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.811.248 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_14_MatMulAllReduceAddRmsNorm is disabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.811.266 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_15_add_layer_norm_fusion is disabled.
[INFO] SESSION(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.811.277 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.811.283 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_16_add_layer_norm_v3_fusion is disabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.811.303 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_17_add_layer_norm_ext_fusion is disabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.811.323 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_18_inference_qbmm_add_fusion is disabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.811.341 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_19_inference_swiglu_fusion is disabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.811.358 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_20_inference_matmul_split_fusion is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.811.364 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_0_process_call_inline in 37.271 us
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.811.359 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:912] InlineSwitchGraph] [PROF]InlineSwitchGraph costs 0.092 msec.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.811.375 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_21_add_rms_norm_dynamic_quant_fusion is disabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.811.407 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_22_add_rms_norm_quant_fusion is disabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.811.426 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_23_add_cast_rms_norm_cast_quant_fusion is disabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.811.446 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_24_rms_norm_quant_fusion is disabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.811.464 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_25_add_cast_rms_norm_cast_fusion is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.811.481 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_1_seed_adapter in 85.8 us
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.811.463 [device.cpp:143]618666 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 5.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.811.484 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_26_shape_reshape is disabled.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.811.505 [api_impl.cc:2999] 618666 SetDevice: device_id=5, deviceMode=0.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.811.505 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_27_split_concat_fusion is enabled.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.811.521 [device.cc:306] 618666 Init: device mode has been already set, mode=0.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.811.528 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_2_insert_tensor_move_for_communication in 16.46 us
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.811.533 [runtime.cc:3393] 618666 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x9
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.811.559 [runtime.cc:3560] 618666 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.811.574 [api_impl.cc:2987] 618666 NewDevice: SetCurRef = 0xaaaaf6e2dcc0,userDeviceId=5,deviceId=5
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.811.585 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_3_process partial inline in 30.43 us
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.811.585 [runtime.cc:5239] 618666 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.811.606 [api_impl.cc:2992] 618666 NewDevice: New device success, user_device_id=5, die_num=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.811.623 [api_impl.cc:3025] 618666 SetDevice: SetDevice success, curCtx=0xaaaaf6e2dcc0, user_device_id=5.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.811.634 [acl.cpp:115]618666 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.811.646 [acl.cpp:121]618666 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.811.659 [device.cpp:154]618666 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 5
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.811.699 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_4_expander_fallback in 87.81 us
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.811.704 [mindspore/ccsrc/plugin/res_manager/ascend/ascend_res_manager.cc:496] SetDeterministic] Set kernel deterministic value: 0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.811.727 [context.cpp:174]618666 aclrtCtxSetSysParamOpt: start to execute aclrtCtxSetSysParamOpt, opt = 0, value = 0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.811.745 [api_impl.cc:6913] 618666 CtxSetSysParamOpt: curCtx = 0xaaaaf6e2dcc0, configOpt=0, configVal=0.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.811.760 [context.cpp:158]618666 SetSysParamOpt: successfully execute aclrtCtxSetSysParamOpt
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.811.755 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_5_convert_pad_v3_paddings in 31.11 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.811.763 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_27_split_concat_fusion in 231.87 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.811.792 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_28_matmul_sigmoid_add_fusion is disabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.811.816 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_29_matmul_sigmoid_cast_add_fusion is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.811.821 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_6_convert_pad_v3_grad_paddings in 28.03 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.811.836 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_30_matmul_elemwise_fusion is disabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.811.857 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_31_qbmm_allreduce_convert_bias is disabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.811.874 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_32_inference_qbmm_allreduce_add_fusion is enabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.811.888 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_7_resize_bilinear_add_attr in 42.82 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.811.921 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_8_backend_custom_depend in 8.52 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.811.969 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:120] GEBackendOptimizeACL] [PROF]GEBackendOptimizeACL costs 0.671 msec.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.811.963 [context.cpp:72]618670 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.811.972 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_32_inference_qbmm_allreduce_add_fusion in 74.03 us
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.811.990 [api_impl.cc:3717] 618670 ContextSetCurrent: set context=aaaad9a630c0, flag=0.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.811.998 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_33_remove_fa_tensor_to_tuple_ops is disabled.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.812.006 [context.cpp:80]618670 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.812.017 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_34_transpose_batch_matmul_transpose_fusion is disabled.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.812.027 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_graph_optimization.cc:131] OptimizeACLGraph] [PROF]OptimizeACLGraph costs 1.08 msec.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.812.038 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_35_add_rms_norm_fusion is enabled.
[INFO] KERNEL(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.812.056 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hccl_kernel_build.cc:32] HcclOpBuild] Build hccl op [AllReduce]
[INFO] SESSION(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.812.088 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.812.120 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_35_add_rms_norm_fusion in 57.77 us
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:47.812.178 [trs_cb_event.c:119][ascend][curpid:618670,618822][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =64; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:47.812.202 [trs_sqcq.c:1491][ascend][curpid:618670,618822][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:47.812.220 [npu_driver.cc:3833] 618822 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:47.812.234 [api_impl.cc:5058] 618822 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:47.812.186 [queue_client_comm.c:114][ascend][curpid:618646,618967][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:47.812.192 [queue_client_comm.c:114][ascend][curpid:618646,618971][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:47.812.192 [queue_client_comm.c:114][ascend][curpid:618646,618969][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.812.205 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:203] GEUnifyMindIR] [PROF]GEUnifyMindIR costs 4.769 msec.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.812.249 [callback.cpp:132]618822 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.812.265 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.812.281 [npu_driver.cc:3828] 618822 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=64.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:47.812.320 [npu_driver.cc:4338] 618967 MemQueuePeek: queue empty
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:47.812.326 [npu_driver.cc:4338] 618971 MemQueuePeek: queue empty
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.812.348 [op_base.cc:1214] [618666][HcclSetConfig] Set HCCL_DETERMINISTIC is false
[INFO] KERNEL(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.812.351 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hccl_kernel.cc:211] CalLoopSize] Get Hccl Kernel: AllReduce, output size: 1
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.812.374 [op_base.cc:128] [618666][HcclGetDeviceId] deviceLogicId[5] 
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.812.367 [tensor_data_transfer.cpp:612]618967 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_image_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.812.366 [tensor_data_transfer.cpp:612]618971 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_histogram_summary
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:47.812.365 [npu_driver.cc:4338] 618969 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.812.387 [tensor_data_transfer.cpp:1054]618967 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_image_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.812.398 [context.cpp:72]618666 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.812.392 [tensor_data_transfer.cpp:1054]618971 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_histogram_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.812.409 [tensor_data_transfer.cpp:1056]618967 acltdtReceiveTensor: new process, use queue process
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.812.406 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:198] GenerateKernelMod] kernel opname:AllReduce, kernel type:hccl_kernel
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.812.408 [tensor_data_transfer.cpp:612]618969 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_scalar_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.812.417 [tensor_data_transfer.cpp:1056]618971 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.812.418 [api_impl.cc:3717] 618666 ContextSetCurrent: set context=aaaaf6e2dcc0, flag=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.812.430 [api_impl.cc:6121] 618967 MemQueuePeek: Start to peek queue on devId 0, qid is 3.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.812.431 [tensor_data_transfer.cpp:1054]618969 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_scalar_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.812.435 [context.cpp:80]618666 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.812.435 [api_impl.cc:6121] 618971 MemQueuePeek: Start to peek queue on devId 0, qid is 5.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.812.445 [npu_driver.cc:4330] 618967 MemQueuePeek: peek mem queue, deviceId=0, qid=3, timeout=800.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.812.452 [tensor_data_transfer.cpp:1056]618969 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.812.459 [npu_driver.cc:4330] 618971 MemQueuePeek: peek mem queue, deviceId=0, qid=5, timeout=800.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.812.476 [api_impl.cc:6121] 618969 MemQueuePeek: Start to peek queue on devId 0, qid is 4.
=================================================================================================================== test session starts ====================================================================================================================
platform linux -- Python 3.9.19, pytest-6.2.5, py-1.11.0, pluggy-1.5.0
rootdir: /home/jenkins/mindspore/testcases/testcases/tests/st/lccl
plugins: requests-mock-1.12.1, hydra-core-1.3.2, mock-3.14.0, forked-1.6.0, xdist-1.32.0
collected 1 item

test_lccl_allreduce.py [INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.812.468 [mindspore/ccsrc/plugin/device/ascend/hal/device/kernel_select_ascend.cc:624] CollectOpSelectedType] AllReduce select hccl kernel
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.812.476 [mindspore/ccsrc/common/amp/amp.cc:149] GetCurrentAmpStrategy] amp strategy stack is empty
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.812.492 [npu_driver.cc:4330] 618969 MemQueuePeek: peek mem queue, deviceId=0, qid=4, timeout=800.
[INFO] SESSION(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.812.503 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.812.507 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:315] SelectKernel] [PROF]SelectKernel costs 0.449 msec.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.812.526 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:319] PrintOpSelectedNum] Number of GE_KERNEL, INTERNAL_KERNEL, OPAPI_KERNEL, ACL_KERNEL, ATB_KERNEL, HCCL_KERNEL, HOST_KERNEL:
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.812.543 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:327] PrintOpSelectedNum] 0 0 0 0 0 1 0 
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.812.615 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1179] OptimizeExecutionOrder] [PROF]OptimizeExecutionOrder costs 0.12 msec.
[INFO] SESSION(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.812.607 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.812.659 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_0_set_fracz_group_attr in 47.6 us
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.812.724 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1214] ResetNodeIds] Start reset node id
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.812.754 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_1_insert_identity in 66.18 us
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.812.755 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_graph_optimization.cc:40] MarkRefGraph] Mark graph is ref graph: 4000000000
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.812.781 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1234] ResetNodeIds] End reset node id
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.812.788 [mindspore/ccsrc/runtime/pynative/op_compiler.cc:179] Compile] Run Op cache miss Ascend_0_AllReducehccl_world_group0sumtrue03-1-3-343_0
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.812.809 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1123] DoStreamAssign] Status record: start stream assign, pynative_kernel_graph4000000000
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.812.826 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_2_erase_visit_attr in 45.6 us
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.812.831 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/acl_stream_assign.cc:151] AssignStream] Not stream assign when pynative forward.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.812.852 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1139] DoStreamAssign] Status record: end stream assign, pynative_kernel_graph4000000000
[INFO] SESSION(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.812.874 [mindspore/ccsrc/backend/common/session/kernel_graph.cc:944] PrintGraphExecuteOrder] Graph 4000000000 execution order:
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.812.925 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_3_deal_ref_output in 72.73 us
[INFO] SESSION(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.812.932 [mindspore/ccsrc/backend/common/session/kernel_graph.cc:984] PrintGraphExecuteOrder] Index[0], node name[Default/AllReduce-op0], logic id[4294967295], stream id[0], node info[@pynative_kernel_graph4000000000:CNode_1{[0]: ValueNode<Primitive> AllReduce, [1]: param_Parameter_2}], group[hccl_world_group]
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.812.949 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_opt_acl_after_kernel_select_pm_4_shape_reshape is disabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.812.967 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_opt_acl_after_kernel_select_pm_5_shape_reshape_direct is enabled.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.813.028 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_opt_acl_after_kernel_select_pm_5_shape_reshape_direct in 41.41 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.813.051 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unfold_inputs_for_special_nodes_pm_0_ascend_convert_tuple_input_to_dynamic_input in 221.53 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.813.065 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_6_graph_view_replace in 14.8 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.813.090 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_7_label_1f1b_overlap_node in 1.25 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.813.132 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:151] CommonUnifyMindIR] start common unify mindir opt graph:4000000000
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.813.152 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:173] GEBackendOptimizeACLAfterKernelSelect] [PROF]GEBackendOptimizeACLAfterKernelSelect costs 0.587 msec.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.813.173 [context.cpp:72]619015 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.813.192 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: conv_transpose_to_conv_backprop_input
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.813.209 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_graph_optimization.cc:166] OptimizeACLGraphAfterKernelSelect] [PROF]OptimizeACLGraphAfterKernelSelect costs 0.645 msec.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.813.197 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_0_process_call_inline in 37.18 us
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.813.204 [api_impl.cc:3717] 619015 ContextSetCurrent: set context=aaaad9a630c0, flag=0.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:47.813.227 [awatchdog_core.c:175](tid:619015) create watchdog for id : 65543, tid : 619015, timeout : 300s
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.813.243 [context.cpp:80]619015 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.813.246 [mindspore/ccsrc/common/amp/amp.cc:149] GetCurrentAmpStrategy] amp strategy stack is empty
[INFO] SESSION(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.813.252 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.813.280 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_0_conv_transpose_to_conv_backprop_input in 90.16 us
[INFO] PRE_ACT(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.813.287 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:704] GenerateAllocator] Generate allocator, is persistent : 1, stream id : 0.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.813.313 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: custom_op_reg_info_to_attr
[INFO] PRE_ACT(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.813.335 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:716] operator()] Malloc mem block, is enable eager free : 0, is enable vmm : 1, size : 512, block size : 1073741824.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.813.330 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_1_seed_adapter in 94.86 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.813.348 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_1_custom_op_reg_info_to_attr in 32.48 us
[INFO] DEVICE(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.813.361 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.cc:204] AllocDeviceMem] VMM AllocDeviceMem size:61029220352, align_size:61029220352
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.813.365 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_after_inline_pm_0_DropoutGenMask is enabled.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.813.372 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Custom not exist in name to cnode
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.813.380 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_2_insert_tensor_move_for_communication in 17.81 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.813.390 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_after_inline_pm_0_DropoutGenMask in 1.11 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.813.409 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_2_inplace_assign_for_custom_op in 35.78 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.813.427 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: convert_attr_to_unify_mindir
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.813.443 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_1_cse in 30.92 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.813.439 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_3_process partial inline in 30.47 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.813.470 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_2_eliminate_maketuple_getitem in 4.92 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.813.490 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_3_insert_move_to in 0.66 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.813.502 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_3_convert_attr_to_unify_mindir in 71.36 us
[INFO] SESSION(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.813.521 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.813.536 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:164] CommonUnifyMindIR] [PROF]CommonUnifyMindIR costs 0.408 msec.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.813.555 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_4_expander_fallback in 87.03 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.813.600 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_4_insert_pre_fetch_depend in 89.68 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.813.611 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:191] EliminateIllegalDataTypePass] Start eliminate illegal data type for kernel graph id:4000000000
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.813.623 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_5_overlap_1b1f in 1.34 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.813.613 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_5_convert_pad_v3_paddings in 29.54 us
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.813.649 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:242] GEAfterInlineOptimize] [PROF]GEAfterInlineOptimize costs 0.312 msec.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.813.662 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_eliminate_illegal_data_type_pm_0_convert_list_to_tuple in 5.24 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.813.665 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_6_convert_pad_v3_grad_paddings in 24.4 us
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.813.704 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:437] InlineCallGraph] [PROF]InlineCallGraph costs 0.468 msec.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.813.727 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_eliminate_illegal_data_type_pm_1_eliminate_func_type in 39.04 us
[INFO] SESSION(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.813.742 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.813.751 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_7_resize_bilinear_add_attr in 59.03 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.813.768 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:204] EliminateIllegalDataTypePass] [PROF]EliminateIllegalDataTypePass costs 0.153 msec.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.813.786 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_8_backend_custom_depend in 8.5 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.813.795 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:151] CommonUnifyMindIR] start common unify mindir opt graph:4000000000
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.813.824 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:912] InlineSwitchGraph] [PROF]InlineSwitchGraph costs 0.093 msec.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.813.831 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: conv_transpose_to_conv_backprop_input
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.813.839 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:120] GEBackendOptimizeACL] [PROF]GEBackendOptimizeACL costs 0.712 msec.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.813.880 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_0_conv_transpose_to_conv_backprop_input in 45.22 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.813.900 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: custom_op_reg_info_to_attr
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.813.905 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_graph_optimization.cc:131] OptimizeACLGraph] [PROF]OptimizeACLGraph costs 1.147 msec.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.813.932 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_1_custom_op_reg_info_to_attr in 29.55 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.813.953 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Custom not exist in name to cnode
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.813.971 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_2_inplace_assign_for_custom_op in 16.95 us
[INFO] SESSION(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.813.973 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.813.988 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: convert_attr_to_unify_mindir
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.814.021 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_3_convert_attr_to_unify_mindir in 30.611 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.814.060 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:164] CommonUnifyMindIR] [PROF]CommonUnifyMindIR costs 0.26 msec.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.814.089 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:81] BackendCommonOptimization] Status record: start common optimization. graph id: 4000000000
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.814.176 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: convert_dynamic_broadcast_to
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.814.256 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_0_convert_dynamic_broadcast_to in 76.63 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.814.315 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_1_convert_const_input_to_attr in 35.19 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.814.360 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_2_custom_op_const_input_to_attr in 21.67 us
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.814.350 [context.cpp:72]618650 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.814.364 [mindspore/ccsrc/plugin/device/ascend/hal/device/kernel_select_ascend.cc:624] CollectOpSelectedType] AllReduce select hccl kernel
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.814.380 [api_impl.cc:3717] 618650 ContextSetCurrent: set context=aaab312ab590, flag=0.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.814.395 [context.cpp:80]618650 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.814.409 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_3_convert_const_input_to_tensor_input in 26.93 us
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.814.405 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:315] SelectKernel] [PROF]SelectKernel costs 0.451 msec.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.814.429 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:319] PrintOpSelectedNum] Number of GE_KERNEL, INTERNAL_KERNEL, OPAPI_KERNEL, ACL_KERNEL, ATB_KERNEL, HCCL_KERNEL, HOST_KERNEL:
[INFO] KERNEL(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.814.436 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hccl_kernel_build.cc:32] HcclOpBuild] Build hccl op [AllReduce]
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.814.454 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_4_convert_const_input_to_tensor_input_for_print in 20.11 us
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.814.451 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:327] PrintOpSelectedNum] 0 0 0 0 0 1 0 
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.814.554 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_5_convert_tuple_output_to_maketuple in 75.39 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.814.581 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_6_convert_unused_tuple_para_to_make_tuple in 2.05 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.814.575 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_0_set_fracz_group_attr in 47.42 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.814.603 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_common_pm_7_flatten_concat_fission is enabled.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.814.655 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_common_pm_7_flatten_concat_fission in 31.47 us
[INFO] KERNEL(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.814.662 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hccl_kernel.cc:211] CalLoopSize] Get Hccl Kernel: AllReduce, output size: 1
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.814.689 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_1_insert_identity in 68.05 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.814.709 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_8_inset_input_structural_for_py_execute in 30.621 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.814.731 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_common_pm_9_broadcast_to_fusion is enabled.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.814.715 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:198] GenerateKernelMod] kernel opname:AllReduce, kernel type:hccl_kernel
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.814.734 [api_impl.cc:7115] 619015 ReserveMemAddress: device malloc Succ, size=61029220352(bytes) start ptr=0x12c2c0000000, end ptr=0x12d0f5a00000
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.814.763 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_2_erase_visit_attr in 45.83 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.814.783 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_common_pm_9_broadcast_to_fusion in 30.38 us
[INFO] SESSION(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.814.808 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.814.870 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_10_add_attr_to_node in 61.97 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.814.863 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_3_deal_ref_output in 70.44 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.814.891 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_common_pm_11_replace_addn is enabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.814.888 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_opt_acl_after_kernel_select_pm_4_shape_reshape is disabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.814.910 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_opt_acl_after_kernel_select_pm_5_shape_reshape_direct is enabled.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.814.916 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1179] OptimizeExecutionOrder] [PROF]OptimizeExecutionOrder costs 0.119 msec.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.814.944 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_common_pm_11_replace_addn in 33.38 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.814.973 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_opt_acl_after_kernel_select_pm_5_shape_reshape_direct in 39.32 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.814.990 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:93] BackendCommonOptimization] [PROF]BackendCommonOptimization costs 0.896 msec.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.815.011 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:100] BackendCommonOptimization] Status record: end common optimization. graph id: 4000000000
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.815.010 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1214] ResetNodeIds] Start reset node id
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.815.016 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_6_graph_view_replace in 14.83 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.815.040 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_7_label_1f1b_overlap_node in 1.46 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.815.062 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:258] OptimizationWithoutBackend] [PROF]OptimizationWithoutBackend costs 1.449 msec.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.815.071 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1234] ResetNodeIds] End reset node id
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.815.100 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1123] DoStreamAssign] Status record: start stream assign, pynative_kernel_graph4000000000
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.815.092 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:173] GEBackendOptimizeACLAfterKernelSelect] [PROF]GEBackendOptimizeACLAfterKernelSelect costs 0.613 msec.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.815.122 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/acl_stream_assign.cc:151] AssignStream] Not stream assign when pynative forward.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.815.140 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1139] DoStreamAssign] Status record: end stream assign, pynative_kernel_graph4000000000
[INFO] SESSION(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.815.161 [mindspore/ccsrc/backend/common/session/kernel_graph.cc:944] PrintGraphExecuteOrder] Graph 4000000000 execution order:
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.815.152 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_graph_optimization.cc:166] OptimizeACLGraphAfterKernelSelect] [PROF]OptimizeACLGraphAfterKernelSelect costs 0.674 msec.
[INFO] SESSION(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.815.198 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] SESSION(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.815.218 [mindspore/ccsrc/backend/common/session/kernel_graph.cc:984] PrintGraphExecuteOrder] Index[0], node name[Default/AllReduce-op0], logic id[4294967295], stream id[0], node info[@pynative_kernel_graph4000000000:CNode_1{[0]: ValueNode<Primitive> AllReduce, [1]: param_Parameter_2}], group[hccl_world_group]
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.815.314 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_after_inline_pm_0_DropoutGenMask is enabled.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.815.343 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_after_inline_pm_0_DropoutGenMask in 1.56 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.815.404 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_1_cse in 36.87 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.815.422 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_0_renorm_split in 35.19 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.815.433 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_2_eliminate_maketuple_getitem in 5.06 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.815.450 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: reduce_axis_update
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.815.458 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_3_insert_move_to in 0.8 us
[INFO] SESSION(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.815.495 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.815.496 [context.cpp:72]619016 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.815.529 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_1_reduce_axis_update in 75.72 us
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.815.535 [api_impl.cc:3717] 619016 ContextSetCurrent: set context=aaab312ab590, flag=0.
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.815.546 [mindspore/ccsrc/common/amp/amp.cc:149] GetCurrentAmpStrategy] amp strategy stack is empty
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.815.551 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: space_to_batch_nd_attr_update
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:47.815.558 [awatchdog_core.c:175](tid:619016) create watchdog for id : 65543, tid : 619016, timeout : 300s
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.815.572 [context.cpp:80]619016 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.815.577 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_4_insert_pre_fetch_depend in 93.82 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.815.589 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_2_space_to_batch_nd_attr_update in 34.94 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.815.611 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: batch_to_space_nd_attr_update
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.815.576 [device.cpp:143]618654 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 2.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.815.605 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_5_overlap_1b1f in 1.68 us
[INFO] PRE_ACT(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.815.626 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:704] GenerateAllocator] Generate allocator, is persistent : 1, stream id : 0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.815.622 [api_impl.cc:2999] 618654 SetDevice: device_id=2, deviceMode=0.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.815.645 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_3_batch_to_space_nd_attr_update in 31.3 us
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.815.649 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:242] GEAfterInlineOptimize] [PROF]GEAfterInlineOptimize costs 0.362 msec.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.815.646 [device.cc:306] 618654 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.815.664 [runtime.cc:3393] 618654 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x9
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.815.666 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AdamWeightDecay not exist in name to cnode
[INFO] PRE_ACT(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.815.676 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:716] operator()] Malloc mem block, is enable eager free : 0, is enable vmm : 1, size : 512, block size : 1073741824.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.815.684 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_4_adam_weight_decay_unify_mindir in 18.41 us
[INFO] DEVICE(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.815.701 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.cc:204] AllocDeviceMem] VMM AllocDeviceMem size:61029220352, align_size:61029220352
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.815.708 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_5_add_depend_for_adamw in 5.58 us
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.815.685 [runtime.cc:3560] 618654 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.815.707 [api_impl.cc:2987] 618654 NewDevice: SetCurRef = 0xaaaaf5082ff0,userDeviceId=2,deviceId=2
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.815.707 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:437] InlineCallGraph] [PROF]InlineCallGraph costs 0.525 msec.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.815.731 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SparseSoftmaxCrossEntropyWithLogits not exist in name to cnode
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.815.721 [runtime.cc:5239] 618654 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.815.740 [api_impl.cc:2992] 618654 NewDevice: New device success, user_device_id=2, die_num=1.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.815.751 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_6_pynative_grad_sparse_softmax_cross_entropy_with_logits_unify_mindir_v2 in 22.1 us
[INFO] SESSION(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.815.747 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.815.773 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SparseSoftmaxCrossEntropyWithLogits not exist in name to cnode
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.815.761 [api_impl.cc:3025] 618654 SetDevice: SetDevice success, curCtx=0xaaaaf5082ff0, user_device_id=2.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.815.779 [acl.cpp:115]618654 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.815.791 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_7_pynative_grad_sparse_softmax_cross_entropy_with_logits_unify_mindir in 20.4 us
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.815.797 [acl.cpp:121]618654 GetSocVersion: socVersion is Ascend910B3
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.815.810 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SparseSoftmaxCrossEntropyWithLogits not exist in name to cnode
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.815.828 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_8_pynative_sparse_softmax_cross_entropy_with_logits_unify_mindir in 16.68 us
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.815.817 [device.cpp:154]618654 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 2
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.815.834 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:912] InlineSwitchGraph] [PROF]InlineSwitchGraph costs 0.096 msec.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.815.852 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim DropoutExt not exist in name to cnode
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.815.870 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_9_dropout_ext_unify_mindir1 in 22.99 us
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.815.861 [mindspore/ccsrc/plugin/res_manager/ascend/ascend_res_manager.cc:496] SetDeterministic] Set kernel deterministic value: 0
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.815.889 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim DropoutGradExt not exist in name to cnode
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.815.885 [context.cpp:174]618654 aclrtCtxSetSysParamOpt: start to execute aclrtCtxSetSysParamOpt, opt = 0, value = 0.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.815.906 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_10_dropoutgrad_ext_unify_mindir in 15.74 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.815.932 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Dropout not exist in name to cnode
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.815.910 [api_impl.cc:6913] 618654 CtxSetSysParamOpt: curCtx = 0xaaaaf5082ff0, configOpt=0, configVal=0.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.815.942 [context.cpp:158]618654 SetSysParamOpt: successfully execute aclrtCtxSetSysParamOpt
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.815.951 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_11_dropout_unify_mindir1 in 18.38 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.815.969 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: dropoutgrad_unify_mindir
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.006 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_12_dropoutgrad_unify_mindir in 31.57 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.028 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim NeighborExchange not exist in name to cnode
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.046 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_13_neighbor_exchange_unify_mindir in 18.87 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.063 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim NeighborExchangeV2 not exist in name to cnode
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.079 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_14_neighbor_exchange_v2_unify_mindir in 15.11 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.095 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim NeighborExchangeV2Grad not exist in name to cnode
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.111 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_15_neighbor_exchange_v2_grad_unify_mindir in 14.71 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.127 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AlltoAll not exist in name to cnode
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.143 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_16_all_to_all_unify_mindir in 14.63 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.172 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AlltoAllV not exist in name to cnode
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.192 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_17_all_to_all_v_unify_mindir in 30.88 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.211 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNorm not exist in name to cnode
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.227 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_18_bn_split in 17.22 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.243 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: bn_grad_unify_mindir
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.303 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_19_bn_grad_unify_mindir in 56.72 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.322 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNormGrad not exist in name to cnode
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.339 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_20_bn_grad_split in 16.67 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.361 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNormGrad not exist in name to cnode
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.378 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_21_batchnormgrad_to_bninfergrad in 15.45 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.394 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNormGrad not exist in name to cnode
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.410 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_22_batch_norm_grad_infer_fission in 14.69 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.426 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNorm not exist in name to cnode
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.442 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_23_batchnorm_to_bninfer in 14.52 us
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.816.422 [context.cpp:72]618658 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.458 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Print not exist in name to cnode
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.816.434 [device.cpp:143]618674 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.816.472 [api_impl.cc:2999] 618674 SetDevi[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.475 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_24_print_insert_placeholder_for_tensor_name in 15.56 us
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.816.464 [api_impl.cc:3717] 618658 ContextSetCurrent: set context=aaab0b9e09a0, flag=0.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.496 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim GetNext not exist in name to cnode
ce: device_id=7, deviceMode=0.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.514 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_25_getnext_for_ge in 18.48 us
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.816.503 [context.cpp:80]618658 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.816.511 [device.cc:306] 618674 Init: device mode has been already set, mode=0.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.533 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SyncBatchNorm not exist in name to cnode
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.816.528 [runtime.cc:3393] 618674 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x9
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.551 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_26_sync_bn_split in 17.43 us
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.816.547 [runtime.cc:3560] 618674 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=7
[INFO] KERNEL(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.816.556 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hccl_kernel_build.cc:32] HcclOpBuild] Build hccl op [AllReduce]
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.569 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SyncBatchNormGrad not exist in name to cnode
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.816.563 [api_impl.cc:2987] 618674 NewDevice: SetCurRef = 0xaaab0103b880,userDeviceId=7,deviceId=7
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.588 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_27_sync_bn_grad_split in 17.86 us
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.816.577 [runtime.cc:5239] 618674 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.816.597 [api_impl.cc:2992] 618674 NewDevice: New device success, user_device_id=7, die_num=1.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.604 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AvgPoolGrad not exist in name to cnode
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.816.579 [op_base.cc:1214] [618654][HcclSetConfig] Set HCCL_DETERMINISTIC is false
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.816.608 [op_base.cc:128] [618654][HcclGetDeviceId] deviceLogicId[2] 
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.622 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_28_avg_pool_grad_for_ge in 16.79 us
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.816.614 [api_impl.cc:3025] 618674 SetDevice: SetDevice success, curCtx=0xaaab0103b880, user_device_id=7.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.816.636 [context.cpp:72]618654 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.816.632 [acl.cpp:115]618674 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.816.646 [acl.cpp:121]618674 GetSocVersion: socVersion is Ascend910B3
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.816.652 [api_impl.cc:3717] 618654 ContextSetCurrent: set context=aaaaf5082ff0, flag=0.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.816.663 [device.cpp:154]618674 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 7
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.816.667 [context.cpp:80]618654 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.696 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_29_add_attr_to_dump in 52.991 us
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.816.705 [mindspore/ccsrc/plugin/res_manager/ascend/ascend_res_manager.cc:496] SetDeterministic] Set kernel deterministic value: 0
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.816.707 [mindspore/ccsrc/common/amp/amp.cc:149] GetCurrentAmpStrategy] amp strategy stack is empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.816.728 [context.cpp:174]618674 aclrtCtxSetSysParamOpt: start to execute aclrtCtxSetSysParamOpt, opt = 0, value = 0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.816.750 [api_impl.cc:6913] 618674 CtxSetSysParamOpt: curCtx = 0xaaab0103b880, configOpt=0, configVal=0.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.763 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_30_ascend_mindir_op_adapter in 43.23 us
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.816.767 [context.cpp:158]618674 SetSysParamOpt: successfully execute aclrtCtxSetSysParamOpt
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.786 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_0_clip_by_norm_fission is enabled.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.839 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_0_clip_by_norm_fission in 31.59 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.859 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_1_cdist_fission is enabled.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.913 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_1_cdist_fission in 29.3 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.933 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_2_cdist_grad_fission is enabled.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.980 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_2_cdist_grad_fission in 28.51 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.816.997 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_3_batchmatmul_reducescatter_alltoall_fusion is enabled.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.817.025 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_3_batchmatmul_reducescatter_alltoall_fusion in 9.83 us
[INFO] KERNEL(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.817.018 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hccl_kernel.cc:211] CalLoopSize] Get Hccl Kernel: AllReduce, output size: 1
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.817.047 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_4_alltoall_allgather_batch_matmul_fusion is enabled.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.817.068 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_4_alltoall_allgather_batch_matmul_fusion in 6.47 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.817.083 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_5_lamb_fission_ge is enabled.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.817.075 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:198] GenerateKernelMod] kernel opname:AllReduce, kernel type:hccl_kernel
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.817.090 [api_impl.cc:7115] 619016 ReserveMemAddress: device malloc Succ, size=61029220352(bytes) start ptr=0x12c2c0000000, end ptr=0x12d0f5a00000
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.817.145 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_5_lamb_fission_ge in 40.57 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.817.166 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_6_adaptive_max_pool2d_ge_fusion is enabled.
[INFO] SESSION(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.817.174 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.817.216 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_6_adaptive_max_pool2d_ge_fusion in 31.23 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.817.234 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_7_matmul_reduce_scatter_fusion is enabled.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.817.290 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1179] OptimizeExecutionOrder] [PROF]OptimizeExecutionOrder costs 0.127 msec.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.817.295 [mindspore/ccsrc/runtime/pynative/op_compiler.cc:179] Compile] Run Op cache miss Ascend_0_AllReducehccl_world_group0sumtrue03-1-3-343_0
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.817.321 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_7_matmul_reduce_scatter_fusion in 67.09 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.817.343 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_8_allgather_matmul_fusion is enabled.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.817.344 [op_base.cc:1214] [618674][HcclSetConfig] Set HCCL_DETERMINISTIC is false
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.817.367 [op_base.cc:128] [618674][HcclGetDeviceId] deviceLogicId[7] 
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.817.382 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1214] ResetNodeIds] Start reset node id
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.817.390 [context.cpp:72]618674 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.817.409 [api_impl.cc:3717] 618674 ContextSetCurrent: set context=aaab0103b880, flag=0.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.817.419 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_8_allgather_matmul_fusion in 57.19 us
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.817.427 [context.cpp:80]618674 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.817.439 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_9_FlashAttentionFusionV1 is enabled.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.817.442 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1234] ResetNodeIds] End reset node id
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.817.459 [mindspore/ccsrc/plugin/device/ascend/optimizer/ir_fusion/flash_attention_fusion.cc:270] DefineFlashAttentionPattern] Do FlashAttentionPattern V1.
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.817.467 [mindspore/ccsrc/common/amp/amp.cc:149] GetCurrentAmpStrategy] amp strategy stack is empty
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.817.471 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1123] DoStreamAssign] Status record: start stream assign, pynative_kernel_graph4000000000
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.817.495 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/acl_stream_assign.cc:151] AssignStream] Not stream assign when pynative forward.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.817.514 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1139] DoStreamAssign] Status record: end stream assign, pynative_kernel_graph4000000000
[INFO] SESSION(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.817.540 [mindspore/ccsrc/backend/common/session/kernel_graph.cc:944] PrintGraphExecuteOrder] Graph 4000000000 execution order:
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.817.587 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_9_FlashAttentionFusionV1 in 127.37 us
[INFO] SESSION(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.817.601 [mindspore/ccsrc/backend/common/session/kernel_graph.cc:984] PrintGraphExecuteOrder] Index[0], node name[Default/AllReduce-op0], logic id[4294967295], stream id[0], node info[@pynative_kernel_graph4000000000:CNode_1{[0]: ValueNode<Primitive> AllReduce, [1]: param_Parameter_2}], group[hccl_world_group]
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.817.616 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_10_FlashAttentionFusionV2 is enabled.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.817.636 [mindspore/ccsrc/plugin/device/ascend/optimizer/ir_fusion/flash_attention_fusion.cc:384] DefineFlashAttentionPattern] Do FlashAttentionPattern V2.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.817.695 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:151] CommonUnifyMindIR] start common unify mindir opt graph:4000000000
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.817.765 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_10_FlashAttentionFusionV2 in 127.3 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.817.760 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: conv_transpose_to_conv_backprop_input
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.817.788 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_11_quantbatchmatmul_reduce_fusion is enabled.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.817.877 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_11_quantbatchmatmul_reduce_fusion in 69.97 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.817.897 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_12_MatMulAllReduce is enabled.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.817.909 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_0_conv_transpose_to_conv_backprop_input in 156.23 us
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.817.899 [context.cpp:72]619017 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.817.925 [mindspore/ccsrc/runtime/pynative/op_compiler.cc:179] Compile] Run Op cache miss Ascend_0_AllReducehccl_world_group0sumtrue03-1-3-343_0
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.817.953 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: custom_op_reg_info_to_attr
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.817.957 [api_impl.cc:3717] 619017 ContextSetCurrent: set context=aaab0b9e09a0, flag=0.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.817.991 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_12_MatMulAllReduce in 59.52 us
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:47.817.982 [awatchdog_core.c:175](tid:619017) create watchdog for id : 65543, tid : 619017, timeout : 300s
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.818.000 [context.cpp:80]619017 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.817.999 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_1_custom_op_reg_info_to_attr in 43.86 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.818.013 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_13_grouped_matmul_assignadd_fusion is disabled.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.818.032 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_14_MatMulAllReduceAddRmsNorm is disabled.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.818.026 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Custom not exist in name to cnode
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.818.027 [mindspore/ccsrc/common/amp/amp.cc:149] GetCurrentAmpStrategy] amp strategy stack is empty
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.818.050 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_15_add_layer_norm_fusion is disabled.
[INFO] PRE_ACT(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.818.049 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:704] GenerateAllocator] Generate allocator, is persistent : 1, stream id : 0.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.818.050 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_2_inplace_assign_for_custom_op in 24.69 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.818.067 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_16_add_layer_norm_v3_fusion is disabled.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.818.083 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_17_add_layer_norm_ext_fusion is disabled.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.818.074 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: convert_attr_to_unify_mindir
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.818.099 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_18_inference_qbmm_add_fusion is disabled.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.818.114 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_19_inference_swiglu_fusion is disabled.
[INFO] PRE_ACT(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.818.097 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:716] operator()] Malloc mem block, is enable eager free : 0, is enable vmm : 1, size : 512, block size : 1073741824.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.818.131 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_20_inference_matmul_split_fusion is disabled.
[INFO] DEVICE(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.818.129 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.cc:204] AllocDeviceMem] VMM AllocDeviceMem size:61029220352, align_size:61029220352
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.818.136 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_3_convert_attr_to_unify_mindir in 59.26 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.818.146 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_21_add_rms_norm_dynamic_quant_fusion is disabled.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.818.162 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_22_add_rms_norm_quant_fusion is disabled.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.818.167 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:164] CommonUnifyMindIR] [PROF]CommonUnifyMindIR costs 0.475 msec.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.818.176 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_23_add_cast_rms_norm_cast_quant_fusion is disabled.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.818.199 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_24_rms_norm_quant_fusion is disabled.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.818.215 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_25_add_cast_rms_norm_cast_fusion is disabled.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.818.230 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_26_shape_reshape is disabled.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.818.244 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_27_split_concat_fusion is enabled.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.818.241 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:191] EliminateIllegalDataTypePass] Start eliminate illegal data type for kernel graph id:4000000000
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.818.279 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:151] CommonUnifyMindIR] start common unify mindir opt graph:4000000000
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.818.301 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_eliminate_illegal_data_type_pm_0_convert_list_to_tuple in 6.73 us
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.818.286 [device.cpp:143]618662 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.818.325 [api_impl.cc:2999] 618662 SetDevice: device_id=4, deviceMode=0.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.818.336 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: conv_transpose_to_conv_backprop_input
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.818.344 [device.cc:306] 618662 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.818.361 [runtime.cc:3393] 618662 PrimaryContextRetain: Context inc ref, ts_id=0, count=0x9
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.818.369 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_eliminate_illegal_data_type_pm_1_eliminate_func_type in 40.04 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.818.413 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:204] EliminateIllegalDataTypePass] [PROF]EliminateIllegalDataTypePass costs 0.169 msec.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.818.455 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:151] CommonUnifyMindIR] start common unify mindir opt graph:4000000000
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.818.379 [runtime.cc:3560] 618662 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.818.396 [api_impl.cc:2987] 618662 NewDevice: SetCurRef = 0xaaab087d6320,userDeviceId=4,deviceId=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.818.409 [runtime.cc:5239] 618662 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.818.423 [api_impl.cc:2992] 618662 NewDevice: New device success, user_device_id=4, die_num=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.818.436 [api_impl.cc:3025] 618662 SetDevice: SetDevice success, curCtx=0xaaab087d6320, user_device_id=4.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.818.446 [acl.cpp:115]618662 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.818.458 [acl.cpp:121]618662 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.818.470 [device.cpp:154]618662 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 4
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.818.469 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_0_conv_transpose_to_conv_backprop_input in 139.2 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.818.493 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_27_split_concat_fusion in 224.09 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.818.497 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: conv_transpose_to_conv_backprop_input
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.818.504 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: custom_op_reg_info_to_attr
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.818.504 [mindspore/ccsrc/plugin/res_manager/ascend/ascend_res_manager.cc:496] SetDeterministic] Set kernel deterministic value: 0
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.818.519 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_28_matmul_sigmoid_add_fusion is disabled.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.818.524 [context.cpp:174]618662 aclrtCtxSetSysParamOpt: start to execute aclrtCtxSetSysParamOpt, opt = 0, value = 0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.818.544 [api_impl.cc:6913] 618662 CtxSetSysParamOpt: curCtx = 0xaaab087d6320, configOpt=0, configVal=0.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.818.539 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_29_matmul_sigmoid_cast_add_fusion is disabled.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.818.550 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_0_conv_transpose_to_conv_backprop_input in 50.44 us
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.818.562 [context.cpp:158]618662 SetSysParamOpt: successfully execute aclrtCtxSetSysParamOpt
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.818.556 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_30_matmul_elemwise_fusion is disabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.818.551 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_1_custom_op_reg_info_to_attr in 43.99 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.818.572 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_31_qbmm_allreduce_convert_bias is disabled.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.818.572 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: custom_op_reg_info_to_attr
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.818.586 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_32_inference_qbmm_allreduce_add_fusion is enabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.818.591 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Custom not exist in name to cnode
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.818.613 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_2_inplace_assign_for_custom_op in 22.63 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.818.611 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_1_custom_op_reg_info_to_attr in 36.42 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.818.634 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Custom not exist in name to cnode
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.818.632 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: convert_attr_to_unify_mindir
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.818.654 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_2_inplace_assign_for_custom_op in 18.46 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.818.675 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: convert_attr_to_unify_mindir
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.818.676 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_3_convert_attr_to_unify_mindir in 41.37 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.818.684 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_32_inference_qbmm_allreduce_add_fusion in 78.01 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.818.706 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_33_remove_fa_tensor_to_tuple_ops is disabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.818.708 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:164] CommonUnifyMindIR] [PROF]CommonUnifyMindIR costs 0.432 msec.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.818.721 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_34_transpose_batch_matmul_transpose_fusion is disabled.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.818.713 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_3_convert_attr_to_unify_mindir in 35.501 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.818.737 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_35_add_rms_norm_fusion is enabled.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.818.755 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:164] CommonUnifyMindIR] [PROF]CommonUnifyMindIR costs 0.297 msec.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.818.779 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:191] EliminateIllegalDataTypePass] Start eliminate illegal data type for kernel graph id:4000000000
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.818.789 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:81] BackendCommonOptimization] Status record: start common optimization. graph id: 4000000000
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.818.795 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_35_add_rms_norm_fusion in 40.2 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.818.834 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_eliminate_illegal_data_type_pm_0_convert_list_to_tuple in 5.55 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.818.848 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:203] GEUnifyMindIR] [PROF]GEUnifyMindIR costs 3.745 msec.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.818.899 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_eliminate_illegal_data_type_pm_1_eliminate_func_type in 37.4 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.818.899 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: convert_dynamic_broadcast_to
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.818.945 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:204] EliminateIllegalDataTypePass] [PROF]EliminateIllegalDataTypePass costs 0.163 msec.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.818.974 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:151] CommonUnifyMindIR] start common unify mindir opt graph:4000000000
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.818.982 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_0_convert_dynamic_broadcast_to in 80.16 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.819.015 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: conv_transpose_to_conv_backprop_input
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.819.043 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_1_convert_const_input_to_attr in 34.93 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.819.064 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_0_conv_transpose_to_conv_backprop_input in 46.83 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.819.089 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: custom_op_reg_info_to_attr
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.819.102 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_2_custom_op_const_input_to_attr in 31.59 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.819.125 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_1_custom_op_reg_info_to_attr in 33.7 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.819.149 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Custom not exist in name to cnode
[INFO] SESSION(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.819.149 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.819.156 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_3_convert_const_input_to_tensor_input in 28.27 us
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.819.154 [op_base.cc:1214] [618662][HcclSetConfig] Set HCCL_DETERMINISTIC is false
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.819.171 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_2_inplace_assign_for_custom_op in 21.45 us
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.819.178 [op_base.cc:128] [618662][HcclGetDeviceId] deviceLogicId[4] 
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.819.191 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: convert_attr_to_unify_mindir
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.819.200 [context.cpp:72]618662 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.819.219 [api_impl.cc:3717] 618662 ContextSetCurrent: set context=aaab087d6320, flag=0.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.819.230 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_3_convert_attr_to_unify_mindir in 36.41 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.819.224 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_4_convert_const_input_to_tensor_input_for_print in 40.32 us
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.819.234 [context.cpp:80]618662 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.819.261 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_graph_optimization.cc:40] MarkRefGraph] Mark graph is ref graph: 4000000000
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.819.273 [mindspore/ccsrc/common/amp/amp.cc:149] GetCurrentAmpStrategy] amp strategy stack is empty
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.819.275 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:164] CommonUnifyMindIR] [PROF]CommonUnifyMindIR costs 0.296 msec.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.819.327 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:81] BackendCommonOptimization] Status record: start common optimization. graph id: 4000000000
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.819.359 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_5_convert_tuple_output_to_maketuple in 107.491 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.819.388 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_6_convert_unused_tuple_para_to_make_tuple in 2.22 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.819.422 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unfold_inputs_for_special_nodes_pm_0_ascend_convert_tuple_input_to_dynamic_input in 91.411 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.819.423 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_common_pm_7_flatten_concat_fission is enabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.819.425 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: convert_dynamic_broadcast_to
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.819.457 [api_impl.cc:7115] 619017 ReserveMemAddress: device malloc Succ, size=61029220352(bytes) start ptr=0x12c2c0000000, end ptr=0x12d0f5a00000
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.819.500 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_0_convert_dynamic_broadcast_to in 72.6 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.819.499 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_common_pm_7_flatten_concat_fission in 52.51 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.819.537 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_0_process_call_inline in 31.53 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.819.555 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_8_inset_input_structural_for_py_execute in 29.76 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.819.558 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_1_convert_const_input_to_attr in 31.27 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.819.577 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_common_pm_9_broadcast_to_fusion is enabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.819.603 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_2_custom_op_const_input_to_attr in 19.31 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.819.628 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_1_seed_adapter in 61.33 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.819.654 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_3_convert_const_input_to_tensor_input in 25.12 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.819.651 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_common_pm_9_broadcast_to_fusion in 49.68 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.819.667 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_2_insert_tensor_move_for_communication in 11.98 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.819.713 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_4_convert_const_input_to_tensor_input_for_print in 34.37 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.819.722 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_3_process partial inline in 28.41 us
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.819.731 [mindspore/ccsrc/runtime/pynative/op_compiler.cc:179] Compile] Run Op cache miss Ascend_0_AllReducehccl_world_group0sumtrue03-1-3-343_0
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.819.760 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_4_expander_fallback in 13.99 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.819.812 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_5_convert_pad_v3_paddings in 27.24 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.819.859 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_6_convert_pad_v3_grad_paddings in 24.1 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.819.850 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_5_convert_tuple_output_to_maketuple in 104.14 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.819.882 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_6_convert_unused_tuple_para_to_make_tuple in 2.16 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.819.902 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_common_pm_7_flatten_concat_fission is enabled.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.819.928 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_7_resize_bilinear_add_attr in 44.6 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.819.966 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_8_backend_custom_depend in 12.45 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.819.974 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_common_pm_7_flatten_concat_fission in 48.03 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.820.009 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:120] GEBackendOptimizeACL] [PROF]GEBackendOptimizeACL costs 0.526 msec.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.820.032 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_8_inset_input_structural_for_py_execute in 28.841 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.820.057 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_common_pm_9_broadcast_to_fusion is enabled.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.820.062 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_graph_optimization.cc:131] OptimizeACLGraph] [PROF]OptimizeACLGraph costs 0.801 msec.
[INFO] SESSION(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.820.104 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.820.123 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_common_pm_9_broadcast_to_fusion in 43.8 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.820.133 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:151] CommonUnifyMindIR] start common unify mindir opt graph:4000000000
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.820.211 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: conv_transpose_to_conv_backprop_input
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.820.201 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_10_add_attr_to_node in 517.811 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.820.228 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_common_pm_11_replace_addn is enabled.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.820.291 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_common_pm_11_replace_addn in 37.88 us
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.820.336 [mindspore/ccsrc/plugin/device/ascend/hal/device/kernel_select_ascend.cc:624] CollectOpSelectedType] AllReduce select hccl kernel
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.820.342 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_0_conv_transpose_to_conv_backprop_input in 133.55 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.820.346 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:93] BackendCommonOptimization] [PROF]BackendCommonOptimization costs 1.551 msec.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.820.370 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:315] SelectKernel] [PROF]SelectKernel costs 0.28 msec.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.820.367 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:100] BackendCommonOptimization] Status record: end common optimization. graph id: 4000000000
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.820.375 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: custom_op_reg_info_to_attr
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.820.389 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:319] PrintOpSelectedNum] Number of GE_KERNEL, INTERNAL_KERNEL, OPAPI_KERNEL, ACL_KERNEL, ATB_KERNEL, HCCL_KERNEL, HOST_KERNEL:
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.820.407 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:327] PrintOpSelectedNum] 0 0 0 0 0 1 0 
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.820.419 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_1_custom_op_reg_info_to_attr in 41.91 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.820.422 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:258] OptimizationWithoutBackend] [PROF]OptimizationWithoutBackend costs 2.179 msec.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.820.443 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Custom not exist in name to cnode
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.820.466 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_2_inplace_assign_for_custom_op in 22.89 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.820.481 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_0_set_fracz_group_attr in 13.69 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.820.487 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: convert_attr_to_unify_mindir
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.820.548 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_3_convert_attr_to_unify_mindir in 58.54 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.820.563 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_10_add_attr_to_node in 408.47 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.820.591 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_common_pm_11_replace_addn is enabled.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.820.568 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_1_insert_identity in 58.91 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.820.580 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:164] CommonUnifyMindIR] [PROF]CommonUnifyMindIR costs 0.449 msec.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.820.650 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:191] EliminateIllegalDataTypePass] Start eliminate illegal data type for kernel graph id:4000000000
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.820.656 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_2_erase_visit_attr in 46.25 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.820.654 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_common_pm_11_replace_addn in 38.46 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.820.700 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:93] BackendCommonOptimization] [PROF]BackendCommonOptimization costs 1.37 msec.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.820.704 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_eliminate_illegal_data_type_pm_0_convert_list_to_tuple in 5.46 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.820.722 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:100] BackendCommonOptimization] Status record: end common optimization. graph id: 4000000000
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.820.753 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_3_deal_ref_output in 69.091 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.820.764 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_eliminate_illegal_data_type_pm_1_eliminate_func_type in 33.97 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.820.777 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_opt_acl_after_kernel_select_pm_4_shape_reshape is disabled.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.820.795 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_opt_acl_after_kernel_select_pm_5_shape_reshape_direct is enabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.820.790 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:258] OptimizationWithoutBackend] [PROF]OptimizationWithoutBackend costs 2.008 msec.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.820.810 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:204] EliminateIllegalDataTypePass] [PROF]EliminateIllegalDataTypePass costs 0.156 msec.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.820.831 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_0_renorm_split in 58.39 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.820.840 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:151] CommonUnifyMindIR] start common unify mindir opt graph:4000000000
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.820.855 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_opt_acl_after_kernel_select_pm_5_shape_reshape_direct in 38.14 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.820.859 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: reduce_axis_update
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.820.877 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: conv_transpose_to_conv_backprop_input
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.820.892 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_6_graph_view_replace in 13.12 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.820.915 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_7_label_1f1b_overlap_node in 0.64 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.820.923 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_0_conv_transpose_to_conv_backprop_input in 43.53 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.820.947 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: custom_op_reg_info_to_attr
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.820.957 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:173] GEBackendOptimizeACLAfterKernelSelect] [PROF]GEBackendOptimizeACLAfterKernelSelect costs 0.528 msec.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.820.953 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_1_reduce_axis_update in 91.27 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.820.978 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: space_to_batch_nd_attr_update
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.820.982 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_1_custom_op_reg_info_to_attr in 32.19 us
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.821.008 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_graph_optimization.cc:166] OptimizeACLGraphAfterKernelSelect] [PROF]OptimizeACLGraphAfterKernelSelect costs 0.581 msec.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.821.004 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Custom not exist in name to cnode
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.821.039 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_2_inplace_assign_for_custom_op in 33.5 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.039 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_2_space_to_batch_nd_attr_update in 58.04 us
[INFO] SESSION(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.821.048 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.821.060 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: convert_attr_to_unify_mindir
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.062 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: batch_to_space_nd_attr_update
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.821.097 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_unify_mindir_pm_3_convert_attr_to_unify_mindir in 34.89 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.101 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_3_batch_to_space_nd_attr_update in 36.01 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.821.139 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:164] CommonUnifyMindIR] [PROF]CommonUnifyMindIR costs 0.295 msec.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.144 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AdamWeightDecay not exist in name to cnode
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.821.153 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_after_inline_pm_0_DropoutGenMask is enabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.821.172 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:81] BackendCommonOptimization] Status record: start common optimization. graph id: 4000000000
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.821.169 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_0_renorm_split in 53.2 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.821.178 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_after_inline_pm_0_DropoutGenMask in 0.67 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.165 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_4_adam_weight_decay_unify_mindir in 41.31 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.821.197 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: reduce_axis_update
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.206 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_5_add_depend_for_adamw in 6.35 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.821.223 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_1_cse in 20.13 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.821.250 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_2_eliminate_maketuple_getitem in 4.01 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.821.270 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_3_insert_move_to in 0.55 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.821.267 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: convert_dynamic_broadcast_to
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.269 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SparseSoftmaxCrossEntropyWithLogits not exist in name to cnode
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.821.281 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_1_reduce_axis_update in 77.1 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.293 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_6_pynative_grad_sparse_softmax_cross_entropy_with_logits_unify_mindir_v2 in 65.21 us
[INFO] SESSION(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.821.304 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.821.306 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: space_to_batch_nd_attr_update
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.317 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SparseSoftmaxCrossEntropyWithLogits not exist in name to cnode
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.338 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_7_pynative_grad_sparse_softmax_cross_entropy_with_logits_unify_mindir in 23.96 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.821.341 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_0_convert_dynamic_broadcast_to in 71.33 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.360 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SparseSoftmaxCrossEntropyWithLogits not exist in name to cnode
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.821.363 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_2_space_to_batch_nd_attr_update in 54.361 us
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.821.381 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_4_insert_pre_fetch_depend in 86.271 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.381 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_8_pynative_sparse_softmax_cross_entropy_with_logits_unify_mindir in 20.44 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.821.388 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: batch_to_space_nd_attr_update
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.821.405 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_5_overlap_1b1f in 0.71 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.821.397 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_1_convert_const_input_to_attr in 31 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.821.425 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_3_batch_to_space_nd_attr_update in 35.01 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.425 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim DropoutExt not exist in name to cnode
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.821.431 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:242] GEAfterInlineOptimize] [PROF]GEAfterInlineOptimize costs 0.301 msec.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.821.441 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_2_custom_op_const_input_to_attr in 18.48 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.446 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_9_dropout_ext_unify_mindir1 in 41.62 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.465 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim DropoutGradExt not exist in name to cnode
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.821.466 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AdamWeightDecay not exist in name to cnode
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.821.488 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_4_adam_weight_decay_unify_mindir in 39.47 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.486 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_10_dropoutgrad_ext_unify_mindir in 20.39 us
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.821.488 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:437] InlineCallGraph] [PROF]InlineCallGraph costs 0.453 msec.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.507 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Dropout not exist in name to cnode
[INFO] SESSION(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.821.526 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.821.528 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_5_add_depend_for_adamw in 18.81 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.529 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_11_dropout_unify_mindir1 in 21.49 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.550 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: dropoutgrad_unify_mindir
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.821.556 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_3_convert_const_input_to_tensor_input in 88.95 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.595 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_12_dropoutgrad_unify_mindir in 35.56 us
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.821.607 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:912] InlineSwitchGraph] [PROF]InlineSwitchGraph costs 0.09 msec.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.821.612 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_4_convert_const_input_to_tensor_input_for_print in 30 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.821.612 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SparseSoftmaxCrossEntropyWithLogits not exist in name to cnode
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.821.635 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_6_pynative_grad_sparse_softmax_cross_entropy_with_logits_unify_mindir_v2 in 82.43 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.821.656 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SparseSoftmaxCrossEntropyWithLogits not exist in name to cnode
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.649 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim NeighborExchange not exist in name to cnode
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.671 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_13_neighbor_exchange_unify_mindir in 51.32 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.821.674 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_7_pynative_grad_sparse_softmax_cross_entropy_with_logits_unify_mindir in 18.27 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.821.693 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SparseSoftmaxCrossEntropyWithLogits not exist in name to cnode
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.693 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim NeighborExchangeV2 not exist in name to cnode
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.821.711 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_8_pynative_sparse_softmax_cross_entropy_with_logits_unify_mindir in 16.19 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.714 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_14_neighbor_exchange_v2_unify_mindir in 20.39 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.821.736 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_5_convert_tuple_output_to_maketuple in 99.28 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.745 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim NeighborExchangeV2Grad not exist in name to cnode
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.821.746 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim DropoutExt not exist in name to cnode
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.764 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_15_neighbor_exchange_v2_grad_unify_mindir in 17.55 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.821.763 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_6_convert_unused_tuple_para_to_make_tuple in 1.98 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.821.781 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_common_pm_7_flatten_concat_fission is enabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.821.766 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_9_dropout_ext_unify_mindir1 in 33.7 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.785 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AlltoAll not exist in name to cnode
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.806 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_16_all_to_all_unify_mindir in 20.44 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.821.810 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim DropoutGradExt not exist in name to cnode
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.821.831 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_10_dropoutgrad_ext_unify_mindir in 32.76 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.844 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AlltoAllV not exist in name to cnode
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.821.851 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Dropout not exist in name to cnode
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.821.852 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_common_pm_7_flatten_concat_fission in 52.11 us
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.821.847 [context.cpp:72]618666 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.866 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_17_all_to_all_v_unify_mindir in 37.18 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.821.872 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_11_dropout_unify_mindir1 in 19.89 us
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.821.876 [api_impl.cc:3717] 618666 ContextSetCurrent: set context=aaaaf6e2dcc0, flag=0.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.821.892 [context.cpp:80]618666 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.821.892 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: dropoutgrad_unify_mindir
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.903 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNorm not exist in name to cnode
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.821.904 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_8_inset_input_structural_for_py_execute in 27.58 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.925 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_18_bn_split in 36.12 us
[INFO] KERNEL(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.821.929 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hccl_kernel_build.cc:32] HcclOpBuild] Build hccl op [AllReduce]
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.821.926 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_common_pm_9_broadcast_to_fusion is enabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.821.937 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_12_dropoutgrad_unify_mindir in 41.72 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.821.946 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: bn_grad_unify_mindir
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.821.991 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim NeighborExchange not exist in name to cnode
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.821.990 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_common_pm_9_broadcast_to_fusion in 44.1 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.013 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_13_neighbor_exchange_unify_mindir in 49.86 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.822.012 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_19_bn_grad_unify_mindir in 63.47 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.034 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim NeighborExchangeV2 not exist in name to cnode
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.051 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_14_neighbor_exchange_v2_unify_mindir in 17.56 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.822.053 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNormGrad not exist in name to cnode
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.822.074 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_20_bn_grad_split in 37.83 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.072 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim NeighborExchangeV2Grad not exist in name to cnode
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.093 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_15_neighbor_exchange_v2_grad_unify_mindir in 19.3 us
[INFO] KERNEL(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.822.092 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hccl_kernel.cc:211] CalLoopSize] Get Hccl Kernel: AllReduce, output size: 1
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.822.093 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNormGrad not exist in name to cnode
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.111 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AlltoAll not exist in name to cnode
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.822.114 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_21_batchnormgrad_to_bninfergrad in 20.1 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.822.133 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNormGrad not exist in name to cnode
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.822.135 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:198] GenerateKernelMod] kernel opname:AllReduce, kernel type:hccl_kernel
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.132 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_16_all_to_all_unify_mindir in 20.27 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.822.151 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_22_batch_norm_grad_infer_fission in 17.04 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.165 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AlltoAllV not exist in name to cnode
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.822.173 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNorm not exist in name to cnode
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.186 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_17_all_to_all_v_unify_mindir in 31.15 us
[INFO] SESSION(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.822.193 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.822.191 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_23_batchnorm_to_bninfer in 17.24 us
[INFO] PRE_ACT(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.822.180 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:736] operator()] Malloc mem block : {"addr_":0x12c2c0000000,"size_":61029220352,"stream_id_":0,"min_addr_":0,"max_addr_":0}.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.822.216 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Print not exist in name to cnode
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.218 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNorm not exist in name to cnode
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.822.220 [api_impl.cc:7129] 619015 MallocPhysical: Start to MallocPhysical
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.240 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_18_bn_split in 31.13 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.822.238 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_24_print_insert_placeholder_for_tensor_name in 21.12 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.257 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: bn_grad_unify_mindir
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.822.276 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim GetNext not exist in name to cnode
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.822.290 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1179] OptimizeExecutionOrder] [PROF]OptimizeExecutionOrder costs 0.106 msec.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.822.305 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_25_getnext_for_ge in 44.94 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.324 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_19_bn_grad_unify_mindir in 63.4 us
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.822.328 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1214] ResetNodeIds] Start reset node id
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.822.341 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SyncBatchNorm not exist in name to cnode
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.822.348 [api_impl.cc:7145] 619015 MapMem: device malloc Succ, size=2097152(bytes), start ptr=0x12c2c0000000, end ptr=0x12c2c0200000
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.822.365 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1234] ResetNodeIds] End reset node id
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.357 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNormGrad not exist in name to cnode
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.822.365 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_26_sync_bn_split in 35.63 us
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.822.387 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1123] DoStreamAssign] Status record: start stream assign, pynative_kernel_graph4000000000
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.387 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_20_bn_grad_split in 40.46 us
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.822.407 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/acl_stream_assign.cc:151] AssignStream] Not stream assign when pynative forward.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.822.400 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SyncBatchNormGrad not exist in name to cnode
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.411 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNormGrad not exist in name to cnode
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.822.424 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1139] DoStreamAssign] Status record: end stream assign, pynative_kernel_graph4000000000
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.822.422 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_27_sync_bn_grad_split in 33.8 us
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.822.419 [device.cpp:143]619015 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 6.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.432 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_21_batchnormgrad_to_bninfergrad in 20.72 us
[INFO] SESSION(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.822.445 [mindspore/ccsrc/backend/common/session/kernel_graph.cc:944] PrintGraphExecuteOrder] Graph 4000000000 execution order:
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.822.443 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AvgPoolGrad not exist in name to cnode
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.822.461 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_28_avg_pool_grad_for_ge in 17.7 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.822.432 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_common_pm_10_add_attr_to_node in 412.311 us
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.822.441 [api_impl.cc:2999] 619015 SetDevice: device_id=6, deviceMode=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.822.457 [device.cc:306] 619015 Init: device mode has been already set, mode=0.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.451 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNormGrad not exist in name to cnode
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.469 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_22_batch_norm_grad_infer_fission in 17.7 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.822.472 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_common_pm_11_replace_addn is enabled.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.822.472 [runtime.cc:3393] 619015 PrimaryContextRetain: Context inc ref, ts_id=0, count=0xa
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.822.488 [runtime.cc:3560] 619015 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=6
[INFO] SESSION(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.822.488 [mindspore/ccsrc/backend/common/session/kernel_graph.cc:984] PrintGraphExecuteOrder] Index[0], node name[Default/AllReduce-op0], logic id[4294967295], stream id[0], node info[@pynative_kernel_graph4000000000:CNode_1{[0]: ValueNode<Primitive> AllReduce, [1]: param_Parameter_2}], group[hccl_world_group]
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.486 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNorm not exist in name to cnode
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.822.502 [api_impl.cc:2987] 619015 NewDevice: SetCurRef = 0xaaaad9a630c0,userDeviceId=6,deviceId=6
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.505 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_23_batchnorm_to_bninfer in 18.26 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.524 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Print not exist in name to cnode
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.822.516 [runtime.cc:5239] 619015 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.822.526 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_common_pm_11_replace_addn in 33.03 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.541 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_24_print_insert_placeholder_for_tensor_name in 16.77 us
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.822.531 [api_impl.cc:2992] 619015 NewDevice: New device success, user_device_id=6, die_num=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.822.547 [api_impl.cc:3025] 619015 SetDevice: SetDevice success, curCtx=0xaaaad9a630c0, user_device_id=6.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.822.556 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_29_add_attr_to_dump in 72.27 us
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.822.559 [acl.cpp:115]619015 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.822.574 [acl.cpp:121]619015 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.822.587 [device.cpp:154]619015 acl[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.578 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim GetNext not exist in name to cnode
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.822.576 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:93] BackendCommonOptimization] [PROF]BackendCommonOptimization costs 1.399 msec.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.600 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_25_getnext_for_ge in 36.47 us
rtSetDevice: successfully execute aclrtSetDevice, deviceId = 6
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.822.599 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:100] BackendCommonOptimization] Status record: end common optimization. graph id: 4000000000
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.631 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SyncBatchNorm not exist in name to cnode
[INFO] DEVICE(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.822.632 [mindspore/ccsrc/plugin/res_manager/ascend/ascend_res_manager.cc:496] SetDeterministic] Set kernel deterministic value: 0
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.652 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_26_sync_bn_split in 31.53 us
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.822.650 [context.cpp:174]619015 aclrtCtxSetSysParamOpt: start to execute aclrtCtxSetSysParamOpt, opt = 0, value = 0.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.822.651 [mindspore/ccsrc/backend/common/optimizer/common_backend_optimization.cc:258] OptimizationWithoutBackend] [PROF]OptimizationWithoutBackend costs 1.998 msec.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.822.668 [api_impl.cc:6913] 619015 CtxSetSysParamOpt: curCtx = 0xaaaad9a630c0, configOpt=0, configVal=0.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.822.682 [context.cpp:158]619015 SetSysParamOpt: successfully execute aclrtCtxSetSysParamOpt
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.684 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SyncBatchNormGrad not exist in name to cnode
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.822.697 [context.cpp:72]619018 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.707 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_27_sync_bn_grad_split in 33.211 us
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.822.725 [api_impl.cc:3717] 619018 ContextSetCurrent: set context=aaaaf6e2dcc0, flag=0.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.822.729 [op_base.cc:1214] [619015][HcclSetConfig] Set HCCL_DETERMINISTIC is false
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.741 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AvgPoolGrad not exist in name to cnode
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.822.752 [runtime.cc:5239] 619015 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:47.822.746 [awatchdog_core.c:175](tid:619018) create watchdog for id : 65543, tid : 619018, timeout : 300s
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.822.768 [mindspore/ccsrc/common/amp/amp.cc:149] GetCurrentAmpStrategy] amp strategy stack is empty
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.762 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_28_avg_pool_grad_for_ge in 31.53 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.822.766 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_30_ascend_mindir_op_adapter in 180.991 us
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.822.770 [adapter_rts.cc:234] [619015][hrtGetDevice]deviceLogicId[6]
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.822.773 [context.cpp:80]619018 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.822.790 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_0_clip_by_norm_fission is enabled.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:47.822.784 [op_base.cc:128] [619015][HcclGetDeviceId] deviceLogicId[6] 
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.822.821 [context.cpp:72]619015 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] PRE_ACT(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.822.829 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:704] GenerateAllocator] Generate allocator, is persistent : 1, stream id : 0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.822.840 [api_impl.cc:3717] 619015 ContextSetCurrent: set context=aaaad9a630c0, flag=0.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.822.846 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_0_clip_by_norm_fission in 34.43 us
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.822.855 [context.cpp:80]619015 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.822.856 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_29_add_attr_to_dump in 64.15 us
[INFO] PRE_ACT(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.822.868 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:716] operator()] Malloc mem block, is enable eager free : 0, is enable vmm : 1, size : 512, block size : 1073741824.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.822.871 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_1_cdist_fission is enabled.
[INFO] DEVICE(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.822.889 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.cc:204] AllocDeviceMem] VMM AllocDeviceMem size:61027123200, align_size:61027123200
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.822.886 [api_error.cc:1807] 619015 MemcpyAsyncCheckKindAndLocation: src pointer loc type=1, dst pointer loc type=2, kind=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.822.909 [memory_task.cc:342] 619015 ConvertCpyType: MemcpyAsyncTask::ConvertCpyType MEMCPY_HOST_TO_DEVICE, direct=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.822.925 [memory_task.cc:473] 619015 MemcpyAsyncTaskInitV3: Init qos=0, partId=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.822.937 [memory_task.cc:518] 619015 MemcpyAsyncTaskInitV3: CopyType=0: use virtual address directly.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.822.942 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_1_cdist_fission in 47.05 us
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.822.953 [task_res.cc:380] 619015 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=6, stream_id=2, taskResId=0, taskResHead_=0, taskResTail_=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.822.971 [memory_task.cc:1007] 619015 ConstructPcieDmaSqe: stream_id=2, task_id=0, copyType=0, src=0xaaaae55874e0, dst=0x12c2c0000000, len=0x6c
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.822.967 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_2_cdist_grad_fission is enabled.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.822.987 [memory_task.cc:1166] 619015 ConstructSqeForMemcpyAsyncTask: MemcpyAsyncTask, stream_id=2, task_id=0, copyType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.823.003 [stream.cc:1400] 619015 AddTaskToList: public task, stream_id=2, task_id=0, task_type=5 (MEMCPY_ASYNC), head=0, tail=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.823.020 [stream.cc:2595] 619015 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=0, type=5(MEMCPY_ASYNC), head=0, tail=1, sqe_num=1, lastTail=0, device_id=6
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.823.021 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_2_cdist_grad_fission in 29.36 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.019 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_0_renorm_split in 53.62 us
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.823.042 [task_submit.cc:573] 619015 AllocTaskAndSendStars: device_id=6, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=0, task_type=5(MEMCPY_ASYNC).
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.823.044 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_3_batchmatmul_reducescatter_alltoall_fusion is enabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.823.046 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_30_ascend_mindir_op_adapter in 157.02 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.051 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: reduce_axis_update
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.823.061 [stream.cc:1494] 619015 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.823.085 [callback.cpp:97]619015 aclrtLaunchCallback: start to execute aclrtLaunchCallback.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.823.073 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_0_clip_by_norm_fission is enabled.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.823.098 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_3_batchmatmul_reducescatter_alltoall_fusion in 28.47 us
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.823.105 [task_res.cc:380] 619015 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=6, stream_id=2, taskResId=1, taskResHead_=0, taskResTail_=2.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.823.121 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_4_alltoall_allgather_batch_matmul_fusion is enabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.127 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_1_reduce_axis_update in 72.94 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.823.140 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_0_clip_by_norm_fission in 29.47 us
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.823.125 [task_info.cc:521] 619015 ConstructSqeForCallbackLaunchTask: CallbackLaunch,topic_type=4,stream_id=2,task_id=1,eventId=65535,isBlock=0,pid=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.823.156 [stream.cc:1400] 619015 AddTaskToList: public task, stream_id=2, task_id=1, task_type=72 (HOSTFUNC_CALLBACK), head=0, tail=2
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.151 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: space_to_batch_nd_attr_update
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.823.163 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_1_cdist_fission is enabled.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.823.171 [stream.cc:2595] 619015 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=1, type=72(HOSTFUNC_CALLBACK), head=0, tail=2, sqe_num=1, lastTail=1, device_id=6
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.823.167 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_4_alltoall_allgather_batch_matmul_fusion in 23.16 us
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.823.187 [task_submit.cc:573] 619015 AllocTaskAndSendStars: device_id=6, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=1, task_type=72(HOSTFUNC_CALLBACK).
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.823.202 [stream.cc:1494] 619015 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=1.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.823.217 [callback.cpp:109]619015 aclrtLaunchCallback: successfully execute aclrtLaunchCallback
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.823.204 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_5_lamb_fission_ge is enabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.205 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_2_space_to_batch_nd_attr_update in 50.47 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.228 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: batch_to_space_nd_attr_update
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.823.229 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_1_cdist_fission in 43.75 us
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.823.231 [npu_driver.cc:3844] 618822 CqReportGet: cq report get start, device_id=6, tsId=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.823.251 [npu_driver.cc:3851] 618822 CqReportGet: halCqReportGet count=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.823.264 [api_impl.cc:5087] 618822 ProcessReport: report[0], sqid=12291, streamId=2, taskId=1, eventId=65535, isBlock=0
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.823.254 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_2_cdist_grad_fission is enabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.263 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_3_batch_to_space_nd_attr_update in 32.3 us
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.823.283 [callback.cpp:138]618822 aclrtProcessReport: successfully aclrtProcessReport, timeout is 500ms.
[INFO] PRE_ACT(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.823.291 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:704] GenerateAllocator] Generate allocator, is persistent : 0, stream id : 0.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.823.292 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_5_lamb_fission_ge in 63.51 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.299 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AdamWeightDecay not exist in name to cnode
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.823.300 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.823.317 [npu_driver.cc:3828] 618822 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=64.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.823.306 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_2_cdist_grad_fission in 28.56 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.823.315 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_6_adaptive_max_pool2d_ge_fusion is enabled.
[INFO] PRE_ACT(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.823.322 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:716] operator()] Malloc mem block, is enable eager free : 0, is enable vmm : 1, size : 512, block size : 1073741824.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.322 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_4_adam_weight_decay_unify_mindir in 35.75 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.823.329 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_3_batchmatmul_reducescatter_alltoall_fusion is enabled.
[INFO] DEVICE(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.823.344 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.cc:204] AllocDeviceMem] VMM AllocDeviceMem size:61029220352, align_size:61029220352
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.351 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_5_add_depend_for_adamw in 6.21 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.823.374 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_3_batchmatmul_reducescatter_alltoall_fusion in 23.131 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.823.384 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_6_adaptive_max_pool2d_ge_fusion in 47.601 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.823.395 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_4_alltoall_allgather_batch_matmul_fusion is enabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.407 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SparseSoftmaxCrossEntropyWithLogits not exist in name to cnode
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.823.406 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_7_matmul_reduce_scatter_fusion is enabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.428 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_6_pynative_grad_sparse_softmax_cross_entropy_with_logits_unify_mindir_v2 in 56.79 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.823.432 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_4_alltoall_allgather_batch_matmul_fusion in 18.12 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.450 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SparseSoftmaxCrossEntropyWithLogits not exist in name to cnode
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.823.454 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_5_lamb_fission_ge is enabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.469 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_7_pynative_grad_sparse_softmax_cross_entropy_with_logits_unify_mindir in 19.25 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.823.495 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_7_matmul_reduce_scatter_fusion in 65.79 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.487 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SparseSoftmaxCrossEntropyWithLogits not exist in name to cnode
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.519 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_8_pynative_sparse_softmax_cross_entropy_with_logits_unify_mindir in 29.51 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.823.518 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_8_allgather_matmul_fusion is enabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.823.529 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_5_lamb_fission_ge in 54.28 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.823.552 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_6_adaptive_max_pool2d_ge_fusion is enabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.554 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim DropoutExt not exist in name to cnode
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.575 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_9_dropout_ext_unify_mindir1 in 36.35 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.594 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim DropoutGradExt not exist in name to cnode
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.823.599 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_8_allgather_matmul_fusion in 57.58 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.614 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_10_dropoutgrad_ext_unify_mindir in 19.39 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.823.620 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_9_FlashAttentionFusionV1 is enabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.823.622 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_6_adaptive_max_pool2d_ge_fusion in 46.68 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.634 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Dropout not exist in name to cnode
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.823.644 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_7_matmul_reduce_scatter_fusion is enabled.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.823.644 [mindspore/ccsrc/plugin/device/ascend/optimizer/ir_fusion/flash_attention_fusion.cc:270] DefineFlashAttentionPattern] Do FlashAttentionPattern V1.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.654 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_11_dropout_unify_mindir1 in 19.17 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.675 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: dropoutgrad_unify_mindir
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.715 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_12_dropoutgrad_unify_mindir in 37.91 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.823.736 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_7_matmul_reduce_scatter_fusion in 69.75 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.823.759 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_8_allgather_matmul_fusion is enabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.764 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim NeighborExchange not exist in name to cnode
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.823.776 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_9_FlashAttentionFusionV1 in 130.17 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.784 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_13_neighbor_exchange_unify_mindir in 45.41 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.823.800 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_10_FlashAttentionFusionV2 is enabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.806 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim NeighborExchangeV2 not exist in name to cnode
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.823.824 [mindspore/ccsrc/plugin/device/ascend/optimizer/ir_fusion/flash_attention_fusion.cc:384] DefineFlashAttentionPattern] Do FlashAttentionPattern V2.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.827 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_14_neighbor_exchange_v2_unify_mindir in 20.36 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.823.830 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_8_allgather_matmul_fusion in 51.02 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.848 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim NeighborExchangeV2Grad not exist in name to cnode
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.823.853 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_9_FlashAttentionFusionV1 is enabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.865 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_15_neighbor_exchange_v2_grad_unify_mindir in 16.57 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.885 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AlltoAll not exist in name to cnode
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.823.874 [mindspore/ccsrc/plugin/device/ascend/optimizer/ir_fusion/flash_attention_fusion.cc:270] DefineFlashAttentionPattern] Do FlashAttentionPattern V1.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.905 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_16_all_to_all_unify_mindir in 19.25 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.926 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AlltoAllV not exist in name to cnode
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.943 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_17_all_to_all_v_unify_mindir in 17.2 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.823.953 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_10_FlashAttentionFusionV2 in 127.8 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.823.976 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_11_quantbatchmatmul_reduce_fusion is enabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.823.976 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNorm not exist in name to cnode
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.824.006 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_18_bn_split in 43.95 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.824.009 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_9_FlashAttentionFusionV1 in 133.57 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.824.027 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:389] Run] Run fast pass: bn_grad_unify_mindir
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.824.034 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_10_FlashAttentionFusionV2 is enabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.824.056 [mindspore/ccsrc/plugin/device/ascend/optimizer/ir_fusion/flash_attention_fusion.cc:384] DefineFlashAttentionPattern] Do FlashAttentionPattern V2.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.824.070 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_11_quantbatchmatmul_reduce_fusion in 71.191 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.824.092 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_19_bn_grad_unify_mindir in 60.551 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.824.094 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_12_MatMulAllReduce is enabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.824.128 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNormGrad not exist in name to cnode
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.824.149 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_20_bn_grad_split in 35.59 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.824.185 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNormGrad not exist in name to cnode
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.824.209 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_21_batchnormgrad_to_bninfergrad in 23.78 us
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.824.200 [api_impl.cc:7115] 619018 ReserveMemAddress: device malloc Succ, size=61027123200(bytes) start ptr=0x12c2c0000000, end ptr=0x12d0f5800000
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.824.202 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_10_FlashAttentionFusionV2 in 143.7 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.824.231 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_11_quantbatchmatmul_reduce_fusion is enabled.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.824.196 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_12_MatMulAllReduce in 78.03 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.824.236 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_13_grouped_matmul_assignadd_fusion is disabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.824.231 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNormGrad not exist in name to cnode
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.824.256 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_14_MatMulAllReduceAddRmsNorm is disabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.824.254 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_22_batch_norm_grad_infer_fission in 21.56 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.824.275 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_15_add_layer_norm_fusion is disabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.824.272 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim BatchNorm not exist in name to cnode
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.824.290 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_23_batchnorm_to_bninfer in 17.33 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.824.294 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_16_add_layer_norm_v3_fusion is disabled.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.824.312 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_17_add_layer_norm_ext_fusion is disabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.824.311 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim Print not exist in name to cnode
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.824.322 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_11_quantbatchmatmul_reduce_fusion in 66.23 us
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:47.824.239 [awatchdog_monitor.c:160](tid:618682) thread 618987 not exist
[INFO] PRE_ACT(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.824.252 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:736] operator()] Malloc mem block : {"addr_":0x12c2c0000000,"size_":61029220352,"stream_id_":0,"min_addr_":0,"max_addr_":0}.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.824.324 [api_impl.cc:7129] 619016 MallocPhysical: Start to MallocPhysical
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.824.329 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_18_inference_qbmm_add_fusion is disabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.824.332 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_24_print_insert_placeholder_for_tensor_name in 20.33 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.824.350 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_19_inference_swiglu_fusion is disabled.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.824.365 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_20_inference_matmul_split_fusion is disabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.824.345 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_12_MatMulAllReduce is enabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.824.370 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim GetNext not exist in name to cnode
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.824.380 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_21_add_rms_norm_dynamic_quant_fusion is disabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.824.388 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_25_getnext_for_ge in 34.02 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.824.400 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_22_add_rms_norm_quant_fusion is disabled.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.824.416 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_23_add_cast_rms_norm_cast_quant_fusion is disabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.824.423 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SyncBatchNorm not exist in name to cnode
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.824.426 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_12_MatMulAllReduce in 56.29 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.824.436 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_24_rms_norm_quant_fusion is disabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.824.442 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_26_sync_bn_split in 35.78 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.824.448 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_13_grouped_matmul_assignadd_fusion is disabled.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.824.457 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_25_add_cast_rms_norm_cast_fusion is disabled.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.824.449 [api_impl.cc:7145] 619016 MapMem: device malloc Succ, size=2097152(bytes), start ptr=0x12c2c0000000, end ptr=0x12c2c0200000
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.824.464 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim SyncBatchNormGrad not exist in name to cnode
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.824.469 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_14_MatMulAllReduceAddRmsNorm is disabled.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.824.478 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_26_shape_reshape is disabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.824.484 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_27_sync_bn_grad_split in 19.69 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.824.502 [mindspore/ccsrc/backend/common/optimizer/node_pass.cc:398] Run] Prim AvgPoolGrad not exist in name to cnode
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.824.486 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_15_add_layer_norm_fusion is disabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.824.503 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_16_add_layer_norm_v3_fusion is disabled.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.824.495 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_27_split_concat_fusion is enabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.824.518 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_17_add_layer_norm_ext_fusion is disabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.824.535 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_18_inference_qbmm_add_fusion is disabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.824.517 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_28_avg_pool_grad_for_ge in 15.12 us
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.824.534 [device.cpp:143]619016 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 1.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.824.549 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_19_inference_swiglu_fusion is disabled.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.824.556 [api_impl.cc:2999] 619016 SetDevice: device_id=1, deviceMode=0.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.824.569 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_20_inference_matmul_split_fusion is disabled.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.824.569 [device.cc:306] 619016 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.824.583 [runtime.cc:3393] 619016 PrimaryContextRetain: Context inc ref, ts_id=0, count=0xa
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.824.586 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_21_add_rms_norm_dynamic_quant_fusion is disabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.824.615 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_29_add_attr_to_dump in 61.65 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.824.606 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_22_add_rms_norm_quant_fusion is disabled.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.824.600 [runtime.cc:3560] 619016 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.824.611 [api_impl.cc:2987] 619016 NewDevice: SetCurRef = 0xaaab312ab590,userDeviceId=1,deviceId=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.824.623 [runtime.cc:5239] 619016 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.824.637 [api_impl.cc:2992] 619016 NewDevice: New device success, user_device_id=1, die_num=1.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.824.637 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_23_add_cast_rms_norm_cast_quant_fusion is disabled.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.824.652 [api_impl.cc:3025] 619016 SetDevice: SetDevice success, curCtx=0xaaab312ab590, user_device_id=1.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.824.655 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_24_rms_norm_quant_fusion is disabled.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.824.665 [acl.cpp:115]619016 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.824.673 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_25_add_cast_rms_norm_cast_fusion is disabled.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.824.676 [acl.cpp:121]619016 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.824.689 [device.cpp:154]619016 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 1
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.824.694 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_26_shape_reshape is disabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.824.711 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_27_split_concat_fusion is enabled.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.824.702 [api_impl.cc:7115] 619015 ReserveMemAddress: device malloc Succ, size=61029220352(bytes) start ptr=0x12d100000000, end ptr=0x12df35a00000
[INFO] DEVICE(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.824.716 [mindspore/ccsrc/plugin/res_manager/ascend/ascend_res_manager.cc:496] SetDeterministic] Set kernel deterministic value: 0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.824.731 [context.cpp:174]619016 aclrtCtxSetSysParamOpt: start to execute aclrtCtxSetSysParamOpt, opt = 0, value = 0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.824.748 [api_impl.cc:6913] 619016 CtxSetSysParamOpt: curCtx = 0xaaab312ab590, configOpt=0, configVal=0.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.824.760 [context.cpp:158]619016 SetSysParamOpt: successfully execute aclrtCtxSetSysParamOpt
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.824.764 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_27_split_concat_fusion in 245.421 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.824.791 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_28_matmul_sigmoid_add_fusion is disabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.824.809 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unify_mindir_30_ascend_mindir_op_adapter in 167.791 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.824.813 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_29_matmul_sigmoid_cast_add_fusion is disabled.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.824.824 [op_base.cc:1214] [619016][HcclSetConfig] Set HCCL_DETERMINISTIC is false
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.824.832 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_0_clip_by_norm_fission is enabled.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.824.842 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_30_matmul_elemwise_fusion is disabled.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.824.846 [runtime.cc:5239] 619016 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.824.862 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_31_qbmm_allreduce_convert_bias is disabled.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.824.860 [adapter_rts.cc:234] [619016][hrtGetDevice]deviceLogicId[1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:47.824.871 [op_base.cc:128] [619016][HcclGetDeviceId] deviceLogicId[1] 
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.824.881 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_32_inference_qbmm_allreduce_add_fusion is enabled.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.824.906 [context.cpp:72]619016 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.824.905 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_0_clip_by_norm_fission in 48.03 us
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.824.922 [api_impl.cc:3717] 619016 ContextSetCurrent: set context=aaab312ab590, flag=0.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.824.928 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_1_cdist_fission is enabled.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.824.934 [context.cpp:80]619016 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.824.962 [api_error.cc:1807] 619016 MemcpyAsyncCheckKindAndLocation: src pointer loc type=1, dst pointer loc type=2, kind=1
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.824.974 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_27_split_concat_fusion in 236.91 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.824.980 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_32_inference_qbmm_allreduce_add_fusion in 77.54 us
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.824.983 [memory_task.cc:342] 619016 ConvertCpyType: MemcpyAsyncTask::ConvertCpyType MEMCPY_HOST_TO_DEVICE, direct=0.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.824.997 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_1_cdist_fission in 48.18 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.825.003 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_33_remove_fa_tensor_to_tuple_ops is disabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.825.001 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_28_matmul_sigmoid_add_fusion is disabled.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.825.013 [memory_task.cc:473] 619016 MemcpyAsyncTaskInitV3: Init qos=0, partId=0.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.825.020 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_2_cdist_grad_fission is enabled.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.825.022 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_34_transpose_batch_matmul_transpose_fusion is disabled.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.825.040 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_35_add_rms_norm_fusion is enabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.825.024 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_29_matmul_sigmoid_cast_add_fusion is disabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.825.041 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_30_matmul_elemwise_fusion is disabled.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.825.024 [memory_task.cc:518] 619016 MemcpyAsyncTaskInitV3: CopyType=0: use virtual address directly.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.825.045 [task_res.cc:380] 619016 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=1, stream_id=2, taskResId=0, taskResHead_=0, taskResTail_=1.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.825.057 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_31_qbmm_allreduce_convert_bias is disabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.825.074 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_32_inference_qbmm_allreduce_add_fusion is enabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.825.066 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_2_cdist_grad_fission in 24.28 us
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.825.067 [memory_task.cc:1007] 619016 ConstructPcieDmaSqe: stream_id=2, task_id=0, copyType=0, src=0xaaab3ceb62b0, dst=0x12c2c0000000, len=0x6c
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.825.082 [memory_task.cc:1166] 619016 ConstructSqeForMemcpyAsyncTask: MemcpyAsyncTask, stream_id=2, task_id=0, copyType=0
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.825.088 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_3_batchmatmul_reducescatter_alltoall_fusion is enabled.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.825.095 [stream.cc:1400] 619016 AddTaskToList: public task, stream_id=2, task_id=0, task_type=5 (MEMCPY_ASYNC), head=0, tail=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.825.109 [stream.cc:2595] 619016 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=0, type=5(MEMCPY_ASYNC), head=0, tail=1, sqe_num=1, lastTail=0, device_id=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.825.128 [task_submit.cc:573] 619016 AllocTaskAndSendStars: device_id=1, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=0, task_type=5(MEMCPY_ASYNC).
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.825.127 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_35_add_rms_norm_fusion in 65.33 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.825.137 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_3_batchmatmul_reducescatter_alltoall_fusion in 25.94 us
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.825.145 [stream.cc:1494] 619016 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.825.159 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_4_alltoall_allgather_batch_matmul_fusion is enabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.825.166 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_32_inference_qbmm_allreduce_add_fusion in 70.93 us
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.825.167 [callback.cpp:97]619016 aclrtLaunchCallback: start to execute aclrtLaunchCallback.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.825.187 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:203] GEUnifyMindIR] [PROF]GEUnifyMindIR costs 4.714 msec.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.825.200 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_4_alltoall_allgather_batch_matmul_fusion in 21.2 us
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.825.195 [task_res.cc:380] 619016 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=1, stream_id=2, taskResId=1, taskResHead_=0, taskResTail_=2.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.825.189 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_33_remove_fa_tensor_to_tuple_ops is disabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.825.209 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_34_transpose_batch_matmul_transpose_fusion is disabled.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.825.212 [task_info.cc:521] 619016 ConstructSqeForCallbackLaunchTask: CallbackLaunch,topic_type=4,stream_id=2,task_id=1,eventId=65535,isBlock=0,pid=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.825.226 [stream.cc:1400] 619016 AddTaskToList: public task, stream_id=2, task_id=1, task_type=72 (HOSTFUNC_CALLBACK), head=0, tail=2
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.825.221 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_5_lamb_fission_ge is enabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.825.226 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_35_add_rms_norm_fusion is enabled.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.825.237 [stream.cc:2595] 619016 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=1, type=72(HOSTFUNC_CALLBACK), head=0, tail=2, sqe_num=1, lastTail=1, device_id=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.825.251 [task_submit.cc:573] 619016 AllocTaskAndSendStars: device_id=1, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=1, task_type=72(HOSTFUNC_CALLBACK).
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.825.263 [stream.cc:1494] 619016 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=1.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.825.272 [callback.cpp:109]619016 aclrtLaunchCallback: successfully execute aclrtLaunchCallback
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.825.298 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_5_lamb_fission_ge in 53.72 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.825.301 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_35_add_rms_norm_fusion in 54.74 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.825.320 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_6_adaptive_max_pool2d_ge_fusion is enabled.
[INFO] PRE_ACT(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.825.354 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:704] GenerateAllocator] Generate allocator, is persistent : 0, stream id : 0.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.825.355 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:203] GEUnifyMindIR] [PROF]GEUnifyMindIR costs 4.517 msec.
[INFO] PRE_ACT(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.825.386 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:716] operator()] Malloc mem block, is enable eager free : 0, is enable vmm : 1, size : 512, block size : 1073741824.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.825.390 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_6_adaptive_max_pool2d_ge_fusion in 47.021 us
[INFO] DEVICE(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.825.404 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.cc:204] AllocDeviceMem] VMM AllocDeviceMem size:61029220352, align_size:61029220352
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.825.413 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_7_matmul_reduce_scatter_fusion is enabled.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.825.426 [npu_driver.cc:3844] 618828 CqReportGet: cq report get start, device_id=1, tsId=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.825.468 [npu_driver.cc:3851] 618828 CqReportGet: halCqReportGet count=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.825.497 [api_impl.cc:5087] 618828 ProcessReport: report[0], sqid=12291, streamId=2, taskId=1, eventId=65535, isBlock=0
[INFO] SESSION(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.825.509 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.825.514 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_7_matmul_reduce_scatter_fusion in 76.58 us
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.825.529 [callback.cpp:138]618828 aclrtProcessReport: successfully aclrtProcessReport, timeout is 500ms.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.825.547 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_8_allgather_matmul_fusion is enabled.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.825.548 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.825.568 [npu_driver.cc:3828] 618828 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=320.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.825.621 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_8_allgather_matmul_fusion in 52.49 us
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.825.631 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_graph_optimization.cc:40] MarkRefGraph] Mark graph is ref graph: 4000000000
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.825.643 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_9_FlashAttentionFusionV1 is enabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.825.663 [mindspore/ccsrc/plugin/device/ascend/optimizer/ir_fusion/flash_attention_fusion.cc:270] DefineFlashAttentionPattern] Do FlashAttentionPattern V1.
[INFO] SESSION(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.825.656 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.825.784 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_9_FlashAttentionFusionV1 in 120.18 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.825.806 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_10_FlashAttentionFusionV2 is enabled.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.825.797 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_graph_optimization.cc:40] MarkRefGraph] Mark graph is ref graph: 4000000000
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.825.826 [mindspore/ccsrc/plugin/device/ascend/optimizer/ir_fusion/flash_attention_fusion.cc:384] DefineFlashAttentionPattern] Do FlashAttentionPattern V2.
[INFO] PRE_ACT(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.825.798 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:736] operator()] Malloc mem block : {"addr_":0x12c2c0000000,"size_":61029220352,"stream_id_":0,"min_addr_":0,"max_addr_":0}.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.825.932 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unfold_inputs_for_special_nodes_pm_0_ascend_convert_tuple_input_to_dynamic_input in 238.37 us
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.825.880 [api_impl.cc:7129] 619017 MallocPhysical: Start to MallocPhysical
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.825.949 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_10_FlashAttentionFusionV2 in 121.59 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.825.970 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_11_quantbatchmatmul_reduce_fusion is enabled.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.826.045 [api_impl.cc:7145] 619017 MapMem: device malloc Succ, size=2097152(bytes), start ptr=0x12c2c0000000, end ptr=0x12c2c0200000
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.826.055 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unfold_inputs_for_special_nodes_pm_0_ascend_convert_tuple_input_to_dynamic_input in 195.611 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.826.058 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_11_quantbatchmatmul_reduce_fusion in 64.941 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.826.062 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_0_process_call_inline in 33.161 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.826.079 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_12_MatMulAllReduce is enabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.826.152 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_12_MatMulAllReduce in 51.74 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.826.174 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_13_grouped_matmul_assignadd_fusion is disabled.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.826.175 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_1_seed_adapter in 81.84 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.826.175 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_0_process_call_inline in 30.89 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.826.194 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_14_MatMulAllReduceAddRmsNorm is disabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.826.213 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_15_add_layer_norm_fusion is disabled.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.826.206 [device.cpp:143]619017 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 3.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.826.217 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_2_insert_tensor_move_for_communication in 14.51 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.826.234 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_16_add_layer_norm_v3_fusion is disabled.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.826.236 [api_impl.cc:2999] 619017 SetDevice: device_id=3, deviceMode=0.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.826.252 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_17_add_layer_norm_ext_fusion is disabled.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.826.255 [device.cc:306] 619017 Init: device mode has been already set, mode=0.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.826.273 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_3_process partial inline in 28.81 us
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.826.272 [runtime.cc:3393] 619017 PrimaryContextRetain: Context inc ref, ts_id=0, count=0xa
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.826.272 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_18_inference_qbmm_add_fusion is disabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.826.284 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_1_seed_adapter in 75.88 us
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.826.294 [runtime.cc:3560] 619017 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=3
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.826.302 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_19_inference_swiglu_fusion is disabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.826.320 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_20_inference_matmul_split_fusion is disabled.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.826.309 [api_impl.cc:2987] 619017 NewDevice: SetCurRef = 0xaaab0b9e09a0,userDeviceId=3,deviceId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.826.326 [runtime.cc:5239] 619017 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.826.324 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_2_insert_tensor_move_for_communication in 12.24 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.826.336 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_21_add_rms_norm_dynamic_quant_fusion is disabled.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.826.341 [api_impl.cc:2992] 619017 NewDevice: New device success, user_device_id=3, die_num=1.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.826.353 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_22_add_rms_norm_quant_fusion is disabled.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.826.367 [api_impl.cc:3025] 619017 SetDevice: SetDevice success, curCtx=0xaaab0b9e09a0, user_device_id=3.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.826.373 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_23_add_cast_rms_norm_cast_quant_fusion is disabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.826.378 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_3_process partial inline in 27.4 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.826.392 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_24_rms_norm_quant_fusion is disabled.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.826.389 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_4_expander_fallback in 87.51 us
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.826.392 [acl.cpp:115]619017 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.826.410 [acl.cpp:121]619017 GetSocVersion: socVersion is Ascend910B3
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.826.409 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_25_add_cast_rms_norm_cast_fusion is disabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.826.429 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_26_shape_reshape is disabled.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.826.431 [device.cpp:154]619017 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 3
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.826.448 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_27_split_concat_fusion is enabled.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.826.446 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_5_convert_pad_v3_paddings in 29.59 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.826.467 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_4_expander_fallback in 63.27 us
[INFO] DEVICE(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.826.478 [mindspore/ccsrc/plugin/res_manager/ascend/ascend_res_manager.cc:496] SetDeterministic] Set kernel deterministic value: 0
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.826.499 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_6_convert_pad_v3_grad_paddings in 24.93 us
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.826.500 [context.cpp:174]619017 aclrtCtxSetSysParamOpt: start to execute aclrtCtxSetSysParamOpt, opt = 0, value = 0.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.826.523 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_5_convert_pad_v3_paddings in 28.19 us
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.826.537 [api_impl.cc:6913] 619017 CtxSetSysParamOpt: curCtx = 0xaaab0b9e09a0, configOpt=0, configVal=0.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.826.552 [context.cpp:158]619017 SetSysParamOpt: successfully execute aclrtCtxSetSysParamOpt
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.826.574 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_6_convert_pad_v3_grad_paddings in 24.96 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.826.603 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_7_resize_bilinear_add_attr in 63.35 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.826.637 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_8_backend_custom_depend in 7.32 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.826.640 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_7_resize_bilinear_add_attr in 39.12 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.826.670 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_8_backend_custom_depend in 6.79 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.826.687 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:120] GEBackendOptimizeACL] [PROF]GEBackendOptimizeACL costs 0.685 msec.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.826.704 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_27_split_concat_fusion in 230.791 us
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.826.702 [op_base.cc:1214] [619017][HcclSetConfig] Set HCCL_DETERMINISTIC is false
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.826.717 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:120] GEBackendOptimizeACL] [PROF]GEBackendOptimizeACL costs 0.596 msec.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.826.728 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_28_matmul_sigmoid_add_fusion is disabled.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.826.733 [runtime.cc:5239] 619017 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.826.736 [api_impl.cc:7115] 619016 ReserveMemAddress: device malloc Succ, size=61029220352(bytes) start ptr=0x12d100000000, end ptr=0x12df35a00000
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.826.748 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_29_matmul_sigmoid_cast_add_fusion is disabled.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.826.745 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_graph_optimization.cc:131] OptimizeACLGraph] [PROF]OptimizeACLGraph costs 1.115 msec.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.826.752 [adapter_rts.cc:234] [619017][hrtGetDevice]deviceLogicId[3]
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.826.770 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_graph_optimization.cc:131] OptimizeACLGraph] [PROF]OptimizeACLGraph costs 0.972 msec.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.826.767 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_30_matmul_elemwise_fusion is disabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.826.786 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_31_qbmm_allreduce_convert_bias is disabled.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:47.826.766 [op_base.cc:128] [619017][HcclGetDeviceId] deviceLogicId[3] 
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.826.802 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_32_inference_qbmm_allreduce_add_fusion is enabled.
[INFO] SESSION(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.826.801 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] SESSION(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.826.813 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.826.816 [context.cpp:72]619017 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.826.836 [api_impl.cc:3717] 619017 ContextSetCurrent: set context=aaab0b9e09a0, flag=0.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.826.852 [context.cpp:80]619017 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.826.884 [api_error.cc:1807] 619017 MemcpyAsyncCheckKindAndLocation: src pointer loc type=1, dst pointer loc type=2, kind=1
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.826.892 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_32_inference_qbmm_allreduce_add_fusion in 70.7 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.826.914 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_33_remove_fa_tensor_to_tuple_ops is disabled.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.826.907 [memory_task.cc:342] 619017 ConvertCpyType: MemcpyAsyncTask::ConvertCpyType MEMCPY_HOST_TO_DEVICE, direct=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.826.925 [memory_task.cc:473] 619017 MemcpyAsyncTaskInitV3: Init qos=0, partId=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.826.938 [memory_task.cc:518] 619017 MemcpyAsyncTaskInitV3: CopyType=0: use virtual address directly.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.826.934 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_backend_fusion_34_transpose_batch_matmul_transpose_fusion is disabled.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.826.958 [task_res.cc:380] 619017 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=3, stream_id=2, taskResId=0, taskResHead_=0, taskResTail_=1.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.826.966 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_backend_fusion_35_add_rms_norm_fusion is enabled.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.826.984 [memory_task.cc:1007] 619017 ConstructPcieDmaSqe: stream_id=2, task_id=0, copyType=0, src=0xaaab166c5d90, dst=0x12c2c0000000, len=0x6c
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.827.002 [memory_task.cc:1166] 619017 ConstructSqeForMemcpyAsyncTask: MemcpyAsyncTask, stream_id=2, task_id=0, copyType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.827.015 [stream.cc:1400] 619017 AddTaskToList: public task, stream_id=2, task_id=0, task_type=5 (MEMCPY_ASYNC), head=0, tail=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.827.029 [stream.cc:2595] 619017 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=0, type=5(MEMCPY_ASYNC), head=0, tail=1, sqe_num=1, lastTail=0, device_id=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.827.047 [task_submit.cc:573] 619017 AllocTaskAndSendStars: device_id=3, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=0, task_type=5(MEMCPY_ASYNC).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.827.064 [stream.cc:1494] 619017 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.827.078 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_backend_fusion_35_add_rms_norm_fusion in 87.29 us
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.827.088 [callback.cpp:97]619017 aclrtLaunchCallback: start to execute aclrtLaunchCallback.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.827.112 [task_res.cc:380] 619017 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=3, stream_id=2, taskResId=1, taskResHead_=0, taskResTail_=2.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.827.132 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:203] GEUnifyMindIR] [PROF]GEUnifyMindIR costs 4.433 msec.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.827.134 [mindspore/ccsrc/plugin/device/ascend/hal/device/kernel_select_ascend.cc:624] CollectOpSelectedType] AllReduce select hccl kernel
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.827.131 [task_info.cc:521] 619017 ConstructSqeForCallbackLaunchTask: CallbackLaunch,topic_type=4,stream_id=2,task_id=1,eventId=65535,isBlock=0,pid=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.827.149 [stream.cc:1400] 619017 AddTaskToList: public task, stream_id=2, task_id=1, task_type=72 (HOSTFUNC_CALLBACK), head=0, tail=2
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.827.160 [mindspore/ccsrc/plugin/device/ascend/hal/device/kernel_select_ascend.cc:624] CollectOpSelectedType] AllReduce select hccl kernel
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.827.172 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:315] SelectKernel] [PROF]SelectKernel costs 0.373 msec.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.827.176 [stream.cc:2595] 619017 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=1, type=72(HOSTFUNC_CALLBACK), head=0, tail=2, sqe_num=1, lastTail=1, device_id=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.827.192 [task_submit.cc:573] 619017 AllocTaskAndSendStars: device_id=3, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=1, task_type=72(HOSTFUNC_CALLBACK).
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.827.193 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:319] PrintOpSelectedNum] Number of GE_KERNEL, INTERNAL_KERNEL, OPAPI_KERNEL, ACL_KERNEL, ATB_KERNEL, HCCL_KERNEL, HOST_KERNEL:
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.827.195 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:315] SelectKernel] [PROF]SelectKernel costs 0.411 msec.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.827.207 [stream.cc:1494] 619017 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=1.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.827.214 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:327] PrintOpSelectedNum] 0 0 0 0 0 1 0 
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.827.215 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:319] PrintOpSelectedNum] Number of GE_KERNEL, INTERNAL_KERNEL, OPAPI_KERNEL, ACL_KERNEL, ATB_KERNEL, HCCL_KERNEL, HOST_KERNEL:
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.827.231 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:327] PrintOpSelectedNum] 0 0 0 0 0 1 0 
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.827.219 [callback.cpp:109]619017 aclrtLaunchCallback: successfully execute aclrtLaunchCallback
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.827.242 [npu_driver.cc:3844] 618774 CqReportGet: cq report get start, device_id=3, tsId=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.827.264 [npu_driver.cc:3851] 618774 CqReportGet: halCqReportGet count=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.827.276 [api_impl.cc:5087] 618774 ProcessReport: report[0], sqid=12291, streamId=2, taskId=1, eventId=65535, isBlock=0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.827.299 [callback.cpp:138]618774 aclrtProcessReport: successfully aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.827.315 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.827.329 [npu_driver.cc:3828] 618774 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=64.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.827.339 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_0_set_fracz_group_attr in 44.8 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.827.322 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_0_set_fracz_group_attr in 37.93 us
[INFO] PRE_ACT(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.827.360 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:704] GenerateAllocator] Generate allocator, is persistent : 0, stream id : 0.
[INFO] PRE_ACT(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.827.406 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:716] operator()] Malloc mem block, is enable eager free : 0, is enable vmm : 1, size : 512, block size : 1073741824.
[INFO] DEVICE(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.827.428 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.cc:204] AllocDeviceMem] VMM AllocDeviceMem size:61029220352, align_size:61029220352
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.827.433 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_1_insert_identity in 65.04 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.827.432 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_1_insert_identity in 62.02 us
[INFO] SESSION(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.827.432 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.827.502 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_2_erase_visit_attr in 42.04 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.827.506 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_2_erase_visit_attr in 45.51 us
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.827.550 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_graph_optimization.cc:40] MarkRefGraph] Mark graph is ref graph: 4000000000
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.827.595 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_3_deal_ref_output in 64.33 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.827.599 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_3_deal_ref_output in 66.4 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.827.618 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_opt_acl_after_kernel_select_pm_4_shape_reshape is disabled.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.827.622 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_opt_acl_after_kernel_select_pm_4_shape_reshape is disabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.827.637 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_opt_acl_after_kernel_select_pm_5_shape_reshape_direct is enabled.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.827.641 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_opt_acl_after_kernel_select_pm_5_shape_reshape_direct is enabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.827.696 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_opt_acl_after_kernel_select_pm_5_shape_reshape_direct in 36.93 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.827.699 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_opt_acl_after_kernel_select_pm_5_shape_reshape_direct in 37.39 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.827.736 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_6_graph_view_replace in 11.13 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.827.734 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_6_graph_view_replace in 13.19 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.827.760 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_7_label_1f1b_overlap_node in 0.58 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.827.759 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_7_label_1f1b_overlap_node in 1.05 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.827.806 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:173] GEBackendOptimizeACLAfterKernelSelect] [PROF]GEBackendOptimizeACLAfterKernelSelect costs 0.569 msec.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.827.807 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:173] GEBackendOptimizeACLAfterKernelSelect] [PROF]GEBackendOptimizeACLAfterKernelSelect costs 0.551 msec.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.827.825 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_unfold_inputs_for_special_nodes_pm_0_ascend_convert_tuple_input_to_dynamic_input in 214.7 us
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.827.860 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_graph_optimization.cc:166] OptimizeACLGraphAfterKernelSelect] [PROF]OptimizeACLGraphAfterKernelSelect costs 0.623 msec.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.827.870 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_graph_optimization.cc:166] OptimizeACLGraphAfterKernelSelect] [PROF]OptimizeACLGraphAfterKernelSelect costs 0.616 msec.
[INFO] SESSION(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.827.905 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] SESSION(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.827.910 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.827.943 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_0_process_call_inline in 31.15 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.828.016 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_after_inline_pm_0_DropoutGenMask is enabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.828.017 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_after_inline_pm_0_DropoutGenMask is enabled.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.828.045 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_after_inline_pm_0_DropoutGenMask in 0.79 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.828.042 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_after_inline_pm_0_DropoutGenMask in 0.81 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.828.056 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_1_seed_adapter in 81.941 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.828.088 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_1_cse in 21.34 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.828.087 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_1_cse in 19.98 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.828.096 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_2_insert_tensor_move_for_communication in 12.06 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.828.115 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_2_eliminate_maketuple_getitem in 3.85 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.828.115 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_2_eliminate_maketuple_getitem in 4.47 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.828.139 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_3_insert_move_to in 0.52 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.828.138 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_3_insert_move_to in 0.8 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.828.147 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_3_process partial inline in 27.17 us
[INFO] SESSION(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.828.184 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] SESSION(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.828.191 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.828.270 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_4_insert_pre_fetch_depend in 109.31 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.828.270 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_4_insert_pre_fetch_depend in 107.61 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.828.277 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_4_expander_fallback in 89.86 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.828.295 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_5_overlap_1b1f in 0.77 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.828.294 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_5_overlap_1b1f in 1.11 us
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.828.321 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:242] GEAfterInlineOptimize] [PROF]GEAfterInlineOptimize costs 0.328 msec.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.828.333 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_5_convert_pad_v3_paddings in 28.61 us
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.828.342 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:242] GEAfterInlineOptimize] [PROF]GEAfterInlineOptimize costs 0.351 msec.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.828.374 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:437] InlineCallGraph] [PROF]InlineCallGraph costs 0.478 msec.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.828.381 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_6_convert_pad_v3_grad_paddings in 23.33 us
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.828.392 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:437] InlineCallGraph] [PROF]InlineCallGraph costs 0.504 msec.
[INFO] SESSION(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.828.412 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] SESSION(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.828.427 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.828.444 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_7_resize_bilinear_add_attr in 39.31 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.828.473 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_pm_8_backend_custom_depend in 6.79 us
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.828.491 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:912] InlineSwitchGraph] [PROF]InlineSwitchGraph costs 0.09 msec.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.828.508 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:912] InlineSwitchGraph] [PROF]InlineSwitchGraph costs 0.09 msec.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.828.517 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:120] GEBackendOptimizeACL] [PROF]GEBackendOptimizeACL costs 0.63 msec.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.828.568 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_graph_optimization.cc:131] OptimizeACLGraph] [PROF]OptimizeACLGraph costs 1.016 msec.
[INFO] SESSION(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.828.609 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.828.792 [api_impl.cc:7115] 619017 ReserveMemAddress: device malloc Succ, size=61029220352(bytes) start ptr=0x12d100000000, end ptr=0x12df35a00000
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.828.890 [context.cpp:72]618674 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.828.924 [api_impl.cc:3717] 618674 ContextSetCurrent: set context=aaab0103b880, flag=0.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.828.938 [mindspore/ccsrc/plugin/device/ascend/hal/device/kernel_select_ascend.cc:624] CollectOpSelectedType] AllReduce select hccl kernel
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.828.945 [context.cpp:80]618674 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.828.948 [context.cpp:72]618654 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.828.976 [api_impl.cc:3717] 618654 ContextSetCurrent: set context=aaaaf5082ff0, flag=0.
[INFO] KERNEL(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.828.986 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hccl_kernel_build.cc:32] HcclOpBuild] Build hccl op [AllReduce]
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.828.971 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:315] SelectKernel] [PROF]SelectKernel costs 0.375 msec.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.828.994 [context.cpp:80]618654 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.829.008 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:319] PrintOpSelectedNum] Number of GE_KERNEL, INTERNAL_KERNEL, OPAPI_KERNEL, ACL_KERNEL, ATB_KERNEL, HCCL_KERNEL, HOST_KERNEL:
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.829.027 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:327] PrintOpSelectedNum] 0 0 0 0 0 1 0 
[INFO] KERNEL(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.829.035 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hccl_kernel_build.cc:32] HcclOpBuild] Build hccl op [AllReduce]
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.829.132 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_0_set_fracz_group_attr in 34.61 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.829.223 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_1_insert_identity in 62.15 us
[INFO] KERNEL(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.829.219 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hccl_kernel.cc:211] CalLoopSize] Get Hccl Kernel: AllReduce, output size: 1
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.829.264 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:198] GenerateKernelMod] kernel opname:AllReduce, kernel type:hccl_kernel
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.829.292 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_2_erase_visit_attr in 42.93 us
[INFO] KERNEL(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.829.294 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hccl_kernel.cc:211] CalLoopSize] Get Hccl Kernel: AllReduce, output size: 1
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.829.335 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:198] GenerateKernelMod] kernel opname:AllReduce, kernel type:hccl_kernel
[INFO] SESSION(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.829.350 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.829.379 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_3_deal_ref_output in 62.001 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.829.402 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:119] Run] graph kernel pass hwopt_fusion_opt_acl_after_kernel_select_pm_4_shape_reshape is disabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.829.421 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_opt_acl_after_kernel_select_pm_5_shape_reshape_direct is enabled.
[INFO] SESSION(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.829.443 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.829.452 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1179] OptimizeExecutionOrder] [PROF]OptimizeExecutionOrder costs 0.113 msec.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.829.481 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_opt_acl_after_kernel_select_pm_5_shape_reshape_direct in 36.96 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.829.515 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_6_graph_view_replace in 11.29 us
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.829.528 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1214] ResetNodeIds] Start reset node id
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.829.538 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_opt_acl_after_kernel_select_pm_7_label_1f1b_overlap_node in 0.68 us
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.829.542 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1179] OptimizeExecutionOrder] [PROF]OptimizeExecutionOrder costs 0.109 msec.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.829.581 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1234] ResetNodeIds] End reset node id
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.829.584 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:173] GEBackendOptimizeACLAfterKernelSelect] [PROF]GEBackendOptimizeACLAfterKernelSelect costs 0.531 msec.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.829.608 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1123] DoStreamAssign] Status record: start stream assign, pynative_kernel_graph4000000000
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.829.628 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/acl_stream_assign.cc:151] AssignStream] Not stream assign when pynative forward.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.829.633 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_graph_optimization.cc:166] OptimizeACLGraphAfterKernelSelect] [PROF]OptimizeACLGraphAfterKernelSelect costs 0.581 msec.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.829.634 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1214] ResetNodeIds] Start reset node id
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.829.648 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1139] DoStreamAssign] Status record: end stream assign, pynative_kernel_graph4000000000
[INFO] SESSION(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.829.671 [mindspore/ccsrc/backend/common/session/kernel_graph.cc:944] PrintGraphExecuteOrder] Graph 4000000000 execution order:
[INFO] SESSION(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.829.672 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.829.688 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1234] ResetNodeIds] End reset node id
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.829.715 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1123] DoStreamAssign] Status record: start stream assign, pynative_kernel_graph4000000000
[INFO] SESSION(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.829.718 [mindspore/ccsrc/backend/common/session/kernel_graph.cc:984] PrintGraphExecuteOrder] Index[0], node name[Default/AllReduce-op0], logic id[4294967295], stream id[0], node info[@pynative_kernel_graph4000000000:CNode_1{[0]: ValueNode<Primitive> AllReduce, [1]: param_Parameter_2}], group[hccl_world_group]
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.829.736 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/acl_stream_assign.cc:151] AssignStream] Not stream assign when pynative forward.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.829.756 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1139] DoStreamAssign] Status record: end stream assign, pynative_kernel_graph4000000000
[INFO] SESSION(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.829.776 [mindspore/ccsrc/backend/common/session/kernel_graph.cc:944] PrintGraphExecuteOrder] Graph 4000000000 execution order:
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.829.779 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:117] Run] graph kernel pass hwopt_fusion_after_inline_pm_0_DropoutGenMask is enabled.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.829.804 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_fusion_after_inline_pm_0_DropoutGenMask in 0.94 us
[INFO] SESSION(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.829.821 [mindspore/ccsrc/backend/common/session/kernel_graph.cc:984] PrintGraphExecuteOrder] Index[0], node name[Default/AllReduce-op0], logic id[4294967295], stream id[0], node info[@pynative_kernel_graph4000000000:CNode_1{[0]: ValueNode<Primitive> AllReduce, [1]: param_Parameter_2}], group[hccl_world_group]
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.829.847 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_1_cse in 19.41 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.829.873 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_2_eliminate_maketuple_getitem in 3.8 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.829.909 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_3_insert_move_to in 0.43 us
[INFO] SESSION(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.829.943 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.829.936 [context.cpp:72]619019 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.829.978 [api_impl.cc:3717] 619019 ContextSetCurrent: set context=aaab0103b880, flag=0.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:47.830.000 [awatchdog_core.c:175](tid:619019) create watchdog for id : 65543, tid : 619019, timeout : 300s
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.830.014 [mindspore/ccsrc/common/amp/amp.cc:149] GetCurrentAmpStrategy] amp strategy stack is empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.830.017 [context.cpp:80]619019 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.830.021 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_4_insert_pre_fetch_depend in 88.94 us
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.830.045 [mindspore/ccsrc/backend/common/optimizer/pass_manager.cc:75] RunPass] Run pass hwopt_after_inline_pm_5_overlap_1b1f in 0.84 us
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.830.034 [context.cpp:72]619020 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] PRE_ACT(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.830.065 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:704] GenerateAllocator] Generate allocator, is persistent : 1, stream id : 0.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.830.071 [mindspore/ccsrc/plugin/device/ascend/optimizer/ge_backend_optimization.cc:242] GEAfterInlineOptimize] [PROF]GEAfterInlineOptimize costs 0.319 msec.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.830.067 [api_impl.cc:3717] 619020 ContextSetCurrent: set context=aaaaf5082ff0, flag=0.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:47.830.090 [awatchdog_core.c:175](tid:619020) create watchdog for id : 65543, tid : 619020, timeout : 300s
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.830.099 [mindspore/ccsrc/common/amp/amp.cc:149] GetCurrentAmpStrategy] amp strategy stack is empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.830.105 [context.cpp:80]619020 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] PRE_ACT(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.830.106 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:716] operator()] Malloc mem block, is enable eager free : 0, is enable vmm : 1, size : 512, block size : 1073741824.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.830.121 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:437] InlineCallGraph] [PROF]InlineCallGraph costs 0.464 msec.
[INFO] DEVICE(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.830.129 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.cc:204] AllocDeviceMem] VMM AllocDeviceMem size:61029220352, align_size:61029220352
[INFO] PRE_ACT(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.830.153 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:704] GenerateAllocator] Generate allocator, is persistent : 1, stream id : 0.
[INFO] SESSION(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.830.164 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] PRE_ACT(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.830.192 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:716] operator()] Malloc mem block, is enable eager free : 0, is enable vmm : 1, size : 512, block size : 1073741824.
[INFO] DEVICE(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.830.216 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.cc:204] AllocDeviceMem] VMM AllocDeviceMem size:61022928896, align_size:61022928896
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.830.246 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:912] InlineSwitchGraph] [PROF]InlineSwitchGraph costs 0.092 msec.
[INFO] PRE_ACT(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.830.638 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:736] operator()] Malloc mem block : {"addr_":0x12c2c0000000,"size_":61027123200,"stream_id_":0,"min_addr_":0,"max_addr_":0}.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.830.669 [api_impl.cc:7129] 619018 MallocPhysical: Start to MallocPhysical
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.830.704 [context.cpp:72]618662 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.830.736 [api_impl.cc:3717] 618662 ContextSetCurrent: set context=aaab087d6320, flag=0.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.830.756 [context.cpp:80]618662 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.830.790 [api_impl.cc:7145] 619018 MapMem: device malloc Succ, size=2097152(bytes), start ptr=0x12c2c0000000, end ptr=0x12c2c0200000
[INFO] KERNEL(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.830.795 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hccl_kernel_build.cc:32] HcclOpBuild] Build hccl op [AllReduce]
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.830.869 [device.cpp:143]619018 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.830.889 [api_impl.cc:2999] 619018 SetDevice: device_id=5, deviceMode=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.830.902 [device.cc:306] 619018 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.830.914 [runtime.cc:3393] 619018 PrimaryContextRetain: Context inc ref, ts_id=0, count=0xa
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.830.927 [runtime.cc:3560] 619018 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.830.939 [api_impl.cc:2987] 619018 NewDevice: SetCurRef = 0xaaaaf6e2dcc0,userDeviceId=5,deviceId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.830.950 [runtime.cc:5239] 619018 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.830.963 [api_impl.cc:2992] 619018 NewDevice: New device success, user_device_id=5, die_num=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.830.978 [api_impl.cc:3025] 619018 SetDevice: SetDevice success, curCtx=0xaaaaf6e2dcc0, user_device_id=5.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.830.990 [acl.cpp:115]619018 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.831.003 [acl.cpp:121]619018 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.831.017 [device.cpp:154]619018 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 5
[INFO] KERNEL(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.831.030 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hccl_kernel.cc:211] CalLoopSize] Get Hccl Kernel: AllReduce, output size: 1
[INFO] DEVICE(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.831.046 [mindspore/ccsrc/plugin/res_manager/ascend/ascend_res_manager.cc:496] SetDeterministic] Set kernel deterministic value: 0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.831.063 [context.cpp:174]619018 aclrtCtxSetSysParamOpt: start to execute aclrtCtxSetSysParamOpt, opt = 0, value = 0.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.831.073 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:198] GenerateKernelMod] kernel opname:AllReduce, kernel type:hccl_kernel
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.831.078 [api_impl.cc:6913] 619018 CtxSetSysParamOpt: curCtx = 0xaaaaf6e2dcc0, configOpt=0, configVal=0.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.831.100 [context.cpp:158]619018 SetSysParamOpt: successfully execute aclrtCtxSetSysParamOpt
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.831.151 [op_base.cc:1214] [619018][HcclSetConfig] Set HCCL_DETERMINISTIC is false
[INFO] SESSION(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.831.161 [mindspore/ccsrc/backend/common/session/exec_order_builder.cc:84] Build] exec order build by bfs
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.831.171 [runtime.cc:5239] 619018 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.831.186 [adapter_rts.cc:234] [619018][hrtGetDevice]deviceLogicId[5]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:47.831.196 [op_base.cc:128] [619018][HcclGetDeviceId] deviceLogicId[5] 
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.831.225 [context.cpp:72]619018 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.831.240 [api_impl.cc:3717] 619018 ContextSetCurrent: set context=aaaaf6e2dcc0, flag=0.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.831.253 [context.cpp:80]619018 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.831.263 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1179] OptimizeExecutionOrder] [PROF]OptimizeExecutionOrder costs 0.114 msec.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.831.277 [api_error.cc:1807] 619018 MemcpyAsyncCheckKindAndLocation: src pointer loc type=1, dst pointer loc type=2, kind=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.831.299 [memory_task.cc:342] 619018 ConvertCpyType: MemcpyAsyncTask::ConvertCpyType MEMCPY_HOST_TO_DEVICE, direct=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.831.312 [memory_task.cc:473] 619018 MemcpyAsyncTaskInitV3: Init qos=0, partId=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.831.322 [memory_task.cc:518] 619018 MemcpyAsyncTaskInitV3: CopyType=0: use virtual address directly.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.831.338 [task_res.cc:380] 619018 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=5, stream_id=2, taskResId=0, taskResHead_=0, taskResTail_=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.831.357 [memory_task.cc:1007] 619018 ConstructPcieDmaSqe: stream_id=2, task_id=0, copyType=0, src=0xaaab02a36ba0, dst=0x12c2c0000000, len=0x6c
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.831.359 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1214] ResetNodeIds] Start reset node id
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.831.371 [memory_task.cc:1166] 619018 ConstructSqeForMemcpyAsyncTask: MemcpyAsyncTask, stream_id=2, task_id=0, copyType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.831.386 [stream.cc:1400] 619018 AddTaskToList: public task, stream_id=2, task_id=0, task_type=5 (MEMCPY_ASYNC), head=0, tail=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.831.399 [stream.cc:2595] 619018 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=0, type=5(MEMCPY_ASYNC), head=0, tail=1, sqe_num=1, lastTail=0, device_id=5
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.831.411 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1234] ResetNodeIds] End reset node id
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.831.419 [task_submit.cc:573] 619018 AllocTaskAndSendStars: device_id=5, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=0, task_type=5(MEMCPY_ASYNC).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.831.434 [stream.cc:1494] 619018 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.831.437 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1123] DoStreamAssign] Status record: start stream assign, pynative_kernel_graph4000000000
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.831.439 [api_impl.cc:7115] 619019 ReserveMemAddress: device malloc Succ, size=61029220352(bytes) start ptr=0x12c2c0000000, end ptr=0x12d0f5a00000
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.831.452 [callback.cpp:97]619018 aclrtLaunchCallback: start to execute aclrtLaunchCallback.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.831.458 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/acl_stream_assign.cc:151] AssignStream] Not stream assign when pynative forward.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.831.481 [task_res.cc:380] 619018 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=5, stream_id=2, taskResId=1, taskResHead_=0, taskResTail_=2.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.831.480 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.cc:1139] DoStreamAssign] Status record: end stream assign, pynative_kernel_graph4000000000
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.831.499 [task_info.cc:521] 619018 ConstructSqeForCallbackLaunchTask: CallbackLaunch,topic_type=4,stream_id=2,task_id=1,eventId=65535,isBlock=0,pid=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.831.514 [stream.cc:1400] 619018 AddTaskToList: public task, stream_id=2, task_id=1, task_type=72 (HOSTFUNC_CALLBACK), head=0, tail=2
[INFO] SESSION(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.831.516 [mindspore/ccsrc/backend/common/session/kernel_graph.cc:944] PrintGraphExecuteOrder] Graph 4000000000 execution order:
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.831.530 [stream.cc:2595] 619018 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=1, type=72(HOSTFUNC_CALLBACK), head=0, tail=2, sqe_num=1, lastTail=1, device_id=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.831.545 [task_submit.cc:573] 619018 AllocTaskAndSendStars: device_id=5, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=1, task_type=72(HOSTFUNC_CALLBACK).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.831.564 [stream.cc:1494] 619018 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=1.
[INFO] SESSION(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.831.564 [mindspore/ccsrc/backend/common/session/kernel_graph.cc:984] PrintGraphExecuteOrder] Index[0], node name[Default/AllReduce-op0], logic id[4294967295], stream id[0], node info[@pynative_kernel_graph4000000000:CNode_1{[0]: ValueNode<Primitive> AllReduce, [1]: param_Parameter_2}], group[hccl_world_group]
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.831.578 [callback.cpp:109]619018 aclrtLaunchCallback: successfully execute aclrtLaunchCallback
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.831.570 [api_impl.cc:7115] 619020 ReserveMemAddress: device malloc Succ, size=61022928896(bytes) start ptr=0x12c2c0000000, end ptr=0x12d0f5400000
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.831.598 [npu_driver.cc:3844] 618808 CqReportGet: cq report get start, device_id=5, tsId=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.831.619 [npu_driver.cc:3851] 618808 CqReportGet: halCqReportGet count=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.831.631 [api_impl.cc:5087] 618808 ProcessReport: report[0], sqid=12291, streamId=2, taskId=1, eventId=65535, isBlock=0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.831.650 [callback.cpp:138]618808 aclrtProcessReport: successfully aclrtProcessReport, timeout is 500ms.
[INFO] PRE_ACT(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.831.660 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:704] GenerateAllocator] Generate allocator, is persistent : 0, stream id : 0.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.831.672 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] PRE_ACT(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.831.688 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:716] operator()] Malloc mem block, is enable eager free : 0, is enable vmm : 1, size : 512, block size : 1073741824.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.831.687 [npu_driver.cc:3828] 618808 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=64.
[INFO] DEVICE(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.831.706 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.cc:204] AllocDeviceMem] VMM AllocDeviceMem size:61027123200, align_size:61027123200
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.831.768 [context.cpp:72]619021 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.831.804 [api_impl.cc:3717] 619021 ContextSetCurrent: set context=aaab087d6320, flag=0.
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.831.822 [mindspore/ccsrc/common/amp/amp.cc:149] GetCurrentAmpStrategy] amp strategy stack is empty
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:47.831.827 [awatchdog_core.c:175](tid:619021) create watchdog for id : 65543, tid : 619021, timeout : 300s
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.831.850 [context.cpp:80]619021 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] PRE_ACT(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.831.896 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:704] GenerateAllocator] Generate allocator, is persistent : 1, stream id : 0.
[INFO] PRE_ACT(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.831.935 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:716] operator()] Malloc mem block, is enable eager free : 0, is enable vmm : 1, size : 512, block size : 1073741824.
[INFO] DEVICE(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.831.958 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.cc:204] AllocDeviceMem] VMM AllocDeviceMem size:61029220352, align_size:61029220352
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.832.991 [api_impl.cc:7115] 619018 ReserveMemAddress: device malloc Succ, size=61027123200(bytes) start ptr=0x12d100000000, end ptr=0x12df35800000
[INFO] PRE_ACT(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.833.258 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:736] operator()] Malloc mem block : {"addr_":0x12d100000000,"size_":61029220352,"stream_id_":0,"min_addr_":0,"max_addr_":0}.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.833.341 [api_impl.cc:7115] 619021 ReserveMemAddress: device malloc Succ, size=61029220352(bytes) start ptr=0x12c2c0000000, end ptr=0x12d0f5a00000
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.833.290 [api_impl.cc:7129] 619015 MallocPhysical: Start to MallocPhysical
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.833.388 [api_impl.cc:7145] 619015 MapMem: device malloc Succ, size=2097152(bytes), start ptr=0x12d100000000, end ptr=0x12d100200000
mki_log log dir:/home/jenkins/atb/log exist
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.834.181 [device.cpp:231]619015 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.834.202 [runtime.cc:5239] 619015 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.834.223 [acl.cpp:802]619015 aclGetRecentErrMsg: start to execute aclGetRecentErrMsg.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.834.338 [npu_driver.cc:404] 619015 StreamIdAlloc: stream id alloc begin, device_id=6, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.834.375 [stream.cc:2246] 619015 AllocExecutedTimesSvm: stream_id=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.834.415 [stream_sqcq_manage.cc:147] 619015 Alloc: deviceId=6, tsId=0, drvFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.834.433 [npu_driver.cc:882] 619015 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.834.854 [npu_driver.cc:6125] 619015 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.834.907 [npu_driver.cc:6137] 619015 LogicCqAllocateV2: success: deviceId=6, tsId=0, cqId=302, streamId=6, logicCq=302, cqeDepth=4096
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.834.934 [npu_driver.cc:6189] 619015 StreamBindLogicCq: success: deviceId=6, tsId=0, streamId=6, logicCq=302.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.834.953 [npu_driver.cc:5916] 619015 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=c8060000, addr=dfffc8060000size=4096
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.834.969 [stream.cc:653] 619015 Setup: Success to get sq=6 sq reg virtual addr length=4096.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.835.012 [stream.cc:276] 619015 CreateStreamTaskRes: Normal STREAM Setup stream_id=6 flags_=0x0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.835.030 [stream.cc:688] 619015 Setup: stream setup end, stream_id=6, IsTaskSink=0, sqId=6, cqId=6, deviceId=6, streamResId=65534
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.835.051 [acl_resource_manager.cpp:814]619015 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.835.066 [acl_resource_manager.cpp:816]619015 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] PRE_ACT(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.835.093 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:736] operator()] Malloc mem block : {"addr_":0x12d100000000,"size_":61029220352,"stream_id_":0,"min_addr_":0,"max_addr_":0}.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.835.128 [api_impl.cc:7129] 619016 MallocPhysical: Start to MallocPhysical
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.835.214 [engine.cc:188] 619015 SubmitTaskNormal: stream_id=6,task_id=0,task_type=87 (GET_DEVICE_MSG).
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.835.237 [npu_driver.cc:5547] 619015 GetSqHead: deviceId=6, tsId=0, sqId=6, head=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.835.236 [api_impl.cc:7145] 619016 MapMem: device malloc Succ, size=2097152(bytes), start ptr=0x12d100000000, end ptr=0x12d100200000
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.835.255 [task_info.cc:409] 619015 ConstructSqeForGetDevMsgTask: stream_id:6, task_id:0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.835.270 [stream.cc:1400] 619015 AddTaskToList: public task, stream_id=6, task_id=0, task_type=87 (GET_DEVICE_MSG), head=0, tail=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.835.284 [stream.cc:2595] 619015 StarsAddTaskToStream: single-operator flow stream, stream_id=6, task_id=0, type=87(GET_DEVICE_MSG), head=0, tail=1, sqe_num=1, lastTail=0, device_id=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.835.305 [npu_driver.cc:751] 619015 SqTaskSend: device_id=6, ts_id=0, sq_id=6, sqe_num=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.835.321 [stars_engine.cc:893] 619015 SendTask: Sq task send finished, device_id=6, ts_id=0, sq_id=6, cq_id=6, stream_id=6, task_id=0, task_type=87(GET_DEVICE_MSG).
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.835.339 [stream.cc:1494] 619015 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.835.353 [npu_driver.cc:5547] 619015 GetSqHead: deviceId=6, tsId=0, sqId=6, head=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.835.371 [stream.cc:2886] 619015 StarsWaitForTask: No.0 stream_id=6, taskId=0, currentId=65535
mki_log log dir:/home/jenkins/atb/log exist
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.835.387 [npu_driver.cc:5547] 619015 GetSqHead: deviceId=6, tsId=0, sqId=6, head=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.835.401 [task.cc:185] 619015 GetTask: this stream no taskRes, stream_id=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.835.416 [task.cc:185] 619015 GetTask: this stream no taskRes, stream_id=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.835.434 [logger.cc:152] 619015 TaskFinished: device_id=6, stream_id=6, task_id=0, task_type=87 (GET_DEVICE_MSG), task_finish_num=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.835.465 [stars_engine.cc:437] 619015 FinishedTaskReclaim: recycle task, stream_id=6, limited=0, taskHead=0, sqHead=1, endTaskId=0, recycleTaskId=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.835.481 [stream.cc:2886] 619015 StarsWaitForTask: No.1 stream_id=6, taskId=0, currentId=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.835.494 [stream.cc:852] 619015 TearDown: stream_id=6, sqId=6, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.835.511 [stream.cc:938] 619015 TearDown: stream_id=6, delay recycle task num=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.835.523 [stream.cc:1507] 619015 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.835.550 [stream_sqcq_manage.cc:451] 619015 FreeLogicCq: Return(0), threadIdentifier(281469708398496), devId(6), tsId(0), cqId(302), isFastCq(0).
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.835.571 [npu_driver.cc:6163] 619015 StreamUnBindLogicCq: success: deviceId=6, tsId=0, streamId=6, logicCq=302.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.835.604 [npu_driver.cc:1180] 619015 LogicCqFree: Succ:device_id=6,ts_id=0,type=2,logic_cq_id=302, drvFlag=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.835.621 [stream.cc:237] 619015 FreeStreamId: Free stream_id=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.835.633 [stream_sqcq_manage.cc:216] 619015 DeAllocStreamSqCq: deviceId=6, tsId=0, drvFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.835.646 [npu_driver.cc:966] 619015 NormalSqCqFree: Normal sqcq free, sqId=6, cqId=6, device_id=6, tsId=0, drvFlag=0
[INFO] PRE_ACT(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.835.869 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:736] operator()] Malloc mem block : {"addr_":0x12d100000000,"size_":61029220352,"stream_id_":0,"min_addr_":0,"max_addr_":0}.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.835.908 [api_impl.cc:7129] 619017 MallocPhysical: Start to MallocPhysical
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.836.020 [device.cpp:231]619016 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.836.043 [runtime.cc:5239] 619016 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.836.046 [api_impl.cc:7145] 619017 MapMem: device malloc Succ, size=2097152(bytes), start ptr=0x12d100000000, end ptr=0x12d100200000
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.836.059 [acl.cpp:802]619016 aclGetRecentErrMsg: start to execute aclGetRecentErrMsg.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.836.179 [npu_driver.cc:404] 619016 StreamIdAlloc: stream id alloc begin, device_id=1, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.836.194 [npu_driver.cc:974] 619015 NormalSqCqFree: Normal sqcq free success, sqId=6, cqId=6, device_id=6, tsId=0, drvFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.836.220 [stream_sqcq_manage.cc:228] 619015 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=6, cq_id=6, stream_id=6, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.836.239 [npu_driver.cc:432] 619015 StreamIdFree: stream id free begin, device_id=6, stream_id=6, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.836.220 [stream.cc:2246] 619016 AllocExecutedTimesSvm: stream_id=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.836.259 [npu_driver.cc:441] 619015 StreamIdFree: Stream id free success, stream_id=6, device_id=6, tsId=0, streamFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.836.263 [stream_sqcq_manage.cc:147] 619016 Alloc: deviceId=1, tsId=0, drvFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.836.277 [npu_driver.cc:882] 619016 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.836.279 [device_msg_handler.cc:110] 619015 HandleMsg: Begin to process device errMessage.
mki_log log dir:/home/jenkins/atb/log exist
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.836.795 [npu_driver.cc:6125] 619016 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.836.846 [npu_driver.cc:6137] 619016 LogicCqAllocateV2: success: deviceId=1, tsId=0, cqId=406, streamId=6, logicCq=406, cqeDepth=4096
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.836.876 [npu_driver.cc:6189] 619016 StreamBindLogicCq: success: deviceId=1, tsId=0, streamId=6, logicCq=406.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.836.895 [npu_driver.cc:5916] 619016 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=d43a6000, addr=dfffd43a6000size=4096
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.836.909 [stream.cc:653] 619016 Setup: Success to get sq=6 sq reg virtual addr length=4096.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.836.923 [device.cpp:231]619017 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.836.950 [stream.cc:276] 619016 CreateStreamTaskRes: Normal STREAM Setup stream_id=6 flags_=0x0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.836.957 [runtime.cc:5239] 619017 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.836.966 [stream.cc:688] 619016 Setup: stream setup end, stream_id=6, IsTaskSink=0, sqId=6, cqId=6, deviceId=1, streamResId=65534
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.836.983 [acl_resource_manager.cpp:814]619016 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.836.981 [acl.cpp:802]619017 aclGetRecentErrMsg: start to execute aclGetRecentErrMsg.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.836.996 [acl_resource_manager.cpp:816]619016 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.837.067 [device_msg_handler.cc:127] 619015 HandleMsg: Finished to process device errInfo, retCode=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.837.091 [npu_driver.cc:404] 619017 StreamIdAlloc: stream id alloc begin, device_id=3, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.837.119 [runtime.cc:5239] 619015 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.837.132 [stream.cc:2246] 619017 AllocExecutedTimesSvm: stream_id=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.837.153 [npu_driver.cc:500] 619015 GetFaultEvent: get fault event, device_id=6, filterFlag=8, outputLen=128.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.837.159 [engine.cc:188] 619016 SubmitTaskNormal: stream_id=6,task_id=0,task_type=87 (GET_DEVICE_MSG).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.837.171 [stream_sqcq_manage.cc:147] 619017 Alloc: deviceId=3, tsId=0, drvFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.837.194 [npu_driver.cc:5547] 619016 GetSqHead: deviceId=1, tsId=0, sqId=6, head=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.837.189 [npu_driver.cc:882] 619017 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.837.212 [task_info.cc:409] 619016 ConstructSqeForGetDevMsgTask: stream_id:6, task_id:0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.837.223 [stream.cc:1400] 619016 AddTaskToList: public task, stream_id=6, task_id=0, task_type=87 (GET_DEVICE_MSG), head=0, tail=1
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.837.220 [acl.cpp:782]619015 GetFaultEventInfo: can not get fault event of device 6, runtime errorCode is 0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.837.235 [stream.cc:2595] 619016 StarsAddTaskToStream: single-operator flow stream, stream_id=6, task_id=0, type=87(GET_DEVICE_MSG), head=0, tail=1, sqe_num=1, lastTail=0, device_id=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.837.251 [npu_driver.cc:751] 619016 SqTaskSend: device_id=1, ts_id=0, sq_id=6, sqe_num=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.837.263 [stars_engine.cc:893] 619016 SendTask: Sq task send finished, device_id=1, ts_id=0, sq_id=6, cq_id=6, stream_id=6, task_id=0, task_type=87(GET_DEVICE_MSG).
[INFO] GE(618670,python3.9):2025-04-03-09:27:47.837.249 [error_manager.cc:989]619015 GetRawErrorMessages:current work_stream_id:0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.837.277 [stream.cc:1494] 619016 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.837.290 [npu_driver.cc:5547] 619016 GetSqHead: deviceId=1, tsId=0, sqId=6, head=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.837.303 [stream.cc:2886] 619016 StarsWaitForTask: No.0 stream_id=6, taskId=0, currentId=65535
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.837.314 [npu_driver.cc:5547] 619016 GetSqHead: deviceId=1, tsId=0, sqId=6, head=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.837.327 [task.cc:185] 619016 GetTask: this stream no taskRes, stream_id=6
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.837.339 [task.cc:185] 619016 GetTask: this stream no taskRes, stream_id=6
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.837.352 [logger.cc:152] 619016 TaskFinished: device_id=1, stream_id=6, task_id=0, task_type=87 (GET_DEVICE_MSG), task_finish_num=6
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.837.372 [stars_engine.cc:437] 619016 FinishedTaskReclaim: recycle task, stream_id=6, limited=0, taskHead=0, sqHead=1, endTaskId=0, recycleTaskId=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.837.385 [stream.cc:2886] 619016 StarsWaitForTask: No.1 stream_id=6, taskId=0, currentId=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.837.397 [stream.cc:852] 619016 TearDown: stream_id=6, sqId=6, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.837.411 [stream.cc:938] 619016 TearDown: stream_id=6, delay recycle task num=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.837.421 [stream.cc:1507] 619016 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.837.445 [stream_sqcq_manage.cc:451] 619016 FreeLogicCq: Return(0), threadIdentifier(281470043942816), devId(1), tsId(0), cqId(406), isFastCq(0).
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.837.463 [npu_driver.cc:6163] 619016 StreamUnBindLogicCq: success: deviceId=1, tsId=0, streamId=6, logicCq=406.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.837.476 [npu_driver.cc:6125] 619017 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.837.494 [npu_driver.cc:1180] 619016 LogicCqFree: Succ:device_id=1,ts_id=0,type=2,logic_cq_id=406, drvFlag=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.837.509 [stream.cc:237] 619016 FreeStreamId: Free stream_id=6.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.837.521 [stream_sqcq_manage.cc:216] 619016 DeAllocStreamSqCq: deviceId=1, tsId=0, drvFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.837.532 [npu_driver.cc:966] 619016 NormalSqCqFree: Normal sqcq free, sqId=6, cqId=6, device_id=1, tsId=0, drvFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.837.532 [npu_driver.cc:6137] 619017 LogicCqAllocateV2: success: deviceId=3, tsId=0, cqId=1044, streamId=6, logicCq=1044, cqeDepth=4096
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.837.555 [npu_driver.cc:6189] 619017 StreamBindLogicCq: success: deviceId=3, tsId=0, streamId=6, logicCq=1044.
[INFO] PRE_ACT(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.837.549 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:736] operator()] Malloc mem block : {"addr_":0x12c2c0000000,"size_":61029220352,"stream_id_":0,"min_addr_":0,"max_addr_":0}.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.837.573 [npu_driver.cc:5916] 619017 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=ec007000, addr=dfffec007000size=4096
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.837.591 [stream.cc:653] 619017 Setup: Success to get sq=6 sq reg virtual addr length=4096.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.837.595 [api_impl.cc:7129] 619019 MallocPhysical: Start to MallocPhysical
[CRITICAL] KERNEL(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.837.606 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.837.634 [stream.cc:276] 619017 CreateStreamTaskRes: Normal STREAM Setup stream_id=6 flags_=0x0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.837.651 [stream.cc:688] 619017 Setup: stream setup end, stream_id=6, IsTaskSink=0, sqId=6, cqId=6, deviceId=3, streamResId=65534
[INFO] DEBUG(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.837.651 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.837.668 [acl_resource_manager.cpp:814]619017 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.837.682 [acl_resource_manager.cpp:816]619017 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] DEBUG(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.837.675 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
[INFO] DEBUG(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.837.694 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.837.731 [api_impl.cc:7145] 619019 MapMem: device malloc Succ, size=2097152(bytes), start ptr=0x12c2c0000000, end ptr=0x12c2c0200000
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.837.811 [device.cpp:143]619019 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 7.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.837.830 [engine.cc:188] 619017 SubmitTaskNormal: stream_id=6,task_id=0,task_type=87 (GET_DEVICE_MSG).
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.837.834 [api_impl.cc:2999] 619019 SetDevice: device_id=7, deviceMode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.837.853 [device.cc:306] 619019 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.837.851 [npu_driver.cc:5547] 619017 GetSqHead: deviceId=3, tsId=0, sqId=6, head=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.837.867 [task_info.cc:409] 619017 ConstructSqeForGetDevMsgTask: stream_id:6, task_id:0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.837.869 [runtime.cc:3393] 619019 PrimaryContextRetain: Context inc ref, ts_id=0, count=0xa
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.837.882 [stream.cc:1400] 619017 AddTaskToList: public task, stream_id=6, task_id=0, task_type=87 (GET_DEVICE_MSG), head=0, tail=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.837.888 [runtime.cc:3560] 619019 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.837.901 [api_impl.cc:2987] 619019 NewDevice: SetCurRef = 0xaaab0103b880,userDeviceId=7,deviceId=7
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.837.898 [stream.cc:2595] 619017 StarsAddTaskToStream: single-operator flow stream, stream_id=6, task_id=0, type=87(GET_DEVICE_MSG), head=0, tail=1, sqe_num=1, lastTail=0, device_id=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.837.917 [npu_driver.cc:751] 619017 SqTaskSend: device_id=3, ts_id=0, sq_id=6, sqe_num=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.837.916 [runtime.cc:5239] 619019 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.837.932 [stars_engine.cc:893] 619017 SendTask: Sq task send finished, device_id=3, ts_id=0, sq_id=6, cq_id=6, stream_id=6, task_id=0, task_type=87(GET_DEVICE_MSG).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.837.949 [stream.cc:1494] 619017 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.837.935 [api_impl.cc:2992] 619019 NewDevice: New device success, user_device_id=7, die_num=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.837.957 [api_impl.cc:3025] 619019 SetDevice: SetDevice success, curCtx=0xaaab0103b880, user_device_id=7.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.837.969 [npu_driver.cc:5547] 619017 GetSqHead: deviceId=3, tsId=0, sqId=6, head=1.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.837.972 [acl.cpp:115]619019 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.837.989 [acl.cpp:121]619019 GetSocVersion: socVersion is Ascend910B3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.837.986 [task.cc:185] 619017 GetTask: this stream no taskRes, stream_id=6
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.838.000 [task.cc:185] 619017 GetTask: this stream no taskRes, stream_id=6
[INFO] RUNTIME_FRAMEWORK(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.838.002 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.

----------------------------------------------------
- C++ Call Stack: (For framework developers)
----------------------------------------------------
mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.838.007 [device.cpp:154]619019 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 7
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.838.013 [logger.cc:152] 619017 TaskFinished: device_id=3, stream_id=6, task_id=0, task_type=87 (GET_DEVICE_MSG), task_finish_num=6
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.838.033 [stars_engine.cc:437] 619017 FinishedTaskReclaim: recycle task, stream_id=6, limited=0, taskHead=0, sqHead=1, endTaskId=0, recycleTaskId=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.838.047 [stream.cc:2886] 619017 StarsWaitForTask: No.0 stream_id=6, taskId=0, currentId=0
[INFO] DEVICE(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.838.040 [mindspore/ccsrc/plugin/res_manager/ascend/ascend_res_manager.cc:496] SetDeterministic] Set kernel deterministic value: 0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.838.061 [stream.cc:852] 619017 TearDown: stream_id=6, sqId=6, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.838.069 [npu_driver.cc:974] 619016 NormalSqCqFree: Normal sqcq free success, sqId=6, cqId=6, device_id=1, tsId=0, drvFlag=0
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.838.060 [context.cpp:174]619019 aclrtCtxSetSysParamOpt: start to execute aclrtCtxSetSysParamOpt, opt = 0, value = 0.
] RUNTIME(618658,python3.9):2025-04-03-09:27:47.838.077 [stream.cc:938] 619017 TearDown: stream_id=6, delay recycle task num=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.838.107 [stream.cc:1507] 619017 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.838.097 [api_impl.cc:6913] 619019 CtxSetSysParamOpt: curCtx = 0xaaab0103b880, configOpt=0, configVal=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.838.088 [stream_sqcq_manage.cc:228] 619016 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=6, cq_id=6, stream_id=6, is_sq_need_release=1, drvFlag=0.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.838.105 [context.cpp:72]619015 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.838.114 [context.cpp:158]619019 SetSysParamOpt: successfully execute aclrtCtxSetSysParamOpt
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.838.115 [npu_driver.cc:432] 619016 StreamIdFree: stream id free begin, device_id=1, stream_id=6, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.838.134 [npu_driver.cc:441] 619016 StreamIdFree: Stream id free success, stream_id=6, device_id=1, tsId=0, streamFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.838.131 [stream_sqcq_manage.cc:451] 619017 FreeLogicCq: Return(0), threadIdentifier(281469725306784), devId(3), tsId(0), cqId(1044), isFastCq(0).
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.127 [api_impl.cc:3717] 619015 ContextSetCurrent: set context=aaaad9a630c0, flag=0.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.838.142 [context.cpp:80]619015 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.838.152 [device_msg_handler.cc:110] 619016 HandleMsg: Begin to process device errMessage.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.838.152 [npu_driver.cc:6163] 619017 StreamUnBindLogicCq: success: deviceId=3, tsId=0, streamId=6, logicCq=1044.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.166 [api_error.cc:1807] 619015 MemcpyAsyncCheckKindAndLocation: src pointer loc type=1, dst pointer loc type=2, kind=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.838.178 [npu_driver.cc:1180] 619017 LogicCqFree: Succ:device_id=3,ts_id=0,type=2,logic_cq_id=1044, drvFlag=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.838.192 [stream.cc:237] 619017 FreeStreamId: Free stream_id=6.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.838.182 [op_base.cc:1214] [619019][HcclSetConfig] Set HCCL_DETERMINISTIC is false
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:47.838.177 [mindspore/ccsrc/common/amp/amp.cc:149] GetCurrentAmpStrategy] amp strategy stack is empty
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.183 [memory_task.cc:342] 619015 ConvertCpyType: MemcpyAsyncTask::ConvertCpyType MEMCPY_HOST_TO_DEVICE, direct=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.201 [memory_task.cc:473] 619015 MemcpyAsyncTaskInitV3: Init qos=0, partId=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.838.204 [stream_sqcq_manage.cc:216] 619017 DeAllocStreamSqCq: deviceId=3, tsId=0, drvFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.838.204 [runtime.cc:5239] 619019 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.838.218 [npu_driver.cc:966] 619017 NormalSqCqFree: Normal sqcq free, sqId=6, cqId=6, device_id=3, tsId=0, drvFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.212 [memory_task.cc:518] 619015 MemcpyAsyncTaskInitV3: CopyType=0: use virtual address directly.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.226 [task_res.cc:380] 619015 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=6, stream_id=2, taskResId=2, taskResHead_=0, taskResTail_=3.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.838.224 [adapter_rts.cc:234] [619019][hrtGetDevice]deviceLogicId[7]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:47.838.238 [op_base.cc:128] [619019][HcclGetDeviceId] deviceLogicId[7] 
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.242 [memory_task.cc:1007] 619015 ConstructPcieDmaSqe: stream_id=2, task_id=2, copyType=0, src=0xaaaae5587f70, dst=0x12c2c0000000, len=0x6c
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.256 [memory_task.cc:1166] 619015 ConstructSqeForMemcpyAsyncTask: MemcpyAsyncTask, stream_id=2, task_id=2, copyType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.269 [stream.cc:1400] 619015 AddTaskToList: public task, stream_id=2, task_id=2, task_type=5 (MEMCPY_ASYNC), head=0, tail=3
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.838.276 [context.cpp:72]619019 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.286 [stream.cc:2595] 619015 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=2, type=5(MEMCPY_ASYNC), head=0, tail=3, sqe_num=1, lastTail=2, device_id=6
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.838.295 [api_impl.cc:3717] 619019 ContextSetCurrent: set context=aaab0103b880, flag=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.304 [task_submit.cc:573] 619015 AllocTaskAndSendStars: device_id=6, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=2, task_type=5(MEMCPY_ASYNC).
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.320 [stream.cc:1494] 619015 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=2.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.838.309 [context.cpp:80]619019 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.838.340 [callback.cpp:97]619015 aclrtLaunchCallback: start to execute aclrtLaunchCallback.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.838.343 [api_error.cc:1807] 619019 MemcpyAsyncCheckKindAndLocation: src pointer loc type=1, dst pointer loc type=2, kind=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.359 [task_res.cc:380] 619015 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=6, stream_id=2, taskResId=3, taskResHead_=0, taskResTail_=4.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.838.365 [memory_task.cc:342] 619019 ConvertCpyType: MemcpyAsyncTask::ConvertCpyType MEMCPY_HOST_TO_DEVICE, direct=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.838.383 [memory_task.cc:473] 619019 MemcpyAsyncTaskInitV3: Init qos=0, partId=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.377 [task_info.cc:521] 619015 ConstructSqeForCallbackLaunchTask: CallbackLaunch,topic_type=4,stream_id=2,task_id=3,eventId=65535,isBlock=0,pid=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.392 [stream.cc:1400] 619015 AddTaskToList: public task, stream_id=2, task_id=3, task_type=72 (HOSTFUNC_CALLBACK), head=0, tail=4
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.838.397 [memory_task.cc:518] 619019 MemcpyAsyncTaskInitV3: CopyType=0: use virtual address directly.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.406 [stream.cc:2595] 619015 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=3, type=72(HOSTFUNC_CALLBACK), head=0, tail=4, sqe_num=1, lastTail=3, device_id=6
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.838.419 [task_res.cc:380] 619019 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=7, stream_id=2, taskResId=0, taskResHead_=0, taskResTail_=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.424 [task_submit.cc:573] 619015 AllocTaskAndSendStars: device_id=6, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=3, task_type=72(HOSTFUNC_CALLBACK).
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.450 [stream.cc:1494] 619015 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.838.442 [memory_task.cc:1007] 619019 ConstructPcieDmaSqe: stream_id=2, task_id=0, copyType=0, src=0xaaab0cc46530, dst=0x12c2c0000000, len=0x6c
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.838.460 [memory_task.cc:1166] 619019 ConstructSqeForMemcpyAsyncTask: MemcpyAsyncTask, stream_id=2, task_id=0, copyType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.460 [npu_driver.cc:3844] 618822 CqReportGet: cq report get start, device_id=6, tsId=0.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.838.463 [callback.cpp:109]619015 aclrtLaunchCallback: successfully execute aclrtLaunchCallback
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.479 [npu_driver.cc:3851] 618822 CqReportGet: halCqReportGet count=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.838.476 [stream.cc:1400] 619019 AddTaskToList: public task, stream_id=2, task_id=0, task_type=5 (MEMCPY_ASYNC), head=0, tail=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.495 [api_impl.cc:5087] 618822 ProcessReport: report[0], sqid=12291, streamId=2, taskId=3, eventId=65535, isBlock=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.838.494 [stream.cc:2595] 619019 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=0, type=5(MEMCPY_ASYNC), head=0, tail=1, sqe_num=1, lastTail=0, device_id=7
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.838.512 [callback.cpp:138]618822 aclrtProcessReport: successfully aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.838.520 [task_submit.cc:573] 619019 AllocTaskAndSendStars: device_id=7, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=0, task_type=5(MEMCPY_ASYNC).
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.838.530 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.838.539 [stream.cc:1494] 619019 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.546 [npu_driver.cc:3828] 618822 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=64.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.838.548 [device.cpp:231]619015 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.838.563 [callback.cpp:97]619019 aclrtLaunchCallback: start to execute aclrtLaunchCallback.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.569 [runtime.cc:5239] 619015 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.838.586 [acl.cpp:802]619015 aclGetRecentErrMsg: start to execute aclGetRecentErrMsg.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.838.599 [task_res.cc:380] 619019 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=7, stream_id=2, taskResId=1, taskResHead_=0, taskResTail_=2.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.616 [npu_driver.cc:404] 619015 StreamIdAlloc: stream id alloc begin, device_id=6, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.838.621 [task_info.cc:521] 619019 ConstructSqeForCallbackLaunchTask: CallbackLaunch,topic_type=4,stream_id=2,task_id=1,eventId=65535,isBlock=0,pid=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.644 [stream.cc:2246] 619015 AllocExecutedTimesSvm: stream_id=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.838.639 [stream.cc:1400] 619019 AddTaskToList: public task, stream_id=2, task_id=1, task_type=72 (HOSTFUNC_CALLBACK), head=0, tail=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.838.670 [stream.cc:2595] 619019 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=1, type=72(HOSTFUNC_CALLBACK), head=0, tail=2, sqe_num=1, lastTail=1, device_id=7
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.681 [stream_sqcq_manage.cc:147] 619015 Alloc: deviceId=6, tsId=0, drvFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.698 [npu_driver.cc:882] 619015 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.838.687 [task_submit.cc:573] 619019 AllocTaskAndSendStars: device_id=7, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=1, task_type=72(HOSTFUNC_CALLBACK).
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.838.705 [stream.cc:1494] 619019 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=1.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.838.718 [callback.cpp:109]619019 aclrtLaunchCallback: successfully execute aclrtLaunchCallback
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.838.707 [npu_driver.cc:974] 619017 NormalSqCqFree: Normal sqcq free success, sqId=6, cqId=6, device_id=3, tsId=0, drvFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.838.727 [stream_sqcq_manage.cc:228] 619017 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=6, cq_id=6, stream_id=6, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.838.732 [npu_driver.cc:3844] 618818 CqReportGet: cq report get start, device_id=7, tsId=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.838.743 [npu_driver.cc:432] 619017 StreamIdFree: stream id free begin, device_id=3, stream_id=6, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.838.756 [npu_driver.cc:3851] 618818 CqReportGet: halCqReportGet count=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.838.767 [api_impl.cc:5087] 618818 ProcessReport: report[0], sqid=12291, streamId=2, taskId=1, eventId=65535, isBlock=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.838.763 [npu_driver.cc:441] 619017 StreamIdFree: Stream id free success, stream_id=6, device_id=3, tsId=0, streamFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.838.781 [device_msg_handler.cc:110] 619017 HandleMsg: Begin to process device errMessage.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.838.787 [callback.cpp:138]618818 aclrtProcessReport: successfully aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.838.803 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] PRE_ACT(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.838.806 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:704] GenerateAllocator] Generate allocator, is persistent : 0, stream id : 0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.838.820 [npu_driver.cc:3828] 618818 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=64.
[INFO] PRE_ACT(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.838.840 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:716] operator()] Malloc mem block, is enable eager free : 0, is enable vmm : 1, size : 512, block size : 1073741824.
[INFO] DEVICE(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.838.865 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.cc:204] AllocDeviceMem] VMM AllocDeviceMem size:61029220352, align_size:61029220352
[INFO] PRE_ACT(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.838.850 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:736] operator()] Malloc mem block : {"addr_":0x12c2c0000000,"size_":61022928896,"stream_id_":0,"min_addr_":0,"max_addr_":0}.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.838.896 [device_msg_handler.cc:127] 619016 HandleMsg: Finished to process device errInfo, retCode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.838.888 [api_impl.cc:7129] 619020 MallocPhysical: Start to MallocPhysical
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.927 [npu_driver.cc:6125] 619015 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.838.950 [runtime.cc:5239] 619016 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.975 [npu_driver.cc:6137] 619015 LogicCqAllocateV2: success: deviceId=6, tsId=0, cqId=303, streamId=7, logicCq=303, cqeDepth=4096
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.838.982 [npu_driver.cc:500] 619016 GetFaultEvent: get fault event, device_id=1, filterFlag=8, outputLen=128.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.838.998 [npu_driver.cc:6189] 619015 StreamBindLogicCq: success: deviceId=6, tsId=0, streamId=7, logicCq=303.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.839.015 [npu_driver.cc:5916] 619015 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=c8060000, addr=dfffc8060000size=4096
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.839.032 [stream.cc:653] 619015 Setup: Success to get sq=7 sq reg virtual addr length=4096.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.004 [api_impl.cc:7145] 619020 MapMem: device malloc Succ, size=2097152(bytes), start ptr=0x12c2c0000000, end ptr=0x12c2c0200000
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.839.052 [acl.cpp:782]619016 GetFaultEventInfo: can not get fault event of device 1, runtime errorCode is 0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.839.070 [stream.cc:276] 619015 CreateStreamTaskRes: Normal STREAM Setup stream_id=7 flags_=0x0
[INFO] GE(618650,python3.9):2025-04-03-09:27:47.839.078 [error_manager.cc:989]619016 GetRawErrorMessages:current work_stream_id:0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.839.087 [stream.cc:688] 619015 Setup: stream setup end, stream_id=7, IsTaskSink=0, sqId=7, cqId=7, deviceId=6, streamResId=65534
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.839.103 [acl_resource_manager.cpp:814]619015 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.839.089 [device.cpp:143]619020 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 2.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.839.117 [acl_resource_manager.cpp:816]619015 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.113 [api_impl.cc:2999] 619020 SetDevice: device_id=2, deviceMode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.132 [device.cc:306] 619020 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.148 [runtime.cc:3393] 619020 PrimaryContextRetain: Context inc ref, ts_id=0, count=0xa
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.165 [runtime.cc:3560] 619020 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.181 [api_impl.cc:2987] 619020 NewDevice: SetCurRef = 0xaaaaf5082ff0,userDeviceId=2,deviceId=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.839.167 [engine.cc:188] 619015 SubmitTaskNormal: stream_id=7,task_id=0,task_type=87 (GET_DEVICE_MSG).
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.195 [runtime.cc:5239] 619020 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.839.186 [npu_driver.cc:5547] 619015 GetSqHead: deviceId=6, tsId=0, sqId=7, head=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.839.215 [task_info.cc:409] 619015 ConstructSqeForGetDevMsgTask: stream_id:7, task_id:0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.215 [api_impl.cc:2992] 619020 NewDevice: New device success, user_device_id=2, die_num=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.839.229 [stream.cc:1400] 619015 AddTaskToList: public task, stream_id=7, task_id=0, task_type=87 (GET_DEVICE_MSG), head=0, tail=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.839.246 [stream.cc:2595] 619015 StarsAddTaskToStream: single-operator flow stream, stream_id=7, task_id=0, type=87(GET_DEVICE_MSG), head=0, tail=1, sqe_num=1, lastTail=0, device_id=6
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.235 [api_impl.cc:3025] 619020 SetDevice: SetDevice success, curCtx=0xaaaaf5082ff0, user_device_id=2.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.839.252 [acl.cpp:115]619020 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.839.264 [npu_driver.cc:751] 619015 SqTaskSend: device_id=6, ts_id=0, sq_id=7, sqe_num=1.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.839.268 [acl.cpp:121]619020 GetSocVersion: socVersion is Ascend910B3
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.839.277 [stars_engine.cc:893] 619015 SendTask: Sq task send finished, device_id=6, ts_id=0, sq_id=7, cq_id=7, stream_id=7, task_id=0, task_type=87(GET_DEVICE_MSG).
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.839.294 [stream.cc:1494] 619015 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.839.284 [device.cpp:154]619020 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.839.308 [npu_driver.cc:5547] 619015 GetSqHead: deviceId=6, tsId=0, sqId=7, head=1.
[INFO] DEVICE(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.839.317 [mindspore/ccsrc/plugin/res_manager/ascend/ascend_res_manager.cc:496] SetDeterministic] Set kernel deterministic value: 0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.839.324 [task.cc:185] 619015 GetTask: this stream no taskRes, stream_id=7
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.839.338 [task.cc:185] 619015 GetTask: this stream no taskRes, stream_id=7
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.839.336 [context.cpp:174]619020 aclrtCtxSetSysParamOpt: start to execute aclrtCtxSetSysParamOpt, opt = 0, value = 0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.839.352 [logger.cc:152] 619015 TaskFinished: device_id=6, stream_id=7, task_id=0, task_type=87 (GET_DEVICE_MSG), task_finish_num=7
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.358 [api_impl.cc:6913] 619020 CtxSetSysParamOpt: curCtx = 0xaaaaf5082ff0, configOpt=0, configVal=0.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.839.375 [context.cpp:158]619020 SetSysParamOpt: successfully execute aclrtCtxSetSysParamOpt
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.839.371 [stars_engine.cc:437] 619015 FinishedTaskReclaim: recycle task, stream_id=7, limited=0, taskHead=0, sqHead=1, endTaskId=0, recycleTaskId=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.839.388 [stream.cc:2886] 619015 StarsWaitForTask: No.0 stream_id=7, taskId=0, currentId=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.839.402 [stream.cc:852] 619015 TearDown: stream_id=7, sqId=7, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.839.418 [stream.cc:938] 619015 TearDown: stream_id=7, delay recycle task num=0.
[CRITICAL] KERNEL(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.839.417 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.839.433 [stream.cc:1507] 619015 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.839.442 [op_base.cc:1214] [619020][HcclSetConfig] Set HCCL_DETERMINISTIC is false
[INFO] DEBUG(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.839.459 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.839.454 [stream_sqcq_manage.cc:451] 619015 FreeLogicCq: Return(0), threadIdentifier(281469708398496), devId(6), tsId(0), cqId(303), isFastCq(0).
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.467 [runtime.cc:5239] 619020 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.839.486 [adapter_rts.cc:234] [619020][hrtGetDevice]deviceLogicId[2]
[INFO] DEBUG(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.839.484 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
[INFO] DEBUG(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.839.500 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.839.476 [npu_driver.cc:6163] 619015 StreamUnBindLogicCq: success: deviceId=6, tsId=0, streamId=7, logicCq=303.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.839.501 [npu_driver.cc:1180] 619015 LogicCqFree: Succ:device_id=6,ts_id=0,type=2,logic_cq_id=303, drvFlag=0.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:47.839.502 [op_base.cc:128] [619020][HcclGetDeviceId] deviceLogicId[2] 
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.839.515 [stream.cc:237] 619015 FreeStreamId: Free stream_id=7.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.839.529 [stream_sqcq_manage.cc:216] 619015 DeAllocStreamSqCq: deviceId=6, tsId=0, drvFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.839.541 [npu_driver.cc:966] 619015 NormalSqCqFree: Normal sqcq free, sqId=7, cqId=7, device_id=6, tsId=0, drvFlag=0
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.839.536 [context.cpp:72]619020 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.555 [api_impl.cc:3717] 619020 ContextSetCurrent: set context=aaaaf5082ff0, flag=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.839.563 [device_msg_handler.cc:127] 619017 HandleMsg: Finished to process device errInfo, retCode=0.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.839.572 [context.cpp:80]619020 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.597 [api_error.cc:1807] 619020 MemcpyAsyncCheckKindAndLocation: src pointer loc type=1, dst pointer loc type=2, kind=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.617 [memory_task.cc:342] 619020 ConvertCpyType: MemcpyAsyncTask::ConvertCpyType MEMCPY_HOST_TO_DEVICE, direct=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.635 [memory_task.cc:473] 619020 MemcpyAsyncTaskInitV3: Init qos=0, partId=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.839.622 [runtime.cc:5239] 619017 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.647 [memory_task.cc:518] 619020 MemcpyAsyncTaskInitV3: CopyType=0: use virtual address directly.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.839.662 [npu_driver.cc:500] 619017 GetFaultEvent: get fault event, device_id=3, filterFlag=8, outputLen=128.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.679 [task_res.cc:380] 619020 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=2, stream_id=2, taskResId=0, taskResHead_=0, taskResTail_=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.700 [memory_task.cc:1007] 619020 ConstructPcieDmaSqe: stream_id=2, task_id=0, copyType=0, src=0xaaab00c8caa0, dst=0x12c2c0000000, len=0x6c
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.719 [memory_task.cc:1166] 619020 ConstructSqeForMemcpyAsyncTask: MemcpyAsyncTask, stream_id=2, task_id=0, copyType=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.734 [stream.cc:1400] 619020 AddTaskToList: public task, stream_id=2, task_id=0, task_type=5 (MEMCPY_ASYNC), head=0, tail=1
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.839.724 [acl.cpp:782]619017 GetFaultEventInfo: can not get fault event of device 3, runtime errorCode is 0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.749 [stream.cc:2595] 619020 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=0, type=5(MEMCPY_ASYNC), head=0, tail=1, sqe_num=1, lastTail=0, device_id=2
[INFO] GE(618658,python3.9):2025-04-03-09:27:47.839.756 [error_manager.cc:989]619017 GetRawErrorMessages:current work_stream_id:0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.770 [task_submit.cc:573] 619020 AllocTaskAndSendStars: device_id=2, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=0, task_type=5(MEMCPY_ASYNC).
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.789 [stream.cc:1494] 619020 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.839.812 [callback.cpp:97]619020 aclrtLaunchCallback: start to execute aclrtLaunchCallback.
[INFO] RUNTIME_FRAMEWORK(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.839.825 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.

----------------------------------------------------
- C++ Call Stack: (For framework developers)
----------------------------------------------------
mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.841 [task_res.cc:380] 619020 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=2, stream_id=2, taskResId=1, taskResHead_=0, taskResTail_=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.862 [task_info.cc:521] 619020 ConstructSqeForCallbackLaunchTask: CallbackLaunch,topic_type=4,stream_id=2,task_id=1,eventId=65535,isBlock=0,pid=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.877 [stream.cc:1400] 619020 AddTaskToList: public task, stream_id=2, task_id=1, task_type=72 (HOSTFUNC_CALLBACK), head=0, tail=2
[INFO] PRE_ACT(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.839.878 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:736] operator()] Malloc mem block : {"addr_":0x12c2c0000000,"size_":61029220352,"stream_id_":0,"min_addr_":0,"max_addr_":0}.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.895 [stream.cc:2595] 619020 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=1, type=72(HOSTFUNC_CALLBACK), head=0, tail=2, sqe_num=1, lastTail=1, device_id=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.914 [task_submit.cc:573] 619020 AllocTaskAndSendStars: device_id=2, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=1, task_type=72(HOSTFUNC_CALLBACK).
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.934 [stream.cc:1494] 619020 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.839.916 [api_impl.cc:7129] 619021 MallocPhysical: Start to MallocPhysical
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.839.925 [context.cpp:72]619016 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.839.948 [api_impl.cc:3717] 619016 ContextSetCurrent: set context=aaab312ab590, flag=0.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.839.949 [callback.cpp:109]619020 aclrtLaunchCallback: successfully execute aclrtLaunchCallback
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.839.964 [context.cpp:80]619016 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:47.839.984 [mindspore/ccsrc/common/amp/amp.cc:149] GetCurrentAmpStrategy] amp strategy stack is empty
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.839.983 [api_error.cc:1807] 619016 MemcpyAsyncCheckKindAndLocation: src pointer loc type=1, dst pointer loc type=2, kind=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.839.972 [npu_driver.cc:3844] 618832 CqReportGet: cq report get start, device_id=2, tsId=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.014 [memory_task.cc:342] 619016 ConvertCpyType: MemcpyAsyncTask::ConvertCpyType MEMCPY_HOST_TO_DEVICE, direct=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.840.004 [npu_driver.cc:974] 619015 NormalSqCqFree: Normal sqcq free success, sqId=7, cqId=7, device_id=6, tsId=0, drvFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.840.003 [npu_driver.cc:3851] 618832 CqReportGet: halCqReportGet count=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.840.019 [api_impl.cc:5087] 618832 ProcessReport: report[0], sqid=12291, streamId=2, taskId=1, eventId=65535, isBlock=0
[INFO] PRE_ACT(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.840.022 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:704] GenerateAllocator] Generate allocator, is persistent : 0, stream id : 0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.026 [memory_task.cc:473] 619016 MemcpyAsyncTaskInitV3: Init qos=0, partId=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.039 [memory_task.cc:518] 619016 MemcpyAsyncTaskInitV3: CopyType=0: use virtual address directly.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.840.023 [stream_sqcq_manage.cc:228] 619015 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=7, cq_id=7, stream_id=7, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.840.041 [npu_driver.cc:432] 619015 StreamIdFree: stream id free begin, device_id=6, stream_id=7, ts_id=0, remote_stream_id=0
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.840.041 [callback.cpp:138]618832 aclrtProcessReport: successfully aclrtProcessReport, timeout is 500ms.
[INFO] PRE_ACT(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.840.058 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:716] operator()] Malloc mem block, is enable eager free : 0, is enable vmm : 1, size : 512, block size : 1073741824.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.051 [task_res.cc:380] 619016 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=1, stream_id=2, taskResId=2, taskResHead_=0, taskResTail_=3.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.840.057 [npu_driver.cc:441] 619015 StreamIdFree: Stream id free success, stream_id=7, device_id=6, tsId=0, streamFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.840.086 [device_msg_handler.cc:110] 619015 HandleMsg: Begin to process device errMessage.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.065 [api_impl.cc:7145] 619021 MapMem: device malloc Succ, size=2097152(bytes), start ptr=0x12c2c0000000, end ptr=0x12c2c0200000
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.066 [memory_task.cc:1007] 619016 ConstructPcieDmaSqe: stream_id=2, task_id=2, copyType=0, src=0xaaab3ceb6d40, dst=0x12c2c0000000, len=0x6c
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.840.066 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] DEVICE(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.840.082 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.cc:204] AllocDeviceMem] VMM AllocDeviceMem size:61022928896, align_size:61022928896
[CRITICAL] KERNEL(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.840.098 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.098 [memory_task.cc:1166] 619016 ConstructSqeForMemcpyAsyncTask: MemcpyAsyncTask, stream_id=2, task_id=2, copyType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.112 [stream.cc:1400] 619016 AddTaskToList: public task, stream_id=2, task_id=2, task_type=5 (MEMCPY_ASYNC), head=0, tail=3
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.840.108 [npu_driver.cc:3828] 618832 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=320.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.125 [stream.cc:2595] 619016 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=2, type=5(MEMCPY_ASYNC), head=0, tail=3, sqe_num=1, lastTail=2, device_id=1
[INFO] DEBUG(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.840.150 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.140 [task_submit.cc:573] 619016 AllocTaskAndSendStars: device_id=1, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=2, task_type=5(MEMCPY_ASYNC).
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.153 [stream.cc:1494] 619016 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=2.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.840.147 [api_impl.cc:7115] 619019 ReserveMemAddress: device malloc Succ, size=61029220352(bytes) start ptr=0x12d100000000, end ptr=0x12df35a00000
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.840.150 [device.cpp:143]619021 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.194 [api_impl.cc:2999] 619021 SetDevice: device_id=4, deviceMode=0.
[INFO] DEBUG(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.840.197 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.840.195 [callback.cpp:97]619016 aclrtLaunchCallback: start to execute aclrtLaunchCallback.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.215 [task_res.cc:380] 619016 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=1, stream_id=2, taskResId=3, taskResHead_=0, taskResTail_=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.214 [device.cc:306] 619021 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.229 [runtime.cc:3393] 619021 PrimaryContextRetain: Context inc ref, ts_id=0, count=0xa
[INFO] DEBUG(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.840.216 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.231 [task_info.cc:521] 619016 ConstructSqeForCallbackLaunchTask: CallbackLaunch,topic_type=4,stream_id=2,task_id=3,eventId=65535,isBlock=0,pid=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.245 [stream.cc:1400] 619016 AddTaskToList: public task, stream_id=2, task_id=3, task_type=72 (HOSTFUNC_CALLBACK), head=0, tail=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.243 [runtime.cc:3560] 619021 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.258 [api_impl.cc:2987] 619021 NewDevice: SetCurRef = 0xaaab087d6320,userDeviceId=4,deviceId=4
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.259 [stream.cc:2595] 619016 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=3, type=72(HOSTFUNC_CALLBACK), head=0, tail=4, sqe_num=1, lastTail=3, device_id=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.272 [runtime.cc:5239] 619021 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.274 [task_submit.cc:573] 619016 AllocTaskAndSendStars: device_id=1, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=3, task_type=72(HOSTFUNC_CALLBACK).
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.288 [stream.cc:1494] 619016 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=3.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.840.298 [callback.cpp:109]619016 aclrtLaunchCallback: successfully execute aclrtLaunchCallback
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.288 [api_impl.cc:2992] 619021 NewDevice: New device success, user_device_id=4, die_num=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.308 [api_impl.cc:3025] 619021 SetDevice: SetDevice success, curCtx=0xaaab087d6320, user_device_id=4.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.840.337 [acl.cpp:115]619021 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.327 [npu_driver.cc:3844] 618828 CqReportGet: cq report get start, device_id=1, tsId=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.350 [npu_driver.cc:3851] 618828 CqReportGet: halCqReportGet count=1
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.840.351 [acl.cpp:121]619021 GetSocVersion: socVersion is Ascend910B3
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.366 [api_impl.cc:5087] 618828 ProcessReport: report[0], sqid=12291, streamId=2, taskId=3, eventId=65535, isBlock=0
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.840.364 [device.cpp:154]619021 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 4
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.840.373 [device.cpp:231]619016 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.840.382 [callback.cpp:138]618828 aclrtProcessReport: successfully aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.395 [runtime.cc:5239] 619016 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] DEVICE(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.840.397 [mindspore/ccsrc/plugin/res_manager/ascend/ascend_res_manager.cc:496] SetDeterministic] Set kernel deterministic value: 0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.840.405 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.840.415 [acl.cpp:802]619016 aclGetRecentErrMsg: start to execute aclGetRecentErrMsg.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.428 [npu_driver.cc:3828] 618828 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=320.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.840.417 [context.cpp:174]619021 aclrtCtxSetSysParamOpt: start to execute aclrtCtxSetSysParamOpt, opt = 0, value = 0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.438 [api_impl.cc:6913] 619021 CtxSetSysParamOpt: curCtx = 0xaaab087d6320, configOpt=0, configVal=0.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.840.453 [context.cpp:158]619021 SetSysParamOpt: successfully execute aclrtCtxSetSysParamOpt
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.455 [npu_driver.cc:404] 619016 StreamIdAlloc: stream id alloc begin, device_id=1, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.840.471 [device_msg_handler.cc:127] 619015 HandleMsg: Finished to process device errInfo, retCode=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.501 [stream.cc:2246] 619016 AllocExecutedTimesSvm: stream_id=7.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.840.508 [runtime.cc:5239] 619015 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.840.517 [op_base.cc:1214] [619021][HcclSetConfig] Set HCCL_DETERMINISTIC is false
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.840.532 [npu_driver.cc:500] 619015 GetFaultEvent: get fault event, device_id=6, filterFlag=8, outputLen=128.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.539 [stream_sqcq_manage.cc:147] 619016 Alloc: deviceId=1, tsId=0, drvFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.538 [runtime.cc:5239] 619021 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.554 [npu_driver.cc:882] 619016 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.840.556 [adapter_rts.cc:234] [619021][hrtGetDevice]deviceLogicId[4]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:47.840.572 [op_base.cc:128] [619021][HcclGetDeviceId] deviceLogicId[4] 
[INFO] RUNTIME_FRAMEWORK(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.840.565 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.

----------------------------------------------------
- C++ Call Stack: (For framework developers)
----------------------------------------------------
mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.840.589 [acl.cpp:782]619015 GetFaultEventInfo: can not get fault event of device 6, runtime errorCode is 0
[INFO] GE(618670,python3.9):2025-04-03-09:27:47.840.608 [error_manager.cc:989]619015 GetRawErrorMessages:current work_stream_id:0
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.840.605 [context.cpp:72]619021 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.624 [api_impl.cc:3717] 619021 ContextSetCurrent: set context=aaab087d6320, flag=0.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.840.639 [context.cpp:80]619021 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.663 [api_error.cc:1807] 619021 MemcpyAsyncCheckKindAndLocation: src pointer loc type=1, dst pointer loc type=2, kind=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.682 [memory_task.cc:342] 619021 ConvertCpyType: MemcpyAsyncTask::ConvertCpyType MEMCPY_HOST_TO_DEVICE, direct=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.699 [memory_task.cc:473] 619021 MemcpyAsyncTaskInitV3: Init qos=0, partId=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.710 [memory_task.cc:518] 619021 MemcpyAsyncTaskInitV3: CopyType=0: use virtual address directly.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.725 [task_res.cc:380] 619021 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=4, stream_id=2, taskResId=0, taskResHead_=0, taskResTail_=1.
[INFO] PRE_ACT(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.840.726 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:736] operator()] Malloc mem block : {"addr_":0x12d100000000,"size_":61027123200,"stream_id_":0,"min_addr_":0,"max_addr_":0}.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.840.725 [context.cpp:72]619017 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.747 [memory_task.cc:1007] 619021 ConstructPcieDmaSqe: stream_id=2, task_id=0, copyType=0, src=0xaaab1421b250, dst=0x12c2c0000000, len=0x6c
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.765 [memory_task.cc:1166] 619021 ConstructSqeForMemcpyAsyncTask: MemcpyAsyncTask, stream_id=2, task_id=0, copyType=0
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:47.840.761 [mindspore/ccsrc/common/amp/amp.cc:149] GetCurrentAmpStrategy] amp strategy stack is empty
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.840.761 [api_impl.cc:3717] 619017 ContextSetCurrent: set context=aaab0b9e09a0, flag=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.780 [stream.cc:1400] 619021 AddTaskToList: public task, stream_id=2, task_id=0, task_type=5 (MEMCPY_ASYNC), head=0, tail=1
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.840.800 [context.cpp:80]619017 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.796 [stream.cc:2595] 619021 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=0, type=5(MEMCPY_ASYNC), head=0, tail=1, sqe_num=1, lastTail=0, device_id=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.817 [task_submit.cc:573] 619021 AllocTaskAndSendStars: device_id=4, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=0, task_type=5(MEMCPY_ASYNC).
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.834 [stream.cc:1494] 619021 IsNeedS[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.825 [npu_driver.cc:6125] 619016 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.840.825 [api_error.cc:1807] 619017 MemcpyAsyncCheckKindAndLocation: src pointer loc type=1, dst pointer loc type=2, kind=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.840.761 [api_impl.cc:7129] 619018 MallocPhysical: Start to MallocPhysical
endFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.840.845 [memory_task.cc:342] 619017 ConvertCpyType: MemcpyAsyncTask::ConvertCpyType MEMCPY_HOST_TO_DEVICE, direct=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.840.858 [memory_task.cc:473] 619017 MemcpyAsyncTaskInitV3: Init qos=0, partId=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.840.870 [memory_task.cc:518] 619017 MemcpyAsyncTaskInitV3: CopyType=0: use virtual address directly.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.840.853 [api_impl.cc:7145] 619018 MapMem: device malloc Succ, size=2097152(bytes), start ptr=0x12d100000000, end ptr=0x12d100200000
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.875 [npu_driver.cc:6137] 619016 LogicCqAllocateV2: success: deviceId=1, tsId=0, cqId=407, streamId=7, logicCq=407, cqeDepth=4096
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.840.871 [callback.cpp:97]619021 aclrtLaunchCallback: start to execute aclrtLaunchCallback.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.840.883 [task_res.cc:380] 619017 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=3, stream_id=2, taskResId=2, taskResHead_=0, taskResTail_=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.896 [npu_driver.cc:6189] 619016 StreamBindLogicCq: success: deviceId=1, tsId=0, streamId=7, logicCq=407.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.899 [task_res.cc:380] 619021 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=4, stream_id=2, taskResId=1, taskResHead_=0, taskResTail_=2.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.840.900 [memory_task.cc:1007] 619017 ConstructPcieDmaSqe: stream_id=2, task_id=2, copyType=0, src=0xaaab166c6820, dst=0x12c2c0000000, len=0x6c
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.840.916 [memory_task.cc:1166] 619017 ConstructSqeForMemcpyAsyncTask: MemcpyAsyncTask, stream_id=2, task_id=2, copyType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.917 [task_info.cc:521] 619021 ConstructSqeForCallbackLaunchTask: CallbackLaunch,topic_type=4,stream_id=2,task_id=1,eventId=65535,isBlock=0,pid=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.936 [stream.cc:1400] 619021 AddTaskToList: public task, stream_id=2, task_id=1, task_type=72 (HOSTFUNC_CALLBACK), head=0, tail=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.910 [npu_driver.cc:5916] 619016 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=d43a6000, addr=dfffd43a6000size=4096
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.922 [stream.cc:653] 619016 Setup: Success to get sq=7 sq reg virtual addr length=4096.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.840.932 [stream.cc:1400] 619017 AddTaskToList: public task, stream_id=2, task_id=2, task_type=5 (MEMCPY_ASYNC), head=0, tail=3
[CRITICAL] KERNEL(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.840.927 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.840.945 [stream.cc:2595] 619017 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=2, type=5(MEMCPY_ASYNC), head=0, tail=3, sqe_num=1, lastTail=2, device_id=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.840.964 [task_submit.cc:573] 619017 AllocTaskAndSendStars: device_id=3, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=2, task_type=5(MEMCPY_ASYNC).
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.949 [stream.cc:2595] 619021 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=1, type=72(HOSTFUNC_CALLBACK), head=0, tail=2, sqe_num=1, lastTail=1, device_id=4
[INFO] DEBUG(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.840.962 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
mki_log log dir:/home/jenkins/atb/log exist
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.962 [stream.cc:276] 619016 CreateStreamTaskRes: Normal STREAM Setup stream_id=7 flags_=0x0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.969 [task_submit.cc:573] 619021 AllocTaskAndSendStars: device_id=4, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=1, task_type=72(HOSTFUNC_CALLBACK).
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.840.984 [stream.cc:1494] 619021 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.840.979 [stream.cc:1494] 619017 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=2.
[INFO] DEBUG(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.840.981 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.840.980 [stream.cc:688] 619016 Setup: stream setup end, stream_id=7, IsTaskSink=0, sqId=7, cqId=7, deviceId=1, streamResId=65534
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.840.995 [acl_resource_manager.cpp:814]619016 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.841.006 [acl_resource_manager.cpp:816]619016 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.840.998 [callback.cpp:109]619021 aclrtLaunchCallback: successfully execute aclrtLaunchCallback
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.841.004 [callback.cpp:97]619017 aclrtLaunchCallback: start to execute aclrtLaunchCallback.
[INFO] DEBUG(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.841.001 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.024 [task_res.cc:380] 619017 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=3, stream_id=2, taskResId=3, taskResHead_=0, taskResTail_=4.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.041 [task_info.cc:521] 619017 ConstructSqeForCallbackLaunchTask: CallbackLaunch,topic_type=4,stream_id=2,task_id=3,eventId=65535,isBlock=0,pid=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.841.035 [npu_driver.cc:3844] 618816 CqReportGet: cq report get start, device_id=4, tsId=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.054 [engine.cc:188] 619016 SubmitTaskNormal: stream_id=7,task_id=0,task_type=87 (GET_DEVICE_MSG).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.055 [stream.cc:1400] 619017 AddTaskToList: public task, stream_id=2, task_id=3, task_type=72 (HOSTFUNC_CALLBACK), head=0, tail=4
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.071 [npu_driver.cc:5547] 619016 GetSqHead: deviceId=1, tsId=0, sqId=7, head=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.841.059 [npu_driver.cc:3851] 618816 CqReportGet: halCqReportGet count=1
[INFO] PRE_ACT(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.841.075 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:704] GenerateAllocator] Generate allocator, is persistent : 0, stream id : 0.
[INFO] RUNTIME_FRAMEWORK(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.841.071 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.

----------------------------------------------------
- C++ Call Stack: (For framework developers)
----------------------------------------------------
mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.072 [stream.cc:2595] 619017 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=3, type=72(HOSTFUNC_CALLBACK), head=0, tail=4, sqe_num=1, lastTail=3, device_id=3
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.088 [task_info.cc:409] 619016 ConstructSqeForGetDevMsgTask: stream_id:7, task_id:0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.841.079 [api_impl.cc:5087] 618816 ProcessReport: report[0], sqid=12291, streamId=2, taskId=1, eventId=65535, isBlock=0
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.841.100 [callback.cpp:138]618816 aclrtProcessReport: successfully aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.088 [task_submit.cc:573] 619017 AllocTaskAndSendStars: device_id=3, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=3, task_type=72(HOSTFUNC_CALLBACK).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.103 [stream.cc:1494] 619017 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=3.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.841.114 [callback.cpp:109]619017 aclrtLaunchCallback: successfully execute aclrtLaunchCallback
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.099 [stream.cc:1400] 619016 AddTaskToList: public task, stream_id=7, task_id=0, task_type=87 (GET_DEVICE_MSG), head=0, tail=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.112 [stream.cc:2595] 619016 StarsAddTaskToStream: single-operator flow stream, stream_id=7, task_id=0, type=87(GET_DEVICE_MSG), head=0, tail=1, sqe_num=1, lastTail=0, device_id=1
[INFO] PRE_ACT(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.841.105 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:716] operator()] Malloc mem block, is enable eager free : 0, is enable vmm : 1, size : 512, block size : 1073741824.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.841.117 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] DEVICE(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.841.130 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.cc:204] AllocDeviceMem] VMM AllocDeviceMem size:61029220352, align_size:61029220352
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.841.131 [npu_driver.cc:3828] 618816 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=832.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.125 [npu_driver.cc:3844] 618774 CqReportGet: cq report get start, device_id=3, tsId=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.128 [npu_driver.cc:751] 619016 SqTaskSend: device_id=1, ts_id=0, sq_id=7, sqe_num=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.142 [stars_engine.cc:893] 619016 SendTask: Sq task send finished, device_id=1, ts_id=0, sq_id=7, cq_id=7, stream_id=7, task_id=0, task_type=87(GET_DEVICE_MSG).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.160 [npu_driver.cc:3851] 618774 CqReportGet: halCqReportGet count=1
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.841.148 [context.cpp:72]619015 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.154 [stream.cc:1494] 619016 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.169 [npu_driver.cc:5547] 619016 GetSqHead: deviceId=1, tsId=0, sqId=7, head=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.172 [api_impl.cc:5087] 618774 ProcessReport: report[0], sqid=12291, streamId=2, taskId=3, eventId=65535, isBlock=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.173 [api_impl.cc:3717] 619015 ContextSetCurrent: set context=aaaad9a630c0, flag=0.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.841.189 [context.cpp:80]619015 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.182 [task.cc:185] 619016 GetTask: this stream no taskRes, stream_id=7
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.841.191 [callback.cpp:138]618774 aclrtProcessReport: successfully aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.194 [task.cc:185] 619016 GetTask: this stream no taskRes, stream_id=7
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.206 [logger.cc:152] 619016 TaskFinished: device_id=1, stream_id=7, task_id=0, task_type=87 (GET_DEVICE_MSG), task_finish_num=7
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.841.208 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.841.216 [device.cpp:231]619017 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.209 [api_error.cc:1807] 619015 MemcpyAsyncCheckKindAndLocation: src pointer loc type=1, dst pointer loc type=2, kind=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.226 [npu_driver.cc:3828] 618774 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=64.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.239 [runtime.cc:5239] 619017 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.220 [stars_engine.cc:437] 619016 FinishedTaskReclaim: recycle task, stream_id=7, limited=0, taskHead=0, sqHead=1, endTaskId=0, recycleTaskId=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.227 [memory_task.cc:342] 619015 ConvertCpyType: MemcpyAsyncTask::ConvertCpyType MEMCPY_HOST_TO_DEVICE, direct=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.240 [memory_task.cc:473] 619015 MemcpyAsyncTaskInitV3: Init qos=0, partId=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.252 [memory_task.cc:518] 619015 MemcpyAsyncTaskInitV3: CopyType=0: use virtual address directly.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.841.255 [acl.cpp:802]619017 aclGetRecentErrMsg: start to execute aclGetRecentErrMsg.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.233 [stream.cc:2886] 619016 StarsWaitForTask: No.0 stream_id=7, taskId=0, currentId=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.257 [stream.cc:852] 619016 TearDown: stream_id=7, sqId=7, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.266 [task_res.cc:380] 619015 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=6, stream_id=2, taskResId=4, taskResHead_=0, taskResTail_=5.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.270 [stream.cc:938] 619016 TearDown: stream_id=7, delay recycle task num=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.282 [stream.cc:1507] 619016 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.281 [memory_task.cc:1007] 619015 ConstructPcieDmaSqe: stream_id=2, task_id=4, copyType=0, src=0xaaaae55889e0, dst=0x12c2c0000000, len=0x6c
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.295 [memory_task.cc:1166] 619015 ConstructSqeForMemcpyAsyncTask: MemcpyAsyncTask, stream_id=2, task_id=4, copyType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.286 [npu_driver.cc:404] 619017 StreamIdAlloc: stream id alloc begin, device_id=3, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.300 [stream_sqcq_manage.cc:451] 619016 FreeLogicCq: Return(0), threadIdentifier(281470043942816), devId(1), tsId(0), cqId(407), isFastCq(0).
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.307 [stream.cc:1400] 619015 AddTaskToList: public task, stream_id=2, task_id=4, task_type=5 (MEMCPY_ASYNC), head=0, tail=5
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.318 [npu_driver.cc:6163] 619016 StreamUnBindLogicCq: success: deviceId=1, tsId=0, streamId=7, logicCq=407.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.316 [stream.cc:2246] 619017 AllocExecutedTimesSvm: stream_id=7.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.320 [stream.cc:2595] 619015 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=4, type=5(MEMCPY_ASYNC), head=0, tail=5, sqe_num=1, lastTail=4, device_id=6
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.346 [npu_driver.cc:1180] 619016 LogicCqFree: Succ:device_id=1,ts_id=0,type=2,logic_cq_id=407, drvFlag=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.348 [task_submit.cc:573] 619015 AllocTaskAndSendStars: device_id=6, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=4, task_type=5(MEMCPY_ASYNC).
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.361 [stream.cc:237] 619016 FreeStreamId: Free stream_id=7.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.357 [stream_sqcq_manage.cc:147] 619017 Alloc: deviceId=3, tsId=0, drvFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.365 [stream.cc:1494] 619015 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=4.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.841.383 [callback.cpp:97]619015 aclrtLaunchCallback: start to execute aclrtLaunchCallback.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.374 [stream_sqcq_manage.cc:216] 619016 DeAllocStreamSqCq: deviceId=1, tsId=0, drvFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.385 [npu_driver.cc:966] 619016 NormalSqCqFree: Normal sqcq free, sqId=7, cqId=7, device_id=1, tsId=0, drvFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.374 [npu_driver.cc:882] 619017 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.400 [task_res.cc:380] 619015 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=6, stream_id=2, taskResId=5, taskResHead_=0, taskResTail_=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.416 [task_info.cc:521] 619015 ConstructSqeForCallbackLaunchTask: CallbackLaunch,topic_type=4,stream_id=2,task_id=5,eventId=65535,isBlock=0,pid=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.431 [stream.cc:1400] 619015 AddTaskToList: public task, stream_id=2, task_id=5, task_type=72 (HOSTFUNC_CALLBACK), head=0, tail=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.445 [stream.cc:2595] 619015 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=5, type=72(HOSTFUNC_CALLBACK), head=0, tail=6, sqe_num=1, lastTail=5, device_id=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.463 [task_submit.cc:573] 619015 AllocTaskAndSendStars: device_id=6, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=5, task_type=72(HOSTFUNC_CALLBACK).
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.480 [stream.cc:1494] 619015 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=5.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.841.493 [callback.cpp:109]619015 aclrtLaunchCallback: successfully execute aclrtLaunchCallback
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.498 [npu_driver.cc:3844] 618822 CqReportGet: cq report get start, device_id=6, tsId=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.841.473 [api_impl.cc:7115] 619020 ReserveMemAddress: device malloc Succ, size=61022928896(bytes) start ptr=0x12d100000000, end ptr=0x12df35400000
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.515 [npu_driver.cc:3851] 618822 CqReportGet: halCqReportGet count=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.527 [api_impl.cc:5087] 618822 ProcessReport: report[0], sqid=12291, streamId=2, taskId=5, eventId=65535, isBlock=0
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.841.545 [callback.cpp:138]618822 aclrtProcessReport: successfully aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.841.561 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.841.564 [device.cpp:231]619015 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.566 [npu_driver.cc:6125] 619017 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.575 [npu_driver.cc:3828] 618822 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=64.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.584 [runtime.cc:5239] 619015 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.841.595 [device.cpp:231]619018 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.841.601 [acl.cpp:802]619015 aclGetRecentErrMsg: start to execute aclGetRecentErrMsg.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.609 [npu_driver.cc:6137] 619017 LogicCqAllocateV2: success: deviceId=3, tsId=0, cqId=1045, streamId=7, logicCq=1045, cqeDepth=4096
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.841.617 [runtime.cc:5239] 619018 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.841.633 [acl.cpp:802]619018 aclGetRecentErrMsg: start to execute aclGetRecentErrMsg.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.631 [npu_driver.cc:6189] 619017 StreamBindLogicCq: success: deviceId=3, tsId=0, streamId=7, logicCq=1045.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.631 [npu_driver.cc:404] 619015 StreamIdAlloc: stream id alloc begin, device_id=6, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.649 [npu_driver.cc:5916] 619017 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=ec007000, addr=dfffec007000size=4096
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.667 [stream.cc:653] 619017 Setup: Success to get sq=7 sq reg virtual addr length=4096.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.657 [stream.cc:2246] 619015 AllocExecutedTimesSvm: stream_id=8.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.694 [stream_sqcq_manage.cc:147] 619015 Alloc: deviceId=6, tsId=0, drvFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.711 [npu_driver.cc:882] 619015 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.707 [stream.cc:276] 619017 CreateStreamTaskRes: Normal STREAM Setup stream_id=7 flags_=0x0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.723 [stream.cc:688] 619017 Setup: stream setup end, stream_id=7, IsTaskSink=0, sqId=7, cqId=7, deviceId=3, streamResId=65534
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.841.735 [npu_driver.cc:404] 619018 StreamIdAlloc: stream id alloc begin, device_id=5, priority=0, ts_id=0, remote_stream_id=0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.841.742 [acl_resource_manager.cpp:814]619017 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.841.758 [acl_resource_manager.cpp:816]619017 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.841.773 [stream.cc:2246] 619018 AllocExecutedTimesSvm: stream_id=6.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.841.806 [stream_sqcq_manage.cc:147] 619018 Alloc: deviceId=5, tsId=0, drvFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.807 [engine.cc:188] 619017 SubmitTaskNormal: stream_id=7,task_id=0,task_type=87 (GET_DEVICE_MSG).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.841.820 [npu_driver.cc:882] 619018 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.827 [npu_driver.cc:5547] 619017 GetSqHead: deviceId=3, tsId=0, sqId=7, head=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.844 [task_info.cc:409] 619017 ConstructSqeForGetDevMsgTask: stream_id:7, task_id:0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.860 [stream.cc:1400] 619017 AddTaskToList: public task, stream_id=7, task_id=0, task_type=87 (GET_DEVICE_MSG), head=0, tail=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.880 [npu_driver.cc:974] 619016 NormalSqCqFree: Normal sqcq free success, sqId=7, cqId=7, device_id=1, tsId=0, drvFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.873 [stream.cc:2595] 619017 StarsAddTaskToStream: single-operator flow stream, stream_id=7, task_id=0, type=87(GET_DEVICE_MSG), head=0, tail=1, sqe_num=1, lastTail=0, device_id=3
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.898 [stream_sqcq_manage.cc:228] 619016 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=7, cq_id=7, stream_id=7, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.905 [npu_driver.cc:751] 619017 SqTaskSend: device_id=3, ts_id=0, sq_id=7, sqe_num=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.910 [npu_driver.cc:432] 619016 StreamIdFree: stream id free begin, device_id=1, stream_id=7, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.926 [npu_driver.cc:441] 619016 StreamIdFree: Stream id free success, stream_id=7, device_id=1, tsId=0, streamFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.920 [stars_engine.cc:893] 619017 SendTask: Sq task send finished, device_id=3, ts_id=0, sq_id=7, cq_id=7, stream_id=7, task_id=0, task_type=87(GET_DEVICE_MSG).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.935 [stream.cc:1494] 619017 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.940 [device_msg_handler.cc:110] 619016 HandleMsg: Begin to process device errMessage.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.948 [npu_driver.cc:5547] 619017 GetSqHead: deviceId=3, tsId=0, sqId=7, head=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.949 [npu_driver.cc:6125] 619015 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.962 [task.cc:185] 619017 GetTask: this stream no taskRes, stream_id=7
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.976 [task.cc:185] 619017 GetTask: this stream no taskRes, stream_id=7
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.841.988 [logger.cc:152] 619017 TaskFinished: device_id=3, stream_id=7, task_id=0, task_type=87 (GET_DEVICE_MSG), task_finish_num=7
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.841.990 [npu_driver.cc:6137] 619015 LogicCqAllocateV2: success: deviceId=6, tsId=0, cqId=304, streamId=8, logicCq=304, cqeDepth=4096
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.842.007 [stars_engine.cc:437] 619017 FinishedTaskReclaim: recycle task, stream_id=7, limited=0, taskHead=0, sqHead=1, endTaskId=0, recycleTaskId=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.842.023 [stream.cc:2886] 619017 StarsWaitForTask: No.0 stream_id=7, taskId=0, currentId=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.842.018 [npu_driver.cc:6189] 619015 StreamBindLogicCq: success: deviceId=6, tsId=0, streamId=8, logicCq=304.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.842.036 [stream.cc:852] 619017 TearDown: stream_id=7, sqId=7, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.842.051 [stream.cc:938] 619017 TearDown: stream_id=7, delay recycle task num=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.842.036 [npu_driver.cc:5916] 619015 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=c8060000, addr=dfffc8060000size=4096
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.842.053 [stream.cc:653] 619015 Setup: Success to get sq=8 sq reg virtual addr length=4096.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.842.063 [stream.cc:1507] 619017 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.842.084 [stream_sqcq_manage.cc:451] 619017 FreeLogicCq: Return(0), threadIdentifier(281469725306784), devId(3), tsId(0), cqId(1045), isFastCq(0).
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.842.088 [stream.cc:276] 619015 CreateStreamTaskRes: Normal STREAM Setup stream_id=8 flags_=0x0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.842.103 [stream.cc:688] 619015 Setup: stream setup end, stream_id=8, IsTaskSink=0, sqId=8, cqId=8, deviceId=6, streamResId=65534
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.842.104 [npu_driver.cc:6163] 619017 StreamUnBindLogicCq: success: deviceId=3, tsId=0, streamId=7, logicCq=1045.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.842.118 [acl_resource_manager.cpp:814]619015 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.842.133 [acl_resource_manager.cpp:816]619015 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.842.132 [npu_driver.cc:1180] 619017 LogicCqFree: Succ:device_id=3,ts_id=0,type=2,logic_cq_id=1045, drvFlag=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.842.148 [stream.cc:237] 619017 FreeStreamId: Free stream_id=7.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.842.162 [stream_sqcq_manage.cc:216] 619017 DeAllocStreamSqCq: deviceId=3, tsId=0, drvFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.842.177 [npu_driver.cc:966] 619017 NormalSqCqFree: Normal sqcq free, sqId=7, cqId=7, device_id=3, tsId=0, drvFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.842.177 [engine.cc:188] 619015 SubmitTaskNormal: stream_id=8,task_id=0,task_type=87 (GET_DEVICE_MSG).
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.842.195 [npu_driver.cc:5547] 619015 GetSqHead: deviceId=6, tsId=0, sqId=8, head=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.842.213 [task_info.cc:409] 619015 ConstructSqeForGetDevMsgTask: stream_id:8, task_id:0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.842.224 [stream.cc:1400] 619015 AddTaskToList: public task, stream_id=8, task_id=0, task_type=87 (GET_DEVICE_MSG), head=0, tail=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.842.239 [stream.cc:2595] 619015 StarsAddTaskToStream: single-operator flow stream, stream_id=8, task_id=0, type=87(GET_DEVICE_MSG), head=0, tail=1, sqe_num=1, lastTail=0, device_id=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.842.259 [npu_driver.cc:751] 619015 SqTaskSend: device_id=6, ts_id=0, sq_id=8, sqe_num=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.279 [npu_driver.cc:6125] 619018 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.842.275 [stars_engine.cc:893] 619015 SendTask: Sq task send finished, device_id=6, ts_id=0, sq_id=8, cq_id=8, stream_id=8, task_id=0, task_type=87(GET_DEVICE_MSG).
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.842.292 [stream.cc:1494] 619015 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.842.306 [npu_driver.cc:5547] 619015 GetSqHead: deviceId=6, tsId=0, sqId=8, head=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.842.319 [task.cc:185] 619015 GetTask: this stream no taskRes, stream_id=8
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.842.334 [task.cc:185] 619015 GetTask: this stream no taskRes, stream_id=8
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.333 [npu_driver.cc:6137] 619018 LogicCqAllocateV2: success: deviceId=5, tsId=0, cqId=363, streamId=6, logicCq=363, cqeDepth=4096
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.842.345 [logger.cc:152] 619015 TaskFinished: device_id=6, stream_id=8, task_id=0, task_type=87 (GET_DEVICE_MSG), task_finish_num=8
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.842.359 [device_msg_handler.cc:127] 619016 HandleMsg: Finished to process device errInfo, retCode=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.364 [npu_driver.cc:6189] 619018 StreamBindLogicCq: success: deviceId=5, tsId=0, streamId=6, logicCq=363.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.842.364 [stars_engine.cc:437] 619015 FinishedTaskReclaim: recycle task, stream_id=8, limited=0, taskHead=0, sqHead=1, endTaskId=0, recycleTaskId=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.842.380 [stream.cc:2886] 619015 StarsWaitForTask: No.0 stream_id=8, taskId=0, currentId=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.384 [npu_driver.cc:5916] 619018 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=e059a000, addr=dfffe059a000size=4096
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.842.395 [stream.cc:852] 619015 TearDown: stream_id=8, sqId=8, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.399 [stream.cc:653] 619018 Setup: Success to get sq=6 sq reg virtual addr length=4096.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.842.390 [runtime.cc:5239] 619016 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.842.409 [stream.cc:938] 619015 TearDown: stream_id=8, delay recycle task num=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.842.411 [npu_driver.cc:500] 619016 GetFaultEvent: get fault event, device_id=1, filterFlag=8, outputLen=128.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.842.422 [stream.cc:1507] 619015 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.842.420 [api_impl.cc:7115] 619021 ReserveMemAddress: device malloc Succ, size=61029220352(bytes) start ptr=0x12d100000000, end ptr=0x12df35a00000
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.443 [stream.cc:276] 619018 CreateStreamTaskRes: Normal STREAM Setup stream_id=6 flags_=0x0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.842.442 [stream_sqcq_manage.cc:451] 619015 FreeLogicCq: Return(0), threadIdentifier(281469708398496), devId(6), tsId(0), cqId(304), isFastCq(0).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.460 [stream.cc:688] 619018 Setup: stream setup end, stream_id=6, IsTaskSink=0, sqId=6, cqId=6, deviceId=5, streamResId=65534
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.842.467 [acl.cpp:782]619016 GetFaultEventInfo: can not get fault event of device 1, runtime errorCode is 0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.842.472 [npu_driver.cc:6163] 619015 StreamUnBindLogicCq: success: deviceId=6, tsId=0, streamId=8, logicCq=304.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.842.477 [acl_resource_manager.cpp:814]619018 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] GE(618650,python3.9):2025-04-03-09:27:47.842.483 [error_manager.cc:989]619016 GetRawErrorMessages:current work_stream_id:0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.842.493 [acl_resource_manager.cpp:816]619018 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.842.501 [npu_driver.cc:1180] 619015 LogicCqFree: Succ:device_id=6,ts_id=0,type=2,logic_cq_id=304, drvFlag=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.842.519 [stream.cc:237] 619015 FreeStreamId: Free stream_id=8.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.842.532 [stream_sqcq_manage.cc:216] 619015 DeAllocStreamSqCq: deviceId=6, tsId=0, drvFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.842.546 [npu_driver.cc:966] 619015 NormalSqCqFree: Normal sqcq free, sqId=8, cqId=8, device_id=6, tsId=0, drvFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.842.619 [npu_driver.cc:974] 619017 NormalSqCqFree: Normal sqcq free success, sqId=7, cqId=7, device_id=3, tsId=0, drvFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.637 [engine.cc:188] 619018 SubmitTaskNormal: stream_id=6,task_id=0,task_type=87 (GET_DEVICE_MSG).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.842.637 [stream_sqcq_manage.cc:228] 619017 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=7, cq_id=7, stream_id=7, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.842.656 [npu_driver.cc:432] 619017 StreamIdFree: stream id free begin, device_id=3, stream_id=7, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.656 [npu_driver.cc:5547] 619018 GetSqHead: deviceId=5, tsId=0, sqId=6, head=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.674 [task_info.cc:409] 619018 ConstructSqeForGetDevMsgTask: stream_id:6, task_id:0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.842.673 [npu_driver.cc:441] 619017 StreamIdFree: Stream id free success, stream_id=7, device_id=3, tsId=0, streamFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.686 [stream.cc:1400] 619018 AddTaskToList: public task, stream_id=6, task_id=0, task_type=87 (GET_DEVICE_MSG), head=0, tail=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.842.691 [device_msg_handler.cc:110] 619017 HandleMsg: Begin to process device errMessage.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.699 [stream.cc:2595] 619018 StarsAddTaskToStream: single-operator flow stream, stream_id=6, task_id=0, type=87(GET_DEVICE_MSG), head=0, tail=1, sqe_num=1, lastTail=0, device_id=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.715 [npu_driver.cc:751] 619018 SqTaskSend: device_id=5, ts_id=0, sq_id=6, sqe_num=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.727 [stars_engine.cc:893] 619018 SendTask: Sq task send finished, device_id=5, ts_id=0, sq_id=6, cq_id=6, stream_id=6, task_id=0, task_type=87(GET_DEVICE_MSG).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.741 [stream.cc:1494] 619018 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.755 [npu_driver.cc:5547] 619018 GetSqHead: deviceId=5, tsId=0, sqId=6, head=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.769 [stream.cc:2886] 619018 StarsWaitForTask: No.0 stream_id=6, taskId=0, currentId=65535
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.781 [npu_driver.cc:5547] 619018 GetSqHead: deviceId=5, tsId=0, sqId=6, head=1.
[CRITICAL] KERNEL(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.842.779 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.797 [task.cc:185] 619018 GetTask: this stream no taskRes, stream_id=6
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.810 [task.cc:185] 619018 GetTask: this stream no taskRes, stream_id=6
[INFO] DEBUG(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.842.813 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.821 [logger.cc:152] 619018 TaskFinished: device_id=5, stream_id=6, task_id=0, task_type=87 (GET_DEVICE_MSG), task_finish_num=6
[INFO] DEBUG(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.842.834 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.839 [stars_engine.cc:437] 619018 FinishedTaskReclaim: recycle task, stream_id=6, limited=0, taskHead=0, sqHead=1, endTaskId=0, recycleTaskId=0.
[INFO] DEBUG(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.842.849 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.853 [stream.cc:2886] 619018 StarsWaitForTask: No.1 stream_id=6, taskId=0, currentId=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.866 [stream.cc:852] 619018 TearDown: stream_id=6, sqId=6, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.879 [stream.cc:938] 619018 TearDown: stream_id=6, delay recycle task num=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.897 [stream.cc:1507] 619018 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.922 [stream_sqcq_manage.cc:451] 619018 FreeLogicCq: Return(0), threadIdentifier(281469355945888), devId(5), tsId(0), cqId(363), isFastCq(0).
[INFO] RUNTIME_FRAMEWORK(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.842.918 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.

----------------------------------------------------
- C++ Call Stack: (For framework developers)
----------------------------------------------------
mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.943 [npu_driver.cc:6163] 619018 StreamUnBindLogicCq: success: deviceId=5, tsId=0, streamId=6, logicCq=363.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.979 [npu_driver.cc:1180] 619018 LogicCqFree: Succ:device_id=5,ts_id=0,type=2,logic_cq_id=363, drvFlag=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.842.992 [stream.cc:237] 619018 FreeStreamId: Free stream_id=6.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.843.004 [stream_sqcq_manage.cc:216] 619018 DeAllocStreamSqCq: deviceId=5, tsId=0, drvFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.843.015 [npu_driver.cc:966] 619018 NormalSqCqFree: Normal sqcq free, sqId=6, cqId=6, device_id=5, tsId=0, drvFlag=0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.843.013 [context.cpp:72]619016 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.034 [api_impl.cc:3717] 619016 ContextSetCurrent: set context=aaab312ab590, flag=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.843.026 [npu_driver.cc:974] 619015 NormalSqCqFree: Normal sqcq free success, sqId=8, cqId=8, device_id=6, tsId=0, drvFlag=0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.843.047 [context.cpp:80]619016 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.843.045 [stream_sqcq_manage.cc:228] 619015 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=8, cq_id=8, stream_id=8, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.843.060 [npu_driver.cc:432] 619015 StreamIdFree: stream id free begin, device_id=6, stream_id=8, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.065 [api_error.cc:1807] 619016 MemcpyAsyncCheckKindAndLocation: src pointer loc type=1, dst pointer loc type=2, kind=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.843.067 [device_msg_handler.cc:127] 619017 HandleMsg: Finished to process device errInfo, retCode=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.082 [memory_task.cc:342] 619016 ConvertCpyType: MemcpyAsyncTask::ConvertCpyType MEMCPY_HOST_TO_DEVICE, direct=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.843.077 [npu_driver.cc:441] 619015 StreamIdFree: Stream id free success, stream_id=8, device_id=6, tsId=0, streamFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.094 [memory_task.cc:473] 619016 MemcpyAsyncTaskInitV3: Init qos=0, partId=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.105 [memory_task.cc:518] 619016 MemcpyAsyncTaskInitV3: CopyType=0: use virtual address directly.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.843.095 [device_msg_handler.cc:110] 619015 HandleMsg: Begin to process device errMessage.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.843.100 [runtime.cc:5239] 619017 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.122 [task_res.cc:380] 619016 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=1, stream_id=2, taskResId=4, taskResHead_=0, taskResTail_=5.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.137 [memory_task.cc:1007] 619016 ConstructPcieDmaSqe: stream_id=2, task_id=4, copyType=0, src=0xaaab3ceb77b0, dst=0x12c2c0000000, len=0x6c
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.843.132 [npu_driver.cc:500] 619017 GetFaultEvent: get fault event, device_id=3, filterFlag=8, outputLen=128.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.152 [memory_task.cc:1166] 619016 ConstructSqeForMemcpyAsyncTask: MemcpyAsyncTask, stream_id=2, task_id=4, copyType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.164 [stream.cc:1400] 619016 AddTaskToList: public task, stream_id=2, task_id=4, task_type=5 (MEMCPY_ASYNC), head=0, tail=5
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.175 [stream.cc:2595] 619016 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=4, type=5(MEMCPY_ASYNC), head=0, tail=5, sqe_num=1, lastTail=4, device_id=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.190 [task_submit.cc:573] 619016 AllocTaskAndSendStars: device_id=1, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=4, task_type=5(MEMCPY_ASYNC).
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.202 [stream.cc:1494] 619016 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=4.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.843.189 [acl.cpp:782]619017 GetFaultEventInfo: can not get fault event of device 3, runtime errorCode is 0
[INFO] GE(618658,python3.9):2025-04-03-09:27:47.843.209 [error_manager.cc:989]619017 GetRawErrorMessages:current work_stream_id:0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.843.218 [callback.cpp:97]619016 aclrtLaunchCallback: start to execute aclrtLaunchCallback.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.237 [task_res.cc:380] 619016 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=1, stream_id=2, taskResId=5, taskResHead_=0, taskResTail_=6.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.251 [task_info.cc:521] 619016 ConstructSqeForCallbackLaunchTask: CallbackLaunch,topic_type=4,stream_id=2,task_id=5,eventId=65535,isBlock=0,pid=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.264 [stream.cc:1400] 619016 AddTaskToList: public task, stream_id=2, task_id=5, task_type=72 (HOSTFUNC_CALLBACK), head=0, tail=6
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.276 [stream.cc:2595] 619016 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=5, type=72(HOSTFUNC_CALLBACK), head=0, tail=6, sqe_num=1, lastTail=5, device_id=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.291 [task_submit.cc:573] 619016 AllocTaskAndSendStars: device_id=1, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=5, task_type=72(HOSTFUNC_CALLBACK).
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.303 [stream.cc:1494] 619016 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=5.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.843.313 [callback.cpp:109]619016 aclrtLaunchCallback: successfully execute aclrtLaunchCallback
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.333 [npu_driver.cc:3844] 618828 CqReportGet: cq report get start, device_id=1, tsId=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.361 [npu_driver.cc:3851] 618828 CqReportGet: halCqReportGet count=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.373 [api_impl.cc:5087] 618828 ProcessReport: report[0], sqid=12291, streamId=2, taskId=5, eventId=65535, isBlock=0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.843.388 [device.cpp:231]619016 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.843.391 [callback.cpp:138]618828 aclrtProcessReport: successfully aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.412 [runtime.cc:5239] 619016 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.843.422 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.843.433 [acl.cpp:802]619016 aclGetRecentErrMsg: start to execute aclGetRecentErrMsg.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.446 [npu_driver.cc:3828] 618828 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=320.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.471 [npu_driver.cc:404] 619016 StreamIdAlloc: stream id alloc begin, device_id=1, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.843.471 [device_msg_handler.cc:127] 619015 HandleMsg: Finished to process device errInfo, retCode=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.502 [stream.cc:2246] 619016 AllocExecutedTimesSvm: stream_id=8.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.843.504 [runtime.cc:5239] 619015 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[CRITICAL] KERNEL(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.843.508 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.843.526 [npu_driver.cc:500] 619015 GetFaultEvent: get fault event, device_id=6, filterFlag=8, outputLen=128.
[INFO] DEBUG(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.843.542 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.843.540 [npu_driver.cc:974] 619018 NormalSqCqFree: Normal sqcq free success, sqId=6, cqId=6, device_id=5, tsId=0, drvFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.540 [stream_sqcq_manage.cc:147] 619016 Alloc: deviceId=1, tsId=0, drvFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.843.559 [stream_sqcq_manage.cc:228] 619018 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=6, cq_id=6, stream_id=6, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.558 [npu_driver.cc:882] 619016 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] DEBUG(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.843.562 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.843.577 [npu_driver.cc:432] 619018 StreamIdFree: stream id free begin, device_id=5, stream_id=6, ts_id=0, remote_stream_id=0
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.843.579 [acl.cpp:782]619015 GetFaultEventInfo: can not get fault event of device 6, runtime errorCode is 0
[INFO] GE(618670,python3.9):2025-04-03-09:27:47.843.597 [error_manager.cc:989]619015 GetRawErrorMessages:current work_stream_id:0
[INFO] DEBUG(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.843.579 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.843.593 [npu_driver.cc:441] 619018 StreamIdFree: Stream id free success, stream_id=6, device_id=5, tsId=0, streamFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.843.607 [device_msg_handler.cc:110] 619018 HandleMsg: Begin to process device errMessage.
[INFO] RUNTIME_FRAMEWORK(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.843.652 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.

----------------------------------------------------
- C++ Call Stack: (For framework developers)
----------------------------------------------------
mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.843.744 [context.cpp:72]619017 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.843.765 [api_impl.cc:3717] 619017 ContextSetCurrent: set context=aaab0b9e09a0, flag=0.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.843.783 [context.cpp:80]619017 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.843.805 [api_error.cc:1807] 619017 MemcpyAsyncCheckKindAndLocation: src pointer loc type=1, dst pointer loc type=2, kind=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.813 [npu_driver.cc:6125] 619016 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.843.823 [memory_task.cc:342] 619017 ConvertCpyType: MemcpyAsyncTask::ConvertCpyType MEMCPY_HOST_TO_DEVICE, direct=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.843.839 [memory_task.cc:473] 619017 MemcpyAsyncTaskInitV3: Init qos=0, partId=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.843.850 [memory_task.cc:518] 619017 MemcpyAsyncTaskInitV3: CopyType=0: use virtual address directly.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.858 [npu_driver.cc:6137] 619016 LogicCqAllocateV2: success: deviceId=1, tsId=0, cqId=408, streamId=8, logicCq=408, cqeDepth=4096
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.843.863 [task_res.cc:380] 619017 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=3, stream_id=2, taskResId=4, taskResHead_=0, taskResTail_=5.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.877 [npu_driver.cc:6189] 619016 StreamBindLogicCq: success: deviceId=1, tsId=0, streamId=8, logicCq=408.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.843.881 [memory_task.cc:1007] 619017 ConstructPcieDmaSqe: stream_id=2, task_id=4, copyType=0, src=0xaaab166c7290, dst=0x12c2c0000000, len=0x6c
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.843.895 [memory_task.cc:1166] 619017 ConstructSqeForMemcpyAsyncTask: MemcpyAsyncTask, stream_id=2, task_id=4, copyType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.891 [npu_driver.cc:5916] 619016 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=d43a6000, addr=dfffd43a6000size=4096
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.903 [stream.cc:653] 619016 Setup: Success to get sq=8 sq reg virtual addr length=4096.
[CRITICAL] KERNEL(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.843.894 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.843.907 [stream.cc:1400] 619017 AddTaskToList: public task, stream_id=2, task_id=4, task_type=5 (MEMCPY_ASYNC), head=0, tail=5
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.843.921 [stream.cc:2595] 619017 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=4, type=5(MEMCPY_ASYNC), head=0, tail=5, sqe_num=1, lastTail=4, device_id=3
[INFO] DEBUG(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.843.925 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.940 [stream.cc:276] 619016 CreateStreamTaskRes: Normal STREAM Setup stream_id=8 flags_=0x0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.843.938 [task_submit.cc:573] 619017 AllocTaskAndSendStars: device_id=3, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=4, task_type=5(MEMCPY_ASYNC).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.843.955 [stream.cc:1494] 619017 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=4.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.843.957 [stream.cc:688] 619016 Setup: stream setup end, stream_id=8, IsTaskSink=0, sqId=8, cqId=8, deviceId=1, streamResId=65534
[INFO] DEBUG(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.843.947 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
[INFO] DEBUG(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.843.964 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.843.971 [acl_resource_manager.cpp:814]619016 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.843.982 [acl_resource_manager.cpp:816]619016 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.843.973 [callback.cpp:97]619017 aclrtLaunchCallback: start to execute aclrtLaunchCallback.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.006 [task_res.cc:380] 619017 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=3, stream_id=2, taskResId=5, taskResHead_=0, taskResTail_=6.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.023 [engine.cc:188] 619016 SubmitTaskNormal: stream_id=8,task_id=0,task_type=87 (GET_DEVICE_MSG).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.024 [task_info.cc:521] 619017 ConstructSqeForCallbackLaunchTask: CallbackLaunch,topic_type=4,stream_id=2,task_id=5,eventId=65535,isBlock=0,pid=0
[INFO] RUNTIME_FRAMEWORK(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.844.028 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.

----------------------------------------------------
- C++ Call Stack: (For framework developers)
----------------------------------------------------
mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.042 [npu_driver.cc:5547] 619016 GetSqHead: deviceId=1, tsId=0, sqId=8, head=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.041 [stream.cc:1400] 619017 AddTaskToList: public task, stream_id=2, task_id=5, task_type=72 (HOSTFUNC_CALLBACK), head=0, tail=6
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.056 [stream.cc:2595] 619017 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=5, type=72(HOSTFUNC_CALLBACK), head=0, tail=6, sqe_num=1, lastTail=5, device_id=3
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.056 [task_info.cc:409] 619016 ConstructSqeForGetDevMsgTask: stream_id:8, task_id:0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.067 [stream.cc:1400] 619016 AddTaskToList: public task, stream_id=8, task_id=0, task_type=87 (GET_DEVICE_MSG), head=0, tail=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.071 [task_submit.cc:573] 619017 AllocTaskAndSendStars: device_id=3, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=5, task_type=72(HOSTFUNC_CALLBACK).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.085 [stream.cc:1494] 619017 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=5.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.844.097 [callback.cpp:109]619017 aclrtLaunchCallback: successfully execute aclrtLaunchCallback
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.079 [stream.cc:2595] 619016 StarsAddTaskToStream: single-operator flow stream, stream_id=8, task_id=0, type=87(GET_DEVICE_MSG), head=0, tail=1, sqe_num=1, lastTail=0, device_id=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.109 [npu_driver.cc:751] 619016 SqTaskSend: device_id=1, ts_id=0, sq_id=8, sqe_num=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.120 [stars_engine.cc:893] 619016 SendTask: Sq task send finished, device_id=1, ts_id=0, sq_id=8, cq_id=8, stream_id=8, task_id=0, task_type=87(GET_DEVICE_MSG).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.110 [npu_driver.cc:3844] 618774 CqReportGet: cq report get start, device_id=3, tsId=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.131 [npu_driver.cc:3851] 618774 CqReportGet: halCqReportGet count=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.135 [stream.cc:1494] 619016 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.149 [npu_driver.cc:5547] 619016 GetSqHead: deviceId=1, tsId=0, sqId=8, head=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.147 [api_impl.cc:5087] 618774 ProcessReport: report[0], sqid=12291, streamId=2, taskId=5, eventId=65535, isBlock=0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.844.179 [callback.cpp:138]618774 aclrtProcessReport: successfully aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.180 [task.cc:185] 619016 GetTask: this stream no taskRes, stream_id=8
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.844.178 [device.cpp:231]619017 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.192 [task.cc:185] 619016 GetTask: this stream no taskRes, stream_id=8
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.204 [logger.cc:152] 619016 TaskFinished: device_id=1, stream_id=8, task_id=0, task_type=87 (GET_DEVICE_MSG), task_finish_num=8
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.844.198 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.209 [runtime.cc:5239] 619017 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.220 [stars_engine.cc:437] 619016 FinishedTaskReclaim: recycle task, stream_id=8, limited=0, taskHead=0, sqHead=1, endTaskId=0, recycleTaskId=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.220 [npu_driver.cc:3828] 618774 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=64.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.844.227 [acl.cpp:802]619017 aclGetRecentErrMsg: start to execute aclGetRecentErrMsg.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.232 [stream.cc:2886] 619016 StarsWaitForTask: No.0 stream_id=8, taskId=0, currentId=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.246 [stream.cc:852] 619016 TearDown: stream_id=8, sqId=8, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.258 [stream.cc:938] 619016 TearDown: stream_id=8, delay recycle task num=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.268 [stream.cc:1507] 619016 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.265 [npu_driver.cc:404] 619017 StreamIdAlloc: stream id alloc begin, device_id=3, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.287 [stream_sqcq_manage.cc:451] 619016 FreeLogicCq: Return(0), threadIdentifier(281470043942816), devId(1), tsId(0), cqId(408), isFastCq(0).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.295 [stream.cc:2246] 619017 AllocExecutedTimesSvm: stream_id=8.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.306 [npu_driver.cc:6163] 619016 StreamUnBindLogicCq: success: deviceId=1, tsId=0, streamId=8, logicCq=408.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.332 [npu_driver.cc:1180] 619016 LogicCqFree: Succ:device_id=1,ts_id=0,type=2,logic_cq_id=408, drvFlag=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.333 [stream_sqcq_manage.cc:147] 619017 Alloc: deviceId=3, tsId=0, drvFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.351 [npu_driver.cc:882] 619017 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.346 [stream.cc:237] 619016 FreeStreamId: Free stream_id=8.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.844.331 [device_msg_handler.cc:127] 619018 HandleMsg: Finished to process device errInfo, retCode=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.359 [stream_sqcq_manage.cc:216] 619016 DeAllocStreamSqCq: deviceId=1, tsId=0, drvFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.371 [npu_driver.cc:966] 619016 NormalSqCqFree: Normal sqcq free, sqId=8, cqId=8, device_id=1, tsId=0, drvFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.844.389 [runtime.cc:5239] 619018 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.844.424 [npu_driver.cc:500] 619018 GetFaultEvent: get fault event, device_id=5, filterFlag=8, outputLen=128.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.844.493 [acl.cpp:782]619018 GetFaultEventInfo: can not get fault event of device 5, runtime errorCode is 0
[INFO] GE(618666,python3.9):2025-04-03-09:27:47.844.516 [error_manager.cc:989]619018 GetRawErrorMessages:current work_stream_id:0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.544 [npu_driver.cc:6125] 619017 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.585 [npu_driver.cc:6137] 619017 LogicCqAllocateV2: success: deviceId=3, tsId=0, cqId=1046, streamId=8, logicCq=1046, cqeDepth=4096
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.607 [npu_driver.cc:6189] 619017 StreamBindLogicCq: success: deviceId=3, tsId=0, streamId=8, logicCq=1046.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.624 [npu_driver.cc:5916] 619017 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=ec007000, addr=dfffec007000size=4096
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.640 [stream.cc:653] 619017 Setup: Success to get sq=8 sq reg virtual addr length=4096.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.695 [stream.cc:276] 619017 CreateStreamTaskRes: Normal STREAM Setup stream_id=8 flags_=0x0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.712 [stream.cc:688] 619017 Setup: stream setup end, stream_id=8, IsTaskSink=0, sqId=8, cqId=8, deviceId=3, streamResId=65534
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.844.731 [acl_resource_manager.cpp:814]619017 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.844.745 [acl_resource_manager.cpp:816]619017 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.789 [engine.cc:188] 619017 SubmitTaskNormal: stream_id=8,task_id=0,task_type=87 (GET_DEVICE_MSG).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.808 [npu_driver.cc:5547] 619017 GetSqHead: deviceId=3, tsId=0, sqId=8, head=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.825 [task_info.cc:409] 619017 ConstructSqeForGetDevMsgTask: stream_id:8, task_id:0.
[CRITICAL] KERNEL(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.844.837 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.840 [stream.cc:1400] 619017 AddTaskToList: public task, stream_id=8, task_id=0, task_type=87 (GET_DEVICE_MSG), head=0, tail=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.846 [npu_driver.cc:974] 619016 NormalSqCqFree: Normal sqcq free success, sqId=8, cqId=8, device_id=1, tsId=0, drvFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.862 [stream_sqcq_manage.cc:228] 619016 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=8, cq_id=8, stream_id=8, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.857 [stream.cc:2595] 619017 StarsAddTaskToStream: single-operator flow stream, stream_id=8, task_id=0, type=87(GET_DEVICE_MSG), head=0, tail=1, sqe_num=1, lastTail=0, device_id=3
[INFO] DEBUG(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.844.876 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.876 [npu_driver.cc:432] 619016 StreamIdFree: stream id free begin, device_id=1, stream_id=8, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.876 [npu_driver.cc:751] 619017 SqTaskSend: device_id=3, ts_id=0, sq_id=8, sqe_num=1.
[INFO] DEBUG(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.844.899 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.893 [npu_driver.cc:441] 619016 StreamIdFree: Stream id free success, stream_id=8, device_id=1, tsId=0, streamFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.890 [stars_engine.cc:893] 619017 SendTask: Sq task send finished, device_id=3, ts_id=0, sq_id=8, cq_id=8, stream_id=8, task_id=0, task_type=87(GET_DEVICE_MSG).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.906 [stream.cc:1494] 619017 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] DEBUG(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.844.917 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.909 [device_msg_handler.cc:110] 619016 HandleMsg: Begin to process device errMessage.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.921 [npu_driver.cc:5547] 619017 GetSqHead: deviceId=3, tsId=0, sqId=8, head=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.935 [task.cc:185] 619017 GetTask: this stream no taskRes, stream_id=8
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.950 [task.cc:185] 619017 GetTask: this stream no taskRes, stream_id=8
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.962 [logger.cc:152] 619017 TaskFinished: device_id=3, stream_id=8, task_id=0, task_type=87 (GET_DEVICE_MSG), task_finish_num=8
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.978 [stars_engine.cc:437] 619017 FinishedTaskReclaim: recycle task, stream_id=8, limited=0, taskHead=0, sqHead=1, endTaskId=0, recycleTaskId=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.844.994 [stream.cc:2886] 619017 StarsWaitForTask: No.0 stream_id=8, taskId=0, currentId=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.845.007 [stream.cc:852] 619017 TearDown: stream_id=8, sqId=8, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.845.023 [stream.cc:938] 619017 TearDown: stream_id=8, delay recycle task num=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.845.034 [stream.cc:1507] 619017 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.845.054 [stream_sqcq_manage.cc:451] 619017 FreeLogicCq: Return(0), threadIdentifier(281469725306784), devId(3), tsId(0), cqId(1046), isFastCq(0).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.845.075 [npu_driver.cc:6163] 619017 StreamUnBindLogicCq: success: deviceId=3, tsId=0, streamId=8, logicCq=1046.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.845.104 [npu_driver.cc:1180] 619017 LogicCqFree: Succ:device_id=3,ts_id=0,type=2,logic_cq_id=1046, drvFlag=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.845.120 [stream.cc:237] 619017 FreeStreamId: Free stream_id=8.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.845.147 [stream_sqcq_manage.cc:216] 619017 DeAllocStreamSqCq: deviceId=3, tsId=0, drvFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.845.159 [npu_driver.cc:966] 619017 NormalSqCqFree: Normal sqcq free, sqId=8, cqId=8, device_id=3, tsId=0, drvFlag=0
[INFO] RUNTIME_FRAMEWORK(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.845.200 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.

----------------------------------------------------
- C++ Call Stack: (For framework developers)
----------------------------------------------------
mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.845.226 [device_msg_handler.cc:127] 619016 HandleMsg: Finished to process device errInfo, retCode=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.845.257 [runtime.cc:5239] 619016 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.845.285 [npu_driver.cc:500] 619016 GetFaultEvent: get fault event, device_id=1, filterFlag=8, outputLen=128.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.845.286 [context.cpp:72]619018 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.845.318 [api_impl.cc:3717] 619018 ContextSetCurrent: set context=aaaaf6e2dcc0, flag=0.
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:47.845.328 [mindspore/ccsrc/common/amp/amp.cc:149] GetCurrentAmpStrategy] amp strategy stack is empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.845.333 [context.cpp:80]619018 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.845.341 [acl.cpp:782]619016 GetFaultEventInfo: can not get fault event of device 1, runtime errorCode is 0
[INFO] GE(618650,python3.9):2025-04-03-09:27:47.845.360 [error_manager.cc:989]619016 GetRawErrorMessages:current work_stream_id:0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.845.363 [api_error.cc:1807] 619018 MemcpyAsyncCheckKindAndLocation: src pointer loc type=1, dst pointer loc type=2, kind=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.845.382 [memory_task.cc:342] 619018 ConvertCpyType: MemcpyAsyncTask::ConvertCpyType MEMCPY_HOST_TO_DEVICE, direct=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.845.394 [memory_task.cc:473] 619018 MemcpyAsyncTaskInitV3: Init qos=0, partId=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.845.403 [memory_task.cc:518] 619018 MemcpyAsyncTaskInitV3: CopyType=0: use virtual address directly.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.845.415 [task_res.cc:380] 619018 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=5, stream_id=2, taskResId=2, taskResHead_=0, taskResTail_=3.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.845.429 [memory_task.cc:1007] 619018 ConstructPcieDmaSqe: stream_id=2, task_id=2, copyType=0, src=0xaaab02a37630, dst=0x12c2c0000000, len=0x6c
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.845.443 [memory_task.cc:1166] 619018 ConstructSqeForMemcpyAsyncTask: MemcpyAsyncTask, stream_id=2, task_id=2, copyType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.845.454 [stream.cc:1400] 619018 AddTaskToList: public task, stream_id=2, task_id=2, task_type=5 (MEMCPY_ASYNC), head=0, tail=3
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.845.466 [stream.cc:2595] 619018 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=2, type=5(MEMCPY_ASYNC), head=0, tail=3, sqe_num=1, lastTail=2, device_id=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.845.482 [task_submit.cc:573] 619018 AllocTaskAndSendStars: device_id=5, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=2, task_type=5(MEMCPY_ASYNC).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.845.496 [stream.cc:1494] 619018 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=2.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.845.513 [callback.cpp:97]619018 aclrtLaunchCallback: start to execute aclrtLaunchCallback.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.845.530 [task_res.cc:380] 619018 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=5, stream_id=2, taskResId=3, taskResHead_=0, taskResTail_=4.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.845.545 [task_info.cc:521] 619018 ConstructSqeForCallbackLaunchTask: CallbackLaunch,topic_type=4,stream_id=2,task_id=3,eventId=65535,isBlock=0,pid=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.845.558 [stream.cc:1400] 619018 AddTaskToList: public task, stream_id=2, task_id=3, task_type=72 (HOSTFUNC_CALLBACK), head=0, tail=4
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.845.570 [stream.cc:2595] 619018 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=3, type=72(HOSTFUNC_CALLBACK), head=0, tail=4, sqe_num=1, lastTail=3, device_id=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.845.585 [task_submit.cc:573] 619018 AllocTaskAndSendStars: device_id=5, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=3, task_type=72(HOSTFUNC_CALLBACK).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.845.597 [stream.cc:1494] 619018 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=3.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.845.607 [callback.cpp:109]619018 aclrtLaunchCallback: successfully execute aclrtLaunchCallback
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.845.602 [npu_driver.cc:974] 619017 NormalSqCqFree: Normal sqcq free success, sqId=8, cqId=8, device_id=3, tsId=0, drvFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.845.621 [stream_sqcq_manage.cc:228] 619017 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=8, cq_id=8, stream_id=8, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.845.637 [npu_driver.cc:3844] 618808 CqReportGet: cq report get start, device_id=5, tsId=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.845.640 [npu_driver.cc:432] 619017 StreamIdFree: stream id free begin, device_id=3, stream_id=8, ts_id=0, remote_stream_id=0
[CRITICAL] KERNEL(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.845.651 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.845.660 [npu_driver.cc:441] 619017 StreamIdFree: Stream id free success, stream_id=8, device_id=3, tsId=0, streamFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.845.656 [npu_driver.cc:3851] 618808 CqReportGet: halCqReportGet count=1
[INFO] DEBUG(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.845.683 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.845.678 [device_msg_handler.cc:110] 619017 HandleMsg: Begin to process device errMessage.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.845.682 [device.cpp:231]619018 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.845.683 [api_impl.cc:5087] 618808 ProcessReport: report[0], sqid=12291, streamId=2, taskId=3, eventId=65535, isBlock=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.845.698 [runtime.cc:5239] 619018 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] DEBUG(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.845.702 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.845.702 [callback.cpp:138]618808 aclrtProcessReport: successfully aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.845.709 [acl.cpp:802]619018 aclGetRecentErrMsg: start to execute aclGetRecentErrMsg.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.845.716 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] DEBUG(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.845.717 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.845.732 [npu_driver.cc:3828] 618808 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=64.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.845.737 [npu_driver.cc:404] 619018 StreamIdAlloc: stream id alloc begin, device_id=5, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.845.761 [stream.cc:2246] 619018 AllocExecutedTimesSvm: stream_id=7.
[INFO] RUNTIME_FRAMEWORK(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.845.785 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.

----------------------------------------------------
- C++ Call Stack: (For framework developers)
----------------------------------------------------
mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.845.793 [stream_sqcq_manage.cc:147] 619018 Alloc: deviceId=5, tsId=0, drvFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.845.809 [npu_driver.cc:882] 619018 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.846.056 [device_msg_handler.cc:127] 619017 HandleMsg: Finished to process device errInfo, retCode=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.093 [npu_driver.cc:6125] 619018 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.846.090 [runtime.cc:5239] 619017 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.846.112 [npu_driver.cc:500] 619017 GetFaultEvent: get fault event, device_id=3, filterFlag=8, outputLen=128.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.136 [npu_driver.cc:6137] 619018 LogicCqAllocateV2: success: deviceId=5, tsId=0, cqId=364, streamId=7, logicCq=364, cqeDepth=4096
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.156 [npu_driver.cc:6189] 619018 StreamBindLogicCq: success: deviceId=5, tsId=0, streamId=7, logicCq=364.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.170 [npu_driver.cc:5916] 619018 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=e059a000, addr=dfffe059a000size=4096
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.846.170 [acl.cpp:782]619017 GetFaultEventInfo: can not get fault event of device 3, runtime errorCode is 0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.183 [stream.cc:653] 619018 Setup: Success to get sq=7 sq reg virtual addr length=4096.
[INFO] GE(618658,python3.9):2025-04-03-09:27:47.846.189 [error_manager.cc:989]619017 GetRawErrorMessages:current work_stream_id:0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.217 [stream.cc:276] 619018 CreateStreamTaskRes: Normal STREAM Setup stream_id=7 flags_=0x0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.231 [stream.cc:688] 619018 Setup: stream setup end, stream_id=7, IsTaskSink=0, sqId=7, cqId=7, deviceId=5, streamResId=65534
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.846.245 [acl_resource_manager.cpp:814]619018 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.846.257 [acl_resource_manager.cpp:816]619018 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.294 [engine.cc:188] 619018 SubmitTaskNormal: stream_id=7,task_id=0,task_type=87 (GET_DEVICE_MSG).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.309 [npu_driver.cc:5547] 619018 GetSqHead: deviceId=5, tsId=0, sqId=7, head=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.323 [task_info.cc:409] 619018 ConstructSqeForGetDevMsgTask: stream_id:7, task_id:0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.334 [stream.cc:1400] 619018 AddTaskToList: public task, stream_id=7, task_id=0, task_type=87 (GET_DEVICE_MSG), head=0, tail=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.346 [stream.cc:2595] 619018 StarsAddTaskToStream: single-operator flow stream, stream_id=7, task_id=0, type=87(GET_DEVICE_MSG), head=0, tail=1, sqe_num=1, lastTail=0, device_id=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.369 [npu_driver.cc:751] 619018 SqTaskSend: device_id=5, ts_id=0, sq_id=7, sqe_num=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.382 [stars_engine.cc:893] 619018 SendTask: Sq task send finished, device_id=5, ts_id=0, sq_id=7, cq_id=7, stream_id=7, task_id=0, task_type=87(GET_DEVICE_MSG).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.395 [stream.cc:1494] 619018 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.408 [npu_driver.cc:5547] 619018 GetSqHead: deviceId=5, tsId=0, sqId=7, head=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.420 [stream.cc:2886] 619018 StarsWaitForTask: No.0 stream_id=7, taskId=0, currentId=65535
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.433 [npu_driver.cc:5547] 619018 GetSqHead: deviceId=5, tsId=0, sqId=7, head=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.445 [task.cc:185] 619018 GetTask: this stream no taskRes, stream_id=7
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.456 [task.cc:185] 619018 GetTask: this stream no taskRes, stream_id=7
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.468 [logger.cc:152] 619018 TaskFinished: device_id=5, stream_id=7, task_id=0, task_type=87 (GET_DEVICE_MSG), task_finish_num=7
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.482 [stars_engine.cc:437] 619018 FinishedTaskReclaim: recycle task, stream_id=7, limited=0, taskHead=0, sqHead=1, endTaskId=0, recycleTaskId=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.495 [stream.cc:2886] 619018 StarsWaitForTask: No.1 stream_id=7, taskId=0, currentId=0
[CRITICAL] KERNEL(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.846.487 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.508 [stream.cc:852] 619018 TearDown: stream_id=7, sqId=7, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.521 [stream.cc:938] 619018 TearDown: stream_id=7, delay recycle task num=0.
[INFO] DEBUG(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.846.520 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.533 [stream.cc:1507] 619018 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] DEBUG(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.846.542 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.553 [stream_sqcq_manage.cc:451] 619018 FreeLogicCq: Return(0), threadIdentifier(281469355945888), devId(5), tsId(0), cqId(364), isFastCq(0).
[INFO] DEBUG(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.846.559 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.571 [npu_driver.cc:6163] 619018 StreamUnBindLogicCq: success: deviceId=5, tsId=0, streamId=7, logicCq=364.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.600 [npu_driver.cc:1180] 619018 LogicCqFree: Succ:device_id=5,ts_id=0,type=2,logic_cq_id=364, drvFlag=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.613 [stream.cc:237] 619018 FreeStreamId: Free stream_id=7.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.624 [stream_sqcq_manage.cc:216] 619018 DeAllocStreamSqCq: deviceId=5, tsId=0, drvFlag=0
[INFO] RUNTIME_FRAMEWORK(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.846.631 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.

----------------------------------------------------
- C++ Call Stack: (For framework developers)
----------------------------------------------------
mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.846.635 [npu_driver.cc:966] 619018 NormalSqCqFree: Normal sqcq free, sqId=7, cqId=7, device_id=5, tsId=0, drvFlag=0
[INFO] PRE_ACT(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.846.793 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:736] operator()] Malloc mem block : {"addr_":0x12d100000000,"size_":61029220352,"stream_id_":0,"min_addr_":0,"max_addr_":0}.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.846.829 [api_impl.cc:7129] 619019 MallocPhysical: Start to MallocPhysical
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.846.928 [api_impl.cc:7145] 619019 MapMem: device malloc Succ, size=2097152(bytes), start ptr=0x12d100000000, end ptr=0x12d100200000
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.847.069 [npu_driver.cc:974] 619018 NormalSqCqFree: Normal sqcq free success, sqId=7, cqId=7, device_id=5, tsId=0, drvFlag=0
mki_log log dir:/home/jenkins/atb/log exist
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.847.087 [stream_sqcq_manage.cc:228] 619018 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=7, cq_id=7, stream_id=7, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.847.101 [npu_driver.cc:432] 619018 StreamIdFree: stream id free begin, device_id=5, stream_id=7, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.847.118 [npu_driver.cc:441] 619018 StreamIdFree: Stream id free success, stream_id=7, device_id=5, tsId=0, streamFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.847.133 [device_msg_handler.cc:110] 619018 HandleMsg: Begin to process device errMessage.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.847.428 [device_msg_handler.cc:127] 619018 HandleMsg: Finished to process device errInfo, retCode=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.847.465 [runtime.cc:5239] 619018 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.847.487 [npu_driver.cc:500] 619018 GetFaultEvent: get fault event, device_id=5, filterFlag=8, outputLen=128.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.847.541 [acl.cpp:782]619018 GetFaultEventInfo: can not get fault event of device 5, runtime errorCode is 0
[INFO] GE(618666,python3.9):2025-04-03-09:27:47.847.555 [error_manager.cc:989]619018 GetRawErrorMessages:current work_stream_id:0
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.847.757 [device.cpp:231]619019 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.847.781 [runtime.cc:5239] 619019 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.847.803 [acl.cpp:802]619019 aclGetRecentErrMsg: start to execute aclGetRecentErrMsg.
[CRITICAL] KERNEL(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.847.837 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
[INFO] DEBUG(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.847.869 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
[INFO] DEBUG(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.847.886 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
[INFO] DEBUG(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.847.900 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.847.912 [npu_driver.cc:404] 619019 StreamIdAlloc: stream id alloc begin, device_id=7, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.847.958 [stream.cc:2246] 619019 AllocExecutedTimesSvm: stream_id=6.
[INFO] RUNTIME_FRAMEWORK(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.847.967 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.

----------------------------------------------------
- C++ Call Stack: (For framework developers)
----------------------------------------------------
mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.848.001 [stream_sqcq_manage.cc:147] 619019 Alloc: deviceId=7, tsId=0, drvFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.848.020 [npu_driver.cc:882] 619019 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.848.039 [context.cpp:72]619018 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.059 [api_impl.cc:3717] 619018 ContextSetCurrent: set context=aaaaf6e2dcc0, flag=0.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.848.074 [context.cpp:80]619018 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.092 [api_error.cc:1807] 619018 MemcpyAsyncCheckKindAndLocation: src pointer loc type=1, dst pointer loc type=2, kind=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.108 [memory_task.cc:342] 619018 ConvertCpyType: MemcpyAsyncTask::ConvertCpyType MEMCPY_HOST_TO_DEVICE, direct=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.120 [memory_task.cc:473] 619018 MemcpyAsyncTaskInitV3: Init qos=0, partId=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.131 [memory_task.cc:518] 619018 MemcpyAsyncTaskInitV3: CopyType=0: use virtual address directly.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.144 [task_res.cc:380] 619018 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=5, stream_id=2, taskResId=4, taskResHead_=0, taskResTail_=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.172 [memory_task.cc:1007] 619018 ConstructPcieDmaSqe: stream_id=2, task_id=4, copyType=0, src=0xaaab02a380a0, dst=0x12c2c0000000, len=0x6c
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.187 [memory_task.cc:1166] 619018 ConstructSqeForMemcpyAsyncTask: MemcpyAsyncTask, stream_id=2, task_id=4, copyType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.197 [stream.cc:1400] 619018 AddTaskToList: public task, stream_id=2, task_id=4, task_type=5 (MEMCPY_ASYNC), head=0, tail=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.209 [stream.cc:2595] 619018 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=4, type=5(MEMCPY_ASYNC), head=0, tail=5, sqe_num=1, lastTail=4, device_id=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.225 [task_submit.cc:573] 619018 AllocTaskAndSendStars: device_id=5, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=4, task_type=5(MEMCPY_ASYNC).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.246 [stream.cc:1494] 619018 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=4.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.848.264 [callback.cpp:97]619018 aclrtLaunchCallback: start to execute aclrtLaunchCallback.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.281 [task_res.cc:380] 619018 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=5, stream_id=2, taskResId=5, taskResHead_=0, taskResTail_=6.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.295 [task_info.cc:521] 619018 ConstructSqeForCallbackLaunchTask: CallbackLaunch,topic_type=4,stream_id=2,task_id=5,eventId=65535,isBlock=0,pid=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.308 [stream.cc:1400] 619018 AddTaskToList: public task, stream_id=2, task_id=5, task_type=72 (HOSTFUNC_CALLBACK), head=0, tail=6
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.321 [stream.cc:2595] 619018 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=5, type=72(HOSTFUNC_CALLBACK), head=0, tail=6, sqe_num=1, lastTail=5, device_id=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.335 [task_submit.cc:573] 619018 AllocTaskAndSendStars: device_id=5, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=5, task_type=72(HOSTFUNC_CALLBACK).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.348 [stream.cc:1494] 619018 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=5.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.848.359 [callback.cpp:109]619018 aclrtLaunchCallback: successfully execute aclrtLaunchCallback
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.371 [npu_driver.cc:3844] 618808 CqReportGet: cq report get start, device_id=5, tsId=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.384 [npu_driver.cc:3851] 618808 CqReportGet: halCqReportGet count=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.395 [api_impl.cc:5087] 618808 ProcessReport: report[0], sqid=12291, streamId=2, taskId=5, eventId=65535, isBlock=0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.848.409 [callback.cpp:138]618808 aclrtProcessReport: successfully aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.848.422 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.848.421 [device.cpp:231]619018 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.435 [npu_driver.cc:3828] 618808 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=64.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.440 [runtime.cc:5239] 619018 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.848.452 [acl.cpp:802]619018 aclGetRecentErrMsg: start to execute aclGetRecentErrMsg.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.481 [npu_driver.cc:404] 619018 StreamIdAlloc: stream id alloc begin, device_id=5, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.505 [stream.cc:2246] 619018 AllocExecutedTimesSvm: stream_id=8.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.535 [stream_sqcq_manage.cc:147] 619018 Alloc: deviceId=5, tsId=0, drvFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.548 [npu_driver.cc:882] 619018 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.848.600 [npu_driver.cc:6125] 619019 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.848.661 [npu_driver.cc:6137] 619019 LogicCqAllocateV2: success: deviceId=7, tsId=0, cqId=336, streamId=6, logicCq=336, cqeDepth=4096
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.848.692 [npu_driver.cc:6189] 619019 StreamBindLogicCq: success: deviceId=7, tsId=0, streamId=6, logicCq=336.
[INFO] PRE_ACT(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.848.678 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:736] operator()] Malloc mem block : {"addr_":0x12d100000000,"size_":61022928896,"stream_id_":0,"min_addr_":0,"max_addr_":0}.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.848.712 [npu_driver.cc:5916] 619019 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=c8006000, addr=dfffc8006000size=4096
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.848.715 [api_impl.cc:7129] 619020 MallocPhysical: Start to MallocPhysical
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.848.731 [stream.cc:653] 619019 Setup: Success to get sq=6 sq reg virtual addr length=4096.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.785 [npu_driver.cc:6125] 619018 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.848.796 [stream.cc:276] 619019 CreateStreamTaskRes: Normal STREAM Setup stream_id=6 flags_=0x0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.848.815 [stream.cc:688] 619019 Setup: stream setup end, stream_id=6, IsTaskSink=0, sqId=6, cqId=6, deviceId=7, streamResId=65534
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.829 [npu_driver.cc:6137] 619018 LogicCqAllocateV2: success: deviceId=5, tsId=0, cqId=365, streamId=8, logicCq=365, cqeDepth=4096
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.848.836 [acl_resource_manager.cpp:814]619019 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.848.853 [acl_resource_manager.cpp:816]619019 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.849 [npu_driver.cc:6189] 619018 StreamBindLogicCq: success: deviceId=5, tsId=0, streamId=8, logicCq=365.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.865 [npu_driver.cc:5916] 619018 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=e059a000, addr=dfffe059a000size=4096
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.848.869 [api_impl.cc:7145] 619020 MapMem: device malloc Succ, size=2097152(bytes), start ptr=0x12d100000000, end ptr=0x12d100200000
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.888 [stream.cc:653] 619018 Setup: Success to get sq=8 sq reg virtual addr length=4096.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.923 [stream.cc:276] 619018 CreateStreamTaskRes: Normal STREAM Setup stream_id=8 flags_=0x0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.937 [stream.cc:688] 619018 Setup: stream setup end, stream_id=8, IsTaskSink=0, sqId=8, cqId=8, deviceId=5, streamResId=65534
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.848.951 [acl_resource_manager.cpp:814]619018 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.848.962 [acl_resource_manager.cpp:816]619018 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.848.999 [engine.cc:188] 619018 SubmitTaskNormal: stream_id=8,task_id=0,task_type=87 (GET_DEVICE_MSG).
mki_log log dir:/home/jenkins/atb/log exist
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.849.016 [npu_driver.cc:5547] 619018 GetSqHead: deviceId=5, tsId=0, sqId=8, head=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.849.008 [engine.cc:188] 619019 SubmitTaskNormal: stream_id=6,task_id=0,task_type=87 (GET_DEVICE_MSG).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.849.033 [task_info.cc:409] 619018 ConstructSqeForGetDevMsgTask: stream_id:8, task_id:0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.849.033 [npu_driver.cc:5547] 619019 GetSqHead: deviceId=7, tsId=0, sqId=6, head=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.849.042 [stream.cc:1400] 619018 AddTaskToList: public task, stream_id=8, task_id=0, task_type=87 (GET_DEVICE_MSG), head=0, tail=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.849.054 [stream.cc:2595] 619018 StarsAddTaskToStream: single-operator flow stream, stream_id=8, task_id=0, type=87(GET_DEVICE_MSG), head=0, tail=1, sqe_num=1, lastTail=0, device_id=5
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.849.054 [task_info.cc:409] 619019 ConstructSqeForGetDevMsgTask: stream_id:6, task_id:0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.849.072 [npu_driver.cc:751] 619018 SqTaskSend: device_id=5, ts_id=0, sq_id=8, sqe_num=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.849.072 [stream.cc:1400] 619019 AddTaskToList: public task, stream_id=6, task_id=0, task_type=87 (GET_DEVICE_MSG), head=0, tail=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.849.084 [stars_engine.cc:893] 619018 SendTask: Sq task send finished, device_id=5, ts_id=0, sq_id=8, cq_id=8, stream_id=8, task_id=0, task_type=87(GET_DEVICE_MSG).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.849.099 [stream.cc:1494] 619018 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.849.090 [stream.cc:2595] 619019 StarsAddTaskToStream: single-operator flow stream, stream_id=6, task_id=0, type=87(GET_DEVICE_MSG), head=0, tail=1, sqe_num=1, lastTail=0, device_id=7
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.849.111 [npu_driver.cc:5547] 619018 GetSqHead: deviceId=5, tsId=0, sqId=8, head=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.849.112 [npu_driver.cc:751] 619019 SqTaskSend: device_id=7, ts_id=0, sq_id=6, sqe_num=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.849.127 [task.cc:185] 619018 GetTask: this stream no taskRes, stream_id=8
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.849.140 [task.cc:185] 619018 GetTask: this stream no taskRes, stream_id=8
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.849.130 [stars_engine.cc:893] 619019 SendTask: Sq task send finished, device_id=7, ts_id=0, sq_id=6, cq_id=6, stream_id=6, task_id=0, task_type=87(GET_DEVICE_MSG).
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.849.149 [stream.cc:1494] 619019 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.849.153 [logger.cc:152] 619018 TaskFinished: device_id=5, stream_id=8, task_id=0, task_type=87 (GET_DEVICE_MSG), task_finish_num=8
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.849.171 [stars_engine.cc:437] 619018 FinishedTaskReclaim: recycle task, stream_id=8, limited=0, taskHead=0, sqHead=1, endTaskId=0, recycleTaskId=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.849.172 [npu_driver.cc:5547] 619019 GetSqHead: deviceId=7, tsId=0, sqId=6, head=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.849.185 [stream.cc:2886] 619018 StarsWaitForTask: No.0 stream_id=8, taskId=0, currentId=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.849.199 [stream.cc:852] 619018 TearDown: stream_id=8, sqId=8, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.849.193 [task.cc:185] 619019 GetTask: this stream no taskRes, stream_id=6
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.849.212 [task.cc:185] 619019 GetTask: this stream no taskRes, stream_id=6
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.849.213 [stream.cc:938] 619018 TearDown: stream_id=8, delay recycle task num=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.849.228 [stream.cc:1507] 619018 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.849.228 [logger.cc:152] 619019 TaskFinished: device_id=7, stream_id=6, task_id=0, task_type=87 (GET_DEVICE_MSG), task_finish_num=6
[INFO] PRE_ACT(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.849.222 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:736] operator()] Malloc mem block : {"addr_":0x12d100000000,"size_":61029220352,"stream_id_":0,"min_addr_":0,"max_addr_":0}.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.849.248 [stream_sqcq_manage.cc:451] 619018 FreeLogicCq: Return(0), threadIdentifier(281469355945888), devId(5), tsId(0), cqId(365), isFastCq(0).
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.849.255 [stars_engine.cc:437] 619019 FinishedTaskReclaim: recycle task, stream_id=6, limited=0, taskHead=0, sqHead=1, endTaskId=0, recycleTaskId=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.849.274 [stream.cc:2886] 619019 StarsWaitForTask: No.0 stream_id=6, taskId=0, currentId=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.849.267 [npu_driver.cc:6163] 619018 StreamUnBindLogicCq: success: deviceId=5, tsId=0, streamId=8, logicCq=365.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.849.260 [api_impl.cc:7129] 619021 MallocPhysical: Start to MallocPhysical
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.849.291 [stream.cc:852] 619019 TearDown: stream_id=6, sqId=6, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.849.294 [npu_driver.cc:1180] 619018 LogicCqFree: Succ:device_id=5,ts_id=0,type=2,logic_cq_id=365, drvFlag=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.849.316 [stream.cc:237] 619018 FreeStreamId: Free stream_id=8.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.849.328 [stream_sqcq_manage.cc:216] 619018 DeAllocStreamSqCq: deviceId=5, tsId=0, drvFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.849.309 [stream.cc:938] 619019 TearDown: stream_id=6, delay recycle task num=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.849.338 [stream.cc:1507] 619019 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.849.341 [npu_driver.cc:966] 619018 NormalSqCqFree: Normal sqcq free, sqId=8, cqId=8, device_id=5, tsId=0, drvFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.849.358 [api_impl.cc:7145] 619021 MapMem: device malloc Succ, size=2097152(bytes), start ptr=0x12d100000000, end ptr=0x12d100200000
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.849.368 [stream_sqcq_manage.cc:451] 619019 FreeLogicCq: Return(0), threadIdentifier(281469171527584), devId(7), tsId(0), cqId(336), isFastCq(0).
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.849.390 [npu_driver.cc:6163] 619019 StreamUnBindLogicCq: success: deviceId=7, tsId=0, streamId=6, logicCq=336.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.849.428 [npu_driver.cc:1180] 619019 LogicCqFree: Succ:device_id=7,ts_id=0,type=2,logic_cq_id=336, drvFlag=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.849.446 [stream.cc:237] 619019 FreeStreamId: Free stream_id=6.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.849.460 [stream_sqcq_manage.cc:216] 619019 DeAllocStreamSqCq: deviceId=7, tsId=0, drvFlag=0
mki_log log dir:/home/jenkins/atb/log exist
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.849.475 [npu_driver.cc:966] 619019 NormalSqCqFree: Normal sqcq free, sqId=6, cqId=6, device_id=7, tsId=0, drvFlag=0
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.849.571 [device.cpp:231]619020 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.849.593 [runtime.cc:5239] 619020 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.849.615 [acl.cpp:802]619020 aclGetRecentErrMsg: start to execute aclGetRecentErrMsg.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.849.725 [npu_driver.cc:404] 619020 StreamIdAlloc: stream id alloc begin, device_id=2, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.849.763 [stream.cc:2246] 619020 AllocExecutedTimesSvm: stream_id=6.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.849.790 [npu_driver.cc:974] 619018 NormalSqCqFree: Normal sqcq free success, sqId=8, cqId=8, device_id=5, tsId=0, drvFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.849.806 [stream_sqcq_manage.cc:228] 619018 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=8, cq_id=8, stream_id=8, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.849.803 [stream_sqcq_manage.cc:147] 619020 Alloc: deviceId=2, tsId=0, drvFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.849.822 [npu_driver.cc:882] 619020 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.849.823 [npu_driver.cc:432] 619018 StreamIdFree: stream id free begin, device_id=5, stream_id=8, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.849.840 [npu_driver.cc:441] 619018 StreamIdFree: Stream id free success, stream_id=8, device_id=5, tsId=0, streamFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.849.855 [device_msg_handler.cc:110] 619018 HandleMsg: Begin to process device errMessage.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.849.991 [device.cpp:231]619021 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.850.017 [npu_driver.cc:974] 619019 NormalSqCqFree: Normal sqcq free success, sqId=6, cqId=6, device_id=7, tsId=0, drvFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.850.015 [runtime.cc:5239] 619021 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.850.036 [stream_sqcq_manage.cc:228] 619019 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=6, cq_id=6, stream_id=6, is_sq_need_release=1, drvFlag=0.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.850.044 [acl.cpp:802]619021 aclGetRecentErrMsg: start to execute aclGetRecentErrMsg.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.850.055 [npu_driver.cc:432] 619019 StreamIdFree: stream id free begin, device_id=7, stream_id=6, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.850.075 [npu_driver.cc:441] 619019 StreamIdFree: Stream id free success, stream_id=6, device_id=7, tsId=0, streamFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.086 [npu_driver.cc:6125] 619020 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.850.097 [device_msg_handler.cc:110] 619019 HandleMsg: Begin to process device errMessage.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.139 [npu_driver.cc:6137] 619020 LogicCqAllocateV2: success: deviceId=2, tsId=0, cqId=1002, streamId=6, logicCq=1002, cqeDepth=4096
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.850.146 [device_msg_handler.cc:127] 619018 HandleMsg: Finished to process device errInfo, retCode=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.850.144 [npu_driver.cc:404] 619021 StreamIdAlloc: stream id alloc begin, device_id=4, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.163 [npu_driver.cc:6189] 619020 StreamBindLogicCq: success: deviceId=2, tsId=0, streamId=6, logicCq=1002.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.850.177 [runtime.cc:5239] 619018 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.850.183 [stream.cc:2246] 619021 AllocExecutedTimesSvm: stream_id=6.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.182 [npu_driver.cc:5916] 619020 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=d0095000, addr=dfffd0095000size=4096
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.200 [stream.cc:653] 619020 Setup: Success to get sq=6 sq reg virtual addr length=4096.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.850.197 [npu_driver.cc:500] 619018 GetFaultEvent: get fault event, device_id=5, filterFlag=8, outputLen=128.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.850.218 [stream_sqcq_manage.cc:147] 619021 Alloc: deviceId=4, tsId=0, drvFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.850.235 [npu_driver.cc:882] 619021 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.850.251 [acl.cpp:782]619018 GetFaultEventInfo: can not get fault event of device 5, runtime errorCode is 0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.245 [stream.cc:276] 619020 CreateStreamTaskRes: Normal STREAM Setup stream_id=6 flags_=0x0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.263 [stream.cc:688] 619020 Setup: stream setup end, stream_id=6, IsTaskSink=0, sqId=6, cqId=6, deviceId=2, streamResId=65534
[INFO] GE(618666,python3.9):2025-04-03-09:27:47.850.267 [error_manager.cc:989]619018 GetRawErrorMessages:current work_stream_id:0
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.850.282 [acl_resource_manager.cpp:814]619020 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.850.298 [acl_resource_manager.cpp:816]619020 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.448 [engine.cc:188] 619020 SubmitTaskNormal: stream_id=6,task_id=0,task_type=87 (GET_DEVICE_MSG).
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.470 [npu_driver.cc:5547] 619020 GetSqHead: deviceId=2, tsId=0, sqId=6, head=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.486 [task_info.cc:409] 619020 ConstructSqeForGetDevMsgTask: stream_id:6, task_id:0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.511 [stream.cc:1400] 619020 AddTaskToList: public task, stream_id=6, task_id=0, task_type=87 (GET_DEVICE_MSG), head=0, tail=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.525 [stream.cc:2595] 619020 StarsAddTaskToStream: single-operator flow stream, stream_id=6, task_id=0, type=87(GET_DEVICE_MSG), head=0, tail=1, sqe_num=1, lastTail=0, device_id=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.545 [npu_driver.cc:751] 619020 SqTaskSend: device_id=2, ts_id=0, sq_id=6, sqe_num=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.562 [stars_engine.cc:893] 619020 SendTask: Sq task send finished, device_id=2, ts_id=0, sq_id=6, cq_id=6, stream_id=6, task_id=0, task_type=87(GET_DEVICE_MSG).
[CRITICAL] KERNEL(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.850.557 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.579 [stream.cc:1494] 619020 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.850.564 [npu_driver.cc:6125] 619021 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] DEBUG(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.850.588 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
[INFO] DEBUG(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.850.606 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.594 [npu_driver.cc:5547] 619020 GetSqHead: deviceId=2, tsId=0, sqId=6, head=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.612 [task.cc:185] 619020 GetTask: this stream no taskRes, stream_id=6
[INFO] DEBUG(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.850.621 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.850.616 [npu_driver.cc:6137] 619021 LogicCqAllocateV2: success: deviceId=4, tsId=0, cqId=316, streamId=6, logicCq=316, cqeDepth=4096
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.628 [task.cc:185] 619020 GetTask: this stream no taskRes, stream_id=6
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.645 [logger.cc:152] 619020 TaskFinished: device_id=2, stream_id=6, task_id=0, task_type=87 (GET_DEVICE_MSG), task_finish_num=6
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.850.641 [npu_driver.cc:6189] 619021 StreamBindLogicCq: success: deviceId=4, tsId=0, streamId=6, logicCq=316.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.850.661 [npu_driver.cc:5916] 619021 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=e03eb000, addr=dfffe03eb000size=4096
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.850.678 [stream.cc:653] 619021 Setup: Success to get sq=6 sq reg virtual addr length=4096.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.662 [stars_engine.cc:437] 619020 FinishedTaskReclaim: recycle task, stream_id=6, limited=0, taskHead=0, sqHead=1, endTaskId=0, recycleTaskId=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.679 [stream.cc:2886] 619020 StarsWaitForTask: No.0 stream_id=6, taskId=0, currentId=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.693 [stream.cc:852] 619020 TearDown: stream_id=6, sqId=6, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME_FRAMEWORK(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.850.687 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.

----------------------------------------------------
- C++ Call Stack: (For framework developers)
----------------------------------------------------
mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.708 [stream.cc:938] 619020 TearDown: stream_id=6, delay recycle task num=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.725 [stream.cc:1507] 619020 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.850.719 [stream.cc:276] 619021 CreateStreamTaskRes: Normal STREAM Setup stream_id=6 flags_=0x0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.850.736 [stream.cc:688] 619021 Setup: stream setup end, stream_id=6, IsTaskSink=0, sqId=6, cqId=6, deviceId=4, streamResId=65534
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.746 [stream_sqcq_manage.cc:451] 619020 FreeLogicCq: Return(0), threadIdentifier(281469230182304), devId(2), tsId(0), cqId(1002), isFastCq(0).
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.850.756 [acl_resource_manager.cpp:814]619021 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.850.773 [acl_resource_manager.cpp:816]619021 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.767 [npu_driver.cc:6163] 619020 StreamUnBindLogicCq: success: deviceId=2, tsId=0, streamId=6, logicCq=1002.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.799 [npu_driver.cc:1180] 619020 LogicCqFree: Succ:device_id=2,ts_id=0,type=2,logic_cq_id=1002, drvFlag=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.816 [stream.cc:237] 619020 FreeStreamId: Free stream_id=6.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.828 [stream_sqcq_manage.cc:216] 619020 DeAllocStreamSqCq: deviceId=2, tsId=0, drvFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.850.816 [device_msg_handler.cc:127] 619019 HandleMsg: Finished to process device errInfo, retCode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.850.841 [npu_driver.cc:966] 619020 NormalSqCqFree: Normal sqcq free, sqId=6, cqId=6, device_id=2, tsId=0, drvFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.850.872 [runtime.cc:5239] 619019 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.850.907 [npu_driver.cc:500] 619019 GetFaultEvent: get fault event, device_id=7, filterFlag=8, outputLen=128.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.850.914 [engine.cc:188] 619021 SubmitTaskNormal: stream_id=6,task_id=0,task_type=87 (GET_DEVICE_MSG).
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.850.934 [npu_driver.cc:5547] 619021 GetSqHead: deviceId=4, tsId=0, sqId=6, head=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.850.953 [task_info.cc:409] 619021 ConstructSqeForGetDevMsgTask: stream_id:6, task_id:0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.850.968 [stream.cc:1400] 619021 AddTaskToList: public task, stream_id=6, task_id=0, task_type=87 (GET_DEVICE_MSG), head=0, tail=1
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.850.978 [acl.cpp:782]619019 GetFaultEventInfo: can not get fault event of device 7, runtime errorCode is 0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.850.982 [stream.cc:2595] 619021 StarsAddTaskToStream: single-operator flow stream, stream_id=6, task_id=0, type=87(GET_DEVICE_MSG), head=0, tail=1, sqe_num=1, lastTail=0, device_id=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.851.002 [npu_driver.cc:751] 619021 SqTaskSend: device_id=4, ts_id=0, sq_id=6, sqe_num=1.
[INFO] GE(618674,python3.9):2025-04-03-09:27:47.851.008 [error_manager.cc:989]619019 GetRawErrorMessages:current work_stream_id:0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.851.016 [stars_engine.cc:893] 619021 SendTask: Sq task send finished, device_id=4, ts_id=0, sq_id=6, cq_id=6, stream_id=6, task_id=0, task_type=87(GET_DEVICE_MSG).
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.851.033 [stream.cc:1494] 619021 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.851.048 [npu_driver.cc:5547] 619021 GetSqHead: deviceId=4, tsId=0, sqId=6, head=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.851.065 [task.cc:185] 619021 GetTask: this stream no taskRes, stream_id=6
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.851.082 [task.cc:185] 619021 GetTask: this stream no taskRes, stream_id=6
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.851.114 [logger.cc:152] 619021 TaskFinished: device_id=4, stream_id=6, task_id=0, task_type=87 (GET_DEVICE_MSG), task_finish_num=6
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.851.135 [stars_engine.cc:437] 619021 FinishedTaskReclaim: recycle task, stream_id=6, limited=0, taskHead=0, sqHead=1, endTaskId=0, recycleTaskId=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.851.151 [stream.cc:2886] 619021 StarsWaitForTask: No.0 stream_id=6, taskId=0, currentId=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.851.165 [stream.cc:852] 619021 TearDown: stream_id=6, sqId=6, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.851.181 [stream.cc:938] 619021 TearDown: stream_id=6, delay recycle task num=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.851.193 [stream.cc:1507] 619021 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.851.219 [stream_sqcq_manage.cc:451] 619021 FreeLogicCq: Return(0), threadIdentifier(281469901270944), devId(4), tsId(0), cqId(316), isFastCq(0).
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.851.240 [npu_driver.cc:6163] 619021 StreamUnBindLogicCq: success: deviceId=4, tsId=0, streamId=6, logicCq=316.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.851.270 [npu_driver.cc:1180] 619021 LogicCqFree: Succ:device_id=4,ts_id=0,type=2,logic_cq_id=316, drvFlag=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.851.287 [stream.cc:237] 619021 FreeStreamId: Free stream_id=6.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.851.300 [stream_sqcq_manage.cc:216] 619021 DeAllocStreamSqCq: deviceId=4, tsId=0, drvFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.851.315 [npu_driver.cc:966] 619021 NormalSqCqFree: Normal sqcq free, sqId=6, cqId=6, device_id=4, tsId=0, drvFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.851.342 [npu_driver.cc:974] 619020 NormalSqCqFree: Normal sqcq free success, sqId=6, cqId=6, device_id=2, tsId=0, drvFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.851.361 [stream_sqcq_manage.cc:228] 619020 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=6, cq_id=6, stream_id=6, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.851.375 [npu_driver.cc:432] 619020 StreamIdFree: stream id free begin, device_id=2, stream_id=6, ts_id=0, remote_stream_id=0
[CRITICAL] KERNEL(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.851.374 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.851.395 [npu_driver.cc:441] 619020 StreamIdFree: Stream id free success, stream_id=6, device_id=2, tsId=0, streamFlag=0
[INFO] DEBUG(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.851.417 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.851.414 [device_msg_handler.cc:110] 619020 HandleMsg: Begin to process device errMessage.
[INFO] DEBUG(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.851.443 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
[INFO] DEBUG(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.851.462 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
[INFO] RUNTIME_FRAMEWORK(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.851.791 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.

----------------------------------------------------
- C++ Call Stack: (For framework developers)
----------------------------------------------------
mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.851.848 [npu_driver.cc:974] 619021 NormalSqCqFree: Normal sqcq free success, sqId=6, cqId=6, device_id=4, tsId=0, drvFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.851.868 [stream_sqcq_manage.cc:228] 619021 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=6, cq_id=6, stream_id=6, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.851.882 [npu_driver.cc:432] 619021 StreamIdFree: stream id free begin, device_id=4, stream_id=6, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.851.902 [npu_driver.cc:441] 619021 StreamIdFree: Stream id free success, stream_id=6, device_id=4, tsId=0, streamFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.851.921 [device_msg_handler.cc:110] 619021 HandleMsg: Begin to process device errMessage.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.851.912 [context.cpp:72]619019 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.851.947 [api_impl.cc:3717] 619019 ContextSetCurrent: set context=aaab0103b880, flag=0.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.851.967 [context.cpp:80]619019 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.851.992 [api_error.cc:1807] 619019 MemcpyAsyncCheckKindAndLocation: src pointer loc type=1, dst pointer loc type=2, kind=1
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:47.852.004 [mindspore/ccsrc/common/amp/amp.cc:149] GetCurrentAmpStrategy] amp strategy stack is empty
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.012 [memory_task.cc:342] 619019 ConvertCpyType: MemcpyAsyncTask::ConvertCpyType MEMCPY_HOST_TO_DEVICE, direct=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.033 [memory_task.cc:473] 619019 MemcpyAsyncTaskInitV3: Init qos=0, partId=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.048 [memory_task.cc:518] 619019 MemcpyAsyncTaskInitV3: CopyType=0: use virtual address directly.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.062 [task_res.cc:380] 619019 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=7, stream_id=2, taskResId=2, taskResHead_=0, taskResTail_=3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.079 [memory_task.cc:1007] 619019 ConstructPcieDmaSqe: stream_id=2, task_id=2, copyType=0, src=0xaaab0cc46fc0, dst=0x12c2c0000000, len=0x6c
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.097 [memory_task.cc:1166] 619019 ConstructSqeForMemcpyAsyncTask: MemcpyAsyncTask, stream_id=2, task_id=2, copyType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.109 [stream.cc:1400] 619019 AddTaskToList: public task, stream_id=2, task_id=2, task_type=5 (MEMCPY_ASYNC), head=0, tail=3
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.852.112 [device_msg_handler.cc:127] 619020 HandleMsg: Finished to process device errInfo, retCode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.126 [stream.cc:2595] 619019 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=2, type=5(MEMCPY_ASYNC), head=0, tail=3, sqe_num=1, lastTail=2, device_id=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.146 [task_submit.cc:573] 619019 AllocTaskAndSendStars: device_id=7, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=2, task_type=5(MEMCPY_ASYNC).
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.172 [stream.cc:1494] 619019 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=2.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.852.194 [callback.cpp:97]619019 aclrtLaunchCallback: start to execute aclrtLaunchCallback.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.852.187 [runtime.cc:5239] 619020 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.216 [task_res.cc:380] 619019 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=7, stream_id=2, taskResId=3, taskResHead_=0, taskResTail_=4.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.852.227 [npu_driver.cc:500] 619020 GetFaultEvent: get fault event, device_id=2, filterFlag=8, outputLen=128.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.237 [task_info.cc:521] 619019 ConstructSqeForCallbackLaunchTask: CallbackLaunch,topic_type=4,stream_id=2,task_id=3,eventId=65535,isBlock=0,pid=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.254 [stream.cc:1400] 619019 AddTaskToList: public task, stream_id=2, task_id=3, task_type=72 (HOSTFUNC_CALLBACK), head=0, tail=4
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.268 [stream.cc:2595] 619019 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=3, type=72(HOSTFUNC_CALLBACK), head=0, tail=4, sqe_num=1, lastTail=3, device_id=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.287 [task_submit.cc:573] 619019 AllocTaskAndSendStars: device_id=7, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=3, task_type=72(HOSTFUNC_CALLBACK).
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.304 [stream.cc:1494] 619019 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=3.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.852.297 [acl.cpp:782]619020 GetFaultEventInfo: can not get fault event of device 2, runtime errorCode is 0
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.852.315 [callback.cpp:109]619019 aclrtLaunchCallback: successfully execute aclrtLaunchCallback
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.322 [npu_driver.cc:3844] 618818 CqReportGet: cq report get start, device_id=7, tsId=0.
[INFO] GE(618654,python3.9):2025-04-03-09:27:47.852.324 [error_manager.cc:989]619020 GetRawErrorMessages:current work_stream_id:0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.362 [npu_driver.cc:3851] 618818 CqReportGet: halCqReportGet count=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.374 [api_impl.cc:5087] 618818 ProcessReport: report[0], sqid=12291, streamId=2, taskId=3, eventId=65535, isBlock=0
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.852.389 [callback.cpp:138]618818 aclrtProcessReport: successfully aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.852.397 [device.cpp:231]619019 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.852.400 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.424 [runtime.cc:5239] 619019 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.432 [npu_driver.cc:3828] 618818 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=64.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.852.446 [acl.cpp:802]619019 aclGetRecentErrMsg: start to execute aclGetRecentErrMsg.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.481 [npu_driver.cc:404] 619019 StreamIdAlloc: stream id alloc begin, device_id=7, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.511 [stream.cc:2246] 619019 AllocExecutedTimesSvm: stream_id=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.550 [stream_sqcq_manage.cc:147] 619019 Alloc: deviceId=7, tsId=0, drvFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.567 [npu_driver.cc:882] 619019 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[CRITICAL] KERNEL(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.852.656 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.852.668 [device_msg_handler.cc:127] 619021 HandleMsg: Finished to process device errInfo, retCode=0.
[INFO] DEBUG(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.852.699 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
[INFO] DEBUG(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.852.724 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.852.724 [runtime.cc:5239] 619021 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] DEBUG(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.852.743 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.852.759 [npu_driver.cc:500] 619021 GetFaultEvent: get fault event, device_id=4, filterFlag=8, outputLen=128.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.822 [npu_driver.cc:6125] 619019 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.852.824 [acl.cpp:782]619021 GetFaultEventInfo: can not get fault event of device 4, runtime errorCode is 0
[INFO] GE(618662,python3.9):2025-04-03-09:27:47.852.851 [error_manager.cc:989]619021 GetRawErrorMessages:current work_stream_id:0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.865 [npu_driver.cc:6137] 619019 LogicCqAllocateV2: success: deviceId=7, tsId=0, cqId=337, streamId=7, logicCq=337, cqeDepth=4096
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.888 [npu_driver.cc:6189] 619019 StreamBindLogicCq: success: deviceId=7, tsId=0, streamId=7, logicCq=337.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.906 [npu_driver.cc:5916] 619019 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=c8006000, addr=dfffc8006000size=4096
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.922 [stream.cc:653] 619019 Setup: Success to get sq=7 sq reg virtual addr length=4096.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.962 [stream.cc:276] 619019 CreateStreamTaskRes: Normal STREAM Setup stream_id=7 flags_=0x0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.852.979 [stream.cc:688] 619019 Setup: stream setup end, stream_id=7, IsTaskSink=0, sqId=7, cqId=7, deviceId=7, streamResId=65534
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.852.997 [acl_resource_manager.cpp:814]619019 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.853.009 [acl_resource_manager.cpp:816]619019 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME_FRAMEWORK(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.852.997 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.

----------------------------------------------------
- C++ Call Stack: (For framework developers)
----------------------------------------------------
mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.057 [engine.cc:188] 619019 SubmitTaskNormal: stream_id=7,task_id=0,task_type=87 (GET_DEVICE_MSG).
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.076 [npu_driver.cc:5547] 619019 GetSqHead: deviceId=7, tsId=0, sqId=7, head=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.094 [task_info.cc:409] 619019 ConstructSqeForGetDevMsgTask: stream_id:7, task_id:0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.109 [stream.cc:1400] 619019 AddTaskToList: public task, stream_id=7, task_id=0, task_type=87 (GET_DEVICE_MSG), head=0, tail=1
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.853.112 [context.cpp:72]619020 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.137 [api_impl.cc:3717] 619020 ContextSetCurrent: set context=aaaaf5082ff0, flag=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.126 [stream.cc:2595] 619019 StarsAddTaskToStream: single-operator flow stream, stream_id=7, task_id=0, type=87(GET_DEVICE_MSG), head=0, tail=1, sqe_num=1, lastTail=0, device_id=7
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.853.153 [context.cpp:80]619020 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.158 [npu_driver.cc:751] 619019 SqTaskSend: device_id=7, ts_id=0, sq_id=7, sqe_num=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.172 [stars_engine.cc:893] 619019 SendTask: Sq task send finished, device_id=7, ts_id=0, sq_id=7, cq_id=7, stream_id=7, task_id=0, task_type=87(GET_DEVICE_MSG).
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.187 [stream.cc:1494] 619019 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[CRITICAL] KERNEL(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.853.174 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.178 [api_error.cc:1807] 619020 MemcpyAsyncCheckKindAndLocation: src pointer loc type=1, dst pointer loc type=2, kind=1
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:47.853.190 [mindspore/ccsrc/common/amp/amp.cc:149] GetCurrentAmpStrategy] amp strategy stack is empty
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.197 [memory_task.cc:342] 619020 ConvertCpyType: MemcpyAsyncTask::ConvertCpyType MEMCPY_HOST_TO_DEVICE, direct=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.201 [npu_driver.cc:5547] 619019 GetSqHead: deviceId=7, tsId=0, sqId=7, head=1.
[INFO] DEBUG(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.853.214 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.217 [task.cc:185] 619019 GetTask: this stream no taskRes, stream_id=7
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.215 [memory_task.cc:473] 619020 MemcpyAsyncTaskInitV3: Init qos=0, partId=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.231 [memory_task.cc:518] 619020 MemcpyAsyncTaskInitV3: CopyType=0: use virtual address directly.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.231 [task.cc:185] 619019 GetTask: this stream no taskRes, stream_id=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.245 [logger.cc:152] 619019 TaskFinished: device_id=7, stream_id=7, task_id=0, task_type=87 (GET_DEVICE_MSG), task_finish_num=7
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.248 [task_res.cc:380] 619020 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=2, stream_id=2, taskResId=2, taskResHead_=0, taskResTail_=3.
[INFO] DEBUG(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.853.237 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.262 [stars_engine.cc:437] 619019 FinishedTaskReclaim: recycle task, stream_id=7, limited=0, taskHead=0, sqHead=1, endTaskId=0, recycleTaskId=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.263 [memory_task.cc:1007] 619020 ConstructPcieDmaSqe: stream_id=2, task_id=2, copyType=0, src=0xaaab00c8d530, dst=0x12c2c0000000, len=0x6c
[INFO] DEBUG(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.853.268 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.276 [stream.cc:2886] 619019 StarsWaitForTask: No.0 stream_id=7, taskId=0, currentId=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.277 [memory_task.cc:1166] 619020 ConstructSqeForMemcpyAsyncTask: MemcpyAsyncTask, stream_id=2, task_id=2, copyType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.290 [stream.cc:852] 619019 TearDown: stream_id=7, sqId=7, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.290 [stream.cc:1400] 619020 AddTaskToList: public task, stream_id=2, task_id=2, task_type=5 (MEMCPY_ASYNC), head=0, tail=3
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.305 [stream.cc:938] 619019 TearDown: stream_id=7, delay recycle task num=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.319 [stream.cc:1507] 619019 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.305 [stream.cc:2595] 619020 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=2, type=5(MEMCPY_ASYNC), head=0, tail=3, sqe_num=1, lastTail=2, device_id=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.338 [task_submit.cc:573] 619020 AllocTaskAndSendStars: device_id=2, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=2, task_type=5(MEMCPY_ASYNC).
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.340 [stream_sqcq_manage.cc:451] 619019 FreeLogicCq: Return(0), threadIdentifier(281469171527584), devId(7), tsId(0), cqId(337), isFastCq(0).
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.353 [stream.cc:1494] 619020 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=2.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.361 [npu_driver.cc:6163] 619019 StreamUnBindLogicCq: success: deviceId=7, tsId=0, streamId=7, logicCq=337.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.853.377 [callback.cpp:97]619020 aclrtLaunchCallback: start to execute aclrtLaunchCallback.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.389 [npu_driver.cc:1180] 619019 LogicCqFree: Succ:device_id=7,ts_id=0,type=2,logic_cq_id=337, drvFlag=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.405 [stream.cc:237] 619019 FreeStreamId: Free stream_id=7.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.399 [task_res.cc:380] 619020 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=2, stream_id=2, taskResId=3, taskResHead_=0, taskResTail_=4.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.418 [stream_sqcq_manage.cc:216] 619019 DeAllocStreamSqCq: deviceId=7, tsId=0, drvFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.419 [task_info.cc:521] 619020 ConstructSqeForCallbackLaunchTask: CallbackLaunch,topic_type=4,stream_id=2,task_id=3,eventId=65535,isBlock=0,pid=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.431 [npu_driver.cc:966] 619019 NormalSqCqFree: Normal sqcq free, sqId=7, cqId=7, device_id=7, tsId=0, drvFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.434 [stream.cc:1400] 619020 AddTaskToList: public task, stream_id=2, task_id=3, task_type=72 (HOSTFUNC_CALLBACK), head=0, tail=4
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.448 [stream.cc:2595] 619020 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=3, type=72(HOSTFUNC_CALLBACK), head=0, tail=4, sqe_num=1, lastTail=3, device_id=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.464 [task_submit.cc:573] 619020 AllocTaskAndSendStars: device_id=2, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=3, task_type=72(HOSTFUNC_CALLBACK).
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.481 [stream.cc:1494] 619020 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=3.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.853.493 [callback.cpp:109]619020 aclrtLaunchCallback: successfully execute aclrtLaunchCallback
[INFO] RUNTIME_FRAMEWORK(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.853.480 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.

----------------------------------------------------
- C++ Call Stack: (For framework developers)
----------------------------------------------------
mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.507 [npu_driver.cc:3844] 618832 CqReportGet: cq report get start, device_id=2, tsId=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.528 [npu_driver.cc:3851] 618832 CqReportGet: halCqReportGet count=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.539 [api_impl.cc:5087] 618832 ProcessReport: report[0], sqid=12291, streamId=2, taskId=3, eventId=65535, isBlock=0
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.853.560 [callback.cpp:138]618832 aclrtProcessReport: successfully aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.853.566 [device.cpp:231]619020 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.853.578 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.585 [runtime.cc:5239] 619020 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.593 [npu_driver.cc:3828] 618832 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=320.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.853.599 [acl.cpp:802]619020 aclGetRecentErrMsg: start to execute aclGetRecentErrMsg.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.853.583 [context.cpp:72]619021 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.853.606 [api_impl.cc:3717] 619021 ContextSetCurrent: set context=aaab087d6320, flag=0.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.853.623 [context.cpp:80]619021 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.633 [npu_driver.cc:404] 619020 StreamIdAlloc: stream id alloc begin, device_id=2, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.853.646 [api_error.cc:1807] 619021 MemcpyAsyncCheckKindAndLocation: src pointer loc type=1, dst pointer loc type=2, kind=1
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:47.853.650 [mindspore/ccsrc/common/amp/amp.cc:149] GetCurrentAmpStrategy] amp strategy stack is empty
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.853.665 [memory_task.cc:342] 619021 ConvertCpyType: MemcpyAsyncTask::ConvertCpyType MEMCPY_HOST_TO_DEVICE, direct=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.661 [stream.cc:2246] 619020 AllocExecutedTimesSvm: stream_id=7.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.853.681 [memory_task.cc:473] 619021 MemcpyAsyncTaskInitV3: Init qos=0, partId=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.853.694 [memory_task.cc:518] 619021 MemcpyAsyncTaskInitV3: CopyType=0: use virtual address directly.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.700 [stream_sqcq_manage.cc:147] 619020 Alloc: deviceId=2, tsId=0, drvFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.717 [npu_driver.cc:882] 619020 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.853.708 [task_res.cc:380] 619021 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=4, stream_id=2, taskResId=2, taskResHead_=0, taskResTail_=3.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.853.725 [memory_task.cc:1007] 619021 ConstructPcieDmaSqe: stream_id=2, task_id=2, copyType=0, src=0xaaab1421bce0, dst=0x12c2c0000000, len=0x6c
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.853.743 [memory_task.cc:1166] 619021 ConstructSqeForMemcpyAsyncTask: MemcpyAsyncTask, stream_id=2, task_id=2, copyType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.853.756 [stream.cc:1400] 619021 AddTaskToList: public task, stream_id=2, task_id=2, task_type=5 (MEMCPY_ASYNC), head=0, tail=3
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.853.772 [stream.cc:2595] 619021 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=2, type=5(MEMCPY_ASYNC), head=0, tail=3, sqe_num=1, lastTail=2, device_id=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.853.792 [task_submit.cc:573] 619021 AllocTaskAndSendStars: device_id=4, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=2, task_type=5(MEMCPY_ASYNC).
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.853.809 [stream.cc:1494] 619021 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=2.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.853.827 [callback.cpp:97]619021 aclrtLaunchCallback: start to execute aclrtLaunchCallback.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.853.845 [task_res.cc:380] 619021 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=4, stream_id=2, taskResId=3, taskResHead_=0, taskResTail_=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.853.863 [task_info.cc:521] 619021 ConstructSqeForCallbackLaunchTask: CallbackLaunch,topic_type=4,stream_id=2,task_id=3,eventId=65535,isBlock=0,pid=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.853.880 [stream.cc:1400] 619021 AddTaskToList: public task, stream_id=2, task_id=3, task_type=72 (HOSTFUNC_CALLBACK), head=0, tail=4
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.879 [npu_driver.cc:974] 619019 NormalSqCqFree: Normal sqcq free success, sqId=7, cqId=7, device_id=7, tsId=0, drvFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.897 [stream_sqcq_manage.cc:228] 619019 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=7, cq_id=7, stream_id=7, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.899 [npu_driver.cc:6125] 619020 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.853.894 [stream.cc:2595] 619021 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=3, type=72(HOSTFUNC_CALLBACK), head=0, tail=4, sqe_num=1, lastTail=3, device_id=4
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.917 [npu_driver.cc:432] 619019 StreamIdFree: stream id free begin, device_id=7, stream_id=7, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.853.922 [task_submit.cc:573] 619021 AllocTaskAndSendStars: device_id=4, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=3, task_type=72(HOSTFUNC_CALLBACK).
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.853.938 [stream.cc:1494] 619021 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=3.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.853.949 [callback.cpp:109]619021 aclrtLaunchCallback: successfully execute aclrtLaunchCallback
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.937 [npu_driver.cc:441] 619019 StreamIdFree: Stream id free success, stream_id=7, device_id=7, tsId=0, streamFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.941 [npu_driver.cc:6137] 619020 LogicCqAllocateV2: success: deviceId=2, tsId=0, cqId=1003, streamId=7, logicCq=1003, cqeDepth=4096
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.956 [device_msg_handler.cc:110] 619019 HandleMsg: Begin to process device errMessage.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.853.965 [npu_driver.cc:3844] 618816 CqReportGet: cq report get start, device_id=4, tsId=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.853.988 [npu_driver.cc:3851] 618816 CqReportGet: halCqReportGet count=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.977 [npu_driver.cc:6189] 619020 StreamBindLogicCq: success: deviceId=2, tsId=0, streamId=7, logicCq=1003.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.853.996 [npu_driver.cc:5916] 619020 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=d0095000, addr=dfffd0095000size=4096
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.002 [api_impl.cc:5087] 618816 ProcessReport: report[0], sqid=12291, streamId=2, taskId=3, eventId=65535, isBlock=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.854.010 [stream.cc:653] 619020 Setup: Success to get sq=7 sq reg virtual addr length=4096.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.854.019 [callback.cpp:138]618816 aclrtProcessReport: successfully aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.854.024 [device.cpp:231]619021 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.854.036 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.043 [runtime.cc:5239] 619021 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.052 [npu_driver.cc:3828] 618816 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=832.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.854.058 [acl.cpp:802]619021 aclGetRecentErrMsg: start to execute aclGetRecentErrMsg.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.854.054 [stream.cc:276] 619020 CreateStreamTaskRes: Normal STREAM Setup stream_id=7 flags_=0x0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.854.070 [stream.cc:688] 619020 Setup: stream setup end, stream_id=7, IsTaskSink=0, sqId=7, cqId=7, deviceId=2, streamResId=65534
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.854.091 [acl_resource_manager.cpp:814]619020 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.854.104 [acl_resource_manager.cpp:816]619020 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.091 [npu_driver.cc:404] 619021 StreamIdAlloc: stream id alloc begin, device_id=4, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.119 [stream.cc:2246] 619021 AllocExecutedTimesSvm: stream_id=7.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.854.154 [engine.cc:188] 619020 SubmitTaskNormal: stream_id=7,task_id=0,task_type=87 (GET_DEVICE_MSG).
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.159 [stream_sqcq_manage.cc:147] 619021 Alloc: deviceId=4, tsId=0, drvFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.176 [npu_driver.cc:882] 619021 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.854.174 [npu_driver.cc:5547] 619020 GetSqHead: deviceId=2, tsId=0, sqId=7, head=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.854.193 [task_info.cc:409] 619020 ConstructSqeForGetDevMsgTask: stream_id:7, task_id:0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.854.207 [stream.cc:1400] 619020 AddTaskToList: public task, stream_id=7, task_id=0, task_type=87 (GET_DEVICE_MSG), head=0, tail=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.854.222 [stream.cc:2595] 619020 StarsAddTaskToStream: single-operator flow stream, stream_id=7, task_id=0, type=87(GET_DEVICE_MSG), head=0, tail=1, sqe_num=1, lastTail=0, device_id=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.854.241 [npu_driver.cc:751] 619020 SqTaskSend: device_id=2, ts_id=0, sq_id=7, sqe_num=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.854.253 [stars_engine.cc:893] 619020 SendTask: Sq task send finished, device_id=2, ts_id=0, sq_id=7, cq_id=7, stream_id=7, task_id=0, task_type=87(GET_DEVICE_MSG).
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.854.270 [stream.cc:1494] 619020 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.854.266 [device_msg_handler.cc:127] 619019 HandleMsg: Finished to process device errInfo, retCode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.854.284 [npu_driver.cc:5547] 619020 GetSqHead: deviceId=2, tsId=0, sqId=7, head=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.854.301 [task.cc:185] 619020 GetTask: this stream no taskRes, stream_id=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.854.299 [runtime.cc:5239] 619019 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.854.315 [task.cc:185] 619020 GetTask: this stream no taskRes, stream_id=7
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.854.329 [logger.cc:152] 619020 TaskFinished: device_id=2, stream_id=7, task_id=0, task_type=87 (GET_DEVICE_MSG), task_finish_num=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.854.321 [npu_driver.cc:500] 619019 GetFaultEvent: get fault event, device_id=7, filterFlag=8, outputLen=128.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.854.345 [stars_engine.cc:437] 619020 FinishedTaskReclaim: recycle task, stream_id=7, limited=0, taskHead=0, sqHead=1, endTaskId=0, recycleTaskId=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.854.362 [stream.cc:2886] 619020 StarsWaitForTask: No.0 stream_id=7, taskId=0, currentId=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.854.377 [stream.cc:852] 619020 TearDown: stream_id=7, sqId=7, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.854.394 [stream.cc:938] 619020 TearDown: stream_id=7, delay recycle task num=0.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.854.390 [acl.cpp:782]619019 GetFaultEventInfo: can not get fault event of device 7, runtime errorCode is 0
[INFO] GE(618674,python3.9):2025-04-03-09:27:47.854.408 [error_manager.cc:989]619019 GetRawErrorMessages:current work_stream_id:0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.854.406 [stream.cc:1507] 619020 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.417 [npu_driver.cc:6125] 619021 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.854.429 [stream_sqcq_manage.cc:451] 619020 FreeLogicCq: Return(0), threadIdentifier(281469230182304), devId(2), tsId(0), cqId(1003), isFastCq(0).
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.854.460 [npu_driver.cc:6163] 619020 StreamUnBindLogicCq: success: deviceId=2, tsId=0, streamId=7, logicCq=1003.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.460 [npu_driver.cc:6137] 619021 LogicCqAllocateV2: success: deviceId=4, tsId=0, cqId=317, streamId=7, logicCq=317, cqeDepth=4096
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.483 [npu_driver.cc:6189] 619021 StreamBindLogicCq: success: deviceId=4, tsId=0, streamId=7, logicCq=317.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.854.490 [npu_driver.cc:1180] 619020 LogicCqFree: Succ:device_id=2,ts_id=0,type=2,logic_cq_id=1003, drvFlag=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.854.506 [stream.cc:237] 619020 FreeStreamId: Free stream_id=7.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.502 [npu_driver.cc:5916] 619021 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=e03eb000, addr=dfffe03eb000size=4096
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.518 [stream.cc:653] 619021 Setup: Success to get sq=7 sq reg virtual addr length=4096.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.854.519 [stream_sqcq_manage.cc:216] 619020 DeAllocStreamSqCq: deviceId=2, tsId=0, drvFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.854.531 [npu_driver.cc:966] 619020 NormalSqCqFree: Normal sqcq free, sqId=7, cqId=7, device_id=2, tsId=0, drvFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.558 [stream.cc:276] 619021 CreateStreamTaskRes: Normal STREAM Setup stream_id=7 flags_=0x0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.575 [stream.cc:688] 619021 Setup: stream setup end, stream_id=7, IsTaskSink=0, sqId=7, cqId=7, deviceId=4, streamResId=65534
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.854.594 [acl_resource_manager.cpp:814]619021 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.854.610 [acl_resource_manager.cpp:816]619021 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.649 [engine.cc:188] 619021 SubmitTaskNormal: stream_id=7,task_id=0,task_type=87 (GET_DEVICE_MSG).
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.678 [npu_driver.cc:5547] 619021 GetSqHead: deviceId=4, tsId=0, sqId=7, head=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.697 [task_info.cc:409] 619021 ConstructSqeForGetDevMsgTask: stream_id:7, task_id:0.
[CRITICAL] KERNEL(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.854.701 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.713 [stream.cc:1400] 619021 AddTaskToList: public task, stream_id=7, task_id=0, task_type=87 (GET_DEVICE_MSG), head=0, tail=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.730 [stream.cc:2595] 619021 StarsAddTaskToStream: single-operator flow stream, stream_id=7, task_id=0, type=87(GET_DEVICE_MSG), head=0, tail=1, sqe_num=1, lastTail=0, device_id=4
[INFO] DEBUG(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.854.733 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.747 [npu_driver.cc:751] 619021 SqTaskSend: device_id=4, ts_id=0, sq_id=7, sqe_num=1.
[INFO] DEBUG(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.854.755 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.762 [stars_engine.cc:893] 619021 SendTask: Sq task send finished, device_id=4, ts_id=0, sq_id=7, cq_id=7, stream_id=7, task_id=0, task_type=87(GET_DEVICE_MSG).
[INFO] DEBUG(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.854.773 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.777 [stream.cc:1494] 619021 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.792 [npu_driver.cc:5547] 619021 GetSqHead: deviceId=4, tsId=0, sqId=7, head=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.809 [task.cc:185] 619021 GetTask: this stream no taskRes, stream_id=7
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.822 [task.cc:185] 619021 GetTask: this stream no taskRes, stream_id=7
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.838 [logger.cc:152] 619021 TaskFinished: device_id=4, stream_id=7, task_id=0, task_type=87 (GET_DEVICE_MSG), task_finish_num=7
[INFO] RUNTIME_FRAMEWORK(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.854.844 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.

----------------------------------------------------
- C++ Call Stack: (For framework developers)
----------------------------------------------------
mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.857 [stars_engine.cc:437] 619021 FinishedTaskReclaim: recycle task, stream_id=7, limited=0, taskHead=0, sqHead=1, endTaskId=0, recycleTaskId=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.875 [stream.cc:2886] 619021 StarsWaitForTask: No.0 stream_id=7, taskId=0, currentId=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.889 [stream.cc:852] 619021 TearDown: stream_id=7, sqId=7, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.906 [stream.cc:938] 619021 TearDown: stream_id=7, delay recycle task num=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.917 [stream.cc:1507] 619021 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.854.926 [context.cpp:72]619019 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.938 [stream_sqcq_manage.cc:451] 619021 FreeLogicCq: Return(0), threadIdentifier(281469901270944), devId(4), tsId(0), cqId(317), isFastCq(0).
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.854.948 [api_impl.cc:3717] 619019 ContextSetCurrent: set context=aaab0103b880, flag=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.957 [npu_driver.cc:6163] 619021 StreamUnBindLogicCq: success: deviceId=4, tsId=0, streamId=7, logicCq=317.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.854.966 [context.cpp:80]619019 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.854.985 [npu_driver.cc:1180] 619021 LogicCqFree: Succ:device_id=4,ts_id=0,type=2,logic_cq_id=317, drvFlag=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.855.002 [stream.cc:237] 619021 FreeStreamId: Free stream_id=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.854.989 [api_error.cc:1807] 619019 MemcpyAsyncCheckKindAndLocation: src pointer loc type=1, dst pointer loc type=2, kind=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.854.991 [npu_driver.cc:974] 619020 NormalSqCqFree: Normal sqcq free success, sqId=7, cqId=7, device_id=2, tsId=0, drvFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.855.014 [stream_sqcq_manage.cc:216] 619021 DeAllocStreamSqCq: deviceId=4, tsId=0, drvFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.006 [memory_task.cc:342] 619019 ConvertCpyType: MemcpyAsyncTask::ConvertCpyType MEMCPY_HOST_TO_DEVICE, direct=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.020 [memory_task.cc:473] 619019 MemcpyAsyncTaskInitV3: Init qos=0, partId=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.855.027 [npu_driver.cc:966] 619021 NormalSqCqFree: Normal sqcq free, sqId=7, cqId=7, device_id=4, tsId=0, drvFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.855.009 [stream_sqcq_manage.cc:228] 619020 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=7, cq_id=7, stream_id=7, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.855.025 [npu_driver.cc:432] 619020 StreamIdFree: stream id free begin, device_id=2, stream_id=7, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.032 [memory_task.cc:518] 619019 MemcpyAsyncTaskInitV3: CopyType=0: use virtual address directly.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.045 [task_res.cc:380] 619019 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=7, stream_id=2, taskResId=4, taskResHead_=0, taskResTail_=5.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.855.040 [npu_driver.cc:441] 619020 StreamIdFree: Stream id free success, stream_id=7, device_id=2, tsId=0, streamFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.855.057 [device_msg_handler.cc:110] 619020 HandleMsg: Begin to process device errMessage.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.061 [memory_task.cc:1007] 619019 ConstructPcieDmaSqe: stream_id=2, task_id=4, copyType=0, src=0xaaab0cc47a30, dst=0x12c2c0000000, len=0x6c
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.078 [memory_task.cc:1166] 619019 ConstructSqeForMemcpyAsyncTask: MemcpyAsyncTask, stream_id=2, task_id=4, copyType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.092 [stream.cc:1400] 619019 AddTaskToList: public task, stream_id=2, task_id=4, task_type=5 (MEMCPY_ASYNC), head=0, tail=5
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.108 [stream.cc:2595] 619019 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=4, type=5(MEMCPY_ASYNC), head=0, tail=5, sqe_num=1, lastTail=4, device_id=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.127 [task_submit.cc:573] 619019 AllocTaskAndSendStars: device_id=7, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=4, task_type=5(MEMCPY_ASYNC).
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.144 [stream.cc:1494] 619019 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=4.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.855.161 [callback.cpp:97]619019 aclrtLaunchCallback: start to execute aclrtLaunchCallback.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.189 [task_res.cc:380] 619019 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=7, stream_id=2, taskResId=5, taskResHead_=0, taskResTail_=6.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.207 [task_info.cc:521] 619019 ConstructSqeForCallbackLaunchTask: CallbackLaunch,topic_type=4,stream_id=2,task_id=5,eventId=65535,isBlock=0,pid=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.224 [stream.cc:1400] 619019 AddTaskToList: public task, stream_id=2, task_id=5, task_type=72 (HOSTFUNC_CALLBACK), head=0, tail=6
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.241 [stream.cc:2595] 619019 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=5, type=72(HOSTFUNC_CALLBACK), head=0, tail=6, sqe_num=1, lastTail=5, device_id=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.259 [task_submit.cc:573] 619019 AllocTaskAndSendStars: device_id=7, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=5, task_type=72(HOSTFUNC_CALLBACK).
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.276 [stream.cc:1494] 619019 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=5.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.855.287 [callback.cpp:109]619019 aclrtLaunchCallback: successfully execute aclrtLaunchCallback
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.291 [npu_driver.cc:3844] 618818 CqReportGet: cq report get start, device_id=7, tsId=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.308 [npu_driver.cc:3851] 618818 CqReportGet: halCqReportGet count=1
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.319 [api_impl.cc:5087] 618818 ProcessReport: report[0], sqid=12291, streamId=2, taskId=5, eventId=65535, isBlock=0
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.855.333 [callback.cpp:138]618818 aclrtProcessReport: successfully aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.855.348 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.855.355 [device.cpp:231]619019 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.363 [npu_driver.cc:3828] 618818 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=64.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.855.362 [device_msg_handler.cc:127] 619020 HandleMsg: Finished to process device errInfo, retCode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.380 [runtime.cc:5239] 619019 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.855.399 [acl.cpp:802]619019 aclGetRecentErrMsg: start to execute aclGetRecentErrMsg.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.855.394 [runtime.cc:5239] 619020 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.855.418 [npu_driver.cc:500] 619020 GetFaultEvent: get fault event, device_id=2, filterFlag=8, outputLen=128.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.426 [npu_driver.cc:404] 619019 StreamIdAlloc: stream id alloc begin, device_id=7, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.453 [stream.cc:2246] 619019 AllocExecutedTimesSvm: stream_id=8.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.855.476 [acl.cpp:782]619020 GetFaultEventInfo: can not get fault event of device 2, runtime errorCode is 0
[INFO] GE(618654,python3.9):2025-04-03-09:27:47.855.495 [error_manager.cc:989]619020 GetRawErrorMessages:current work_stream_id:0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.491 [stream_sqcq_manage.cc:147] 619019 Alloc: deviceId=7, tsId=0, drvFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.507 [npu_driver.cc:882] 619019 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.855.513 [npu_driver.cc:974] 619021 NormalSqCqFree: Normal sqcq free success, sqId=7, cqId=7, device_id=4, tsId=0, drvFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.855.531 [stream_sqcq_manage.cc:228] 619021 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=7, cq_id=7, stream_id=7, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.855.547 [npu_driver.cc:432] 619021 StreamIdFree: stream id free begin, device_id=4, stream_id=7, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.855.573 [npu_driver.cc:441] 619021 StreamIdFree: Stream id free success, stream_id=7, device_id=4, tsId=0, streamFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.855.592 [device_msg_handler.cc:110] 619021 HandleMsg: Begin to process device errMessage.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.739 [npu_driver.cc:6125] 619019 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.780 [npu_driver.cc:6137] 619019 LogicCqAllocateV2: success: deviceId=7, tsId=0, cqId=338, streamId=8, logicCq=338, cqeDepth=4096
[CRITICAL] KERNEL(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.855.793 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.802 [npu_driver.cc:6189] 619019 StreamBindLogicCq: success: deviceId=7, tsId=0, streamId=8, logicCq=338.
[INFO] DEBUG(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.855.826 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.820 [npu_driver.cc:5916] 619019 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=c8006000, addr=dfffc8006000size=4096
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.836 [stream.cc:653] 6190[INFO] DEBUG(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.855.847 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
19 Setup: Success to get sq=8 sq reg virtual addr length=4096.
[INFO] DEBUG(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.855.866 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.895 [stream.cc:276] 619019 CreateStreamTaskRes: Normal STREAM Setup stream_id=8 flags_=0x0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.855.908 [device_msg_handler.cc:127] 619021 HandleMsg: Finished to process device errInfo, retCode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.912 [stream.cc:688] 619019 Setup: stream setup end, stream_id=8, IsTaskSink=0, sqId=8, cqId=8, deviceId=7, streamResId=65534
[INFO] RUNTIME_FRAMEWORK(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.855.935 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.

----------------------------------------------------
- C++ Call Stack: (For framework developers)
----------------------------------------------------
mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.855.931 [acl_resource_manager.cpp:814]619019 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.855.944 [acl_resource_manager.cpp:816]619019 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.855.942 [runtime.cc:5239] 619021 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.855.964 [npu_driver.cc:500] 619021 GetFaultEvent: get fault event, device_id=4, filterFlag=8, outputLen=128.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.855.985 [engine.cc:188] 619019 SubmitTaskNormal: stream_id=8,task_id=0,task_type=87 (GET_DEVICE_MSG).
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.856.004 [npu_driver.cc:5547] 619019 GetSqHead: deviceId=7, tsId=0, sqId=8, head=0.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.856.014 [context.cpp:72]619020 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.856.023 [task_info.cc:409] 619019 ConstructSqeForGetDevMsgTask: stream_id:8, task_id:0.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.856.022 [acl.cpp:782]619021 GetFaultEventInfo: can not get fault event of device 4, runtime errorCode is 0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.037 [api_impl.cc:3717] 619020 ContextSetCurrent: set context=aaaaf5082ff0, flag=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.856.038 [stream.cc:1400] 619019 AddTaskToList: public task, stream_id=8, task_id=0, task_type=87 (GET_DEVICE_MSG), head=0, tail=1
[INFO] GE(618662,python3.9):2025-04-03-09:27:47.856.040 [error_manager.cc:989]619021 GetRawErrorMessages:current work_stream_id:0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.856.052 [stream.cc:2595] 619019 StarsAddTaskToStream: single-operator flow stream, stream_id=8, task_id=0, type=87(GET_DEVICE_MSG), head=0, tail=1, sqe_num=1, lastTail=0, device_id=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.856.072 [npu_driver.cc:751] 619019 SqTaskSend: device_id=7, ts_id=0, sq_id=8, sqe_num=1.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.856.053 [context.cpp:80]619020 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.856.085 [stars_engine.cc:893] 619019 SendTask: Sq task send finished, device_id=7, ts_id=0, sq_id=8, cq_id=8, stream_id=8, task_id=0, task_type=87(GET_DEVICE_MSG).
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.856.103 [stream.cc:1494] 619019 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.090 [api_error.cc:1807] 619020 MemcpyAsyncCheckKindAndLocation: src pointer loc type=1, dst pointer loc type=2, kind=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.109 [memory_task.cc:342] 619020 ConvertCpyType: MemcpyAsyncTask::ConvertCpyType MEMCPY_HOST_TO_DEVICE, direct=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.123 [memory_task.cc:473] 619020 MemcpyAsyncTaskInitV3: Init qos=0, partId=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.856.118 [npu_driver.cc:5547] 619019 GetSqHead: deviceId=7, tsId=0, sqId=8, head=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.856.135 [task.cc:185] 619019 GetTask: this stream no taskRes, stream_id=8
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.135 [memory_task.cc:518] 619020 MemcpyAsyncTaskInitV3: CopyType=0: use virtual address directly.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.856.149 [task.cc:185] 619019 GetTask: this stream no taskRes, stream_id=8
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.856.193 [logger.cc:152] 619019 TaskFinished: device_id=7, stream_id=8, task_id=0, task_type=87 (GET_DEVICE_MSG), task_finish_num=8
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.153 [task_res.cc:380] 619020 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=2, stream_id=2, taskResId=4, taskResHead_=0, taskResTail_=5.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.201 [memory_task.cc:1007] 619020 ConstructPcieDmaSqe: stream_id=2, task_id=4, copyType=0, src=0xaaab00c8dfa0, dst=0x12c2c0000000, len=0x6c
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.216 [memory_task.cc:1166] 619020 ConstructSqeForMemcpyAsyncTask: MemcpyAsyncTask, stream_id=2, task_id=4, copyType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.856.214 [stars_engine.cc:437] 619019 FinishedTaskReclaim: recycle task, stream_id=8, limited=0, taskHead=0, sqHead=1, endTaskId=0, recycleTaskId=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.856.230 [stream.cc:2886] 619019 StarsWaitForTask: No.0 stream_id=8, taskId=0, currentId=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.230 [stream.cc:1400] 619020 AddTaskToList: public task, stream_id=2, task_id=4, task_type=5 (MEMCPY_ASYNC), head=0, tail=5
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.246 [stream.cc:2595] 619020 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=4, type=5(MEMCPY_ASYNC), head=0, tail=5, sqe_num=1, lastTail=4, device_id=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.856.245 [stream.cc:852] 619019 TearDown: stream_id=8, sqId=8, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.856.262 [stream.cc:938] 619019 TearDown: stream_id=8, delay recycle task num=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.856.276 [stream.cc:1507] 619019 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.264 [task_submit.cc:573] 619020 AllocTaskAndSendStars: device_id=2, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=4, task_type=5(MEMCPY_ASYNC).
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.281 [stream.cc:1494] 619020 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=4.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.856.297 [stream_sqcq_manage.cc:451] 619019 FreeLogicCq: Return(0), threadIdentifier(281469171527584), devId(7), tsId(0), cqId(338), isFastCq(0).
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.856.301 [callback.cpp:97]619020 aclrtLaunchCallback: start to execute aclrtLaunchCallback.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.856.318 [npu_driver.cc:6163] 619019 StreamUnBindLogicCq: success: deviceId=7, tsId=0, streamId=8, logicCq=338.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.321 [task_res.cc:380] 619020 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=2, stream_id=2, taskResId=5, taskResHead_=0, taskResTail_=6.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.342 [task_info.cc:521] 619020 ConstructSqeForCallbackLaunchTask: CallbackLaunch,topic_type=4,stream_id=2,task_id=5,eventId=65535,isBlock=0,pid=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.856.346 [npu_driver.cc:1180] 619019 LogicCqFree: Succ:device_id=7,ts_id=0,type=2,logic_cq_id=338, drvFlag=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.856.363 [stream.cc:237] 619019 FreeStreamId: Free stream_id=8.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.357 [stream.cc:1400] 619020 AddTaskToList: public task, stream_id=2, task_id=5, task_type=72 (HOSTFUNC_CALLBACK), head=0, tail=6
[CRITICAL] KERNEL(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.856.357 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.373 [stream.cc:2595] 619020 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=5, type=72(HOSTFUNC_CALLBACK), head=0, tail=6, sqe_num=1, lastTail=5, device_id=2
[INFO] DEBUG(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.856.391 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.394 [task_submit.cc:573] 619020 AllocTaskAndSendStars: device_id=2, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=5, task_type=72(HOSTFUNC_CALLBACK).
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.856.376 [stream_sqcq_manage.cc:216] 619019 DeAllocStreamSqCq: deviceId=7, tsId=0, drvFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.856.404 [npu_driver.cc:966] 619019 NormalSqCqFree: Normal sqcq free, sqId=8, cqId=8, device_id=7, tsId=0, drvFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.409 [stream.cc:1494] 619020 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=5.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.856.422 [callback.cpp:109]619020 aclrtLaunchCallback: successfully execute aclrtLaunchCallback
[INFO] DEBUG(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.856.414 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.431 [npu_driver.cc:3844] 618832 CqReportGet: cq report get start, device_id=2, tsId=0.
[INFO] DEBUG(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.856.431 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.447 [npu_driver.cc:3851] 618832 CqReportGet: halCqReportGet count=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.463 [api_impl.cc:5087] 618832 ProcessReport: report[0], sqid=12291, streamId=2, taskId=5, eventId=65535, isBlock=0
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.856.477 [callback.cpp:138]618832 aclrtProcessReport: successfully aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.856.491 [device.cpp:231]619020 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.856.506 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME_FRAMEWORK(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.856.504 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.

----------------------------------------------------
- C++ Call Stack: (For framework developers)
----------------------------------------------------
mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.515 [runtime.cc:5239] 619020 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.521 [npu_driver.cc:3828] 618832 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=320.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.856.530 [acl.cpp:802]619020 aclGetRecentErrMsg: start to execute aclGetRecentErrMsg.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.560 [npu_driver.cc:404] 619020 StreamIdAlloc: stream id alloc begin, device_id=2, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.587 [stream.cc:2246] 619020 AllocExecutedTimesSvm: stream_id=8.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.856.584 [context.cpp:72]619021 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.856.606 [api_impl.cc:3717] 619021 ContextSetCurrent: set context=aaab087d6320, flag=0.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.856.622 [context.cpp:80]619021 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.625 [stream_sqcq_manage.cc:147] 619020 Alloc: deviceId=2, tsId=0, drvFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.643 [npu_driver.cc:882] 619020 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.856.642 [api_error.cc:1807] 619021 MemcpyAsyncCheckKindAndLocation: src pointer loc type=1, dst pointer loc type=2, kind=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.856.660 [memory_task.cc:342] 619021 ConvertCpyType: MemcpyAsyncTask::ConvertCpyType MEMCPY_HOST_TO_DEVICE, direct=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.856.676 [memory_task.cc:473] 619021 MemcpyAsyncTaskInitV3: Init qos=0, partId=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.856.687 [memory_task.cc:518] 619021 MemcpyAsyncTaskInitV3: CopyType=0: use virtual address directly.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.856.701 [task_res.cc:380] 619021 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=4, stream_id=2, taskResId=4, taskResHead_=0, taskResTail_=5.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.856.719 [memory_task.cc:1007] 619021 ConstructPcieDmaSqe: stream_id=2, task_id=4, copyType=0, src=0xaaab1421c750, dst=0x12c2c0000000, len=0x6c
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.856.736 [memory_task.cc:1166] 619021 ConstructSqeForMemcpyAsyncTask: MemcpyAsyncTask, stream_id=2, task_id=4, copyType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.856.748 [stream.cc:1400] 619021 AddTaskToList: public task, stream_id=2, task_id=4, task_type=5 (MEMCPY_ASYNC), head=0, tail=5
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.856.774 [stream.cc:2595] 619021 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=4, type=5(MEMCPY_ASYNC), head=0, tail=5, sqe_num=1, lastTail=4, device_id=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.856.795 [task_submit.cc:573] 619021 AllocTaskAndSendStars: device_id=4, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=4, task_type=5(MEMCPY_ASYNC).
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.856.814 [stream.cc:1494] 619021 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=4.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.856.832 [callback.cpp:97]619021 aclrtLaunchCallback: start to execute aclrtLaunchCallback.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.856.838 [npu_driver.cc:974] 619019 NormalSqCqFree: Normal sqcq free success, sqId=8, cqId=8, device_id=7, tsId=0, drvFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.856.856 [stream_sqcq_manage.cc:228] 619019 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=8, cq_id=8, stream_id=8, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.856.853 [task_res.cc:380] 619021 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=4, stream_id=2, taskResId=5, taskResHead_=0, taskResTail_=6.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.853 [npu_driver.cc:6125] 619020 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.856.872 [task_info.cc:521] 619021 ConstructSqeForCallbackLaunchTask: CallbackLaunch,topic_type=4,stream_id=2,task_id=5,eventId=65535,isBlock=0,pid=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.856.871 [npu_driver.cc:432] 619019 StreamIdFree: stream id free begin, device_id=7, stream_id=8, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.856.887 [stream.cc:1400] 619021 AddTaskToList: public task, stream_id=2, task_id=5, task_type=72 (HOSTFUNC_CALLBACK), head=0, tail=6
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.856.891 [npu_driver.cc:441] 619019 StreamIdFree: Stream id free success, stream_id=8, device_id=7, tsId=0, streamFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.894 [npu_driver.cc:6137] 619020 LogicCqAllocateV2: success: deviceId=2, tsId=0, cqId=1004, streamId=8, logicCq=1004, cqeDepth=4096
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.856.903 [stream.cc:2595] 619021 StarsAddTaskToStream: single-operator flow stream, stream_id=2, task_id=5, type=72(HOSTFUNC_CALLBACK), head=0, tail=6, sqe_num=1, lastTail=5, device_id=4
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.856.910 [device_msg_handler.cc:110] 619019 HandleMsg: Begin to process device errMessage.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.916 [npu_driver.cc:6189] 619020 StreamBindLogicCq: success: deviceId=2, tsId=0, streamId=8, logicCq=1004.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.932 [npu_driver.cc:5916] 619020 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=d0095000, addr=dfffd0095000size=4096
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.856.919 [task_submit.cc:573] 619021 AllocTaskAndSendStars: device_id=4, ts_id=0, sq_id=2, cq_id=2, stream_id=2, task_id=5, task_type=72(HOSTFUNC_CALLBACK).
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.856.934 [stream.cc:1494] 619021 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=5.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.947 [stream.cc:653] 619020 Setup: Success to get sq=8 sq reg virtual addr length=4096.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.856.945 [callback.cpp:109]619021 aclrtLaunchCallback: successfully execute aclrtLaunchCallback
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.856.958 [npu_driver.cc:3844] 618816 CqReportGet: cq report get start, device_id=4, tsId=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.856.977 [npu_driver.cc:3851] 618816 CqReportGet: halCqReportGet count=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.856.985 [stream.cc:276] 619020 CreateStreamTaskRes: Normal STREAM Setup stream_id=8 flags_=0x0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.856.988 [api_impl.cc:5087] 618816 ProcessReport: report[0], sqid=12291, streamId=2, taskId=5, eventId=65535, isBlock=0
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.857.009 [callback.cpp:138]618816 aclrtProcessReport: successfully aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.857.013 [device.cpp:231]619021 aclrtGetDevice: start to execute aclrtGetDevice
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.003 [stream.cc:688] 619020 Setup: stream setup end, stream_id=8, IsTaskSink=0, sqId=8, cqId=8, deviceId=2, streamResId=65534
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.857.024 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.033 [runtime.cc:5239] 619021 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.857.023 [acl_resource_manager.cpp:814]619020 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.040 [npu_driver.cc:3828] 618816 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=832.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.857.039 [acl_resource_manager.cpp:816]619020 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.857.050 [acl.cpp:802]619021 aclGetRecentErrMsg: start to execute aclGetRecentErrMsg.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.081 [npu_driver.cc:404] 619021 StreamIdAlloc: stream id alloc begin, device_id=4, priority=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.082 [engine.cc:188] 619020 SubmitTaskNormal: stream_id=8,task_id=0,task_type=87 (GET_DEVICE_MSG).
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.102 [npu_driver.cc:5547] 619020 GetSqHead: deviceId=2, tsId=0, sqId=8, head=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.109 [stream.cc:2246] 619021 AllocExecutedTimesSvm: stream_id=8.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.119 [task_info.cc:409] 619020 ConstructSqeForGetDevMsgTask: stream_id:8, task_id:0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.135 [stream.cc:1400] 619020 AddTaskToList: public task, stream_id=8, task_id=0, task_type=87 (GET_DEVICE_MSG), head=0, tail=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.150 [stream_sqcq_manage.cc:147] 619021 Alloc: deviceId=4, tsId=0, drvFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.149 [stream.cc:2595] 619020 StarsAddTaskToStream: single-operator flow stream, stream_id=8, task_id=0, type=87(GET_DEVICE_MSG), head=0, tail=1, sqe_num=1, lastTail=0, device_id=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.167 [npu_driver.cc:882] 619021 NormalSqCqAllocate: Set cq dep to 2048, sysMode=0 addrMode=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.169 [npu_driver.cc:751] 619020 SqTaskSend: device_id=2, ts_id=0, sq_id=8, sqe_num=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.182 [stars_engine.cc:893] 619020 SendTask: Sq task send finished, device_id=2, ts_id=0, sq_id=8, cq_id=8, stream_id=8, task_id=0, task_type=87(GET_DEVICE_MSG).
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.198 [stream.cc:1494] 619020 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.225 [npu_driver.cc:5547] 619020 GetSqHead: deviceId=2, tsId=0, sqId=8, head=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.857.222 [device_msg_handler.cc:127] 619019 HandleMsg: Finished to process device errInfo, retCode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.240 [task.cc:185] 619020 GetTask: this stream no taskRes, stream_id=8
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.256 [task.cc:185] 619020 GetTask: this stream no taskRes, stream_id=8
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.857.253 [runtime.cc:5239] 619019 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.270 [logger.cc:152] 619020 TaskFinished: device_id=2, stream_id=8, task_id=0, task_type=87 (GET_DEVICE_MSG), task_finish_num=8
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.857.275 [npu_driver.cc:500] 619019 GetFaultEvent: get fault event, device_id=7, filterFlag=8, outputLen=128.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.290 [stars_engine.cc:437] 619020 FinishedTaskReclaim: recycle task, stream_id=8, limited=0, taskHead=0, sqHead=1, endTaskId=0, recycleTaskId=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.307 [stream.cc:2886] 619020 StarsWaitForTask: No.0 stream_id=8, taskId=0, currentId=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.321 [stream.cc:852] 619020 TearDown: stream_id=8, sqId=8, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.339 [stream.cc:938] 619020 TearDown: stream_id=8, delay recycle task num=0.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.857.331 [acl.cpp:782]619019 GetFaultEventInfo: can not get fault event of device 7, runtime errorCode is 0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.351 [stream.cc:1507] 619020 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] GE(618674,python3.9):2025-04-03-09:27:47.857.348 [error_manager.cc:989]619019 GetRawErrorMessages:current work_stream_id:0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.372 [stream_sqcq_manage.cc:451] 619020 FreeLogicCq: Return(0), threadIdentifier(281469230182304), devId(2), tsId(0), cqId(1004), isFastCq(0).
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.393 [npu_driver.cc:6163] 619020 StreamUnBindLogicCq: success: deviceId=2, tsId=0, streamId=8, logicCq=1004.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.408 [npu_driver.cc:6125] 619021 LogicCqAllocateV2: cqeDepth=4096, isDvppGrp=0, inFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.421 [npu_driver.cc:1180] 619020 LogicCqFree: Succ:device_id=2,ts_id=0,type=2,logic_cq_id=1004, drvFlag=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.438 [stream.cc:237] 619020 FreeStreamId: Free stream_id=8.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.449 [stream_sqcq_manage.cc:216] 619020 DeAllocStreamSqCq: deviceId=2, tsId=0, drvFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.461 [npu_driver.cc:966] 619020 NormalSqCqFree: Normal sqcq free, sqId=8, cqId=8, device_id=2, tsId=0, drvFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.458 [npu_driver.cc:6137] 619021 LogicCqAllocateV2: success: deviceId=4, tsId=0, cqId=318, streamId=8, logicCq=318, cqeDepth=4096
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.480 [npu_driver.cc:6189] 619021 StreamBindLogicCq: success: deviceId=4, tsId=0, streamId=8, logicCq=318.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.498 [npu_driver.cc:5916] 619021 GetSqRegVirtualAddrBySqid: addr high 32 bit=dfff, addr low 32 bit=e03eb000, addr=dfffe03eb000size=4096
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.515 [stream.cc:653] 619021 Setup: Success to get sq=8 sq reg virtual addr length=4096.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.553 [stream.cc:276] 619021 CreateStreamTaskRes: Normal STREAM Setup stream_id=8 flags_=0x0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.570 [stream.cc:688] 619021 Setup: stream setup end, stream_id=8, IsTaskSink=0, sqId=8, cqId=8, deviceId=4, streamResId=65534
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.857.589 [acl_resource_manager.cpp:814]619021 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.857.604 [acl_resource_manager.cpp:816]619021 HandleReleaseSourceByStream: it's create stream callback, currently do nothing.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.643 [engine.cc:188] 619021 SubmitTaskNormal: stream_id=8,task_id=0,task_type=87 (GET_DEVICE_MSG).
[CRITICAL] KERNEL(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.857.648 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.663 [npu_driver.cc:5547] 619021 GetSqHead: deviceId=4, tsId=0, sqId=8, head=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.680 [task_info.cc:409] 619021 ConstructSqeForGetDevMsgTask: stream_id:8, task_id:0.
[INFO] DEBUG(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.857.680 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.693 [stream.cc:1400] 619021 AddTaskToList: public task, stream_id=8, task_id=0, task_type=87 (GET_DEVICE_MSG), head=0, tail=1
[INFO] DEBUG(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.857.701 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
[INFO] DEBUG(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.857.719 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.710 [stream.cc:2595] 619021 StarsAddTaskToStream: single-operator flow stream, stream_id=8, task_id=0, type=87(GET_DEVICE_MSG), head=0, tail=1, sqe_num=1, lastTail=0, device_id=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.730 [npu_driver.cc:751] 619021 SqTaskSend: device_id=4, ts_id=0, sq_id=8, sqe_num=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.744 [stars_engine.cc:893] 619021 SendTask: Sq task send finished, device_id=4, ts_id=0, sq_id=8, cq_id=8, stream_id=8, task_id=0, task_type=87(GET_DEVICE_MSG).
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.761 [stream.cc:1494] 619021 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.774 [npu_driver.cc:5547] 619021 GetSqHead: deviceId=4, tsId=0, sqId=8, head=1.
[INFO] RUNTIME_FRAMEWORK(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.857.788 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.

----------------------------------------------------
- C++ Call Stack: (For framework developers)
----------------------------------------------------
mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.790 [task.cc:185] 619021 GetTask: this stream no taskRes, stream_id=8
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.804 [task.cc:185] 619021 GetTask: this stream no taskRes, stream_id=8
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.817 [logger.cc:152] 619021 TaskFinished: device_id=4, stream_id=8, task_id=0, task_type=87 (GET_DEVICE_MSG), task_finish_num=8
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.836 [stars_engine.cc:437] 619021 FinishedTaskReclaim: recycle task, stream_id=8, limited=0, taskHead=0, sqHead=1, endTaskId=0, recycleTaskId=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.852 [stream.cc:2886] 619021 StarsWaitForTask: No.0 stream_id=8, taskId=0, currentId=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.865 [stream.cc:852] 619021 TearDown: stream_id=8, sqId=8, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.881 [stream.cc:938] 619021 TearDown: stream_id=8, delay recycle task num=0.
[INFO] RUNTIME(618662,python3.9)[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.903 [npu_driver.cc:974] 619020 NormalSqCqFree: Normal sqcq free success, sqId=8, cqId=8, device_id=2, tsId=0, drvFlag=0
:2025-04-03-09:27:47.857.893 [stream.cc:1507] 619021 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.922 [stream_sqcq_manage.cc:228] 619020 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=8, cq_id=8, stream_id=8, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.935 [stream_sqcq_manage.cc:451] 619021 FreeLogicCq: Return(0), threadIdentifier(281469901270944), devId(4), tsId(0), cqId(318), isFastCq(0).
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.936 [npu_driver.cc:432] 619020 StreamIdFree: stream id free begin, device_id=2, stream_id=8, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.956 [npu_driver.cc:441] 619020 StreamIdFree: Stream id free success, stream_id=8, device_id=2, tsId=0, streamFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.956 [npu_driver.cc:6163] 619021 StreamUnBindLogicCq: success: deviceId=4, tsId=0, streamId=8, logicCq=318.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.973 [device_msg_handler.cc:110] 619020 HandleMsg: Begin to process device errMessage.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.857.983 [npu_driver.cc:1180] 619021 LogicCqFree: Succ:device_id=4,ts_id=0,type=2,logic_cq_id=318, drvFlag=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.858.000 [stream.cc:237] 619021 FreeStreamId: Free stream_id=8.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.858.014 [stream_sqcq_manage.cc:216] 619021 DeAllocStreamSqCq: deviceId=4, tsId=0, drvFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.858.029 [npu_driver.cc:966] 619021 NormalSqCqFree: Normal sqcq free, sqId=8, cqId=8, device_id=4, tsId=0, drvFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.858.279 [device_msg_handler.cc:127] 619020 HandleMsg: Finished to process device errInfo, retCode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.858.312 [runtime.cc:5239] 619020 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.858.335 [npu_driver.cc:500] 619020 GetFaultEvent: get fault event, device_id=2, filterFlag=8, outputLen=128.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.858.391 [acl.cpp:782]619020 GetFaultEventInfo: can not get fault event of device 2, runtime errorCode is 0
[INFO] GE(618654,python3.9):2025-04-03-09:27:47.858.410 [error_manager.cc:989]619020 GetRawErrorMessages:current work_stream_id:0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.858.526 [npu_driver.cc:974] 619021 NormalSqCqFree: Normal sqcq free success, sqId=8, cqId=8, device_id=4, tsId=0, drvFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.858.546 [stream_sqcq_manage.cc:228] 619021 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=8, cq_id=8, stream_id=8, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.858.564 [npu_driver.cc:432] 619021 StreamIdFree: stream id free begin, device_id=4, stream_id=8, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.858.580 [npu_driver.cc:441] 619021 StreamIdFree: Stream id free success, stream_id=8, device_id=4, tsId=0, streamFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.858.598 [device_msg_handler.cc:110] 619021 HandleMsg: Begin to process device errMessage.
[CRITICAL] KERNEL(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.858.721 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
[INFO] DEBUG(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.858.755 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
[INFO] DEBUG(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.858.777 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
[INFO] DEBUG(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.858.795 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
[INFO] RUNTIME_FRAMEWORK(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.858.864 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.

----------------------------------------------------
- C++ Call Stack: (For framework developers)
----------------------------------------------------
mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.858.913 [device_msg_handler.cc:127] 619021 HandleMsg: Finished to process device errInfo, retCode=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.858.947 [runtime.cc:5239] 619021 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.858.968 [npu_driver.cc:500] 619021 GetFaultEvent: get fault event, device_id=4, filterFlag=8, outputLen=128.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.859.025 [acl.cpp:782]619021 GetFaultEventInfo: can not get fault event of device 4, runtime errorCode is 0
[INFO] GE(618662,python3.9):2025-04-03-09:27:47.859.044 [error_manager.cc:989]619021 GetRawErrorMessages:current work_stream_id:0
[CRITICAL] KERNEL(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.859.339 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
[INFO] DEBUG(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.859.372 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
[INFO] DEBUG(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.859.393 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
[INFO] DEBUG(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.859.411 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
[INFO] RUNTIME_FRAMEWORK(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.859.484 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.

----------------------------------------------------
- C++ Call Stack: (For framework developers)
----------------------------------------------------
mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:47.898.446 [awatchdog_monitor.c:160](tid:618694) thread 618986 not exist
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:47.902.174 [awatchdog_monitor.c:160](tid:618693) thread 618983 not exist
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:47.908.183 [trs_cb_event.c:119][ascend][curpid:618650,618829][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =321; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:47.908.215 [trs_sqcq.c:1491][ascend][curpid:618650,618829][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:47.908.227 [npu_driver.cc:3833] 618829 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:47.908.238 [api_impl.cc:5058] 618829 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.908.251 [callback.cpp:132]618829 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.908.261 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.908.273 [npu_driver.cc:3828] 618829 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=321.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:47.952.968 [awatchdog_monitor.c:160](tid:618687) thread 618982 not exist
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:47.959.916 [awatchdog_monitor.c:160](tid:618684) thread 618988 not exist
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:47.977.099 [awatchdog_monitor.c:160](tid:618698) thread 618985 not exist
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:48.004.182 [trs_cb_event.c:119][ascend][curpid:618654,618833][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =321; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:48.004.241 [trs_sqcq.c:1491][ascend][curpid:618654,618833][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:48.004.263 [npu_driver.cc:3833] 618833 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:48.004.284 [api_impl.cc:5058] 618833 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.004.316 [callback.cpp:132]618833 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.004.337 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.004.360 [npu_driver.cc:3828] 618833 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=321.
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:48.100.194 [trs_cb_event.c:119][ascend][curpid:618646,618837][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =65; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:48.100.237 [trs_sqcq.c:1491][ascend][curpid:618646,618837][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:48.100.251 [npu_driver.cc:3833] 618837 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:48.100.267 [api_impl.cc:5058] 618837 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.100.300 [callback.cpp:132]618837 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.100.332 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.100.356 [npu_driver.cc:3828] 618837 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=65.
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:48.164.180 [trs_cb_event.c:119][ascend][curpid:618646,618836][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =64; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:48.164.222 [trs_sqcq.c:1491][ascend][curpid:618646,618836][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:48.164.236 [npu_driver.cc:3833] 618836 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:48.164.255 [api_impl.cc:5058] 618836 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.164.273 [callback.cpp:132]618836 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.164.292 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.164.313 [npu_driver.cc:3828] 618836 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=64.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.175.695 [context.cpp:72]618646 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.175.733 [api_impl.cc:3717] 618646 ContextSetCurrent: set context=aaab06c88220, flag=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.175.754 [context.cpp:80]618646 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.175.790 [stream.cpp:131]618646 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.175.810 [api_impl.cc:1394] 618646 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.175.833 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.175.900 [stars_engine.cc:643] 618646 ProcLogicCqUntilEmpty: Notify: cnt=3, idx=0, stream_id=2, task_id=1, sqeType=1, retCode=0, errType=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.175.930 [logger.cc:152] 618646 TaskFinished: device_id=0, stream_id=2, task_id=0, task_type=5 (MEMCPY_ASYNC), task_finish_num=9
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.175.945 [task_manager.cc:485] 618646 TaskFailCallBack: task ok, stream_id=2, task_id=0, retCode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.175.960 [task_res.cc:323] 618646 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=0, stream_id=2, taskId=0, taskDesHeadIdx=0, taskResHead_=1, tail=6, taskResTail_=6
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.175.975 [logger.cc:152] 618646 TaskFinished: device_id=0, stream_id=2, task_id=1, task_type=72 (HOSTFUNC_CALLBACK), task_finish_num=10
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.175.988 [task_res.cc:323] 618646 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=0, stream_id=2, taskId=1, taskDesHeadIdx=1, taskResHead_=2, tail=6, taskResTail_=6
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.006 [stars_engine.cc:643] 618646 ProcLogicCqUntilEmpty: Notify: cnt=3, idx=1, stream_id=2, task_id=3, sqeType=1, retCode=0, errType=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.019 [logger.cc:152] 618646 TaskFinished: device_id=0, stream_id=2, task_id=2, task_type=5 (MEMCPY_ASYNC), task_finish_num=11
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.032 [task_manager.cc:485] 618646 TaskFailCallBack: task ok, stream_id=2, task_id=2, retCode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.056 [task_res.cc:323] 618646 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=0, stream_id=2, taskId=2, taskDesHeadIdx=2, taskResHead_=3, tail=6, taskResTail_=6
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.070 [logger.cc:152] 618646 TaskFinished: device_id=0, stream_id=2, task_id=3, task_type=72 (HOSTFUNC_CALLBACK), task_finish_num=12
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.085 [task_res.cc:323] 618646 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=0, stream_id=2, taskId=3, taskDesHeadIdx=3, taskResHead_=4, tail=6, taskResTail_=6
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.100 [stars_engine.cc:643] 618646 ProcLogicCqUntilEmpty: Notify: cnt=3, idx=2, stream_id=2, task_id=5, sqeType=1, retCode=0, errType=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.113 [logger.cc:152] 618646 TaskFinished: device_id=0, stream_id=2, task_id=4, task_type=5 (MEMCPY_ASYNC), task_finish_num=13
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.125 [task_manager.cc:485] 618646 TaskFailCallBack: task ok, stream_id=2, task_id=4, retCode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.137 [task_res.cc:323] 618646 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=0, stream_id=2, taskId=4, taskDesHeadIdx=4, taskResHead_=5, tail=6, taskResTail_=6
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.150 [logger.cc:152] 618646 TaskFinished: device_id=0, stream_id=2, task_id=5, task_type=72 (HOSTFUNC_CALLBACK), task_finish_num=14
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.169 [task_res.cc:323] 618646 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=0, stream_id=2, taskId=5, taskDesHeadIdx=5, taskResHead_=6, tail=6, taskResTail_=6
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.191 [stars_engine.cc:622] 618646 ProcLogicCqUntilEmpty: Task Wait: stream_id=2, logicCqId=489, retCode=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.203 [stream.cc:2886] 618646 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.217 [api_error.cc:895] 618646 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.176.230 [stream.cpp:146]618646 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.176.247 [stream.cpp:131]618646 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.281 [api_impl.cc:1394] 618646 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.294 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.318 [stream.cc:2886] 618646 StarsWaitForTask: No.0 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.331 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.342 [stream.cc:2886] 618646 StarsWaitForTask: No.1 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.354 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.365 [stream.cc:2886] 618646 StarsWaitForTask: No.2 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.377 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.388 [stream.cc:2886] 618646 StarsWaitForTask: No.3 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.400 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.417 [stream.cc:2886] 618646 StarsWaitForTask: No.4 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.429 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.441 [stream.cc:2886] 618646 StarsWaitForTask: No.5 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.452 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.461 [stream.cc:2886] 618646 StarsWaitForTask: No.6 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.472 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.483 [stream.cc:2886] 618646 StarsWaitForTask: No.7 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.495 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.506 [stream.cc:2886] 618646 StarsWaitForTask: No.8 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.517 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.528 [stream.cc:2886] 618646 StarsWaitForTask: No.9 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.540 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.551 [stream.cc:2886] 618646 StarsWaitForTask: No.10 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.564 [event.cc:310] 618646 InitEventAllocFlag: Stars not need to alloc id in this flag=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.597 [task_res.cc:380] 618646 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=0, stream_id=3, taskResId=0, taskResHead_=0, taskResTail_=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.620 [event.cc:249] 618646 UpdateLatestRecord: device_id=0, event_id=-1, cur stream_id=3, cur task_id=0, latest stream_id=3, latest task_id=0, status=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.633 [event_task.cc:259] 618646 ConstructSqeForEventRecordTask: event_record: device_id=0, stream_id=3, task_id=0, event_id=4294967295, sq_id=3.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.647 [stream.cc:1400] 618646 AddTaskToList: public task, stream_id=3, task_id=0, task_type=2 (EVENT_RECORD), head=0, tail=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.659 [stream.cc:2595] 618646 StarsAddTaskToStream: single-operator flow stream, stream_id=3, task_id=0, type=2(EVENT_RECORD), head=0, tail=1, sqe_num=1, lastTail=0, device_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.686 [task_submit.cc:573] 618646 AllocTaskAndSendStars: device_id=0, ts_id=0, sq_id=3, cq_id=3, stream_id=3, task_id=0, task_type=2(EVENT_RECORD).
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.701 [stars_engine.cc:1122] 618646 SyncTask: Task Wait: device_id=0, stream_id=3, task_id=0, logicCqId=490.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.743 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.757 [stars_engine.cc:1071] 618646 IsSyncTaskFinish: Sync task finished, sqHead=1 finishedTaskId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.772 [stars_engine.cc:1017] 618646 ProcReport: Get logic report: cnt=1, idx=0, stream_id=3, report task_id=0, sync task_id=0, sqeType=3, sqeHead=0, retCode=0, errType=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.787 [stars_engine.cc:1027] 618646 ProcReport: taskType=2.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.799 [logger.cc:152] 618646 TaskFinished: device_id=0, stream_id=3, task_id=0, task_type=2 (EVENT_RECORD), task_finish_num=15
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.817 [event.cc:249] 618646 UpdateLatestRecord: device_id=0, event_id=-1, cur stream_id=3, cur task_id=0, latest stream_id=3, latest task_id=0, status=2
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.832 [event_task.cc:211] 618646 DoCompleteSuccessForEventRecordTask: event_record: device_id=0, stream_id=3, task_id=0, sq_id=3, event_id=4294967295, timeline=0xffffffffffffffff, timestamp=0x1e4b839e0bc
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.847 [event.cc:122] 618646 TryFreeEventIdAndCheckCanBeDelete: device_id=0, event_id=-1, map_count=0, isNewMode=0, isIdFromDrv=0, newestId=-1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.860 [task_res.cc:323] 618646 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=0, stream_id=3, taskId=0, taskDesHeadIdx=0, taskResHead_=1, tail=1, taskResTail_=1
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.883 [npu_driver.cc:5618] 618646 GetSqEnable: deviceId=0, tsId=0, sqId=3, enable=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.895 [stream.cc:1494] 618646 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.906 [api_error.cc:895] 618646 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.176.917 [stream.cpp:146]618646 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.176.966 [context.cpp:72]618646 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.176.980 [api_impl.cc:3717] 618646 ContextSetCurrent: set context=aaab06c88220, flag=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.176.993 [context.cpp:80]618646 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.177.005 [stream.cpp:131]618646 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.177.017 [api_impl.cc:1394] 618646 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.177.029 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.177.042 [stream.cc:2886] 618646 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.177.054 [api_error.cc:895] 618646 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.177.064 [stream.cpp:146]618646 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.177.077 [stream.cpp:131]618646 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.177.091 [api_impl.cc:1394] 618646 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.177.102 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.177.127 [stars_engine.cc:622] 618646 ProcLogicCqUntilEmpty: Task Wait: stream_id=3, logicCqId=490, retCode=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.177.140 [stream.cc:2886] 618646 StarsWaitForTask: No.0 stream_id=3, taskId=0, currentId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.177.151 [api_error.cc:895] 618646 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.177.162 [stream.cpp:146]618646 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.177.174 [memory.cpp:421]618646 aclrtMemcpy: start to execute aclrtMemcpy, destMaxSize = 108, srcSize = 108, kind = 2
F

========================================================================================================================= FAILURES =========================================================================================================================
______________________________________________________________________________________________________________________ test_AllReduce ______________________________________________________________________________________________________________________

    def test_AllReduce():
        """
        Feature: lccl operator test.
        Description: msrun lccl all_reduce 8P case.
        Expectation: success
        """
        all_reduce = Net()
        output = all_reduce()
    
        expect0 = np.ones([3, 1, 3, 3]).astype(np.float32) * 0
        for i in range(size):
            part = np.ones([3, 1, 3, 3]).astype(np.float32) * 0.01 * (i + 1)
            expect0 += part
>       diff0 = output[0].asnumpy() - expect0

test_lccl_allreduce.py:66: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = Tensor(shape=[3, 1, 3, 3], dtype=Float32, value=
[[[[ 0.00000000e+00,  0.00000000e+00,  0.00000000e+00],
   [ 0.000000...00],
   [ 0.00000000e+00,  0.00000000e+00,  0.00000000e+00],
   [ 0.00000000e+00,  0.00000000e+00,  0.00000000e+00]]]])

    def asnumpy(self):
        """
        Convert tensor to numpy array. Returns self tensor as a NumPy ndarray. This tensor and the returned ndarray
        share the same underlying storage. Changes to self tensor will be reflected in the ndarray.
    
        Returns:
            A numpy ndarray which shares the same underlying storage with the tensor.
    
        Examples:
            >>> from mindspore import Tensor
            >>> import numpy as np
            >>> x = Tensor(np.array([1, 2], dtype=np.float32))
            >>> y = x.asnumpy()
            >>> y[0] = 11
            >>> print(x)
            [11.  2.]
            >>> print(y)
            [11.  2.]
        """
        if self.has_init:
            self.init_data()
>       return TensorPy_.asnumpy(self)
E       RuntimeError: LCCL AllReduce failed.
E       
E       ----------------------------------------------------
E       - C++ Call Stack: (For framework developers)
E       ----------------------------------------------------
E       mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/common/tensor.py:989: RuntimeError
===================================================================================================================== warnings summary =====================================================================================================================
../../../../../../../../usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866
  /usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866: DeprecationWarning: invalid escape sequence \L
    if not dirpath.find("AppData\Local\Temp"):

../../../../../../../../usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/classifier/transdata/transdata_classifier.py:222
  /usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/classifier/transdata/transdata_classifier.py:222: DeprecationWarning: invalid escape sequence \B
    """

../../../../../../../../usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:143
  /usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:143: DeprecationWarning: invalid escape sequence \c
    """

../../../../../../../../usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:170
  /usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:170: DeprecationWarning: invalid escape sequence \c
    """

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for <class 'numpy.float64'> type is zero.
    setattr(self, word, getattr(machar, word).flat[0])

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for <class 'numpy.float64'> type is zero.
    return self._float_to_str(self.smallest_subnormal)

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for <class 'numpy.float32'> type is zero.
    setattr(self, word, getattr(machar, word).flat[0])

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for <class 'numpy.float32'> type is zero.
    return self._float_to_str(self.smallest_subnormal)

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2.py:57
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2.py:57: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("batchnorm_fold2")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad.py:56
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad.py:56: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("batchnorm_fold2_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad_reduce.py:48
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad_reduce.py:48: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("batchnorm_fold2_grad_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul.py:51
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul.py:51: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("correction_mul")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:51
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:51: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("correction_mul_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:143
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:143: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("correction_mul_grad_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perlayer")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad.py:92
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad.py:92: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perlayer_grad_d")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad_reduce.py:49
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad_reduce.py:49: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perlayer_grad_d_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perchannel")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad.py:91
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad.py:91: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perchannel_grad_d")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad_reduce.py:48
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad_reduce.py:48: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perchannel_grad_d_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel.py:52
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel.py:52: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_perchannel")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel_grad.py:81
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel_grad.py:81: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_perchannel_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer.py:54
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer.py:54: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_per_layer")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer_grad.py:81
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer_grad.py:81: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_per_layer_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perchannel.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perchannel.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("minmax_update_perchannel")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("minmax_update_perlayer")

-- Docs: https://docs.pytest.org/en/stable/warnings.html
================================================================================================================= short test summary info ==================================================================================================================
FAILED test_lccl_allreduce.py::test_AllReduce - RuntimeError: LCCL AllReduce failed.
============================================================================================================= 1 failed, 26 warnings in 23.52s ==============================================================================================================
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.186.029 [mindspore/ccsrc/pybind_api/init.cc:651] operator()] Start register...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.186.068 [mindspore/ccsrc/pybind_api/init.cc:654] operator()] Start mindspore.profiler...
[INFO] ME(618646:281472926821856,MainProcess):2025-04-03-09:27:48.186.136 [mindspore/profiler/envprofiler.py:57] analyse start
[INFO] ME(618646:281472926821856,MainProcess):2025-04-03-09:27:48.186.291 [mindspore/profiler/envprofiler.py:59] Profiler is not initialized, skip analyse.
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.186.366 [mindspore/ccsrc/pybind_api/init.cc:661] operator()] Start EmbeddingCacheScheduler...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.186.426 [mindspore/ccsrc/pybind_api/init.cc:668] operator()] Start releasing dataset handles...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.186.467 [mindspore/ccsrc/pybind_api/init.cc:671] operator()] End release dataset handles.
[INFO] PIPELINE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.186.489 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:2616] FinalizeCluster] Start finalize the cluster instance.
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:48.196.187 [queue_client_comm.c:114][ascend][curpid:618658,618783][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:48.196.189 [queue_client_comm.c:114][ascend][curpid:618658,618789][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:48.196.187 [queue_client_comm.c:114][ascend][curpid:618658,618781][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:48.196.187 [queue_client_comm.c:114][ascend][curpid:618658,618779][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:48.196.243 [queue_client_comm.c:114][ascend][curpid:618658,618787][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:48.196.243 [queue_client_comm.c:114][ascend][curpid:618658,618785][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:48.196.368 [npu_driver.cc:4338] 618783 MemQueuePeek: queue empty
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:48.196.387 [npu_driver.cc:4338] 618789 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.196.420 [tensor_data_transfer.cpp:612]618783 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_tensor_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.196.423 [tensor_data_transfer.cpp:612]618789 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_histogram_summary
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:48.196.424 [npu_driver.cc:4338] 618781 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.196.448 [tensor_data_transfer.cpp:1054]618783 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_tensor_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.196.451 [tensor_data_transfer.cpp:1054]618789 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_histogram_summary
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:48.196.452 [npu_driver.cc:4338] 618779 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.196.460 [tensor_data_transfer.cpp:612]618781 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_tensor_dump
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.196.463 [tensor_data_transfer.cpp:1056]618783 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.196.472 [tensor_data_transfer.cpp:1056]618789 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:48.196.484 [npu_driver.cc:4338] 618785 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.196.485 [tensor_data_transfer.cpp:612]618779 acltdtReceiveTensorV2: queue is empty, device is 3, name is _npu_log
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.196.489 [tensor_data_transfer.cpp:1054]618781 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_tensor_dump
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.196.499 [api_impl.cc:6121] 618783 MemQueuePeek: Start to peek queue on devId 3, qid is 2.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.196.505 [api_impl.cc:6121] 618789 MemQueuePeek: Start to peek queue on devId 3, qid is 5.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:48.196.509 [npu_driver.cc:4338] 618787 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.196.525 [tensor_data_transfer.cpp:1054]618779 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is _npu_log
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.196.530 [tensor_data_transfer.cpp:1056]618781 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.196.538 [npu_driver.cc:4330] 618783 MemQueuePeek: peek mem queue, deviceId=3, qid=2, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.196.546 [npu_driver.cc:4330] 618789 MemQueuePeek: peek mem queue, deviceId=3, qid=5, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.196.566 [tensor_data_transfer.cpp:1056]618779 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.196.575 [api_impl.cc:6121] 618781 MemQueuePeek: Start to peek queue on devId 3, qid is 1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.196.597 [api_impl.cc:6121] 618779 MemQueuePeek: Start to peek queue on devId 3, qid is 0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.196.602 [npu_driver.cc:4330] 618781 MemQueuePeek: peek mem queue, deviceId=3, qid=1, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.196.619 [npu_driver.cc:4330] 618779 MemQueuePeek: peek mem queue, deviceId=3, qid=0, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.196.612 [tensor_data_transfer.cpp:612]618787 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_scalar_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.196.606 [tensor_data_transfer.cpp:612]618785 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_image_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.196.662 [tensor_data_transfer.cpp:1054]618787 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_scalar_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.196.672 [tensor_data_transfer.cpp:1054]618785 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_image_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.196.679 [tensor_data_transfer.cpp:1056]618787 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.196.687 [tensor_data_transfer.cpp:1056]618785 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.196.701 [api_impl.cc:6121] 618787 MemQueuePeek: Start to peek queue on devId 3, qid is 4.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.196.703 [api_impl.cc:6121] 618785 MemQueuePeek: Start to peek queue on devId 3, qid is 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.196.720 [npu_driver.cc:4330] 618787 MemQueuePeek: peek mem queue, deviceId=3, qid=4, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.196.723 [npu_driver.cc:4330] 618785 MemQueuePeek: peek mem queue, deviceId=3, qid=3, timeout=800.
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.203.267 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:132] Finalize] The compute graph node has been unregistered successfully.
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.203.371 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:563] Finalize] Delete send event loop
[INFO] DISTRIBUTED(618646,ffff253b9fa0,python3.9):2025-04-03-09:27:48.203.457 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.203.550 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.203.569 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:570] Finalize] Delete recv event loop
[INFO] DISTRIBUTED(618646,ffff25bc9fa0,python3.9):2025-04-03-09:27:48.203.651 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.203.759 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.203.782 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:584] Finalize] Delete connection pool.
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.203.848 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:563] Finalize] Delete send event loop
[INFO] DISTRIBUTED(618646,ffff17ffefa0,python3.9):2025-04-03-09:27:48.203.902 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.204.108 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.204.124 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:570] Finalize] Delete recv event loop
[INFO] DISTRIBUTED(618646,ffff24ba9fa0,python3.9):2025-04-03-09:27:48.204.171 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.204.263 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.204.281 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:584] Finalize] Delete connection pool.
[INFO] PIPELINE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.204.301 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:2619] FinalizeCluster] End finalize the cluster instance.
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.204.319 [mindspore/ccsrc/pybind_api/resource/manager.cc:259] ClearResAtexit] Pipeline clear all resource
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.204.511 [context.cpp:72]618646 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.204.532 [api_impl.cc:3717] 618646 ContextSetCurrent: set context=aaab06c88220, flag=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.204.547 [context.cpp:80]618646 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.204.573 [stream.cpp:131]618646 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.204.589 [api_impl.cc:1394] 618646 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.204.606 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.204.619 [stream.cc:2886] 618646 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.204.633 [api_error.cc:895] 618646 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.204.644 [stream.cpp:146]618646 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.204.660 [stream.cpp:131]618646 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.204.685 [api_impl.cc:1394] 618646 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.204.697 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.204.709 [stream.cc:2886] 618646 StarsWaitForTask: No.0 stream_id=3, taskId=0, currentId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.204.720 [api_error.cc:895] 618646 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.204.731 [stream.cpp:146]618646 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.204.750 [stream.cpp:131]618646 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.204.766 [api_impl.cc:1394] 618646 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.204.778 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.204.790 [stream.cc:2886] 618646 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.204.801 [api_error.cc:895] 618646 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.204.811 [stream.cpp:146]618646 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.204.822 [stream.cpp:131]618646 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.204.834 [api_impl.cc:1394] 618646 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.204.844 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.204.855 [stream.cc:2886] 618646 StarsWaitForTask: No.0 stream_id=3, taskId=0, currentId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.204.867 [api_error.cc:895] 618646 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.204.877 [stream.cpp:146]618646 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.204.916 [mindspore/ccsrc/pybind_api/resource/manager.cc:82] RecordExitStatus] Status record: system exit.
[INFO] DEBUG(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.204.974 [mindspore/ccsrc/common/debug/env_config_parser.cc:152] ParseFromFile] The 'env_config_path' in 'mindspore.context.set_context(env_config_path={path})' is empty.
[INFO] ME(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.205.018 [mindspore/core/mindrt/src/actor/actormgr.cc:165] Finalize] mindrt Actors finish exiting.
[INFO] ME(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.205.033 [mindspore/core/mindrt/src/actor/actormgr.cc:168] Finalize] mindrt Threads finish exiting.
[INFO] ME(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.205.047 [mindspore/core/mindrt/src/actor/actormgr.cc:179] Finalize] mindrt IOMGRS finish exiting.
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.205.214 [mindspore/ccsrc/pybind_api/resource/manager.cc:134] ClearResPart1] Start Finalize StreamSynchronizer...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.205.231 [mindspore/ccsrc/pybind_api/resource/manager.cc:136] ClearResPart1] End Finalize StreamSynchronizer...
[INFO] PIPELINE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.205.876 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:1000] ClearInfo] Clean graph resource!
[INFO] PIPELINE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.205.902 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:1000] ClearInfo] Clean graph resource!
[INFO] PIPELINE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.205.928 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:995] ClearRes] Clean Graph executor resource!
[INFO] PIPELINE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.205.943 [mindspore/ccsrc/pipeline/jit/ps/pipeline_jit.cc:426] ClearRes] Clean JIT executor resource!
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.205.958 [mindspore/ccsrc/pybind_api/resource/manager.cc:155] ClearResPart2] Start clear PyNativeExecutor...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.206.179 [mindspore/ccsrc/pybind_api/resource/manager.cc:157] ClearResPart2] End clear PyNativeExecutor.
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.206.198 [mindspore/ccsrc/pybind_api/resource/manager.cc:159] ClearResPart2] Start clear ConfigManager...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.206.212 [mindspore/ccsrc/pybind_api/resource/manager.cc:161] ClearResPart2] End clear ConfigManager.
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.206.273 [mindspore/ccsrc/common/thread_pool.cc:41] ThreadPool] Set max_thread_num_ to 4
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.206.289 [mindspore/ccsrc/pybind_api/resource/manager.cc:165] ClearResPart2] Start clear device context...
[INFO] ME(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.206.304 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:401] ClearDeviceContexts] Release device Ascend_0
[INFO] GE_ADPT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.213.857 [mindspore/ccsrc/backend/ge_backend/graph_ir/df_graph_manager.cc:154] ClearGraph] Remove all graphs in GraphManager
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.213.893 [mindspore/ccsrc/backend/ge_backend/executor/ge_graph_executor.cc:1440] UnregisterExternalAllocator] The graph_runner is not exist
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.213.915 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:178] ReleaseDeviceRes] Ascend finalize start
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.213.927 [context.cpp:72]618646 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.213.947 [api_impl.cc:3717] 618646 ContextSetCurrent: set context=aaab06c88220, flag=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.213.961 [context.cpp:80]618646 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.213.973 [context.cpp:72]618646 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.213.985 [api_impl.cc:3717] 618646 ContextSetCurrent: set context=aaab06c88220, flag=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.213.996 [context.cpp:80]618646 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.214.020 [device.cpp:143]618646 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.214.038 [api_impl.cc:2999] 618646 SetDevice: device_id=0, deviceMode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.214.050 [device.cc:306] 618646 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.214.063 [runtime.cc:3393] 618646 PrimaryContextRetain: Context inc ref, ts_id=0, count=0xb
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.214.077 [runtime.cc:3560] 618646 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.214.089 [api_impl.cc:2987] 618646 NewDevice: SetCurRef = 0xaaab06c88220,userDeviceId=0,deviceId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.214.101 [runtime.cc:5239] 618646 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.214.132 [api_impl.cc:2992] 618646 NewDevice: New device success, user_device_id=0, die_num=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.214.147 [api_impl.cc:3025] 618646 SetDevice: SetDevice success, curCtx=0xaaab06c88220, user_device_id=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.214.161 [acl.cpp:115]618646 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.214.173 [acl.cpp:121]618646 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.214.189 [device.cpp:154]618646 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 0
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.214.211 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:46] DestroyHandlerByName] Destroy watch dog thread by group name: hccl_world_group
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:48.228.194 [trs_cb_event.c:119][ascend][curpid:618666,618809][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =65; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:48.228.231 [trs_sqcq.c:1491][ascend][curpid:618666,618809][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:48.228.247 [npu_driver.cc:3833] 618809 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:48.228.268 [api_impl.cc:5058] 618809 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.228.308 [callback.cpp:132]618809 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.228.326 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.228.348 [npu_driver.cc:3828] 618809 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=65.
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:48.260.175 [queue_client_comm.c:114][ascend][curpid:618666,618845][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:48.260.175 [queue_client_comm.c:114][ascend][curpid:618666,618841][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:48.260.176 [queue_client_comm.c:114][ascend][curpid:618666,618849][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:48.260.173 [queue_client_comm.c:114][ascend][curpid:618666,618847][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:48.260.174 [queue_client_comm.c:114][ascend][curpid:618666,618843][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:48.260.188 [trs_cb_event.c:119][ascend][curpid:618658,618775][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =65; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:48.260.230 [trs_sqcq.c:1491][ascend][curpid:618658,618775][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:48.260.249 [npu_driver.cc:3833] 618775 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=65, drvRetCode=16.
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:48.260.176 [queue_client_comm.c:114][ascend][curpid:618666,618851][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:48.260.270 [api_impl.cc:5058] 618775 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:48.260.282 [npu_driver.cc:4338] 618845 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.260.303 [tensor_data_transfer.cpp:612]618845 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_tensor_summary
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:48.260.314 [npu_driver.cc:4338] 618841 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.260.303 [callback.cpp:132]618775 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.260.321 [tensor_data_transfer.cpp:1054]618845 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_tensor_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.260.329 [tensor_data_transfer.cpp:612]618841 acltdtReceiveTensorV2: queue is empty, device is 5, name is _npu_log
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.260.336 [tensor_data_transfer.cpp:1056]618845 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.260.329 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.260.345 [tensor_data_transfer.cpp:1054]618841 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is _npu_log
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.260.352 [api_impl.cc:6121] 618845 MemQueuePeek: Start to peek queue on devId 5, qid is 2.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.260.360 [npu_driver.cc:3828] 618775 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=65.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.260.359 [tensor_data_transfer.cpp:1056]618841 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:48.260.347 [npu_driver.cc:4338] 618849 MemQueuePeek: queue empty
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.260.367 [npu_driver.cc:4330] 618845 MemQueuePeek: peek mem queue, deviceId=5, qid=2, timeout=800.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.260.373 [api_impl.cc:6121] 618841 MemQueuePeek: Start to peek queue on devId 5, qid is 0.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.260.380 [tensor_data_transfer.cpp:612]618849 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_scalar_summary
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:48.260.381 [npu_driver.cc:4338] 618847 MemQueuePeek: queue empty
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.260.387 [npu_driver.cc:4330] 618841 MemQueuePeek: peek mem queue, deviceId=5, qid=0, timeout=800.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:48.260.412 [npu_driver.cc:4338] 618843 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.260.425 [tensor_data_transfer.cpp:612]618847 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_image_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.260.413 [tensor_data_transfer.cpp:1054]618849 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_scalar_summary
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:48.260.443 [npu_driver.cc:4338] 618851 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.260.459 [tensor_data_transfer.cpp:612]618843 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_tensor_dump
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.260.466 [tensor_data_transfer.cpp:1054]618847 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_image_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.260.487 [tensor_data_transfer.cpp:1056]618849 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.260.499 [tensor_data_transfer.cpp:612]618851 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_histogram_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.260.505 [tensor_data_transfer.cpp:1054]618843 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_tensor_dump
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.260.510 [tensor_data_transfer.cpp:1056]618847 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.260.530 [tensor_data_transfer.cpp:1054]618851 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_histogram_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.260.534 [tensor_data_transfer.cpp:1056]618843 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.260.521 [api_impl.cc:6121] 618849 MemQueuePeek: Start to peek queue on devId 5, qid is 4.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.260.541 [api_impl.cc:6121] 618847 MemQueuePeek: Start to peek queue on devId 5, qid is 3.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.260.544 [tensor_data_transfer.cpp:1056]618851 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.260.553 [api_impl.cc:6121] 618843 MemQueuePeek: Start to peek queue on devId 5, qid is 1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.260.560 [npu_driver.cc:4330] 618849 MemQueuePeek: peek mem queue, deviceId=5, qid=4, timeout=800.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.260.568 [npu_driver.cc:4330] 618847 MemQueuePeek: peek mem queue, deviceId=5, qid=3, timeout=800.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.260.578 [api_impl.cc:6121] 618851 MemQueuePeek: Start to peek queue on devId 5, qid is 5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.260.582 [npu_driver.cc:4330] 618843 MemQueuePeek: peek mem queue, deviceId=5, qid=1, timeout=800.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.260.606 [npu_driver.cc:4330] 618851 MemQueuePeek: peek mem queue, deviceId=5, qid=5, timeout=800.
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:48.292.188 [trs_cb_event.c:119][ascend][curpid:618674,618819][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =65; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:48.292.227 [trs_sqcq.c:1491][ascend][curpid:618674,618819][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:48.292.245 [npu_driver.cc:3833] 618819 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=65, drvRetCode=16.
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:48.292.194 [trs_cb_event.c:119][ascend][curpid:618662,618817][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =833; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:48.292.233 [trs_sqcq.c:1491][ascend][curpid:618662,618817][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:48.292.265 [api_impl.cc:5058] 618819 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:48.292.275 [npu_driver.cc:3833] 618817 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=833, drvRetCode=16.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:48.292.295 [api_impl.cc:5058] 618817 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.292.296 [callback.cpp:132]618819 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.292.327 [callback.cpp:132]618817 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.292.336 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.292.350 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.292.364 [npu_driver.cc:3828] 618819 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=65.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.292.377 [npu_driver.cc:3828] 618817 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=833.
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:48.324.170 [queue_client_comm.c:114][ascend][curpid:618662,618880][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:48.324.171 [queue_client_comm.c:114][ascend][curpid:618662,618885][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:48.324.171 [queue_client_comm.c:114][ascend][curpid:618662,618864][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:48.324.170 [queue_client_comm.c:114][ascend][curpid:618662,618872][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:48.324.172 [queue_client_comm.c:114][ascend][curpid:618662,618868][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:48.324.183 [trs_cb_event.c:119][ascend][curpid:618670,618823][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =65; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:48.324.220 [trs_sqcq.c:1491][ascend][curpid:618670,618823][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:48.324.181 [queue_client_comm.c:114][ascend][curpid:618674,618873][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:48.324.180 [queue_client_comm.c:114][ascend][curpid:618674,618881][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:48.324.180 [queue_client_comm.c:114][ascend][curpid:618662,618876][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:48.324.252 [npu_driver.cc:3833] 618823 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:48.324.282 [npu_driver.cc:4338] 618880 MemQueuePeek: queue empty
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:48.324.288 [api_impl.cc:5058] 618823 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:48.324.299 [queue_client_comm.c:114][ascend][curpid:618674,618884][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:48.324.317 [queue_client_comm.c:114][ascend][curpid:618674,618866][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:48.324.320 [npu_driver.cc:4338] 618864 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.324.341 [callback.cpp:132]618823 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:48.324.336 [queue_client_comm.c:114][ascend][curpid:618674,618870][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:48.324.347 [npu_driver.cc:4338] 618873 MemQueuePeek: queue empty
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:48.324.347 [npu_driver.cc:4338] 618872 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.324.383 [tensor_data_transfer.cpp:612]618873 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_tensor_summary
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:48.324.382 [npu_driver.cc:4338] 618881 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.324.409 [tensor_data_transfer.cpp:1054]618873 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_tensor_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.324.364 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.324.388 [npu_driver.cc:3828] 618823 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=65.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:48.324.394 [npu_driver.cc:4338] 618876 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.324.386 [tensor_data_transfer.cpp:612]618880 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_scalar_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.324.426 [tensor_data_transfer.cpp:612]618876 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_image_summary
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:48.324.421 [npu_driver.cc:4338] 618868 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.324.438 [tensor_data_transfer.cpp:1054]618880 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_scalar_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.324.458 [tensor_data_transfer.cpp:1054]618876 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_image_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.324.459 [tensor_data_transfer.cpp:612]618868 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_tensor_dump
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.324.444 [tensor_data_transfer.cpp:1056]618873 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:48.324.459 [npu_driver.cc:4338] 618884 MemQueuePeek: queue empty
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.324.466 [api_impl.cc:6121] 618873 MemQueuePeek: Start to peek queue on devId 7, qid is 2.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:48.324.472 [npu_driver.cc:4338] 618866 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.324.466 [tensor_data_transfer.cpp:1056]618880 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.324.488 [npu_driver.cc:4330] 618873 MemQueuePeek: peek mem queue, deviceId=7, qid=2, timeout=800.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.324.495 [tensor_data_transfer.cpp:612]618884 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_histogram_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.324.476 [tensor_data_transfer.cpp:612]618881 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_scalar_summary
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:48.324.469 [npu_driver.cc:4338] 618885 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.324.520 [tensor_data_transfer.cpp:612]618866 acltdtReceiveTensorV2: queue is empty, device is 7, name is _npu_log
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.324.480 [tensor_data_transfer.cpp:1056]618876 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:48.324.517 [npu_driver.cc:4338] 618870 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.324.475 [tensor_data_transfer.cpp:612]618872 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_tensor_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.324.522 [tensor_data_transfer.cpp:1054]618884 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_histogram_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.324.538 [tensor_data_transfer.cpp:1054]618866 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is _npu_log
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.324.455 [tensor_data_transfer.cpp:612]618864 acltdtReceiveTensorV2: queue is empty, device is 4, name is _npu_log
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.324.493 [tensor_data_transfer.cpp:1054]618868 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_tensor_dump
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.324.530 [tensor_data_transfer.cpp:1054]618881 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_scalar_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.324.558 [tensor_data_transfer.cpp:1056]618884 acltdtReceiveT[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.324.509 [api_impl.cc:6121] 618880 MemQueuePeek: Start to peek queue on devId 4, qid is 4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.324.547 [api_impl.cc:6121] 618876 MemQueuePeek: Start to peek queue on devId 4, qid is 3.
ensor: new process, use queue process
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.324.564 [tensor_data_transfer.cpp:1056]618866 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.324.599 [api_impl.cc:6121] 618884 MemQueuePeek: Start to peek queue on devId 7, qid is 5.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.324.573 [tensor_data_transfer.cpp:1056]618881 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.324.562 [tensor_data_transfer.cpp:1054]618872 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_tensor_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.324.575 [tensor_data_transfer.cpp:612]618870 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_tensor_dump
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.324.568 [tensor_data_transfer.cpp:612]618885 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_histogram_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.324.575 [tensor_data_transfer.cpp:1054]618864 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is _npu_log
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.324.604 [api_impl.cc:6121] 618866 MemQueuePeek: Start to peek queue on devId 7, qid is 0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.324.614 [npu_driver.cc:4330] 618884 MemQueuePeek: peek mem queue, deviceId=7, qid=5, timeout=800.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.324.583 [tensor_data_transfer.cpp:1056]618868 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.324.626 [api_impl.cc:6121] 618881 MemQueuePeek: Start to peek queue on devId 7, qid is 4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.324.600 [npu_driver.cc:4330] 618880 MemQueuePeek: peek mem queue, deviceId=4, qid=4, timeout=800.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.324.637 [tensor_data_transfer.cpp:1054]618870 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_tensor_dump
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.324.643 [npu_driver.cc:4330] 618866 MemQueuePeek: peek mem queue, deviceId=7, qid=0, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.324.614 [npu_driver.cc:4330] 618876 MemQueuePeek: peek mem queue, deviceId=4, qid=3, timeout=800.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.324.626 [tensor_data_transfer.cpp:1056]618872 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.324.644 [tensor_data_transfer.cpp:1054]618885 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_histogram_summary
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.324.658 [npu_driver.cc:4330] 618881 MemQueuePeek: peek mem queue, deviceId=7, qid=4, timeout=800.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.324.669 [tensor_data_transfer.cpp:1056]618870 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.324.647 [tensor_data_transfer.cpp:1056]618864 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.324.713 [api_impl.cc:6121] 618870 MemQueuePeek: Start to peek queue on devId 7, qid is 1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.324.718 [api_impl.cc:6121] 618864 MemQueuePeek: Start to peek queue on devId 4, qid is 0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.324.658 [api_impl.cc:6121] 618868 MemQueuePeek: Start to peek queue on devId 4, qid is 1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.324.730 [npu_driver.cc:4330] 618870 MemQueuePeek: peek mem queue, deviceId=7, qid=1, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.324.700 [api_impl.cc:6121] 618872 MemQueuePeek: Start to peek queue on devId 4, qid is 2.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.324.704 [tensor_data_transfer.cpp:1056]618885 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.324.758 [npu_driver.cc:4330] 618872 MemQueuePeek: peek mem queue, deviceId=4, qid=2, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.324.737 [npu_driver.cc:4330] 618864 MemQueuePeek: peek mem queue, deviceId=4, qid=0, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.324.746 [npu_driver.cc:4330] 618868 MemQueuePeek: peek mem queue, deviceId=4, qid=1, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.324.771 [api_impl.cc:6121] 618885 MemQueuePeek: Start to peek queue on devId 4, qid is 5.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.324.808 [npu_driver.cc:4330] 618885 MemQueuePeek: peek mem queue, deviceId=4, qid=5, timeout=800.
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:48.325.616 [queue_client_comm.c:114][ascend][curpid:618674,618878][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:48.325.718 [npu_driver.cc:4338] 618878 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.325.744 [tensor_data_transfer.cpp:612]618878 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_image_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.325.761 [tensor_data_transfer.cpp:1054]618878 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_image_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.325.777 [tensor_data_transfer.cpp:1056]618878 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.325.790 [api_impl.cc:6121] 618878 MemQueuePeek: Start to peek queue on devId 7, qid is 3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.325.804 [npu_driver.cc:4330] 618878 MemQueuePeek: peek mem queue, deviceId=7, qid=3, timeout=800.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:48.355.751 [awatchdog_monitor.c:160](tid:618680) thread 619007 not exist
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:48.356.182 [queue_client_comm.c:114][ascend][curpid:618670,618901][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:48.356.182 [queue_client_comm.c:114][ascend][curpid:618670,618903][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:48.356.185 [queue_client_comm.c:114][ascend][curpid:618670,618907][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:48.356.180 [trs_cb_event.c:119][ascend][curpid:618658,618774][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =64; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:48.356.218 [trs_sqcq.c:1491][ascend][curpid:618658,618774][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:48.356.188 [trs_cb_event.c:119][ascend][curpid:618670,618822][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =64; ret=16)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:48.356.235 [npu_driver.cc:3833] 618774 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=64, drvRetCode=16.
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:48.356.193 [trs_cb_event.c:119][ascend][curpid:618650,618828][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =320; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:48.356.235 [trs_sqcq.c:1491][ascend][curpid:618650,618828][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:48.356.190 [queue_client_comm.c:114][ascend][curpid:618670,618909][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:48.356.249 [trs_sqcq.c:1491][ascend][curpid:618670,618822][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:48.356.253 [api_impl.cc:5058] 618774 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:48.356.254 [npu_driver.cc:3833] 618828 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=320, drvRetCode=16.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:48.356.270 [npu_driver.cc:3833] 618822 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=64, drvRetCode=16.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.356.278 [callback.cpp:132]618774 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:48.356.261 [trs_cb_event.c:119][ascend][curpid:618666,618808][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =64; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:48.356.292 [trs_sqcq.c:1491][ascend][curpid:618666,618808][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:48.356.278 [api_impl.cc:5058] 618828 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:48.356.271 [queue_client_comm.c:114][ascend][curpid:618670,618905][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:48.356.275 [queue_client_comm.c:114][ascend][curpid:618670,618911][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:48.356.286 [api_impl.cc:5058] 618822 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:48.356.290 [npu_driver.cc:4338] 618901 MemQueuePeek: queue empty
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:48.356.311 [npu_driver.cc:4338] 618903 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.356.319 [callback.cpp:132]618822 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.356.299 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.356.312 [callback.cpp:132]618828 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.356.335 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:48.356.311 [npu_driver.cc:3833] 618808 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:48.356.326 [api_impl.cc:5058] 618808 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.356.334 [npu_driver.cc:3828] 618774 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=64.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.356.323 [tensor_data_transfer.cpp:612]618901 acltdtReceiveTensorV2: queue is empty, device is 6, name is _npu_log
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.356.325 [tensor_data_transfer.cpp:612]618903 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_tensor_dump
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.356.336 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.356.341 [tensor_data_transfer.cpp:1054]618901 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is _npu_log
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.356.344 [ten[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.356.361 [callback.cpp:132]618808 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.356.376 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
sor_data_transfer.cpp:1054]618903 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_tensor_dump
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.356.355 [npu_driver.cc:3828] 618822 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=64.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.356.358 [tensor_data_transfer.cpp:1056]618901 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:48.356.359 [npu_driver.cc:4338] 618907 MemQueuePeek: queue empty
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.356.394 [npu_driver.cc:3828] 618808 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=64.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.356.358 [npu_driver.cc:3828] 618828 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=320.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.356.382 [tensor_data_transfer.cpp:1056]618903 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:48.356.390 [npu_driver.cc:4338] 618909 MemQueuePeek: queue empty
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.356.396 [api_impl.cc:6121] 618901 MemQueuePeek: Start to peek queue on devId 6, qid is 0.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.356.404 [tensor_data_transfer.cpp:612]618907 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_image_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.356.410 [api_impl.cc:6121] 618903 MemQueuePeek: Start to peek queue on devId 6, qid is 1.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:48.356.419 [npu_driver.cc:4338] 618905 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.356.419 [tensor_data_transfer.cpp:612]618909 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_scalar_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.356.424 [npu_driver.cc:4330] 618901 MemQueuePeek: peek mem queue, deviceId=6, qid=0, timeout=800.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.356.431 [tensor_data_transfer.cpp:1054]618907 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_image_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.356.435 [npu_driver.cc:4330] 618903 MemQueuePeek: peek mem queue, deviceId=6, qid=1, timeout=800.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.356.441 [tensor_data_transfer.cpp:612]618905 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_tensor_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.356.448 [tensor_data_transfer.cpp:1054]618909 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_scalar_summary
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:48.356.450 [npu_driver.cc:4338] 618911 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.356.458 [tensor_data_transfer.cpp:1056]618907 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.356.476 [tensor_data_transfer.cpp:1054]618905 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_tensor_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.356.482 [tensor_data_transfer.cpp:1056]618909 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.356.491 [tensor_data_transfer.cpp:612]618911 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_histogram_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.356.501 [api_impl.cc:6121] 618907 MemQueuePeek: Start to peek queue on devId 6, qid is 3.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.356.504 [tensor_data_transfer.cpp:1056]618905 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.356.512 [api_impl.cc:6121] 618909 MemQueuePeek: Start to peek queue on devId 6, qid is 4.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.356.518 [tensor_data_transfer.cpp:1054]618911 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_histogram_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.356.524 [npu_driver.cc:4330] 618907 MemQueuePeek: peek mem queue, deviceId=6, qid=3, timeout=800.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.356.532 [api_impl.cc:6121] 618905 MemQueuePeek: Start to peek queue on devId 6, qid is 2.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.356.537 [npu_driver.cc:4330] 618909 MemQueuePeek: peek mem queue, deviceId=6, qid=4, timeout=800.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.356.543 [tensor_data_transfer.cpp:1056]618911 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.356.567 [npu_driver.cc:4330] 618905 MemQueuePeek: peek mem queue, deviceId=6, qid=2, timeout=800.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.356.579 [api_impl.cc:6121] 618911 MemQueuePeek: Start to peek queue on devId 6, qid is 5.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.356.592 [npu_driver.cc:4330] 618911 MemQueuePeek: peek mem queue, deviceId=6, qid=5, timeout=800.
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:48.388.181 [trs_cb_event.c:119][ascend][curpid:618674,618818][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =64; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:48.388.205 [trs_sqcq.c:1491][ascend][curpid:618674,618818][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:48.388.219 [npu_driver.cc:3833] 618818 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:48.388.234 [api_impl.cc:5058] 618818 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.388.251 [callback.cpp:132]618818 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:48.388.189 [trs_cb_event.c:119][ascend][curpid:618654,618832][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =320; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:48.388.244 [trs_sqcq.c:1491][ascend][curpid:618654,618832][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:48.388.190 [trs_cb_event.c:119][ascend][curpid:618662,618816][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =832; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:48.388.244 [trs_s[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:48.388.263 [npu_driver.cc:3833] 618832 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=320, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:48.388.285 [api_impl.cc:5058] 618832 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.388.267 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
qcq.c:1491][ascend][curpid:618662,618816][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:48.388.302 [npu_driver.cc:3833] 618816 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=832, drvRetCode=16.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.388.307 [npu_driver.cc:3828] 618818 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=64.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.388.312 [callback.cpp:132]618832 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:48.388.319 [api_impl.cc:5058] 618816 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.388.336 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.388.342 [callback.cpp:132]618816 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.388.361 [npu_driver.cc:3828] 618832 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=320.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.388.362 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.388.381 [npu_driver.cc:3828] 618816 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=832.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.414.731 [context.cpp:72]618658 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.414.805 [api_impl.cc:3717] 618658 ContextSetCurrent: set context=aaab0b9e09a0, flag=0.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.414.833 [context.cpp:80]618658 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.414.903 [stream.cpp:131]618658 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.414.940 [api_impl.cc:1394] 618658 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.414.970 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.075 [stars_engine.cc:643] 618658 ProcLogicCqUntilEmpty: Notify: cnt=3, idx=0, stream_id=2, task_id=1, sqeType=1, retCode=0, errType=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.164 [logger.cc:152] 618658 TaskFinished: device_id=3, stream_id=2, task_id=0, task_type=5 (MEMCPY_ASYNC), task_finish_num=9
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.186 [task_manager.cc:485] 618658 TaskFailCallBack: task ok, stream_id=2, task_id=0, retCode=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.209 [task_res.cc:323] 618658 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=3, stream_id=2, taskId=0, taskDesHeadIdx=0, taskResHead_=1, tail=6, taskResTail_=6
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.229 [logger.cc:152] 618658 TaskFinished: device_id=3, stream_id=2, task_id=1, task_type=72 (HOSTFUNC_CALLBACK), task_finish_num=10
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.259 [task_res.cc:323] 618658 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=3, stream_id=2, taskId=1, taskDesHeadIdx=1, taskResHead_=2, tail=6, taskResTail_=6
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.285 [stars_engine.cc:643] 618658 ProcLogicCqUntilEmpty: Notify: cnt=3, idx=1, stream_id=2, task_id=3, sqeType=1, retCode=0, errType=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.303 [logger.cc:152] 618658 TaskFinished: device_id=3, stream_id=2, task_id=2, task_type=5 (MEMCPY_ASYNC), task_finish_num=11
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.321 [task_manager.cc:485] 618658 TaskFailCallBack: task ok, stream_id=2, task_id=2, retCode=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.344 [task_res.cc:323] 618658 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=3, stream_id=2, taskId=2, taskDesHeadIdx=2, taskResHead_=3, tail=6, taskResTail_=6
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.362 [logger.cc:152] 618658 TaskFinished: device_id=3, stream_id=2, task_id=3, task_type=72 (HOSTFUNC_CALLBACK), task_finish_num=12
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.377 [task_res.cc:323] 618658 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=3, stream_id=2, taskId=3, taskDesHeadIdx=3, taskResHead_=4, tail=6, taskResTail_=6
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.398 [stars_engine.cc:643] 618658 ProcLogicCqUntilEmpty: Notify: cnt=3, idx=2, stream_id=2, task_id=5, sqeType=1, retCode=0, errType=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.416 [logger.cc:152] 618658 TaskFinished: device_id=3, stream_id=2, task_id=4, task_type=5 (MEMCPY_ASYNC), task_finish_num=13
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.434 [task_manager.cc:485] 618658 TaskFailCallBack: task ok, stream_id=2, task_id=4, retCode=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.447 [task_res.cc:323] 618658 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=3, stream_id=2, taskId=4, taskDesHeadIdx=4, taskResHead_=5, tail=6, taskResTail_=6
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.486 [logger.cc:152] 618658 TaskFinished: device_id=3, stream_id=2, task_id=5, task_type=72 (HOSTFUNC_CALLBACK), task_finish_num=14
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.501 [task_res.cc:323] 618658 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=3, stream_id=2, taskId=5, taskDesHeadIdx=5, taskResHead_=6, tail=6, taskResTail_=6
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.530 [stars_engine.cc:622] 618658 ProcLogicCqUntilEmpty: Task Wait: stream_id=2, logicCqId=1040, retCode=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.547 [stream.cc:2886] 618658 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.563 [api_error.cc:895] 618658 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.415.581 [stream.cpp:146]618658 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.415.603 [stream.cpp:131]618658 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.637 [api_impl.cc:1394] 618658 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.655 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.686 [stream.cc:2886] 618658 StarsWaitForTask: No.0 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.704 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.717 [stream.cc:2886] 618658 StarsWaitForTask: No.1 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.734 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.746 [stream.cc:2886] 618658 StarsWaitForTask: No.2 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.763 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.775 [stream.cc:2886] 618658 StarsWaitForTask: No.3 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.792 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.804 [stream.cc:2886] 618658 StarsWaitForTask: No.4 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.818 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.834 [stream.cc:2886] 618658 StarsWaitForTask: No.5 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.846 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.863 [stream.cc:2886] 618658 StarsWaitForTask: No.6 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.876 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.892 [stream.cc:2886] 618658 StarsWaitForTask: No.7 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.905 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.919 [stream.cc:2886] 618658 StarsWaitForTask: No.8 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.950 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.963 [stream.cc:2886] 618658 StarsWaitForTask: No.9 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.980 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.415.992 [stream.cc:2886] 618658 StarsWaitForTask: No.10 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.010 [event.cc:310] 618658 InitEventAllocFlag: Stars not need to alloc id in this flag=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.054 [task_res.cc:380] 618658 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=3, stream_id=3, taskResId=0, taskResHead_=0, taskResTail_=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.085 [event.cc:249] 618658 UpdateLatestRecord: device_id=3, event_id=-1, cur stream_id=3, cur task_id=0, latest stream_id=3, latest task_id=0, status=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.104 [event_task.cc:259] 618658 ConstructSqeForEventRecordTask: event_record: device_id=3, stream_id=3, task_id=0, event_id=4294967295, sq_id=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.124 [stream.cc:1400] 618658 AddTaskToList: public task, stream_id=3, task_id=0, task_type=2 (EVENT_RECORD), head=0, tail=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.141 [stream.cc:2595] 618658 StarsAddTaskToStream: single-operator flow stream, stream_id=3, task_id=0, type=2(EVENT_RECORD), head=0, tail=1, sqe_num=1, lastTail=0, device_id=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.187 [task_submit.cc:573] 618658 AllocTaskAndSendStars: device_id=3, ts_id=0, sq_id=3, cq_id=3, stream_id=3, task_id=0, task_type=2(EVENT_RECORD).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.210 [stars_engine.cc:1122] 618658 SyncTask: Task Wait: device_id=3, stream_id=3, task_id=0, logicCqId=1041.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.234 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.252 [stars_engine.cc:1071] 618658 IsSyncTaskFinish: Sync task finished, sqHead=1 finishedTaskId=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.270 [stars_engine.cc:1017] 618658 ProcReport: Get logic report: cnt=1, idx=0, stream_id=3, report task_id=0, sync task_id=0, sqeType=3, sqeHead=0, retCode=0, errType=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.293 [stars_engine.cc:1027] 618658 ProcReport: taskType=2.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.309 [logger.cc:152] 618658 TaskFinished: device_id=3, stream_id=3, task_id=0, task_type=2 (EVENT_RECORD), task_finish_num=15
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.328 [event.cc:249] 618658 UpdateLatestRecord: device_id=3, event_id=-1, cur stream_id=3, cur task_id=0, latest stream_id=3, latest task_id=0, status=2
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.347 [event_task.cc:211] 618658 DoCompleteSuccessForEventRecordTask: event_record: device_id=3, stream_id=3, task_id=0, sq_id=3, event_id=4294967295, timeline=0xffffffffffffffff, timestamp=0x1e4b8f098e8
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.367 [event.cc:122] 618658 TryFreeEventIdAndCheckCanBeDelete: device_id=3, event_id=-1, map_count=0, isNewMode=0, isIdFromDrv=0, newestId=-1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.386 [task_res.cc:323] 618658 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=3, stream_id=3, taskId=0, taskDesHeadIdx=0, taskResHead_=1, tail=1, taskResTail_=1
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.417 [npu_driver.cc:5618] 618658 GetSqEnable: deviceId=3, tsId=0, sqId=3, enable=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.434 [stream.cc:1494] 618658 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.459 [api_error.cc:895] 618658 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.416.472 [stream.cpp:146]618658 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.416.532 [context.cpp:72]618658 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.551 [api_impl.cc:3717] 618658 ContextSetCurrent: set context=aaab0b9e09a0, flag=0.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.416.565 [context.cpp:80]618658 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.416.582 [stream.cpp:131]618658 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.602 [api_impl.cc:1394] 618658 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.614 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.641 [stream.cc:2886] 618658 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.658 [api_error.cc:895] 618658 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.416.670 [stream.cpp:146]618658 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.416.685 [stream.cpp:131]618658 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.705 [api_impl.cc:1394] 618658 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.718 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.748 [stars_engine.cc:622] 618658 ProcLogicCqUntilEmpty: Task Wait: stream_id=3, logicCqId=1041, retCode=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.765 [stream.cc:2886] 618658 StarsWaitForTask: No.0 stream_id=3, taskId=0, currentId=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.416.777 [api_error.cc:895] 618658 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.416.792 [stream.cpp:146]618658 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.416.807 [memory.cpp:421]618658 aclrtMemcpy: start to execute aclrtMemcpy, destMaxSize = 108, srcSize = 108, kind = 2
F[WARNING] DRV(618650,python3.9):2025-04-03-09:27:48.420.202 [trs_cb_event.c:119][ascend][curpid:618650,618829][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =321; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:48.420.238 [trs_sqcq.c:1491][ascend][curpid:618650,618829][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:48.420.251 [npu_driver.cc:3833] 618829 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:48.420.265 [api_impl.cc:5058] 618829 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.420.287 [callback.cpp:132]618829 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.420.307 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.420.322 [npu_driver.cc:3828] 618829 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=321.


========================================================================================================================= FAILURES =========================================================================================================================
______________________________________________________________________________________________________________________ test_AllReduce ______________________________________________________________________________________________________________________

    def test_AllReduce():
        """
        Feature: lccl operator test.
        Description: msrun lccl all_reduce 8P case.
        Expectation: success
        """
        all_reduce = Net()
        output = all_reduce()
    
        expect0 = np.ones([3, 1, 3, 3]).astype(np.float32) * 0
        for i in range(size):
            part = np.ones([3, 1, 3, 3]).astype(np.float32) * 0.01 * (i + 1)
            expect0 += part
>       diff0 = output[0].asnumpy() - expect0

test_lccl_allreduce.py:66: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = Tensor(shape=[3, 1, 3, 3], dtype=Float32, value=
[[[[ 0.00000000e+00,  0.00000000e+00,  0.00000000e+00],
   [ 0.000000...00],
   [ 0.00000000e+00,  0.00000000e+00,  0.00000000e+00],
   [ 0.00000000e+00,  0.00000000e+00,  0.00000000e+00]]]])

    def asnumpy(self):
        """
        Convert tensor to numpy array. Returns self tensor as a NumPy ndarray. This tensor and the returned ndarray
        share the same underlying storage. Changes to self tensor will be reflected in the ndarray.
    
        Returns:
            A numpy ndarray which shares the same underlying storage with the tensor.
    
        Examples:
            >>> from mindspore import Tensor
            >>> import numpy as np
            >>> x = Tensor(np.array([1, 2], dtype=np.float32))
            >>> y = x.asnumpy()
            >>> y[0] = 11
            >>> print(x)
            [11.  2.]
            >>> print(y)
            [11.  2.]
        """
        if self.has_init:
            self.init_data()
>       return TensorPy_.asnumpy(self)
E       RuntimeError: LCCL AllReduce failed.
E       
E       ----------------------------------------------------
E       - C++ Call Stack: (For framework developers)
E       ----------------------------------------------------
E       mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/common/tensor.py:989: RuntimeError
===================================================================================================================== warnings summary =====================================================================================================================
../../../../../../../../usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866
  /usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866: DeprecationWarning: invalid escape sequence \L
    if not dirpath.find("AppData\Local\Temp"):

../../../../../../../../usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/classifier/transdata/transdata_classifier.py:222
  /usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/classifier/transdata/transdata_classifier.py:222: DeprecationWarning: invalid escape sequence \B
    """

../../../../../../../../usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:143
  /usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:143: DeprecationWarning: invalid escape sequence \c
    """

../../../../../../../../usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:170
  /usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:170: DeprecationWarning: invalid escape sequence \c
    """

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for <class 'numpy.float64'> type is zero.
    setattr(self, word, getattr(machar, word).flat[0])

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for <class 'numpy.float64'> type is zero.
    return self._float_to_str(self.smallest_subnormal)

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for <class 'numpy.float32'> type is zero.
    setattr(self, word, getattr(machar, word).flat[0])

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for <class 'numpy.float32'> type is zero.
    return self._float_to_str(self.smallest_subnormal)

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2.py:57
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2.py:57: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("batchnorm_fold2")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad.py:56
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad.py:56: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("batchnorm_fold2_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad_reduce.py:48
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad_reduce.py:48: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("batchnorm_fold2_grad_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul.py:51
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul.py:51: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("correction_mul")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:51
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:51: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("correction_mul_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:143
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.424.481 [context.cpp:72]618654 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.424.529 [api_impl.cc:3717] 618654 ContextSetCurrent: set context=aaaaf5082ff0, flag=0.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.424.554 [context.cpp:80]618654 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.424.599 [stream.cpp:131]618654 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.424.635 [api_impl.cc:1394] 618654 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.424.656 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.424.715 [stars_engine.cc:643] 618654 ProcLogicCqUntilEmpty: Notify: cnt=3, idx=0, stream_id=2, task_id=1, sqeType=1, retCode=0, errType=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.424.743 [logger.cc:152] 618654 TaskFinished: device_id=2, stream_id=2, task_id=0, task_type=5 (MEMCPY_ASYNC), task_finish_num=9
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.424.763 [task_manager.cc:485] 618654 TaskFailCallBack: task ok, stream_id=2, task_id=0, retCode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.424.779 [task_res.cc:323] 618654 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=2, stream_id=2, taskId=0, taskDesHeadIdx=0, taskResHead_=1, tail=6, taskResTail_=6
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.424.798 [logger.cc:152] 618654 TaskFinished: device_id=2, stream_id=2, task_id=1, task_type=72 (HOSTFUNC_CALLBACK), task_finish_num=10
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.424.817 [task_res.cc:323] 618654 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=2, stream_id=2, taskId=1, taskDesHeadIdx=1, taskResHead_=2, tail=6, taskResTail_=6
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.424.841 [stars_engine.cc:643] 618654 ProcLogicCqUntilEmpty: Notify: cnt=3, idx=1, stream_id=2, task_id=3, sqeType=1, retCode=0, errType=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.424.860 [logger.cc:152] 618654 TaskFinished: device_id=2, stream_id=2, task_id=2, task_type=5 (MEMCPY_ASYNC), task_finish_num=11
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.424.878 [task_manager.cc:485] 618654 TaskFailCallBack: task ok, stream_id=2, task_id=2, retCode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.424.892 [task_res.cc:323] 618654 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=2, stream_id=2, taskId=2, taskDesHeadIdx=2, taskResHead_=3, tail=6, taskResTail_=6
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.424.910 [logger.cc:152] 618654 TaskFinished: device_id=2, stream_id=2, task_id=3, task_type=72 (HOSTFUNC_CALLBACK), task_finish_num=12
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.424.924 [task_res.cc:323] 618654 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=2, stream_id=2, taskId=3, taskDesHeadIdx=3, taskResHead_=4, tail=6, taskResTail_=6
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.424.945 [stars_engine.cc:643] 618654 ProcLogicCqUntilEmpty: Notify: cnt=3, idx=2, stream_id=2, task_id=5, sqeType=1, retCode=0, errType=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.424.963 [logger.cc:152] 618654 TaskFinished: device_id=2, stream_id=2, task_id=4, task_type=5 (MEMCPY_ASYNC), task_finish_num=13
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.424.977 [task_manager.cc:485] 618654 TaskFailCallBack: task ok, stream_id=2, task_id=4, retCode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.424.994 [task_res.cc:323] 618654 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=2, stream_id=2, taskId=4, taskDesHeadIdx=4, taskResHead_=5, tail=6, taskResTail_=6
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.013 [logger.cc:152] 618654 TaskFinished: device_id=2, stream_id=2, task_id=5, task_type=72 (HOSTFUNC_CALLBACK), task_finish_num=14
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.027 [task_res.cc:323] 618654 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=2, stream_id=2, taskId=5, taskDesHeadIdx=5, taskResHead_=6, tail=6, taskResTail_=6
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.051 [stars_engine.cc:622] 618654 ProcLogicCqUntilEmpty: Task Wait: stream_id=2, logicCqId=998, retCode=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.068 [stream.cc:2886] 618654 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.099 [api_error.cc:895] 618654 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.425.112 [stream.cpp:146]618654 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.425.138 [stream.cpp:131]618654 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.158 [api_impl.cc:1394] 618654 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.172 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.191 [stream.cc:2886] 618654 StarsWaitForTask: No.0 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.209 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.228 [stream.cc:2886] 618654 StarsWaitForTask: No.1 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.242 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.258 [stream.cc:2886] 618654 StarsWaitForTask: No.2 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.272 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.288 [stream.cc:2886] 618654 StarsWaitForTask: No.3 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.301 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.316 [stream.cc:2886] 618654 StarsWaitForTask: No.4 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.333 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.345 [stream.cc:2886] 618654 StarsWaitForTask: No.5 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.361 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.375 [stream.cc:2886] 618654 StarsWaitForTask: No.6 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.392 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.405 [stream.cc:2886] 618654 StarsWaitForTask: No.7 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.425 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.440 [stream.cc:2886] 618654 StarsWaitForTask: No.8 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.454 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.470 [stream.cc:2886] 618654 StarsWaitForTask: No.9 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.483 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.497 [stream.cc:2886] 618654 StarsWaitForTask: No.10 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.512 [event.cc:310] 618654 InitEventAllocFlag: Stars not need to alloc id in this flag=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.537 [task_res.cc:380] 618654 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=2, stream_id=3, taskResId=0, taskResHead_=0, taskResTail_=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.571 [event.cc:249] 618654 UpdateLatestRecord: device_id=2, event_id=-1, cur stream_id=3, cur task_id=0, latest stream_id=3, latest task_id=0, status=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.591 [event_task.cc:259] 618654 ConstructSqeForEventRecordTask: event_record: device_id=2, stream_id=3, task_id=0, event_id=4294967295, sq_id=3.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.605 [stream.cc:1400] 618654 AddTaskToList: public task, stream_id=3, task_id=0, task_type=2 (EVENT_RECORD), head=0, tail=1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.623 [stream.cc:2595] 618654 StarsAddTaskToStream: single-operator flow stream, stream_id=3, task_id=0, type=2(EVENT_RECORD), head=0, tail=1, sqe_num=1, lastTail=0, device_id=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.644 [task_submit.cc:573] 618654 AllocTaskAndSendStars: device_id=2, ts_id=0, sq_id=3, cq_id=3, stream_id=3, task_id=0, task_type=2(EVENT_RECORD).
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.663 [stars_engine.cc:1122] 618654 SyncTask: Task Wait: device_id=2, stream_id=3, task_id=0, logicCqId=999.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.703 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.721 [stars_engine.cc:1071] 618654 IsSyncTaskFinish: Sync task finished, sqHead=1 finishedTaskId=0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.425.711 [context.cpp:72]618666 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.425.750 [api_impl.cc:3717] 618666 ContextSetCurrent: set context=aaaaf6e2dcc0, flag=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.741 [stars_engine.cc:1017] 618654 ProcReport: Get logic report: cnt=1, idx=0, stream_id=3, report task_id=0, sync task_id=0, sqeType=3, sqeHead=0, retCode=0, errType=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.761 [stars_engine.cc:1027] 618654 ProcReport: taskType=2.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.425.769 [context.cpp:80]618666 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.775 [logger.cc:152] 618654 TaskFinished: device_id=2, stream_id=3, task_id=0, task_type=2 (EVENT_RECORD), task_finish_num=15
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.425.793 [stream.cpp:131]618666 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.794 [event.cc:249] 618654 UpdateLatestRecord: device_id=2, event_id=-1, cur stream_id=3, cur task_id=0, latest stream_id=3, latest task_id=0, status=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.425.816 [api_impl.cc:1394] 618666 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.815 [event_task.cc:211] 618654 DoCompleteSuccessForEventRecordTask: event_record: device_id=2, stream_id=3, task_id=0, sq_id=3, event_id=4294967295, timeline=0xffffffffffffffff, timestamp=0x1e4b8f7d020
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.833 [event.cc:122] 618654 TryFreeEventIdAndCheckCanBeDelete: device_id=2, event_id=-1, map_count=0, isNewMode=0, isIdFromDrv=0, newestId=-1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.849 [task_res.cc:323] 618654 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=2, stream_id=3, taskId=0, taskDesHeadIdx=0, taskResHead_=1, tail=1, taskResTail_=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.425.837 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.872 [npu_driver.cc:5618] 618654 GetSqEnable: deviceId=2, tsId=0, sqId=3, enable=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.889 [stream.cc:1494] 618654 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.425.902 [api_error.cc:895] 618654 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.425.898 [stars_engine.cc:643] 618666 ProcLogicCqUntilEmpty: Notify: cnt=3, idx=0, stream_id=2, task_id=1, sqeType=1, retCode=0, errType=0.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.425.916 [stream.cpp:146]618654 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.425.926 [logger.cc:152] 618666 TaskFinished: device_id=5, stream_id=2, task_id=0, task_type=5 (MEMCPY_ASYNC), task_finish_num=9
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.425.945 [task_manager.cc:485] 618666 TaskFailCallBack: task ok, stream_id=2, task_id=0, retCode=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.425.960 [task_res.cc:323] 618666 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=5, stream_id=2, taskId=0, taskDesHeadIdx=0, taskResHead_=1, tail=6, taskResTail_=6
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.425.978 [logger.cc:152] 618666 TaskFinished: device_id=5, stream_id=2, task_id=1, task_type=72 (HOSTFUNC_CALLBACK), task_finish_num=10
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.425.995 [task_res.cc:323] 618666 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=5, stream_id=2, taskId=1, taskDesHeadIdx=1, taskResHead_=2, tail=6, taskResTail_=6
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.426.007 [context.cpp:72]618654 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.017 [stars_engine.cc:643] 618666 ProcLogicCqUntilEmpty: Notify: cnt=3, idx=1, stream_id=2, task_id=3, sqeType=1, retCode=0, errType=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.426.028 [api_impl.cc:3717] 618654 ContextSetCurrent: set context=aaaaf5082ff0, flag=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.034 [logger.cc:152] 618666 TaskFinished: device_id=5, stream_id=2, task_id=2, task_type=5 (MEMCPY_ASYNC), task_finish_num=11
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.048 [task_manager.cc:485] 618666 TaskFailCallBack: task ok, stream_id=2, task_id=2, retCode=0.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.426.045 [context.cpp:80]618654 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.426.074 [stream.cpp:131]618654 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.063 [task_res.cc:323] 618666 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=5, stream_id=2, taskId=2, taskDesHeadIdx=2, taskResHead_=3, tail=6, taskResTail_=6
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.426.091 [api_impl.cc:1394] 618654 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.080 [logger.cc:152] 618666 TaskFinished: device_id=5, stream_id=2, task_id=3, task_type=72 (HOSTFUNC_CALLBACK), task_finish_num=12
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.096 [task_res.cc:323] 618666 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=5, stream_id=2, taskId=3, taskDesHeadIdx=3, taskResHead_=4, tail=6, taskResTail_=6
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.426.106 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.116 [stars_engine.cc:643] 618666 ProcLogicCqUntilEmpty: Notify: cnt=3, idx=2, stream_id=2, task_id=5, sqeType=1, retCode=0, errType=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.426.125 [stream.cc:2886] 618654 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.426.141 [api_error.cc:895] 618654 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.426.154 [stream.cpp:146]618654 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.133 [logger.cc:152] 618666 TaskFinished: device_id=5, stream_id=2, task_id=4, task_type=5 (MEMCPY_ASYNC), task_finish_num=13
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.162 [task_manager.cc:485] 618666 TaskFailCallBack: task ok, stream_id=2, task_id=4, retCode=0.
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:143: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("correction_mul_grad_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perlayer")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad.py:92
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad.py:92: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perlayer_grad_d")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad_reduce.py:49
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad_reduce.py:49: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perlayer_grad_d_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perchannel")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad.py:91
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad.py:91: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perchannel_grad_d")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad_reduce.py:48
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad_reduce.py:48: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perchannel_grad_d_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel.py:52
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel.py:52: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_perchannel")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel_grad.py:81
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.177 [task_res.cc:323] 618666 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=5, stream_id=2, taskId=4, taskDesHeadIdx=4, taskResHead_=5, tail=6, taskResTail_=6
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.426.170 [stream.cpp:131]618654 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.426.192 [api_impl.cc:1394] 618654 StreamSynchronize: stream_id=3.
op/fake_quant_perchannel_grad.py:81: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_perchannel_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer.py:54
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer.py:54: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_per_layer")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer_grad.py:81
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer_grad.py:81: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_per_layer_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perchannel.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perchannel.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("minmax_update_perchannel")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("minmax_update_perlayer")

-- Docs: https://docs.pytest.org/en/stable/warnings.html
================================================================================================================= short test summary info ==================================================================================================================
FAILED test_lccl_allreduce.py::test_AllReduce - RuntimeError: LCCL AllReduce failed.
============================================================================================================= 1 failed, 26 warnings in 23.60s ==============================================================================================================
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.195 [logger.cc:152] 618666 TaskFinished: device_id=5, stream_id=2, task_id=5, task_type=72 (HOSTFUNC_CALLBACK), task_finish_num=14
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.208 [task_res.cc:323] 618666 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=5, stream_id=2, taskId=5, taskDesHeadIdx=5, taskResHead_=6, tail=6, taskResTail_=6
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.426.204 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.236 [stars_engine.cc:622] 618666 ProcLogicCqUntilEmpty: Task Wait: stream_id=2, logicCqId=359, retCode=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.426.239 [stars_engine.cc:622] 618654 ProcLogicCqUntilEmpty: Task Wait: stream_id=3, logicCqId=999, retCode=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.253 [stream.cc:2886] 618666 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.426.255 [stream.cc:2886] 618654 StarsWaitForTask: No.0 stream_id=3, taskId=0, currentId=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.426.271 [api_error.cc:895] 618654 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.269 [api_error.cc:895] 618666 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.426.286 [stream.cpp:146]618654 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.426.285 [stream.cpp:146]618666 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.426.304 [memory.cpp:421]618654 aclrtMemcpy: start to execute aclrtMemcpy, destMaxSize = 108, srcSize = 108, kind = 2
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.426.305 [stream.cpp:131]618666 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.329 [api_impl.cc:1394] 618666 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.347 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.364 [stream.cc:2886] 618666 StarsWaitForTask: No.0 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.381 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.393 [stream.cc:2886] 618666 StarsWaitForTask: No.1 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.408 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=3, head=0.
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.426.394 [mindspore/ccsrc/pybind_api/init.cc:651] operator()] Start register...
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.424 [stream.cc:2886] 618666 StarsWaitForTask: No.2 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.439 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.451 [stream.cc:2886] 618666 StarsWaitForTask: No.3 stream_id=3, taskId=65535, currentId=65535
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.426.447 [mindspore/ccsrc/pybind_api/init.cc:654] operator()] Start mindspore.profiler...
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.465 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.480 [stream.cc:2886] 618666 StarsWaitForTask: No.4 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.493 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.504 [stream.cc:2886] 618666 StarsWaitForTask: No.5 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.520 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.532 [stream.cc:2886] 618666 StarsWaitForTask: No.6 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.547 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.559 [stream.cc:2886] 618666 StarsWaitForTask: No.7 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.574 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.597 [stream.cc:2886] 618666 StarsWaitForTask: No.8 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.611 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.626 [stream.cc:2886] 618666 StarsWaitForTask: No.9 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.638 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.653 [stream.cc:2886] 618666 StarsWaitForTask: No.10 stream_id=3, taskId=65535, currentId=65535
[INFO] ME(618658:281473716280800,MainProcess):2025-04-03-09:27:48.426.531 [mindspore/profiler/envprofiler.py:57] analyse start
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.667 [event.cc:310] 618666 InitEventAllocFlag: Stars not need to alloc id in this flag=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.692 [task_res.cc:380] 618666 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=5, stream_id=3, taskResId=0, taskResHead_=0, taskResTail_=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.717 [event.cc:249] 618666 UpdateLatestRecord: device_id=5, event_id=-1, cur stream_id=3, cur task_id=0, latest stream_id=3, latest task_id=0, status=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.736 [event_task.cc:259] 618666 ConstructSqeForEventRecordTask: event_record: device_id=5, stream_id=3, task_id=0, event_id=4294967295, sq_id=3.
[INFO] ME(618658:281473716280800,MainProcess):2025-04-03-09:27:48.426.698 [mindspore/profiler/envprofiler.py:59] Profiler is not initialized, skip analyse.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.754 [stream.cc:1400] 618666 AddTaskToList: public task, stream_id=3, task_id=0, task_type=2 (EVENT_RECORD), head=0, tail=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.771 [stream.cc:2595] 618666 StarsAddTaskToStream: single-operator flow stream, stream_id=3, task_id=0, type=2(EVENT_RECORD), head=0, tail=1, sqe_num=1, lastTail=0, device_id=5
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.426.783 [mindspore/ccsrc/pybind_api/init.cc:661] operator()] Start EmbeddingCacheScheduler...
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.789 [task_submit.cc:573] 618666 AllocTaskAndSendStars: device_id=5, ts_id=0, sq_id=3, cq_id=3, stream_id=3, task_id=0, task_type=2(EVENT_RECORD).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.807 [stars_engine.cc:1122] 618666 SyncTask: Task Wait: device_id=5, stream_id=3, task_id=0, logicCqId=360.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.825 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.840 [stars_engine.cc:1071] 618666 IsSyncTaskFinish: Sync task finished, sqHead=1 finishedTaskId=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.857 [stars_engine.cc:1017] 618666 ProcReport: Get logic report: cnt=1, idx=0, stream_id=3, report task_id=0, sync task_id=0, sqeType=3, sqeHead=0, retCode=0, errType=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.875 [stars_engine.cc:1027] 618666 ProcReport: taskType=2.
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.426.868 [mindspore/ccsrc/pybind_api/init.cc:668] operator()] Start releasing dataset handles...
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.889 [logger.cc:152] 618666 TaskFinished: device_id=5, stream_id=3, task_id=0, task_type=2 (EVENT_RECORD), task_finish_num=15
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.905 [event.cc:249] 618666 UpdateLatestRecord: device_id=5, event_id=-1, cur stream_id=3, cur task_id=0, latest stream_id=3, latest task_id=0, status=2
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.426.916 [mindspore/ccsrc/pybind_api/init.cc:671] operator()] End release dataset handles.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.924 [event_task.cc:211] 618666 DoCompleteSuccessForEventRecordTask: event_record: device_id=5, stream_id=3, task_id=0, sq_id=3, event_id=4294967295, timeline=0xffffffffffffffff, timestamp=0x1e4b8f8aee0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.943 [event.cc:122] 618666 TryFreeEventIdAndCheckCanBeDelete: device_id=5, event_id=-1, map_count=0, isNewMode=0, isIdFromDrv=0, newestId=-1
[INFO] PIPELINE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.426.948 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:2616] FinalizeCluster] Start finalize the cluster instance.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.957 [task_res.cc:323] 618666 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=5, stream_id=3, taskId=0, taskDesHeadIdx=0, taskResHead_=1, tail=1, taskResTail_=1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.426.982 [npu_driver.cc:5618] 618666 GetSqEnable: deviceId=5, tsId=0, sqId=3, enable=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.427.005 [stream.cc:1494] 618666 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.427.017 [api_error.cc:895] 618666 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.427.032 [stream.cpp:146]618666 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.427.064 [context.cpp:72]618666 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.427.084 [api_impl.cc:3717] 618666 ContextSetCurrent: set context=aaaaf6e2dcc0, flag=0.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.427.100 [context.cpp:80]618666 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.427.113 [stream.cpp:131]618666 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.427.131 [api_impl.cc:1394] 618666 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.427.143 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.427.159 [stream.cc:2886] 618666 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.427.172 [api_error.cc:895] 618666 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.427.186 [stream.cpp:146]618666 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.427.199 [stream.cpp:131]618666 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.427.218 [api_impl.cc:1394] 618666 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.427.231 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.427.258 [stars_engine.cc:622] 618666 ProcLogicCqUntilEmpty: Task Wait: stream_id=3, logicCqId=360, retCode=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.427.274 [stream.cc:2886] 618666 StarsWaitForTask: No.0 stream_id=3, taskId=0, currentId=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.427.287 [api_error.cc:895] 618666 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.427.301 [stream.cpp:146]618666 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.427.315 [memory.cpp:421]618666 aclrtMemcpy: start to execute aclrtMemcpy, destMaxSize = 108, srcSize = 108, kind = 2
FF[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.430.063 [context.cpp:72]618674 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.108 [api_impl.cc:3717] 618674 ContextSetCurrent: set context=aaab0103b880, flag=0.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.430.132 [context.cpp:80]618674 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.430.158 [stream.cpp:131]618674 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.190 [api_impl.cc:1394] 618674 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.215 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.273 [stars_engine.cc:643] 618674 ProcLogicCqUntilEmpty: Notify: cnt=3, idx=0, stream_id=2, task_id=1, sqeType=1, retCode=0, errType=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.342 [logger.cc:152] 618674 TaskFinished: device_id=7, stream_id=2, task_id=0, task_type=5 (MEMCPY_ASYNC), task_finish_num=9
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.361 [task_manager.cc:485] 618674 TaskFailCallBack: task ok, stream_id=2, task_id=0, retCode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.381 [task_res.cc:323] 618674 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=7, stream_id=2, taskId=0, taskDesHeadIdx=0, taskResHead_=1, tail=6, taskResTail_=6
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.400 [logger.cc:152] 618674 TaskFinished: device_id=7, stream_id=2, task_id=1, task_type=72 (HOSTFUNC_CALLBACK), task_finish_num=10
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.419 [task_res.cc:323] 618674 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=7, stream_id=2, taskId=1, taskDesHeadIdx=1, taskResHead_=2, tail=6, taskResTail_=6
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.442 [stars_engine.cc:643] 618674 ProcLogicCqUntilEmpty: Notify: cnt=3, idx=1, stream_id=2, task_id=3, sqeType=1, retCode=0, errType=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.459 [logger.cc:152] 618674 TaskFinished: device_id=7, stream_id=2, task_id=2, task_type=5 (MEMCPY_ASYNC), task_finish_num=11
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.477 [task_manager.cc:485] 618674 TaskFailCallBack: task ok, stream_id=2, task_id=2, retCode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.492 [task_res.cc:323] 618674 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=7, stream_id=2, taskId=2, taskDesHeadIdx=2, taskResHead_=3, tail=6, taskResTail_=6
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.510 [logger.cc:152] 618674 TaskFinished: device_id=7, stream_id=2, task_id=3, task_type=72 (HOSTFUNC_CALLBACK), task_finish_num=12
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.527 [task_res.cc:323] 618674 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=7, stream_id=2, taskId=3, taskDesHeadIdx=3, taskResHead_=4, tail=6, taskResTail_=6
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.549 [stars_engine.cc:643] 618674 ProcLogicCqUntilEmpty: Notify: cnt=3, idx=2, stream_id=2, task_id=5, sqeType=1, retCode=0, errType=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.564 [logger.cc:152] 618674 TaskFinished: device_id=7, stream_id=2, task_id=4, task_type=5 (MEMCPY_ASYNC), task_finish_num=13
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.580 [task_manager.cc:485] 618674 TaskFailCallBack: task ok, stream_id=2, task_id=4, retCode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.595 [task_res.cc:323] 618674 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=7, stream_id=2, taskId=4, taskDesHeadIdx=4, taskResHead_=5, tail=6, taskResTail_=6
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.627 [logger.cc:152] 618674 TaskFinished: device_id=7, stream_id=2, task_id=5, task_type=72 (HOSTFUNC_CALLBACK), task_finish_num=14
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.642 [task_res.cc:323] 618674 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=7, stream_id=2, taskId=5, taskDesHeadIdx=5, taskResHead_=6, tail=6, taskResTail_=6
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.674 [stars_engine.cc:622] 618674 ProcLogicCqUntilEmpty: Task Wait: stream_id=2, logicCqId=332, retCode=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.690 [stream.cc:2886] 618674 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.704 [api_error.cc:895] 618674 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.430.719 [stream.cpp:146]618674 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.430.740 [stream.cpp:131]618674 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.776 [api_impl.cc:1394] 618674 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.795 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.824 [stream.cc:2886] 618674 StarsWaitForTask: No.0 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.843 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.859 [stream.cc:2886] 618674 StarsWaitForTask: No.1 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.874 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.890 [stream.cc:2886] 618674 StarsWaitForTask: No.2 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.903 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.919 [stream.cc:2886] 618674 StarsWaitForTask: No.3 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.932 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.948 [stream.cc:2886] 618674 StarsWaitForTask: No.4 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.961 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.976 [stream.cc:2886] 618674 StarsWaitForTask: No.5 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.430.989 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.005 [stream.cc:2886] 618674 StarsWaitForTask: No.6 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.018 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.031 [stream.cc:2886] 618674 StarsWaitForTask: No.7 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.047 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.064 [stream.cc:2886] 618674 StarsWaitForTask: No.8 stream_id=3, taskId=65535, currentId=65535
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.431.031 [context.cpp:72]618662 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.073 [api_impl.cc:3717] 618662 ContextSetCurrent: set context=aaab087d6320, flag=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.077 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.102 [stream.cc:2886] 618674 StarsWaitForTask: No.9 stream_id=3, taskId=65535, currentId=65535
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.431.097 [context.cpp:80]618662 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.115 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.134 [stream.cc:2886] 618674 StarsWaitForTask: No.10 stream_id=3, taskId=65535, currentId=65535
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.431.139 [stream.cpp:131]618662 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.151 [event.cc:310] 618674 InitEventAllocFlag: Stars not need to alloc id in this flag=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.162 [api_impl.cc:1394] 618662 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.188 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.186 [task_res.cc:380] 618674 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=7, stream_id=3, taskResId=0, taskResHead_=0, taskResTail_=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.225 [event.cc:249] 618674 UpdateLatestRecord: device_id=7, event_id=-1, cur stream_id=3, cur task_id=0, latest stream_id=3, latest task_id=0, status=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.239 [stars_engine.cc:643] 618662 ProcLogicCqUntilEmpty: Notify: cnt=3, idx=0, stream_id=2, task_id=1, sqeType=1, retCode=0, errType=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.244 [event_task.cc:259] 618674 ConstructSqeForEventRecordTask: event_record: device_id=7, stream_id=3, task_id=0, event_id=4294967295, sq_id=3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.262 [stream.cc:1400] 618674 AddTaskToList: public task, stream_id=3, task_id=0, task_type=2 (EVENT_RECORD), head=0, tail=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.270 [logger.cc:152] 618662 TaskFinished: device_id=4, stream_id=2, task_id=0, task_type=5 (MEMCPY_ASYNC), task_finish_num=9
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.277 [stream.cc:2595] 618674 StarsAddTaskToStream: single-operator flow stream, stream_id=3, task_id=0, type=2(EVENT_RECORD), head=0, tail=1, sqe_num=1, lastTail=0, device_id=7
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.289 [task_manager.cc:485] 618662 TaskFailCallBack: task ok, stream_id=2, task_id=0, retCode=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.306 [task_res.cc:323] 618662 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=4, stream_id=2, taskId=0, taskDesHeadIdx=0, taskResHead_=1, tail=6, taskResTail_=6
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.307 [task_submit.cc:573] 618674 AllocTaskAndSendStars: device_id=7, ts_id=0, sq_id=3, cq_id=3, stream_id=3, task_id=0, task_type=2(EVENT_RECORD).
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.325 [logger.cc:152] 618662 TaskFinished: device_id=4, stream_id=2, task_id=1, task_type=72 (HOSTFUNC_CALLBACK), task_finish_num=10
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.340 [task_res.cc:323] 618662 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=4, stream_id=2, taskId=1, taskDesHeadIdx=1, taskResHead_=2, tail=6, taskResTail_=6
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.357 [stars_engine.cc:643] 618662 ProcLogicCqUntilEmpty: Notify: cnt=3, idx=1, stream_id=2, task_id=3, sqeType=1, retCode=0, errType=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.325 [stars_engine.cc:1122] 618674 SyncTask: Task Wait: device_id=7, stream_id=3, task_id=0, logicCqId=333.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.348 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.358 [stars_engine.cc:1071] 618674 IsSyncTaskFinish: Sync task finished, sqHead=1 finishedTaskId=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.372 [logger.cc:152] 618662 TaskFinished: device_id=4, stream_id=2, task_id=2, task_type=5 (MEMCPY_ASYNC), task_finish_num=11
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.373 [stars_engine.cc:1017] 618674 ProcReport: Get logic report: cnt=1, idx=0, stream_id=3, report task_id=0, sync task_id=0, sqeType=3, sqeHead=0, retCode=0, errType=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.388 [task_manager.cc:485] 618662 TaskFailCallBack: task ok, stream_id=2, task_id=2, retCode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.392 [stars_engine.cc:1027] 618674 ProcReport: taskType=2.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.406 [logger.cc:152] 618674 TaskFinished: device_id=7, stream_id=3, task_id=0, task_type=2 (EVENT_RECORD), task_finish_num=15
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.404 [task_res.cc:323] 618662 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=4, stream_id=2, taskId=2, taskDesHeadIdx=2, taskResHead_=3, tail=6, taskResTail_=6
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.422 [logger.cc:152] 618662 TaskFinished: device_id=4, stream_id=2, task_id=3, task_type=72 (HOSTFUNC_CALLBACK), task_finish_num=12
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.420 [event.cc:249] 618674 UpdateLatestRecord: device_id=7, event_id=-1, cur stream_id=3, cur task_id=0, latest stream_id=3, latest task_id=0, status=2
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.439 [event_task.cc:211] 618674 DoCompleteSuccessForEventRecordTask: event_record: device_id=7, stream_id=3, task_id=0, sq_id=3, event_id=4294967295, timeline=0xffffffffffffffff, timestamp=0x1e4b8fc20a0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.437 [task_res.cc:323] 618662 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=4, stream_id=2, taskId=3, taskDesHeadIdx=3, taskResHead_=4, tail=6, taskResTail_=6
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.458 [event.cc:122] 618674 TryFreeEventIdAndCheckCanBeDelete: device_id=7, event_id=-1, map_count=0, isNewMode=0, isIdFromDrv=0, newestId=-1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.469 [stars_engine.cc:643] 618662 ProcLogicCqUntilEmpty: Notify: cnt=3, idx=2, stream_id=2, task_id=5, sqeType=1, retCode=0, errType=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.476 [task_res.cc:323] 618674 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=7, stream_id=3, taskId=0, taskDesHeadIdx=0, taskResHead_=1, tail=1, taskResTail_=1
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.487 [logger.cc:152] 618662 TaskFinished: device_id=4, stream_id=2, task_id=4, task_type=5 (MEMCPY_ASYNC), task_finish_num=13
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.501 [task_manager.cc:485] 618662 TaskFailCallBack: task ok, stream_id=2, task_id=4, retCode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.503 [npu_driver.cc:5618] 618674 GetSqEnable: deviceId=7, tsId=0, sqId=3, enable=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.521 [stream.cc:1494] 618674 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.515 [task_res.cc:323] 618662 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=4, stream_id=2, taskId=4, taskDesHeadIdx=4, taskResHead_=5, tail=6, taskResTail_=6
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.534 [logger.cc:152] 618662 TaskFinished: device_id=4, stream_id=2, task_id=5, task_type=72 (HOSTFUNC_CALLBACK), task_finish_num=14
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.534 [api_error.cc:895] 618674 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.431.557 [stream.cpp:146]618674 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.548 [task_res.cc:323] 618662 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=4, stream_id=2, taskId=5, taskDesHeadIdx=5, taskResHead_=6, tail=6, taskResTail_=6
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.575 [stars_engine.cc:622] 618662 ProcLogicCqUntilEmpty: Task Wait: stream_id=2, logicCqId=312, retCode=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.591 [stream.cc:2886] 618662 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.431.587 [context.cpp:72]618674 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.604 [api_impl.cc:3717] 618674 ContextSetCurrent: set context=aaab0103b880, flag=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.605 [api_error.cc:895] 618662 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.431.620 [stream.cpp:146]618662 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.431.619 [context.cpp:80]618674 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.431.636 [stream.cpp:131]618674 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.431.638 [stream.cpp:131]618662 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.431.620 [context.cpp:72]618670 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.431.664 [api_impl.cc:3717] 618670 ContextSetCurrent: set context=aaaad9a630c0, flag=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.654 [api_impl.cc:1394] 618674 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.657 [api_impl.cc:1394] 618662 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.670 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.673 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.688 [stream.cc:2886] 618662 StarsWaitForTask: No.0 stream_id=3, taskId=65535, currentId=65535
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.431.685 [context.cpp:80]618670 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.702 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.703 [stream.cc:2886] 618674 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.720 [api_error.cc:895] 618674 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.718 [stream.cc:2886] 618662 StarsWaitForTask: No.1 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.734 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=3, head=0.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.431.733 [stream.cpp:146]618674 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.431.727 [stream.cpp:131]618670 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.431.748 [stream.cpp:131]618674 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.749 [stream.cc:2886] 618662 StarsWaitForTask: No.2 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.765 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.765 [api_impl.cc:1394] 618674 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.431.762 [api_impl.cc:1394] 618670 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.779 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.779 [stream.cc:2886] 618662 StarsWaitForTask: No.3 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.431.788 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.796 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.811 [stars_engine.cc:622] 618674 ProcLogicCqUntilEmpty: Task Wait: stream_id=3, logicCqId=333, retCode=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.810 [stream.cc:2886] 618662 StarsWaitForTask: No.4 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.827 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.829 [stream.cc:2886] 618674 StarsWaitForTask: No.0 stream_id=3, taskId=0, currentId=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.840 [stream.cc:2886] 618662 StarsWaitForTask: No.5 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.431.843 [api_error.cc:895] 618674 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.856 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=3, head=0.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.431.856 [stream.cpp:146]618674 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.868 [stream.cc:2886] 618662 StarsWaitForTask: No.6 stream_id=3, taskId=65535, currentId=65535
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.431.871 [memory.cpp:421]618674 aclrtMemcpy: start to execute aclrtMemcpy, destMaxSize = 108, srcSize = 108, kind = 2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.431.871 [stars_engine.cc:643] 618670 ProcLogicCqUntilEmpty: Notify: cnt=3, idx=0, stream_id=2, task_id=1, sqeType=1, retCode=0, errType=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.897 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.910 [stream.cc:2886] 618662 StarsWaitForTask: No.7 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.925 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.941 [stream.cc:2886] 618662 StarsWaitForTask: No.8 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.956 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.431.941 [logger.cc:152] 618670 TaskFinished: device_id=6, stream_id=2, task_id=0, task_type=5 (MEMCPY_ASYNC), task_finish_num=9
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.431.961 [task_manager.cc:485] 618670 TaskFailCallBack: task ok, stream_id=2, task_id=0, retCode=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.971 [stream.cc:2886] 618662 StarsWaitForTask: No.9 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.431.978 [task_res.cc:323] 618670 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=6, stream_id=2, taskId=0, taskDesHeadIdx=0, taskResHead_=1, tail=6, taskResTail_=6
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.431.988 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.431.997 [logger.cc:152] 618670 TaskFinished: device_id=6, stream_id=2, task_id=1, task_type=72 (HOSTFUNC_CALLBACK), task_finish_num=10
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.002 [stream.cc:2886] 618662 StarsWaitForTask: No.10 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.014 [task_res.cc:323] 618670 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=6, stream_id=2, taskId=1, taskDesHeadIdx=1, taskResHead_=2, tail=6, taskResTail_=6
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.019 [event.cc:310] 618662 InitEventAllocFlag: Stars not need to alloc id in this flag=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.037 [stars_engine.cc:643] 618670 ProcLogicCqUntilEmpty: Notify: cnt=3, idx=1, stream_id=2, task_id=3, sqeType=1, retCode=0, errType=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.044 [task_res.cc:380] 618662 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=4, stream_id=3, taskResId=0, taskResHead_=0, taskResTail_=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.055 [logger.cc:152] 618670 TaskFinished: device_id=6, stream_id=2, task_id=2, task_type=5 (MEMCPY_ASYNC), task_finish_num=11
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.073 [task_manager.cc:485] 618670 TaskFailCallBack: task ok, stream_id=2, task_id=2, retCode=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.069 [event.cc:249] 618662 UpdateLatestRecord: device_id=4, event_id=-1, cur stream_id=3, cur task_id=0, latest stream_id=3, latest task_id=0, status=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.089 [task_res.cc:323] 618670 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=6, stream_id=2, taskId=2, taskDesHeadIdx=2, taskResHead_=3, tail=6, taskResTail_=6
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.088 [event_task.cc:259] 618662 ConstructSqeForEventRecordTask: event_record: device_id=4, stream_id=3, task_id=0, event_id=4294967295, sq_id=3.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.108 [stream.cc:1400] 618662 AddTaskToList: public task, stream_id=3, task_id=0, task_type=2 (EVENT_RECORD), head=0, tail=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.107 [logger.cc:152] 618670 TaskFinished: device_id=6, stream_id=2, task_id=3, task_type=72 (HOSTFUNC_CALLBACK), task_finish_num=12
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.123 [task_res.cc:323] 618670 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=6, stream_id=2, taskId=3, taskDesHeadIdx=3, taskResHead_=4, tail=6, taskResTail_=6
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.123 [stream.cc:2595] 618662 StarsAddTaskToStream: single-operator flow stream, stream_id=3, task_id=0, type=2(EVENT_RECORD), head=0, tail=1, sqe_num=1, lastTail=0, device_id=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.145 [task_submit.cc:573] 618662 AllocTaskAndSendStars: device_id=4, ts_id=0, sq_id=3, cq_id=3, stream_id=3, task_id=0, task_type=2(EVENT_RECORD).
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.172 [stars_engine.cc:1122] 618662 SyncTask: Task Wait: device_id=4, stream_id=3, task_id=0, logicCqId=313.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.203 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.219 [stars_engine.cc:1071] 618662 IsSyncTaskFinish: Sync task finished, sqHead=1 finishedTaskId=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.145 [stars_engine.cc:643] 618670 ProcLogicCqUntilEmpty: Notify: cnt=3, idx=2, stream_id=2, task_id=5, sqeType=1, retCode=0, errType=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.218 [logger.cc:152] 618670 TaskFinished: device_id=6, stream_id=2, task_id=4, task_type=5 (MEMCPY_ASYNC), task_finish_num=13
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.240 [task_manager.cc:485] 618670 TaskFailCallBack: task ok, stream_id=2, task_id=4, retCode=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.238 [stars_engine.cc:1017] 618662 ProcReport: Get logic report: cnt=1, idx=0, stream_id=3, report task_id=0, sync task_id=0, sqeType=3, sqeHead=0, retCode=0, errType=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.256 [task_res.cc:323] 618670 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=6, stream_id=2, taskId=4, taskDesHeadIdx=4, taskResHead_=5, tail=6, taskResTail_=6
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.259 [stars_engine.cc:1027] 618662 ProcReport: taskType=2.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.278 [logger.cc:152] 618662 TaskFinished: device_id=4, stream_id=3, task_id=0, task_type=2 (EVENT_RECORD), task_finish_num=15
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.275 [logger.cc:152] 618670 TaskFinished: device_id=6, stream_id=2, task_id=5, task_type=72 (HOSTFUNC_CALLBACK), task_finish_num=14
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.292 [task_res.cc:323] 618670 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=6, stream_id=2, taskId=5, taskDesHeadIdx=5, taskResHead_=6, tail=6, taskResTail_=6
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.294 [event.cc:249] 618662 UpdateLatestRecord: device_id=4, event_id=-1, cur stream_id=3, cur task_id=0, latest stream_id=3, latest task_id=0, status=2
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.313 [event_task.cc:211] 618662 DoCompleteSuccessForEventRecordTask: event_record: device_id=4, stream_id=3, task_id=0, sq_id=3, event_id=4294967295, timeline=0xffffffffffffffff, timestamp=0x1e4b8fcc8c6
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.432.299 [context.cpp:72]618650 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.327 [stars_engine.cc:622] 618670 ProcLogicCqUntilEmpty: Task Wait: stream_id=2, logicCqId=298, retCode=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.432.336 [api_impl.cc:3717] 618650 ContextSetCurrent: set context=aaab312ab590, flag=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.344 [stream.cc:2886] 618670 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.359 [api_error.cc:895] 618670 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.332 [event.cc:122] 618662 TryFreeEventIdAndCheckCanBeDelete: device_id=4, event_id=-1, map_count=0, isNewMode=0, isIdFromDrv=0, newestId=-1
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.432.355 [context.cpp:80]618650 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.432.373 [stream.cpp:146]618670 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.363 [task_res.cc:323] 618662 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=4, stream_id=3, taskId=0, taskDesHeadIdx=0, taskResHead_=1, tail=1, taskResTail_=1
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.432.394 [stream.cpp:131]618670 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.386 [npu_driver.cc:5618] 618662 GetSqEnable: deviceId=4, tsId=0, sqId=3, enable=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.401 [stream.cc:1494] 618662 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.414 [api_error.cc:895] 618662 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.432.404 [stream.cpp:131]618650 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.432.428 [stream.cpp:146]618662 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.427 [api_impl.cc:1394] 618670 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.432.444 [api_impl.cc:1394] 618650 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.446 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.432.468 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.478 [stream.cc:2886] 618670 StarsWaitForTask: No.0 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.495 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.508 [stream.cc:2886] 618670 StarsWaitForTask: No.1 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.521 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=3, head=0.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.432.519 [context.cpp:72]618662 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.432.536 [stars_engine.cc:643] 618650 ProcLogicCqUntilEmpty: Notify: cnt=3, idx=0, stream_id=2, task_id=1, sqeType=1, retCode=0, errType=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.536 [stream.cc:2886] 618670 StarsWaitForTask: No.2 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.540 [api_impl.cc:3717] 618662 ContextSetCurrent: set context=aaab087d6320, flag=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.553 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.566 [stream.cc:2886] 618670 StarsWaitForTask: No.3 stream_id=3, taskId=65535, currentId=65535
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.432.559 [context.cpp:80]618662 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.432.574 [stream.cpp:131]618662 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.581 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.588 [api_impl.cc:1394] 618662 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.594 [stream.cc:2886] 618670 StarsWaitForTask: No.4 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.604 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.609 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.622 [stream.cc:2886] 618662 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.637 [api_error.cc:895] 618662 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.624 [stream.cc:2886] 618670 StarsWaitForTask: No.5 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.638 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.432.631 [logger.cc:152] 618650 TaskFinished: device_id=1, stream_id=2, task_id=0, task_type=5 (MEMCPY_ASYNC), task_finish_num=9
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.650 [stream.cc:2886] 618670 StarsWaitForTask: No.6 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.432.648 [task_manager.cc:485] 618650 TaskFailCallBack: task ok, stream_id=2, task_id=0, retCode=0.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.432.651 [stream.cpp:146]618662 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.432.667 [task_res.cc:323] 618650 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=1, stream_id=2, taskId=0, taskDesHeadIdx=0, taskResHead_=1, tail=6, taskResTail_=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.665 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=3, head=0.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.432.670 [stream.cpp:131]618662 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.686 [api_impl.cc:1394] 618662 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.432.682 [logger.cc:152] 618650 TaskFinished: device_id=1, stream_id=2, task_id=1, task_type=72 (HOSTFUNC_CALLBACK), task_finish_num=10
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.692 [stream.cc:2886] 618670 StarsWaitForTask: No.7 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.700 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.432.706 [task_res.cc:323] 618650 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=1, stream_id=2, taskId=1, taskDesHeadIdx=1, taskResHead_=2, tail=6, taskResTail_=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.708 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.722 [stream.cc:2886] 618670 StarsWaitForTask: No.8 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.736 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.432.730 [stars_engine.cc:643] 618650 ProcLogicCqUntilEmpty: Notify: cnt=3, idx=1, stream_id=2, task_id=3, sqeType=1, retCode=0, errType=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.728 [stars_engine.cc:622] 618662 ProcLogicCqUntilEmpty: Task Wait: stream_id=3, logicCqId=313, retCode=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.748 [stream.cc:2886] 618670 StarsWaitForTask: No.9 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.432.748 [logger.cc:152] 618650 TaskFinished: device_id=1, stream_id=2, task_id=2, task_type=5 (MEMCPY_ASYNC), task_finish_num=11
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.747 [stream.cc:2886] 618662 StarsWaitForTask: No.0 stream_id=3, taskId=0, currentId=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.432.764 [api_error.cc:895] 618662 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.765 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.432.764 [task_manager.cc:485] 618650 TaskFailCallBack: task ok, stream_id=2, task_id=2, retCode=0.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.432.776 [stream.cpp:146]618662 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.432.791 [memory.cpp:421]618662 aclrtMemcpy: start to execute aclrtMemcpy, destMaxSize = 108, srcSize = 108, kind = 2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.779 [stream.cc:2886] 618670 StarsWaitForTask: No.10 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.795 [event.cc:310] 618670 InitEventAllocFlag: Stars not need to alloc id in this flag=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.432.787 [task_res.cc:323] 618650 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=1, stream_id=2, taskId=2, taskDesHeadIdx=2, taskResHead_=3, tail=6, taskResTail_=6
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.432.803 [logger.cc:152] 618650 TaskFinished: device_id=1, stream_id=2, task_id=3, task_type=72 (HOSTFUNC_CALLBACK), task_finish_num=12
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.432.830 [task_res.cc:323] 618650 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=1, stream_id=2, taskId=3, taskDesHeadIdx=3, taskResHead_=4, tail=6, taskResTail_=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.837 [task_res.cc:380] 618670 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=6, stream_id=3, taskResId=0, taskResHead_=0, taskResTail_=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.432.849 [stars_engine.cc:643] 618650 ProcLogicCqUntilEmpty: Notify: cnt=3, idx=2, stream_id=2, task_id=5, sqeType=1, retCode=0, errType=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.864 [event.cc:249] 618670 UpdateLatestRecord: device_id=6, event_id=-1, cur stream_id=3, cur task_id=0, latest stream_id=3, latest task_id=0, status=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.432.879 [logger.cc:152] 618650 TaskFinished: device_id=1, stream_id=2, task_id=4, task_type=5 (MEMCPY_ASYNC), task_finish_num=13
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.883 [event_task.cc:259] 618670 ConstructSqeForEventRecordTask: event_record: device_id=6, stream_id=3, task_id=0, event_id=4294967295, sq_id=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.432.894 [task_manager.cc:485] 618650 TaskFailCallBack: task ok, stream_id=2, task_id=4, retCode=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.899 [stream.cc:1400] 618670 AddTaskToList: public task, stream_id=3, task_id=0, task_type=2 (EVENT_RECORD), head=0, tail=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.432.906 [task_res.cc:323] 618650 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=1, stream_id=2, taskId=4, taskDesHeadIdx=4, taskResHead_=5, tail=6, taskResTail_=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.913 [stream.cc:2595] 618670 StarsAddTaskToStream: single-operator flow stream, stream_id=3, task_id=0, type=2(EVENT_RECORD), head=0, tail=1, sqe_num=1, lastTail=0, device_id=6
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.432.919 [logger.cc:152] 618650 TaskFinished: device_id=1, stream_id=2, task_id=5, task_type=72 (HOSTFUNC_CALLBACK), task_finish_num=14
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.432.932 [task_res.cc:323] 618650 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=1, stream_id=2, taskId=5, taskDesHeadIdx=5, taskResHead_=6, tail=6, taskResTail_=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.945 [task_submit.cc:573] 618670 AllocTaskAndSendStars: device_id=6, ts_id=0, sq_id=3, cq_id=3, stream_id=3, task_id=0, task_type=2(EVENT_RECORD).
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.432.958 [stars_engine.cc:622] 618650 ProcLogicCqUntilEmpty: Task Wait: stream_id=2, logicCqId=402, retCode=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.964 [stars_engine.cc:1122] 618670 SyncTask: Task Wait: device_id=6, stream_id=3, task_id=0, logicCqId=299.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.432.973 [stream.cc:2886] 618650 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.432.986 [api_error.cc:895] 618650 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.984 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.432.997 [stars_engine.cc:1071] 618670 IsSyncTaskFinish: Sync task finished, sqHead=1 finishedTaskId=0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.432.998 [stream.cpp:146]618650 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.433.018 [stream.cpp:131]618650 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.433.015 [stars_engine.cc:1017] 618670 ProcReport: Get logic report: cnt=1, idx=0, stream_id=3, report task_id=0, sync task_id=0, sqeType=3, sqeHead=0, retCode=0, errType=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.433.034 [stars_engine.cc:1027] 618670 ProcReport: taskType=2.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.433.049 [logger.cc:152] 618670 TaskFinished: device_id=6, stream_id=3, task_id=0, task_type=2 (EVENT_RECORD), task_finish_num=15
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.055 [api_impl.cc:1394] 618650 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.071 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.433.066 [event.cc:249] 618670 UpdateLatestRecord: device_id=6, event_id=-1, cur stream_id=3, cur task_id=0, latest stream_id=3, latest task_id=0, status=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.433.085 [event_task.cc:211] 618670 DoCompleteSuccessForEventRecordTask: event_record: device_id=6, stream_id=3, task_id=0, sq_id=3, event_id=4294967295, timeline=0xffffffffffffffff, timestamp=0x1e4b8fd61f4


========================================================================================================================= FAILURES =========================================================================================================================
______________________________________________________________________________________________________________________ test_AllReduce ______________________________________________________________________________________________________________________

    def test_AllReduce():
        """
        Feature: lccl operator test.
        Description: msrun lccl all_reduce 8P case.
        Expectation: success
        """
        all_reduce = Net()
        output = all_reduce()
    
        expect0 = np.ones([3, 1, 3, 3]).astype(np.float32) * 0
        for i in range(size):
            part = np.ones([3, 1, 3, 3]).astype(np.float32) * 0.01 * (i + 1)
            expect0 += part
>       diff0 = output[0].asnumpy() - expect0

test_lccl_allreduce.py:66: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = Tensor(shape=[3, 1, 3, 3], dtype=Float32, value=
[[[[ 0.00000000e+00,  0.00000000e+00,  0.00000000e+00],
   [ 0.000000...00],
   [ 0.00000000e+00,  0.00000000e+00,  0.00000000e+00],
   [ 0.00000000e+00,  0.00000000e+00,  0.00000000e+00]]]])

    def asnumpy(self):
        """
        Convert tensor to numpy array. Returns self tensor as a NumPy ndarray. This tensor and the returned ndarray
        share the same underlying storage. Changes to self tensor will be reflected in the ndarray.
    
        Returns:
            A numpy ndarray which shares the same underlying storage with the tensor.
    
        Examples:
            >>> from mindspore import Tensor
            >>> import numpy as np
            >>> x = Tensor(np.array([1, 2], dtype=np.float32))
            >>> y = x.asnumpy()
            >>> y[0] = 11
            >>> print(x)
            [11.  2.]
            >>> print(y)
            [11.  2.]
        """
        if self.has_init:
            self.init_data()
>       return TensorPy_.asnumpy(self)
E       RuntimeError: LCCL AllReduce failed.
E       
E       ----------------------------------------------------
E       - C++ Call Stack: (For framework developers)
E       ----------------------------------------------------
E       mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/common/tensor.py:989: RuntimeError
===================================================================================================================== warnings summary =====================================================================================================================
../../../../../../../../usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866
  /usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866: DeprecationWarning: invalid escape sequence \L
    if not dirpath.find("AppData\Local\Temp"):

../../../../../../../../usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/classifier/transdata/transdata_classifier.py:222
  /usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/classifier/transdata/transdata_classifier.py:222: DeprecationWarning: invalid escape sequence \B
    """

../../../../../../../../usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:143
  /usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:143: DeprecationWarning: invalid escape sequence \c
    """

../../../../../../../../usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.097 [stream.cc:2886] 618650 StarsWaitForTask: No.0 stream_id=3, taskId=65535, currentId=65535
transdata_graph_info.py:170
  /usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:170: DeprecationWarning: invalid escape sequence \c
    """

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for <class 'numpy.float64'> type is zero.
    setattr(self, word, getattr(machar, word).flat[0])

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for <class 'numpy.float64'> type is zero.
    return self._float_to_str(self.smallest_subnormal)

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for <class 'numpy.float32'> type is zero.
    setattr(self, word, getattr(machar, word).flat[0])

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for <class 'numpy.float32'> type is zero.
    return self._float_to_str(self.smallest_subnormal)

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2.py:57
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2.py:57: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("batchnorm_fold2")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad.py:56
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad.py:56: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("batchnorm_fold2_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad_reduce.py:48
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad_reduce.py:48: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("batchnorm_fold2_grad_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul.py:51
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul.py:51: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("correction_mul")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:51
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:51: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("correction_mul_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:143
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.433.105 [event.cc:122] 618670 TryFreeEventIdAndCheckCanBeDelete: device_id=6, event_id=-1, map_count=0, isNewMode=0, isIdFromDrv=0, newestId=-1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.112 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.125 [stream.cc:2886] 618650 StarsWaitForTask: No.1 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.139 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.433.132 [task_res.cc:323] 618670 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=6, stream_id=3, taskId=0, taskDesHeadIdx=0, taskResHead_=1, tail=1, taskResTail_=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.433.156 [npu_driver.cc:5618] 618670 GetSqEnable: deviceId=6, tsId=0, sqId=3, enable=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.150 [stream.cc:2886] 618650 StarsWaitForTask: No.2 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.161 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.172 [stream.cc:2886] 618650 StarsWaitForTask: No.3 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.433.169 [stream.cc:1494] 618670 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.433.182 [api_error.cc:895] 618670 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.186 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=3, head=0.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.433.196 [stream.cpp:146]618670 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.200 [stream.cc:2886] 618650 StarsWaitForTask: No.4 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.212 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.224 [stream.cc:2886] 618650 StarsWaitForTask: No.5 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.243 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.254 [stream.cc:2886] 618650 StarsWaitForTask: No.6 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.266 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.277 [stream.cc:2886] 618650 StarsWaitForTask: No.7 stream_id=3, taskId=65535, currentId=65535
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.433.277 [context.cpp:72]618670 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.290 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.433.295 [api_impl.cc:3717] 618670 ContextSetCurrent: set context=aaaad9a630c0, flag=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.302 [stream.cc:2886] 618650 StarsWaitForTask: No.8 stream_id=3, taskId=65535, currentId=65535
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.433.310 [context.cpp:80]618670 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.314 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=3, head=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.327 [stream.cc:2886] 618650 StarsWaitForTask: No.9 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.337 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=3, head=0.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.433.325 [stream.cpp:131]618670 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.433.345 [api_impl.cc:1394] 618670 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.348 [stream.cc:2886] 618650 StarsWaitForTask: No.10 stream_id=3, taskId=65535, currentId=65535
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.365 [event.cc:310] 618650 InitEventAllocFlag: Stars not need to alloc id in this flag=2
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.433.359 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.433.385 [stream.cc:2886] 618670 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.433.402 [api_error.cc:895] 618670 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.433.413 [stream.cpp:146]618670 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.405 [task_res.cc:380] 618650 AllocTaskInfoByTaskResId: alloc taskinfo success, device_id=1, stream_id=3, taskResId=0, taskResHead_=0, taskResTail_=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.431 [event.cc:249] 618650 UpdateLatestRecord: device_id=1, event_id=-1, cur stream_id=3, cur task_id=0, latest stream_id=3, latest task_id=0, status=1
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.433.428 [stream.cpp:131]618670 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.448 [event_task.cc:259] 618650 ConstructSqeForEventRecordTask: event_record: device_id=1, stream_id=3, task_id=0, event_id=4294967295, sq_id=3.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.433.447 [api_impl.cc:1394] 618670 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.433.461 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.463 [stream.cc:1400] 618650 AddTaskToList: public task, stream_id=3, task_id=0, task_type=2 (EVENT_RECORD), head=0, tail=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.476 [stream.cc:2595] 618650 StarsAddTaskToStream: single-operator flow stream, stream_id=3, task_id=0, type=2(EVENT_RECORD), head=0, tail=1, sqe_num=1, lastTail=0, device_id=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.433.491 [stars_engine.cc:622] 618670 ProcLogicCqUntilEmpty: Task Wait: stream_id=3, logicCqId=299, retCode=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.433.508 [stream.cc:2886] 618670 StarsWaitForTask: No.0 stream_id=3, taskId=0, currentId=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.504 [task_submit.cc:573] 618650 AllocTaskAndSendStars: device_id=1, ts_id=0, sq_id=3, cq_id=3, stream_id=3, task_id=0, task_type=2(EVENT_RECORD).
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.433.523 [api_error.cc:895] 618670 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.524 [stars_engine.cc:1122] 618650 SyncTask: Task Wait: device_id=1, stream_id=3, task_id=0, logicCqId=403.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.433.536 [stream.cpp:146]618670 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success


========================================================================================================================= FAILURES =========================================================================================================================
______________________________________________________________________________________________________________________ test_AllReduce ______________________________________________________________________________________________________________________

    def test_AllReduce():
        """
        Feature: lccl operator test.
        Description: msrun lccl all_reduce 8P case.
        Expectation: success
        """
        all_reduce = Net()
        output = all_reduce()
    
        expect0 = np.ones([3, 1, 3, 3]).astype(np.float32) * 0
        for i in range(size):
            part = np.ones([3, 1, 3, 3]).astype(np.float32) * 0.01 * (i + 1)
            expect0 += part
>       diff0 = output[0].asnumpy() - expect0

test_lccl_allreduce.py:66: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = Tensor(shape=[3, 1, 3, 3], dtype=Float32, value=
[[[[           -nan,            -nan,            -nan],
   [         ...an],
   [           -nan,            -nan,            -nan],
   [           -nan,            -nan,            -nan]]]])

    def asnumpy(self):
        """
        Convert tensor to numpy array. Returns self tensor as a NumPy ndarray. This tensor and the returned ndarray
        share the same underlying storage. Changes to self tensor will be reflected in the ndarray.
    
        Returns:
            A numpy ndarray which shares the same underlying storage with the tensor.
    
        Examples:
            >>> from mindspore import Tensor
            >>> import numpy as np
            >>> x = Tensor(np.array([1, 2], dtype=np.float32))
            >>> y = x.asnumpy()
            >>> y[0] = 11
            >>> print(x)
            [11.  2.]
            >>> print(y)
            [11.  2.]
        """
        if self.has_init:
            self.init_data()
>       return TensorPy_.asnumpy(self)
E       RuntimeError: LCCL AllReduce failed.
E       
E       ----------------------------------------------------
E       - C++ Call Stack: (For framework developers)
E       ----------------------------------------------------
E       mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/common/tensor.py:989: RuntimeError
===================================================================================================================== warnings summary =====================================================================================================================
../../../../../../../../usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866
  /usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866: DeprecationWarning: invalid escape sequence \L
    if not dirpath.find("AppData\Local\Temp"):

../../../../../../../../usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/classifier/transdata/transdata_classifier.py:222
  /usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/classifier/transdata/transdata_classifier.py:222: DeprecationWarning: invalid escape sequence \B
    """

../../../../../../../../usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:143
  /usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:143: DeprecationWarning: invalid escape sequence \c
    """

../../../../../../../../usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.546 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=3, head=1.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.433.552 [memory.cpp:421]618670 aclrtMemcpy: start to execute aclrtMemcpy, destMaxSize = 108, srcSize = 108, kind = 2
transdata_graph_info.py:170
  /usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:170: DeprecationWarning: invalid escape sequence \c
    """

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for <class 'numpy.float64'> type is zero.
    setattr(self, word, getattr(machar, word).flat[0])

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for <class 'numpy.float64'> type is zero.
    return self._float_to_str(self.smallest_subnormal)

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for <class 'numpy.float32'> type is zero.
    setattr(self, word, getattr(machar, word).flat[0])

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for <class 'numpy.float32'> type is zero.
    return self._float_to_str(self.smallest_subnormal)

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2.py:57
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2.py:57: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("batchnorm_fold2")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad.py:56
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad.py:56: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("batchnorm_fold2_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad_reduce.py:48
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad_reduce.py:48: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("batchnorm_fold2_grad_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul.py:51
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul.py:51: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("correction_mul")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:51
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:51: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("correction_mul_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:143
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.561 [stars_engine.cc:1071] 618650 IsSyncTaskFinish: Sync task finished, sqHead=1 finishedTaskId=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.577 [stars_engine.cc:1017] 618650 ProcReport: Get logic report: cnt=1, idx=0, stream_id=3, report task_id=0, sync task_id=0, sqeType=3, sqeHead=0, retCode=0, errType=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.592 [stars_engine.cc:1027] 618650 ProcReport: taskType=2.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.604 [logger.cc:152] 618650 TaskFinished: device_id=1, stream_id=3, task_id=0, task_type=2 (EVENT_RECORD), task_finish_num=15
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.617 [event.cc:249] 618650 UpdateLatestRecord: device_id=1, event_id=-1, cur stream_id=3, cur task_id=0, latest stream_id=3, latest task_id=0, status=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.633 [event_task.cc:211] 618650 DoCompleteSuccessForEventRecordTask: event_record: device_id=1, stream_id=3, task_id=0, sq_id=3, event_id=4294967295, timeline=0xffffffffffffffff, timestamp=0x1e4b8fdce63
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.657 [event.cc:122] 618650 TryFreeEventIdAndCheckCanBeDelete: device_id=1, event_id=-1, map_count=0, isNewMode=0, isIdFromDrv=0, newestId=-1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.673 [task_res.cc:323] 618650 RecycleTaskInfoO1: recycleO1 taskinfo success, device_id=1, stream_id=3, taskId=0, taskDesHeadIdx=0, taskResHead_=1, tail=1, taskResTail_=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.695 [npu_driver.cc:5618] 618650 GetSqEnable: deviceId=1, tsId=0, sqId=3, enable=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.709 [stream.cc:1494] 618650 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.720 [api_error.cc:895] 618650 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.433.732 [stream.cpp:146]618650 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.433.774 [context.cpp:72]618650 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.791 [api_impl.cc:3717] 618650 ContextSetCurrent: set context=aaab312ab590, flag=0.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.433.804 [context.cpp:80]618650 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.433.817 [stream.cpp:131]618650 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.832 [api_impl.cc:1394] 618650 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.844 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.857 [stream.cc:2886] 618650 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.870 [api_error.cc:895] 618650 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.433.881 [stream.cpp:146]618650 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.433.894 [stream.cpp:131]618650 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.911 [api_impl.cc:1394] 618650 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.922 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.948 [stars_engine.cc:622] 618650 ProcLogicCqUntilEmpty: Task Wait: stream_id=3, logicCqId=403, retCode=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.961 [stream.cc:2886] 618650 StarsWaitForTask: No.0 stream_id=3, taskId=0, currentId=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.433.973 [api_error.cc:895] 618650 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.433.984 [stream.cpp:146]618650 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.433.999 [memory.cpp:421]618650 aclrtMemcpy: start to execute aclrtMemcpy, destMaxSize = 108, srcSize = 108, kind = 2
F  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:143: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("correction_mul_grad_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perlayer")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad.py:92
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad.py:92: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perlayer_grad_d")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad_reduce.py:49
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad_reduce.py:49: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perlayer_grad_d_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perchannel")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad.py:91
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad.py:91: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perchannel_grad_d")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad_reduce.py:48
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad_reduce.py:48: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perchannel_grad_d_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel.py:52
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel.py:52: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_perchannel")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel_grad.py:81
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel_grad.py:81: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_perchannel_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer.py:54
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer.py:54: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_per_layer")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer_grad.py:81
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer_grad.py:81: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_per_layer_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perchannel.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perchannel.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("minmax_update_perchannel")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("minmax_update_perlayer")

-- Docs: https://docs.pytest.org/en/stable/warnings.html
================================================================================================================= short test summary info ==================================================================================================================
FAILED test_lccl_allreduce.py::test_AllReduce - RuntimeError: LCCL AllReduce failed.
============================================================================================================= 1 failed, 26 warnings in 23.67s ==============================================================================================================
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.435.497 [mindspore/ccsrc/pybind_api/init.cc:651] operator()] Start register...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.435.536 [mindspore/ccsrc/pybind_api/init.cc:654] operator()] Start mindspore.profiler...
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:143: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("correction_mul_grad_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perlayer")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad.py:92
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad.py:92: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perlayer_grad_d")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad_reduce.py:49
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad_reduce.py:49: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perlayer_grad_d_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perchannel")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad.py:91
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad.py:91: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perchannel_grad_d")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad_reduce.py:48
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad_reduce.py:48: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perchannel_grad_d_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel.py:52
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel.py:52: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_perchannel")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel_grad.py:81
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel_grad.py:81: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_perchannel_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer.py:54
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer.py:54: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_per_layer")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer_grad.py:81
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer_grad.py:81: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_per_layer_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perchannel.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perchannel.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("minmax_update_perchannel")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("minmax_update_perlayer")

-- Docs: https://docs.pytest.org/en/stable/warnings.html
================================================================================================================= short test summary info ==================================================================================================================
FAILED test_lccl_allreduce.py::test_AllReduce - RuntimeError: LCCL AllReduce failed.
============================================================================================================= 1 failed, 26 warnings in 23.51s ==============================================================================================================
[INFO] ME(618654:281473077956064,MainProcess):2025-04-03-09:27:48.435.616 [mindspore/profiler/envprofiler.py:57] analyse start
[INFO] ME(618654:281473077956064,MainProcess):2025-04-03-09:27:48.435.776 [mindspore/profiler/envprofiler.py:59] Profiler is not initialized, skip analyse.
F[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.435.857 [mindspore/ccsrc/pybind_api/init.cc:661] operator()] Start EmbeddingCacheScheduler...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.435.900 [mindspore/ccsrc/pybind_api/init.cc:651] operator()] Start register...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.435.937 [mindspore/ccsrc/pybind_api/init.cc:654] operator()] Start mindspore.profiler...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.435.939 [mindspore/ccsrc/pybind_api/init.cc:668] operator()] Start releasing dataset handles...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.435.987 [mindspore/ccsrc/pybind_api/init.cc:671] operator()] End release dataset handles.
[INFO] PIPELINE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.436.014 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:2616] FinalizeCluster] Start finalize the cluster instance.
F[INFO] ME(618666:281473067970016,MainProcess):2025-04-03-09:27:48.436.012 [mindspore/profiler/envprofiler.py:57] analyse start
[INFO] ME(618666:281473067970016,MainProcess):2025-04-03-09:27:48.436.182 [mindspore/profiler/envprofiler.py:59] Profiler is not initialized, skip analyse.
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.436.267 [mindspore/ccsrc/pybind_api/init.cc:661] operator()] Start EmbeddingCacheScheduler...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.436.323 [mindspore/ccsrc/pybind_api/init.cc:668] operator()] Start releasing dataset handles...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.436.367 [mindspore/ccsrc/pybind_api/init.cc:671] operator()] End release dataset handles.
[INFO] PIPELINE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.436.391 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:2616] FinalizeCluster] Start finalize the cluster instance.
F

========================================================================================================================= FAILURES =========================================================================================================================
______________________________________________________________________________________________________________________ test_AllReduce ______________________________________________________________________________________________________________________

    def test_AllReduce():
        """
        Feature: lccl operator test.
        Description: msrun lccl all_reduce 8P case.
        Expectation: success
        """
        all_reduce = Net()
        output = all_reduce()
    
        expect0 = np.ones([3, 1, 3, 3]).astype(np.float32) * 0
        for i in range(size):
            part = np.ones([3, 1, 3, 3]).astype(np.float32) * 0.01 * (i + 1)
            expect0 += part
>       diff0 = output[0].asnumpy() - expect0

test_lccl_allreduce.py:66: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = Tensor(shape=[3, 1, 3, 3], dtype=Float32, value=
[[[[ 0.00000000e+00,  0.00000000e+00,  0.00000000e+00],
   [ 0.000000...00],
   [ 0.00000000e+00,  0.00000000e+00,  0.00000000e+00],
   [ 0.00000000e+00,  0.00000000e+00,  0.00000000e+00]]]])

    def asnumpy(self):
        """
        Convert tensor to numpy array. Returns self tensor as a NumPy ndarray. This tensor and the returned ndarray
        share the same underlying storage. Changes to self tensor will be reflected in the ndarray.
    
        Returns:
            A numpy ndarray which shares the same underlying storage with the tensor.
    
        Examples:
            >>> from mindspore import Tensor
            >>> import numpy as np
            >>> x = Tensor(np.array([1, 2], dtype=np.float32))
            >>> y = x.asnumpy()
            >>> y[0] = 11
            >>> print(x)
            [11.  2.]
            >>> print(y)
            [11.  2.]
        """
        if self.has_init:
            self.init_data()
>       return TensorPy_.asnumpy(self)
E       RuntimeError: LCCL AllReduce failed.
E       
E       ----------------------------------------------------
E       - C++ Call Stack: (For framework developers)
E       ----------------------------------------------------
E       mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/common/tensor.py:989: RuntimeError
===================================================================================================================== warnings summary =====================================================================================================================
../../../../../../../../usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866
  /usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866: DeprecationWarning: invalid escape sequence \L
    if not dirpath.find("AppData\Local\Temp"):

../../../../../../../../usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/classifier/transdata/transdata_classifier.py:222
  /usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/classifier/transdata/transdata_classifier.py:222: DeprecationWarning: invalid escape sequence \B
    """

../../../../../../../../usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:143
  /usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:143: DeprecationWarning: invalid escape sequence \c
    """

../../../../../../../../usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:170
  /usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:170: DeprecationWarning: invalid escape sequence \c
    """

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for <class 'numpy.float64'> type is zero.
    setattr(self, word, getattr(machar, word).flat[0])

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for <class 'numpy.float64'> type is zero.
    return self._float_to_str(self.smallest_subnormal)

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for <class 'numpy.float32'> type is zero.
    setattr(self, word, getattr(machar, word).flat[0])

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for <class 'numpy.float32'> type is zero.
    return self._float_to_str(self.smallest_subnormal)

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2.py:57
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2.py:57: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("batchnorm_fold2")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad.py:56
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad.py:56: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("batchnorm_fold2_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad_reduce.py:48
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad_reduce.py:48: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("batchnorm_fold2_grad_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul.py:51
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul.py:51: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("correction_mul")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:51
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:51: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("correction_mul_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:143


========================================================================================================================= FAILURES =========================================================================================================================
______________________________________________________________________________________________________________________ test_AllReduce ______________________________________________________________________________________________________________________

    def test_AllReduce():
        """
        Feature: lccl operator test.
        Description: msrun lccl all_reduce 8P case.
        Expectation: success
        """
        all_reduce = Net()
        output = all_reduce()
    
        expect0 = np.ones([3, 1, 3, 3]).astype(np.float32) * 0
        for i in range(size):
            part = np.ones([3, 1, 3, 3]).astype(np.float32) * 0.01 * (i + 1)
            expect0 += part
>       diff0 = output[0].asnumpy() - expect0

test_lccl_allreduce.py:66: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = Tensor(shape=[3, 1, 3, 3], dtype=Float32, value=
[[[[           -nan,            -nan,            -nan],
   [         ...an],
   [           -nan,            -nan,            -nan],
   [           -nan,            -nan,            -nan]]]])

    def asnumpy(self):
        """
        Convert tensor to numpy array. Returns self tensor as a NumPy ndarray. This tensor and the returned ndarray
        share the same underlying storage. Changes to self tensor will be reflected in the ndarray.
    
        Returns:
            A numpy ndarray which shares the same underlying storage with the tensor.
    
        Examples:
            >>> from mindspore import Tensor
            >>> import numpy as np
            >>> x = Tensor(np.array([1, 2], dtype=np.float32))
            >>> y = x.asnumpy()
            >>> y[0] = 11
            >>> print(x)
            [11.  2.]
            >>> print(y)
            [11.  2.]
        """
        if self.has_init:
            self.init_data()
>       return TensorPy_.asnumpy(self)
E       RuntimeError: LCCL AllReduce failed.
E       
E       ----------------------------------------------------
E       - C++ Call Stack: (For framework developers)
E       ----------------------------------------------------
E       mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/common/tensor.py:989: RuntimeError
===================================================================================================================== warnings summary =====================================================================================================================
../../../../../../../../usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866
  /usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866: DeprecationWarning: invalid escape sequence \L
    if not dirpath.find("AppData\Local\Temp"):

../../../../../../../../usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/classifier/transdata/transdata_classifier.py:222
  /usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/classifier/transdata/transdata_classifier.py:222: DeprecationWarning: invalid escape sequence \B
    """

../../../../../../../../usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:143
  /usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:143: DeprecationWarning: invalid escape sequence \c
    """

../../../../../../../../usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:170
  /usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:170: DeprecationWarning: invalid escape sequence \c
    """

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for <class 'numpy.float64'> type is zero.
    setattr(self, word, getattr(machar, word).flat[0])

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for <class 'numpy.float64'> type is zero.
    return self._float_to_str(self.smallest_subnormal)

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for <class 'numpy.float32'> type is zero.
    setattr(self, word, getattr(machar, word).flat[0])

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for <class 'numpy.float32'> type is zero.
    return self._float_to_str(self.smallest_subnormal)

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2.py:57
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2.py:57: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("batchnorm_fold2")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad.py:56
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad.py:56: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("batchnorm_fold2_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad_reduce.py:48
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad_reduce.py:48: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("batchnorm_fold2_grad_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul.py:51
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul.py:51: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("correction_mul")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:51
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:51: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("correction_mul_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:143


========================================================================================================================= FAILURES =========================================================================================================================
______________________________________________________________________________________________________________________ test_AllReduce ______________________________________________________________________________________________________________________

    def test_AllReduce():
        """
        Feature: lccl operator test.
        Description: msrun lccl all_reduce 8P case.
        Expectation: success
        """
        all_reduce = Net()
        output = all_reduce()
    
        expect0 = np.ones([3, 1, 3, 3]).astype(np.float32) * 0
        for i in range(size):
            part = np.ones([3, 1, 3, 3]).astype(np.float32) * 0.01 * (i + 1)
            expect0 += part
>       diff0 = output[0].asnumpy() - expect0

test_lccl_allreduce.py:66: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = Tensor(shape=[3, 1, 3, 3], dtype=Float32, value=
[[[[ 0.00000000e+00,  0.00000000e+00,  0.00000000e+00],
   [ 0.000000...00],
   [ 0.00000000e+00,  0.00000000e+00,  0.00000000e+00],
   [ 0.00000000e+00,  0.00000000e+00,  0.00000000e+00]]]])

    def asnumpy(self):
        """
        Convert tensor to numpy array. Returns self tensor as a NumPy ndarray. This tensor and the returned ndarray
        share the same underlying storage. Changes to self tensor will be reflected in the ndarray.
    
        Returns:
            A numpy ndarray which shares the same underlying storage with the tensor.
    
        Examples:
            >>> from mindspore import Tensor
            >>> import numpy as np
            >>> x = Tensor(np.array([1, 2], dtype=np.float32))
            >>> y = x.asnumpy()
            >>> y[0] = 11
            >>> print(x)
            [11.  2.]
            >>> print(y)
            [11.  2.]
        """
        if self.has_init:
            self.init_data()
>       return TensorPy_.asnumpy(self)
E       RuntimeError: LCCL AllReduce failed.
E       
E       ----------------------------------------------------
E       - C++ Call Stack: (For framework developers)
E       ----------------------------------------------------
E       mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/common/tensor.py:989: RuntimeError
===================================================================================================================== warnings summary =====================================================================================================================
../../../../../../../../usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866
  /usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866: DeprecationWarning: invalid escape sequence \L
    if not dirpath.find("AppData\Local\Temp"):

../../../../../../../../usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/classifier/transdata/transdata_classifier.py:222
  /usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/classifier/transdata/transdata_classifier.py:222: DeprecationWarning: invalid escape sequence \B
    """

../../../../../../../../usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:143
  /usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:143: DeprecationWarning: invalid escape sequence \c
    """

../../../../../../../../usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:170
  /usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:170: DeprecationWarning: invalid escape sequence \c
    """

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for <class 'numpy.float64'> type is zero.
    setattr(self, word, getattr(machar, word).flat[0])

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for <class 'numpy.float64'> type is zero.
    return self._float_to_str(self.smallest_subnormal)

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for <class 'numpy.float32'> type is zero.
    setattr(self, word, getattr(machar, word).flat[0])

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for <class 'numpy.float32'> type is zero.
    return self._float_to_str(self.smallest_subnormal)

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2.py:57
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2.py:57: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("batchnorm_fold2")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad.py:56
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad.py:56: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("batchnorm_fold2_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad_reduce.py:48
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad_reduce.py:48: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("batchnorm_fold2_grad_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul.py:51
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul.py:51: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("correction_mul")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:51
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:51: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("correction_mul_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:143
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:143: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("correction_mul_grad_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perlayer")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad.py:92
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad.py:92: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perlayer_grad_d")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad_reduce.py:49
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad_reduce.py:49: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perlayer_grad_d_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perchannel")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad.py:91
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad.py:91: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perchannel_grad_d")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad_reduce.py:48
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad_reduce.py:48: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perchannel_grad_d_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel.py:52
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel.py:52: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_perchannel")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel_grad.py:81
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel_grad.py:81: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_perchannel_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer.py:54
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer.py:54: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_per_layer")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer_grad.py:81
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer_grad.py:81: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_per_layer_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perchannel.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perchannel.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("minmax_update_perchannel")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("minmax_update_perlayer")

-- Docs: https://docs.pytest.org/en/stable/warnings.html
================================================================================================================= short test summary info ==================================================================================================================
FAILED test_lccl_allreduce.py::test_AllReduce - RuntimeError: LCCL AllReduce failed.
============================================================================================================= 1 failed, 26 warnings in 23.42s ==============================================================================================================


========================================================================================================================= FAILURES =========================================================================================================================
______________________________________________________________________________________________________________________ test_AllReduce ______________________________________________________________________________________________________________________

    def test_AllReduce():
        """
        Feature: lccl operator test.
        Description: msrun lccl all_reduce 8P case.
        Expectation: success
        """
        all_reduce = Net()
        output = all_reduce()
    
        expect0 = np.ones([3, 1, 3, 3]).astype(np.float32) * 0
        for i in range(size):
            part = np.ones([3, 1, 3, 3]).astype(np.float32) * 0.01 * (i + 1)
            expect0 += part
>       diff0 = output[0].asnumpy() - expect0

test_lccl_allreduce.py:66: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = Tensor(shape=[3, 1, 3, 3], dtype=Float32, value=
[[[[ 0.00000000e+00,  0.00000000e+00,  0.00000000e+00],
   [ 0.000000...00],
   [ 0.00000000e+00,  0.00000000e+00,  0.00000000e+00],
   [ 0.00000000e+00,  0.00000000e+00,  0.00000000e+00]]]])

    def asnumpy(self):
        """
        Convert tensor to numpy array. Returns self tensor as a NumPy ndarray. This tensor and the returned ndarray
        share the same underlying storage. Changes to self tensor will be reflected in the ndarray.
    
        Returns:
            A numpy ndarray which shares the same underlying storage with the tensor.
    
        Examples:
            >>> from mindspore import Tensor
            >>> import numpy as np
            >>> x = Tensor(np.array([1, 2], dtype=np.float32))
            >>> y = x.asnumpy()
            >>> y[0] = 11
            >>> print(x)
            [11.  2.]
            >>> print(y)
            [11.  2.]
        """
        if self.has_init:
            self.init_data()
>       return TensorPy_.asnumpy(self)
E       RuntimeError: LCCL AllReduce failed.
E       
E       ----------------------------------------------------
E       - C++ Call Stack: (For framework developers)
E       ----------------------------------------------------
E       mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch

/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/common/tensor.py:989: RuntimeError
===================================================================================================================== warnings summary =====================================================================================================================
../../../../../../../../usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866
  /usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866: DeprecationWarning: invalid escape sequence \L
    if not dirpath.find("AppData\Local\Temp"):

../../../../../../../../usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/classifier/transdata/transdata_classifier.py:222
  /usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/classifier/transdata/transdata_classifier.py:222: DeprecationWarning: invalid escape sequence \B
    """

../../../../../../../../usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:143
  /usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:143: DeprecationWarning: invalid escape sequence \c
    """

../../../../../../../../usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:170
  /usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:170: DeprecationWarning: invalid escape sequence \c
    """

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for <class 'numpy.float64'> type is zero.
    setattr(self, word, getattr(machar, word).flat[0])

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for <class 'numpy.float64'> type is zero.
    return self._float_to_str(self.smallest_subnormal)

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for <class 'numpy.float32'> type is zero.
    setattr(self, word, getattr(machar, word).flat[0])

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for <class 'numpy.float32'> type is zero.
    return self._float_to_str(self.smallest_subnormal)

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2.py:57
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2.py:57: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("batchnorm_fold2")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad.py:56
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad.py:56: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("batchnorm_fold2_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad_reduce.py:48
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad_reduce.py:48: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("batchnorm_fold2_grad_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul.py:51
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul.py:51: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("correction_mul")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:51
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:51: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("correction_mul_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:143
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.440.979 [mindspore/ccsrc/pybind_api/init.cc:651] operator()] Start register...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.441.017 [mindspore/ccsrc/pybind_api/init.cc:654] operator()] Start mindspore.profiler...
[INFO] ME(618674:281473023856096,MainProcess):2025-04-03-09:27:48.441.092 [mindspore/profiler/envprofiler.py:57] analyse start
[INFO] ME(618674:281473023856096,MainProcess):2025-04-03-09:27:48.441.247 [mindspore/profiler/envprofiler.py:59] Profiler is not initialized, skip analyse.
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.441.325 [mindspore/ccsrc/pybind_api/init.cc:661] operator()] Start EmbeddingCacheScheduler...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.441.370 [mindspore/ccsrc/pybind_api/init.cc:668] operator()] Start releasing dataset handles...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.441.415 [mindspore/ccsrc/pybind_api/init.cc:671] operator()] End release dataset handles.
[INFO] PIPELINE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.441.440 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:2616] FinalizeCluster] Start finalize the cluster instance.
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:143: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("correction_mul_grad_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perlayer")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad.py:92
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad.py:92: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perlayer_grad_d")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad_reduce.py:49
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad_reduce.py:49: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perlayer_grad_d_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perchannel")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad.py:91
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad.py:91: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perchannel_grad_d")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad_reduce.py:48
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad_reduce.py:48: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perchannel_grad_d_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel.py:52
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel.py:52: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_perchannel")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel_grad.py:81
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel_grad.py:81: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_perchannel_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer.py:54
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer.py:54: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_per_layer")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer_grad.py:81
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer_grad.py:81: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_per_layer_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perchannel.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perchannel.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("minmax_update_perchannel")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("minmax_update_perlayer")

-- Docs: https://docs.pytest.org/en/stable/warnings.html
================================================================================================================= short test summary info ==================================================================================================================
FAILED test_lccl_allreduce.py::test_AllReduce - RuntimeError: LCCL AllReduce failed.
============================================================================================================= 1 failed, 26 warnings in 23.57s ==============================================================================================================
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.442.029 [mindspore/ccsrc/pybind_api/init.cc:651] operator()] Start register...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.442.069 [mindspore/ccsrc/pybind_api/init.cc:654] operator()] Start mindspore.profiler...
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:143: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("correction_mul_grad_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perlayer")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad.py:92
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad.py:92: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perlayer_grad_d")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad_reduce.py:49
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad_reduce.py:49: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perlayer_grad_d_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perchannel")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad.py:91
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad.py:91: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perchannel_grad_d")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad_reduce.py:48
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad_reduce.py:48: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perchannel_grad_d_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel.py:52
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel.py:52: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_perchannel")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel_grad.py:81
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel_grad.py:81: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_perchannel_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer.py:54
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer.py:54: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_per_layer")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer_grad.py:81
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer_grad.py:81: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_per_layer_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perchannel.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perchannel.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("minmax_update_perchannel")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("minmax_update_perlayer")

-- Docs: https://docs.pytest.org/en/stable/warnings.html
================================================================================================================= short test summary info ==================================================================================================================
FAILED test_lccl_allreduce.py::test_AllReduce - RuntimeError: LCCL AllReduce failed.
============================================================================================================= 1 failed, 26 warnings in 23.48s ==============================================================================================================
[INFO] ME(618662:281473748110816,MainProcess):2025-04-03-09:27:48.442.144 [mindspore/profiler/envprofiler.py:57] analyse start
[INFO] ME(618662:281473748110816,MainProcess):2025-04-03-09:27:48.442.302 [mindspore/profiler/envprofiler.py:59] Profiler is not initialized, skip analyse.
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.442.351 [mindspore/ccsrc/pybind_api/init.cc:651] operator()] Start register...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.442.382 [mindspore/ccsrc/pybind_api/init.cc:661] operator()] Start EmbeddingCacheScheduler...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.442.393 [mindspore/ccsrc/pybind_api/init.cc:654] operator()] Start mindspore.profiler...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.442.462 [mindspore/ccsrc/pybind_api/init.cc:668] operator()] Start releasing dataset handles...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.442.509 [mindspore/ccsrc/pybind_api/init.cc:671] operator()] End release dataset handles.
[INFO] PIPELINE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.442.534 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:2616] FinalizeCluster] Start finalize the cluster instance.
[INFO] ME(618670:281473556700640,MainProcess):2025-04-03-09:27:48.442.473 [mindspore/profiler/envprofiler.py:57] analyse start
[INFO] ME(618670:281473556700640,MainProcess):2025-04-03-09:27:48.442.636 [mindspore/profiler/envprofiler.py:59] Profiler is not initialized, skip analyse.
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.442.718 [mindspore/ccsrc/pybind_api/init.cc:661] operator()] Start EmbeddingCacheScheduler...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.442.805 [mindspore/ccsrc/pybind_api/init.cc:668] operator()] Start releasing dataset handles...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.442.851 [mindspore/ccsrc/pybind_api/init.cc:671] operator()] End release dataset handles.
[INFO] PIPELINE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.442.876 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:2616] FinalizeCluster] Start finalize the cluster instance.
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:143: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("correction_mul_grad_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perlayer")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad.py:92
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad.py:92: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perlayer_grad_d")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad_reduce.py:49
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad_reduce.py:49: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perlayer_grad_d_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perchannel")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad.py:91
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad.py:91: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perchannel_grad_d")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad_reduce.py:48
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad_reduce.py:48: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perchannel_grad_d_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel.py:52
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel.py:52: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_perchannel")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel_grad.py:81
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel_grad.py:81: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_perchannel_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer.py:54
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer.py:54: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_per_layer")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer_grad.py:81
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer_grad.py:81: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_per_layer_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perchannel.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perchannel.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("minmax_update_perchannel")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("minmax_update_perlayer")

-- Docs: https://docs.pytest.org/en/stable/warnings.html
================================================================================================================= short test summary info ==================================================================================================================
FAILED test_lccl_allreduce.py::test_AllReduce - RuntimeError: LCCL AllReduce failed.
============================================================================================================= 1 failed, 26 warnings in 23.71s ==============================================================================================================
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.443.443 [mindspore/ccsrc/pybind_api/init.cc:651] operator()] Start register...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.443.485 [mindspore/ccsrc/pybind_api/init.cc:654] operator()] Start mindspore.profiler...
[INFO] ME(618650:281473891839456,MainProcess):2025-04-03-09:27:48.443.574 [mindspore/profiler/envprofiler.py:57] analyse start
[INFO] ME(618650:281473891839456,MainProcess):2025-04-03-09:27:48.443.752 [mindspore/profiler/envprofiler.py:59] Profiler is not initialized, skip analyse.
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.443.833 [mindspore/ccsrc/pybind_api/init.cc:661] operator()] Start EmbeddingCacheScheduler...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.443.898 [mindspore/ccsrc/pybind_api/init.cc:668] operator()] Start releasing dataset handles...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.443.947 [mindspore/ccsrc/pybind_api/init.cc:671] operator()] End release dataset handles.
[INFO] PIPELINE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.443.969 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:2616] FinalizeCluster] Start finalize the cluster instance.
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:48.452.183 [queue_client_comm.c:114][ascend][curpid:618650,618925][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:48.452.194 [queue_client_comm.c:114][ascend][curpid:618650,618929][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:48.452.193 [queue_client_comm.c:114][ascend][curpid:618650,618923][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:48.452.204 [queue_client_comm.c:114][ascend][curpid:618650,618927][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:48.452.318 [npu_driver.cc:4338] 618925 MemQueuePeek: queue empty
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:48.452.307 [queue_client_comm.c:114][ascend][curpid:618650,618931][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.452.342 [tensor_data_transfer.cpp:612]618925 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_tensor_summary
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:48.452.338 [queue_client_comm.c:114][ascend][curpid:618650,618921][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.452.361 [tensor_data_transfer.cpp:1054]618925 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_tensor_summary
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:48.452.372 [npu_driver.cc:4338] 618929 MemQueuePeek: queue empty
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:48.452.381 [npu_driver.cc:4338] 618923 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.452.384 [tensor_data_transfer.cpp:1056]618925 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:48.452.414 [npu_driver.cc:4338] 618927 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.452.430 [tensor_data_transfer.cpp:612]618923 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_tensor_dump
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.452.433 [api_impl.cc:6121] 618925 MemQueuePeek: Start to peek queue on devId 1, qid is 2.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.452.440 [tensor_data_transfer.cpp:612]618927 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_image_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.452.443 [tensor_data_transfer.cpp:1054]618923 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_tensor_dump
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.452.446 [npu_driver.cc:4330] 618925 MemQueuePeek: peek mem queue, deviceId=1, qid=2, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.452.454 [tensor_data_transfer.cpp:1054]618927 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_image_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.452.456 [tensor_data_transfer.cpp:1056]618923 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:48.452.454 [npu_driver.cc:4338] 618931 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.452.466 [tensor_data_transfer.cpp:1056]618927 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.452.472 [api_impl.cc:6121] 618923 MemQueuePeek: Start to peek queue on devId 1, qid is 1.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:48.452.482 [npu_driver.cc:4338] 618921 MemQueuePeek: queue empty
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.452.488 [api_impl.cc:6121] 618927 MemQueuePeek: Start to peek queue on devId 1, qid is 3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.452.493 [npu_driver.cc:4330] 618923 MemQueuePeek: peek mem queue, deviceId=1, qid=1, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.452.480 [tensor_data_transfer.cpp:612]618929 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_scalar_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.452.506 [tensor_data_transfer.cpp:612]618921 acltdtReceiveTensorV2: queue is empty, device is 1, name is _npu_log
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.452.509 [tensor_data_transfer.cpp:612]618931 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_histogram_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.452.511 [npu_driver.cc:4330] 618927 MemQueuePeek: peek mem queue, deviceId=1, qid=3, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.452.558 [tensor_data_transfer.cpp:1054]618931 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_histogram_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.452.574 [tensor_data_transfer.cpp:1056]618931 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.452.593 [api_impl.cc:6121] 618931 MemQueuePeek: Start to peek queue on devId 1, qid is 5.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.452.529 [tensor_data_transfer.cpp:1054]618929 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_scalar_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.452.552 [tensor_data_transfer.cpp:1054]618921 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is _npu_log
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.452.611 [npu_driver.cc:4330] 618931 MemQueuePeek: peek mem queue, deviceId=1, qid=5, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.452.629 [tensor_data_transfer.cpp:1056]618921 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.452.621 [tensor_data_transfer.cpp:1056]618929 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.452.643 [api_impl.cc:6121] 618921 MemQueuePeek: Start to peek queue on devId 1, qid is 0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.452.660 [npu_driver.cc:4330] 618921 MemQueuePeek: peek mem queue, deviceId=1, qid=0, timeout=800.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.452.654 [api_impl.cc:6121] 618929 MemQueuePeek: Start to peek queue on devId 1, qid is 4.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.452.699 [npu_driver.cc:4330] 618929 MemQueuePeek: peek mem queue, deviceId=1, qid=4, timeout=800.
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.504.692 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:132] Finalize] The compute graph node has been unregistered successfully.
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.504.797 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:563] Finalize] Delete send event loop
[INFO] DISTRIBUTED(618650,ffff5ec09fa0,python3.9):2025-04-03-09:27:48.504.881 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.504.985 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.505.004 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:570] Finalize] Delete recv event loop
[INFO] DISTRIBUTED(618650,ffff5f419fa0,python3.9):2025-04-03-09:27:48.505.059 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.505.133 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.505.149 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:584] Finalize] Delete connection pool.
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.505.207 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:563] Finalize] Delete send event loop
[INFO] DISTRIBUTED(618650,ffff5dbe9fa0,python3.9):2025-04-03-09:27:48.505.279 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.505.418 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.505.448 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:570] Finalize] Delete recv event loop
[INFO] DISTRIBUTED(618650,ffff5e3f9fa0,python3.9):2025-04-03-09:27:48.505.501 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.505.604 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.505.623 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:584] Finalize] Delete connection pool.
[INFO] PIPELINE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.505.644 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:2619] FinalizeCluster] End finalize the cluster instance.
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.505.662 [mindspore/ccsrc/pybind_api/resource/manager.cc:259] ClearResAtexit] Pipeline clear all resource
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.505.812 [context.cpp:72]618650 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.505.834 [api_impl.cc:3717] 618650 ContextSetCurrent: set context=aaab312ab590, flag=0.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.505.849 [context.cpp:80]618650 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.505.878 [stream.cpp:131]618650 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.505.896 [api_impl.cc:1394] 618650 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.505.913 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.505.927 [stream.cc:2886] 618650 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.505.940 [api_error.cc:895] 618650 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.505.950 [stream.cpp:146]618650 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.505.965 [stream.cpp:131]618650 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.505.982 [api_impl.cc:1394] 618650 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.505.994 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.506.007 [stream.cc:2886] 618650 StarsWaitForTask: No.0 stream_id=3, taskId=0, currentId=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.506.019 [api_error.cc:895] 618650 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.506.030 [stream.cpp:146]618650 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.506.052 [stream.cpp:131]618650 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.506.068 [api_impl.cc:1394] 618650 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.506.080 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.506.092 [stream.cc:2886] 618650 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.506.104 [api_error.cc:895] 618650 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.506.115 [stream.cpp:146]618650 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.506.137 [stream.cpp:131]618650 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.506.152 [api_impl.cc:1394] 618650 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.506.165 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.506.177 [stream.cc:2886] 618650 StarsWaitForTask: No.0 stream_id=3, taskId=0, currentId=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.506.189 [api_error.cc:895] 618650 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.506.199 [stream.cpp:146]618650 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.506.240 [mindspore/ccsrc/pybind_api/resource/manager.cc:82] RecordExitStatus] Status record: system exit.
[INFO] DEBUG(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.506.298 [mindspore/ccsrc/common/debug/env_config_parser.cc:152] ParseFromFile] The 'env_config_path' in 'mindspore.context.set_context(env_config_path={path})' is empty.
[INFO] ME(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.506.352 [mindspore/core/mindrt/src/actor/actormgr.cc:165] Finalize] mindrt Actors finish exiting.
[INFO] ME(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.506.368 [mindspore/core/mindrt/src/actor/actormgr.cc:168] Finalize] mindrt Threads finish exiting.
[INFO] ME(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.506.382 [mindspore/core/mindrt/src/actor/actormgr.cc:179] Finalize] mindrt IOMGRS finish exiting.
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.506.544 [mindspore/ccsrc/pybind_api/resource/manager.cc:134] ClearResPart1] Start Finalize StreamSynchronizer...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.506.563 [mindspore/ccsrc/pybind_api/resource/manager.cc:136] ClearResPart1] End Finalize StreamSynchronizer...
[INFO] PIPELINE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.507.295 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:1000] ClearInfo] Clean graph resource!
[INFO] PIPELINE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.507.319 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:1000] ClearInfo] Clean graph resource!
[INFO] PIPELINE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.507.335 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:995] ClearRes] Clean Graph executor resource!
[INFO] PIPELINE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.507.350 [mindspore/ccsrc/pipeline/jit/ps/pipeline_jit.cc:426] ClearRes] Clean JIT executor resource!
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.507.366 [mindspore/ccsrc/pybind_api/resource/manager.cc:155] ClearResPart2] Start clear PyNativeExecutor...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.507.627 [mindspore/ccsrc/pybind_api/resource/manager.cc:157] ClearResPart2] End clear PyNativeExecutor.
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.507.649 [mindspore/ccsrc/pybind_api/resource/manager.cc:159] ClearResPart2] Start clear ConfigManager...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.507.664 [mindspore/ccsrc/pybind_api/resource/manager.cc:161] ClearResPart2] End clear ConfigManager.
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.507.730 [mindspore/ccsrc/common/thread_pool.cc:41] ThreadPool] Set max_thread_num_ to 4
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.507.748 [mindspore/ccsrc/pybind_api/resource/manager.cc:165] ClearResPart2] Start clear device context...
[INFO] ME(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.507.765 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:401] ClearDeviceContexts] Release device Ascend_1
[INFO] GE_ADPT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.514.793 [mindspore/ccsrc/backend/ge_backend/graph_ir/df_graph_manager.cc:154] ClearGraph] Remove all graphs in GraphManager
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.514.841 [mindspore/ccsrc/backend/ge_backend/executor/ge_graph_executor.cc:1440] UnregisterExternalAllocator] The graph_runner is not exist
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.514.868 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:178] ReleaseDeviceRes] Ascend finalize start
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.514.881 [context.cpp:72]618650 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.514.903 [api_impl.cc:3717] 618650 ContextSetCurrent: set context=aaab312ab590, flag=0.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.514.918 [context.cpp:80]618650 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.514.931 [context.cpp:72]618650 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.514.945 [api_impl.cc:3717] 618650 ContextSetCurrent: set context=aaab312ab590, flag=0.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.514.957 [context.cpp:80]618650 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.514.999 [device.cpp:143]618650 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.515.018 [api_impl.cc:2999] 618650 SetDevice: device_id=1, deviceMode=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.515.032 [device.cc:306] 618650 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.515.046 [runtime.cc:3393] 618650 PrimaryContextRetain: Context inc ref, ts_id=0, count=0xb
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.515.075 [runtime.cc:3560] 618650 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.515.089 [api_impl.cc:2987] 618650 NewDevice: SetCurRef = 0xaaab312ab590,userDeviceId=1,deviceId=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.515.103 [runtime.cc:5239] 618650 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.515.122 [api_impl.cc:2992] 618650 NewDevice: New device success, user_device_id=1, die_num=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.515.138 [api_impl.cc:3025] 618650 SetDevice: SetDevice success, curCtx=0xaaab312ab590, user_device_id=1.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.515.162 [acl.cpp:115]618650 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.515.174 [acl.cpp:121]618650 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.515.221 [device.cpp:154]618650 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 1
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.515.247 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:46] DestroyHandlerByName] Destroy watch dog thread by group name: hccl_world_group
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:48.516.186 [trs_cb_event.c:119][ascend][curpid:618654,618833][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =321; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:48.516.224 [trs_sqcq.c:1491][ascend][curpid:618654,618833][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:48.516.245 [npu_driver.cc:3833] 618833 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:48.516.262 [api_impl.cc:5058] 618833 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.516.284 [callback.cpp:132]618833 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.516.304 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.516.326 [npu_driver.cc:3828] 618833 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=321.
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:48.548.174 [queue_client_comm.c:114][ascend][curpid:618654,618945][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:48.548.176 [queue_client_comm.c:114][ascend][curpid:618654,618947][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:48.548.177 [queue_client_comm.c:114][ascend][curpid:618654,618951][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:48.548.180 [queue_client_comm.c:114][ascend][curpid:618654,618949][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:48.548.182 [queue_client_comm.c:114][ascend][curpid:618654,618943][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:48.548.184 [queue_client_comm.c:114][ascend][curpid:618654,618941][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:48.548.294 [npu_driver.cc:4338] 618945 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.548.315 [tensor_data_transfer.cpp:612]618945 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_tensor_summary
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:48.548.319 [npu_driver.cc:4338] 618947 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.548.337 [tensor_data_transfer.cpp:1054]618945 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_tensor_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.548.343 [tensor_data_transfer.cpp:612]618947 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_image_summary
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:48.548.350 [npu_driver.cc:4338] 618951 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.548.352 [tensor_data_transfer.cpp:1056]618945 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.548.360 [tensor_data_transfer.cpp:1054]618947 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_image_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.548.367 [tensor_data_transfer.cpp:612]618951 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_histogram_summary
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.548.374 [api_impl.cc:6121] 618945 MemQueuePeek: Start to peek queue on devId 2, qid is 2.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.548.379 [tensor_data_transfer.cpp:1056]618947 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:48.548.383 [npu_driver.cc:4338] 618949 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.548.387 [tensor_data_transfer.cpp:1054]618951 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_histogram_summary
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.548.392 [npu_driver.cc:4330] 618945 MemQueuePeek: peek mem queue, deviceId=2, qid=2, timeout=800.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.548.399 [api_impl.cc:6121] 618947 MemQueuePeek: Start to peek queue on devId 2, qid is 3.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.548.407 [tensor_data_transfer.cpp:612]618949 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_scalar_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.548.413 [tensor_data_transfer.cpp:1056]618951 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:48.548.416 [npu_driver.cc:4338] 618943 MemQueuePeek: queue empty
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.548.425 [npu_driver.cc:4330] 618947 MemQueuePeek: peek mem queue, deviceId=2, qid=3, timeout=800.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.548.433 [tensor_data_transfer.cpp:1054]618949 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_scalar_summary
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.548.439 [api_impl.cc:6121] 618951 MemQueuePeek: Start to peek queue on devId 2, qid is 5.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.548.449 [tensor_data_transfer.cpp:612]618943 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_tensor_dump
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:48.548.450 [npu_driver.cc:4338] 618941 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.548.458 [tensor_data_transfer.cpp:1056]618949 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.548.465 [npu_driver.cc:4330] 618951 MemQueuePeek: peek mem queue, deviceId=2, qid=5, timeout=800.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.548.472 [tensor_data_transfer.cpp:1054]618943 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_tensor_dump
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.548.480 [tensor_data_transfer.cpp:612]618941 acltdtReceiveTensorV2: queue is empty, device is 2, name is _npu_log
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.548.486 [api_impl.cc:6121] 618949 MemQueuePeek: Start to peek queue on devId 2, qid is 4.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.548.520 [tensor_data_transfer.cpp:1056]618943 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.548.526 [tensor_data_transfer.cpp:1054]618941 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is _npu_log
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.548.531 [npu_driver.cc:4330] 618949 MemQueuePeek: peek mem queue, deviceId=2, qid=4, timeout=800.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.548.539 [api_impl.cc:6121] 618943 MemQueuePeek: Start to peek queue on devId 2, qid is 1.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.548.542 [tensor_data_transfer.cpp:1056]618941 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.548.554 [npu_driver.cc:4330] 618943 MemQueuePeek: peek mem queue, deviceId=2, qid=1, timeout=800.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.548.561 [api_impl.cc:6121] 618941 MemQueuePeek: Start to peek queue on devId 2, qid is 0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.548.575 [npu_driver.cc:4330] 618941 MemQueuePeek: peek mem queue, deviceId=2, qid=0, timeout=800.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:48.591.767 [awatchdog_monitor.c:160](tid:618682) thread 619016 not exist
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.606.440 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:132] Finalize] The compute graph node has been unregistered successfully.
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.606.544 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:563] Finalize] Delete send event loop
[INFO] DISTRIBUTED(618654,ffff2e3dbfa0,python3.9):2025-04-03-09:27:48.606.647 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.606.744 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.606.767 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:570] Finalize] Delete recv event loop
[INFO] DISTRIBUTED(618654,ffff2ebebfa0,python3.9):2025-04-03-09:27:48.606.823 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.606.925 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.606.945 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:584] Finalize] Delete connection pool.
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.607.012 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:563] Finalize] Delete send event loop
[INFO] DISTRIBUTED(618654,ffff2d3bbfa0,python3.9):2025-04-03-09:27:48.607.085 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.607.196 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.607.218 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:570] Finalize] Delete recv event loop
[INFO] DISTRIBUTED(618654,ffff2dbcbfa0,python3.9):2025-04-03-09:27:48.607.316 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.607.412 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.607.443 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:584] Finalize] Delete connection pool.
[INFO] PIPELINE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.607.468 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:2619] FinalizeCluster] End finalize the cluster instance.
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.607.491 [mindspore/ccsrc/pybind_api/resource/manager.cc:259] ClearResAtexit] Pipeline clear all resource
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.607.638 [context.cpp:72]618654 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.607.662 [api_impl.cc:3717] 618654 ContextSetCurrent: set context=aaaaf5082ff0, flag=0.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.607.683 [context.cpp:80]618654 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.607.723 [stream.cpp:131]618654 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.607.746 [api_impl.cc:1394] 618654 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.607.769 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.607.789 [stream.cc:2886] 618654 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.607.808 [api_error.cc:895] 618654 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.607.825 [stream.cpp:146]618654 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.607.844 [stream.cpp:131]618654 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.607.865 [api_impl.cc:1394] 618654 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.607.879 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.607.897 [stream.cc:2886] 618654 StarsWaitForTask: No.0 stream_id=3, taskId=0, currentId=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.607.910 [api_error.cc:895] 618654 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.607.925 [stream.cpp:146]618654 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.607.952 [stream.cpp:131]618654 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.607.973 [api_impl.cc:1394] 618654 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.607.986 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.608.004 [stream.cc:2886] 618654 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.608.017 [api_error.cc:895] 618654 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.608.030 [stream.cpp:146]618654 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.608.046 [stream.cpp:131]618654 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.608.060 [api_impl.cc:1394] 618654 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.608.073 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.608.100 [stream.cc:2886] 618654 StarsWaitForTask: No.0 stream_id=3, taskId=0, currentId=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.608.115 [api_error.cc:895] 618654 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.608.131 [stream.cpp:146]618654 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.608.193 [mindspore/ccsrc/pybind_api/resource/manager.cc:82] RecordExitStatus] Status record: system exit.
[INFO] DEBUG(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.608.271 [mindspore/ccsrc/common/debug/env_config_parser.cc:152] ParseFromFile] The 'env_config_path' in 'mindspore.context.set_context(env_config_path={path})' is empty.
[INFO] ME(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.608.338 [mindspore/core/mindrt/src/actor/actormgr.cc:165] Finalize] mindrt Actors finish exiting.
[INFO] ME(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.608.358 [mindspore/core/mindrt/src/actor/actormgr.cc:168] Finalize] mindrt Threads finish exiting.
[INFO] ME(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.608.378 [mindspore/core/mindrt/src/actor/actormgr.cc:179] Finalize] mindrt IOMGRS finish exiting.
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.608.578 [mindspore/ccsrc/pybind_api/resource/manager.cc:134] ClearResPart1] Start Finalize StreamSynchronizer...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.608.603 [mindspore/ccsrc/pybind_api/resource/manager.cc:136] ClearResPart1] End Finalize StreamSynchronizer...
[INFO] PIPELINE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.609.424 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:1000] ClearInfo] Clean graph resource!
[INFO] PIPELINE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.609.452 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:1000] ClearInfo] Clean graph resource!
[INFO] PIPELINE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.609.472 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:995] ClearRes] Clean Graph executor resource!
[INFO] PIPELINE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.609.492 [mindspore/ccsrc/pipeline/jit/ps/pipeline_jit.cc:426] ClearRes] Clean JIT executor resource!
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.609.513 [mindspore/ccsrc/pybind_api/resource/manager.cc:155] ClearResPart2] Start clear PyNativeExecutor...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.609.814 [mindspore/ccsrc/pybind_api/resource/manager.cc:157] ClearResPart2] End clear PyNativeExecutor.
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.609.839 [mindspore/ccsrc/pybind_api/resource/manager.cc:159] ClearResPart2] Start clear ConfigManager...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.609.859 [mindspore/ccsrc/pybind_api/resource/manager.cc:161] ClearResPart2] End clear ConfigManager.
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.609.932 [mindspore/ccsrc/common/thread_pool.cc:41] ThreadPool] Set max_thread_num_ to 4
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.609.954 [mindspore/ccsrc/pybind_api/resource/manager.cc:165] ClearResPart2] Start clear device context...
[INFO] ME(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.609.975 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:401] ClearDeviceContexts] Release device Ascend_2
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:48.612.181 [queue_client_comm.c:114][ascend][curpid:618646,618961][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:48.612.186 [trs_cb_event.c:119][ascend][curpid:618646,618837][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =65; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:48.612.189 [queue_client_comm.c:114][ascend][curpid:618646,618965][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:48.612.187 [queue_client_comm.c:114][ascend][curpid:618646,618963][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:48.612.224 [trs_sqcq.c:1491][ascend][curpid:618646,618837][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:48.612.258 [npu_driver.cc:3833] 618837 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:48.612.274 [api_impl.cc:5058] 618837 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.612.288 [callback.cpp:132]618837 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.612.302 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:48.612.314 [npu_driver.cc:4338] 618961 MemQueuePeek: queue empty
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.612.319 [npu_driver.cc:3828] 618837 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=65.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:48.612.336 [npu_driver.cc:4338] 618965 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.612.339 [tensor_data_transfer.cpp:612]618961 acltdtReceiveTensorV2: queue is empty, device is 0, name is _npu_log
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.612.359 [tensor_data_transfer.cpp:1054]618961 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is _npu_log
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.612.359 [tensor_data_transfer.cpp:612]618965 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_tensor_summary
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:48.612.367 [npu_driver.cc:4338] 618963 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.612.372 [tensor_data_transfer.cpp:1056]618961 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.612.378 [tensor_data_transfer.cpp:1054]618965 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_tensor_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.612.392 [tensor_data_transfer.cpp:612]618963 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_tensor_dump
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.612.397 [api_impl.cc:6121] 618961 MemQueuePeek: Start to peek queue on devId 0, qid is 0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.612.417 [tensor_data_transfer.cpp:1056]618965 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.612.437 [npu_driver.cc:4330] 618961 MemQueuePeek: peek mem queue, deviceId=0, qid=0, timeout=800.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.612.442 [api_impl.cc:6121] 618965 MemQueuePeek: Start to peek queue on devId 0, qid is 2.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.612.453 [npu_driver.cc:4330] 618965 MemQueuePeek: peek mem queue, deviceId=0, qid=2, timeout=800.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.612.588 [tensor_data_transfer.cpp:1054]618963 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_tensor_dump
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.612.629 [tensor_data_transfer.cpp:1056]618963 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.612.651 [api_impl.cc:6121] 618963 MemQueuePeek: Start to peek queue on devId 0, qid is 1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.612.669 [npu_driver.cc:4330] 618963 MemQueuePeek: peek mem queue, deviceId=0, qid=1, timeout=800.
[INFO] GE_ADPT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.618.962 [mindspore/ccsrc/backend/ge_backend/graph_ir/df_graph_manager.cc:154] ClearGraph] Remove all graphs in GraphManager
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.618.997 [mindspore/ccsrc/backend/ge_backend/executor/ge_graph_executor.cc:1440] UnregisterExternalAllocator] The graph_runner is not exist
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.619.028 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:178] ReleaseDeviceRes] Ascend finalize start
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.619.056 [context.cpp:72]618654 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.619.079 [api_impl.cc:3717] 618654 ContextSetCurrent: set context=aaaaf5082ff0, flag=0.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.619.099 [context.cpp:80]618654 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.619.117 [context.cpp:72]618654 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.619.131 [api_impl.cc:3717] 618654 ContextSetCurrent: set context=aaaaf5082ff0, flag=0.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.619.143 [context.cpp:80]618654 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.619.170 [device.cpp:143]618654 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.619.195 [api_impl.cc:2999] 618654 SetDevice: device_id=2, deviceMode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.619.215 [device.cc:306] 618654 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.619.235 [runtime.cc:3393] 618654 PrimaryContextRetain: Context inc ref, ts_id=0, count=0xb
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.619.257 [runtime.cc:3560] 618654 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.619.275 [api_impl.cc:2987] 618654 NewDevice: SetCurRef = 0xaaaaf5082ff0,userDeviceId=2,deviceId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.619.294 [runtime.cc:5239] 618654 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.619.319 [api_impl.cc:2992] 618654 NewDevice: New device success, user_device_id=2, die_num=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.619.339 [api_impl.cc:3025] 618654 SetDevice: SetDevice success, curCtx=0xaaaaf5082ff0, user_device_id=2.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.619.361 [acl.cpp:115]618654 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.619.378 [acl.cpp:121]618654 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.619.396 [device.cpp:154]618654 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 2
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.619.424 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:46] DestroyHandlerByName] Destroy watch dog thread by group name: hccl_world_group
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:48.644.179 [queue_client_comm.c:114][ascend][curpid:618646,618967][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:48.644.180 [queue_client_comm.c:114][ascend][curpid:618646,618971][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:48.644.182 [queue_client_comm.c:114][ascend][curpid:618646,618969][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:48.644.267 [npu_driver.cc:4338] 618967 MemQueuePeek: queue empty
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:48.644.299 [npu_driver.cc:4338] 618971 MemQueuePeek: queue empty
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:48.644.324 [npu_driver.cc:4338] 618969 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.644.340 [tensor_data_transfer.cpp:612]618967 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_image_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.644.371 [tensor_data_transfer.cpp:1054]618967 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_image_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.644.388 [tensor_data_transfer.cpp:1056]618967 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.644.387 [tensor_data_transfer.cpp:612]618969 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_scalar_summary
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.644.399 [api_impl.cc:6121] 618967 MemQueuePeek: Start to peek queue on devId 0, qid is 3.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.644.410 [tensor_data_transfer.cpp:1054]618969 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_scalar_summary
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.644.412 [npu_driver.cc:4330] 618967 MemQueuePeek: peek mem queue, deviceId=0, qid=3, timeout=800.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.644.421 [tensor_data_transfer.cpp:1056]618969 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.644.416 [tensor_data_transfer.cpp:612]618971 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_histogram_summary
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.644.434 [api_impl.cc:6121] 618969 MemQueuePeek: Start to peek queue on devId 0, qid is 4.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.644.477 [tensor_data_transfer.cpp:1054]618971 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_histogram_summary
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.644.492 [npu_driver.cc:4330] 618969 MemQueuePeek: peek mem queue, deviceId=0, qid=4, timeout=800.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.644.502 [tensor_data_transfer.cpp:1056]618971 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.644.523 [api_impl.cc:6121] 618971 MemQueuePeek: Start to peek queue on devId 0, qid is 5.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.644.540 [npu_driver.cc:4330] 618971 MemQueuePeek: peek mem queue, deviceId=0, qid=5, timeout=800.
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:48.676.184 [trs_cb_event.c:119][ascend][curpid:618646,618836][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =64; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:48.676.214 [trs_sqcq.c:1491][ascend][curpid:618646,618836][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:48.676.233 [npu_driver.cc:3833] 618836 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:48.676.258 [api_impl.cc:5058] 618836 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.676.276 [callback.cpp:132]618836 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:48.676.294 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.676.311 [npu_driver.cc:3828] 618836 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=64.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:48.730.977 [awatchdog_monitor.c:160](tid:618684) thread 619020 not exist
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:48.740.175 [trs_cb_event.c:119][ascend][curpid:618666,618809][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =65; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:48.740.201 [trs_sqcq.c:1491][ascend][curpid:618666,618809][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:48.740.219 [npu_driver.cc:3833] 618809 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:48.740.233 [api_impl.cc:5058] 618809 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.740.247 [callback.cpp:132]618809 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.740.261 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.740.283 [npu_driver.cc:3828] 618809 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=65.
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:48.772.181 [trs_cb_event.c:119][ascend][curpid:618658,618775][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =65; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:48.772.212 [trs_sqcq.c:1491][ascend][curpid:618658,618775][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:48.772.233 [npu_driver.cc:3833] 618775 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:48.772.248 [api_impl.cc:5058] 618775 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.772.270 [callback.cpp:132]618775 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.772.290 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.772.311 [npu_driver.cc:3828] 618775 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=65.
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.772.876 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:132] Finalize] The compute graph node has been unregistered successfully.
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.772.982 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:563] Finalize] Delete send event loop
[INFO] DISTRIBUTED(618658,ffff4fffefa0,python3.9):2025-04-03-09:27:48.773.074 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.773.309 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.773.331 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:570] Finalize] Delete recv event loop
[INFO] DISTRIBUTED(618658,ffff54cacfa0,python3.9):2025-04-03-09:27:48.773.424 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.773.512 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.773.531 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:584] Finalize] Delete connection pool.
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.773.595 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:563] Finalize] Delete send event loop
[INFO] DISTRIBUTED(618658,ffff4efdefa0,python3.9):2025-04-03-09:27:48.773.670 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.773.799 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.773.820 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:570] Finalize] Delete recv event loop
[INFO] DISTRIBUTED(618658,ffff4f7eefa0,python3.9):2025-04-03-09:27:48.773.888 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.774.028 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.774.057 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:584] Finalize] Delete connection pool.
[INFO] PIPELINE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.774.085 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:2619] FinalizeCluster] End finalize the cluster instance.
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.774.106 [mindspore/ccsrc/pybind_api/resource/manager.cc:259] ClearResAtexit] Pipeline clear all resource
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.774.295 [context.cpp:72]618658 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.774.321 [api_impl.cc:3717] 618658 ContextSetCurrent: set context=aaab0b9e09a0, flag=0.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.774.341 [context.cpp:80]618658 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.774.376 [stream.cpp:131]618658 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.774.400 [api_impl.cc:1394] 618658 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.774.422 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.774.441 [stream.cc:2886] 618658 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.774.460 [api_error.cc:895] 618658 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.774.472 [stream.cpp:146]618658 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.774.491 [stream.cpp:131]618658 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.774.521 [api_impl.cc:1394] 618658 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.774.535 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.774.549 [stream.cc:2886] 618658 StarsWaitForTask: No.0 stream_id=3, taskId=0, currentId=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.774.566 [api_error.cc:895] 618658 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.774.578 [stream.cpp:146]618658 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.774.601 [stream.cpp:131]618658 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.774.622 [api_impl.cc:1394] 618658 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.774.635 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.774.653 [stream.cc:2886] 618658 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.774.665 [api_error.cc:895] 618658 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.774.678 [stream.cpp:146]618658 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.774.695 [stream.cpp:131]618658 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.774.715 [api_impl.cc:1394] 618658 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.774.728 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.774.740 [stream.cc:2886] 618658 StarsWaitForTask: No.0 stream_id=3, taskId=0, currentId=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.774.754 [api_error.cc:895] 618658 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.774.769 [stream.cpp:146]618658 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.774.813 [mindspore/ccsrc/pybind_api/resource/manager.cc:82] RecordExitStatus] Status record: system exit.
[INFO] DEBUG(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.774.884 [mindspore/ccsrc/common/debug/env_config_parser.cc:152] ParseFromFile] The 'env_config_path' in 'mindspore.context.set_context(env_config_path={path})' is empty.
[INFO] ME(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.774.942 [mindspore/core/mindrt/src/actor/actormgr.cc:165] Finalize] mindrt Actors finish exiting.
[INFO] ME(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.774.961 [mindspore/core/mindrt/src/actor/actormgr.cc:168] Finalize] mindrt Threads finish exiting.
[INFO] ME(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.774.980 [mindspore/core/mindrt/src/actor/actormgr.cc:179] Finalize] mindrt IOMGRS finish exiting.
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.775.158 [mindspore/ccsrc/pybind_api/resource/manager.cc:134] ClearResPart1] Start Finalize StreamSynchronizer...
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.775.180 [mindspore/ccsrc/pybind_api/resource/manager.cc:136] ClearResPart1] End Finalize StreamSynchronizer...
[INFO] PIPELINE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.775.896 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:1000] ClearInfo] Clean graph resource!
[INFO] PIPELINE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.775.923 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:1000] ClearInfo] Clean graph resource!
[INFO] PIPELINE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.775.942 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:995] ClearRes] Clean Graph executor resource!
[INFO] PIPELINE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.775.971 [mindspore/ccsrc/pipeline/jit/ps/pipeline_jit.cc:426] ClearRes] Clean JIT executor resource!
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.775.989 [mindspore/ccsrc/pybind_api/resource/manager.cc:155] ClearResPart2] Start clear PyNativeExecutor...
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.776.264 [mindspore/ccsrc/pybind_api/resource/manager.cc:157] ClearResPart2] End clear PyNativeExecutor.
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.776.289 [mindspore/ccsrc/pybind_api/resource/manager.cc:159] ClearResPart2] Start clear ConfigManager...
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.776.308 [mindspore/ccsrc/pybind_api/resource/manager.cc:161] ClearResPart2] End clear ConfigManager.
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.776.363 [mindspore/ccsrc/common/thread_pool.cc:41] ThreadPool] Set max_thread_num_ to 4
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.776.383 [mindspore/ccsrc/pybind_api/resource/manager.cc:165] ClearResPart2] Start clear device context...
[INFO] ME(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.776.403 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:401] ClearDeviceContexts] Release device Ascend_3
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.780.737 [runtime.cc:5239] 618834 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:48.780.773 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618834] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:48.780.796 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618834] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:48.780.811 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618834] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.780.862 [runtime.cc:3077] 618834 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=0, devId=0, tdt status=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:48.780.971 [npu_driver.cc:551] 618834 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] GE_ADPT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.783.968 [mindspore/ccsrc/backend/ge_backend/graph_ir/df_graph_manager.cc:154] ClearGraph] Remove all graphs in GraphManager
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.784.003 [mindspore/ccsrc/backend/ge_backend/executor/ge_graph_executor.cc:1440] UnregisterExternalAllocator] The graph_runner is not exist
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.784.051 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:178] ReleaseDeviceRes] Ascend finalize start
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.784.068 [context.cpp:72]618658 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.784.092 [api_impl.cc:3717] 618658 ContextSetCurrent: set context=aaab0b9e09a0, flag=0.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.784.110 [context.cpp:80]618658 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.784.125 [context.cpp:72]618658 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.784.141 [api_impl.cc:3717] 618658 ContextSetCurrent: set context=aaab0b9e09a0, flag=0.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.784.153 [context.cpp:80]618658 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.784.195 [device.cpp:143]618658 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.784.218 [api_impl.cc:2999] 618658 SetDevice: device_id=3, deviceMode=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.784.234 [device.cc:306] 618658 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.784.248 [runtime.cc:3393] 618658 PrimaryContextRetain: Context inc ref, ts_id=0, count=0xb
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.784.267 [runtime.cc:3560] 618658 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.784.285 [api_impl.cc:2987] 618658 NewDevice: SetCurRef = 0xaaab0b9e09a0,userDeviceId=3,deviceId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.784.298 [runtime.cc:5239] 618658 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.784.317 [api_impl.cc:2992] 618658 NewDevice: New device success, user_device_id=3, die_num=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.784.345 [api_impl.cc:3025] 618658 SetDevice: SetDevice success, curCtx=0xaaab0b9e09a0, user_device_id=3.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.784.360 [acl.cpp:115]618658 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.784.377 [acl.cpp:121]618658 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.784.406 [device.cpp:154]618658 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 3
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.784.434 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:46] DestroyHandlerByName] Destroy watch dog thread by group name: hccl_world_group
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:48.804.192 [trs_cb_event.c:119][ascend][curpid:618674,618819][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =65; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:48.804.224 [trs_sqcq.c:1491][ascend][curpid:618674,618819][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:48.804.197 [trs_cb_event.c:119][ascend][curpid:618662,618817][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =833; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:48.804.229 [trs_sqcq.c:1491][ascend][curpid:618662,618817][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:48.804.243 [npu_driver.cc:3833] 618819 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:48.804.250 [npu_driver.cc:3833] 618817 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=833, drvRetCode=16.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:48.804.259 [api_impl.cc:5058] 618819 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:48.804.268 [api_impl.cc:5058] 618817 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.804.276 [callback.cpp:132]618819 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.804.294 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.804.290 [callback.cpp:132]618817 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.804.313 [npu_driver.cc:3828] 618819 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=65.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.804.309 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.804.343 [npu_driver.cc:3828] 618817 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=833.
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.818.071 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:132] Finalize] The compute graph node has been unregistered successfully.
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.818.168 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:563] Finalize] Delete send event loop
[INFO] DISTRIBUTED(618666,ffff2da55fa0,python3.9):2025-04-03-09:27:48.818.263 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.818.357 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.818.379 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:570] Finalize] Delete recv event loop
[INFO] DISTRIBUTED(618666,ffff2e265fa0,python3.9):2025-04-03-09:27:48.818.433 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.818.531 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.818.551 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:584] Finalize] Delete connection pool.
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.818.609 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:563] Finalize] Delete send event loop
[INFO] DISTRIBUTED(618666,ffff2ca35fa0,python3.9):2025-04-03-09:27:48.818.701 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.818.829 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.818.850 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:570] Finalize] Delete recv event loop
[INFO] DISTRIBUTED(618666,ffff2d245fa0,python3.9):2025-04-03-09:27:48.818.905 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.819.030 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.819.051 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:584] Finalize] Delete connection pool.
[INFO] PIPELINE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.819.076 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:2619] FinalizeCluster] End finalize the cluster instance.
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.819.097 [mindspore/ccsrc/pybind_api/resource/manager.cc:259] ClearResAtexit] Pipeline clear all resource
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.819.213 [context.cpp:72]618666 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.819.237 [api_impl.cc:3717] 618666 ContextSetCurrent: set context=aaaaf6e2dcc0, flag=0.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.819.254 [context.cpp:80]618666 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.819.277 [stream.cpp:131]618666 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.819.297 [api_impl.cc:1394] 618666 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.819.315 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.819.332 [stream.cc:2886] 618666 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.819.348 [api_error.cc:895] 618666 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.819.364 [stream.cpp:146]618666 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.819.414 [stream.cpp:131]618666 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.819.435 [api_impl.cc:1394] 618666 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.819.449 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.819.465 [stream.cc:2886] 618666 StarsWaitForTask: No.0 stream_id=3, taskId=0, currentId=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.819.479 [api_error.cc:895] 618666 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.819.494 [stream.cpp:146]618666 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.819.515 [stream.cpp:131]618666 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.819.534 [api_impl.cc:1394] 618666 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.819.547 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.819.561 [stream.cc:2886] 618666 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.819.574 [api_error.cc:895] 618666 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.819.587 [stream.cpp:146]618666 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.819.600 [stream.cpp:131]618666 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.819.616 [api_impl.cc:1394] 618666 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.819.629 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.819.645 [stream.cc:2886] 618666 StarsWaitForTask: No.0 stream_id=3, taskId=0, currentId=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.819.658 [api_error.cc:895] 618666 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.819.670 [stream.cpp:146]618666 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.819.698 [mindspore/ccsrc/pybind_api/resource/manager.cc:82] RecordExitStatus] Status record: system exit.
[INFO] DEBUG(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.819.744 [mindspore/ccsrc/common/debug/env_config_parser.cc:152] ParseFromFile] The 'env_config_path' in 'mindspore.context.set_context(env_config_path={path})' is empty.
[INFO] ME(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.819.777 [mindspore/core/mindrt/src/actor/actormgr.cc:165] Finalize] mindrt Actors finish exiting.
[INFO] ME(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.819.795 [mindspore/core/mindrt/src/actor/actormgr.cc:168] Finalize] mindrt Threads finish exiting.
[INFO] ME(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.819.810 [mindspore/core/mindrt/src/actor/actormgr.cc:179] Finalize] mindrt IOMGRS finish exiting.
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.819.864 [mindspore/ccsrc/pybind_api/resource/manager.cc:134] ClearResPart1] Start Finalize StreamSynchronizer...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.819.884 [mindspore/ccsrc/pybind_api/resource/manager.cc:136] ClearResPart1] End Finalize StreamSynchronizer...
[INFO] PIPELINE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.820.408 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:1000] ClearInfo] Clean graph resource!
[INFO] PIPELINE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.820.445 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:1000] ClearInfo] Clean graph resource!
[INFO] PIPELINE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.820.465 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:995] ClearRes] Clean Graph executor resource!
[INFO] PIPELINE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.820.483 [mindspore/ccsrc/pipeline/jit/ps/pipeline_jit.cc:426] ClearRes] Clean JIT executor resource!
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.820.500 [mindspore/ccsrc/pybind_api/resource/manager.cc:155] ClearResPart2] Start clear PyNativeExecutor...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.820.748 [mindspore/ccsrc/pybind_api/resource/manager.cc:157] ClearResPart2] End clear PyNativeExecutor.
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.820.772 [mindspore/ccsrc/pybind_api/resource/manager.cc:159] ClearResPart2] Start clear ConfigManager...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.820.788 [mindspore/ccsrc/pybind_api/resource/manager.cc:161] ClearResPart2] End clear ConfigManager.
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.820.853 [mindspore/ccsrc/common/thread_pool.cc:41] ThreadPool] Set max_thread_num_ to 4
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.820.872 [mindspore/ccsrc/pybind_api/resource/manager.cc:165] ClearResPart2] Start clear device context...
[INFO] ME(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.820.889 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:401] ClearDeviceContexts] Release device Ascend_5
[INFO] GE_ADPT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.822.618 [mindspore/ccsrc/backend/ge_backend/graph_ir/df_graph_manager.cc:154] ClearGraph] Remove all graphs in GraphManager
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.822.648 [mindspore/ccsrc/backend/ge_backend/executor/ge_graph_executor.cc:1440] UnregisterExternalAllocator] The graph_runner is not exist
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.822.669 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:178] ReleaseDeviceRes] Ascend finalize start
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.822.683 [context.cpp:72]618666 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.822.705 [api_impl.cc:3717] 618666 ContextSetCurrent: set context=aaaaf6e2dcc0, flag=0.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.822.721 [context.cpp:80]618666 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.822.737 [context.cpp:72]618666 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.822.754 [api_impl.cc:3717] 618666 ContextSetCurrent: set context=aaaaf6e2dcc0, flag=0.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.822.771 [context.cpp:80]618666 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.822.790 [device.cpp:143]618666 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.822.812 [api_impl.cc:2999] 618666 SetDevice: device_id=5, deviceMode=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.822.826 [device.cc:306] 618666 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.822.842 [runtime.cc:3393] 618666 PrimaryContextRetain: Context inc ref, ts_id=0, count=0xb
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.822.856 [runtime.cc:3560] 618666 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.822.870 [api_impl.cc:2987] 618666 NewDevice: SetCurRef = 0xaaaaf6e2dcc0,userDeviceId=5,deviceId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.822.886 [runtime.cc:5239] 618666 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.822.917 [api_impl.cc:2992] 618666 NewDevice: New device success, user_device_id=5, die_num=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.822.933 [api_impl.cc:3025] 618666 SetDevice: SetDevice success, curCtx=0xaaaaf6e2dcc0, user_device_id=5.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.822.949 [acl.cpp:115]618666 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.822.961 [acl.cpp:121]618666 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.822.974 [device.cpp:154]618666 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 5
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.823.001 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:46] DestroyHandlerByName] Destroy watch dog thread by group name: hccl_world_group
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:48.836.183 [trs_cb_event.c:119][ascend][curpid:618670,618823][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =65; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:48.836.212 [trs_sqcq.c:1491][ascend][curpid:618670,618823][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:48.836.226 [npu_driver.cc:3833] 618823 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:48.836.243 [api_impl.cc:5058] 618823 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.836.259 [callback.cpp:132]618823 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.836.274 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.836.308 [npu_driver.cc:3828] 618823 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=65.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:48.866.769 [awatchdog_monitor.c:160](tid:618693) thread 619018 not exist
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:48.868.174 [trs_cb_event.c:119][ascend][curpid:618670,618822][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =64; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:48.868.203 [trs_sqcq.c:1491][ascend][curpid:618670,618822][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:48.868.180 [trs_cb_event.c:119][ascend][curpid:618658,618774][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =64; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:48.868.209 [trs_sqcq.c:1491][ascend][curpid:618658,618774][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:48.868.178 [trs_cb_event.c:119][ascend][curpid:618666,618808][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =64; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:48.868.213 [trs_sqcq.c:1491][ascend][curpid:618666,618808][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:48.868.221 [npu_driver.cc:3833] 618822 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=64, drvRetCode=16.
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:48.868.191 [trs_cb_event.c:119][ascend][curpid:618650,618828][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =320; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:48.868.239 [trs_sqcq.c:1491][ascend][curpid:618650,618828][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:48.868.231 [npu_driver.cc:3833] 618774 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:48.868.233 [npu_driver.cc:3833] 618808 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:48.868.236 [api_impl.cc:5058] 618822 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.868.252 [callback.cpp:132]618822 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:48.868.261 [npu_driver.cc:3833] 618828 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=320, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:48.868.244 [api_impl.cc:5058] 618774 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.868.259 [callback.cpp:132]618774 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:48.868.270 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.868.282 [npu_driver.cc:3828] 618774 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=64.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:48.868.249 [api_impl.cc:5058] 618808 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.868.264 [callback.cpp:132]618808 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:48.868.279 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.868.266 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.868.281 [npu_driver.cc:3828] 618822 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=64.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:48.868.279 [api_impl.cc:5058] 618828 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.868.308 [callback.cpp:132]618828 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:48.868.293 [npu_driver.cc:3828] 618808 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=64.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.868.328 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.868.345 [npu_driver.cc:3828] 618828 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=320.
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.886.022 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:132] Finalize] The compute graph node has been unregistered successfully.
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.886.117 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:563] Finalize] Delete send event loop
[INFO] DISTRIBUTED(618674,ffff2b043fa0,python3.9):2025-04-03-09:27:48.886.237 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.886.337 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.886.360 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:570] Finalize] Delete recv event loop
[INFO] DISTRIBUTED(618674,ffff2b853fa0,python3.9):2025-04-03-09:27:48.886.421 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.886.498 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.886.519 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:584] Finalize] Delete connection pool.
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.886.578 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:563] Finalize] Delete send event loop
[INFO] DISTRIBUTED(618674,ffff2a023fa0,python3.9):2025-04-03-09:27:48.886.654 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.886.765 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.886.786 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:570] Finalize] Delete recv event loop
[INFO] DISTRIBUTED(618674,ffff2a833fa0,python3.9):2025-04-03-09:27:48.886.831 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.886.915 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.886.936 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:584] Finalize] Delete connection pool.
[INFO] PIPELINE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.886.963 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:2619] FinalizeCluster] End finalize the cluster instance.
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.886.985 [mindspore/ccsrc/pybind_api/resource/manager.cc:259] ClearResAtexit] Pipeline clear all resource
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.887.121 [context.cpp:72]618674 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.887.148 [api_impl.cc:3717] 618674 ContextSetCurrent: set context=aaab0103b880, flag=0.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.887.168 [context.cpp:80]618674 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.887.202 [stream.cpp:131]618674 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.887.223 [api_impl.cc:1394] 618674 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.887.244 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.887.262 [stream.cc:2886] 618674 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.887.280 [api_error.cc:895] 618674 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.887.296 [stream.cpp:146]618674 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.887.313 [stream.cpp:131]618674 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.887.333 [api_impl.cc:1394] 618674 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.887.360 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.887.379 [stream.cc:2886] 618674 StarsWaitForTask: No.0 stream_id=3, taskId=0, currentId=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.887.394 [api_error.cc:895] 618674 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.887.408 [stream.cpp:146]618674 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.887.430 [stream.cpp:131]618674 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.887.450 [api_impl.cc:1394] 618674 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.887.468 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.887.485 [stream.cc:2886] 618674 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.887.499 [api_error.cc:895] 618674 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.887.514 [stream.cpp:146]618674 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.887.526 [stream.cpp:131]618674 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.887.545 [api_impl.cc:1394] 618674 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.887.557 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.887.572 [stream.cc:2886] 618674 StarsWaitForTask: No.0 stream_id=3, taskId=0, currentId=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.887.587 [api_error.cc:895] 618674 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.887.598 [stream.cpp:146]618674 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.887.629 [mindspore/ccsrc/pybind_api/resource/manager.cc:82] RecordExitStatus] Status record: system exit.
[INFO] DEBUG(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.887.680 [mindspore/ccsrc/common/debug/env_config_parser.cc:152] ParseFromFile] The 'env_config_path' in 'mindspore.context.set_context(env_config_path={path})' is empty.
[INFO] ME(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.887.717 [mindspore/core/mindrt/src/actor/actormgr.cc:165] Finalize] mindrt Actors finish exiting.
[INFO] ME(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.887.735 [mindspore/core/mindrt/src/actor/actormgr.cc:168] Finalize] mindrt Threads finish exiting.
[INFO] ME(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.887.754 [mindspore/core/mindrt/src/actor/actormgr.cc:179] Finalize] mindrt IOMGRS finish exiting.
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.887.819 [mindspore/ccsrc/pybind_api/resource/manager.cc:134] ClearResPart1] Start Finalize StreamSynchronizer...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.887.840 [mindspore/ccsrc/pybind_api/resource/manager.cc:136] ClearResPart1] End Finalize StreamSynchronizer...
[INFO] PIPELINE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.888.406 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:1000] ClearInfo] Clean graph resource!
[INFO] PIPELINE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.888.436 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:1000] ClearInfo] Clean graph resource!
[INFO] PIPELINE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.888.457 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:995] ClearRes] Clean Graph executor resource!
[INFO] PIPELINE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.888.486 [mindspore/ccsrc/pipeline/jit/ps/pipeline_jit.cc:426] ClearRes] Clean JIT executor resource!
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.888.505 [mindspore/ccsrc/pybind_api/resource/manager.cc:155] ClearResPart2] Start clear PyNativeExecutor...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.888.738 [mindspore/ccsrc/pybind_api/resource/manager.cc:157] ClearResPart2] End clear PyNativeExecutor.
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.888.763 [mindspore/ccsrc/pybind_api/resource/manager.cc:159] ClearResPart2] Start clear ConfigManager...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.888.781 [mindspore/ccsrc/pybind_api/resource/manager.cc:161] ClearResPart2] End clear ConfigManager.
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.888.837 [mindspore/ccsrc/common/thread_pool.cc:41] ThreadPool] Set max_thread_num_ to 4
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.888.857 [mindspore/ccsrc/pybind_api/resource/manager.cc:165] ClearResPart2] Start clear device context...
[INFO] ME(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.888.876 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:401] ClearDeviceContexts] Release device Ascend_7
[INFO] GE_ADPT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.890.764 [mindspore/ccsrc/backend/ge_backend/graph_ir/df_graph_manager.cc:154] ClearGraph] Remove all graphs in GraphManager
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.890.796 [mindspore/ccsrc/backend/ge_backend/executor/ge_graph_executor.cc:1440] UnregisterExternalAllocator] The graph_runner is not exist
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.890.837 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:178] ReleaseDeviceRes] Ascend finalize start
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.890.853 [context.cpp:72]618674 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.890.875 [api_impl.cc:3717] 618674 ContextSetCurrent: set context=aaab0103b880, flag=0.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.890.893 [context.cpp:80]618674 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.890.907 [context.cpp:72]618674 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.890.919 [api_impl.cc:3717] 618674 ContextSetCurrent: set context=aaab0103b880, flag=0.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.890.934 [context.cpp:80]618674 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.890.956 [device.cpp:143]618674 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.890.974 [api_impl.cc:2999] 618674 SetDevice: device_id=7, deviceMode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.890.990 [device.cc:306] 618674 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.891.005 [runtime.cc:3393] 618674 PrimaryContextRetain: Context inc ref, ts_id=0, count=0xb
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.891.023 [runtime.cc:3560] 618674 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.891.039 [api_impl.cc:2987] 618674 NewDevice: SetCurRef = 0xaaab0103b880,userDeviceId=7,deviceId=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.891.057 [runtime.cc:5239] 618674 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.891.077 [api_impl.cc:2992] 618674 NewDevice: New device success, user_device_id=7, die_num=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.891.106 [api_impl.cc:3025] 618674 SetDevice: SetDevice success, curCtx=0xaaab0103b880, user_device_id=7.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.891.120 [acl.cpp:115]618674 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.891.136 [acl.cpp:121]618674 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.891.151 [device.cpp:154]618674 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 7
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.891.178 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:46] DestroyHandlerByName] Destroy watch dog thread by group name: hccl_world_group
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.892.866 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:132] Finalize] The compute graph node has been unregistered successfully.
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.892.958 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:563] Finalize] Delete send event loop
[INFO] DISTRIBUTED(618662,ffff562f7fa0,python3.9):2025-04-03-09:27:48.893.057 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.893.165 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.893.189 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:570] Finalize] Delete recv event loop
[INFO] DISTRIBUTED(618662,ffff56b07fa0,python3.9):2025-04-03-09:27:48.893.252 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.893.338 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.893.358 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:584] Finalize] Delete connection pool.
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.893.425 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:563] Finalize] Delete send event loop
[INFO] DISTRIBUTED(618662,ffff552d7fa0,python3.9):2025-04-03-09:27:48.893.508 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.893.618 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.893.640 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:570] Finalize] Delete recv event loop
[INFO] DISTRIBUTED(618662,ffff55ae7fa0,python3.9):2025-04-03-09:27:48.893.723 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.893.870 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.893.897 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:584] Finalize] Delete connection pool.
[INFO] PIPELINE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.893.922 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:2619] FinalizeCluster] End finalize the cluster instance.
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.893.944 [mindspore/ccsrc/pybind_api/resource/manager.cc:259] ClearResAtexit] Pipeline clear all resource
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.894.106 [context.cpp:72]618662 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.894.131 [api_impl.cc:3717] 618662 ContextSetCurrent: set context=aaab087d6320, flag=0.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.894.150 [context.cpp:80]618662 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.894.184 [stream.cpp:131]618662 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.894.206 [api_impl.cc:1394] 618662 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.894.228 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.894.246 [stream.cc:2886] 618662 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.894.274 [api_error.cc:895] 618662 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.894.287 [stream.cpp:146]618662 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.894.307 [stream.cpp:131]618662 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.894.327 [api_impl.cc:1394] 618662 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.894.346 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.894.363 [stream.cc:2886] 618662 StarsWaitForTask: No.0 stream_id=3, taskId=0, currentId=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.894.378 [api_error.cc:895] 618662 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.894.393 [stream.cpp:146]618662 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.894.412 [stream.cpp:131]618662 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.894.432 [api_impl.cc:1394] 618662 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.894.448 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.894.464 [stream.cc:2886] 618662 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.894.481 [api_error.cc:895] 618662 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.894.493 [stream.cpp:146]618662 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.894.509 [stream.cpp:131]618662 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.894.529 [api_impl.cc:1394] 618662 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.894.542 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.894.558 [stream.cc:2886] 618662 StarsWaitForTask: No.0 stream_id=3, taskId=0, currentId=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.894.571 [api_error.cc:895] 618662 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.894.585 [stream.cpp:146]618662 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.894.632 [mindspore/ccsrc/pybind_api/resource/manager.cc:82] RecordExitStatus] Status record: system exit.
[INFO] DEBUG(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.894.702 [mindspore/ccsrc/common/debug/env_config_parser.cc:152] ParseFromFile] The 'env_config_path' in 'mindspore.context.set_context(env_config_path={path})' is empty.
[INFO] ME(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.894.759 [mindspore/core/mindrt/src/actor/actormgr.cc:165] Finalize] mindrt Actors finish exiting.
[INFO] ME(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.894.778 [mindspore/core/mindrt/src/actor/actormgr.cc:168] Finalize] mindrt Threads finish exiting.
[INFO] ME(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.894.796 [mindspore/core/mindrt/src/actor/actormgr.cc:179] Finalize] mindrt IOMGRS finish exiting.
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.894.966 [mindspore/ccsrc/pybind_api/resource/manager.cc:134] ClearResPart1] Start Finalize StreamSynchronizer...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.894.998 [mindspore/ccsrc/pybind_api/resource/manager.cc:136] ClearResPart1] End Finalize StreamSynchronizer...
[INFO] PIPELINE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.895.762 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:1000] ClearInfo] Clean graph resource!
[INFO] PIPELINE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.895.789 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:1000] ClearInfo] Clean graph resource!
[INFO] PIPELINE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.895.808 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:995] ClearRes] Clean Graph executor resource!
[INFO] PIPELINE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.895.827 [mindspore/ccsrc/pipeline/jit/ps/pipeline_jit.cc:426] ClearRes] Clean JIT executor resource!
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.895.846 [mindspore/ccsrc/pybind_api/resource/manager.cc:155] ClearResPart2] Start clear PyNativeExecutor...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.896.081 [mindspore/ccsrc/pybind_api/resource/manager.cc:157] ClearResPart2] End clear PyNativeExecutor.
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.896.104 [mindspore/ccsrc/pybind_api/resource/manager.cc:159] ClearResPart2] Start clear ConfigManager...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.896.122 [mindspore/ccsrc/pybind_api/resource/manager.cc:161] ClearResPart2] End clear ConfigManager.
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.896.187 [mindspore/ccsrc/common/thread_pool.cc:41] ThreadPool] Set max_thread_num_ to 4
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.896.209 [mindspore/ccsrc/pybind_api/resource/manager.cc:165] ClearResPart2] Start clear device context...
[INFO] ME(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.896.229 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:401] ClearDeviceContexts] Release device Ascend_4
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:48.900.182 [trs_cb_event.c:119][ascend][curpid:618674,618818][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =64; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:48.900.209 [trs_sqcq.c:1491][ascend][curpid:618674,618818][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:48.900.224 [npu_driver.cc:3833] 618818 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=64, drvRetCode=16.
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:48.900.194 [trs_cb_event.c:119][ascend][curpid:618662,618816][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =832; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:48.900.225 [trs_sqcq.c:1491][ascend][curpid:618662,618816][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:48.900.237 [api_impl.cc:5058] 618818 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:48.900.245 [npu_driver.cc:3833] 618816 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=832, drvRetCode=16.
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:48.900.196 [trs_cb_event.c:119][ascend][curpid:618654,618832][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =320; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:48.900.240 [trs_sqcq.c:1491][ascend][curpid:618654,618832][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.900.252 [callback.cpp:132]618818 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:48.900.260 [api_impl.cc:5058] 618816 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:48.900.258 [npu_driver.cc:3833] 618832 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=320, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:48.900.275 [api_impl.cc:5058] 618832 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:48.900.267 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.900.275 [callback.cpp:132]618816 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:48.900.281 [npu_driver.cc:3828] 618818 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=64.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.900.293 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.900.296 [callback.cpp:132]618832 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.900.310 [npu_driver.cc:3828] 618816 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=832.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:48.900.315 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:48.900.350 [npu_driver.cc:3828] 618832 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=320.
[INFO] GE_ADPT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.904.012 [mindspore/ccsrc/backend/ge_backend/graph_ir/df_graph_manager.cc:154] ClearGraph] Remove all graphs in GraphManager
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.904.044 [mindspore/ccsrc/backend/ge_backend/executor/ge_graph_executor.cc:1440] UnregisterExternalAllocator] The graph_runner is not exist
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.904.071 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:178] ReleaseDeviceRes] Ascend finalize start
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.904.087 [context.cpp:72]618662 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.904.109 [api_impl.cc:3717] 618662 ContextSetCurrent: set context=aaab087d6320, flag=0.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.904.137 [context.cpp:80]618662 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.904.150 [context.cpp:72]618662 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.904.181 [api_impl.cc:3717] 618662 ContextSetCurrent: set context=aaab087d6320, flag=0.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.904.198 [context.cpp:80]618662 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.904.217 [device.cpp:143]618662 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.904.231 [api_impl.cc:2999] 618662 SetDevice: device_id=4, deviceMode=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.904.241 [device.cc:306] 618662 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.904.251 [runtime.cc:3393] 618662 PrimaryContextRetain: Context inc ref, ts_id=0, count=0xb
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.904.268 [runtime.cc:3560] 618662 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.904.285 [api_impl.cc:2987] 618662 NewDevice: SetCurRef = 0xaaab087d6320,userDeviceId=4,deviceId=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.904.301 [runtime.cc:5239] 618662 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.904.321 [api_impl.cc:2992] 618662 NewDevice: New device success, user_device_id=4, die_num=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:48.904.339 [api_impl.cc:3025] 618662 SetDevice: SetDevice success, curCtx=0xaaab087d6320, user_device_id=4.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.904.358 [acl.cpp:115]618662 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.904.374 [acl.cpp:121]618662 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:48.904.390 [device.cpp:154]618662 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 4
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.904.417 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:46] DestroyHandlerByName] Destroy watch dog thread by group name: hccl_world_group
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.911.015 [mindspore/ccsrc/distributed/cluster/topology/compute_graph_node.cc:132] Finalize] The compute graph node has been unregistered successfully.
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.911.098 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:563] Finalize] Delete send event loop
[INFO] DISTRIBUTED(618670,ffff4ac6cfa0,python3.9):2025-04-03-09:27:48.911.185 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.911.314 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.911.336 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:570] Finalize] Delete recv event loop
[INFO] DISTRIBUTED(618670,ffff4b47cfa0,python3.9):2025-04-03-09:27:48.911.393 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.911.463 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.911.482 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:584] Finalize] Delete connection pool.
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.911.532 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:563] Finalize] Delete send event loop
[INFO] DISTRIBUTED(618670,ffff49c4cfa0,python3.9):2025-04-03-09:27:48.911.611 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.911.718 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.911.739 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:570] Finalize] Delete recv event loop
[INFO] DISTRIBUTED(618670,ffff4a45cfa0,python3.9):2025-04-03-09:27:48.911.785 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:82] EventLoopRun] Event epoll loop run end
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.911.866 [mindspore/ccsrc/distributed/rpc/tcp/event_loop.cc:210] Finalize] Stop loop succ
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.911.887 [mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.cc:584] Finalize] Delete connection pool.
[INFO] PIPELINE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.911.909 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:2619] FinalizeCluster] End finalize the cluster instance.
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.911.941 [mindspore/ccsrc/pybind_api/resource/manager.cc:259] ClearResAtexit] Pipeline clear all resource
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.912.069 [context.cpp:72]618670 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.912.095 [api_impl.cc:3717] 618670 ContextSetCurrent: set context=aaaad9a630c0, flag=0.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.912.113 [context.cpp:80]618670 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.912.152 [stream.cpp:131]618670 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.912.210 [api_impl.cc:1394] 618670 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.912.230 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.912.248 [stream.cc:2886] 618670 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.912.263 [api_error.cc:895] 618670 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.912.278 [stream.cpp:146]618670 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.912.294 [stream.cpp:131]618670 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.912.314 [api_impl.cc:1394] 618670 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.912.327 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=3, head=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.912.343 [stream.cc:2886] 618670 StarsWaitForTask: No.0 stream_id=3, taskId=0, currentId=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.912.358 [api_error.cc:895] 618670 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.912.372 [stream.cpp:146]618670 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.912.395 [stream.cpp:131]618670 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.912.415 [api_impl.cc:1394] 618670 StreamSynchronize: stream_id=2.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.912.427 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=2, head=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.912.440 [stream.cc:2886] 618670 StarsWaitForTask: No.0 stream_id=2, taskId=5, currentId=5
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.912.453 [api_error.cc:895] 618670 StreamSynchronize: stream synchronize exit, stream_id=2, result=0x0
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.912.467 [stream.cpp:146]618670 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.912.479 [stream.cpp:131]618670 aclrtSynchronizeStreamWithTimeout: start to execute aclrtSynchronizeStreamWithTimeout, timeout = -1ms
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.912.493 [api_impl.cc:1394] 618670 StreamSynchronize: stream_id=3.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.912.508 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=3, head=1.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:48.912.490 [awatchdog_monitor.c:160](tid:618687) thread 619017 not exist
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.912.522 [stream.cc:2886] 618670 StarsWaitForTask: No.0 stream_id=3, taskId=0, currentId=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.912.538 [api_error.cc:895] 618670 StreamSynchronize: stream synchronize exit, stream_id=3, result=0x0
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.912.550 [stream.cpp:146]618670 aclrtSynchronizeStreamWithTimeout: Synchronize stream with timeout success
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.912.611 [mindspore/ccsrc/pybind_api/resource/manager.cc:82] RecordExitStatus] Status record: system exit.
[INFO] DEBUG(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.912.675 [mindspore/ccsrc/common/debug/env_config_parser.cc:152] ParseFromFile] The 'env_config_path' in 'mindspore.context.set_context(env_config_path={path})' is empty.
[INFO] ME(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.912.740 [mindspore/core/mindrt/src/actor/actormgr.cc:165] Finalize] mindrt Actors finish exiting.
[INFO] ME(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.912.759 [mindspore/core/mindrt/src/actor/actormgr.cc:168] Finalize] mindrt Threads finish exiting.
[INFO] ME(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.912.779 [mindspore/core/mindrt/src/actor/actormgr.cc:179] Finalize] mindrt IOMGRS finish exiting.
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.912.977 [mindspore/ccsrc/pybind_api/resource/manager.cc:134] ClearResPart1] Start Finalize StreamSynchronizer...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.913.001 [mindspore/ccsrc/pybind_api/resource/manager.cc:136] ClearResPart1] End Finalize StreamSynchronizer...
[INFO] PIPELINE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.913.825 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:1000] ClearInfo] Clean graph resource!
[INFO] PIPELINE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.913.851 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:1000] ClearInfo] Clean graph resource!
[INFO] PIPELINE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.913.870 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:995] ClearRes] Clean Graph executor resource!
[INFO] PIPELINE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.913.888 [mindspore/ccsrc/pipeline/jit/ps/pipeline_jit.cc:426] ClearRes] Clean JIT executor resource!
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.913.908 [mindspore/ccsrc/pybind_api/resource/manager.cc:155] ClearResPart2] Start clear PyNativeExecutor...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.914.216 [mindspore/ccsrc/pybind_api/resource/manager.cc:157] ClearResPart2] End clear PyNativeExecutor.
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.914.239 [mindspore/ccsrc/pybind_api/resource/manager.cc:159] ClearResPart2] Start clear ConfigManager...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.914.257 [mindspore/ccsrc/pybind_api/resource/manager.cc:161] ClearResPart2] End clear ConfigManager.
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.914.322 [mindspore/ccsrc/common/thread_pool.cc:41] ThreadPool] Set max_thread_num_ to 4
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.914.342 [mindspore/ccsrc/pybind_api/resource/manager.cc:165] ClearResPart2] Start clear device context...
[INFO] ME(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.914.361 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:401] ClearDeviceContexts] Release device Ascend_6
[INFO] GE_ADPT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.923.435 [mindspore/ccsrc/backend/ge_backend/graph_ir/df_graph_manager.cc:154] ClearGraph] Remove all graphs in GraphManager
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.923.469 [mindspore/ccsrc/backend/ge_backend/executor/ge_graph_executor.cc:1440] UnregisterExternalAllocator] The graph_runner is not exist
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.923.509 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:178] ReleaseDeviceRes] Ascend finalize start
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.923.526 [context.cpp:72]618670 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.923.549 [api_impl.cc:3717] 618670 ContextSetCurrent: set context=aaaad9a630c0, flag=0.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.923.567 [context.cpp:80]618670 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.923.592 [context.cpp:72]618670 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.923.606 [api_impl.cc:3717] 618670 ContextSetCurrent: set context=aaaad9a630c0, flag=0.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.923.620 [context.cpp:80]618670 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.923.649 [device.cpp:143]618670 aclrtSetDevice: start to execute aclrtSetDevice, deviceId = 6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.923.671 [api_impl.cc:2999] 618670 SetDevice: device_id=6, deviceMode=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.923.688 [device.cc:306] 618670 Init: device mode has been already set, mode=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.923.702 [runtime.cc:3393] 618670 PrimaryContextRetain: Context inc ref, ts_id=0, count=0xb
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.923.731 [runtime.cc:3560] 618670 MsProfNotifyWhenSetDevice: MsprofNotifySetDevice success, devId=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.923.748 [api_impl.cc:2987] 618670 NewDevice: SetCurRef = 0xaaaad9a630c0,userDeviceId=6,deviceId=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.923.766 [runtime.cc:5239] 618670 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.923.787 [api_impl.cc:2992] 618670 NewDevice: New device success, user_device_id=6, die_num=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.923.805 [api_impl.cc:3025] 618670 SetDevice: SetDevice success, curCtx=0xaaaad9a630c0, user_device_id=6.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.923.823 [acl.cpp:115]618670 InitSocVersion: get SocVersion success, SocVersion = Ascend910B3
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.923.840 [acl.cpp:121]618670 GetSocVersion: socVersion is Ascend910B3
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:48.923.855 [device.cpp:154]618670 aclrtSetDevice: successfully execute aclrtSetDevice, deviceId = 6
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.923.880 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:46] DestroyHandlerByName] Destroy watch dog thread by group name: hccl_world_group
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:48.932.202 [trs_cb_event.c:119][ascend][curpid:618650,618829][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =321; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:48.932.228 [trs_sqcq.c:1491][ascend][curpid:618650,618829][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:48.932.240 [npu_driver.cc:3833] 618829 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:48.932.251 [api_impl.cc:5058] 618829 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.932.263 [callback.cpp:132]618829 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:48.932.275 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.932.288 [npu_driver.cc:3828] 618829 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=321.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:48.940.695 [awatchdog_monitor.c:160](tid:618698) thread 619019 not exist
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:48.960.201 [awatchdog_monitor.c:160](tid:618689) thread 619021 not exist
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.972.741 [runtime.cc:5239] 618820 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:48.972.768 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618820] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:48.972.787 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618820] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.972.756 [runtime.cc:5239] 618772 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:48.972.803 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618820] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.972.781 [runtime.cc:5239] 618826 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:48.972.797 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618772] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:48.972.810 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618826] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:48.972.824 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618826] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:48.972.822 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618772] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.972.830 [runtime.cc:3077] 618820 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=6, devId=6, tdt status=0
[INFO] TDT(618658,python3.9):2025-04-03-09:27:48.972.842 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618772] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:48.972.840 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618826] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.972.858 [runtime.cc:3077] 618826 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=1, devId=1, tdt status=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.972.870 [runtime.cc:3077] 618772 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=3, devId=3, tdt status=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:48.972.919 [npu_driver.cc:551] 618820 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:48.972.931 [npu_driver.cc:551] 618826 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:48.972.986 [npu_driver.cc:551] 618772 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.004.731 [runtime.cc:5239] 618812 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.004.706 [runtime.cc:5239] 618830 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:49.004.749 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618830] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.004.731 [runtime.cc:5239] 618806 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:49.004.755 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618812] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:49.004.769 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618812] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.004.733 [runtime.cc:5239] 618814 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:49.004.773 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618814] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:49.004.769 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618830] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:49.004.793 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618814] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:49.004.766 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618806] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:49.004.788 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618806] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:49.004.782 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618812] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:49.004.803 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618806] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:49.004.785 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618830] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.004.808 [runtime.cc:3077] 618830 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=2, devId=2, tdt status=0
[INFO] TDT(618662,python3.9):2025-04-03-09:27:49.004.808 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618814] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.004.802 [runtime.cc:3077] 618812 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=7, devId=7, tdt status=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.004.827 [runtime.cc:3077] 618806 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=5, devId=5, tdt status=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.004.833 [runtime.cc:3077] 618814 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=4, devId=4, tdt status=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.004.861 [npu_driver.cc:551] 618812 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.004.888 [npu_driver.cc:551] 618830 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.004.910 [npu_driver.cc:551] 618814 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.004.913 [npu_driver.cc:551] 618806 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:49.028.179 [trs_cb_event.c:119][ascend][curpid:618654,618833][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =321; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:49.028.206 [trs_sqcq.c:1491][ascend][curpid:618654,618833][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:49.028.178 [queue_client_comm.c:114][ascend][curpid:618658,618789][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:49.028.185 [queue_client_comm.c:114][ascend][curpid:618658,618781][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:49.028.190 [queue_client_comm.c:114][ascend][curpid:618658,618783][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.028.228 [npu_driver.cc:3833] 618833 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.028.243 [api_impl.cc:5058] 618833 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:49.028.256 [queue_client_comm.c:114][ascend][curpid:618658,618779][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.028.258 [callback.cpp:132]618833 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.028.275 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.028.288 [npu_driver.cc:3828] 618833 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=321.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.028.323 [npu_driver.cc:4338] 618789 MemQueuePeek: queue empty
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:49.028.319 [queue_client_comm.c:114][ascend][curpid:618658,618785][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.028.351 [npu_driver.cc:4338] 618781 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.028.360 [tensor_data_transfer.cpp:612]618789 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_histogram_summary
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.028.381 [npu_driver.cc:4338] 618783 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.028.381 [tensor_data_transfer.cpp:612]618781 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_tensor_dump
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.028.390 [tensor_data_transfer.cpp:1054]618789 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_histogram_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.028.400 [tensor_data_transfer.cpp:612]618783 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_tensor_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.028.407 [tensor_data_transfer.cpp:1054]618781 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_tensor_dump
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.028.411 [tensor_data_transfer.cpp:1056]618789 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.028.412 [npu_driver.cc:4338] 618779 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.028.421 [tensor_data_transfer.cpp:1054]618783 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_tensor_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.028.426 [tensor_data_transfer.cpp:1056]618781 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.028.434 [api_impl.cc:6121] 618789 MemQueuePeek: Start to peek queue on devId 3, qid is 5.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.028.444 [tensor_data_transfer.cpp:612]618779 acltdtReceiveTensorV2: queue is empty, device is 3, name is _npu_log
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.028.447 [tensor_data_transfer.cpp:1056]618783 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.028.456 [api_impl.cc:6121] 618781 MemQueuePeek: Start to peek queue on devId 3, qid is 1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.028.459 [npu_driver.cc:4330] 618789 MemQueuePeek: peek mem queue, deviceId=3, qid=5, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.028.469 [tensor_data_transfer.cpp:1054]618779 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is _npu_log
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.028.470 [npu_driver.cc:4338] 618785 MemQueuePeek: queue empty
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.028.474 [api_impl.cc:6121] 618783 MemQueuePeek: Start to peek queue on devId 3, qid is 2.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.028.481 [npu_driver.cc:4330] 618781 MemQueuePeek: peek mem queue, deviceId=3, qid=1, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.028.493 [tensor_data_transfer.cpp:1056]618779 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.028.510 [tensor_data_transfer.cpp:612]618785 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_image_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.028.517 [npu_driver.cc:4330] 618783 MemQueuePeek: peek mem queue, deviceId=3, qid=2, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.028.531 [api_impl.cc:6121] 618779 MemQueuePeek: Start to peek queue on devId 3, qid is 0.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.028.543 [tensor_data_transfer.cpp:1054]618785 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_image_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.028.559 [npu_driver.cc:4330] 618779 MemQueuePeek: peek mem queue, deviceId=3, qid=0, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.028.588 [tensor_data_transfer.cpp:1056]618785 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.028.612 [api_impl.cc:6121] 618785 MemQueuePeek: Start to peek queue on devId 3, qid is 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.028.629 [npu_driver.cc:4330] 618785 MemQueuePeek: peek mem queue, deviceId=3, qid=3, timeout=800.
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:49.029.859 [queue_client_comm.c:114][ascend][curpid:618658,618787][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.029.964 [npu_driver.cc:4338] 618787 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.029.981 [tensor_data_transfer.cpp:612]618787 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_scalar_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.029.996 [tensor_data_transfer.cpp:1054]618787 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_scalar_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.030.009 [tensor_data_transfer.cpp:1056]618787 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.030.019 [api_impl.cc:6121] 618787 MemQueuePeek: Start to peek queue on devId 3, qid is 4.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.030.028 [npu_driver.cc:4330] 618787 MemQueuePeek: peek mem queue, deviceId=3, qid=4, timeout=800.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:49.054.764 [awatchdog_monitor.c:160](tid:618694) thread 619015 not exist
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:49.092.171 [queue_client_comm.c:114][ascend][curpid:618666,618851][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:49.092.176 [queue_client_comm.c:114][ascend][curpid:618666,618843][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:49.092.176 [queue_client_comm.c:114][ascend][curpid:618666,618847][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:49.092.180 [queue_client_comm.c:114][ascend][curpid:618666,618841][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:49.092.182 [queue_client_comm.c:114][ascend][curpid:618666,618849][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:49.092.196 [queue_client_comm.c:114][ascend][curpid:618666,618845][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.092.271 [npu_driver.cc:4338] 618851 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.092.291 [tensor_data_transfer.cpp:612]618851 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_histogram_summary
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.092.297 [npu_driver.cc:4338] 618843 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.092.307 [tensor_data_transfer.cpp:1054]618851 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_histogram_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.092.314 [tensor_data_transfer.cpp:612]618843 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_tensor_dump
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.092.320 [tensor_data_transfer.cpp:1056]618851 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.092.329 [tensor_data_transfer.cpp:1054]618843 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_tensor_dump
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.092.329 [npu_driver.cc:4338] 618847 MemQueuePeek: queue empty
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.092.334 [api_impl.cc:6121] 618851 MemQueuePeek: Start to peek queue on devId 5, qid is 5.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.092.343 [tensor_data_transfer.cpp:1056]618843 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.092.353 [npu_driver.cc:4338] 618841 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.092.353 [tensor_data_transfer.cpp:612]618847 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_image_summary
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.092.357 [npu_driver.cc:4330] 618851 MemQueuePeek: peek mem queue, deviceId=5, qid=5, timeout=800.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.092.362 [api_impl.cc:6121] 618843 MemQueuePeek: Start to peek queue on devId 5, qid is 1.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.092.371 [tensor_data_transfer.cpp:612]618841 acltdtReceiveTensorV2: queue is empty, device is 5, name is _npu_log
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.092.380 [tensor_data_transfer.cpp:1054]618847 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_image_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.092.400 [tensor_data_transfer.cpp:1054]618841 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is _npu_log
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.092.417 [tensor_data_transfer.cpp:1056]618841 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.092.388 [npu_driver.cc:4338] 618849 MemQueuePeek: queue empty
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.092.391 [npu_driver.cc:4330] 618843 MemQueuePeek: peek mem queue, deviceId=5, qid=1, timeout=800.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.092.408 [tensor_data_transfer.cpp:1056]618847 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.092.422 [npu_driver.cc:4338] 618845 MemQueuePeek: queue empty
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.092.431 [api_impl.cc:6121] 618841 MemQueuePeek: Start to peek queue on devId 5, qid is 0.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.092.438 [tensor_data_transfer.cpp:612]618849 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_scalar_summary
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.092.453 [api_impl.cc:6121] 618847 MemQueuePeek: Start to peek queue on devId 5, qid is 3.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.092.463 [tensor_data_transfer.cpp:612]618845 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_tensor_summary
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.092.483 [npu_driver.cc:4330] 618841 MemQueuePeek: peek mem queue, deviceId=5, qid=0, timeout=800.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.092.503 [tensor_data_transfer.cpp:1054]618849 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_scalar_summary
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.092.510 [npu_driver.cc:4330] 618847 MemQueuePeek: peek mem queue, deviceId=5, qid=3, timeout=800.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.092.520 [tensor_data_transfer.cpp:1054]618845 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_tensor_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.092.530 [tensor_data_transfer.cpp:1056]618849 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.092.546 [tensor_data_transfer.cpp:1056]618845 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.092.584 [api_impl.cc:6121] 618849 MemQueuePeek: Start to peek queue on devId 5, qid is 4.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.092.590 [api_impl.cc:6121] 618845 MemQueuePeek: Start to peek queue on devId 5, qid is 2.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.092.598 [npu_driver.cc:4330] 618849 MemQueuePeek: peek mem queue, deviceId=5, qid=4, timeout=800.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.092.603 [npu_driver.cc:4330] 618845 MemQueuePeek: peek mem queue, deviceId=5, qid=2, timeout=800.
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:49.124.176 [trs_cb_event.c:119][ascend][curpid:618646,618837][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =65; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:49.124.203 [trs_sqcq.c:1491][ascend][curpid:618646,618837][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.124.216 [npu_driver.cc:3833] 618837 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.124.228 [api_impl.cc:5058] 618837 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.124.239 [callback.cpp:132]618837 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.124.266 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.124.280 [npu_driver.cc:3828] 618837 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=65.
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:49.156.187 [queue_client_comm.c:114][ascend][curpid:618662,618876][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:49.156.177 [queue_client_comm.c:114][ascend][curpid:618674,618873][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:49.156.185 [queue_client_comm.c:114][ascend][curpid:618674,618881][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:49.156.184 [queue_client_comm.c:114][ascend][curpid:618674,618870][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:49.156.185 [queue_client_comm.c:114][ascend][curpid:618674,618866][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:49.156.225 [queue_client_comm.c:114][ascend][curpid:618674,618884][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:49.156.222 [queue_client_comm.c:114][ascend][curpid:618662,618864][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:49.156.227 [queue_client_comm.c:114][ascend][curpid:618662,618872][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:49.156.238 [queue_client_comm.c:114][ascend][curpid:618674,618878][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.156.300 [npu_driver.cc:4338] 618873 MemQueuePeek: queue empty
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.156.316 [npu_driver.cc:4338] 618876 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.156.334 [tensor_data_transfer.cpp:612]618876 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_image_summary
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.156.339 [npu_driver.cc:4338] 618864 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.156.350 [tensor_data_transfer.cpp:1054]618876 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_image_summary
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:49.156.346 [queue_client_comm.c:114][ascend][curpid:618662,618880][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.156.322 [npu_driver.cc:4338] 618881 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.156.321 [tensor_data_transfer.cpp:612]618873 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_tensor_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.156.359 [tensor_data_transfer.cpp:612]618864 acltdtReceiveTensorV2: queue is empty, device is 4, name is _npu_log
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.156.361 [npu_driver.cc:4338] 618870 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.156.395 [tensor_data_transfer.cpp:1054]618873 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_tensor_summary
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.156.395 [npu_driver.cc:4338] 618866 MemQueuePeek: queue empty
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.156.363 [npu_driver.cc:4338] 618872 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.156.365 [tensor_data_transfer.cpp:1056]618876 acltdtReceiveTensor: new process, use queue process
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:49.156.360 [queue_client_comm.c:114][ascend][curpid:618662,618885][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.156.419 [npu_driver.cc:4338] 618884 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.156.400 [tensor_data_transfer.cpp:1054]618864 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is _npu_log
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.156.408 [tensor_data_transfer.cpp:612]618872 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_tensor_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.156.430 [tensor_data_transfer.cpp:612]618866 acltdtReceiveTensorV2: queue is empty, device is 7, name is _npu_log
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.156.415 [api_impl.cc:6121] 618876 MemQueuePeek: Start to peek queue on devId 4, qid is 3.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.156.384 [tensor_data_transfer.cpp:612]618881 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_scalar_summary
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:49.156.420 [queue_client_comm.c:114][ascend][curpid:618662,618868][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.156.405 [tensor_data_transfer.cpp:612]618870 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_tensor_dump
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.156.413 [tensor_data_transfer.cpp:1056]618873 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.156.440 [tensor_data_transfer.cpp:612]618884 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_histogram_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.156.439 [tensor_data_transfer.cpp:1056]618864 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.156.451 [tensor_data_transfer.cpp:1054]618866 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is _npu_log
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.156.457 [npu_driver.cc:4338] 618878 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.156.448 [tensor_data_transfer.cpp:1054]618872 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_tensor_summary
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.156.458 [npu_driver.cc:4330] 618876 MemQueuePeek: peek mem queue, deviceId=4, qid=3, timeout=800.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.156.457 [tensor_data_transfer.cpp:1054]618881 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_scalar_summary
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.156.495 [api_impl.cc:6121] 618864 MemQueuePeek: Start to peek queue on devId 4, qid is 0.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.156.470 [tensor_data_transfer.cpp:1054]618870 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_tensor_dump
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.156.498 [npu_driver.cc:4338] 618880 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.156.503 [tensor_data_transfer.cpp:1056]618872 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.156.480 [api_impl.cc:6121] 618873 MemQueuePeek: Start to peek queue on devId 7, qid is 2.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.156.491 [tensor_data_transfer.cpp:1054]618884 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_histogram_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.156.498 [tensor_data_transfer.cpp:1056]618866 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.156.522 [npu_driver.cc:4330] 618864 MemQueuePeek: peek mem queue, deviceId=4, qid=0, timeout=800.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.156.525 [npu_driver.cc:4338] 618885 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.156.518 [tensor_data_transfer.cpp:1056]618881 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.156.539 [tensor_data_transfer.cpp:612]618880 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_scalar_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.156.518 [tensor_data_transfer.cpp:612]618878 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_image_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.156.529 [tensor_data_transfer.cpp:1056]618870 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.156.546 [api_impl.cc:6121] 618872 MemQueuePeek: Start to peek queue on devId 4, qid is 2.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.156.540 [npu_driver.cc:4330] 618873 MemQueuePeek: peek mem queue, deviceId=7, qid=2, timeout=800.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.1[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.156.566 [tensor_data_transfer.cpp:612]618885 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_histogram_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.156.574 [tensor_data_transfer.cpp:1054]618880 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_scalar_summary
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.156.601 [npu_driver.cc:4330] 618872 MemQueuePeek: peek mem queue, deviceId=4, qid=2, timeout=800.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.156.613 [tensor_data_transfer.cpp:1054]618885 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_histogram_summary
56.550 [tensor_data_transfer.cpp:1056]618884 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.156.618 [tensor_data_transfer.cpp:1056]618880 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.156.625 [npu_driver.cc:4338] 618868 MemQueuePeek: queue empty
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.156.561 [api_impl.cc:6121] 618866 MemQueuePeek: Start to peek queue on devId 7, qid is 0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.156.639 [api_impl.cc:6121] 618884 MemQueuePeek: Start to peek queue on devId 7, qid is 5.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.156.640 [tensor_data_transfer.cpp:1056]618885 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.156.649 [api_impl.cc:6121] 618880 MemQueuePeek: Start to peek queue on devId 4, qid is 4.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.156.568 [api_impl.cc:6121] 618881 MemQueuePeek: Start to peek queue on devId 7, qid is 4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.156.671 [api_impl.cc:6121] 618885 MemQueuePeek: Start to peek queue on devId 4, qid is 5.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.156.658 [npu_driver.cc:4330] 618866 MemQueuePeek: peek mem queue, deviceId=7, qid=0, timeout=800.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.156.669 [npu_driver.cc:4330] 618884 MemQueuePeek: peek mem queue, deviceId=7, qid=5, timeout=800.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.156.671 [tensor_data_transfer.cpp:612]618868 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_tensor_dump
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.156.676 [npu_driver.cc:4330] 618880 MemQueuePeek: peek mem queue, deviceId=4, qid=4, timeout=800.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.156.582 [tensor_data_transfer.cpp:1054]618878 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_image_summary
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.156.681 [npu_driver.cc:4330] 618881 MemQueuePeek: peek mem queue, deviceId=7, qid=4, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.156.685 [npu_driver.cc:4330] 618885 MemQueuePeek: peek mem queue, deviceId=4, qid=5, timeout=800.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.156.706 [tensor_data_transfer.cpp:1054]618868 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_tensor_dump
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.156.724 [tensor_data_transfer.cpp:1056]618868 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.156.589 [api_impl.cc:6121] 618870 MemQueuePeek: Start to peek queue on devId 7, qid is 1.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.156.712 [tensor_data_transfer.cpp:1056]618878 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.156.743 [api_impl.cc:6121] 618868 MemQueuePeek: Start to peek queue on devId 4, qid is 1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.156.761 [npu_driver.cc:4330] 618870 MemQueuePeek: peek mem queue, deviceId=7, qid=1, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.156.761 [npu_driver.cc:4330] 618868 MemQueuePeek: peek mem queue, deviceId=4, qid=1, timeout=800.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.156.773 [api_impl.cc:6121] 618878 MemQueuePeek: Start to peek queue on devId 7, qid is 3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.156.789 [npu_driver.cc:4330] 618878 MemQueuePeek: peek mem queue, deviceId=7, qid=3, timeout=800.
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:49.188.167 [queue_client_comm.c:114][ascend][curpid:618670,618909][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:49.188.167 [queue_client_comm.c:114][ascend][curpid:618670,618903][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:49.188.173 [trs_cb_event.c:119][ascend][curpid:618646,618836][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =64; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:49.188.200 [trs_sqcq.c:1491][ascend][curpid:618646,618836][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:49.188.170 [queue_client_comm.c:114][ascend][curpid:618670,618907][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:49.188.172 [queue_client_comm.c:114][ascend][curpid:618670,618905][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.188.219 [npu_driver.cc:3833] 618836 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=64, drvRetCode=16.
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:49.188.174 [queue_client_comm.c:114][ascend][curpid:618670,618911][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.188.233 [api_impl.cc:5058] 618836 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:49.188.194 [queue_client_comm.c:114][ascend][curpid:618670,618901][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.188.248 [callback.cpp:132]618836 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.188.263 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.188.262 [npu_driver.cc:4338] 618909 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.188.279 [tensor_data_transfer.cpp:612]618909 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_scalar_summary
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.188.287 [npu_driver.cc:4338] 618903 MemQueuePeek: queue empty
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.188.279 [npu_driver.cc:3828] 618836 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=64.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.188.295 [tensor_data_transfer.cpp:1054]618909 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_scalar_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.188.301 [tensor_data_transfer.cpp:612]618903 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_tensor_dump
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.188.308 [tensor_data_transfer.cpp:1056]618909 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.188.322 [tensor_data_transfer.cpp:1054]618903 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_tensor_dump
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.188.329 [api_impl.cc:6121] 618909 MemQueuePeek: Start to peek queue on devId 6, qid is 4.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.188.332 [npu_driver.cc:4338] 618907 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.188.337 [tensor_data_transfer.cpp:1056]618903 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.188.343 [npu_driver.cc:4330] 618909 MemQueuePeek: peek mem queue, deviceId=6, qid=4, timeout=800.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.188.348 [tensor_data_transfer.cpp:612]618907 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_image_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.188.356 [api_impl.cc:6121] 618903 MemQueuePeek: Start to peek queue on devId 6, qid is 1.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.188.364 [npu_driver.cc:4338] 618905 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.188.367 [tensor_data_transfer.cpp:1054]618907 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_image_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.188.371 [npu_driver.cc:4330] 618903 MemQueuePeek: peek mem queue, deviceId=6, qid=1, timeout=800.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.188.379 [tensor_data_transfer.cpp:612]618905 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_tensor_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.188.383 [tensor_data_transfer.cpp:1056]618907 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.188.397 [npu_driver.cc:4338] 618911 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.188.397 [tensor_data_transfer.cpp:1054]618905 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_tensor_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.188.401 [api_impl.cc:6121] 618907 MemQueuePeek: Start to peek queue on devId 6, qid is 3.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.188.412 [tensor_data_transfer.cpp:612]618911 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_histogram_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.188.420 [tensor_data_transfer.cpp:1056]618905 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.188.429 [npu_driver.cc:4338] 618901 MemQueuePeek: queue empty
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.188.442 [npu_driver.cc:4330] 618907 MemQueuePeek: peek mem queue, deviceId=6, qid=3, timeout=800.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.188.450 [tensor_data_transfer.cpp:1054]618911 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_histogram_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.188.456 [api_impl.cc:6121] 618905 MemQueuePeek: Start to peek queue on devId 6, qid is 2.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.188.463 [tensor_data_transfer.cpp:612]618901 acltdtReceiveTensorV2: queue is empty, device is 6, name is _npu_log
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.188.475 [tensor_data_transfer.cpp:1056]618911 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.188.480 [npu_driver.cc:4330] 618905 MemQueuePeek: peek mem queue, deviceId=6, qid=2, timeout=800.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.188.488 [tensor_data_transfer.cpp:1054]618901 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is _npu_log
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.188.493 [api_impl.cc:6121] 618911 MemQueuePeek: Start to peek queue on devId 6, qid is 5.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.188.505 [tensor_data_transfer.cpp:1056]618901 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.188.512 [npu_driver.cc:4330] 618911 MemQueuePeek: peek mem queue, deviceId=6, qid=5, timeout=800.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.188.519 [api_impl.cc:6121] 618901 MemQueuePeek: Start to peek queue on devId 6, qid is 0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.188.533 [npu_driver.cc:4330] 618901 MemQueuePeek: peek mem queue, deviceId=6, qid=0, timeout=800.
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:49.252.175 [trs_cb_event.c:119][ascend][curpid:618666,618809][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =65; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:49.252.201 [trs_sqcq.c:1491][ascend][curpid:618666,618809][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.252.220 [npu_driver.cc:3833] 618809 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.252.234 [api_impl.cc:5058] 618809 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.252.250 [callback.cpp:132]618809 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.252.264 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.252.279 [npu_driver.cc:3828] 618809 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=65.
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:49.284.173 [queue_client_comm.c:114][ascend][curpid:618650,618923][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:49.284.174 [queue_client_comm.c:114][ascend][curpid:618650,618925][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:49.284.183 [queue_client_comm.c:114][ascend][curpid:618650,618927][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:49.284.176 [trs_cb_event.c:119][ascend][curpid:618658,618775][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =65; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:49.284.206 [trs_sqcq.c:1491][ascend][curpid:618658,618775][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:49.284.181 [queue_client_comm.c:114][ascend][curpid:618650,618931][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:49.284.190 [queue_client_comm.c:114][ascend][curpid:618650,618921][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.284.227 [npu_driver.cc:3833] 618775 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.284.246 [api_impl.cc:5058] 618775 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.284.260 [callback.cpp:132]618775 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:49.284.187 [queue_client_comm.c:114][ascend][curpid:618650,618929][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.284.269 [npu_driver.cc:4338] 618923 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.284.277 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.284.305 [npu_driver.cc:3828] 618775 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=65.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.284.309 [npu_driver.cc:4338] 618925 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.284.321 [tensor_data_transfer.cpp:612]618923 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_tensor_dump
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.284.328 [tensor_data_transfer.cpp:612]618925 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_tensor_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.284.333 [tensor_data_transfer.cpp:1054]618923 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_tensor_dump
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.284.339 [npu_driver.cc:4338] 618927 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.284.343 [tensor_data_transfer.cpp:1054]618925 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_tensor_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.284.346 [tensor_data_transfer.cpp:1056]618923 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.284.354 [tensor_data_transfer.cpp:1056]618925 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.284.353 [tensor_data_transfer.cpp:612]618927 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_image_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.284.358 [api_impl.cc:6121] 618923 MemQueuePeek: Start to peek queue on devId 1, qid is 1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.284.364 [api_impl.cc:6121] 618925 MemQueuePeek: Start to peek queue on devId 1, qid is 2.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.284.368 [tensor_data_transfer.cpp:1054]618927 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_image_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.284.370 [npu_driver.cc:4330] 618923 MemQueuePeek: peek mem queue, deviceId=1, qid=1, timeout=800.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.284.374 [npu_driver.cc:4330] 618925 MemQueuePeek: peek mem queue, deviceId=1, qid=2, timeout=800.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.284.376 [npu_driver.cc:4338] 618931 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.284.379 [tensor_data_transfer.cpp:1056]618927 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.284.401 [tensor_data_transfer.cpp:612]618931 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_histogram_summary
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.284.405 [npu_driver.cc:4338] 618921 MemQueuePeek: queue empty
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.284.407 [api_impl.cc:6121] 618927 MemQueuePeek: Start to peek queue on devId 1, qid is 3.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.284.421 [tensor_data_transfer.cpp:1054]618931 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_histogram_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.284.429 [tensor_data_transfer.cpp:612]618921 acltdtReceiveTensorV2: queue is empty, device is 1, name is _npu_log
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.284.436 [npu_driver.cc:4330] 618927 MemQueuePeek: peek mem queue, deviceId=1, qid=3, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.284.444 [tensor_data_transfer.cpp:1056]618931 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.284.456 [tensor_data_transfer.cpp:1054]618921 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is _npu_log
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.284.474 [api_impl.cc:6121] 618931 MemQueuePeek: Start to peek queue on devId 1, qid is 5.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.284.458 [npu_driver.cc:4338] 618929 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.284.480 [tensor_data_transfer.cpp:1056]618921 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.284.508 [npu_driver.cc:4330] 618931 MemQueuePeek: peek mem queue, deviceId=1, qid=5, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.284.548 [tensor_data_transfer.cpp:612]618929 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_scalar_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.284.555 [api_impl.cc:6121] 618921 MemQueuePeek: Start to peek queue on devId 1, qid is 0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.284.577 [npu_driver.cc:4330] 618921 MemQueuePeek: peek mem queue, deviceId=1, qid=0, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.284.571 [tensor_data_transfer.cpp:1054]618929 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_scalar_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.284.635 [tensor_data_transfer.cpp:1056]618929 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.284.669 [api_impl.cc:6121] 618929 MemQueuePeek: Start to peek queue on devId 1, qid is 4.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.284.701 [npu_driver.cc:4330] 618929 MemQueuePeek: peek mem queue, deviceId=1, qid=4, timeout=800.
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:49.316.177 [trs_cb_event.c:119][ascend][curpid:618662,618817][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =833; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:49.316.206 [trs_sqcq.c:1491][ascend][curpid:618662,618817][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:49.316.180 [trs_cb_event.c:119][ascend][curpid:618674,618819][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =65; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:49.316.211 [trs_sqcq.c:1491][ascend][curpid:618674,618819][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.316.226 [npu_driver.cc:3833] 618817 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=833, drvRetCode=16.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.316.229 [npu_driver.cc:3833] 618819 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.316.244 [api_impl.cc:5058] 618819 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.316.241 [api_impl.cc:5058] 618817 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.316.256 [callback.cpp:132]618817 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.316.258 [callback.cpp:132]618819 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.316.271 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.316.275 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.316.288 [npu_driver.cc:3828] 618817 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=833.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.316.293 [npu_driver.cc:3828] 618819 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=65.
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:49.348.178 [trs_cb_event.c:119][ascend][curpid:618670,618823][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =65; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:49.348.204 [trs_sqcq.c:1491][ascend][curpid:618670,618823][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.348.221 [npu_driver.cc:3833] 618823 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.348.235 [api_impl.cc:5058] 618823 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.348.251 [callback.cpp:132]618823 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.348.268 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.348.286 [npu_driver.cc:3828] 618823 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=65.
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:49.380.168 [trs_cb_event.c:119][ascend][curpid:618670,618822][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =64; ret=16)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:49.380.195 [trs_sqcq.c:1491][ascend][curpid:618670,618822][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:49.380.173 [trs_cb_event.c:119][ascend][curpid:618658,618774][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =64; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:49.380.203 [trs_sqcq.c:1491][ascend][curpid:618658,618774][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:49.380.174 [trs_cb_event.c:119][ascend][curpid:618666,618808][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =64; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:49.380.206 [trs_sqcq.c:1491][ascend][curpid:618666,618808][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:49.380.171 [queue_client_comm.c:114][ascend][curpid:618654,618943][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:49.380.176 [queue_client_comm.c:114][ascend][curpid:618654,618941][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:49.380.179 [queue_client_comm.c:114][ascend][curpid:618654,618949][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.380.212 [npu_driver.cc:3833] 618822 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.380.223 [npu_driver.cc:3833] 618774 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=64, drvRetCode=16.
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:49.380.186 [trs_cb_event.c:119][ascend][curpid:618650,618828][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =320; ret=16)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:49.380.227 [trs_sqcq.c:1491][ascend][curpid:618650,618828][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.380.226 [npu_driver.cc:3833] 618808 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.380.244 [api_impl.cc:5058] 618808 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:49.380.179 [queue_client_comm.c:114][ascend][curpid:618654,618947][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:49.380.181 [queue_client_comm.c:114][ascend][curpid:618654,618945][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.380.241 [api_impl.cc:5058] 618822 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.380.258 [callback.cpp:132]618822 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.380.271 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.380.237 [api_impl.cc:5058] 618774 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.380.252 [callback.cpp:132]618774 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.380.263 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.380.249 [npu_driver.cc:3833] 618828 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=320, drvRetCode=16.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.380.266 [api_impl.cc:5058] 618828 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.380.257 [callback.cpp:132]618808 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.380.287 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:49.380.265 [queue_client_comm.c:114][ascend][curpid:618654,618951][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.380.281 [npu_driver.cc:4338] 618943 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.380.298 [tensor_data_transfer.cpp:612]618943 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_tensor_dump
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.380.287 [npu_driver.cc:3828] 618822 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=64.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.380.290 [npu_driver.cc:3828] 618774 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=64.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.380.287 [callback.cpp:132]618828 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.380.308 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.380.324 [npu_driver.cc:3828] 618828 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=320.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.380.302 [npu_driver.cc:3828] 618808 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=64.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.380.306 [npu_driver.cc:4338] 618941 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.380.313 [tensor_data_transfer.cpp:1054]618943 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_tensor_dump
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.380.336 [npu_driver.cc:4338] 618949 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.380.340 [tensor_data_transfer.cpp:612]618941 acltdtReceiveTensorV2: queue is empty, device is 2, name is _npu_log
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.380.342 [tensor_data_transfer.cpp:1056]618943 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.380.351 [tensor_data_transfer.cpp:612]618949 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_scalar_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.380.355 [tensor_data_transfer.cpp:1054]618941 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is _npu_log
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.380.358 [api_impl.cc:6121] 618943 MemQueuePeek: Start to peek queue on devId 2, qid is 1.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.380.365 [npu_driver.cc:4338] 618947 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.380.367 [tensor_data_transfer.cpp:1054]618949 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_scalar_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.380.373 [tensor_data_transfer.cpp:1056]618941 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.380.378 [npu_driver.cc:4330] 618943 MemQueuePeek: peek mem queue, deviceId=2, qid=1, timeout=800.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.380.385 [tensor_data_transfer.cpp:612]618947 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_image_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.380.388 [tensor_data_transfer.cpp:1056]618949 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.380.392 [npu_driver.cc:4338] 618945 MemQueuePeek: queue empty
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.380.393 [api_impl.cc:6121] 618941 MemQueuePeek: Start to peek queue on devId 2, qid is 0.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.380.405 [tensor_data_transfer.cpp:1054]618947 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_image_summary
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.380.410 [api_impl.cc:6121] 618949 MemQueuePeek: Start to peek queue on devId 2, qid is 4.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.380.428 [tensor_data_transfer.cpp:1056]618947 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.380.419 [tensor_data_transfer.cpp:612]618945 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_tensor_summary
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.380.422 [npu_driver.cc:4330] 618941 MemQueuePeek: peek mem queue, deviceId=2, qid=0, timeout=800.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.380.435 [npu_driver.cc:4330] 618949 MemQueuePeek: peek mem queue, deviceId=2, qid=4, timeout=800.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.380.432 [npu_driver.cc:4338] 618951 MemQueuePeek: queue empty
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.380.444 [api_impl.cc:6121] 618947 MemQueuePeek: Start to peek queue on devId 2, qid is 3.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.380.450 [tensor_data_transfer.cpp:1054]618945 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_tensor_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.380.469 [tensor_data_transfer.cpp:612]618951 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_histogram_summary
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.380.476 [npu_driver.cc:4330] 618947 MemQueuePeek: peek mem queue, deviceId=2, qid=3, timeout=800.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.380.480 [tensor_data_transfer.cpp:1056]618945 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.380.489 [tensor_data_transfer.cpp:1054]618951 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_histogram_summary
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.380.523 [api_impl.cc:6121] 618945 MemQueuePeek: Start to peek queue on devId 2, qid is 2.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.380.526 [tensor_data_transfer.cpp:1056]618951 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.380.537 [npu_driver.cc:4330] 618945 MemQueuePeek: peek mem queue, deviceId=2, qid=2, timeout=800.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.380.543 [api_impl.cc:6121] 618951 MemQueuePeek: Start to peek queue on devId 2, qid is 5.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.380.558 [npu_driver.cc:4330] 618951 MemQueuePeek: peek mem queue, deviceId=2, qid=5, timeout=800.
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:49.412.182 [trs_cb_event.c:119][ascend][curpid:618674,618818][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =64; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:49.412.206 [trs_sqcq.c:1491][ascend][curpid:618674,618818][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:49.412.173 [trs_cb_event.c:119][ascend][curpid:618654,618832][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =320; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:49.412.199 [trs_sqcq.c:1491][ascend][curpid:618654,618832][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:49.412.173 [trs_cb_event.c:119][ascend][curpid:618662,618816][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =832; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:49.412.197 [trs_sqcq.c:1491][ascend][curpid:618662,618816][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.412.220 [npu_driver.cc:3833] 618818 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.412.217 [npu_driver.cc:3833] 618832 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=320, drvRetCode=16.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.412.233 [api_impl.cc:5058] 618818 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.412.217 [npu_driver.cc:3833] 618816 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=832, drvRetCode=16.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.412.241 [api_impl.cc:5058] 618816 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.412.234 [api_impl.cc:5058] 618832 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.412.246 [callback.cpp:132]618818 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.412.262 [callback.cpp:132]618816 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.412.253 [callback.cpp:132]618832 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.412.268 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.412.259 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.412.278 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.412.282 [npu_driver.cc:3828] 618832 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=320.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.412.289 [npu_driver.cc:3828] 618818 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=64.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.412.294 [npu_driver.cc:3828] 618816 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=832.
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:49.444.168 [trs_cb_event.c:119][ascend][curpid:618650,618829][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=1, tid =321; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:49.444.172 [queue_client_comm.c:114][ascend][curpid:618646,618961][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:49.444.174 [queue_client_comm.c:114][ascend][curpid:618646,618965][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:49.444.197 [trs_sqcq.c:1491][ascend][curpid:618650,618829][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.444.212 [npu_driver.cc:3833] 618829 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=321, drvRetCode=16.
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:49.444.186 [queue_client_comm.c:114][ascend][curpid:618646,618963][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.444.225 [api_impl.cc:5058] 618829 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.444.241 [callback.cpp:132]618829 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.444.252 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.444.263 [npu_driver.cc:3828] 618829 CqReportIrqWait: Irq wait start, deviceId=1, tsId=0, groupId=321.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.444.305 [npu_driver.cc:4338] 618961 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.444.324 [tensor_data_transfer.cpp:612]618961 acltdtReceiveTensorV2: queue is empty, device is 0, name is _npu_log
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.444.325 [npu_driver.cc:4338] 618965 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.444.336 [tensor_data_transfer.cpp:1054]618961 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is _npu_log
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.444.342 [tensor_data_transfer.cpp:612]618965 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_tensor_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.444.347 [tensor_data_transfer.cpp:1056]618961 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.444.354 [tensor_data_transfer.cpp:1054]618965 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_tensor_summary
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.444.359 [api_impl.cc:6121] 618961 MemQueuePeek: Start to peek queue on devId 0, qid is 0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.444.369 [tensor_data_transfer.cpp:1056]618965 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.444.372 [npu_driver.cc:4330] 618961 MemQueuePeek: peek mem queue, deviceId=0, qid=0, timeout=800.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.444.367 [npu_driver.cc:4338] 618963 MemQueuePeek: queue empty
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.444.380 [api_impl.cc:6121] 618965 MemQueuePeek: Start to peek queue on devId 0, qid is 2.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.444.402 [npu_driver.cc:4330] 618965 MemQueuePeek: peek mem queue, deviceId=0, qid=2, timeout=800.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.444.401 [tensor_data_transfer.cpp:612]618963 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_tensor_dump
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.444.442 [tensor_data_transfer.cpp:1054]618963 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_tensor_dump
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.444.460 [tensor_data_transfer.cpp:1056]618963 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.444.475 [api_impl.cc:6121] 618963 MemQueuePeek: Start to peek queue on devId 0, qid is 1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.444.491 [npu_driver.cc:4330] 618963 MemQueuePeek: peek mem queue, deviceId=0, qid=1, timeout=800.
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:49.476.174 [queue_client_comm.c:114][ascend][curpid:618646,618971][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:49.476.176 [queue_client_comm.c:114][ascend][curpid:618646,618967][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:49.476.178 [queue_client_comm.c:114][ascend][curpid:618646,618969][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.476.267 [npu_driver.cc:4338] 618971 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.476.287 [tensor_data_transfer.cpp:612]618971 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_histogram_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.476.301 [tensor_data_transfer.cpp:1054]618971 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_histogram_summary
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.476.302 [npu_driver.cc:4338] 618967 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.476.319 [tensor_data_transfer.cpp:1056]618971 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.476.327 [npu_driver.cc:4338] 618969 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.476.331 [tensor_data_transfer.cpp:612]618967 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_image_summary
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.476.341 [api_impl.cc:6121] 618971 MemQueuePeek: Start to peek queue on devId 0, qid is 5.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.476.351 [tensor_data_transfer.cpp:612]618969 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_scalar_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.476.355 [tensor_data_transfer.cpp:1054]618967 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_image_summary
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.476.365 [npu_driver.cc:4330] 618971 MemQueuePeek: peek mem queue, deviceId=0, qid=5, timeout=800.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.476.375 [tensor_data_transfer.cpp:1054]618969 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_scalar_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.476.378 [tensor_data_transfer.cpp:1056]618967 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.476.396 [tensor_data_transfer.cpp:1056]618969 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.476.401 [api_impl.cc:6121] 618967 MemQueuePeek: Start to peek queue on devId 0, qid is 3.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.476.407 [api_impl.cc:6121] 618969 MemQueuePeek: Start to peek queue on devId 0, qid is 4.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.476.411 [npu_driver.cc:4330] 618967 MemQueuePeek: peek mem queue, deviceId=0, qid=3, timeout=800.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.476.418 [npu_driver.cc:4330] 618969 MemQueuePeek: peek mem queue, deviceId=0, qid=4, timeout=800.
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:49.540.172 [trs_cb_event.c:119][ascend][curpid:618654,618833][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=2, tid =321; ret=16)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:49.540.197 [trs_sqcq.c:1491][ascend][curpid:618654,618833][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.540.215 [npu_driver.cc:3833] 618833 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.540.232 [api_impl.cc:5058] 618833 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.540.254 [callback.cpp:132]618833 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.540.268 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.540.286 [npu_driver.cc:3828] 618833 CqReportIrqWait: Irq wait start, deviceId=2, tsId=0, groupId=321.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.578.505 [op_base.cc:2136] [618646]Entry-HcclCommDestroy: op_base comm destroy begin
[INFO] DEVICE(618646,fffe85fbefa0,python3.9):2025-04-03-09:27:49.578.514 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:177] WatchDogProcess] end
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.578.533 [runtime.cc:5239] 618646 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.578.548 [adapter_rts.cc:198] [618646][hrtGetDeviceRefresh]deviceLogicId[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.578.567 [op_base.cc:2151] [618646][HcclCommDestroy] comm state is IDLE
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.578.590 [op_base.cc:128] [618646][HcclGetDeviceId] deviceLogicId[0] 
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.578.603 [op_base.cc:2168] [618646]com is not global com
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.578.618 [hcom_plugin.cc:381] [618646][Unset][GroupTopoInfo]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.578.668 [hccl_comm.cc:1375] [618646]UnRegistTaskAbortHandler begin
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.578.683 [task_abort_handler.cc:140] [618646]TaskAbortHandler::DeInit commVector size is [1], ref_ count is [1]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.578.697 [api_impl.cc:4192] 618646 SetTaskAbortCallBack: set task abort callback.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.578.708 [runtime.cc:4698] 618646 SetTaskAbortCallBack: SetTaskAbortCallBack finish, moduleName:HCCL.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.578.723 [hccl_communicator.cc:2112] [618646][HcclCommunicator][DestroyAicpuComm]start to destroy the aicpu comm, group[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[WARNING] HCCL(618646,python3.9):2025-04-03-09:27:49.578.736 [hccl_communicator.cc:2114] [618646][HcclCommunicator][DestroyAicpuComm]Device type is not A3, no needs to destroy the aicpu comm.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.578.747 [hccl_communicator.cc:2082] [618646]start to stop the backGround Thread
[WARNING] HCCL(618646,python3.9):2025-04-03-09:27:49.578.760 [heartbeat.cc:1203] [618646]Heartbeat has been destroyed
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.578.773 [heartbeat.cc:451] [618646][UnRegisterRanks]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] UnregisterRanks Start.
[WARNING] HCCL(618646,python3.9):2025-04-03-09:27:49.578.784 [heartbeat.cc:452] [618646]Heartbeat has been destroyed
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.578.798 [hccl_impl.cc:69] [618646]start hccl resources destruction:deviceLogicId[0]
[WARNING] HCCL(618646,python3.9):2025-04-03-09:27:49.578.814 [heartbeat.cc:1203] [618646]Heartbeat has been destroyed
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.578.825 [heartbeat.cc:451] [618646][UnRegisterRanks]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] UnregisterRanks Start.
[WARNING] HCCL(618646,python3.9):2025-04-03-09:27:49.578.834 [heartbeat.cc:452] [618646]Heartbeat has been destroyed
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.578.955 [api_impl.cc:2003] 618646 DevFree: device free mem=0x12c280003000
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.579.126 [task_exception_handler.cc:1232] [618646]deInit taskFailCallback
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.579.508 [api_impl.cc:2003] 618646 DevFree: device free mem=0x12c2800a5000
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.579.527 [api_impl.cc:2003] 618646 DevFree: device free mem=0x12c280004000
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.579.566 [api_error.cc:1278] 618646 HostFree: Free host memory succeed, host addr=0x12c0807f0000.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.579.589 [api_impl.cc:2003] 618646 DevFree: device free mem=0x12c280146000
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.579.623 [hccl_socket_manager.cc:81] [618646][DeInit][Server]ip[192.168.2.199] port[16666] serverSocketRef.Count() = 0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.579.638 [hccl_socket_manager.cc:83] [618646][DeInit][Server]ip[192.168.2.199] port[16666]
[WARNING] HCCL(618646,python3.9):2025-04-03-09:27:49.579.649 [hccl_socket.cc:232] [618646][Close] socket's fdHandle is null, do not need close.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.579.660 [network_manager.cc:69] [618646]NetworkManager::GetInstance deviceLogicID[0].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.579.673 [network_manager.cc:458] [618646]NetworkManager devicePhyId_[0] vnic stopped. refcount[0]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.579.707 [ra_host.c:911]tid:618646,ra_socket_listen_stop(911) : Input parameters: [0]th, phy_id[0], local_ip[192.168.2.199]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.580.039 [ra_host.c:404]tid:618646,ra_socket_deinit(404) : Input parameters: phy_id[0] family[2] local_ip[192.168.2.199]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.580.180 [hccl_socket.cc:68] [618646][HcclSocket][DeInit] device[0] stops listen on ip[192.168.2.199], port[16666] success, socketType[0].
[WARNING] HCCL(618646,python3.9):2025-04-03-09:27:49.580.200 [hccl_socket.cc:232] [618646][Close] socket's fdHandle is null, do not need close.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.580.223 [hccl_communicator.cc:1741] [618646][HcclCommunicator][ReleasePreemptSocket] release all preempt socket success, comm id[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.580.236 [network_manager.cc:69] [618646]NetworkManager::GetInstance deviceLogicID[0].
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.580.249 [ra_host.c:248]tid:618646,ra_deinit(248) : Input parameters: phy_id[0], nic_position:[1]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.580.262 [ra_hdc.c:651]tid:618646,ra_hdc_deinit(651) : hdc deinit start! phy_id[0]
[INFO] DRV(618646,python3.9):2025-04-03-09:27:49.580.353 [hdc_client.c:417][ascend][curpid:618646,618646][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4195)
[INFO] ROCE(618646,python3.9):2025-04-03-09:27:49.580.426 [dl_hal_function.c:199]dl_hal_deinit(199) : dl_hal_deinit success, no need to dlclose libascend_hal.so!
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.580.440 [ra_hdc.c:685]tid:618646,ra_hdc_deinit(685) : hdc deinit OK! phy_id[0]
[INFO] ROCE(618646,python3.9):2025-04-03-09:27:49.580.451 [dl_hal_function.c:199]dl_hal_deinit(199) : dl_hal_deinit success, no need to dlclose libascend_hal.so!
[INFO] TDT(618646,python3.9):2025-04-03-09:27:49.580.522 [tsd_client.cpp:189][TsdCapabilityGet][tid:618646] TsdCapabilityGet Begin.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:49.580.535 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618646] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:49.580.548 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618646] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:49.580.560 [process_mode_manager.cpp:1042][CapabilityGet][tid:618646] [ProcessModeManager] enter into CapabilityGet process deviceId[0] type[6]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.580.574 [adapter_tdt.cc:66] [618646]Get TsdCapability success. deviceLogicId[0]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:49.580.587 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618646] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:49.580.598 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618646] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:49.580.609 [process_mode_manager.cpp:1735][ProcessCloseSubProcList][tid:618646] enter ExcuteClosePidList cnt:1, tsdSupportLevel_:63
[INFO] TDT(618646,python3.9):2025-04-03-09:27:49.580.634 [process_mode_manager.cpp:1794][ExcuteClosePidList][tid:618646] add close subproc:31799, proctype:0
[INFO] TDT(618646,python3.9):2025-04-03-09:27:49.580.672 [hdc_client.cpp:154][TsdRecvData][tid:618646] recv timeout is:150000 ms
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:49.636.170 [trs_cb_event.c:119][ascend][curpid:618646,618837][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =65; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:49.636.188 [trs_sqcq.c:1491][ascend][curpid:618646,618837][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.636.199 [npu_driver.cc:3833] 618837 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.636.213 [api_impl.cc:5058] 618837 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.636.223 [callback.cpp:132]618837 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.636.236 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.636.250 [npu_driver.cc:3828] 618837 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=65.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:49.653.079 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618646] [ServerToClientMsgProc] [sessionID=1]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:49.653.097 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618646] [TsdClient] DeviceMsgProc recvMsg realDeviceId[0] msgType[61] localDevId[0] rspCode[0]heterogeneousSubPid[31799], tsdSupportLevel_[63]
[INFO] TDT(618646,python3.9):2025-04-03-09:27:49.653.112 [hdc_client.cpp:172][TsdRecvData][tid:618646] [deviceId=0] the Tsd recv data already
[INFO] TDT(618646,python3.9):2025-04-03-09:27:49.653.124 [process_mode_manager.cpp:1809][ExcuteClosePidList][tid:618646] leave ExcuteClosePidList startindex:0, cnt:1
[INFO] TDT(618646,python3.9):2025-04-03-09:27:49.653.137 [process_mode_manager.cpp:1769][ProcessCloseSubProcList][tid:618646] ExcuteClosePidList success reserveCnt:1
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.653.149 [adapter_tdt.cc:52] [618646]Open TsdProcess success. deviceLogicId[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.653.160 [network_manager.cc:405] [618646][DeInit]finish CloseHccpProcess, phy_id[0], hdc_type[18], nicDeployment[1], hasBackup[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.653.173 [network_manager.cc:409] [618646]NetworkManager: deinit nic success, nicPosition[1] ref[0].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.653.184 [hccl_communicator_attrs.cc:1307] [618646][HcclCommunicator]IsSupportEnableRoce
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.653.196 [hccl_communicator_attrs.cc:1275] [618646]IsEnableRoce ret: 0, interServer_: 0, isInterServerVnic: 0, roceSwitch: 0, isSingleMeshAggregation_: 1
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.653.212 [notify_pool_impl.cc:43] [618646]NotifyPoolImpl Destroy.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.653.232 [notify_pool_impl.cc:56] [618646]NotifyPoolImpl Destroy success.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.253 [api_impl.cc:3100] 618646 GetDevicePhyIdByIndex: get PhyId by Index=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.265 [api_impl.cc:3111] 618646 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.275 [api_impl.cc:3130] 618646 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.292 [api_impl.cc:3100] 618646 GetDevicePhyIdByIndex: get PhyId by Index=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.302 [api_impl.cc:3111] 618646 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.320 [api_impl.cc:3130] 618646 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.653.330 [p2p_mgmt.cc:171] [618646]local logic id:0, local physic id:0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.343 [api_impl.cc:3100] 618646 GetDevicePhyIdByIndex: get PhyId by Index=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.352 [api_impl.cc:3111] 618646 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.361 [api_impl.cc:3130] 618646 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.653.372 [p2p_mgmt.cc:171] [618646]local logic id:0, local physic id:0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.383 [api_impl.cc:3520] 618646 GetPhyDeviceInfo: get phy device info, phyId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.405 [api_impl.cc:3520] 618646 GetPhyDeviceInfo: get phy device info, phyId=1
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.653.418 [p2p_mgmt.cc:178] [618646]disable p2p: local logic id:0, remote physic id:1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.432 [api_impl.cc:3184] 618646 DisableP2P: Disable P2P devIdDes=0, phyIdSrc=1.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:49.653.450 [devdrv_pcie.c:890][ascend][curpid:618646,618646][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=0; peer_phy_devid=1.)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.465 [api_impl.cc:3100] 618646 GetDevicePhyIdByIndex: get PhyId by Index=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.473 [api_impl.cc:3111] 618646 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.483 [api_impl.cc:3130] 618646 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.653.493 [p2p_mgmt.cc:171] [618646]local logic id:0, local physic id:0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.503 [api_impl.cc:3520] 618646 GetPhyDeviceInfo: get phy device info, phyId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.515 [api_impl.cc:3520] 618646 GetPhyDeviceInfo: get phy device info, phyId=2
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.653.526 [p2p_mgmt.cc:178] [618646]disable p2p: local logic id:0, remote physic id:2.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.537 [api_impl.cc:3184] 618646 DisableP2P: Disable P2P devIdDes=0, phyIdSrc=2.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:49.653.549 [devdrv_pcie.c:890][ascend][curpid:618646,618646][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=0; peer_phy_devid=2.)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.562 [api_impl.cc:3100] 618646 GetDevicePhyIdByIndex: get PhyId by Index=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.570 [api_impl.cc:3111] 618646 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.582 [api_impl.cc:3130] 618646 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.653.591 [p2p_mgmt.cc:171] [618646]local logic id:0, local physic id:0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.601 [api_impl.cc:3520] 618646 GetPhyDeviceInfo: get phy device info, phyId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.612 [api_impl.cc:3520] 618646 GetPhyDeviceInfo: get phy device info, phyId=3
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.653.623 [p2p_mgmt.cc:178] [618646]disable p2p: local logic id:0, remote physic id:3.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.635 [api_impl.cc:3184] 618646 DisableP2P: Disable P2P devIdDes=0, phyIdSrc=3.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:49.653.647 [devdrv_pcie.c:890][ascend][curpid:618646,618646][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=0; peer_phy_devid=3.)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.664 [api_impl.cc:3100] 618646 GetDevicePhyIdByIndex: get PhyId by Index=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.673 [api_impl.cc:3111] 618646 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.684 [api_impl.cc:3130] 618646 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.653.693 [p2p_mgmt.cc:171] [618646]local logic id:0, local physic id:0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.703 [api_impl.cc:3520] 618646 GetPhyDeviceInfo: get phy device info, phyId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.713 [api_impl.cc:3520] 618646 GetPhyDeviceInfo: get phy device info, phyId=4
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.653.725 [p2p_mgmt.cc:178] [618646]disable p2p: local logic id:0, remote physic id:4.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.736 [api_impl.cc:3184] 618646 DisableP2P: Disable P2P devIdDes=0, phyIdSrc=4.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:49.653.749 [devdrv_pcie.c:890][ascend][curpid:618646,618646][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=0; peer_phy_devid=4.)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.761 [api_impl.cc:3100] 618646 GetDevicePhyIdByIndex: get PhyId by Index=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.770 [api_impl.cc:3111] 618646 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.779 [api_impl.cc:3130] 618646 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.653.787 [p2p_mgmt.cc:171] [618646]local logic id:0, local physic id:0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.797 [api_impl.cc:3520] 618646 GetPhyDeviceInfo: get phy device info, phyId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.807 [api_impl.cc:3520] 618646 GetPhyDeviceInfo: get phy device info, phyId=5
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.653.818 [p2p_mgmt.cc:178] [618646]disable p2p: local logic id:0, remote physic id:5.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.830 [api_impl.cc:3184] 618646 DisableP2P: Disable P2P devIdDes=0, phyIdSrc=5.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:49.653.841 [devdrv_pcie.c:890][ascend][curpid:618646,618646][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=0; peer_phy_devid=5.)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.853 [api_impl.cc:3100] 618646 GetDevicePhyIdByIndex: get PhyId by Index=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.862 [api_impl.cc:3111] 618646 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.872 [api_impl.cc:3130] 618646 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.653.882 [p2p_mgmt.cc:171] [618646]local logic id:0, local physic id:0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.892 [api_impl.cc:3520] 618646 GetPhyDeviceInfo: get phy device info, phyId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.902 [api_impl.cc:3520] 618646 GetPhyDeviceInfo: get phy device info, phyId=6
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.653.914 [p2p_mgmt.cc:178] [618646]disable p2p: local logic id:0, remote physic id:6.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.925 [api_impl.cc:3184] 618646 DisableP2P: Disable P2P devIdDes=0, phyIdSrc=6.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:49.653.939 [devdrv_pcie.c:890][ascend][curpid:618646,618646][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=0; peer_phy_devid=6.)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.952 [api_impl.cc:3100] 618646 GetDevicePhyIdByIndex: get PhyId by Index=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.960 [api_impl.cc:3111] 618646 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.976 [api_impl.cc:3130] 618646 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.653.985 [p2p_mgmt.cc:171] [618646]local logic id:0, local physic id:0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.653.996 [api_impl.cc:3520] 618646 GetPhyDeviceInfo: get phy device info, phyId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.654.006 [api_impl.cc:3520] 618646 GetPhyDeviceInfo: get phy device info, phyId=7
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.654.018 [p2p_mgmt.cc:178] [618646]disable p2p: local logic id:0, remote physic id:7.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.654.029 [api_impl.cc:3184] 618646 DisableP2P: Disable P2P devIdDes=0, phyIdSrc=7.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:49.654.041 [devdrv_pcie.c:890][ascend][curpid:618646,618646][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=0; peer_phy_devid=7.)
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.654.055 [hccl_communicator.cc:2043] [618646]Profiling is deinitiated.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.654.067 [api_impl.cc:2003] 618646 DevFree: device free mem=0x12c280000000
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.654.086 [api_impl.cc:2003] 618646 DevFree: device free mem=0x12c280001000
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.654.100 [api_impl.cc:2003] 618646 DevFree: device free mem=0x12c280002000
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.654.113 [opexecounter.cc:103] [618646]free counter mem resource
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:49.654.128 [atrace_api.c:118](tid:618646) AtraceDestroy start.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:49.654.144 [tracer_mgr_operate.c:248](tid:618646) destroy object HCCL_618981_0, exitSave(true).
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:49.654.155 [atrace_api.c:120](tid:618646) AtraceDestroy end.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.654.163 [adapter_trace.cc:33] [618646]Call TraceDestroy, Params:handle[0xaaaaf6110be8]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.655.885 [api_impl.cc:2003] 618646 DevFree: device free mem=0x12c280147000
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.655.922 [api_impl.cc:2003] 618646 DevFree: device free mem=0x12c100c00000
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.655.947 [queue_notify_manager.cc:100] [618646]QueueNotifyManager Destroy.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.655.960 [queue_notify_manager.cc:106] [618646]QueueNotifyManager Destroy success.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.656.084 [queue_notify_manager.cc:100] [618646]QueueNotifyManager Destroy.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.656.097 [queue_notify_manager.cc:106] [618646]QueueNotifyManager Destroy success.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.656.191 [ccl_buffer_manager.cc:125] [618646][HCCL_TRACE][ReleaseCCLbuffer]CCLBuffer is null, no need to release.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.656.209 [ccl_buffer_manager.cc:147] [618646][HCCL_TRACE][ReleaseCCLbuffer]CCLBuffer is null, no need to release.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.656.220 [ccl_buffer_manager.cc:160] [618646][HCCL_TRACE][ReleaseAIVbuffer]Release inAIVbuffer. buffer ptr[(nil)], size[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.656.234 [ccl_buffer_manager.cc:163] [618646][HCCL_TRACE][ReleaseAIVbuffer]Release outAIVbuffer. buffer ptr[(nil)], size[0]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.656.245 [ccl_buffer_manager.cc:166] [618646][HCCL_TRACE][ReleaseAIVbuffer]Release AIV buffer success.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.656.277 [op_base.cc:128] [618646][HcclGetDeviceId] deviceLogicId[0] 
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.656.330 [adapter_hccp.cc:1067] [618646]ra socket batch close fdhandle[0xfffe7c003a80]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.656.349 [ra_host.c:796]tid:618646,ra_socket_batch_close(796) : Input parameters: [0]th, phy_id[0], local_ip[192.168.0.44], cnt[1]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.656.385 [rs_socket.c:1937]tid:618646,rs_socket_batch_close(1937) : conn node of IP(192.168.0.44) fd:61, state:9
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.656.487 [adapter_hccp.cc:1099] [618646]ra socket batch close success,take time [142]us
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.656.503 [adapter_hccp.cc:1067] [618646]ra socket batch close fdhandle[0xfffe7c002e50]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.656.517 [ra_host.c:796]tid:618646,ra_socket_batch_close(796) : Input parameters: [0]th, phy_id[0], local_ip[192.168.0.44], cnt[2]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.656.530 [rs_socket.c:1937]tid:618646,rs_socket_batch_close(1937) : conn node of IP(192.168.0.44) fd:56, state:9
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.656.576 [adapter_hccp.cc:1099] [618646]ra socket batch close success,take time [62]us
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.656.590 [adapter_hccp.cc:1067] [618646]ra socket batch close fdhandle[0xfffe7c003810]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.656.602 [ra_host.c:796]tid:618646,ra_socket_batch_close(796) : Input parameters: [0]th, phy_id[0], local_ip[192.168.0.44], cnt[3]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.656.614 [rs_socket.c:1937]tid:618646,rs_socket_batch_close(1937) : conn node of IP(192.168.0.44) fd:60, state:9
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.656.651 [adapter_hccp.cc:1099] [618646]ra socket batch close success,take time [50]us
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.656.664 [adapter_hccp.cc:1067] [618646]ra socket batch close fdhandle[0xfffe7c002be0]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.656.677 [ra_host.c:796]tid:618646,ra_socket_batch_close(796) : Input parameters: [0]th, phy_id[0], local_ip[192.168.0.44], cnt[4]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.656.689 [rs_socket.c:1937]tid:618646,rs_socket_batch_close(1937) : conn node of IP(192.168.0.44) fd:55, state:9
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.656.727 [adapter_hccp.cc:1099] [618646]ra socket batch close success,take time [51]us
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.656.740 [adapter_hccp.cc:1067] [618646]ra socket batch close fdhandle[0xfffe7c003330]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.656.753 [ra_host.c:796]tid:618646,ra_socket_batch_close(796) : Input parameters: [0]th, phy_id[0], local_ip[192.168.0.44], cnt[5]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.656.766 [rs_socket.c:1937]tid:618646,rs_socket_batch_close(1937) : conn node of IP(192.168.0.44) fd:58, state:9
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.656.804 [adapter_hccp.cc:1099] [618646]ra socket batch close success,take time [52]us
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.656.817 [adapter_hccp.cc:1067] [618646]ra socket batch close fdhandle[0xfffe7c0035a0]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.656.828 [ra_host.c:796]tid:618646,ra_socket_batch_close(796) : Input parameters: [0]th, phy_id[0], local_ip[192.168.0.44], cnt[6]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.656.840 [rs_socket.c:1937]tid:618646,rs_socket_batch_close(1937) : conn node of IP(192.168.0.44) fd:59, state:9
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.656.878 [adapter_hccp.cc:1099] [618646]ra socket batch close success,take time [50]us
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.656.890 [adapter_hccp.cc:1067] [618646]ra socket batch close fdhandle[0xfffe7c0030c0]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.656.901 [ra_host.c:796]tid:618646,ra_socket_batch_close(796) : Input parameters: [0]th, phy_id[0], local_ip[192.168.0.44], cnt[7]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.656.914 [rs_socket.c:1937]tid:618646,rs_socket_batch_close(1937) : conn node of IP(192.168.0.44) fd:57, state:9
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.656.951 [adapter_hccp.cc:1099] [618646]ra socket batch close success,take time [50]us
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.656.972 [adapter_hccp.cc:1067] [618646]ra socket batch close fdhandle[0xfffe7c002970]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.656.983 [ra_host.c:796]tid:618646,ra_socket_batch_close(796) : Input parameters: [0]th, phy_id[0], local_ip[192.168.0.44], cnt[8]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.656.996 [rs_socket.c:1937]tid:618646,rs_socket_batch_close(1937) : conn node of IP(192.168.0.44) fd:54, state:9
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.657.029 [adapter_hccp.cc:1099] [618646]ra socket batch close success,take time [47]us
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.657.046 [topoinfo_detect.cc:555] [618646]NetworkManager stop host net success! ip[192.168.0.44%enp67s0f5] 
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.657.059 [network_manager.cc:69] [618646]NetworkManager::GetInstance deviceLogicID[0].
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.657.075 [ra_host.c:404]tid:618646,ra_socket_deinit(404) : Input parameters: phy_id[0] family[2] local_ip[192.168.0.44]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.657.089 [rs.c:1629]tid:618646,rs_socket_deinit(1629) : rs socket deinit start, phy_id:0
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.657.102 [rs.c:1641]tid:618646,rs_socket_deinit(1641) : socket deinit local IP is 0x2c00a8c0, ret:-1
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.657.119 [rs.c:1653]tid:618646,rs_socket_deinit(1653) : socket deinit success, phy_id:0, local_ip:192.168.0.44
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.657.132 [network_manager.cc:1233] [618646]ip[192.168.0.44%enp67s0f5] deinit success.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.657.145 [network_manager.cc:69] [618646]NetworkManager::GetInstance deviceLogicID[0].
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.657.157 [ra_host.c:248]tid:618646,ra_deinit(248) : Input parameters: phy_id[0], nic_position:[0]
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.657.169 [ra_peer.c:821]tid:618646,ra_peer_deinit(821) : [deinit][ra_peer]ra_peer_deinit phy_id[0] start
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.657.188 [rs.c:1783]tid:618646,rs_deinit(1783) : epoll wait up ok, rscb->conn_flag:1
[WARNING] HCCP(618646,python3.9):2025-04-03-09:27:49.657.193 [rs_epoll.c:523]tid:618978,rs_epoll_handle(523) : <EPOLL> SHUT DOWN event!!! eventfd:50
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.657.211 [rs_epoll.c:544]tid:618978,rs_epoll_handle(544) : <EPOLL> QUIT thread_id:281468668473248, pid:618646, read num:8
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:49.700.167 [trs_cb_event.c:119][ascend][curpid:618646,618836][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=0, tid =64; ret=16)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:49.700.192 [trs_sqcq.c:1491][ascend][curpid:618646,618836][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.700.210 [npu_driver.cc:3833] 618836 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.700.225 [api_impl.cc:5058] 618836 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.700.238 [callback.cpp:132]618836 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.700.253 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.700.268 [npu_driver.cc:3828] 618836 CqReportIrqWait: Irq wait start, deviceId=0, tsId=0, groupId=64.
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.701.333 [rs_epoll.c:679]tid:618979,rs_connect_handle(679) : <SOCKET> QUIT thread_id:281468660019104, pid:618646
[INFO] ROCE(618646,python3.9):2025-04-03-09:27:49.717.383 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.717.400 [rs.c:1810]tid:618646,rs_deinit(1810) : rs_deinit chip_id[0] ok
[INFO] ROCE(618646,python3.9):2025-04-03-09:27:49.717.422 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] HCCP(618646,python3.9):2025-04-03-09:27:49.717.434 [ra_peer.c:852]tid:618646,ra_peer_deinit(852) : [deinit][ra_peer]ra_peer_deinit phy_id[0] succ
[INFO] ROCE(618646,python3.9):2025-04-03-09:27:49.717.444 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.717.468 [network_manager.cc:409] [618646]NetworkManager: deinit nic success, nicPosition[0] ref[0].
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.717.481 [topoinfo_detect.cc:219] [618646]TopoInfoDetect TeardownServer ok, identifier[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[WARNING] HCCL(618646,python3.9):2025-04-03-09:27:49.717.494 [hccl_socket.cc:232] [618646][Close] socket's fdHandle is null, do not need close.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.717.514 [op_base.cc:2196] [618646]op_base comm destroy complete, take time [138981]us, group[192.168.0.44%enp67s0f5_60008_0_1743643662827273], deviceLogicId[0].
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.717.530 [device.cpp:183]618646 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.717.544 [api_impl.cc:3419] 618646 DeviceReset: reset device, device_id=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.717.558 [runtime.cc:3444] 618646 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0xa, reset:0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.717.568 [api_impl.cc:3449] 618646 DeviceReset: Succ, userDeviceId=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.717.577 [device.cpp:189]618646 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 0.
[INFO] HCCL_ADPT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.717.617 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:364] FinalizeHccl] Start destroy hccl adapter for GE_MODE
[INFO] HCCL_ADPT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.717.640 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:806] FinalizeHcclExec] Start finalize hccl exec.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.717.651 [hcom_executor.cc:40] [618646]Hcom Excutor Finalize start.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.717.800 [api_impl.cc:3419] 618973 DeviceReset: reset device, device_id=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.717.808 [api_impl.cc:3419] 618975 DeviceReset: reset device, device_id=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.717.824 [runtime.cc:3444] 618973 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x9, reset:0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.717.833 [runtime.cc:3444] 618975 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x8, reset:0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.717.837 [api_impl.cc:3449] 618973 DeviceReset: Succ, userDeviceId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.717.848 [api_impl.cc:3449] 618975 DeviceReset: Succ, userDeviceId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.718.063 [api_impl.cc:3419] 618976 DeviceReset: reset device, device_id=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.718.064 [api_impl.cc:3419] 618974 DeviceReset: reset device, device_id=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.718.085 [runtime.cc:3444] 618976 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x7, reset:0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.718.094 [runtime.cc:3444] 618974 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x6, reset:0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.718.097 [api_impl.cc:3449] 618976 DeviceReset: Succ, userDeviceId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.718.109 [api_impl.cc:3449] 618974 DeviceReset: Succ, userDeviceId=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.718.248 [api_impl.cc:3717] 618646 ContextSetCurrent: set context=aaab06c88220, flag=0.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.718.275 [adapter_rts.cc:321] [618646][hrtCtxSetCurrent] success
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.718.287 [stream.cc:182] [618646]Switch Ctx ret[0], curCtx[0xaaab06c88220], setCtx[0xaaab06c88220], stream id[5]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.718.305 [api_impl.cc:1228] 618646 StreamDestroy: stream_id=5.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.718.320 [acl_resource_manager.cpp:814]618646 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] GE(618646,python3.9):2025-04-03-09:27:49.718.349 [single_op_manager.cc:50]618646 ReleaseResource:ReleaseResource in. resource id = 0xaaab12110dd0
[INFO] GE(618646,python3.9):2025-04-03-09:27:49.718.370 [caching_allocator.cc:402]618646 TryFreeBlocks:Try free blocks.
[INFO] GE(618646,python3.9):2025-04-03-09:27:49.718.382 [caching_allocator.cc:358]618646 FreeCachedBlocks:Free cached blocks
[INFO] GE(618646,python3.9):2025-04-03-09:27:49.718.404 [npu_memory_allocator.cc:72]618646 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.718.416 [stream_executor.cpp:197]618646 RemoveExecutor: To remove executor by stream = 187651719237072
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.718.440 [acl_resource_manager.cpp:823]618646 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.718.454 [stream.cc:852] 618646 TearDown: stream_id=5, sqId=5, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.718.468 [stream.cc:938] 618646 TearDown: stream_id=5, delay recycle task num=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.718.480 [stream.cc:1507] 618646 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.718.508 [stream_sqcq_manage.cc:451] 618646 FreeLogicCq: Return(0), threadIdentifier(281472926821856), devId(0), tsId(0), cqId(492), isFastCq(0).
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.718.533 [npu_driver.cc:6163] 618646 StreamUnBindLogicCq: success: deviceId=0, tsId=0, streamId=5, logicCq=492.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.718.585 [npu_driver.cc:1180] 618646 LogicCqFree: Succ:device_id=0,ts_id=0,type=2,logic_cq_id=492, drvFlag=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.720.038 [stream.cc:237] 618646 FreeStreamId: Free stream_id=5.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.720.061 [stream_sqcq_manage.cc:216] 618646 DeAllocStreamSqCq: deviceId=0, tsId=0, drvFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.720.074 [npu_driver.cc:966] 618646 NormalSqCqFree: Normal sqcq free, sqId=5, cqId=5, device_id=0, tsId=0, drvFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.720.664 [npu_driver.cc:974] 618646 NormalSqCqFree: Normal sqcq free success, sqId=5, cqId=5, device_id=0, tsId=0, drvFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.720.681 [stream_sqcq_manage.cc:228] 618646 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=5, cq_id=5, stream_id=5, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.720.694 [npu_driver.cc:432] 618646 StreamIdFree: stream id free begin, device_id=0, stream_id=5, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.720.714 [npu_driver.cc:441] 618646 StreamIdFree: Stream id free success, stream_id=5, device_id=0, tsId=0, streamFlag=1536
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.721.375 [stream.cc:185] [618646][HCCL_TRACE]StreamDestroy, streamPtr[0xaaab12110dd0], stream id[5]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.721.392 [api_impl.cc:3717] 618646 ContextSetCurrent: set context=aaab06c88220, flag=0.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.721.405 [adapter_rts.cc:321] [618646][hrtCtxSetCurrent] success
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.721.416 [stream.cc:193] [618646]Restore Ctx ret[0], setCtx[0xaaab06c88220], stream id[5]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.721.486 [api_impl.cc:3717] 618646 ContextSetCurrent: set context=aaab06c88220, flag=0.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.721.501 [adapter_rts.cc:321] [618646][hrtCtxSetCurrent] success
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.721.512 [stream.cc:182] [618646]Switch Ctx ret[0], curCtx[0xaaab06c88220], setCtx[0xaaab06c88220], stream id[4]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.721.526 [api_impl.cc:1228] 618646 StreamDestroy: stream_id=4.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.721.539 [acl_resource_manager.cpp:814]618646 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] GE(618646,python3.9):2025-04-03-09:27:49.721.551 [single_op_manager.cc:50]618646 ReleaseResource:ReleaseResource in. resource id = 0xaaab12094d70
[INFO] GE(618646,python3.9):2025-04-03-09:27:49.721.564 [caching_allocator.cc:402]618646 TryFreeBlocks:Try free blocks.
[INFO] GE(618646,python3.9):2025-04-03-09:27:49.721.574 [caching_allocator.cc:358]618646 FreeCachedBlocks:Free cached blocks
[INFO] GE(618646,python3.9):2025-04-03-09:27:49.721.583 [npu_memory_allocator.cc:72]618646 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.721.593 [stream_executor.cpp:197]618646 RemoveExecutor: To remove executor by stream = 187651718729072
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.721.603 [acl_resource_manager.cpp:823]618646 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.721.614 [stream.cc:852] 618646 TearDown: stream_id=4, sqId=4, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.721.628 [stream.cc:938] 618646 TearDown: stream_id=4, delay recycle task num=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.721.637 [stream.cc:1507] 618646 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.721.657 [stream_sqcq_manage.cc:451] 618646 FreeLogicCq: Return(0), threadIdentifier(281472926821856), devId(0), tsId(0), cqId(491), isFastCq(0).
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.721.675 [npu_driver.cc:6163] 618646 StreamUnBindLogicCq: success: deviceId=0, tsId=0, streamId=4, logicCq=491.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.721.705 [npu_driver.cc:1180] 618646 LogicCqFree: Succ:device_id=0,ts_id=0,type=2,logic_cq_id=491, drvFlag=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.722.810 [stream.cc:237] 618646 FreeStreamId: Free stream_id=4.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.722.824 [stream_sqcq_manage.cc:216] 618646 DeAllocStreamSqCq: deviceId=0, tsId=0, drvFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.722.835 [npu_driver.cc:966] 618646 NormalSqCqFree: Normal sqcq free, sqId=4, cqId=4, device_id=0, tsId=0, drvFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.723.252 [npu_driver.cc:974] 618646 NormalSqCqFree: Normal sqcq free success, sqId=4, cqId=4, device_id=0, tsId=0, drvFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.723.266 [stream_sqcq_manage.cc:228] 618646 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=4, cq_id=4, stream_id=4, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.723.280 [npu_driver.cc:432] 618646 StreamIdFree: stream id free begin, device_id=0, stream_id=4, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.723.295 [npu_driver.cc:441] 618646 StreamIdFree: Stream id free success, stream_id=4, device_id=0, tsId=0, streamFlag=1536
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.723.947 [stream.cc:185] [618646][HCCL_TRACE]StreamDestroy, streamPtr[0xaaab12094d70], stream id[4]
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.723.963 [api_impl.cc:3717] 618646 ContextSetCurrent: set context=aaab06c88220, flag=0.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.723.986 [adapter_rts.cc:321] [618646][hrtCtxSetCurrent] success
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.723.998 [stream.cc:193] [618646]Restore Ctx ret[0], setCtx[0xaaab06c88220], stream id[4]
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.031 [hcom_executor.cc:45] [618646][Finalize][HcomExecutor]Hcom Excutor Finalize end. ret[0]
[INFO] HCCL_ADPT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.724.062 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:814] FinalizeHcclExec] HcclExec destroy success
[INFO] HCCL_ADPT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.724.083 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:616] FinalizeKernelInfoStore] Start destroy hccl kernel info store.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.094 [hcom_ops_kernel_info_store.cc:3423] [618646]finalize hccl kernel info store.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.111 [hcom_common.cc:85] [618646][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[0] 
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.130 [plugin_manager.cc:56] [618646]hccl ops plugin finalize start.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.145 [hcom_plugin.cc:90] [618646]Finalize start.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.234 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[0].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.249 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.260 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.270 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.299 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[1].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.310 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.319 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.329 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.347 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[2].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.358 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.367 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.378 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.396 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[3].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.407 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.416 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.425 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.444 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[4].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.455 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.464 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.473 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.491 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[5].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.502 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.511 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.529 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.547 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[6].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.558 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.566 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.576 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.593 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[7].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.604 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.613 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.622 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.640 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[8].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.651 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.660 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.670 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.687 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[9].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.699 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.707 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.716 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.735 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[10].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.746 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.754 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.763 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.782 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[11].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.793 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.802 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.810 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.830 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[12].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.841 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.849 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.858 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.879 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[13].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.890 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.899 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.908 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.927 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[14].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.943 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.952 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.962 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.980 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[15].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.991 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.724.999 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.008 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.018 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[16].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.028 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.036 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.045 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.056 [hcom_plugin.cc:119] [618646]Finalize: HcomDestroy success.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.066 [plugin_manager.cc:62] [618646]hccl ops plugin finalize end. ret[0]
[INFO] HCCL_ADPT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.725.135 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:638] FinalizeKernelInfoStore] Destroy hccl kernel info store success.
[INFO] HCCL_ADPT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.725.154 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:695] FinalizeHcclComm] Start finalize hccl comm.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.164 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[0].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.178 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.187 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.197 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.206 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[1].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.215 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.224 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.233 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.241 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[2].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.252 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.260 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.269 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.279 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[3].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.288 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.298 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.307 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.317 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[4].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.334 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.343 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.353 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.362 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[5].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.371 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.379 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.388 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.397 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[6].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.406 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.414 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.424 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.433 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[7].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.443 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.451 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.460 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.468 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[8].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.479 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.487 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.496 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.505 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[9].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.516 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.524 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.533 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.541 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[10].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.551 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.559 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.568 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.578 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[11].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.587 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.597 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.606 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.614 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[12].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.624 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.633 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.659 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.668 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[13].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.678 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.687 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.695 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.705 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[14].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.714 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.723 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.733 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.741 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[15].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.751 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.759 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.768 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.776 [hcom_common.cc:958] [618646][Destroy][Result]hcomInfo[16].isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.786 [hcom_common.cc:961] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.795 [hcom.cc:337] [618646][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:49.725.804 [hcom.cc:340] [618646]Entry-HcomDestroy:void skip
[INFO] HCCL_ADPT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.725.824 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:377] FinalizeHccl] Destroy hccl adapter success.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.725.841 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:613] DestroyHccl] Hccl destroy successful.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.017 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	In used mem buf info for Mem buf allocator, is persistent : 1, stream id : 0., mem_bufs size : 1
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.036 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	In used mem buf info for Mem buf allocator, is persistent : 0, stream id : 0., mem_bufs size : 1
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.050 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] stream id : 0, is persistent : 0
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.063 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] Dump state info for Mem buf allocator, is persistent : 0, stream id : 0.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.077 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block info - total count : 1
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.090 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 		{"addr_":0x12d100000000,"size_":61025026048,"stream_id_":0,"min_addr_":0x12d100000000,"max_addr_":0x12d100000200}
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.103 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block total size : 61025026048
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.124 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Free mem buf total size : 0, total count : 0
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.137 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Eager free mem buf total size : 61025025536, total count : 1
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.150 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] stream id : 0, is persistent : 1
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.163 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] Dump state info for Mem buf allocator, is persistent : 1, stream id : 0.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.177 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block info - total count : 1
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.190 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 		{"addr_":0x12c2c0000000,"size_":61025026048,"stream_id_":0,"min_addr_":0x12c2c0000000,"max_addr_":0x12c2c0000200}
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.203 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block total size : 61025026048
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.216 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Free mem buf total size : 0, total count : 0
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.227 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Eager free mem buf total size : 61025025536, total count : 1
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.240 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] The dynamic memory pool[DefaultAscendMemoryPool] stat info : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":116396.00MB,"idle mem":116395.99MB,"used by event mem":0.00MB,"eager free mem":116395.99MB}, actual peak used mem:4M. Weight used size:0M, constant value used size:0M, kernel output used size:0M, other used size:0M.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.264 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:430] ReleaseDeviceRes] Release device resource for DefaultAscendMemoryPool : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":116396.00MB,"idle mem":116395.99MB,"used by event mem":0.00MB,"eager free mem":116395.99MB}.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.280 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:62] ReleaseDeviceRes] Release device resource for allocator, Mem buf allocator, is persistent : 0, stream id : 0., mem_blocks_ size : 1.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.297 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:65] ReleaseDeviceRes] Clean mem block : {"addr_":0x12d100000000,"size_":61025026048,"stream_id_":0,"min_addr_":0x12d100000000,"max_addr_":0x12d100000200}.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.312 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:191] FreeDeviceMem] Max actual used memory size is 4194304
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.326 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:194] FreeDeviceMem] Max peak used memory size is 1024
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.343 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:69] ReleaseDeviceRes] Delete mem block : {"addr_":0x12d100000000,"size_":61025026048,"stream_id_":0,"min_addr_":0x12d100000000,"max_addr_":0x12d100000200}.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.363 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:74] ReleaseDeviceRes] Free mem buf size : 0.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.376 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:80] ReleaseDeviceRes] Eager free mem buf size : 1.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.392 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:62] ReleaseDeviceRes] Release device resource for allocator, Mem buf allocator, is persistent : 1, stream id : 0., mem_blocks_ size : 1.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.407 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:65] ReleaseDeviceRes] Clean mem block : {"addr_":0x12c2c0000000,"size_":61025026048,"stream_id_":0,"min_addr_":0x12c2c0000000,"max_addr_":0x12c2c0000200}.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.422 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:191] FreeDeviceMem] Max actual used memory size is 4194304
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.435 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:194] FreeDeviceMem] Max peak used memory size is 1024
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.450 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:69] ReleaseDeviceRes] Delete mem block : {"addr_":0x12c2c0000000,"size_":61025026048,"stream_id_":0,"min_addr_":0x12c2c0000000,"max_addr_":0x12c2c0000200}.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.464 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:74] ReleaseDeviceRes] Free mem buf size : 0.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.475 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:80] ReleaseDeviceRes] Eager free mem buf size : 1.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.490 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:45] ~MemBufAllocator] MemBufAllocator[0xfffe7007d690] : Mem buf allocator, is persistent : 1, stream id : 0. deconstruct.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.505 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:45] ~MemBufAllocator] MemBufAllocator[0xfffe7007df80] : Mem buf allocator, is persistent : 0, stream id : 0. deconstruct.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.726.525 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:222] DeInitialize] Ascend Memory Adapter deinitialize success, statistics:
Device MOC memory size: 62420M
MindSpore Used memory size: 58198M
Used peak memory usage (without fragments): 0M
Actual peak memory usage (with fragments): 4M

[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.726.543 [callback.cpp:37]618646 aclrtSetExceptionInfoCallback: start to execute aclrtSetExceptionInfoCallback.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.726.561 [callback.cpp:44]618646 aclrtSetExceptionInfoCallback: successfully execute aclrtSetExceptionInfoCallback
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.726.591 [context.cpp:72]618646 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.726.604 [api_impl.cc:3717] 618646 ContextSetCurrent: set context=aaab06c88220, flag=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.726.617 [context.cpp:80]618646 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.726.630 [stream.cpp:75]618646 aclrtDestroyStream: start to execute aclrtDestroyStream
[INFO] GE(618646,python3.9):2025-04-03-09:27:49.726.647 [stream_manage_func_registry.cc:22]618646 TryCallStreamMngFunc:Stream manage func is not found, FuncType is [0]
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.726.659 [stream.cpp:80]618646 aclrtDestroyStream: try to call stream manage function success, action type is DESTROY_STREAM.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.726.678 [api_impl.cc:1228] 618646 StreamDestroy: stream_id=2.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.726.691 [acl_resource_manager.cpp:814]618646 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] GE(618646,python3.9):2025-04-03-09:27:49.726.702 [single_op_manager.cc:50]618646 ReleaseResource:ReleaseResource in. resource id = 0xaaab07cd7cf0
[INFO] GE(618646,python3.9):2025-04-03-09:27:49.726.714 [caching_allocator.cc:402]618646 TryFreeBlocks:Try free blocks.
[INFO] GE(618646,python3.9):2025-04-03-09:27:49.726.725 [caching_allocator.cc:358]618646 FreeCachedBlocks:Free cached blocks
[INFO] GE(618646,python3.9):2025-04-03-09:27:49.726.734 [npu_memory_allocator.cc:72]618646 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.726.744 [stream_executor.cpp:197]618646 RemoveExecutor: To remove executor by stream = 187651547036912
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.726.754 [acl_resource_manager.cpp:823]618646 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.726.766 [stream.cc:852] 618646 TearDown: stream_id=2, sqId=2, pendingNum=0, isForceRecycle_=0, flag=0, failMode=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.726.779 [stream.cc:938] 618646 TearDown: stream_id=2, delay recycle task num=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.726.806 [event.cc:1036] 618646 WaitForBusy: device_id=0, event_id=0 finished map already empty.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.726.820 [npu_driver.cc:626] 618646 EventIdFree: event id free begin, device_id=0, event_id=0, ts_id=0, remote_event_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.726.843 [raw_device.cc:1158] 618646 FreeEventIdFromDrv: device_id=0, event_id=0 tear down.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.726.855 [event.cc:61] 618646 ~Event: device_id=0, event deconstruct, recordSize=0, waitSize=0, idSize=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.726.880 [npu_driver.cc:3803] 618646 SqCqFree: deviceId=0, tsId=0, sqId=133, cqId=133
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.726.918 [subscribe.cc:244] 618646 Delete: delete callback subscribe: groupId=64, threadId=281471050575776, devId=0, tsId=0, streamId=2, sqId=133, cqId=133
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:49.726.922 [trs_sqcq.c:1491][ascend][curpid:618646,618836][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.726.934 [stream.cc:1507] 618646 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.726.945 [npu_driver.cc:3833] 618836 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.726.963 [api_impl.cc:5058] 618836 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.726.965 [stream_sqcq_manage.cc:451] 618646 FreeLogicCq: Return(0), threadIdentifier(281472926821856), devId(0), tsId(0), cqId(489), isFastCq(0).
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.726.981 [callback.cpp:132]618836 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.726.992 [npu_driver.cc:6163] 618646 StreamUnBindLogicCq: success: deviceId=0, tsId=0, streamId=2, logicCq=489.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.726.999 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.017 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.030 [npu_driver.cc:1180] 618646 LogicCqFree: Succ:device_id=0,ts_id=0,type=2,logic_cq_id=489, drvFlag=0.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.033 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.075 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.090 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.103 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.115 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.130 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.141 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.154 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.168 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.180 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.193 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.206 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.220 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.236 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.246 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.259 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.274 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.287 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.299 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.314 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.325 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.337 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.352 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.363 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.392 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.405 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.418 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.433 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.444 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.456 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.471 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.483 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.495 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.510 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.520 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.533 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.545 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.558 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.570 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.585 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.596 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.608 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.623 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.634 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.646 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.661 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.672 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.685 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.699 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.727 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.738 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.751 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.763 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.777 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.788 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.801 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.815 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.826 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.839 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.852 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.867 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.878 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.890 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.906 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.917 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.929 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.944 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.955 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.727.967 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.982 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.727.993 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.005 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.020 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.031 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.056 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.068 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.080 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.096 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.107 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.119 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.134 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.147 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.189 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.204 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.215 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.227 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.239 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.252 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.264 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.279 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.279 [stream.cc:237] 618646 FreeStreamId: Free stream_id=2.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.291 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.301 [stream_sqcq_manage.cc:216] 618646 DeAllocStreamSqCq: deviceId=0, tsId=0, drvFlag=0
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.309 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.318 [npu_driver.cc:966] 618646 NormalSqCqFree: Normal sqcq free, sqId=2, cqId=2, device_id=0, tsId=0, drvFlag=0
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.327 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.344 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.359 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.369 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.403 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.416 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.428 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.445 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.456 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.468 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.483 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.494 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.506 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.521 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.531 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.545 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.557 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.570 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.582 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.597 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.608 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.621 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.636 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.647 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.659 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.674 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.685 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.698 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.712 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.734 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.748 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.761 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.774 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.789 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.800 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.812 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.806 [npu_driver.cc:974] 618646 NormalSqCqFree: Normal sqcq free success, sqId=2, cqId=2, device_id=0, tsId=0, drvFlag=0
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.827 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.841 [stream_sqcq_manage.cc:228] 618646 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=2, cq_id=2, stream_id=2, is_sq_need_release=1, drvFlag=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.846 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.863 [npu_driver.cc:432] 618646 StreamIdFree: stream id free begin, device_id=0, stream_id=2, ts_id=0, remote_stream_id=0
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.865 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.887 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.888 [npu_driver.cc:441] 618646 StreamIdFree: Stream id free success, stream_id=2, device_id=0, tsId=0, streamFlag=1536
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.900 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.911 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.924 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.936 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.949 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.964 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.728.974 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.987 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.728.999 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.018 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.029 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.041 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.054 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.068 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.079 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.092 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.106 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.117 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.129 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.142 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.157 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.168 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.180 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.193 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.207 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.218 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.230 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.243 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.258 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.269 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.281 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.294 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.309 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.320 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.346 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.357 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.370 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.385 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.396 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.409 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.423 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.436 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.448 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.463 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.474 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.485 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.498 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.511 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.523 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.538 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.550 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.562 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.577 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.588 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.600 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.616 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.627 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.640 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.654 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.678 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.689 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.703 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.717 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.729 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.741 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.757 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.768 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.780 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.795 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.806 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.819 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.832 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.845 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.860 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.870 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.883 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.899 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.910 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.922 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.938 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.950 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.962 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.729.977 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.729.990 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.012 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.023 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.036 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.051 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.061 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.074 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.086 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.101 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.111 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.123 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.135 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.148 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.160 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.175 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.186 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.198 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.213 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.224 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.236 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.249 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.263 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.275 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.286 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.299 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.318 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.329 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.341 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.354 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.369 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.380 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.392 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.405 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.420 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.431 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.445 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.458 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.470 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.482 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.497 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.508 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.520 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.532 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.547 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.558 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.569 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.582 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.597 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.608 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.620 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.644 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.655 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.668 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.683 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.694 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.707 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.723 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.733 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.746 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.760 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.771 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.784 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.797 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.809 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.825 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.835 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.848 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.862 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.874 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.886 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.900 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.911 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.923 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.938 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.949 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.730.973 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.986 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.730.998 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.013 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.024 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.037 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.052 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.063 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.075 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.090 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.101 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.113 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.126 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.139 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.151 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.166 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.176 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.188 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.204 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.215 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.227 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.243 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.254 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.267 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.282 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.299 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.311 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.324 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.336 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.352 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.362 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.374 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.389 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.400 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.412 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.425 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.437 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.450 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.464 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.475 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.487 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.500 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.513 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.528 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.538 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.551 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.563 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.578 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.588 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.601 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.636 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.649 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.661 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.677 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.689 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.701 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.716 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.728 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.740 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.752 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.760 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.768 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.776 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.787 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.799 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.812 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.826 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.838 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.850 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.865 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.876 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.888 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.903 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.914 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.941 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.954 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.731.968 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.983 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.731.994 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.007 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.022 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.034 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.046 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.061 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.072 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.085 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.098 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.111 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.126 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.138 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.150 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.180 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.189 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.198 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.206 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.221 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.232 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.245 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.258 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.278 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.288 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.300 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.313 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.328 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.338 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.350 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.363 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.378 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.389 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.401 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.415 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.426 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.438 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.454 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.464 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.476 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.491 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.503 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.515 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.529 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.540 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.553 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.565 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.580 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.596 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.608 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.621 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.634 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.646 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.661 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.671 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.684 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.698 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.709 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.722 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.735 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.748 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.761 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.775 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.786 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.798 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.814 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.824 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.836 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.851 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.862 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.874 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.889 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.899 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.926 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.937 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.950 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.963 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.732.960 [stream.cpp:87]618646 aclrtDestroyStream: aclrtDestroyStream success
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.732.978 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.009 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.733.021 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.733.036 [callback.cpp:116]618836 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.048 [subscribe.cc:308] 618836 GetGroupIdByThreadId: can not find subscribe info, threadId=281471050575776
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.733.051 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:137] UnRegCallback] Unregister callback thread, stream : 0xaaab07cd7cf0.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.060 [api_impl.cc:5043] 618836 ProcessReport: get groupId fail, threadIdentifier=281471050575776, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.733.084 [callback.cpp:130]618836 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.733.083 [stream.cpp:75]618646 aclrtDestroyStream: start to execute aclrtDestroyStream
[INFO] GE(618646,python3.9):2025-04-03-09:27:49.733.115 [stream_manage_func_registry.cc:22]618646 TryCallStreamMngFunc:Stream manage func is not found, FuncType is [0]
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.733.132 [stream.cpp:80]618646 aclrtDestroyStream: try to call stream manage function success, action type is DESTROY_STREAM.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.151 [api_impl.cc:1228] 618646 StreamDestroy: stream_id=3.
[INFO] DEVICE(618646,ffff15fbefa0,python3.9):2025-04-03-09:27:49.733.163 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/callback_thread.cc:42] callback_thread_func] Exit callback thread loop.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.733.179 [acl_resource_manager.cpp:814]618646 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] GE(618646,python3.9):2025-04-03-09:27:49.733.203 [single_op_manager.cc:50]618646 ReleaseResource:ReleaseResource in. resource id = 0xaaab07e09880
[INFO] GE(618646,python3.9):2025-04-03-09:27:49.733.227 [caching_allocator.cc:402]618646 TryFreeBlocks:Try free blocks.
[INFO] GE(618646,python3.9):2025-04-03-09:27:49.733.243 [caching_allocator.cc:358]618646 FreeCachedBlocks:Free cached blocks
[INFO] GE(618646,python3.9):2025-04-03-09:27:49.733.256 [npu_memory_allocator.cc:72]618646 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.733.271 [stream_executor.cpp:197]618646 RemoveExecutor: To remove executor by stream = 187651548289152
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.733.287 [acl_resource_manager.cpp:823]618646 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.326 [stream.cc:852] 618646 TearDown: stream_id=3, sqId=3, pendingNum=0, isForceRecycle_=0, flag=0, failMode=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.346 [stream.cc:938] 618646 TearDown: stream_id=3, delay recycle task num=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.362 [event.cc:1036] 618646 WaitForBusy: device_id=0, event_id=1 finished map already empty.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.382 [npu_driver.cc:626] 618646 EventIdFree: event id free begin, device_id=0, event_id=1, ts_id=0, remote_event_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.416 [raw_device.cc:1158] 618646 FreeEventIdFromDrv: device_id=0, event_id=1 tear down.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.431 [event.cc:61] 618646 ~Event: device_id=0, event deconstruct, recordSize=0, waitSize=0, idSize=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.451 [npu_driver.cc:3803] 618646 SqCqFree: deviceId=0, tsId=0, sqId=134, cqId=134
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.501 [subscribe.cc:244] 618646 Delete: delete callback subscribe: groupId=65, threadId=281471042121632, devId=0, tsId=0, streamId=3, sqId=134, cqId=134
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:49.733.504 [trs_sqcq.c:1491][ascend][curpid:618646,618837][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=0; type=1; ret=16)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.519 [stream.cc:1507] 618646 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.530 [npu_driver.cc:3833] 618837 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=0, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.547 [api_impl.cc:5058] 618837 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.733.562 [callback.cpp:132]618837 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.566 [stream_sqcq_manage.cc:451] 618646 FreeLogicCq: Return(0), threadIdentifier(281472926821856), devId(0), tsId(0), cqId(490), isFastCq(0).
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.733.575 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.590 [npu_driver.cc:6163] 618646 StreamUnBindLogicCq: success: deviceId=0, tsId=0, streamId=3, logicCq=490.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.592 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.617 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.733.630 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.638 [npu_driver.cc:1180] 618646 LogicCqFree: Succ:device_id=0,ts_id=0,type=2,logic_cq_id=490, drvFlag=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.733.641 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.665 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.676 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.733.686 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.733.696 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.717 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.727 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.733.737 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.733.746 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.757 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.766 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.733.776 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.733.785 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.796 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.805 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.733.814 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.733.823 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.833 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.842 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.733.853 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.733.862 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.873 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.882 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.733.892 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.733.902 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.911 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.921 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.733.931 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.733.941 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.950 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.965 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.733.977 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.733.987 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.733.996 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.006 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.015 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.026 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.035 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.045 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.055 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.063 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.073 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.082 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.092 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.101 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.112 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.120 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.131 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.140 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.151 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.159 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.170 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.179 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.189 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.198 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.212 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.221 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.232 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.241 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.251 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.260 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.271 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.279 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.290 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.299 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.308 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.318 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.327 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.337 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.348 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.358 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.367 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.377 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.387 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.397 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.407 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.415 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.426 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.435 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.452 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.462 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.472 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.481 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.492 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.500 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.511 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.520 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.530 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.539 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.548 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.557 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.566 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.575 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.584 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.593 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.603 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.613 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.624 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.632 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.643 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.654 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.664 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.674 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.684 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.697 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.707 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.717 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.727 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.736 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.746 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.754 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.764 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.775 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.784 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.793 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.802 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.812 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.821 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.831 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.842 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.851 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.861 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.870 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.881 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.890 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.901 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.910 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.921 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.924 [stream.cc:237] 618646 FreeStreamId: Free stream_id=3.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.930 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.956 [stream_sqcq_manage.cc:216] 618646 DeAllocStreamSqCq: deviceId=0, tsId=0, drvFlag=0
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.961 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.972 [npu_driver.cc:966] 618646 NormalSqCqFree: Normal sqcq free, sqId=3, cqId=3, device_id=0, tsId=0, drvFlag=0
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.734.978 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.734.995 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.006 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.016 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.026 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.035 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.044 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.053 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.063 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.072 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.082 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.092 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.101 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.110 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.120 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.130 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.140 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.149 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.160 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.170 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.180 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.196 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.205 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.216 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.225 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.235 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.244 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.253 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.263 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.273 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.282 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.291 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.300 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.310 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.319 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.329 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.338 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.348 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.357 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.368 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.377 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.387 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.396 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.406 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.415 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.425 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.439 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.449 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.459 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.468 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.465 [npu_driver.cc:974] 618646 NormalSqCqFree: Normal sqcq free success, sqId=3, cqId=3, device_id=0, tsId=0, drvFlag=0
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.479 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.500 [stream_sqcq_manage.cc:228] 618646 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=3, cq_id=3, stream_id=3, is_sq_need_release=1, drvFlag=0.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.507 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.523 [npu_driver.cc:432] 618646 StreamIdFree: stream id free begin, device_id=0, stream_id=3, ts_id=0, remote_stream_id=0
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.528 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.547 [npu_driver.cc:441] 618646 StreamIdFree: Stream id free success, stream_id=3, device_id=0, tsId=0, streamFlag=1536
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.549 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.576 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.585 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.596 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.605 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.615 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.624 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.634 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.643 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.653 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.662 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.673 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.682 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.698 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.708 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.718 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.727 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.736 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.745 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.755 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.763 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.773 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.784 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.792 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.801 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.811 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.821 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.831 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.840 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.850 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.860 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.870 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.880 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.888 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.899 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.909 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.918 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.928 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.942 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.951 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.962 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.735.973 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.982 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.735.993 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.736.002 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.736.012 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.736.022 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.736.031 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.736.040 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.736.049 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.736.059 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.736.067 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.736.078 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.736.087 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.736.098 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.736.110 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.736.119 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.736.128 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.736.137 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.736.147 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.736.169 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.736.181 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.736.186 [event.cc:61] 618646 ~Event: device_id=0, event deconstruct, recordSize=0, waitSize=0, idSize=0
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.736.191 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.736.232 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.736.236 [stream.cpp:87]618646 aclrtDestroyStream: aclrtDestroyStream success
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.736.244 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.736.262 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.736.273 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.736.282 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.736.293 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.736.295 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:137] UnRegCallback] Unregister callback thread, stream : 0xaaab07e09880.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.736.303 [callback.cpp:116]618837 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.736.331 [subscribe.cc:308] 618837 GetGroupIdByThreadId: can not find subscribe info, threadId=281471042121632
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.736.330 [device.cpp:183]618646 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 0.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:49.736.340 [api_impl.cc:5043] 618837 ProcessReport: get groupId fail, threadIdentifier=281471042121632, reCode=0x7160004
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.736.358 [callback.cpp:130]618837 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.736.357 [api_impl.cc:3419] 618646 DeviceReset: reset device, device_id=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.736.381 [runtime.cc:3444] 618646 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x5, reset:0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.736.399 [api_impl.cc:3449] 618646 DeviceReset: Succ, userDeviceId=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.736.411 [device.cpp:189]618646 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 0.
[INFO] DEVICE(618646,ffff157aefa0,python3.9):2025-04-03-09:27:49.736.418 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/callback_thread.cc:42] callback_thread_func] Exit callback thread loop.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.736.441 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:206] ReleaseDeviceRes] Ascend finalize end
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.736.507 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] The dynamic memory pool[DefaultAscendMemoryPool] stat info : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":0.00MB,"idle mem":0.00MB,"used by event mem":0.00MB,"eager free mem":0.00MB}, actual peak used mem:4M. Weight used size:0M, constant value used size:0M, kernel output used size:0M, other used size:0M.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.736.536 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:430] ReleaseDeviceRes] Release device resource for DefaultAscendMemoryPool : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":0.00MB,"idle mem":0.00MB,"used by event mem":0.00MB,"eager free mem":0.00MB}.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.736.569 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:217] DeInitialize] DeInitialize Ascend Memory Adapter when it is not initialize
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.736.588 [callback.cpp:37]618646 aclrtSetExceptionInfoCallback: start to execute aclrtSetExceptionInfoCallback.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:49.736.612 [callback.cpp:44]618646 aclrtSetExceptionInfoCallback: successfully execute aclrtSetExceptionInfoCallback
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.736.637 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ascend_deprecated_interface.cc:118] CloseTsd] Start to close tsd, ref = 1
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:49.736.664 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel _npu_log begins the destruction process.
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:49.764.169 [trs_cb_event.c:119][ascend][curpid:618666,618809][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=5, tid =65; ret=16)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:49.764.195 [trs_sqcq.c:1491][ascend][curpid:618666,618809][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.764.214 [npu_driver.cc:3833] 618809 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.764.229 [api_impl.cc:5058] 618809 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.764.240 [callback.cpp:132]618809 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.764.255 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.764.270 [npu_driver.cc:3828] 618809 CqReportIrqWait: Irq wait start, deviceId=5, tsId=0, groupId=65.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.782.346 [op_base.cc:2136] [618670]Entry-HcclCommDestroy: op_base comm destroy begin
[INFO] DEVICE(618670,fffec4f9efa0,python3.9):2025-04-03-09:27:49.782.358 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:177] WatchDogProcess] end
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.782.380 [runtime.cc:5239] 618670 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.782.398 [adapter_rts.cc:198] [618670][hrtGetDeviceRefresh]deviceLogicId[6]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.782.417 [op_base.cc:2151] [618670][HcclCommDestroy] comm state is IDLE
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.782.438 [op_base.cc:128] [618670][HcclGetDeviceId] deviceLogicId[6] 
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.782.473 [op_base.cc:2168] [618670]com is not global com
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.782.494 [hcom_plugin.cc:381] [618670][Unset][GroupTopoInfo]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.782.548 [hccl_comm.cc:1375] [618670]UnRegistTaskAbortHandler begin
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.782.566 [task_abort_handler.cc:140] [618670]TaskAbortHandler::DeInit commVector size is [1], ref_ count is [1]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.782.583 [api_impl.cc:4192] 618670 SetTaskAbortCallBack: set task abort callback.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.782.601 [runtime.cc:4698] 618670 SetTaskAbortCallBack: SetTaskAbortCallBack finish, moduleName:HCCL.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.782.621 [hccl_communicator.cc:2112] [618670][HcclCommunicator][DestroyAicpuComm]start to destroy the aicpu comm, group[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[WARNING] HCCL(618670,python3.9):2025-04-03-09:27:49.782.637 [hccl_communicator.cc:2114] [618670][HcclCommunicator][DestroyAicpuComm]Device type is not A3, no needs to destroy the aicpu comm.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.782.649 [hccl_communicator.cc:2082] [618670]start to stop the backGround Thread
[WARNING] HCCL(618670,python3.9):2025-04-03-09:27:49.782.664 [heartbeat.cc:1203] [618670]Heartbeat has been destroyed
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.782.679 [heartbeat.cc:451] [618670][UnRegisterRanks]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] UnregisterRanks Start.
[WARNING] HCCL(618670,python3.9):2025-04-03-09:27:49.782.691 [heartbeat.cc:452] [618670]Heartbeat has been destroyed
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.782.706 [hccl_impl.cc:69] [618670]start hccl resources destruction:deviceLogicId[6]
[WARNING] HCCL(618670,python3.9):2025-04-03-09:27:49.782.724 [heartbeat.cc:1203] [618670]Heartbeat has been destroyed
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.782.737 [heartbeat.cc:451] [618670][UnRegisterRanks]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] UnregisterRanks Start.
[WARNING] HCCL(618670,python3.9):2025-04-03-09:27:49.782.752 [heartbeat.cc:452] [618670]Heartbeat has been destroyed
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.782.850 [api_impl.cc:2003] 618670 DevFree: device free mem=0x12c280003000
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.783.000 [task_exception_handler.cc:1232] [618670]deInit taskFailCallback
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.783.554 [api_impl.cc:2003] 618670 DevFree: device free mem=0x12c2800a5000
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.783.577 [api_impl.cc:2003] 618670 DevFree: device free mem=0x12c280004000
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.783.617 [api_error.cc:1278] 618670 HostFree: Free host memory succeed, host addr=0x12c0807f0000.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.783.635 [api_impl.cc:2003] 618670 DevFree: device free mem=0x12c280146000
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.783.674 [hccl_socket_manager.cc:81] [618670][DeInit][Server]ip[192.168.2.193] port[16666] serverSocketRef.Count() = 0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.783.692 [hccl_socket_manager.cc:83] [618670][DeInit][Server]ip[192.168.2.193] port[16666]
[WARNING] HCCL(618670,python3.9):2025-04-03-09:27:49.783.704 [hccl_socket.cc:232] [618670][Close] socket's fdHandle is null, do not need close.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.783.717 [network_manager.cc:69] [618670]NetworkManager::GetInstance deviceLogicID[6].
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.783.747 [network_manager.cc:458] [618670]NetworkManager devicePhyId_[6] vnic stopped. refcount[0]
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:49.783.779 [ra_host.c:911]tid:618670,ra_socket_listen_stop(911) : Input parameters: [0]th, phy_id[6], local_ip[192.168.2.193]
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:49.784.079 [ra_host.c:404]tid:618670,ra_socket_deinit(404) : Input parameters: phy_id[6] family[2] local_ip[192.168.2.193]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.784.207 [hccl_socket.cc:68] [618670][HcclSocket][DeInit] device[6] stops listen on ip[192.168.2.193], port[16666] success, socketType[0].
[WARNING] HCCL(618670,python3.9):2025-04-03-09:27:49.784.229 [hccl_socket.cc:232] [618670][Close] socket's fdHandle is null, do not need close.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.784.251 [hccl_communicator.cc:1741] [618670][HcclCommunicator][ReleasePreemptSocket] release all preempt socket success, comm id[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.784.269 [network_manager.cc:69] [618670]NetworkManager::GetInstance deviceLogicID[6].
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:49.784.282 [ra_host.c:248]tid:618670,ra_deinit(248) : Input parameters: phy_id[6], nic_position:[1]
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:49.784.299 [ra_hdc.c:651]tid:618670,ra_hdc_deinit(651) : hdc deinit start! phy_id[6]
[INFO] DRV(618670,python3.9):2025-04-03-09:27:49.784.386 [hdc_client.c:417][ascend][curpid:618670,618670][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4196)
[INFO] ROCE(618670,python3.9):2025-04-03-09:27:49.784.459 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] HCCP(618670,python3.9):2025-04-03-09:27:49.784.475 [ra_hdc.c:685]tid:618670,ra_hdc_deinit(685) : hdc deinit OK! phy_id[6]
[INFO] ROCE(618670,python3.9):2025-04-03-09:27:49.784.487 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] TDT(618670,python3.9):2025-04-03-09:27:49.784.561 [tsd_client.cpp:189][TsdCapabilityGet][tid:618670] TsdCapabilityGet Begin.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:49.784.578 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618670] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:49.784.589 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618670] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:49.784.602 [process_mode_manager.cpp:1042][CapabilityGet][tid:618670] [ProcessModeManager] enter into CapabilityGet process deviceId[6] type[6]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.784.619 [adapter_tdt.cc:66] [618670]Get TsdCapability success. deviceLogicId[6]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:49.784.635 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618670] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:49.784.657 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618670] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:49.784.674 [process_mode_manager.cpp:1735][ProcessCloseSubProcList][tid:618670] enter ExcuteClosePidList cnt:1, tsdSupportLevel_:63
[INFO] TDT(618670,python3.9):2025-04-03-09:27:49.784.690 [process_mode_manager.cpp:1794][ExcuteClosePidList][tid:618670] add close subproc:29795, proctype:0
[INFO] TDT(618670,python3.9):2025-04-03-09:27:49.784.726 [hdc_client.cpp:154][TsdRecvData][tid:618670] recv timeout is:150000 ms
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.784.759 [op_base.cc:2136] [618650]Entry-HcclCommDestroy: op_base comm destroy begin
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.784.754 [op_base.cc:2136] [618658]Entry-HcclCommDestroy: op_base comm destroy begin
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.784.787 [runtime.cc:5239] 618658 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] DEVICE(618658,fffec5fbefa0,python3.9):2025-04-03-09:27:49.784.782 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:177] WatchDogProcess] end
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.784.813 [adapter_rts.cc:198] [618658][hrtGetDeviceRefresh]deviceLogicId[3]
[INFO] DEVICE(618650,fffed8f9efa0,python3.9):2025-04-03-09:27:49.784.780 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:177] WatchDogProcess] end
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.784.789 [runtime.cc:5239] 618650 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.784.835 [adapter_rts.cc:198] [618650][hrtGetDeviceRefresh]deviceLogicId[1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.784.869 [op_base.cc:2151] [618650][HcclCommDestroy] comm state is IDLE
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.784.861 [op_base.cc:2151] [618658][HcclCommDestroy] comm state is IDLE
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.784.891 [op_base.cc:128] [618658][HcclGetDeviceId] deviceLogicId[3] 
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.784.894 [op_base.cc:128] [618650][HcclGetDeviceId] deviceLogicId[1] 
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.784.924 [op_base.cc:2168] [618650]com is not global com
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.784.928 [op_base.cc:2168] [618658]com is not global com
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.784.940 [hcom_plugin.cc:381] [618650][Unset][GroupTopoInfo]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.784.950 [hcom_plugin.cc:381] [618658][Unset][GroupTopoInfo]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.785.000 [hccl_comm.cc:1375] [618650]UnRegistTaskAbortHandler begin
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.785.020 [task_abort_handler.cc:140] [618650]TaskAbortHandler::DeInit commVector size is [1], ref_ count is [1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.785.011 [hccl_comm.cc:1375] [618658]UnRegistTaskAbortHandler begin
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.785.033 [task_abort_handler.cc:140] [618658]TaskAbortHandler::DeInit commVector size is [1], ref_ count is [1]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.785.049 [api_impl.cc:4192] 618650 SetTaskAbortCallBack: set task abort callback.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.785.065 [runtime.cc:4698] 618650 SetTaskAbortCallBack: SetTaskAbortCallBack finish, moduleName:HCCL.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.785.068 [api_impl.cc:4192] 618658 SetTaskAbortCallBack: set task abort callback.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.785.088 [runtime.cc:4698] 618658 SetTaskAbortCallBack: SetTaskAbortCallBack finish, moduleName:HCCL.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.785.093 [hccl_communicator.cc:2112] [618650][HcclCommunicator][DestroyAicpuComm]start to destroy the aicpu comm, group[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[WARNING] HCCL(618650,python3.9):2025-04-03-09:27:49.785.109 [hccl_communicator.cc:2114] [618650][HcclCommunicator][DestroyAicpuComm]Device type is not A3, no needs to destroy the aicpu comm.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.785.122 [hccl_communicator.cc:2082] [618650]start to stop the backGround Thread
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.785.117 [hccl_communicator.cc:2112] [618658][HcclCommunicator][DestroyAicpuComm]start to destroy the aicpu comm, group[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[WARNING] HCCL(618650,python3.9):2025-04-03-09:27:49.785.138 [heartbeat.cc:1203] [618650]Heartbeat has been destroyed
[WARNING] HCCL(618658,python3.9):2025-04-03-09:27:49.785.139 [hccl_communicator.cc:2114] [618658][HcclCommunicator][DestroyAicpuComm]Device type is not A3, no needs to destroy the aicpu comm.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.785.155 [hccl_communicator.cc:2082] [618658]start to stop the backGround Thread
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.785.151 [heartbeat.cc:451] [618650][UnRegisterRanks]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] UnregisterRanks Start.
[WARNING] HCCL(618650,python3.9):2025-04-03-09:27:49.785.163 [heartbeat.cc:452] [618650]Heartbeat has been destroyed
[WARNING] HCCL(618658,python3.9):2025-04-03-09:27:49.785.172 [heartbeat.cc:1203] [618658]Heartbeat has been destroyed
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.785.189 [hccl_impl.cc:69] [618650]start hccl resources destruction:deviceLogicId[1]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.785.191 [heartbeat.cc:451] [618658][UnRegisterRanks]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] UnregisterRanks Start.
[WARNING] HCCL(618658,python3.9):2025-04-03-09:27:49.785.206 [heartbeat.cc:452] [618658]Heartbeat has been destroyed
[WARNING] HCCL(618650,python3.9):2025-04-03-09:27:49.785.208 [heartbeat.cc:1203] [618650]Heartbeat has been destroyed
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.785.222 [heartbeat.cc:451] [618650][UnRegisterRanks]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] UnregisterRanks Start.
[WARNING] HCCL(618650,python3.9):2025-04-03-09:27:49.785.233 [heartbeat.cc:452] [618650]Heartbeat has been destroyed
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.785.234 [hccl_impl.cc:69] [618658]start hccl resources destruction:deviceLogicId[3]
[WARNING] HCCL(618658,python3.9):2025-04-03-09:27:49.785.256 [heartbeat.cc:1203] [618658]Heartbeat has been destroyed
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.785.268 [heartbeat.cc:451] [618658][UnRegisterRanks]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] UnregisterRanks Start.
[WARNING] HCCL(618658,python3.9):2025-04-03-09:27:49.785.281 [heartbeat.cc:452] [618658]Heartbeat has been destroyed
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.785.644 [api_impl.cc:2003] 618650 DevFree: device free mem=0x12c280003000
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.785.663 [api_impl.cc:2003] 618658 DevFree: device free mem=0x12c280003000
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.786.014 [task_exception_handler.cc:1232] [618650]deInit taskFailCallback
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.786.018 [task_exception_handler.cc:1232] [618658]deInit taskFailCallback
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.786.579 [api_impl.cc:2003] 618658 DevFree: device free mem=0x12c2800a5000
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.786.604 [api_impl.cc:2003] 618658 DevFree: device free mem=0x12c280004000
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.786.663 [api_error.cc:1278] 618658 HostFree: Free host memory succeed, host addr=0x12c0807f0000.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.786.682 [api_impl.cc:2003] 618658 DevFree: device free mem=0x12c280146000
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.786.734 [hccl_socket_manager.cc:81] [618658][DeInit][Server]ip[192.168.2.196] port[16666] serverSocketRef.Count() = 0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.786.754 [hccl_socket_manager.cc:83] [618658][DeInit][Server]ip[192.168.2.196] port[16666]
[WARNING] HCCL(618658,python3.9):2025-04-03-09:27:49.786.768 [hccl_socket.cc:232] [618658][Close] socket's fdHandle is null, do not need close.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.786.766 [api_impl.cc:2003] 618650 DevFree: device free mem=0x12c2800a5000
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.786.788 [api_impl.cc:2003] 618650 DevFree: device free mem=0x12c280004000
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.786.784 [network_manager.cc:69] [618658]NetworkManager::GetInstance deviceLogicID[3].
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.786.818 [network_manager.cc:458] [618658]NetworkManager devicePhyId_[3] vnic stopped. refcount[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.786.848 [api_error.cc:1278] 618650 HostFree: Free host memory succeed, host addr=0x12c0807f0000.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.786.865 [api_impl.cc:2003] 618650 DevFree: device free mem=0x12c280146000
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:49.786.858 [ra_host.c:911]tid:618658,ra_socket_listen_stop(911) : Input parameters: [0]th, phy_id[3], local_ip[192.168.2.196]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.786.898 [hccl_socket_manager.cc:81] [618650][DeInit][Server]ip[192.168.2.198] port[16666] serverSocketRef.Count() = 0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.786.915 [hccl_socket_manager.cc:83] [618650][DeInit][Server]ip[192.168.2.198] port[16666]
[WARNING] HCCL(618650,python3.9):2025-04-03-09:27:49.786.940 [hccl_socket.cc:232] [618650][Close] socket's fdHandle is null, do not need close.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.786.950 [network_manager.cc:69] [618650]NetworkManager::GetInstance deviceLogicID[1].
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.786.961 [network_manager.cc:458] [618650]NetworkManager devicePhyId_[1] vnic stopped. refcount[0]
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:49.786.981 [ra_host.c:911]tid:618650,ra_socket_listen_stop(911) : Input parameters: [0]th, phy_id[1], local_ip[192.168.2.198]
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:49.787.190 [ra_host.c:404]tid:618658,ra_socket_deinit(404) : Input parameters: phy_id[3] family[2] local_ip[192.168.2.196]
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:49.787.306 [ra_host.c:404]tid:618650,ra_socket_deinit(404) : Input parameters: phy_id[1] family[2] local_ip[192.168.2.198]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.787.321 [hccl_socket.cc:68] [618658][HcclSocket][DeInit] device[3] stops listen on ip[192.168.2.196], port[16666] success, socketType[0].
[WARNING] HCCL(618658,python3.9):2025-04-03-09:27:49.787.346 [hccl_socket.cc:232] [618658][Close] socket's fdHandle is null, do not need close.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.787.370 [hccl_communicator.cc:1741] [618658][HcclCommunicator][ReleasePreemptSocket] release all preempt socket success, comm id[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.787.388 [network_manager.cc:69] [618658]NetworkManager::GetInstance deviceLogicID[3].
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:49.787.404 [ra_host.c:248]tid:618658,ra_deinit(248) : Input parameters: phy_id[3], nic_position:[1]
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:49.787.421 [ra_hdc.c:651]tid:618658,ra_hdc_deinit(651) : hdc deinit start! phy_id[3]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.787.434 [hccl_socket.cc:68] [618650][HcclSocket][DeInit] device[1] stops listen on ip[192.168.2.198], port[16666] success, socketType[0].
[WARNING] HCCL(618650,python3.9):2025-04-03-09:27:49.787.455 [hccl_socket.cc:232] [618650][Close] socket's fdHandle is null, do not need close.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.787.474 [hccl_communicator.cc:1741] [618650][HcclCommunicator][ReleasePreemptSocket] release all preempt socket success, comm id[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.787.488 [network_manager.cc:69] [618650]NetworkManager::GetInstance deviceLogicID[1].
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:49.787.500 [ra_host.c:248]tid:618650,ra_deinit(248) : Input parameters: phy_id[1], nic_position:[1]
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:49.787.510 [ra_hdc.c:651]tid:618650,ra_hdc_deinit(651) : hdc deinit start! phy_id[1]
[INFO] DRV(618658,python3.9):2025-04-03-09:27:49.787.514 [hdc_client.c:417][ascend][curpid:618658,618658][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4198)
[INFO] ROCE(618658,python3.9):2025-04-03-09:27:49.787.560 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] HCCP(618658,python3.9):2025-04-03-09:27:49.787.578 [ra_hdc.c:685]tid:618658,ra_hdc_deinit(685) : hdc deinit OK! phy_id[3]
[INFO] ROCE(618658,python3.9):2025-04-03-09:27:49.787.592 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] DRV(618650,python3.9):2025-04-03-09:27:49.787.597 [hdc_client.c:417][ascend][curpid:618650,618650][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4197)
[INFO] ROCE(618650,python3.9):2025-04-03-09:27:49.787.665 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] TDT(618658,python3.9):2025-04-03-09:27:49.787.661 [tsd_client.cpp:189][TsdCapabilityGet][tid:618658] TsdCapabilityGet Begin.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:49.787.680 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618658] [TsdClient] g_userDeviceInfo is empty.
[INFO] HCCP(618650,python3.9):2025-04-03-09:27:49.787.681 [ra_hdc.c:685]tid:618650,ra_hdc_deinit(685) : hdc deinit OK! phy_id[1]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:49.787.697 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618658] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:49.787.710 [process_mode_manager.cpp:1042][CapabilityGet][tid:618658] [ProcessModeManager] enter into CapabilityGet process deviceId[3] type[6]
[INFO] ROCE(618650,python3.9):2025-04-03-09:27:49.787.712 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.787.728 [adapter_tdt.cc:66] [618658]Get TsdCapability success. deviceLogicId[3]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:49.787.747 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618658] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:49.787.759 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618658] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:49.787.760 [tsd_client.cpp:189][TsdCapabilityGet][tid:618650] TsdCapabilityGet Begin.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:49.787.776 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618650] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:49.787.772 [process_mode_manager.cpp:1735][ProcessCloseSubProcList][tid:618658] enter ExcuteClosePidList cnt:1, tsdSupportLevel_:63
[INFO] TDT(618650,python3.9):2025-04-03-09:27:49.787.789 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618650] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:49.787.801 [process_mode_manager.cpp:1042][CapabilityGet][tid:618650] [ProcessModeManager] enter into CapabilityGet process deviceId[1] type[6]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.787.815 [adapter_tdt.cc:66] [618650]Get TsdCapability success. deviceLogicId[1]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:49.787.796 [process_mode_manager.cpp:1794][ExcuteClosePidList][tid:618658] add close subproc:30159, proctype:0
[INFO] TDT(618650,python3.9):2025-04-03-09:27:49.787.827 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618650] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:49.787.837 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618650] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:49.787.848 [process_mode_manager.cpp:1735][ProcessCloseSubProcList][tid:618650] enter ExcuteClosePidList cnt:1, tsdSupportLevel_:63
[INFO] TDT(618650,python3.9):2025-04-03-09:27:49.787.865 [process_mode_manager.cpp:1794][ExcuteClosePidList][tid:618650] add close subproc:30534, proctype:0
[INFO] TDT(618658,python3.9):2025-04-03-09:27:49.787.855 [hdc_client.cpp:154][TsdRecvData][tid:618658] recv timeout is:150000 ms
[INFO] TDT(618650,python3.9):2025-04-03-09:27:49.787.903 [hdc_client.cpp:154][TsdRecvData][tid:618650] recv timeout is:150000 ms
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:49.796.172 [trs_cb_event.c:119][ascend][curpid:618658,618775][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=3, tid =65; ret=16)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:49.796.200 [trs_sqcq.c:1491][ascend][curpid:618658,618775][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.796.219 [npu_driver.cc:3833] 618775 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.796.235 [api_impl.cc:5058] 618775 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.796.251 [callback.cpp:132]618775 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.796.269 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.796.285 [npu_driver.cc:3828] 618775 CqReportIrqWait: Irq wait start, deviceId=3, tsId=0, groupId=65.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.797.029 [op_base.cc:2136] [618666]Entry-HcclCommDestroy: op_base comm destroy begin
[INFO] DEVICE(618666,fffe8f7eefa0,python3.9):2025-04-03-09:27:49.797.049 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:177] WatchDogProcess] end
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.797.056 [runtime.cc:5239] 618666 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.797.085 [adapter_rts.cc:198] [618666][hrtGetDeviceRefresh]deviceLogicId[5]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.797.103 [op_base.cc:2151] [618666][HcclCommDestroy] comm state is IDLE
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.797.121 [op_base.cc:128] [618666][HcclGetDeviceId] deviceLogicId[5] 
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.797.139 [op_base.cc:2168] [618666]com is not global com
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.797.154 [hcom_plugin.cc:381] [618666][Unset][GroupTopoInfo]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.797.198 [hccl_comm.cc:1375] [618666]UnRegistTaskAbortHandler begin
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.797.215 [task_abort_handler.cc:140] [618666]TaskAbortHandler::DeInit commVector size is [1], ref_ count is [1]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.797.229 [api_impl.cc:4192] 618666 SetTaskAbortCallBack: set task abort callback.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.797.244 [runtime.cc:4698] 618666 SetTaskAbortCallBack: SetTaskAbortCallBack finish, moduleName:HCCL.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.797.268 [hccl_communicator.cc:2112] [618666][HcclCommunicator][DestroyAicpuComm]start to destroy the aicpu comm, group[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[WARNING] HCCL(618666,python3.9):2025-04-03-09:27:49.797.284 [hccl_communicator.cc:2114] [618666][HcclCommunicator][DestroyAicpuComm]Device type is not A3, no needs to destroy the aicpu comm.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.797.296 [hccl_communicator.cc:2082] [618666]start to stop the backGround Thread
[WARNING] HCCL(618666,python3.9):2025-04-03-09:27:49.797.310 [heartbeat.cc:1203] [618666]Heartbeat has been destroyed
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.797.323 [heartbeat.cc:451] [618666][UnRegisterRanks]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] UnregisterRanks Start.
[WARNING] HCCL(618666,python3.9):2025-04-03-09:27:49.797.350 [heartbeat.cc:452] [618666]Heartbeat has been destroyed
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.797.364 [hccl_impl.cc:69] [618666]start hccl resources destruction:deviceLogicId[5]
[WARNING] HCCL(618666,python3.9):2025-04-03-09:27:49.797.381 [heartbeat.cc:1203] [618666]Heartbeat has been destroyed
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.797.393 [heartbeat.cc:451] [618666][UnRegisterRanks]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] UnregisterRanks Start.
[WARNING] HCCL(618666,python3.9):2025-04-03-09:27:49.797.405 [heartbeat.cc:452] [618666]Heartbeat has been destroyed
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.797.493 [api_impl.cc:2003] 618666 DevFree: device free mem=0x12c280003000
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.797.611 [task_exception_handler.cc:1232] [618666]deInit taskFailCallback
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.798.036 [api_impl.cc:2003] 618666 DevFree: device free mem=0x12c2800a5000
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.798.056 [api_impl.cc:2003] 618666 DevFree: device free mem=0x12c280004000
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.798.087 [api_error.cc:1278] 618666 HostFree: Free host memory succeed, host addr=0x12c0807f0000.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.798.104 [api_impl.cc:2003] 618666 DevFree: device free mem=0x12c280146000
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.798.133 [hccl_socket_manager.cc:81] [618666][DeInit][Server]ip[192.168.2.194] port[16666] serverSocketRef.Count() = 0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.798.150 [hccl_socket_manager.cc:83] [618666][DeInit][Server]ip[192.168.2.194] port[16666]
[WARNING] HCCL(618666,python3.9):2025-04-03-09:27:49.798.163 [hccl_socket.cc:232] [618666][Close] socket's fdHandle is null, do not need close.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.798.175 [network_manager.cc:69] [618666]NetworkManager::GetInstance deviceLogicID[5].
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.798.208 [network_manager.cc:458] [618666]NetworkManager devicePhyId_[5] vnic stopped. refcount[0]
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:49.798.241 [ra_host.c:911]tid:618666,ra_socket_listen_stop(911) : Input parameters: [0]th, phy_id[5], local_ip[192.168.2.194]
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:49.798.559 [ra_host.c:404]tid:618666,ra_socket_deinit(404) : Input parameters: phy_id[5] family[2] local_ip[192.168.2.194]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.798.685 [hccl_socket.cc:68] [618666][HcclSocket][DeInit] device[5] stops listen on ip[192.168.2.194], port[16666] success, socketType[0].
[WARNING] HCCL(618666,python3.9):2025-04-03-09:27:49.798.705 [hccl_socket.cc:232] [618666][Close] socket's fdHandle is null, do not need close.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.798.725 [hccl_communicator.cc:1741] [618666][HcclCommunicator][ReleasePreemptSocket] release all preempt socket success, comm id[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.798.741 [network_manager.cc:69] [618666]NetworkManager::GetInstance deviceLogicID[5].
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:49.798.756 [ra_host.c:248]tid:618666,ra_deinit(248) : Input parameters: phy_id[5], nic_position:[1]
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:49.798.771 [ra_hdc.c:651]tid:618666,ra_hdc_deinit(651) : hdc deinit start! phy_id[5]
[INFO] DRV(618666,python3.9):2025-04-03-09:27:49.798.858 [hdc_client.c:417][ascend][curpid:618666,618666][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4199)
[INFO] ROCE(618666,python3.9):2025-04-03-09:27:49.798.925 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] HCCP(618666,python3.9):2025-04-03-09:27:49.798.941 [ra_hdc.c:685]tid:618666,ra_hdc_deinit(685) : hdc deinit OK! phy_id[5]
[INFO] ROCE(618666,python3.9):2025-04-03-09:27:49.798.955 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] TDT(618666,python3.9):2025-04-03-09:27:49.798.991 [tsd_client.cpp:189][TsdCapabilityGet][tid:618666] TsdCapabilityGet Begin.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:49.799.016 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618666] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:49.799.029 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618666] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:49.799.041 [process_mode_manager.cpp:1042][CapabilityGet][tid:618666] [ProcessModeManager] enter into CapabilityGet process deviceId[5] type[6]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.799.057 [adapter_tdt.cc:66] [618666]Get TsdCapability success. deviceLogicId[5]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:49.799.072 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618666] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:49.799.084 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618666] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:49.799.095 [process_mode_manager.cpp:1735][ProcessCloseSubProcList][tid:618666] enter ExcuteClosePidList cnt:1, tsdSupportLevel_:63
[INFO] TDT(618666,python3.9):2025-04-03-09:27:49.799.111 [process_mode_manager.cpp:1794][ExcuteClosePidList][tid:618666] add close subproc:30114, proctype:0
[INFO] TDT(618666,python3.9):2025-04-03-09:27:49.799.142 [hdc_client.cpp:154][TsdRecvData][tid:618666] recv timeout is:150000 ms
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.800.087 [op_base.cc:2136] [618654]Entry-HcclCommDestroy: op_base comm destroy begin
[INFO] DEVICE(618654,fffe8fffefa0,python3.9):2025-04-03-09:27:49.800.107 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:177] WatchDogProcess] end
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.800.116 [runtime.cc:5239] 618654 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.800.145 [adapter_rts.cc:198] [618654][hrtGetDeviceRefresh]deviceLogicId[2]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.800.168 [op_base.cc:2151] [618654][HcclCommDestroy] comm state is IDLE
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.800.215 [op_base.cc:128] [618654][HcclGetDeviceId] deviceLogicId[2] 
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.800.250 [op_base.cc:2168] [618654]com is not global com
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.800.270 [hcom_plugin.cc:381] [618654][Unset][GroupTopoInfo]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.800.309 [hccl_comm.cc:1375] [618654]UnRegistTaskAbortHandler begin
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.800.328 [task_abort_handler.cc:140] [618654]TaskAbortHandler::DeInit commVector size is [1], ref_ count is [1]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.800.344 [api_impl.cc:4192] 618654 SetTaskAbortCallBack: set task abort callback.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.800.363 [runtime.cc:4698] 618654 SetTaskAbortCallBack: SetTaskAbortCallBack finish, moduleName:HCCL.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.800.378 [hccl_communicator.cc:2112] [618654][HcclCommunicator][DestroyAicpuComm]start to destroy the aicpu comm, group[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[WARNING] HCCL(618654,python3.9):2025-04-03-09:27:49.800.395 [hccl_communicator.cc:2114] [618654][HcclCommunicator][DestroyAicpuComm]Device type is not A3, no needs to destroy the aicpu comm.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.800.410 [hccl_communicator.cc:2082] [618654]start to stop the backGround Thread
[WARNING] HCCL(618654,python3.9):2025-04-03-09:27:49.800.426 [heartbeat.cc:1203] [618654]Heartbeat has been destroyed
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.800.441 [heartbeat.cc:451] [618654][UnRegisterRanks]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] UnregisterRanks Start.
[WARNING] HCCL(618654,python3.9):2025-04-03-09:27:49.800.456 [heartbeat.cc:452] [618654]Heartbeat has been destroyed
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.800.471 [hccl_impl.cc:69] [618654]start hccl resources destruction:deviceLogicId[2]
[WARNING] HCCL(618654,python3.9):2025-04-03-09:27:49.800.490 [heartbeat.cc:1203] [618654]Heartbeat has been destroyed
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.800.503 [heartbeat.cc:451] [618654][UnRegisterRanks]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] UnregisterRanks Start.
[WARNING] HCCL(618654,python3.9):2025-04-03-09:27:49.800.520 [heartbeat.cc:452] [618654]Heartbeat has been destroyed
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.800.598 [api_impl.cc:2003] 618654 DevFree: device free mem=0x12c280003000
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.800.718 [task_exception_handler.cc:1232] [618654]deInit taskFailCallback
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.800.783 [op_base.cc:2136] [618662]Entry-HcclCommDestroy: op_base comm destroy begin
[INFO] DEVICE(618662,fffeb7ffefa0,python3.9):2025-04-03-09:27:49.800.793 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:177] WatchDogProcess] end
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.800.809 [runtime.cc:5239] 618662 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.800.829 [adapter_rts.cc:198] [618662][hrtGetDeviceRefresh]deviceLogicId[4]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.800.846 [op_base.cc:2151] [618662][HcclCommDestroy] comm state is IDLE
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.800.869 [op_base.cc:128] [618662][HcclGetDeviceId] deviceLogicId[4] 
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.800.900 [op_base.cc:2168] [618662]com is not global com
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.800.920 [hcom_plugin.cc:381] [618662][Unset][GroupTopoInfo]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.800.957 [hccl_comm.cc:1375] [618662]UnRegistTaskAbortHandler begin
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.800.976 [task_abort_handler.cc:140] [618662]TaskAbortHandler::DeInit commVector size is [1], ref_ count is [1]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.800.994 [api_impl.cc:4192] 618662 SetTaskAbortCallBack: set task abort callback.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.801.010 [runtime.cc:4698] 618662 SetTaskAbortCallBack: SetTaskAbortCallBack finish, moduleName:HCCL.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.801.027 [hccl_communicator.cc:2112] [618662][HcclCommunicator][DestroyAicpuComm]start to destroy the aicpu comm, group[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[WARNING] HCCL(618662,python3.9):2025-04-03-09:27:49.801.043 [hccl_communicator.cc:2114] [618662][HcclCommunicator][DestroyAicpuComm]Device type is not A3, no needs to destroy the aicpu comm.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.801.056 [hccl_communicator.cc:2082] [618662]start to stop the backGround Thread
[WARNING] HCCL(618662,python3.9):2025-04-03-09:27:49.801.075 [heartbeat.cc:1203] [618662]Heartbeat has been destroyed
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.801.089 [heartbeat.cc:451] [618662][UnRegisterRanks]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] UnregisterRanks Start.
[WARNING] HCCL(618662,python3.9):2025-04-03-09:27:49.801.105 [heartbeat.cc:452] [618662]Heartbeat has been destroyed
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.801.119 [hccl_impl.cc:69] [618662]start hccl resources destruction:deviceLogicId[4]
[WARNING] HCCL(618662,python3.9):2025-04-03-09:27:49.801.136 [heartbeat.cc:1203] [618662]Heartbeat has been destroyed
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.801.148 [heartbeat.cc:451] [618662][UnRegisterRanks]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] UnregisterRanks Start.
[WARNING] HCCL(618662,python3.9):2025-04-03-09:27:49.801.161 [heartbeat.cc:452] [618662]Heartbeat has been destroyed
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.801.259 [api_impl.cc:2003] 618662 DevFree: device free mem=0x12c280003000
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.801.278 [op_base.cc:2136] [618674]Entry-HcclCommDestroy: op_base comm destroy begin
[INFO] DEVICE(618674,fffea4f9efa0,python3.9):2025-04-03-09:27:49.801.292 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:177] WatchDogProcess] end
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.801.307 [runtime.cc:5239] 618674 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.801.304 [api_impl.cc:2003] 618654 DevFree: device free mem=0x12c2800a5000
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.801.325 [adapter_rts.cc:198] [618674][hrtGetDeviceRefresh]deviceLogicId[7]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.801.327 [api_impl.cc:2003] 618654 DevFree: device free mem=0x12c280004000
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.801.343 [op_base.cc:2151] [618674][HcclCommDestroy] comm state is IDLE
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.801.365 [op_base.cc:128] [618674][HcclGetDeviceId] deviceLogicId[7] 
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.801.361 [api_error.cc:1278] 618654 HostFree: Free host memory succeed, host addr=0x12c0807f0000.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.801.384 [op_base.cc:2168] [618674]com is not global com
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.801.381 [api_impl.cc:2003] 618654 DevFree: device free mem=0x12c280146000
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.801.400 [hcom_plugin.cc:381] [618674][Unset][GroupTopoInfo]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.801.406 [task_exception_handler.cc:1232] [618662]deInit taskFailCallback
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.801.410 [hccl_socket_manager.cc:81] [618654][DeInit][Server]ip[192.168.2.197] port[16666] serverSocketRef.Count() = 0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.801.428 [hccl_socket_manager.cc:83] [618654][DeInit][Server]ip[192.168.2.197] port[16666]
[WARNING] HCCL(618654,python3.9):2025-04-03-09:27:49.801.443 [hccl_socket.cc:232] [618654][Close] socket's fdHandle is null, do not need close.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.801.437 [hccl_comm.cc:1375] [618674]UnRegistTaskAbortHandler begin
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.801.455 [task_abort_handler.cc:140] [618674]TaskAbortHandler::DeInit commVector size is [1], ref_ count is [1]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.801.458 [network_manager.cc:69] [618654]NetworkManager::GetInstance deviceLogicID[2].
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.801.472 [api_impl.cc:4192] 618674 SetTaskAbortCallBack: set task abort callback.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.801.490 [runtime.cc:4698] 618674 SetTaskAbortCallBack: SetTaskAbortCallBack finish, moduleName:HCCL.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.801.496 [network_manager.cc:458] [618654]NetworkManager devicePhyId_[2] vnic stopped. refcount[0]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.801.506 [hccl_communicator.cc:2112] [618674][HcclCommunicator][DestroyAicpuComm]start to destroy the aicpu comm, group[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[WARNING] HCCL(618674,python3.9):2025-04-03-09:27:49.801.523 [hccl_communicator.cc:2114] [618674][HcclCommunicator][DestroyAicpuComm]Device type is not A3, no needs to destroy the aicpu comm.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.801.537 [hccl_communicator.cc:2082] [618674]start to stop the backGround Thread
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:49.801.518 [ra_host.c:911]tid:618654,ra_socket_listen_stop(911) : Input parameters: [0]th, phy_id[2], local_ip[192.168.2.197]
[WARNING] HCCL(618674,python3.9):2025-04-03-09:27:49.801.552 [heartbeat.cc:1203] [618674]Heartbeat has been destroyed
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.801.568 [heartbeat.cc:451] [618674][UnRegisterRanks]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] UnregisterRanks Start.
[WARNING] HCCL(618674,python3.9):2025-04-03-09:27:49.801.581 [heartbeat.cc:452] [618674]Heartbeat has been destroyed
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.801.599 [hccl_impl.cc:69] [618674]start hccl resources destruction:deviceLogicId[7]
[WARNING] HCCL(618674,python3.9):2025-04-03-09:27:49.801.617 [heartbeat.cc:1203] [618674]Heartbeat has been destroyed
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.801.631 [heartbeat.cc:451] [618674][UnRegisterRanks]group[192.168.0.44%enp67s0f5_60008_0_1743643662827273] UnregisterRanks Start.
[WARNING] HCCL(618674,python3.9):2025-04-03-09:27:49.801.646 [heartbeat.cc:452] [618674]Heartbeat has been destroyed
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.801.753 [api_impl.cc:2003] 618674 DevFree: device free mem=0x12c280003000
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:49.801.836 [ra_host.c:404]tid:618654,ra_socket_deinit(404) : Input parameters: phy_id[2] family[2] local_ip[192.168.2.197]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.801.843 [api_impl.cc:2003] 618662 DevFree: device free mem=0x12c2800a5000
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.801.864 [api_impl.cc:2003] 618662 DevFree: device free mem=0x12c280004000
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.801.889 [task_exception_handler.cc:1232] [618674]deInit taskFailCallback
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.801.899 [api_error.cc:1278] 618662 HostFree: Free host memory succeed, host addr=0x12c0807f0000.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.801.916 [api_impl.cc:2003] 618662 DevFree: device free mem=0x12c280146000
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.801.944 [hccl_socket_manager.cc:81] [618662][DeInit][Server]ip[192.168.2.195] port[16666] serverSocketRef.Count() = 0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.801.962 [hccl_socket_manager.cc:83] [618662][DeInit][Server]ip[192.168.2.195] port[16666]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.801.960 [hccl_socket.cc:68] [618654][HcclSocket][DeInit] device[2] stops listen on ip[192.168.2.197], port[16666] success, socketType[0].
[WARNING] HCCL(618662,python3.9):2025-04-03-09:27:49.801.975 [hccl_socket.cc:232] [618662][Close] socket's fdHandle is null, do not need close.
[WARNING] HCCL(618654,python3.9):2025-04-03-09:27:49.801.980 [hccl_socket.cc:232] [618654][Close] socket's fdHandle is null, do not need close.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.801.989 [network_manager.cc:69] [618662]NetworkManager::GetInstance deviceLogicID[4].
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.802.000 [hccl_communicator.cc:1741] [618654][HcclCommunicator][ReleasePreemptSocket] release all preempt socket success, comm id[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.802.018 [network_manager.cc:69] [618654]NetworkManager::GetInstance deviceLogicID[2].
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.802.022 [network_manager.cc:458] [618662]NetworkManager devicePhyId_[4] vnic stopped. refcount[0]
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:49.802.034 [ra_host.c:248]tid:618654,ra_deinit(248) : Input parameters: phy_id[2], nic_position:[1]
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:49.802.051 [ra_hdc.c:651]tid:618654,ra_hdc_deinit(651) : hdc deinit start! phy_id[2]
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:49.802.051 [ra_host.c:911]tid:618662,ra_socket_listen_stop(911) : Input parameters: [0]th, phy_id[4], local_ip[192.168.2.195]
[INFO] DRV(618654,python3.9):2025-04-03-09:27:49.802.140 [hdc_client.c:417][ascend][curpid:618654,618654][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4200)
[INFO] ROCE(618654,python3.9):2025-04-03-09:27:49.802.179 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] HCCP(618654,python3.9):2025-04-03-09:27:49.802.196 [ra_hdc.c:685]tid:618654,ra_hdc_deinit(685) : hdc deinit OK! phy_id[2]
[INFO] ROCE(618654,python3.9):2025-04-03-09:27:49.802.209 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.802.255 [api_impl.cc:2003] 618674 DevFree: device free mem=0x12c2800a5000
[INFO] TDT(618654,python3.9):2025-04-03-09:27:49.802.260 [tsd_client.cpp:189][TsdCapabilityGet][tid:618654] TsdCapabilityGet Begin.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:49.802.276 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618654] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.802.277 [api_impl.cc:2003] 618674 DevFree: device free mem=0x12c280004000
[INFO] TDT(618654,python3.9):2025-04-03-09:27:49.802.291 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618654] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:49.802.306 [process_mode_manager.cpp:1042][CapabilityGet][tid:618654] [ProcessModeManager] enter into CapabilityGet process deviceId[2] type[6]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.802.323 [adapter_tdt.cc:66] [618654]Get TsdCapability success. deviceLogicId[2]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.802.317 [api_error.cc:1278] 618674 HostFree: Free host memory succeed, host addr=0x12c0807f0000.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:49.802.337 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618654] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:49.802.350 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618654] [TsdClient] g_userDeviceInfo is empty.
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:49.802.343 [ra_host.c:404]tid:618662,ra_socket_deinit(404) : Input parameters: phy_id[4] family[2] local_ip[192.168.2.195]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.802.334 [api_impl.cc:2003] 618674 DevFree: device free mem=0x12c280146000
[INFO] TDT(618654,python3.9):2025-04-03-09:27:49.802.363 [process_mode_manager.cpp:1735][ProcessCloseSubProcList][tid:618654] enter ExcuteClosePidList cnt:1, tsdSupportLevel_:63
[INFO] TDT(618654,python3.9):2025-04-03-09:27:49.802.382 [process_mode_manager.cpp:1794][ExcuteClosePidList][tid:618654] add close subproc:5116, proctype:0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.802.379 [hccl_socket_manager.cc:81] [618674][DeInit][Server]ip[192.168.2.192] port[16666] serverSocketRef.Count() = 0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.802.398 [hccl_socket_manager.cc:83] [618674][DeInit][Server]ip[192.168.2.192] port[16666]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:49.802.412 [hdc_client.cpp:154][TsdRecvData][tid:618654] recv timeout is:150000 ms
[WARNING] HCCL(618674,python3.9):2025-04-03-09:27:49.802.413 [hccl_socket.cc:232] [618674][Close] socket's fdHandle is null, do not need close.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.802.428 [network_manager.cc:69] [618674]NetworkManager::GetInstance deviceLogicID[7].
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.802.441 [network_manager.cc:458] [618674]NetworkManager devicePhyId_[7] vnic stopped. refcount[0]
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:49.802.462 [ra_host.c:911]tid:618674,ra_socket_listen_stop(911) : Input parameters: [0]th, phy_id[7], local_ip[192.168.2.192]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.802.472 [hccl_socket.cc:68] [618662][HcclSocket][DeInit] device[4] stops listen on ip[192.168.2.195], port[16666] success, socketType[0].
[WARNING] HCCL(618662,python3.9):2025-04-03-09:27:49.802.491 [hccl_socket.cc:232] [618662][Close] socket's fdHandle is null, do not need close.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.802.509 [hccl_communicator.cc:1741] [618662][HcclCommunicator][ReleasePreemptSocket] release all preempt socket success, comm id[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.802.526 [network_manager.cc:69] [618662]NetworkManager::GetInstance deviceLogicID[4].
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:49.802.539 [ra_host.c:248]tid:618662,ra_deinit(248) : Input parameters: phy_id[4], nic_position:[1]
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:49.802.552 [ra_hdc.c:651]tid:618662,ra_hdc_deinit(651) : hdc deinit start! phy_id[4]
[INFO] DRV(618662,python3.9):2025-04-03-09:27:49.802.641 [hdc_client.c:417][ascend][curpid:618662,618662][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4201)
[INFO] ROCE(618662,python3.9):2025-04-03-09:27:49.802.675 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] HCCP(618662,python3.9):2025-04-03-09:27:49.802.692 [ra_hdc.c:685]tid:618662,ra_hdc_deinit(685) : hdc deinit OK! phy_id[4]
[INFO] ROCE(618662,python3.9):2025-04-03-09:27:49.802.704 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] TDT(618662,python3.9):2025-04-03-09:27:49.802.749 [tsd_client.cpp:189][TsdCapabilityGet][tid:618662] TsdCapabilityGet Begin.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:49.802.766 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618662] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:49.802.779 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618662] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:49.802.793 [process_mode_manager.cpp:1042][CapabilityGet][tid:618662] [ProcessModeManager] enter into CapabilityGet process deviceId[4] type[6]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.802.810 [adapter_tdt.cc:66] [618662]Get TsdCapability success. deviceLogicId[4]
[INFO] TDT(618662,py[INFO] HCCP(618674,python3.9):2025-04-03-09:27:49.802.817 [ra_host.c:404]tid:618674,ra_socket_deinit(404) : Input parameters: phy_id[7] family[2] local_ip[192.168.2.192]
thon3.9):2025-04-03-09:27:49.802.823 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618662] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:49.802.853 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618662] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:49.802.868 [process_mode_manager.cpp:1735][ProcessCloseSubProcList][tid:618662] enter ExcuteClosePidList cnt:1, tsdSupportLevel_:63
[INFO] TDT(618662,python3.9):2025-04-03-09:27:49.802.884 [process_mode_manager.cpp:1794][ExcuteClosePidList][tid:618662] add close subproc:29706, proctype:0
[INFO] TDT(618662,python3.9):2025-04-03-09:27:49.802.915 [hdc_client.cpp:154][TsdRecvData][tid:618662] recv timeout is:150000 ms
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.802.975 [hccl_socket.cc:68] [618674][HcclSocket][DeInit] device[7] stops listen on ip[192.168.2.192], port[16666] success, socketType[0].
[WARNING] HCCL(618674,python3.9):2025-04-03-09:27:49.802.996 [hccl_socket.cc:232] [618674][Close] socket's fdHandle is null, do not need close.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.803.014 [hccl_communicator.cc:1741] [618674][HcclCommunicator][ReleasePreemptSocket] release all preempt socket success, comm id[192.168.0.44%enp67s0f5_60008_0_1743643662827273].
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.803.031 [network_manager.cc:69] [618674]NetworkManager::GetInstance deviceLogicID[7].
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:49.803.045 [ra_host.c:248]tid:618674,ra_deinit(248) : Input parameters: phy_id[7], nic_position:[1]
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:49.803.061 [ra_hdc.c:651]tid:618674,ra_hdc_deinit(651) : hdc deinit start! phy_id[7]
[INFO] DRV(618674,python3.9):2025-04-03-09:27:49.803.157 [hdc_client.c:417][ascend][curpid:618674,618674][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4202)
[INFO] ROCE(618674,python3.9):2025-04-03-09:27:49.803.212 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] HCCP(618674,python3.9):2025-04-03-09:27:49.803.228 [ra_hdc.c:685]tid:618674,ra_hdc_deinit(685) : hdc deinit OK! phy_id[7]
[INFO] ROCE(618674,python3.9):2025-04-03-09:27:49.803.242 [dl_hal_function.c:208]dl_hal_deinit(208) : dl_hal_deinit success!
[INFO] TDT(618674,python3.9):2025-04-03-09:27:49.803.276 [tsd_client.cpp:189][TsdCapabilityGet][tid:618674] TsdCapabilityGet Begin.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:49.803.291 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618674] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:49.803.304 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618674] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:49.803.317 [process_mode_manager.cpp:1042][CapabilityGet][tid:618674] [ProcessModeManager] enter into CapabilityGet process deviceId[7] type[6]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.803.334 [adapter_tdt.cc:66] [618674]Get TsdCapability success. deviceLogicId[7]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:49.803.346 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618674] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:49.803.360 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618674] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:49.803.375 [process_mode_manager.cpp:1735][ProcessCloseSubProcList][tid:618674] enter ExcuteClosePidList cnt:1, tsdSupportLevel_:63
[INFO] TDT(618674,python3.9):2025-04-03-09:27:49.803.391 [process_mode_manager.cpp:1794][ExcuteClosePidList][tid:618674] add close subproc:29983, proctype:0
[INFO] TDT(618674,python3.9):2025-04-03-09:27:49.803.433 [hdc_client.cpp:154][TsdRecvData][tid:618674] recv timeout is:150000 ms
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:49.828.176 [trs_cb_event.c:119][ascend][curpid:618662,618817][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=4, tid =833; ret=16)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:49.828.204 [trs_sqcq.c:1491][ascend][curpid:618662,618817][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:49.828.188 [trs_cb_event.c:119][ascend][curpid:618674,618819][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=7, tid =65; ret=16)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:49.828.217 [trs_sqcq.c:1491][ascend][curpid:618674,618819][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.828.224 [npu_driver.cc:3833] 618817 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=833, drvRetCode=16.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.828.234 [npu_driver.cc:3833] 618819 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.828.239 [api_impl.cc:5058] 618817 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.828.249 [api_impl.cc:5058] 618819 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.828.256 [callback.cpp:132]618817 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.828.264 [callback.cpp:132]618819 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.828.274 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.828.281 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.828.292 [npu_driver.cc:3828] 618817 CqReportIrqWait: Irq wait start, deviceId=4, tsId=0, groupId=833.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.828.296 [npu_driver.cc:3828] 618819 CqReportIrqWait: Irq wait start, deviceId=7, tsId=0, groupId=65.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:49.856.572 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618670] [ServerToClientMsgProc] [sessionID=1]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:49.856.592 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618670] [TsdClient] DeviceMsgProc recvMsg realDeviceId[6] msgType[61] localDevId[6] rspCode[0]heterogeneousSubPid[29795], tsdSupportLevel_[63]
[INFO] TDT(618670,python3.9):2025-04-03-09:27:49.856.610 [hdc_client.cpp:172][TsdRecvData][tid:618670] [deviceId=6] the Tsd recv data already
[INFO] TDT(618670,python3.9):2025-04-03-09:27:49.856.624 [process_mode_manager.cpp:1809][ExcuteClosePidList][tid:618670] leave ExcuteClosePidList startindex:0, cnt:1
[INFO] TDT(618670,python3.9):2025-04-03-09:27:49.856.638 [process_mode_manager.cpp:1769][ProcessCloseSubProcList][tid:618670] ExcuteClosePidList success reserveCnt:1
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.856.652 [adapter_tdt.cc:52] [618670]Open TsdProcess success. deviceLogicId[6]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.856.667 [network_manager.cc:405] [618670][DeInit]finish CloseHccpProcess, phy_id[6], hdc_type[18], nicDeployment[1], hasBackup[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.856.681 [network_manager.cc:409] [618670]NetworkManager: deinit nic success, nicPosition[1] ref[0].
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.856.695 [hccl_communicator_attrs.cc:1307] [618670][HcclCommunicator]IsSupportEnableRoce
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.856.712 [hccl_communicator_attrs.cc:1275] [618670]IsEnableRoce ret: 0, interServer_: 0, isInterServerVnic: 0, roceSwitch: 0, isSingleMeshAggregation_: 1
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.856.728 [notify_pool_impl.cc:43] [618670]NotifyPoolImpl Destroy.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.856.752 [notify_pool_impl.cc:56] [618670]NotifyPoolImpl Destroy success.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.856.769 [api_impl.cc:3100] 618670 GetDevicePhyIdByIndex: get PhyId by Index=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.856.782 [api_impl.cc:3111] 618670 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.856.797 [api_impl.cc:3130] 618670 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.856.811 [api_impl.cc:3100] 618670 GetDevicePhyIdByIndex: get PhyId by Index=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.856.825 [api_impl.cc:3111] 618670 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.856.836 [api_impl.cc:3130] 618670 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=6
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.856.848 [p2p_mgmt.cc:171] [618670]local logic id:6, local physic id:6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.856.863 [api_impl.cc:3520] 618670 GetPhyDeviceInfo: get phy device info, phyId=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.856.889 [api_impl.cc:3520] 618670 GetPhyDeviceInfo: get phy device info, phyId=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.856.905 [p2p_mgmt.cc:178] [618670]disable p2p: local logic id:6, remote physic id:0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.856.921 [api_impl.cc:3184] 618670 DisableP2P: Disable P2P devIdDes=6, phyIdSrc=0.
[INFO] DRV(618670,python3.9):2025-04-03-09:27:49.856.953 [devdrv_pcie.c:890][ascend][curpid:618670,618670][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=6; peer_phy_devid=0.)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.856.972 [api_impl.cc:3100] 618670 GetDevicePhyIdByIndex: get PhyId by Index=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.856.983 [api_impl.cc:3111] 618670 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.856.995 [api_impl.cc:3130] 618670 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=6
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.857.010 [p2p_mgmt.cc:171] [618670]local logic id:6, local physic id:6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.021 [api_impl.cc:3520] 618670 GetPhyDeviceInfo: get phy device info, phyId=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.034 [api_impl.cc:3520] 618670 GetPhyDeviceInfo: get phy device info, phyId=1
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.857.047 [p2p_mgmt.cc:178] [618670]disable p2p: local logic id:6, remote physic id:1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.063 [api_impl.cc:3184] 618670 DisableP2P: Disable P2P devIdDes=6, phyIdSrc=1.
[INFO] DRV(618670,python3.9):2025-04-03-09:27:49.857.076 [devdrv_pcie.c:890][ascend][curpid:618670,618670][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=6; peer_phy_devid=1.)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.093 [api_impl.cc:3100] 618670 GetDevicePhyIdByIndex: get PhyId by Index=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.103 [api_impl.cc:3111] 618670 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.115 [api_impl.cc:3130] 618670 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=6
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.857.128 [p2p_mgmt.cc:171] [618670]local logic id:6, local physic id:6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.142 [api_impl.cc:3520] 618670 GetPhyDeviceInfo: get phy device info, phyId=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.154 [api_impl.cc:3520] 618670 GetPhyDeviceInfo: get phy device info, phyId=2
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.857.167 [p2p_mgmt.cc:178] [618670]disable p2p: local logic id:6, remote physic id:2.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.183 [api_impl.cc:3184] 618670 DisableP2P: Disable P2P devIdDes=6, phyIdSrc=2.
[INFO] DRV(618670,python3.9):2025-04-03-09:27:49.857.196 [devdrv_pcie.c:890][ascend][curpid:618670,618670][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=6; peer_phy_devid=2.)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.212 [api_impl.cc:3100] 618670 GetDevicePhyIdByIndex: get PhyId by Index=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.223 [api_impl.cc:3111] 618670 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.235 [api_impl.cc:3130] 618670 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=6
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.857.247 [p2p_mgmt.cc:171] [618670]local logic id:6, local physic id:6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.262 [api_impl.cc:3520] 618670 GetPhyDeviceInfo: get phy device info, phyId=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.274 [api_impl.cc:3520] 618670 GetPhyDeviceInfo: get phy device info, phyId=3
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.857.287 [p2p_mgmt.cc:178] [618670]disable p2p: local logic id:6, remote physic id:3.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.302 [api_impl.cc:3184] 618670 DisableP2P: Disable P2P devIdDes=6, phyIdSrc=3.
[INFO] DRV(618670,python3.9):2025-04-03-09:27:49.857.315 [devdrv_pcie.c:890][ascend][curpid:618670,618670][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=6; peer_phy_devid=3.)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.332 [api_impl.cc:3100] 618670 GetDevicePhyIdByIndex: get PhyId by Index=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.349 [api_impl.cc:3111] 618670 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.361 [api_impl.cc:3130] 618670 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=6
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.857.374 [p2p_mgmt.cc:171] [618670]local logic id:6, local physic id:6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.386 [api_impl.cc:3520] 618670 GetPhyDeviceInfo: get phy device info, phyId=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.402 [api_impl.cc:3520] 618670 GetPhyDeviceInfo: get phy device info, phyId=4
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.857.414 [p2p_mgmt.cc:178] [618670]disable p2p: local logic id:6, remote physic id:4.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.426 [api_impl.cc:3184] 618670 DisableP2P: Disable P2P devIdDes=6, phyIdSrc=4.
[INFO] DRV(618670,python3.9):2025-04-03-09:27:49.857.440 [devdrv_pcie.c:890][ascend][curpid:618670,618670][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=6; peer_phy_devid=4.)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.457 [api_impl.cc:3100] 618670 GetDevicePhyIdByIndex: get PhyId by Index=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.467 [api_impl.cc:3111] 618670 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.479 [api_impl.cc:3130] 618670 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=6
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.857.491 [p2p_mgmt.cc:171] [618670]local logic id:6, local physic id:6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.506 [api_impl.cc:3520] 618670 GetPhyDeviceInfo: get phy device info, phyId=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.518 [api_impl.cc:3520] 618670 GetPhyDeviceInfo: get phy device info, phyId=5
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.857.531 [p2p_mgmt.cc:178] [618670]disable p2p: local logic id:6, remote physic id:5.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.546 [api_impl.cc:3184] 618670 DisableP2P: Disable P2P devIdDes=6, phyIdSrc=5.
[INFO] DRV(618670,python3.9):2025-04-03-09:27:49.857.560 [devdrv_pcie.c:890][ascend][curpid:618670,618670][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=6; peer_phy_devid=5.)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.576 [api_impl.cc:3100] 618670 GetDevicePhyIdByIndex: get PhyId by Index=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.586 [api_impl.cc:3111] 618670 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.599 [api_impl.cc:3130] 618670 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=6
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.857.610 [p2p_mgmt.cc:171] [618670]local logic id:6, local physic id:6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.625 [api_impl.cc:3100] 618670 GetDevicePhyIdByIndex: get PhyId by Index=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.635 [api_impl.cc:3111] 618670 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.647 [api_impl.cc:3130] 618670 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=6
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.857.659 [p2p_mgmt.cc:171] [618670]local logic id:6, local physic id:6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.672 [api_impl.cc:3520] 618670 GetPhyDeviceInfo: get phy device info, phyId=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.685 [api_impl.cc:3520] 618670 GetPhyDeviceInfo: get phy device info, phyId=7
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.857.701 [p2p_mgmt.cc:178] [618670]disable p2p: local logic id:6, remote physic id:7.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.715 [api_impl.cc:3184] 618670 DisableP2P: Disable P2P devIdDes=6, phyIdSrc=7.
[INFO] DRV(618670,python3.9):2025-04-03-09:27:49.857.736 [devdrv_pcie.c:890][ascend][curpid:618670,618670][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=6; peer_phy_devid=7.)
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.857.755 [hccl_communicator.cc:2043] [618670]Profiling is deinitiated.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.770 [api_impl.cc:2003] 618670 DevFree: device free mem=0x12c280000000
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.794 [api_impl.cc:2003] 618670 DevFree: device free mem=0x12c280001000
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.857.813 [api_impl.cc:2003] 618670 DevFree: device free mem=0x12c280002000
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.857.829 [opexecounter.cc:103] [618670]free counter mem resource
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:49.857.846 [atrace_api.c:118](tid:618670) AtraceDestroy start.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:49.857.865 [tracer_mgr_operate.c:248](tid:618670) destroy object HCCL_618986_6, exitSave(true).
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:49.857.881 [atrace_api.c:120](tid:618670) AtraceDestroy end.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.857.892 [adapter_trace.cc:33] [618670]Call TraceDestroy, Params:handle[0xaaaac8e04558]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:49.859.161 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618650] [ServerToClientMsgProc] [sessionID=1]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:49.859.181 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618650] [TsdClient] DeviceMsgProc recvMsg realDeviceId[1] msgType[61] localDevId[1] rspCode[0]heterogeneousSubPid[30534], tsdSupportLevel_[63]
[INFO] TDT(618650,python3.9):2025-04-03-09:27:49.859.209 [hdc_client.cpp:172][TsdRecvData][tid:618650] [deviceId=1] the Tsd recv data already
[INFO] TDT(618650,python3.9):2025-04-03-09:27:49.859.222 [process_mode_manager.cpp:1809][ExcuteClosePidList][tid:618650] leave ExcuteClosePidList startindex:0, cnt:1
[INFO] TDT(618650,python3.9):2025-04-03-09:27:49.859.236 [process_mode_manager.cpp:1769][ProcessCloseSubProcList][tid:618650] ExcuteClosePidList success reserveCnt:1
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.859.246 [adapter_tdt.cc:52] [618650]Open TsdProcess success. deviceLogicId[1]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.859.256 [network_manager.cc:405] [618650][DeInit]finish CloseHccpProcess, phy_id[1], hdc_type[18], nicDeployment[1], hasBackup[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.859.269 [network_manager.cc:409] [618650]NetworkManager: deinit nic success, nicPosition[1] ref[0].
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.859.280 [hccl_communicator_attrs.cc:1307] [618650][HcclCommunicator]IsSupportEnableRoce
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.859.290 [hccl_communicator_attrs.cc:1275] [618650]IsEnableRoce ret: 0, interServer_: 0, isInterServerVnic: 0, roceSwitch: 0, isSingleMeshAggregation_: 1
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.859.306 [notify_pool_impl.cc:43] [618650]NotifyPoolImpl Destroy.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.859.324 [notify_pool_impl.cc:56] [618650]NotifyPoolImpl Destroy success.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.345 [api_impl.cc:3100] 618650 GetDevicePhyIdByIndex: get PhyId by Index=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.357 [api_impl.cc:3111] 618650 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.367 [api_impl.cc:3130] 618650 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.380 [api_impl.cc:3100] 618650 GetDevicePhyIdByIndex: get PhyId by Index=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.390 [api_impl.cc:3111] 618650 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.399 [api_impl.cc:3130] 618650 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=1
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.859.409 [p2p_mgmt.cc:171] [618650]local logic id:1, local physic id:1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.422 [api_impl.cc:3520] 618650 GetPhyDeviceInfo: get phy device info, phyId=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.442 [api_impl.cc:3520] 618650 GetPhyDeviceInfo: get phy device info, phyId=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.859.455 [p2p_mgmt.cc:178] [618650]disable p2p: local logic id:1, remote physic id:0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.467 [api_impl.cc:3184] 618650 DisableP2P: Disable P2P devIdDes=1, phyIdSrc=0.
[INFO] DRV(618650,python3.9):2025-04-03-09:27:49.859.487 [devdrv_pcie.c:890][ascend][curpid:618650,618650][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=1; peer_phy_devid=0.)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.859.484 [api_impl.cc:2003] 618670 DevFree: device free mem=0x12c280147000
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.501 [api_impl.cc:3100] 618650 GetDevicePhyIdByIndex: get PhyId by Index=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.512 [api_impl.cc:3111] 618650 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.522 [api_impl.cc:3130] 618650 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=1
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.859.532 [p2p_mgmt.cc:171] [618650]local logic id:1, local physic id:1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.859.521 [api_impl.cc:2003] 618670 DevFree: device free mem=0x12c100c00000
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.543 [api_impl.cc:3100] 618650 GetDevicePhyIdByIndex: get PhyId by Index=1.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.859.549 [queue_notify_manager.cc:100] [618670]QueueNotifyManager Destroy.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.561 [api_impl.cc:3111] 618650 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.572 [api_impl.cc:3130] 618650 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=1
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.859.567 [queue_notify_manager.cc:106] [618670]QueueNotifyManager Destroy success.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.859.583 [p2p_mgmt.cc:171] [618650]local logic id:1, local physic id:1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.593 [api_impl.cc:3520] 618650 GetPhyDeviceInfo: get phy device info, phyId=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.606 [api_impl.cc:3520] 618650 GetPhyDeviceInfo: get phy device info, phyId=2
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.859.616 [p2p_mgmt.cc:178] [618650]disable p2p: local logic id:1, remote physic id:2.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.626 [api_impl.cc:3184] 618650 DisableP2P: Disable P2P devIdDes=1, phyIdSrc=2.
[INFO] DRV(618650,python3.9):2025-04-03-09:27:49.859.640 [devdrv_pcie.c:890][ascend][curpid:618650,618650][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=1; peer_phy_devid=2.)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.654 [api_impl.cc:3100] 618650 GetDevicePhyIdByIndex: get PhyId by Index=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.663 [api_impl.cc:3111] 618650 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.672 [api_impl.cc:3130] 618650 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=1
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.859.681 [p2p_mgmt.cc:171] [618650]local logic id:1, local physic id:1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.692 [api_impl.cc:3520] 618650 GetPhyDeviceInfo: get phy device info, phyId=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.702 [api_impl.cc:3520] 618650 GetPhyDeviceInfo: get phy device info, phyId=3
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.859.694 [queue_notify_manager.cc:100] [618670]QueueNotifyManager Destroy.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.859.711 [queue_notify_manager.cc:106] [618670]QueueNotifyManager Destroy success.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.859.714 [p2p_mgmt.cc:178] [618650]disable p2p: local logic id:1, remote physic id:3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.728 [api_impl.cc:3184] 618650 DisableP2P: Disable P2P devIdDes=1, phyIdSrc=3.
[INFO] DRV(618650,python3.9):2025-04-03-09:27:49.859.742 [devdrv_pcie.c:890][ascend][curpid:618650,618650][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=1; peer_phy_devid=3.)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.754 [api_impl.cc:3100] 618650 GetDevicePhyIdByIndex: get PhyId by Index=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.763 [api_impl.cc:3111] 618650 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.772 [api_impl.cc:3130] 618650 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=1
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.859.781 [p2p_mgmt.cc:171] [618650]local logic id:1, local physic id:1.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.859.771 [ccl_buffer_manager.cc:125] [618670][HCCL_TRACE][ReleaseCCLbuffer]CCLBuffer is null, no need to release.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.792 [api_impl.cc:3520] 618650 GetPhyDeviceInfo: get phy device info, phyId=1
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.859.790 [ccl_buffer_manager.cc:147] [618670][HCCL_TRACE][ReleaseCCLbuffer]CCLBuffer is null, no need to release.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.859.804 [ccl_buffer_manager.cc:160] [618670][HCCL_TRACE][ReleaseAIVbuffer]Release inAIVbuffer. buffer ptr[(nil)], size[0]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.808 [api_impl.cc:3520] 618650 GetPhyDeviceInfo: get phy device info, phyId=4
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.859.819 [ccl_buffer_manager.cc:163] [618670][HCCL_TRACE][ReleaseAIVbuffer]Release outAIVbuffer. buffer ptr[(nil)], size[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.859.820 [p2p_mgmt.cc:178] [618650]disable p2p: local logic id:1, remote physic id:4.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.859.834 [ccl_buffer_manager.cc:166] [618670][HCCL_TRACE][ReleaseAIVbuffer]Release AIV buffer success.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.833 [api_impl.cc:3184] 618650 DisableP2P: Disable P2P devIdDes=1, phyIdSrc=4.
[INFO] DRV(618650,python3.9):2025-04-03-09:27:49.859.847 [devdrv_pcie.c:890][ascend][curpid:618650,618650][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=1; peer_phy_devid=4.)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.861 [api_impl.cc:3100] 618650 GetDevicePhyIdByIndex: get PhyId by Index=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.869 [api_impl.cc:3111] 618650 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=1
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.859.867 [op_base.cc:128] [618670][HcclGetDeviceId] deviceLogicId[6] 
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.881 [api_impl.cc:3130] 618650 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=1
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.859.887 [op_base.cc:2196] [618670]op_base comm destroy complete, take time [77511]us, group[192.168.0.44%enp67s0f5_60008_0_1743643662827273], deviceLogicId[6].
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.859.896 [p2p_mgmt.cc:171] [618650]local logic id:1, local physic id:1.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.859.906 [device.cpp:183]618670 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 6.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.908 [api_impl.cc:3520] 618650 GetPhyDeviceInfo: get phy device info, phyId=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.917 [api_impl.cc:3520] 618650 GetPhyDeviceInfo: get phy device info, phyId=5
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.859.924 [api_impl.cc:3419] 618670 DeviceReset: reset device, device_id=6.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.859.929 [p2p_mgmt.cc:178] [618650]disable p2p: local logic id:1, remote physic id:5.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.941 [api_impl.cc:3184] 618650 DisableP2P: Disable P2P devIdDes=1, phyIdSrc=5.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.859.939 [runtime.cc:3444] 618670 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0xa, reset:0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.859.954 [api_impl.cc:3449] 618670 DeviceReset: Succ, userDeviceId=6.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:49.859.919 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618658] [ServerToClientMsgProc] [sessionID=1]
[INFO] TDT(618658,python3.9):2025-04-03-09:27:49.859.950 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618658] [TsdClient] DeviceMsgProc recvMsg realDeviceId[3] msgType[61] localDevId[3] rspCode[0]heterogeneousSubPid[30159], tsdSupportLevel_[63]
[INFO] DRV(618650,python3.9):2025-04-03-09:27:49.859.957 [devdrv_pcie.c:890][ascend][curpid:618650,618650][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=1; peer_phy_devid=5.)
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.859.968 [device.cpp:189]618670 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 6.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:49.859.972 [hdc_client.cpp:172][TsdRecvData][tid:618658] [deviceId=3] the Tsd recv data already
[INFO] TDT(618658,python3.9):2025-04-03-09:27:49.859.987 [process_mode_manager.cpp:1809][ExcuteClosePidList][tid:618658] leave ExcuteClosePidList startindex:0, cnt:1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.972 [api_impl.cc:3100] 618650 GetDevicePhyIdByIndex: get PhyId by Index=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.982 [api_impl.cc:3111] 618650 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.859.993 [api_impl.cc:3130] 618650 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=1
[INFO] TDT(618658,python3.9):2025-04-03-09:27:49.860.003 [process_mode_manager.cpp:1769][ProcessCloseSubProcList][tid:618658] ExcuteClosePidList success reserveCnt:1
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.860.004 [p2p_mgmt.cc:171] [618650]local logic id:1, local physic id:1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.860.015 [api_impl.cc:3520] 618650 GetPhyDeviceInfo: get phy device info, phyId=1
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.860.017 [adapter_tdt.cc:52] [618658]Open TsdProcess success. deviceLogicId[3]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.860.027 [api_impl.cc:3520] 618650 GetPhyDeviceInfo: get phy device info, phyId=6
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.860.038 [p2p_mgmt.cc:178] [618650]disable p2p: local logic id:1, remote physic id:6.
[INFO] HCCL_ADPT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.860.014 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:364] FinalizeHccl] Start destroy hccl adapter for GE_MODE
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.860.032 [network_manager.cc:405] [618658][DeInit]finish CloseHccpProcess, phy_id[3], hdc_type[18], nicDeployment[1], hasBackup[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.860.049 [network_manager.cc:409] [618658]NetworkManager: deinit nic success, nicPosition[1] ref[0].
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.860.052 [api_impl.cc:3184] 618650 DisableP2P: Disable P2P devIdDes=1, phyIdSrc=6.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.860.066 [hccl_communicator_attrs.cc:1307] [618658][HcclCommunicator]IsSupportEnableRoce
[INFO] HCCL_ADPT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.860.059 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:806] FinalizeHcclExec] Start finalize hccl exec.
[INFO] DRV(618650,python3.9):2025-04-03-09:27:49.860.067 [devdrv_pcie.c:890][ascend][curpid:618650,618650][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=1; peer_phy_devid=6.)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.860.082 [api_impl.cc:3100] 618650 GetDevicePhyIdByIndex: get PhyId by Index=1.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.860.082 [hccl_communicator_attrs.cc:1275] [618658]IsEnableRoce ret: 0, interServer_: 0, isInterServerVnic: 0, roceSwitch: 0, isSingleMeshAggregation_: 1
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.860.075 [hcom_executor.cc:40] [618670]Hcom Excutor Finalize start.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.860.093 [api_impl.cc:3111] 618650 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.860.104 [api_impl.cc:3130] 618650 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=1
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.860.101 [notify_pool_impl.cc:43] [618658]NotifyPoolImpl Destroy.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.860.117 [p2p_mgmt.cc:171] [618650]local logic id:1, local physic id:1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.860.127 [api_impl.cc:3520] 618650 GetPhyDeviceInfo: get phy device info, phyId=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.860.138 [api_impl.cc:3520] 618650 GetPhyDeviceInfo: get phy device info, phyId=7
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.860.126 [notify_pool_impl.cc:56] [618658]NotifyPoolImpl Destroy success.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.860.150 [p2p_mgmt.cc:178] [618650]disable p2p: local logic id:1, remote physic id:7.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.860.144 [api_impl.cc:3419] 618915 DeviceReset: reset device, device_id=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.860.148 [api_impl.cc:3419] 618913 DeviceReset: reset device, device_id=6.
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:49.860.169 [trs_cb_event.c:119][ascend][curpid:618670,618823][drv][tsdrv][trsCbEventWait]Call halEschedWaitEvent warn. (devId=6, tid =65; ret=16)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.860.189 [api_impl.cc:3184] 618650 DisableP2P: Disable P2P devIdDes=1, phyIdSrc=7.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.860.192 [runtime.cc:3444] 618915 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x9, reset:0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.860.202 [runtime.cc:3444] 618913 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x8, reset:0
[INFO] DRV(618650,python3.9):2025-04-03-09:27:49.860.206 [devdrv_pcie.c:890][ascend][curpid:618650,618650][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=1; peer_phy_devid=7.)
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.860.222 [hccl_communicator.cc:2043] [618650]Profiling is deinitiated.
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:49.860.211 [trs_sqcq.c:1491][ascend][curpid:618670,618823][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.860.219 [api_impl.cc:3449] 618915 DeviceReset: Succ, userDeviceId=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.860.226 [api_impl.cc:3449] 618913 DeviceReset: Succ, userDeviceId=6.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.860.239 [api_impl.cc:2003] 618650 DevFree: device free mem=0x12c280000000
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.860.234 [npu_driver.cc:3833] 618823 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=65, drvRetCode=16.
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:49.860.175 [queue_client_comm.c:114][ascend][curpid:618658,618781][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:49.860.175 [queue_client_comm.c:114][ascend][curpid:618658,618779][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:49.860.175 [queue_client_comm.c:114][ascend][curpid:618658,618789][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:49.860.175 [queue_client_comm.c:114][ascend][curpid:618658,618783][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:49.860.187 [queue_client_comm.c:114][ascend][curpid:618658,618785][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.860.253 [api_impl.cc:5058] 618823 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.860.260 [api_impl.cc:2003] 618650 DevFree: device free mem=0x12c280001000
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:49.860.190 [queue_client_comm.c:114][ascend][curpid:618658,618787][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.860.273 [callback.cpp:132]618823 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.860.277 [api_impl.cc:2003] 618650 DevFree: device free mem=0x12c280002000
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.860.294 [opexecounter.cc:103] [6[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.150 [api_impl.cc:3100] 618658 GetDevicePhyIdByIndex: get PhyId by Index=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.294 [api_impl.cc:3111] 618658 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.307 [api_impl.cc:3130] 618658 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=3
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.860.288 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.860.305 [npu_driver.cc:3828] 618823 CqReportIrqWait: Irq wait start, deviceId=6, tsId=0, groupId=65.
18650]free counter mem resource
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:49.860.318 [atrace_api.c:118](tid:618650) AtraceDestroy start.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.311 [npu_driver.cc:4338] 618781 MemQueuePeek: queue empty
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.329 [api_impl.cc:3100] 618658 GetDevicePhyIdByIndex: get PhyId by Index=3.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:49.860.337 [tracer_mgr_operate.c:248](tid:618650) destroy object HCCL_618987_1, exitSave(true).
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.860.330 [tensor_data_transfer.cpp:612]618781 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_tensor_dump
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.343 [api_impl.cc:3111] 618658 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=3
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.347 [npu_driver.cc:4338] 618779 MemQueuePeek: queue empty
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:49.860.352 [atrace_api.c:120](tid:618650) AtraceDestroy end.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.860.350 [tensor_data_transfer.cpp:1054]618781 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_tensor_dump
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.356 [api_impl.cc:3130] 618658 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=3
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.860.363 [tensor_data_transfer.cpp:612]618779 acltdtReceiveTensorV2: queue is empty, device is 3, name is _npu_log
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.860.364 [adapter_trace.cc:33] [618650]Call TraceDestroy, Params:handle[0xaaab20732988]
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.860.368 [tensor_data_transfer.cpp:1056]618781 acltdtReceiveTensor: new process, use queue process
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.860.375 [p2p_mgmt.cc:171] [618658]local logic id:3, local physic id:3.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.860.382 [tensor_data_transfer.cpp:1054]618779 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is _npu_log
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.385 [npu_driver.cc:4338] 618789 MemQueuePeek: queue empty
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.387 [api_impl.cc:6121] 618781 MemQueuePeek: Start to peek queue on devId 3, qid is 1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.395 [api_impl.cc:3520] 618658 GetPhyDeviceInfo: get phy device info, phyId=3
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.860.398 [tensor_data_transfer.cpp:1056]618779 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.860.408 [tensor_data_transfer.cpp:612]618789 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_histogram_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.412 [npu_driver.cc:4330] 618781 MemQueuePeek: peek mem queue, deviceId=3, qid=1, timeout=800.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.423 [npu_driver.cc:4338] 618783 MemQueuePeek: queue empty
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.428 [api_impl.cc:6121] 618779 MemQueuePeek: Start to peek queue on devId 3, qid is 0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.432 [api_impl.cc:3520] 618658 GetPhyDeviceInfo: get phy device info, phyId=0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.860.435 [tensor_data_transfer.cpp:1054]618789 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name i[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.860.453 [api_impl.cc:3419] 618916 DeviceReset: reset device, device_id=6.
s ms_histogram_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.860.448 [tensor_data_transfer.cpp:612]618783 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_tensor_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.452 [npu_driver.cc:4330] 618779 MemQueuePeek: peek mem queue, deviceId=3, qid=0, timeout=800.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.860.485 [runtime.cc:3444] 618916 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x7, reset:0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.860.489 [api_impl.cc:3419] 618914 DeviceReset: reset device, device_id=6.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.860.463 [p2p_mgmt.cc:178] [618658]disable p2p: local logic id:3, remote physic id:0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.860.502 [api_impl.cc:3449] 618916 DeviceReset: Succ, userDeviceId=6.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.475 [npu_driver.cc:4338] 618785 MemQueuePeek: queue empty
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.860.515 [runtime.cc:3444] 618914 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x6, reset:0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.860.490 [tensor_data_transfer.cpp:1056]618789 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.860.531 [api_impl.cc:3449] 618914 DeviceReset: Succ, userDeviceId=6.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.860.499 [tensor_data_transfer.cpp:1054]618783 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_tensor_summary
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.508 [npu_driver.cc:4338] 618787 MemQueuePeek: queue empty
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.515 [api_impl.cc:3184] 618658 DisableP2P: Disable P2P devIdDes=3, phyIdSrc=0.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.860.529 [tensor_data_transfer.cpp:612]618785 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_image_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.536 [api_impl.cc:6121] 618789 MemQueuePeek: Start to peek queue on devId 3, qid is 5.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.860.544 [tensor_data_transfer.cpp:1056]618783 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.860.557 [tensor_data_transfer.cpp:612]618787 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_scalar_summary
[INFO] DRV(618658,python3.9):2025-04-03-09:27:49.860.577 [devdrv_pcie.c:890][ascend][curpid:618658,618658][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=3; peer_phy_devid=0.)
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.860.579 [tensor_data_transfer.cpp:1054]618785 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_image_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.590 [npu_driver.cc:4330] 618789 MemQueuePeek: peek mem queue, deviceId=3, qid=5, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.602 [api_impl.cc:6121] 618783 MemQueuePeek: Start to peek queue on devId 3, qid is 2.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.860.619 [tensor_data_transfer.cpp:1054]618787 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_scalar_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.631 [api_impl.cc:3100] 618658 GetDevicePhyIdByIndex: get PhyId by Index=3.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.860.640 [tensor_data_transfer.cpp:1056]618785 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.658 [npu_driver.cc:4330] 618783 MemQueuePeek: peek mem queue, deviceId=3, qid=2, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.860.668 [tensor_data_transfer.cpp:1056]618787 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.682 [api_impl.cc:3111] 618658 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.696 [api_impl.cc:6121] 618785 MemQueuePeek: Start to peek queue on devId 3, qid is 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.714 [api_impl.cc:6121] 618787 MemQueuePeek: Start to peek queue on devId 3, qid is 4.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.726 [api_impl.cc:3130] 618658 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.737 [npu_driver.cc:4330] 618785 MemQueuePeek: peek mem queue, deviceId=3, qid=3, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.744 [npu_driver.cc:4330] 618787 MemQueuePeek: peek mem queue, deviceId=3, qid=4, timeout=800.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.860.756 [p2p_mgmt.cc:171] [618658]local logic id:3, local physic id:3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.801 [api_impl.cc:3520] 618658 GetPhyDeviceInfo: get phy device info, phyId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.818 [api_impl.cc:3520] 618658 GetPhyDeviceInfo: get phy device info, phyId=1
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.860.807 [api_impl.cc:3717] 618670 ContextSetCurrent: set context=aaaad9a630c0, flag=0.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.860.830 [adapter_rts.cc:321] [618670][hrtCtxSetCurrent] success
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.860.834 [p2p_mgmt.cc:178] [618658]disable p2p: local logic id:3, remote physic id:1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.851 [api_impl.cc:3184] 618658 DisableP2P: Disable P2P devIdDes=3, phyIdSrc=1.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.860.847 [stream.cc:182] [618670]Switch Ctx ret[0], curCtx[0xaaaad9a630c0], setCtx[0xaaaad9a630c0], stream id[5]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.860.867 [api_impl.cc:1228] 618670 StreamDestroy: stream_id=5.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:49.860.869 [devdrv_pcie.c:890][ascend][curpid:618658,618658][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=3; peer_phy_devid=1.)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.887 [api_impl.cc:3100] 618658 GetDevicePhyIdByIndex: get PhyId by Index=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.901 [api_impl.cc:3111] 618658 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=3
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.860.890 [acl_resource_manager.cpp:814]618670 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.914 [api_impl.cc:3130] 618658 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=3
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.860.928 [p2p_mgmt.cc:171] [618658]local logic id:3, local physic id:3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.940 [api_impl.cc:3520] 618658 GetPhyDeviceInfo: get phy device info, phyId=3
[INFO] GE(618670,python3.9):2025-04-03-09:27:49.860.937 [single_op_manager.cc:50]618670 ReleaseResource:ReleaseResource in. resource id = 0xaaaae4e04420
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.957 [api_impl.cc:3520] 618658 GetPhyDeviceInfo: get phy device info, phyId=2
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.860.973 [p2p_mgmt.cc:178] [618658]disable p2p: local logic id:3, remote physic id:2.
[INFO] GE(618670,python3.9):2025-04-03-09:27:49.860.972 [caching_allocator.cc:402]618670 TryFreeBlocks:Try free blocks.
[INFO] GE(618670,python3.9):2025-04-03-09:27:49.860.989 [caching_allocator.cc:358]618670 FreeCachedBlocks:Free cached blocks
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.860.990 [api_impl.cc:3184] 618658 DisableP2P: Disable P2P devIdDes=3, phyIdSrc=2.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:49.861.009 [devdrv_pcie.c:890][ascend][curpid:618658,618658][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=3; peer_phy_devid=2.)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.027 [api_impl.cc:3100] 618658 GetDevicePhyIdByIndex: get PhyId by Index=3.
[INFO] GE(618670,python3.9):2025-04-03-09:27:49.861.026 [npu_memory_allocator.cc:72]618670 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.039 [api_impl.cc:3111] 618658 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.052 [api_impl.cc:3130] 618658 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=3
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.861.044 [stream_executor.cpp:197]618670 RemoveExecutor: To remove executor by stream = 187650961064992
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.861.066 [p2p_mgmt.cc:171] [618658]local logic id:3, local physic id:3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.080 [api_impl.cc:3100] 618658 GetDevicePhyIdByIndex: get PhyId by Index=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.093 [api_impl.cc:3111] 618658 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=3
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.861.085 [acl_resource_manager.cpp:823]618670 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.106 [api_impl.cc:3130] 618658 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=3
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.861.104 [stream.cc:852] 618670 TearDown: stream_id=5, sqId=5, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.861.124 [stream.cc:938] 618670 TearDown: stream_id=5, delay recycle task num=0.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.861.119 [p2p_mgmt.cc:171] [618658]local logic id:3, local physic id:3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.136 [api_impl.cc:3520] 618658 GetPhyDeviceInfo: get phy device info, phyId=3
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.861.139 [stream.cc:1507] 618670 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.152 [api_impl.cc:3520] 618658 GetPhyDeviceInfo: get phy device info, phyId=4
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.861.169 [p2p_mgmt.cc:178] [618658]disable p2p: local logic id:3, remote physic id:4.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.183 [api_impl.cc:3184] 618658 DisableP2P: Disable P2P devIdDes=3, phyIdSrc=4.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.861.174 [stream_sqcq_manage.cc:451] 618670 FreeLogicCq: Return(0), threadIdentifier(281473556700640), devId(6), tsId(0), cqId(301), isFastCq(0).
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.861.200 [npu_driver.cc:6163] 618670 StreamUnBindLogicCq: success: deviceId=6, tsId=0, streamId=5, logicCq=301.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:49.861.200 [devdrv_pcie.c:890][ascend][curpid:618658,618658][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=3; peer_phy_devid=4.)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.220 [api_impl.cc:3100] 618658 GetDevicePhyIdByIndex: get PhyId by Index=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.250 [api_impl.cc:3111] 618658 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=3
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.861.240 [npu_driver.cc:1180] 618670 LogicCqFree: Succ:device_id=6,ts_id=0,type=2,logic_cq_id=301, drvFlag=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.265 [api_impl.cc:3130] 618658 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=3
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.861.278 [p2p_mgmt.cc:171] [618658]local logic id:3, local physic id:3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.294 [api_impl.cc:3520] 618658 GetPhyDeviceInfo: get phy device info, phyId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.305 [api_impl.cc:3520] 618658 GetPhyDeviceInfo: get phy device info, phyId=5
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.861.320 [p2p_mgmt.cc:178] [618658]disable p2p: local logic id:3, remote physic id:5.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.335 [api_impl.cc:3184] 618658 DisableP2P: Disable P2P devIdDes=3, phyIdSrc=5.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:49.861.349 [devdrv_pcie.c:890][ascend][curpid:618658,618658][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=3; peer_phy_devid=5.)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.367 [api_impl.cc:3100] 618658 GetDevicePhyIdByIndex: get PhyId by Index=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.378 [api_impl.cc:3111] 618658 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.391 [api_impl.cc:3130] 618658 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=3
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.861.403 [p2p_mgmt.cc:171] [618658]local logic id:3, local physic id:3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.419 [api_impl.cc:3520] 618658 GetPhyDeviceInfo: get phy device info, phyId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.432 [api_impl.cc:3520] 618658 GetPhyDeviceInfo: get phy device info, phyId=6
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.861.445 [p2p_mgmt.cc:178] [618658]disable p2p: local logic id:3, remote physic id:6.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.461 [api_impl.cc:3184] 618658 DisableP2P: Disable P2P devIdDes=3, phyIdSrc=6.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:49.861.477 [devdrv_pcie.c:890][ascend][curpid:618658,618658][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=3; peer_phy_devid=6.)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.494 [api_impl.cc:3100] 618658 GetDevicePhyIdByIndex: get PhyId by Index=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.504 [api_impl.cc:3111] 618658 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.517 [api_impl.cc:3130] 618658 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=3
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.861.530 [p2p_mgmt.cc:171] [618658]local logic id:3, local physic id:3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.546 [api_impl.cc:3520] 618658 GetPhyDeviceInfo: get phy device info, phyId=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.558 [api_impl.cc:3520] 618658 GetPhyDeviceInfo: get phy device info, phyId=7
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.861.572 [p2p_mgmt.cc:178] [618658]disable p2p: local logic id:3, remote physic id:7.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.588 [api_impl.cc:3184] 618658 DisableP2P: Disable P2P devIdDes=3, phyIdSrc=7.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:49.861.604 [devdrv_pcie.c:890][ascend][curpid:618658,618658][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=3; peer_phy_devid=7.)
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.861.622 [hccl_communicator.cc:2043] [618658]Profiling is deinitiated.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.640 [api_impl.cc:2003] 618658 DevFree: device free mem=0x12c280000000
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.663 [api_impl.cc:2003] 618658 DevFree: device free mem=0x12c280001000
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.861.692 [api_impl.cc:2003] 618658 DevFree: device free mem=0x12c280002000
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.861.710 [opexecounter.cc:103] [618658]free counter mem resource
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:49.861.728 [atrace_api.c:118](tid:618658) AtraceDestroy start.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:49.861.750 [tracer_mgr_operate.c:248](tid:618658) destroy object HCCL_618982_3, exitSave(true).
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:49.861.767 [atrace_api.c:120](tid:618658) AtraceDestroy end.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.861.779 [adapter_trace.cc:33] [618658]Call TraceDestroy, Params:handle[0xaaaaf9f43558]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.862.446 [api_impl.cc:2003] 618650 DevFree: device free mem=0x12c280147000
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.862.481 [api_impl.cc:2003] 618650 DevFree: device free mem=0x12c100c00000
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.862.543 [queue_notify_manager.cc:100] [618650]QueueNotifyManager Destroy.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.862.558 [queue_notify_manager.cc:106] [618650]QueueNotifyManager Destroy success.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.862.842 [queue_notify_manager.cc:100] [618650]QueueNotifyManager Destroy.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.862.856 [queue_notify_manager.cc:106] [618650]QueueNotifyManager Destroy success.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.862.965 [ccl_buffer_manager.cc:125] [618650][HCCL_TRACE][ReleaseCCLbuffer]CCLBuffer is null, no need to release.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.862.982 [ccl_buffer_manager.cc:147] [618650][HCCL_TRACE][ReleaseCCLbuffer]CCLBuffer is null, no need to release.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.862.993 [ccl_buffer_manager.cc:160] [618650][HCCL_TRACE][ReleaseAIVbuffer]Release inAIVbuffer. buffer ptr[(nil)], size[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.863.005 [ccl_buffer_manager.cc:163] [618650][HCCL_TRACE][ReleaseAIVbuffer]Release outAIVbuffer. buffer ptr[(nil)], size[0]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.863.016 [ccl_buffer_manager.cc:166] [618650][HCCL_TRACE][ReleaseAIVbuffer]Release AIV buffer success.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.863.065 [op_base.cc:128] [618650][HcclGetDeviceId] deviceLogicId[1] 
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.863.085 [op_base.cc:2196] [618650]op_base comm destroy complete, take time [78295]us, group[192.168.0.44%enp67s0f5_60008_0_1743643662827273], deviceLogicId[1].
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.863.101 [device.cpp:183]618650 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.863.117 [api_impl.cc:3419] 618650 DeviceReset: reset device, device_id=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.863.129 [runtime.cc:3444] 618650 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0xa, reset:0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.863.140 [api_impl.cc:3449] 618650 DeviceReset: Succ, userDeviceId=1.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.863.149 [device.cpp:189]618650 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 1.
[INFO] HCCL_ADPT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.863.191 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:364] FinalizeHccl] Start destroy hccl adapter for GE_MODE
[INFO] HCCL_ADPT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.863.218 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:806] FinalizeHcclExec] Start finalize hccl exec.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.863.228 [hcom_executor.cc:40] [618650]Hcom Excutor Finalize start.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.863.376 [api_impl.cc:3419] 618935 DeviceReset: reset device, device_id=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.863.382 [api_impl.cc:3419] 618933 DeviceReset: reset device, device_id=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.863.399 [runtime.cc:3444] 618935 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x9, reset:0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.863.408 [runtime.cc:3444] 618933 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x8, reset:0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.863.423 [api_impl.cc:3449] 618935 DeviceReset: Succ, userDeviceId=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.863.427 [api_impl.cc:3449] 618933 DeviceReset: Succ, userDeviceId=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.863.583 [stream.cc:237] 618670 FreeStreamId: Free stream_id=5.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.863.623 [stream_sqcq_manage.cc:216] 618670 DeAllocStreamSqCq: deviceId=6, tsId=0, drvFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.863.639 [npu_driver.cc:966] 618670 NormalSqCqFree: Normal sqcq free, sqId=5, cqId=5, device_id=6, tsId=0, drvFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.863.640 [api_impl.cc:3419] 618934 DeviceReset: reset device, device_id=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.863.645 [api_impl.cc:3419] 618936 DeviceReset: reset device, device_id=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.863.666 [runtime.cc:3444] 618934 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x7, reset:0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.863.676 [runtime.cc:3444] 618936 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x6, reset:0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.863.680 [api_impl.cc:3449] 618934 DeviceReset: Succ, userDeviceId=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.863.690 [api_impl.cc:3449] 618936 DeviceReset: Succ, userDeviceId=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.863.965 [api_impl.cc:3717] 618650 ContextSetCurrent: set context=aaab312ab590, flag=0.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.863.985 [adapter_rts.cc:321] [618650][hrtCtxSetCurrent] success
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.863.997 [stream.cc:182] [618650]Switch Ctx ret[0], curCtx[0xaaab312ab590], setCtx[0xaaab312ab590], stream id[5]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.864.012 [api_impl.cc:1228] 618650 StreamDestroy: stream_id=5.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.864.047 [acl_resource_manager.cpp:814]618650 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] GE(618650,python3.9):2025-04-03-09:27:49.864.084 [single_op_manager.cc:50]618650 ReleaseResource:ReleaseResource in. resource id = 0xaaab3c7331f0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.864.091 [api_impl.cc:2003] 618658 DevFree: device free mem=0x12c280147000
[INFO] GE(618650,python3.9):2025-04-03-09:27:49.864.108 [caching_allocator.cc:402]618650 TryFreeBlocks:Try free blocks.
[INFO] GE(618650,python3.9):2025-04-03-09:27:49.864.122 [caching_allocator.cc:358]618650 FreeCachedBlocks:Free cached blocks
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.864.131 [api_impl.cc:2003] 618658 DevFree: device free mem=0x12c100c00000
[INFO] GE(618650,python3.9):2025-04-03-09:27:49.864.147 [npu_memory_allocator.cc:72]618650 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.864.171 [stream_executor.cpp:197]618650 RemoveExecutor: To remove executor by stream = 187652430311920
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.864.201 [acl_resource_manager.cpp:823]618650 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.864.216 [stream.cc:852] 618650 TearDown: stream_id=5, sqId=5, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.864.211 [queue_notify_manager.cc:100] [618658]QueueNotifyManager Destroy.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.864.237 [queue_notify_manager.cc:106] [618658]QueueNotifyManager Destroy success.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.864.233 [stream.cc:938] 618650 TearDown: stream_id=5, delay recycle task num=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.864.246 [stream.cc:1507] 618650 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.864.231 [npu_driver.cc:974] 618670 NormalSqCqFree: Normal sqcq free success, sqId=5, cqId=5, device_id=6, tsId=0, drvFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.864.257 [stream_sqcq_manage.cc:228] 618670 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=5, cq_id=5, stream_id=5, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.864.275 [npu_driver.cc:432] 618670 StreamIdFree: stream id free begin, device_id=6, stream_id=5, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.864.293 [npu_driver.cc:441] 618670 StreamIdFree: Stream id free success, stream_id=5, device_id=6, tsId=0, streamFlag=1536
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.864.294 [stream_sqcq_manage.cc:451] 618650 FreeLogicCq: Return(0), threadIdentifier(281473891839456), devId(1), tsId(0), cqId(405), isFastCq(0).
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.864.319 [npu_driver.cc:6163] 618650 StreamUnBindLogicCq: success: deviceId=1, tsId=0, streamId=5, logicCq=405.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.864.360 [npu_driver.cc:1180] 618650 LogicCqFree: Succ:device_id=1,ts_id=0,type=2,logic_cq_id=405, drvFlag=0.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.864.508 [queue_notify_manager.cc:100] [618658]QueueNotifyManager Destroy.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.864.527 [queue_notify_manager.cc:106] [618658]QueueNotifyManager Destroy success.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.864.618 [ccl_buffer_manager.cc:125] [618658][HCCL_TRACE][ReleaseCCLbuffer]CCLBuffer is null, no need to release.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.864.638 [ccl_buffer_manager.cc:147] [618658][HCCL_TRACE][ReleaseCCLbuffer]CCLBuffer is null, no need to release.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.864.651 [ccl_buffer_manager.cc:160] [618658][HCCL_TRACE][ReleaseAIVbuffer]Release inAIVbuffer. buffer ptr[(nil)], size[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.864.667 [ccl_buffer_manager.cc:163] [618658][HCCL_TRACE][ReleaseAIVbuffer]Release outAIVbuffer. buffer ptr[(nil)], size[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.864.684 [ccl_buffer_manager.cc:166] [618658][HCCL_TRACE][ReleaseAIVbuffer]Release AIV buffer success.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.864.721 [op_base.cc:128] [618658][HcclGetDeviceId] deviceLogicId[3] 
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.864.744 [op_base.cc:2196] [618658]op_base comm destroy complete, take time [79957]us, group[192.168.0.44%enp67s0f5_60008_0_1743643662827273], deviceLogicId[3].
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.864.764 [device.cpp:183]618658 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.864.788 [api_impl.cc:3419] 618658 DeviceReset: reset device, device_id=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.864.805 [runtime.cc:3444] 618658 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0xa, reset:0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.864.825 [api_impl.cc:3449] 618658 DeviceReset: Succ, userDeviceId=3.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.864.837 [device.cpp:189]618658 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 3.
[INFO] HCCL_ADPT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.864.885 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:364] FinalizeHccl] Start destroy hccl adapter for GE_MODE
[INFO] HCCL_ADPT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.864.915 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:806] FinalizeHcclExec] Start finalize hccl exec.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.864.931 [hcom_executor.cc:40] [618658]Hcom Excutor Finalize start.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.864.957 [stream.cc:185] [618670][HCCL_TRACE]StreamDestroy, streamPtr[0xaaaae4e04420], stream id[5]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.864.977 [api_impl.cc:3717] 618670 ContextSetCurrent: set context=aaaad9a630c0, flag=0.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.864.991 [adapter_rts.cc:321] [618670][hrtCtxSetCurrent] success
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.865.006 [stream.cc:193] [618670]Restore Ctx ret[0], setCtx[0xaaaad9a630c0], stream id[5]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.865.062 [api_impl.cc:3717] 618670 ContextSetCurrent: set context=aaaad9a630c0, flag=0.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.865.080 [adapter_rts.cc:321] [618670][hrtCtxSetCurrent] success
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.865.065 [api_impl.cc:3419] 618793 DeviceReset: reset device, device_id=3.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.865.093 [stream.cc:182] [618670]Switch Ctx ret[0], curCtx[0xaaaad9a630c0], setCtx[0xaaaad9a630c0], stream id[4]
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.865.109 [api_impl.cc:1228] 618670 StreamDestroy: stream_id=4.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.865.104 [api_impl.cc:3419] 618791 DeviceReset: reset device, device_id=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.865.108 [runtime.cc:3444] 618793 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x9, reset:0
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.865.123 [acl_resource_manager.cpp:814]618670 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.865.131 [runtime.cc:3444] 618791 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x8, reset:0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.865.139 [api_impl.cc:3449] 618793 DeviceReset: Succ, userDeviceId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.865.146 [api_impl.cc:3449] 618791 DeviceReset: Succ, userDeviceId=3.
[INFO] GE(618670,python3.9):2025-04-03-09:27:49.865.150 [single_op_manager.cc:50]618670 ReleaseResource:ReleaseResource in. resource id = 0xaaaae4d883c0
[INFO] GE(618670,python3.9):2025-04-03-09:27:49.865.169 [caching_allocator.cc:402]618670 TryFreeBlocks:Try free blocks.
[INFO] GE(618670,python3.9):2025-04-03-09:27:49.865.185 [caching_allocator.cc:358]618670 FreeCachedBlocks:Free cached blocks
[INFO] GE(618670,python3.9):2025-04-03-09:27:49.865.196 [npu_memory_allocator.cc:72]618670 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.865.208 [stream_executor.cpp:197]618670 RemoveExecutor: To remove executor by stream = 187650960556992
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.865.222 [acl_resource_manager.cpp:823]618670 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.865.237 [stream.cc:852] 618670 TearDown: stream_id=4, sqId=4, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.865.252 [stream.cc:938] 618670 TearDown: stream_id=4, delay recycle task num=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.865.267 [stream.cc:1507] 618670 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.865.288 [stream_sqcq_manage.cc:451] 618670 FreeLogicCq: Return(0), threadIdentifier(281473556700640), devId(6), tsId(0), cqId(300), isFastCq(0).
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.865.310 [npu_driver.cc:6163] 618670 StreamUnBindLogicCq: success: deviceId=6, tsId=0, streamId=4, logicCq=300.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.865.345 [npu_driver.cc:1180] 618670 LogicCqFree: Succ:device_id=6,ts_id=0,type=2,logic_cq_id=300, drvFlag=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.865.368 [api_impl.cc:3419] 618794 DeviceReset: reset device, device_id=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.865.370 [api_impl.cc:3419] 618792 DeviceReset: reset device, device_id=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.865.392 [runtime.cc:3444] 618794 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x7, reset:0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.865.403 [runtime.cc:3444] 618792 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x6, reset:0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.865.410 [api_impl.cc:3449] 618794 DeviceReset: Succ, userDeviceId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.865.419 [api_impl.cc:3449] 618792 DeviceReset: Succ, userDeviceId=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.865.707 [api_impl.cc:3717] 618658 ContextSetCurrent: set context=aaab0b9e09a0, flag=0.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.865.730 [adapter_rts.cc:321] [618658][hrtCtxSetCurrent] success
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.865.748 [stream.cc:182] [618658]Switch Ctx ret[0], curCtx[0xaaab0b9e09a0], setCtx[0xaaab0b9e09a0], stream id[5]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.865.767 [api_impl.cc:1228] 618658 StreamDestroy: stream_id=5.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.865.791 [acl_resource_manager.cpp:814]618658 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] GE(618658,python3.9):2025-04-03-09:27:49.865.834 [single_op_manager.cc:50]618658 ReleaseResource:ReleaseResource in. resource id = 0xaaab15f42cd0
[INFO] GE(618658,python3.9):2025-04-03-09:27:49.865.861 [caching_allocator.cc:402]618658 TryFreeBlocks:Try free blocks.
[INFO] GE(618658,python3.9):2025-04-03-09:27:49.865.878 [caching_allocator.cc:358]618658 FreeCachedBlocks:Free cached blocks
[INFO] GE(618658,python3.9):2025-04-03-09:27:49.865.906 [npu_memory_allocator.cc:72]618658 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.865.924 [stream_executor.cpp:197]618658 RemoveExecutor: To remove executor by stream = 187651784453328
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.865.955 [acl_resource_manager.cpp:823]618658 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.865.974 [stream.cc:852] 618658 TearDown: stream_id=5, sqId=5, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.865.995 [stream.cc:938] 618658 TearDown: stream_id=5, delay recycle task num=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.866.013 [stream.cc:1507] 618658 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.866.093 [stream_sqcq_manage.cc:451] 618658 FreeLogicCq: Return(0), threadIdentifier(281473716280800), devId(3), tsId(0), cqId(1043), isFastCq(0).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.866.124 [npu_driver.cc:6163] 618658 StreamUnBindLogicCq: success: deviceId=3, tsId=0, streamId=5, logicCq=1043.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.866.169 [npu_driver.cc:1180] 618658 LogicCqFree: Succ:device_id=3,ts_id=0,type=2,logic_cq_id=1043, drvFlag=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.866.931 [stream.cc:237] 618650 FreeStreamId: Free stream_id=5.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.866.958 [stream_sqcq_manage.cc:216] 618650 DeAllocStreamSqCq: deviceId=1, tsId=0, drvFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.866.970 [npu_driver.cc:966] 618650 NormalSqCqFree: Normal sqcq free, sqId=5, cqId=5, device_id=1, tsId=0, drvFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.867.592 [npu_driver.cc:974] 618650 NormalSqCqFree: Normal sqcq free success, sqId=5, cqId=5, device_id=1, tsId=0, drvFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.867.608 [stream_sqcq_manage.cc:228] 618650 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=5, cq_id=5, stream_id=5, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.867.621 [npu_driver.cc:432] 618650 StreamIdFree: stream id free begin, device_id=1, stream_id=5, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.867.638 [npu_driver.cc:441] 618650 StreamIdFree: Stream id free success, stream_id=5, device_id=1, tsId=0, streamFlag=1536
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.868.315 [stream.cc:185] [618650][HCCL_TRACE]StreamDestroy, streamPtr[0xaaab3c7331f0], stream id[5]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.868.336 [api_impl.cc:3717] 618650 ContextSetCurrent: set context=aaab312ab590, flag=0.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.868.351 [adapter_rts.cc:321] [618650][hrtCtxSetCurrent] success
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.868.362 [stream.cc:193] [618650]Restore Ctx ret[0], setCtx[0xaaab312ab590], stream id[5]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.868.327 [stream.cc:237] 618658 FreeStreamId: Free stream_id=5.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.868.418 [api_impl.cc:3717] 618650 ContextSetCurrent: set context=aaab312ab590, flag=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.868.413 [stream_sqcq_manage.cc:216] 618658 DeAllocStreamSqCq: deviceId=3, tsId=0, drvFlag=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.868.435 [adapter_rts.cc:321] [618650][hrtCtxSetCurrent] success
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.868.434 [npu_driver.cc:966] 618658 NormalSqCqFree: Normal sqcq free, sqId=5, cqId=5, device_id=3, tsId=0, drvFlag=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.868.445 [stream.cc:182] [618650]Switch Ctx ret[0], curCtx[0xaaab312ab590], setCtx[0xaaab312ab590], stream id[4]
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.868.460 [api_impl.cc:1228] 618650 StreamDestroy: stream_id=4.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.868.472 [acl_resource_manager.cpp:814]618650 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] GE(618650,python3.9):2025-04-03-09:27:49.868.484 [single_op_manager.cc:50]618650 ReleaseResource:ReleaseResource in. resource id = 0xaaab3c6b7190
[INFO] GE(618650,python3.9):2025-04-03-09:27:49.868.498 [caching_allocator.cc:402]618650 TryFreeBlocks:Try free blocks.
[INFO] GE(618650,python3.9):2025-04-03-09:27:49.868.507 [caching_allocator.cc:358]618650 FreeCachedBlocks:Free cached blocks
[INFO] GE(618650,python3.9):2025-04-03-09:27:49.868.518 [npu_memory_allocator.cc:72]618650 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.868.528 [stream_executor.cpp:197]618650 RemoveExecutor: To remove executor by stream = 187652429803920
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.868.538 [acl_resource_manager.cpp:823]618650 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.868.548 [stream.cc:852] 618650 TearDown: stream_id=4, sqId=4, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.868.562 [stream.cc:938] 618650 TearDown: stream_id=4, delay recycle task num=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.868.572 [stream.cc:1507] 618650 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.868.593 [stream_sqcq_manage.cc:451] 618650 FreeLogicCq: Return(0), threadIdentifier(281473891839456), devId(1), tsId(0), cqId(404), isFastCq(0).
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.868.612 [npu_driver.cc:6163] 618650 StreamUnBindLogicCq: success: deviceId=1, tsId=0, streamId=4, logicCq=404.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.868.643 [npu_driver.cc:1180] 618650 LogicCqFree: Succ:device_id=1,ts_id=0,type=2,logic_cq_id=404, drvFlag=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.868.644 [stream.cc:237] 618670 FreeStreamId: Free stream_id=4.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.868.680 [stream_sqcq_manage.cc:216] 618670 DeAllocStreamSqCq: deviceId=6, tsId=0, drvFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.868.697 [npu_driver.cc:966] 618670 NormalSqCqFree: Normal sqcq free, sqId=4, cqId=4, device_id=6, tsId=0, drvFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.869.040 [npu_driver.cc:974] 618658 NormalSqCqFree: Normal sqcq free success, sqId=5, cqId=5, device_id=3, tsId=0, drvFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.869.061 [stream_sqcq_manage.cc:228] 618658 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=5, cq_id=5, stream_id=5, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.869.079 [npu_driver.cc:432] 618658 StreamIdFree: stream id free begin, device_id=3, stream_id=5, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.869.103 [npu_driver.cc:441] 618658 StreamIdFree: Stream id free success, stream_id=5, device_id=3, tsId=0, streamFlag=1536
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:49.869.131 [awatchdog_monitor.c:160](tid:618687) thread 618791 not exist
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:49.869.163 [awatchdog_monitor.c:160](tid:618687) thread 618792 not exist
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:49.869.185 [awatchdog_monitor.c:160](tid:618687) thread 618793 not exist
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:49.869.206 [awatchdog_monitor.c:160](tid:618687) thread 618794 not exist
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.869.202 [npu_driver.cc:974] 618670 NormalSqCqFree: Normal sqcq free success, sqId=4, cqId=4, device_id=6, tsId=0, drvFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.869.221 [stream_sqcq_manage.cc:228] 618670 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=4, cq_id=4, stream_id=4, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.869.236 [npu_driver.cc:432] 618670 StreamIdFree: stream id free begin, device_id=6, stream_id=4, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.869.253 [npu_driver.cc:441] 618670 StreamIdFree: Stream id free success, stream_id=4, device_id=6, tsId=0, streamFlag=1536
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.869.831 [stream.cc:185] [618658][HCCL_TRACE]StreamDestroy, streamPtr[0xaaab15f42cd0], stream id[5]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.869.843 [stream.cc:185] [618670][HCCL_TRACE]StreamDestroy, streamPtr[0xaaaae4d883c0], stream id[4]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.869.854 [api_impl.cc:3717] 618658 ContextSetCurrent: set context=aaab0b9e09a0, flag=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.869.863 [api_impl.cc:3717] 618670 ContextSetCurrent: set context=aaaad9a630c0, flag=0.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.869.871 [adapter_rts.cc:321] [618658][hrtCtxSetCurrent] success
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.869.878 [adapter_rts.cc:321] [618670][hrtCtxSetCurrent] success
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.869.894 [stream.cc:193] [618670]Restore Ctx ret[0], setCtx[0xaaaad9a630c0], stream id[4]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.869.888 [stream.cc:193] [618658]Restore Ctx ret[0], setCtx[0xaaab0b9e09a0], stream id[5]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.869.924 [hcom_executor.cc:45] [618670][Finalize][HcomExecutor]Hcom Excutor Finalize end. ret[0]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.869.947 [api_impl.cc:3717] 618658 ContextSetCurrent: set context=aaab0b9e09a0, flag=0.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.869.967 [adapter_rts.cc:321] [618658][hrtCtxSetCurrent] success
[INFO] HCCL_ADPT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.869.963 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:814] FinalizeHcclExec] HcclExec destroy success
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.869.982 [stream.cc:182] [618658]Switch Ctx ret[0], curCtx[0xaaab0b9e09a0], setCtx[0xaaab0b9e09a0], stream id[4]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.869.999 [api_impl.cc:1228] 618658 StreamDestroy: stream_id=4.
[INFO] HCCL_ADPT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.869.991 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:616] FinalizeKernelInfoStore] Start destroy hccl kernel info store.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.018 [hcom_ops_kernel_info_store.cc:3423] [618670]finalize hccl kernel info store.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.870.014 [acl_resource_manager.cpp:814]618658 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] GE(618658,python3.9):2025-04-03-09:27:49.870.031 [single_op_manager.cc:50]618658 ReleaseResource:ReleaseResource in. resource id = 0xaaab15ec6c70
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.036 [hcom_common.cc:85] [618670][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[6] 
[INFO] GE(618658,python3.9):2025-04-03-09:27:49.870.048 [caching_allocator.cc:402]618658 TryFreeBlocks:Try free blocks.
[INFO] GE(618658,python3.9):2025-04-03-09:27:49.870.064 [caching_allocator.cc:358]618658 FreeCachedBlocks:Free cached blocks
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.060 [plugin_manager.cc:56] [618670]hccl ops plugin finalize start.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.077 [hcom_plugin.cc:90] [618670]Finalize start.
[INFO] GE(618658,python3.9):2025-04-03-09:27:49.870.077 [npu_memory_allocator.cc:72]618658 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.870.094 [stream_executor.cpp:197]618658 RemoveExecutor: To remove executor by stream = 187651783945328
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.870.109 [acl_resource_manager.cpp:823]618658 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.870.123 [stream.cc:852] 618658 TearDown: stream_id=4, sqId=4, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.870.141 [stream.cc:938] 618658 TearDown: stream_id=4, delay recycle task num=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.870.153 [stream.cc:1507] 618658 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.870.195 [stream.cc:237] 618650 FreeStreamId: Free stream_id=4.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.186 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[0].isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.206 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.870.197 [stream_sqcq_manage.cc:451] 618658 FreeLogicCq: Return(0), threadIdentifier(281473716280800), devId(3), tsId(0), cqId(1042), isFastCq(0).
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.870.212 [stream_sqcq_manage.cc:216] 618650 DeAllocStreamSqCq: deviceId=1, tsId=0, drvFlag=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.221 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.870.221 [npu_driver.cc:6163] 618658 StreamUnBindLogicCq: success: deviceId=3, tsId=0, streamId=4, logicCq=1042.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.870.233 [npu_driver.cc:966] 618650 NormalSqCqFree: Normal sqcq free, sqId=4, cqId=4, device_id=1, tsId=0, drvFlag=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.236 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.870.255 [npu_driver.cc:1180] 618658 LogicCqFree: Succ:device_id=3,ts_id=0,type=2,logic_cq_id=1042, drvFlag=0.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.263 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[1].isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.276 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.287 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.299 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.328 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[2].isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.343 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.352 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.364 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.391 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[3].isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.406 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.416 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.427 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.455 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[4].isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.470 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.480 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.492 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.504 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[5].isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.516 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.528 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.540 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.552 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[6].isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.566 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.576 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.587 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.614 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[7].isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.635 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.644 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.656 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.684 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[8].isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.699 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.709 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.720 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.748 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[9].isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.762 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.870.752 [npu_driver.cc:974] 618650 NormalSqCqFree: Normal sqcq free success, sqId=4, cqId=4, device_id=1, tsId=0, drvFlag=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.775 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.787 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.870.769 [stream_sqcq_manage.cc:228] 618650 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=4, cq_id=4, stream_id=4, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.870.784 [npu_driver.cc:432] 618650 StreamIdFree: stream id free begin, device_id=1, stream_id=4, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.870.798 [npu_driver.cc:441] 618650 StreamIdFree: Stream id free success, stream_id=4, device_id=1, tsId=0, streamFlag=1536
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.815 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[10].isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.830 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.839 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.851 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.879 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[11].isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.893 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.903 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.915 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.942 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[12].isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.957 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.966 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.870.978 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] TDT(618666,python3.9):2025-04-03-09:27:49.870.970 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618666] [ServerToClientMsgProc] [sessionID=1]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:49.870.991 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618666] [TsdClient] DeviceMsgProc recvMsg realDeviceId[5] msgType[61] localDevId[5] rspCode[0]heterogeneousSubPid[30114], tsdSupportLevel_[63]
[INFO] TDT(618666,python3.9):2025-04-03-09:27:49.871.009 [hdc_client.cpp:172][TsdRecvData][tid:618666] [deviceId=5] the Tsd recv data already
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.009 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[13].isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.024 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] TDT(618666,python3.9):2025-04-03-09:27:49.871.024 [process_mode_manager.cpp:1809][ExcuteClosePidList][tid:618666] leave ExcuteClosePidList startindex:0, cnt:1
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.036 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:49.871.039 [process_mode_manager.cpp:1769][ProcessCloseSubProcList][tid:618666] ExcuteClosePidList success reserveCnt:1
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.048 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.871.052 [adapter_tdt.cc:52] [618666]Open TsdProcess success. deviceLogicId[5]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.871.065 [network_manager.cc:405] [618666][DeInit]finish CloseHccpProcess, phy_id[5], hdc_type[18], nicDeployment[1], hasBackup[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.871.079 [network_manager.cc:409] [618666]NetworkManager: deinit nic success, nicPosition[1] ref[0].
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.075 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[14].isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.090 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.871.091 [hccl_communicator_attrs.cc:1307] [618666][HcclCommunicator]IsSupportEnableRoce
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.871.105 [hccl_communicator_attrs.cc:1275] [618666]IsEnableRoce ret: 0, interServer_: 0, isInterServerVnic: 0, roceSwitch: 0, isSingleMeshAggregation_: 1
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.102 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.113 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.871.123 [notify_pool_impl.cc:43] [618666]NotifyPoolImpl Destroy.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.871.140 [notify_pool_impl.cc:56] [618666]NotifyPoolImpl Destroy success.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.140 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[15].isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.156 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.166 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.161 [api_impl.cc:3100] 618666 GetDevicePhyIdByIndex: get PhyId by Index=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.176 [api_impl.cc:3111] 618666 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=5
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.186 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.190 [api_impl.cc:3130] 618666 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=5
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.199 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[16].isHcomInit is false.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.206 [api_impl.cc:3100] 618666 GetDevicePhyIdByIndex: get PhyId by Index=5.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.212 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.219 [api_impl.cc:3111] 618666 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=5
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.224 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.240 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.246 [api_impl.cc:3130] 618666 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=5
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.253 [hcom_plugin.cc:119] [618670]Finalize: HcomDestroy success.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.871.259 [p2p_mgmt.cc:171] [618666]local logic id:5, local physic id:5.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.266 [plugin_manager.cc:62] [618670]hccl ops plugin finalize end. ret[0]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.275 [api_impl.cc:3520] 618666 GetPhyDeviceInfo: get phy device info, phyId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.298 [api_impl.cc:3520] 618666 GetPhyDeviceInfo: get phy device info, phyId=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.871.314 [p2p_mgmt.cc:178] [618666]disable p2p: local logic id:5, remote physic id:0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.327 [api_impl.cc:3184] 618666 DisableP2P: Disable P2P devIdDes=5, phyIdSrc=0.
[INFO] DRV(618666,python3.9):2025-04-03-09:27:49.871.344 [devdrv_pcie.c:890][ascend][curpid:618666,618666][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=5; peer_phy_devid=0.)
[INFO] HCCL_ADPT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.871.341 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:638] FinalizeKernelInfoStore] Destroy hccl kernel info store success.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.359 [api_impl.cc:3100] 618666 GetDevicePhyIdByIndex: get PhyId by Index=5.
[INFO] HCCL_ADPT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.871.366 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:695] FinalizeHcclComm] Start finalize hccl comm.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.371 [api_impl.cc:3111] 618666 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=5
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.381 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[0].isHcomInit is false.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.385 [api_impl.cc:3130] 618666 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=5
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.871.399 [p2p_mgmt.cc:171] [618666]local logic id:5, local physic id:5.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.396 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.409 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.412 [api_impl.cc:3520] 618666 GetPhyDeviceInfo: get phy device info, phyId=5
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.422 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.426 [api_impl.cc:3520] 618666 GetPhyDeviceInfo: get phy device info, phyId=1
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.435 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[1].isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.871.439 [p2p_mgmt.cc:178] [618666]disable p2p: local logic id:5, remote physic id:1.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.449 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.453 [api_impl.cc:3184] 618666 DisableP2P: Disable P2P devIdDes=5, phyIdSrc=1.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.460 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] DRV(618666,python3.9):2025-04-03-09:27:49.871.468 [devdrv_pcie.c:890][ascend][curpid:618666,618666][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=5; peer_phy_devid=1.)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.485 [api_impl.cc:3100] 618666 GetDevicePhyIdByIndex: get PhyId by Index=5.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.474 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.490 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[2].isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.871.477 [stream.cc:185] [618650][HCCL_TRACE]StreamDestroy, streamPtr[0xaaab3c6b7190], stream id[4]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.499 [api_impl.cc:3111] 618666 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=5
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.503 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.871.495 [api_impl.cc:3717] 618650 ContextSetCurrent: set context=aaab312ab590, flag=0.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.871.508 [adapter_rts.cc:321] [618650][hrtCtxSetCurrent] success
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.871.519 [stream.cc:193] [618650]Restore Ctx ret[0], setCtx[0xaaab312ab590], stream id[4]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.516 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.528 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.539 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[3].isHcomInit is false.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.510 [api_impl.cc:3130] 618666 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=5
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.871.523 [p2p_mgmt.cc:171] [618666]local logic id:5, local physic id:5.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.871.517 [stream.cc:237] 618658 FreeStreamId: Free stream_id=4.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.871.550 [hcom_executor.cc:45] [618650][Finalize][HcomExecutor]Hcom Excutor Finalize end. ret[0]
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.551 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.564 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.536 [api_impl.cc:3520] 618666 GetPhyDeviceInfo: get phy device info, phyId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.549 [api_impl.cc:3520] 618666 GetPhyDeviceInfo: get phy device info, phyId=2
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.871.560 [p2p_mgmt.cc:178] [618666]disable p2p: local logic id:5, remote physic id:2.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.571 [api_impl.cc:3184] 618666 DisableP2P: Disable P2P devIdDes=5, phyIdSrc=2.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.871.551 [stream_sqcq_manage.cc:216] 618658 DeAllocStreamSqCq: deviceId=3, tsId=0, drvFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.871.566 [npu_driver.cc:966] 618658 NormalSqCqFree: Normal sqcq free, sqId=4, cqId=4, device_id=3, tsId=0, drvFlag=0
[INFO] HCCL_ADPT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.871.587 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:814] FinalizeHcclExec] HcclExec destroy success
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.576 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.587 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[4].isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.598 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] DRV(618666,python3.9):2025-04-03-09:27:49.871.585 [devdrv_pcie.c:890][ascend][curpid:618666,618666][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=5; peer_phy_devid=2.)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.601 [api_impl.cc:3100] 618666 GetDevicePhyIdByIndex: get PhyId by Index=5.
[INFO] HCCL_ADPT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.871.612 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:616] FinalizeKernelInfoStore] Start destroy hccl kernel info store.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.871.625 [hcom_ops_kernel_info_store.cc:3423] [618650]finalize hccl kernel info store.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.609 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.622 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.632 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[5].isHcomInit is false.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.612 [api_impl.cc:3111] 618666 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.625 [api_impl.cc:3130] 618666 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=5
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.871.645 [p2p_mgmt.cc:171] [618666]local logic id:5, local physic id:5.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.871.642 [hcom_common.cc:85] [618650][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[1] 
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.660 [api_impl.cc:3520] 618666 GetPhyDeviceInfo: get phy device info, phyId=5
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.645 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.656 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.871.663 [plugin_manager.cc:56] [618650]hccl ops plugin finalize start.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.672 [api_impl.cc:3520] 618666 GetPhyDeviceInfo: get phy device info, phyId=3
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.871.686 [p2p_mgmt.cc:178] [618666]disable p2p: local logic id:5, remote physic id:3.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.697 [api_impl.cc:3184] 618666 DisableP2P: Disable P2P devIdDes=5, phyIdSrc=3.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.680 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.692 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[6].isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.703 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.871.679 [hcom_plugin.cc:90] [618650]Finalize start.
[INFO] DRV(618666,python3.9):2025-04-03-09:27:49.871.711 [devdrv_pcie.c:890][ascend][curpid:618666,618666][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=5; peer_phy_devid=3.)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.728 [api_impl.cc:3100] 618666 GetDevicePhyIdByIndex: get PhyId by Index=5.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.713 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.726 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.736 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[7].isHcomInit is false.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.739 [api_impl.cc:3111] 618666 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.751 [api_impl.cc:3130] 618666 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=5
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.749 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.761 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.871.763 [p2p_mgmt.cc:171] [618666]local logic id:5, local physic id:5.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.773 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.871.762 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[0].isHcomInit is false.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.777 [api_impl.cc:3520] 618666 GetPhyDeviceInfo: get phy device info, phyId=5
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.785 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[8].isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.871.780 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.871.794 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.791 [api_impl.cc:3520] 618666 GetPhyDeviceInfo: get phy device info, phyId=4
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.871.805 [p2p_mgmt.cc:178] [618666]disable p2p: local logic id:5, remote physic id:4.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.799 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.811 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.822 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.871.806 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.871.819 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[1].isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.871.830 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.817 [api_impl.cc:3184] 618666 DisableP2P: Disable P2P devIdDes=5, phyIdSrc=4.
[INFO] DRV(618666,python3.9):2025-04-03-09:27:49.871.833 [devdrv_pcie.c:890][ascend][curpid:618666,618666][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=5; peer_phy_devid=4.)
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.834 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[9].isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.846 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.848 [api_impl.cc:3100] 618666 GetDevicePhyIdByIndex: get PhyId by Index=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.860 [api_impl.cc:3111] 618666 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.871 [api_impl.cc:3130] 618666 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=5
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.871.882 [p2p_mgmt.cc:171] [618666]local logic id:5, local physic id:5.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.871.842 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.871.853 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.858 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.871 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.881 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[10].isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.892 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.896 [api_impl.cc:3100] 618666 GetDevicePhyIdByIndex: get PhyId by Index=5.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.871.877 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[2].isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.871.889 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.871.900 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.904 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.915 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.908 [api_impl.cc:3111] 618666 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.921 [api_impl.cc:3130] 618666 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=5
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.871.910 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.926 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[11].isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.938 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.871.932 [p2p_mgmt.cc:171] [618666]local logic id:5, local physic id:5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.946 [api_impl.cc:3520] 618666 GetPhyDeviceInfo: get phy device info, phyId=5
.9):2025-04-03-09:27:49.871.933 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[3].isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.871.954 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.949 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.962 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.958 [api_impl.cc:3520] 618666 GetPhyDeviceInfo: get phy device info, phyId=6
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.871.971 [p2p_mgmt.cc:178] [618666]disable p2p: local logic id:5, remote physic id:6.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.871.965 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.871.976 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.871.998 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[4].isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.975 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[12].isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.988 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.871.999 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.872.009 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.871.996 [npu_driver.cc:974] 618658 NormalSqCqFree: Normal sqcq free success, sqId=4, cqId=4, device_id=3, tsId=0, drvFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.871.983 [api_impl.cc:3184] 618666 DisableP2P: Disable P2P devIdDes=5, phyIdSrc=6.
[INFO] DRV(618666,python3.9):2025-04-03-09:27:49.871.998 [devdrv_pcie.c:890][ascend][curpid:618666,618666][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=5; peer_phy_devid=6.)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.872.012 [api_impl.cc:3100] 618666 GetDevicePhyIdByIndex: get PhyId by Index=5.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.012 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.025 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.872.021 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[13].isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.872.034 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.872.018 [stream_sqcq_manage.cc:228] 618658 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=4, cq_id=4, stream_id=4, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.872.037 [npu_driver.cc:432] 618658 StreamIdFree: stream id free begin, device_id=3, stream_id=4, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.872.034 [api_impl.cc:3111] 618666 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.872.049 [api_impl.cc:3130] 618666 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=5
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.872.045 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.872.056 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.872.066 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[14].isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.036 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.059 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[5].isHcomInit is false.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.872.054 [npu_driver.cc:441] 618658 StreamIdFree: Stream id free success, stream_id=4, device_id=3, tsId=0, streamFlag=1536
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.872.060 [p2p_mgmt.cc:171] [618666]local logic id:5, local physic id:5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.872.074 [api_impl.cc:3520] 618666 GetPhyDeviceInfo: get phy device info, phyId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.872.086 [api_impl.cc:3520] 618666 GetPhyDeviceInfo: get phy device info, phyId=7
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.872.089 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.071 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.082 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.092 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.112 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[6].isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.125 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.135 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.147 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.872.100 [p2p_mgmt.cc:178] [618666]disable p2p: local logic id:5, remote physic id:7.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.872.112 [api_impl.cc:3184] 618666 DisableP2P: Disable P2P devIdDes=5, phyIdSrc=7.
[INFO] DRV(618666,python3.9):2025-04-03-09:27:49.872.125 [devdrv_pcie.c:890][ascend][curpid:618666,618666][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=5; peer_phy_devid=7.)
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.872.103 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.872.115 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.872.126 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[15].isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.872.138 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.872.141 [hccl_communicator.cc:2043] [618666]Profiling is deinitiated.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.872.167 [api_impl.cc:2003] 618666 DevFree: device free mem=0x12c280000000
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.872.190 [api_impl.cc:2003] 618666 DevFree: device free mem=0x12c280001000
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.190 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[7].isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.872.149 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.872.177 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.872.188 [hcom_common.cc:958] [618670][Destroy][Result]hcomInfo[16].isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.872.199 [hcom_common.cc:961] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.872.210 [hcom.cc:337] [618670][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.872.206 [api_impl.cc:2003] 618666 DevFree: device free mem=0x12c280002000
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.211 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.222 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:49.872.225 [hcom.cc:340] [618670]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.872.225 [opexecounter.cc:103] [618666]free counter mem resource
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:49.872.241 [atrace_api.c:118](tid:618666) AtraceDestroy start.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.233 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL_ADPT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.251 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:377] FinalizeHccl] Destroy hccl adapter success.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:49.872.256 [tracer_mgr_operate.c:248](tid:618666) destroy object HCCL_618983_5, exitSave(true).
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:49.872.270 [atrace_api.c:120](tid:618666) AtraceDestroy end.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.254 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[8].isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.266 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.277 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.286 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.271 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:613] DestroyHccl] Hccl destroy successful.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.872.282 [adapter_trace.cc:33] [618666]Call TraceDestroy, Params:handle[0xaaaae62b46b8]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.307 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[9].isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.318 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.326 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.336 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.354 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[10].isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.366 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.374 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.384 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.407 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[11].isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.417 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.434 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.443 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.464 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[12].isHcomInit is false.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.461 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	In used mem buf info for Mem buf allocator, is persistent : 1, stream id : 0., mem_bufs size : 1
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.478 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.486 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.484 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	In used mem buf info for Mem buf allocator, is persistent : 0, stream id : 0., mem_bufs size : 1
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.500 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] stream id : 0, is persistent : 0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.498 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.517 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] Dump state info for Mem buf allocator, is persistent : 0, stream id : 0.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.522 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[13].isHcomInit is false.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.534 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block info - total count : 1
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.549 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 		{"addr_":0x12d100000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12d100000000,"max_addr_":0x12d100000200}
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.535 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.546 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.556 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.564 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block total size : 61029220352
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.579 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Free mem buf total size : 0, total count : 0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.581 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[14].isHcomInit is false.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.594 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Eager free mem buf total size : 61029219840, total count : 1
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.593 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.611 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] stream id : 0, is persistent : 1
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.605 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.615 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.626 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] Dump state info for Mem buf allocator, is persistent : 1, stream id : 0.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.638 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[15].isHcomInit is false.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.650 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block info - total count : 1
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.652 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.663 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.666 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 		{"addr_":0x12c2c0000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12c2c0000000,"max_addr_":0x12c2c0000200}
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.674 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.682 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block total size : 61029220352
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.684 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[16].isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.694 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.696 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Free mem buf total size : 0, total count : 0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.704 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.713 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Eager free mem buf total size : 61029219840, total count : 1
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.728 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] The dynamic memory pool[DefaultAscendMemoryPool] stat info : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":116404.00MB,"idle mem":116403.99MB,"used by event mem":0.00MB,"eager free mem":116403.99MB}, actual peak used mem:4M. Weight used size:0M, constant value used size:0M, kernel output used size:0M, other used size:0M.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.715 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.726 [hcom_plugin.cc:119] [618650]Finalize: HcomDestroy success.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.737 [plugin_manager.cc:62] [618650]hccl ops plugin finalize end. ret[0]
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.755 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:430] ReleaseDeviceRes] Release device resource for DefaultAscendMemoryPool : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":116404.00MB,"idle mem":116403.99MB,"used by event mem":0.00MB,"eager free mem":116403.99MB}.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.776 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:62] ReleaseDeviceRes] Release device resource for allocator, Mem buf allocator, is persistent : 0, stream id : 0., mem_blocks_ size : 1.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.797 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:65] ReleaseDeviceRes] Clean mem block : {"addr_":0x12d100000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12d100000000,"max_addr_":0x12d100000200}.
[INFO] HCCL_ADPT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.872.802 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:638] FinalizeKernelInfoStore] Destroy hccl kernel info store success.
[INFO] HCCL_ADPT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.872.824 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:695] FinalizeHcclComm] Start finalize hccl comm.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.817 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:191] FreeDeviceMem] Max actual used memory size is 4194304
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.872.800 [stream.cc:185] [618658][HCCL_TRACE]StreamDestroy, streamPtr[0xaaab15ec6c70], stream id[4]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.872.826 [api_impl.cc:3717] 618658 ContextSetCurrent: set context=aaab0b9e09a0, flag=0.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.834 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[0].isHcomInit is false.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.836 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:194] FreeDeviceMem] Max peak used memory size is 1024
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.872.845 [adapter_rts.cc:321] [618658][hrtCtxSetCurrent] success
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.872.857 [stream.cc:193] [618658]Restore Ctx ret[0], setCtx[0xaaab0b9e09a0], stream id[4]
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.850 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.861 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.854 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:69] ReleaseDeviceRes] Delete mem block : {"addr_":0x12d100000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12d100000000,"max_addr_":0x12d100000200}.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.870 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:74] ReleaseDeviceRes] Free mem buf size : 0.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.872 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.884 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[1].isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.872.889 [hcom_executor.cc:45] [618658][Finalize][HcomExecutor]Hcom Excutor Finalize end. ret[0]
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.885 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:80] ReleaseDeviceRes] Eager free mem buf size : 1.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.903 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:62] ReleaseDeviceRes] Release device resource for allocator, Mem buf allocator, is persistent : 1, stream id : 0., mem_blocks_ size : 1.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.895 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.914 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.924 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.935 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[2].isHcomInit is false.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.919 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:65] ReleaseDeviceRes] Clean mem block : {"addr_":0x12c2c0000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12c2c0000000,"max_addr_":0x12c2c0000200}.
[INFO] HCCL_ADPT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.872.929 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:814] FinalizeHcclExec] HcclExec destroy success
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.948 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.950 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:191] FreeDeviceMem] Max actual used memory size is 4194304
[INFO] HCCL_ADPT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.872.956 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:616] FinalizeKernelInfoStore] Start destroy hccl kernel info store.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.966 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:194] FreeDeviceMem] Max peak used memory size is 1024
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.983 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:69] ReleaseDeviceRes] Delete mem block : {"addr_":0x12c2c0000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12c2c0000000,"max_addr_":0x12c2c0000200}.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.956 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.968 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.978 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[3].isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.872.971 [hcom_ops_kernel_info_store.cc:3423] [618658]finalize hccl kernel info store.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.872.989 [hcom_common.cc:85] [618658][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[3] 
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.872.998 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:74] ReleaseDeviceRes] Free mem buf size : 0.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.013 [plugin_manager.cc:56] [618658]hccl ops plugin finalize start.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.872.990 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.000 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.873.012 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:80] ReleaseDeviceRes] Eager free mem buf size : 1.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.029 [hcom_plugin.cc:90] [618658]Finalize start.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.011 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.022 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[4].isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.033 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.045 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.873.032 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:45] ~MemBufAllocator] MemBufAllocator[0xfffea4100230] : Mem buf allocator, is persistent : 1, stream id : 0. deconstruct.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.873.052 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:45] ~MemBufAllocator] MemBufAllocator[0xfffea4100b20] : Mem buf allocator, is persistent : 0, stream id : 0. deconstruct.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.053 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.064 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[5].isHcomInit is false.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.873.076 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:222] DeInitialize] Ascend Memory Adapter deinitialize success, statistics:
Device MOC memory size: 62420M
MindSpore Used memory size: 58202M
Used peak memory usage (without fragments): 0M
Actual peak memory usage (with fragments): 4M

[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.074 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.083 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.094 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.102 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[6].isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.112 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.873.100 [callback.cpp:37]618670 aclrtSetExceptionInfoCallback: start to execute aclrtSetExceptionInfoCallback.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.121 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.131 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.873.124 [callback.cpp:44]618670 aclrtSetExceptionInfoCallback: successfully execute aclrtSetExceptionInfoCallback
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.141 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[7].isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.153 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.134 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[0].isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.152 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.162 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.173 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.168 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.181 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.873.165 [context.cpp:72]618670 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.183 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[8].isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.196 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.205 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.208 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[1].isHcomInit is false.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.186 [api_impl.cc:3717] 618670 ContextSetCurrent: set context=aaaad9a630c0, flag=0.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.873.201 [context.cpp:80]618670 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.873.216 [stream.cpp:75]618670 aclrtDestroyStream: start to execute aclrtDestroyStream
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.217 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.229 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[9].isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.221 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] GE(618670,python3.9):2025-04-03-09:27:49.873.240 [stream_manage_func_registry.cc:22]618670 TryCallStreamMngFunc:Stream manage func is not found, FuncType is [0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.246 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.260 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.241 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.251 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.873.255 [stream.cpp:80]618670 aclrtDestroyStream: try to call stream manage function success, action type is DESTROY_STREAM.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.269 [api_impl.cc:1228] 618670 StreamDestroy: stream_id=2.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.270 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[2].isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.263 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.282 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[10].isHcomInit is false.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.873.285 [acl_resource_manager.cpp:814]618670 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.285 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.298 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.292 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.302 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.313 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] GE(618670,python3.9):2025-04-03-09:27:49.873.300 [single_op_manager.cc:50]618670 ReleaseResource:ReleaseResource in. resource id = 0xaaaada9cc680
[INFO] GE(618670,python3.9):2025-04-03-09:27:49.873.317 [caching_allocator.cc:402]618670 TryFreeBlocks:Try free blocks.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.310 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.323 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[3].isHcomInit is false.
[INFO] GE(618670,python3.9):2025-04-03-09:27:49.873.328 [caching_allocator.cc:358]618670 FreeCachedBlocks:Free cached blocks
[INFO] GE(618670,python3.9):2025-04-03-09:27:49.873.351 [npu_memory_allocator.cc:72]618670 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.336 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.350 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.361 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.873.364 [stream_executor.cpp:197]618670 RemoveExecutor: To remove executor by stream = 187650788869760
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.325 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[11].isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.336 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.873.378 [acl_resource_manager.cpp:823]618670 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.347 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.358 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.368 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[12].isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.379 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.390 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.392 [stream.cc:852] 618670 TearDown: stream_id=2, sqId=2, pendingNum=0, isForceRecycle_=0, flag=0, failMode=1.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.400 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.390 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[4].isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.407 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.408 [stream.cc:938] 618670 TearDown: stream_id=2, delay recycle task num=0.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.409 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[13].isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.423 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.422 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.436 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.435 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.445 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.442 [event.cc:1036] 618670 WaitForBusy: device_id=6, event_id=0 finished map already empty.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.456 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[14].isHcomInit is false.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.461 [npu_driver.cc:626] 618670 EventIdFree: event id free begin, device_id=6, event_id=0, ts_id=0, remote_event_id=0
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.465 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.478 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.464 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[5].isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.482 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.487 [raw_device.cc:1158] 618670 FreeEventIdFromDrv: device_id=6, event_id=0 tear down.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.488 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.500 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[15].isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.511 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.495 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.507 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.504 [event.cc:61] 618670 ~Event: device_id=6, event deconstruct, recordSize=0, waitSize=0, idSize=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.523 [npu_driver.cc:3803] 618670 SqCqFree: deviceId=6, tsId=0, sqId=89, cqId=89
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.530 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[6].isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.545 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.522 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.532 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.558 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.542 [hcom_common.cc:958] [618650][Destroy][Result]hcomInfo[16].isHcomInit is false.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.553 [hcom_common.cc:961] [618650]Entry-HcomDestroy:void skip
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.564 [hcom.cc:337] [618650][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.572 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.560 [subscribe.cc:244] 618670 Delete: delete callback subscribe: groupId=64, threadId=281471545700256, devId=6, tsId=0, streamId=2, sqId=89, cqId=89
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:49.873.560 [trs_sqcq.c:1491][ascend][curpid:618670,618822][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:49.873.575 [hcom.cc:340] [618650]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.580 [stream.cc:1507] 618670 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.588 [npu_driver.cc:3833] 618822 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.601 [api_impl.cc:5058] 618822 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] HCCL_ADPT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.873.601 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:377] FinalizeHccl] Destroy hccl adapter success.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.599 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[7].isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.616 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.607 [stream_sqcq_manage.cc:451] 618670 FreeLogicCq: Return(0), threadIdentifier(281473556700640), devId(6), tsId(0), cqId(298), isFastCq(0).
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.873.617 [callback.cpp:132]618822 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.873.618 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:613] DestroyHccl] Hccl destroy successful.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.630 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.625 [npu_driver.cc:6163] 618670 StreamUnBindLogicCq: success: deviceId=6, tsId=0, streamId=2, logicCq=298.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.873.632 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.646 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.644 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.658 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.659 [npu_driver.cc:1180] 618670 LogicCqFree: Succ:device_id=6,ts_id=0,type=2,logic_cq_id=298, drvFlag=0.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.873.675 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.668 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[8].isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.685 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.873.689 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.696 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.709 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.702 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.730 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.735 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[9].isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.752 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.873.743 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.873.759 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.764 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.773 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] HCCL(618658,python3.9):[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.785 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.873.798 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
2025-04-03-09:27:49.873.776 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.873.810 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.873.794 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	In used mem buf info for Mem buf allocator, is persistent : 1, stream id : 0., mem_bufs size : 1
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.823 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.837 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.814 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[10].isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.831 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.873.829 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	In used mem buf info for Mem buf allocator, is persistent : 0, stream id : 0., mem_bufs size : 1
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.873.844 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] stream id : 0, is persistent : 0
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.873.859 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] Dump state info for Mem buf allocator, is persistent : 0, stream id : 0.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.873.850 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.873.862 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.843 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.855 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.873.874 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block info - total count : 1
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.875 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.887 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.873.887 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 		{"addr_":0x12d100000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12d100000000,"max_addr_":0x12d100000200}
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.873.904 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block total size : 61029220352
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.883 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[11].isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.903 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.873.899 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.873.917 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Free mem buf total size : 0, total count : 0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.916 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.928 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.873.912 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.924 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.935 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.873.931 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Eager free mem buf total size : 61029219840, total count : 1
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.873.944 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] stream id : 0, is persistent : 1
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.873.948 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.873.960 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.873.957 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] Dump state info for Mem buf allocator, is persistent : 1, stream id : 0.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.873.971 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block info - total count : 1
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.955 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[12].isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.972 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.972 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.873.983 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 		{"addr_":0x12c2c0000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12c2c0000000,"max_addr_":0x12c2c0000200}
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.873.986 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.873.985 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.873.999 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.873.996 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block total size : 61029220352
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.874.009 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Free mem buf total size : 0, total count : 0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.873.993 [api_impl.cc:2003] 618666 DevFree: device free mem=0x12c280147000
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.000 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.010 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.023 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.874.023 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Eager free mem buf total size : 61029219840, total count : 1
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.874.030 [api_impl.cc:2003] 618666 DevFree: device free mem=0x12c100c00000
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.028 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[13].isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.042 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.052 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.035 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.056 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.066 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.094 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[14].isHcomInit is false.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.874.040 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] The dynamic memory pool[DefaultAscendMemoryPool] stat info : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":116404.00MB,"idle mem":116403.99MB,"used by event mem":0.00MB,"eager free mem":116403.99MB}, actual peak used mem:4M. Weight used size:0M, constant value used size:0M, kernel output used size:0M, other used size:0M.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.874.066 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:430] ReleaseDeviceRes] Release device resource for DefaultAscendMemoryPool : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":116404.00MB,"idle mem":116403.99MB,"used by event mem":0.00MB,"eager free mem":116403.99MB}.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.874.051 [queue_notify_manager.cc:100] [618666]QueueNotifyManager Destroy.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.874.068 [queue_notify_manager.cc:106] [618666]QueueNotifyManager Destroy success.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.068 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.082 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.093 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.104 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.110 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.874.092 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:62] ReleaseDeviceRes] Release device resource for allocator, Mem buf allocator, is persistent : 0, stream id : 0., mem_blocks_ size : 1.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.874.110 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:65] ReleaseDeviceRes] Clean mem block : {"addr_":0x12d100000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12d100000000,"max_addr_":0x12d100000200}.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.116 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.128 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.138 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.125 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.139 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.874.127 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:191] FreeDeviceMem] Max actual used memory size is 4194304
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.874.143 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:194] FreeDeviceMem] Max peak used memory size is 1024
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.150 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.162 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.164 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[15].isHcomInit is false.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.174 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.186 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.180 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.192 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.203 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.874.160 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:69] ReleaseDeviceRes] Delete mem block : {"addr_":0x12d100000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12d100000000,"max_addr_":0x12d100000200}.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.874.175 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:74] ReleaseDeviceRes] Free mem buf size : 0.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.874.189 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:80] ReleaseDeviceRes] Eager free mem buf size : 1.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.874.186 [queue_notify_manager.cc:100] [618666]QueueNotifyManager Destroy.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.874.204 [queue_notify_manager.cc:106] [618666]QueueNotifyManager Destroy success.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.199 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.215 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[16].isHcomInit is false.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.874.206 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:62] ReleaseDeviceRes] Release device resource for allocator, Mem buf allocator, is persistent : 1, stream id : 0., mem_blocks_ size : 1.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.874.224 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:65] ReleaseDeviceRes] Clean mem block : {"addr_":0x12c2c0000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12c2c0000000,"max_addr_":0x12c2c0000200}.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.212 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.225 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.236 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.228 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.239 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.250 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.249 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.261 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.874.238 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:191] FreeDeviceMem] Max actual used memory size is 4194304
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.874.254 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:194] FreeDeviceMem] Max peak used memory size is 1024
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.874.248 [ccl_buffer_manager.cc:125] [618666][HCCL_TRACE][ReleaseCCLbuffer]CCLBuffer is null, no need to release.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.267 [hcom_plugin.cc:119] [618658]Finalize: HcomDestroy success.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.273 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.286 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.874.274 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:69] ReleaseDeviceRes] Delete mem block : {"addr_":0x12c2c0000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12c2c0000000,"max_addr_":0x12c2c0000200}.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.874.288 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:74] ReleaseDeviceRes] Free mem buf size : 0.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.874.269 [ccl_buffer_manager.cc:147] [618666][HCCL_TRACE][ReleaseCCLbuffer]CCLBuffer is null, no need to release.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.874.285 [ccl_buffer_manager.cc:160] [618666][HCCL_TRACE][ReleaseAIVbuffer]Release inAIVbuffer. buffer ptr[(nil)], size[0]
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.874.299 [ccl_buffer_manager.cc:163] [618666][HCCL_TRACE][ReleaseAIVbuffer]Release outAIVbuffer. buffer ptr[(nil)], size[0]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.279 [plugin_manager.cc:62] [618658]hccl ops plugin finalize end. ret[0]
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.297 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.309 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.321 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.874.303 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:80] ReleaseDeviceRes] Eager free mem buf size : 1.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.874.321 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:45] ~MemBufAllocator] MemBufAllocator[0xfffeb8100230] : Mem buf allocator, is persistent : 1, stream id : 0. deconstruct.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.874.315 [ccl_buffer_manager.cc:166] [618666][HCCL_TRACE][ReleaseAIVbuffer]Release AIV buffer success.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.332 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.344 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.874.338 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:45] ~MemBufAllocator] MemBufAllocator[0xfffeb8100b20] : Mem buf allocator, is persistent : 0, stream id : 0. deconstruct.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.874.359 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:222] DeInitialize] Ascend Memory Adapter deinitialize success, statistics:
Device MOC memory size: 62420M
MindSpore Used memory size: 58202M
Used peak memory usage (without fragments): 0M
Actual peak memory usage (with fragments): 4M

[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.362 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.376 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] HCCL_ADPT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.874.364 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:638] FinalizeKernelInfoStore] Destroy hccl kernel info store success.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.387 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.400 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.412 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.874.346 [op_base.cc:128] [618666][HcclGetDeviceId] deviceLogicId[5] 
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.874.362 [op_base.cc:2196] [618666]op_base comm destroy complete, take time [77308]us, group[192.168.0.44%enp67s0f5_60008_0_1743643662827273], deviceLogicId[5].
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.874.391 [callback.cpp:37]618650 aclrtSetExceptionInfoCallback: start to execute aclrtSetExceptionInfoCallback.
[INFO] HCCL_ADPT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.874.389 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:695] FinalizeHcclComm] Start finalize hccl comm.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.418 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[0].isHcomInit is false.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.424 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.874.397 [device.cpp:183]618666 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.874.417 [api_impl.cc:3419] 618666 DeviceReset: reset device, device_id=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.874.428 [runtime.cc:3444] 618666 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0xa, reset:0
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.438 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.450 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.462 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.874.408 [callback.cpp:44]618650 aclrtSetExceptionInfoCallback: successfully execute aclrtSetExceptionInfoCallback
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.434 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.447 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.874.441 [api_impl.cc:3449] 618666 DeviceReset: Succ, userDeviceId=5.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.874.453 [device.cpp:189]618666 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 5.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.475 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.874.447 [context.cpp:72]618650 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.874.465 [api_impl.cc:3717] 618650 ContextSetCurrent: set context=aaab312ab590, flag=0.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.874.479 [context.cpp:80]618650 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.458 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.471 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[1].isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.483 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.492 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:49.874.474 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618654] [ServerToClientMsgProc] [sessionID=1]
[INFO] TDT(618654,python3.9):2025-04-03-09:27:49.874.499 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618654] [TsdClient] DeviceMsgProc recvMsg realDeviceId[2] msgType[61] localDevId[2] rspCode[0]heterogeneousSubPid[5116], tsdSupportLevel_[63]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.504 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.518 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[2].isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.530 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL_ADPT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.874.492 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:364] FinalizeHccl] Start destroy hccl adapter for GE_MODE
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.487 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.500 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.511 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.521 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] HCCL_ADPT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.874.520 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:806] FinalizeHcclExec] Start finalize hccl exec.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.874.536 [hcom_executor.cc:40] [618666]Hcom Excutor Finalize start.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.534 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.546 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.557 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.568 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.874.492 [stream.cpp:75]618650 aclrtDestroyStream: start to execute aclrtDestroyStream
[INFO] GE(618650,python3.9):2025-04-03-09:27:49.874.515 [stream_manage_func_registry.cc:22]618650 TryCallStreamMngFunc:Stream manage func is not found, FuncType is [0]
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.874.528 [stream.cpp:80]618650 aclrtDestroyStream: try to call stream manage function success, action type is DESTROY_STREAM.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.542 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.558 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] TDT(618654,python3.9):2025-04-03-09:27:49.874.520 [hdc_client.cpp:172][TsdRecvData][tid:618654] [deviceId=2] the Tsd recv data already
[INFO] TDT(618654,python3.9):2025-04-03-09:27:49.874.537 [process_mode_manager.cpp:1809][ExcuteClosePidList][tid:618654] leave ExcuteClosePidList startindex:0, cnt:1
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.583 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.601 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.874.541 [api_impl.cc:1228] 618650 StreamDestroy: stream_id=2.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.874.555 [acl_resource_manager.cpp:814]618650 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] GE(618650,python3.9):2025-04-03-09:27:49.874.569 [single_op_manager.cc:50]618650 ReleaseResource:ReleaseResource in. resource id = 0xaaab322faa00
[INFO] GE(618650,python3.9):2025-04-03-09:27:49.874.584 [caching_allocator.cc:402]618650 TryFreeBlocks:Try free blocks.
[INFO] GE(618650,python3.9):2025-04-03-09:27:49.874.596 [caching_allocator.cc:358]618650 FreeCachedBlocks:Free cached blocks
[INFO] GE(618650,python3.9):2025-04-03-09:27:49.874.606 [npu_memory_allocator.cc:72]618650 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.572 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[3].isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.585 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.597 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.608 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.619 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[4].isHcomInit is false.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:49.874.569 [process_mode_manager.cpp:1769][ProcessCloseSubProcList][tid:618654] ExcuteClosePidList success reserveCnt:1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.874.583 [adapter_tdt.cc:52] [618654]Open TsdProcess success. deviceLogicId[2]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.874.599 [network_manager.cc:405] [618654][DeInit]finish CloseHccpProcess, phy_id[2], hdc_type[18], nicDeployment[1], hasBackup[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.874.611 [network_manager.cc:409] [618654]NetworkManager: deinit nic success, nicPosition[1] ref[0].
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.874.624 [hccl_communicator_attrs.cc:1307] [618654][HcclCommunicator]IsSupportEnableRoce
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.615 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.627 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.874.618 [stream_executor.cpp:197]618650 RemoveExecutor: To remove executor by stream = 187652258114048
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.874.630 [acl_resource_manager.cpp:823]618650 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.632 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.644 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.874.638 [hccl_communicator_attrs.cc:1275] [618654]IsEnableRoce ret: 0, interServer_: 0, isInterServerVnic: 0, roceSwitch: 0, isSingleMeshAggregation_: 1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.874.641 [stream.cc:852] 618650 TearDown: stream_id=2, sqId=2, pendingNum=0, isForceRecycle_=0, flag=0, failMode=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.874.657 [stream.cc:938] 618650 TearDown: stream_id=2, delay recycle task num=0.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.638 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.651 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.654 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.667 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[5].isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.677 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.874.657 [notify_pool_impl.cc:43] [618654]NotifyPoolImpl Destroy.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.874.677 [notify_pool_impl.cc:56] [618654]NotifyPoolImpl Destroy success.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.874.679 [api_impl.cc:3419] 618853 DeviceReset: reset device, device_id=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.874.679 [api_impl.cc:3419] 618855 DeviceReset: reset device, device_id=5.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.874.694 [event.cc:1036] 618650 WaitForBusy: device_id=1, event_id=0 finished map already empty.
(618670,python3.9):2025-04-03-09:27:49.874.662 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.698 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.712 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.690 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.702 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.712 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[6].isHcomInit is false.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.874.696 [api_impl.cc:3100] 618654 GetDevicePhyIdByIndex: get PhyId by Index=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.874.712 [api_impl.cc:3111] 618654 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.874.705 [runtime.cc:3444] 618853 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x9, reset:0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.874.716 [runtime.cc:3444] 618855 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x8, reset:0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.874.721 [api_impl.cc:3449] 618853 DeviceReset: Succ, userDeviceId=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.874.731 [api_impl.cc:3449] 618855 DeviceReset: Succ, userDeviceId=5.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.874.713 [npu_driver.cc:626] 618650 EventIdFree: event id free begin, device_id=1, event_id=0, ts_id=0, remote_event_id=0
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.725 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.737 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.748 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.725 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.739 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.749 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.874.725 [api_impl.cc:3130] 618654 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.874.744 [api_impl.cc:3100] 618654 GetDevicePhyIdByIndex: get PhyId by Index=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.874.756 [api_impl.cc:3111] 618654 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.874.741 [raw_device.cc:1158] 618650 FreeEventIdFromDrv: device_id=1, event_id=0 tear down.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.874.754 [event.cc:61] 618650 ~Event: device_id=1, event deconstruct, recordSize=0, waitSize=0, idSize=0
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.761 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.773 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.784 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.796 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.761 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[7].isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.775 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.786 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.798 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.874.769 [api_impl.cc:3130] 618654 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=2
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.874.783 [p2p_mgmt.cc:171] [618654]local logic id:2, local physic id:2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.874.795 [api_impl.cc:3520] 618654 GetPhyDeviceInfo: get phy device info, phyId=2
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.874.790 [npu_driver.cc:3803] 618650 SqCqFree: deviceId=1, tsId=0, sqId=131, cqId=131
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.808 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.820 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.809 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[8].isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.822 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.874.815 [api_impl.cc:3520] 618654 GetPhyDeviceInfo: get phy device info, phyId=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.874.830 [p2p_mgmt.cc:178] [618654]disable p2p: local logic id:2, remote physic id:0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.874.832 [subscribe.cc:244] 618650 Delete: delete callback subscribe: groupId=320, threadId=281471881244576, devId=1, tsId=0, streamId=2, sqId=131, cqId=131
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:49.874.835 [trs_sqcq.c:1491][ascend][curpid:618650,618828][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.834 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.848 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.840 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.852 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.862 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[9].isHcomInit is false.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.874.842 [api_impl.cc:3184] 618654 DisableP2P: Disable P2P devIdDes=2, phyIdSrc=0.
[INFO] DRV(618654,python3.9):2025-04-03-09:27:49.874.862 [devdrv_pcie.c:890][ascend][curpid:618654,618654][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=2; peer_phy_devid=0.)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.874.848 [stream.cc:1507] 618650 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.874.864 [npu_driver.cc:3833] 618828 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=320, drvRetCode=16.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.863 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.879 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.891 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.876 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.887 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.896 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.906 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[10].isHcomInit is false.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.874.878 [api_impl.cc:3100] 618654 GetDevicePhyIdByIndex: get PhyId by Index=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.874.889 [api_impl.cc:3111] 618654 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.874.899 [api_impl.cc:3130] 618654 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=2
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.874.910 [p2p_mgmt.cc:171] [618654]local logic id:2, local physic id:2.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.874.894 [stream_sqcq_manage.cc:451] 618650 FreeLogicCq: Return(0), threadIdentifier(281473891839456), devId(1), tsId(0), cqId(402), isFastCq(0).
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.874.896 [api_impl.cc:5058] 618828 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.874.917 [npu_driver.cc:6163] 618650 StreamUnBindLogicCq: success: deviceId=1, tsId=0, streamId=2, logicCq=402.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.902 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.916 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.926 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.920 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.931 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.874.923 [api_impl.cc:3520] 618654 GetPhyDeviceInfo: get phy device info, phyId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.874.937 [api_impl.cc:3520] 618654 GetPhyDeviceInfo: get phy device info, phyId=1
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.874.927 [callback.cpp:132]618828 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.874.934 [api_impl.cc:3419] 618854 DeviceReset: reset device, device_id=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.874.934 [api_impl.cc:3419] 618856 DeviceReset: reset device, device_id=5.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.938 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.951 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] TDT(618662,python3.9):2025-04-03-09:27:49.874.928 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618662] [ServerToClientMsgProc] [sessionID=1]
[INFO] TDT(618662,python3.9):2025-04-03-09:27:49.874.956 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618662] [TsdClient] DeviceMsgProc recvMsg realDeviceId[4] msgType[61] localDevId[4] rspCode[0]heterogeneousSubPid[29706], tsdSupportLevel_[63]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.945 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.958 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[11].isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.971 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.874.949 [p2p_mgmt.cc:178] [618654]disable p2p: local logic id:2, remote physic id:1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.874.963 [api_impl.cc:3184] 618654 DisableP2P: Disable P2P devIdDes=2, phyIdSrc=1.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.874.951 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.874.965 [npu_driver.cc:1180] 618650 LogicCqFree: Succ:device_id=1,ts_id=0,type=2,logic_cq_id=402, drvFlag=0.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.874.967 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.874.959 [runtime.cc:3444] 618854 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x7, reset:0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.874.970 [runtime.cc:3444] 618856 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x6, reset:0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.874.979 [api_impl.cc:3449] 618854 DeviceReset: Succ, userDeviceId=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.874.985 [api_impl.cc:3449] 618856 DeviceReset: Succ, userDeviceId=5.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.874.962 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.977 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.874.989 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.010 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] TDT(618662,python3.9):2025-04-03-09:27:49.874.975 [hdc_client.cpp:172][TsdRecvData][tid:618662] [deviceId=4] the Tsd recv data already
[INFO] TDT(618662,python3.9):2025-04-03-09:27:49.874.991 [process_mode_manager.cpp:1809][ExcuteClosePidList][tid:618662] leave ExcuteClosePidList startindex:0, cnt:1
[INFO] TDT(618662,python3.9):2025-04-03-09:27:49.875.005 [process_mode_manager.cpp:1769][ProcessCloseSubProcList][tid:618662] ExcuteClosePidList success reserveCnt:1
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.875.017 [adapter_tdt.cc:52] [618662]Open TsdProcess success. deviceLogicId[4]
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.983 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.874.994 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.875.004 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[12].isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.875.016 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] DRV(618654,python3.9):2025-04-03-09:27:49.874.987 [devdrv_pcie.c:890][ascend][curpid:618654,618654][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=2; peer_phy_devid=1.)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.004 [api_impl.cc:3100] 618654 GetDevicePhyIdByIndex: get PhyId by Index=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.016 [api_impl.cc:3111] 618654 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.027 [api_impl.cc:3130] 618654 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=2
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.874.995 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.010 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.022 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.033 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.023 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.035 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.047 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.875.033 [network_manager.cc:405] [618662][DeInit]finish CloseHccpProcess, phy_id[4], hdc_type[18], nicDeployment[1], hasBackup[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.875.049 [network_manager.cc:409] [618662]NetworkManager: deinit nic success, nicPosition[1] ref[0].
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.875.062 [hccl_communicator_attrs.cc:1307] [618662][HcclCommunicator]IsSupportEnableRoce
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.875.029 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.875.041 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.875.051 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[13].isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.875.063 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.875.073 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.875.040 [p2p_mgmt.cc:171] [618654]local logic id:2, local physic id:2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.051 [api_impl.cc:3100] 618654 GetDevicePhyIdByIndex: get PhyId by Index=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.062 [api_impl.cc:3111] 618654 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.076 [api_impl.cc:3130] 618654 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=2
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.875.087 [p2p_mgmt.cc:171] [618654]local logic id:2, local physic id:2.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.044 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.056 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.065 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.078 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.089 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.061 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.074 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.085 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.095 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.106 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.875.076 [hccl_communicator_attrs.cc:1275] [618662]IsEnableRoce ret: 0, interServer_: 0, isInterServerVnic: 0, roceSwitch: 0, isSingleMeshAggregation_: 1
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.875.092 [notify_pool_impl.cc:43] [618662]NotifyPoolImpl Destroy.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.875.106 [notify_pool_impl.cc:56] [618662]NotifyPoolImpl Destroy success.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.875.085 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.875.098 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[14].isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.875.109 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.102 [api_impl.cc:3520] 618654 GetPhyDeviceInfo: get phy device info, phyId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.114 [api_impl.cc:3520] 618654 GetPhyDeviceInfo: get phy device info, phyId=3
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.875.127 [p2p_mgmt.cc:178] [618654]disable p2p: local logic id:2, remote physic id:3.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.875.110 [api_impl.cc:3717] 618666 ContextSetCurrent: set context=aaaaf6e2dcc0, flag=0.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.099 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.112 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.123 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.135 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.119 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.131 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.142 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.123 [api_impl.cc:3100] 618662 GetDevicePhyIdByIndex: get PhyId by Index=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.136 [api_impl.cc:3111] 618662 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=4
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.875.124 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.875.136 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.875.149 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[15].isHcomInit is false.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.138 [api_impl.cc:3184] 618654 DisableP2P: Disable P2P devIdDes=2, phyIdSrc=3.
[INFO] DRV(618654,python3.9):2025-04-03-09:27:49.875.155 [devdrv_pcie.c:890][ascend][curpid:618654,618654][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=2; peer_phy_devid=3.)
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.875.134 [adapter_rts.cc:321] [618666][hrtCtxSetCurrent] success
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.875.151 [stream.cc:182] [618666]Switch Ctx ret[0], curCtx[0xaaaaf6e2dcc0], setCtx[0xaaaaf6e2dcc0], stream id[5]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.875.166 [api_impl.cc:1228] 618666 StreamDestroy: stream_id=5.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.148 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.160 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.171 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] R[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.154 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.166 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.178 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.190 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.162 [api_impl.cc:3130] 618662 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.178 [api_impl.cc:3100] 618662 GetDevicePhyIdByIndex: get PhyId by Index=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.188 [api_impl.cc:3111] 618662 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.200 [api_impl.cc:3130] 618662 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=4
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.875.159 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.875.170 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.875.180 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.875.190 [hcom_common.cc:958] [618658][Destroy][Result]hcomInfo[16].isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.875.202 [hcom_common.cc:961] [618658]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.170 [api_impl.cc:3100] 618654 GetDevicePhyIdByIndex: get PhyId by Index=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.183 [api_impl.cc:3111] 618654 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.194 [api_impl.cc:3130] 618654 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=2
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.875.205 [p2p_mgmt.cc:171] [618654]local logic id:2, local physic id:2.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.875.182 [acl_resource_manager.cpp:814]618666 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] GE(618666,python3.9):2025-04-03-09:27:49.875.203 [single_op_manager.cc:50]618666 ReleaseResource:ReleaseResource in. resource id = 0xaaab022b3ae0
UNTIME(618650,python3.9):2025-04-03-09:27:49.875.180 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.207 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.219 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.232 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.204 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.219 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.230 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.875.212 [p2p_mgmt.cc:171] [618662]local logic id:4, local physic id:4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.225 [api_impl.cc:3520] 618662 GetPhyDeviceInfo: get phy device info, phyId=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.241 [api_impl.cc:3520] 618662 GetPhyDeviceInfo: get phy device info, phyId=0
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.875.213 [hcom.cc:337] [618658][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:49.875.231 [hcom.cc:340] [618658]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.221 [api_impl.cc:3520] 618654 GetPhyDeviceInfo: get phy device info, phyId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.236 [api_impl.cc:3520] 618654 GetPhyDeviceInfo: get phy device info, phyId=4
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.875.247 [p2p_mgmt.cc:178] [618654]disable p2p: local logic id:2, remote physic id:4.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.261 [api_impl.cc:3184] 618654 DisableP2P: Disable P2P devIdDes=2, phyIdSrc=4.
[INFO] GE(618666,python3.9):2025-04-03-09:27:49.875.223 [caching_allocator.cc:402]618666 TryFreeBlocks:Try free blocks.
[INFO] GE(618666,python3.9):2025-04-03-09:27:49.875.238 [caching_allocator.cc:358]618666 FreeCachedBlocks:Free cached blocks
[INFO] GE(618666,python3.9):2025-04-03-09:27:49.875.251 [npu_memory_allocator.cc:72]618666 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] DRV(618654,python3.9):2025-04-03-09:27:49.875.277 [devdrv_pcie.c:890][ascend][curpid:618654,618654][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=2; peer_phy_devid=4.)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.294 [api_impl.cc:3100] 618654 GetDevicePhyIdByIndex: get PhyId by Index=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.305 [api_impl.cc:3111] 618654 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=2
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.875.277 [stream_executor.cpp:197]618666 RemoveExecutor: To remove executor by stream = 187651452517088
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.875.295 [acl_resource_manager.cpp:823]618666 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.875.307 [stream.cc:852] 618666 TearDown: stream_id=5, sqId=5, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.246 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.260 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.271 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:49.875.243 [process_mode_msg_parse.cpp:115][ServerToClientMsgProc][tid:618674] [ServerToClientMsgProc] [sessionID=1]
[INFO] TDT(618674,python3.9):2025-04-03-09:27:49.875.275 [process_mode_msg_parse.cpp:110][DeviceMsgProcess][tid:618674] [TsdClient] DeviceMsgProc recvMsg realDeviceId[7] msgType[61] localDevId[7] rspCode[0]heterogeneousSubPid[29983], tsdSupportLevel_[63]
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.245 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.258 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.272 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.284 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.875.256 [p2p_mgmt.cc:178] [618662]disable p2p: local logic id:4, remote physic id:0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.271 [api_impl.cc:3184] 618662 DisableP2P: Disable P2P devIdDes=4, phyIdSrc=0.
[INFO] DRV(618662,python3.9):2025-04-03-09:27:49.875.289 [devdrv_pcie.c:890][ascend][curpid:618662,618662][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=4; peer_phy_devid=0.)
[INFO] HCCL_ADPT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.257 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:377] FinalizeHccl] Destroy hccl adapter success.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.278 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:613] DestroyHccl] Hccl destroy successful.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.317 [api_impl.cc:3130] 618654 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.875.324 [stream.cc:938] 618666 TearDown: stream_id=5, delay recycle task num=0.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.283 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.298 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.311 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.324 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.337 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.347 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] TDT(618674,python3.9):2025-04-03-09:27:49.875.296 [hdc_client.cpp:172][TsdRecvData][tid:618674] [deviceId=7] the Tsd recv data already
[INFO] TDT(618674,python3.9):2025-04-03-09:27:49.875.311 [process_mode_manager.cpp:1809][ExcuteClosePidList][tid:618674] leave ExcuteClosePidList startindex:0, cnt:1
[INFO] TDT(618674,python3.9):2025-04-03-09:27:49.875.325 [process_mode_manager.cpp:1769][ProcessCloseSubProcList][tid:618674] ExcuteClosePidList success reserveCnt:1
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.875.340 [adapter_tdt.cc:52] [618674]Open TsdProcess success. deviceLogicId[7]
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.875.351 [network_manager.cc:405] [618674][DeInit]finish CloseHccpProcess, phy_id[7], hdc_type[18], nicDeployment[1], hasBackup[0]
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.298 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.311 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.330 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.341 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.353 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.366 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.303 [api_impl.cc:3100] 618662 GetDevicePhyIdByIndex: get PhyId by Index=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.315 [api_impl.cc:3111] 618662 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.326 [api_impl.cc:3130] 618662 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=4
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.875.340 [p2p_mgmt.cc:171] [618662]local logic id:4, local physic id:4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.352 [api_impl.cc:3520] 618662 GetPhyDeviceInfo: get phy device info, phyId=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.364 [api_impl.cc:3520] 618662 GetPhyDeviceInfo: get phy device info, phyId=1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.875.331 [p2p_mgmt.cc:171] [618654]local logic id:2, local physic id:2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.344 [api_impl.cc:3520] 618654 GetPhyDeviceInfo: get phy device info, phyId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.357 [api_impl.cc:3520] 618654 GetPhyDeviceInfo: get phy device info, phyId=5
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.875.376 [p2p_mgmt.cc:178] [618654]disable p2p: local logic id:2, remote physic id:5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.875.339 [stream.cc:1507] 618666 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.875.366 [stream_sqcq_manage.cc:451] 618666 FreeLogicCq: Return(0), threadIdentifier(281473067970016), devId(5), tsId(0), cqId(362), isFastCq(0).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.875.386 [npu_driver.cc:6163] 618666 StreamUnBindLogicCq: success: deviceId=5, tsId=0, streamId=5, logicCq=362.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.361 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.372 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.384 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.394 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.406 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.875.364 [network_manager.cc:409] [618674]NetworkManager: deinit nic success, nicPosition[1] ref[0].
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.875.376 [hccl_communicator_attrs.cc:1307] [618674][HcclCommunicator]IsSupportEnableRoce
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.875.387 [hccl_communicator_attrs.cc:1275] [618674]IsEnableRoce ret: 0, interServer_: 0, isInterServerVnic: 0, roceSwitch: 0, isSingleMeshAggregation_: 1
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.875.404 [notify_pool_impl.cc:43] [618674]NotifyPoolImpl Destroy.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.875.419 [notify_pool_impl.cc:56] [618674]NotifyPoolImpl Destroy success.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.378 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.391 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.403 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.415 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.425 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.875.377 [p2p_mgmt.cc:178] [618662]disable p2p: local logic id:4, remote physic id:1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.391 [api_impl.cc:3184] 618662 DisableP2P: Disable P2P devIdDes=4, phyIdSrc=1.
[INFO] DRV(618662,python3.9):2025-04-03-09:27:49.875.406 [devdrv_pcie.c:890][ascend][curpid:618662,618662][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=4; peer_phy_devid=1.)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.418 [api_impl.cc:3100] 618662 GetDevicePhyIdByIndex: get PhyId by Index=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.429 [api_impl.cc:3111] 618662 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=4
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.388 [api_impl.cc:3184] 618654 DisableP2P: Disable P2P devIdDes=2, phyIdSrc=5.
[INFO] DRV(618654,python3.9):2025-04-03-09:27:49.875.405 [devdrv_pcie.c:890][ascend][curpid:618654,618654][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=2; peer_phy_devid=5.)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.419 [api_impl.cc:3100] 618654 GetDevicePhyIdByIndex: get PhyId by Index=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.429 [api_impl.cc:3111] 618654 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=2
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.875.428 [npu_driver.cc:1180] 618666 LogicCqFree: Succ:device_id=5,ts_id=0,type=2,logic_cq_id=362, drvFlag=0.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.419 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.431 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.443 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.453 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.463 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.437 [api_impl.cc:3100] 618674 GetDevicePhyIdByIndex: get PhyId by Index=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.449 [api_impl.cc:3111] 618674 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.460 [api_impl.cc:3130] 618674 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.473 [api_impl.cc:3100] 618674 GetDevicePhyIdByIndex: get PhyId by Index=7.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.438 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.450 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.461 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.473 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.485 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.441 [api_impl.cc:3130] 618662 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=4
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.875.452 [p2p_mgmt.cc:171] [618662]local logic id:4, local physic id:4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.464 [api_impl.cc:3520] 618662 GetPhyDeviceInfo: get phy device info, phyId=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.476 [api_impl.cc:3520] 618662 GetPhyDeviceInfo: get phy device info, phyId=2
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.875.487 [p2p_mgmt.cc:178] [618662]disable p2p: local logic id:4, remote physic id:2.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.475 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	In used mem buf info for Mem buf allocator, is persistent : 1, stream id : 0., mem_bufs size : 1
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.440 [api_impl.cc:3130] 618654 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=2
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.875.453 [p2p_mgmt.cc:171] [618654]local logic id:2, local physic id:2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.465 [api_impl.cc:3520] 618654 GetPhyDeviceInfo: get phy device info, phyId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.476 [api_impl.cc:3520] 618654 GetPhyDeviceInfo: get phy device info, phyId=6
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.875.488 [p2p_mgmt.cc:178] [618654]disable p2p: local logic id:2, remote physic id:6.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.477 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.489 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.514 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.525 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.485 [api_impl.cc:3111] 618674 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.499 [api_impl.cc:3130] 618674 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=7
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.875.523 [p2p_mgmt.cc:171] [618674]local logic id:7, local physic id:7.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.498 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.512 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.523 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.536 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.499 [api_impl.cc:3184] 618662 DisableP2P: Disable P2P devIdDes=4, phyIdSrc=2.
[INFO] DRV(618662,python3.9):2025-04-03-09:27:49.875.515 [devdrv_pcie.c:890][ascend][curpid:618662,618662][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=4; peer_phy_devid=2.)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.529 [api_impl.cc:3100] 618662 GetDevicePhyIdByIndex: get PhyId by Index=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.548 [api_impl.cc:3111] 618662 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=4
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.499 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	In used mem buf info for Mem buf allocator, is persistent : 0, stream id : 0., mem_bufs size : 1
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.517 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] stream id : 0, is persistent : 0
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.530 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] Dump state info for Mem buf allocator, is persistent : 0, stream id : 0.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.543 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block info - total count : 1
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.555 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 		{"addr_":0x12d100000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12d100000000,"max_addr_":0x12d100000200}
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.503 [api_impl.cc:3184] 618654 DisableP2P: Disable P2P devIdDes=2, phyIdSrc=6.
[INFO] DRV(618654,python3.9):2025-04-03-09:27:49.875.519 [devdrv_pcie.c:890][ascend][curpid:618654,618654][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=2; peer_phy_devid=6.)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.530 [api_impl.cc:3100] 618654 GetDevicePhyIdByIndex: get PhyId by Index=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.540 [api_impl.cc:3111] 618654 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.551 [api_impl.cc:3130] 618654 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=2
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.540 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.550 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.562 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.538 [api_impl.cc:3520] 618674 GetPhyDeviceInfo: get phy device info, phyId=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.557 [api_impl.cc:3520] 618674 GetPhyDeviceInfo: get phy device info, phyId=0
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.875.567 [p2p_mgmt.cc:178] [618674]disable p2p: local logic id:7, remote physic id:0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.578 [api_impl.cc:3184] 618674 DisableP2P: Disable P2P devIdDes=7, phyIdSrc=0.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.547 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.560 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.570 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.581 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.591 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.563 [api_impl.cc:3130] 618662 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=4
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.875.574 [p2p_mgmt.cc:171] [618662]local logic id:4, local physic id:4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.587 [api_impl.cc:3520] 618662 GetPhyDeviceInfo: get phy device info, phyId=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.599 [api_impl.cc:3520] 618662 GetPhyDeviceInfo: get phy device info, phyId=3
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.569 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block total size : 61029220352
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.581 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Free mem buf total size : 0, total count : 0
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.594 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Eager free mem buf total size : 61029219840, total count : 1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.875.562 [p2p_mgmt.cc:171] [618654]local logic id:2, local physic id:2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.575 [api_impl.cc:3520] 618654 GetPhyDeviceInfo: get phy device info, phyId=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.588 [api_impl.cc:3520] 618654 GetPhyDeviceInfo: get phy device info, phyId=7
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.875.600 [p2p_mgmt.cc:178] [618654]disable p2p: local logic id:2, remote physic id:7.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.611 [api_impl.cc:3184] 618654 DisableP2P: Disable P2P devIdDes=2, phyIdSrc=7.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.574 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.586 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.597 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.607 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.617 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] DRV(618674,python3.9):2025-04-03-09:27:49.875.593 [devdrv_pcie.c:890][ascend][curpid:618674,618674][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=7; peer_phy_devid=0.)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.609 [api_impl.cc:3100] 618674 GetDevicePhyIdByIndex: get PhyId by Index=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.619 [api_impl.cc:3111] 618674 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.629 [api_impl.cc:3130] 618674 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=7
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.604 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.616 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.634 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.875.614 [p2p_mgmt.cc:178] [618662]disable p2p: local logic id:4, remote physic id:3.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.626 [api_impl.cc:3184] 618662 DisableP2P: Disable P2P devIdDes=4, phyIdSrc=3.
[INFO] DRV(618662,python3.9):2025-04-03-09:27:49.875.641 [devdrv_pcie.c:890][ascend][curpid:618662,618662][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=4; peer_phy_devid=3.)
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.608 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] stream id : 0, is persistent : 1
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.624 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] Dump state info for Mem buf allocator, is persistent : 1, stream id : 0.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.637 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block info - total count : 1
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.649 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 		{"addr_":0x12c2c0000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12c2c0000000,"max_addr_":0x12c2c0000200}
[INFO] DRV(618654,python3.9):2025-04-03-09:27:49.875.627 [devdrv_pcie.c:890][ascend][curpid:618654,618654][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=2; peer_phy_devid=7.)
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.875.642 [hccl_communicator.cc:2043] [618654]Profiling is deinitiated.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.654 [api_impl.cc:2003] 618654 DevFree: device free mem=0x12c280000000
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.630 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.639 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.651 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.661 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.875.641 [p2p_mgmt.cc:171] [618674]local logic id:7, local physic id:7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.653 [api_impl.cc:3520] 618674 GetPhyDeviceInfo: get phy device info, phyId=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.665 [api_impl.cc:3520] 618674 GetPhyDeviceInfo: get phy device info, phyId=1
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.875.676 [p2p_mgmt.cc:178] [618674]disable p2p: local logic id:7, remote physic id:1.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.647 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.660 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.672 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.684 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.654 [api_impl.cc:3100] 618662 GetDevicePhyIdByIndex: get PhyId by Index=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.665 [api_impl.cc:3111] 618662 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.675 [api_impl.cc:3130] 618662 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=4
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.875.686 [p2p_mgmt.cc:171] [618662]local logic id:4, local physic id:4.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.675 [api_impl.cc:2003] 618654 DevFree: device free mem=0x12c280001000
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.875.691 [api_impl.cc:2003] 618654 DevFree: device free mem=0x12c280002000
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.662 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block total size : 61029220352
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.678 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Free mem buf total size : 0, total count : 0
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.690 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Eager free mem buf total size : 61029219840, total count : 1
[INFO] PRE_ACT(618658,ffffb4df5de0[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.674 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.686 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.697 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.708 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.688 [api_impl.cc:3184] 618674 DisableP2P: Disable P2P devIdDes=7, phyIdSrc=1.
[INFO] DRV(618674,python3.9):2025-04-03-09:27:49.875.702 [devdrv_pcie.c:890][ascend][curpid:618674,618674][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=7; peer_phy_devid=1.)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.715 [api_impl.cc:3100] 618674 GetDevicePhyIdByIndex: get PhyId by Index=7.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.695 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.710 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.720 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.732 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.699 [api_impl.cc:3100] 618662 GetDevicePhyIdByIndex: get PhyId by Index=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.712 [api_impl.cc:3111] 618662 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.723 [api_impl.cc:3130] 618662 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=4
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.875.734 [p2p_mgmt.cc:171] [618662]local logic id:4, local physic id:4.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.875.706 [opexecounter.cc:103] [618654]free counter mem resource
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:49.875.720 [atrace_api.c:118](tid:618654) AtraceDestroy start.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:49.875.736 [tracer_mgr_operate.c:248](tid:618654) destroy object HCCL_618988_2, exitSave(true).
,python3.9):2025-04-03-09:27:49.875.702 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] The dynamic memory pool[DefaultAscendMemoryPool] stat info : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":116404.00MB,"idle mem":116403.99MB,"used by event mem":0.00MB,"eager free mem":116403.99MB}, actual peak used mem:4M. Weight used size:0M, constant value used size:0M, kernel output used size:0M, other used size:0M.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.719 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.732 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.746 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.757 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.725 [api_impl.cc:3111] 618674 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.736 [api_impl.cc:3130] 618674 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=7
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.875.748 [p2p_mgmt.cc:171] [618674]local logic id:7, local physic id:7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.759 [api_impl.cc:3520] 618674 GetPhyDeviceInfo: get phy device info, phyId=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.771 [api_impl.cc:3520] 618674 GetPhyDeviceInfo: get phy device info, phyId=2
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.746 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.759 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.770 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.748 [api_impl.cc:3520] 618662 GetPhyDeviceInfo: get phy device info, phyId=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.761 [api_impl.cc:3520] 618662 GetPhyDeviceInfo: get phy device info, phyId=5
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.875.772 [p2p_mgmt.cc:178] [618662]disable p2p: local logic id:4, remote physic id:5.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:49.875.750 [atrace_api.c:120](tid:618654) AtraceDestroy end.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.875.762 [adapter_trace.cc:33] [618654]Call TraceDestroy, Params:handle[0xaaaae450a6b8]
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.754 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:430] ReleaseDeviceRes] Release device resource for DefaultAscendMemoryPool : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":116404.00MB,"idle mem":116403.99MB,"used by event mem":0.00MB,"eager free mem":116403.99MB}.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.775 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:62] ReleaseDeviceRes] Release device resource for allocator, Mem buf allocator, is persistent : 0, stream id : 0., mem_blocks_ size : 1.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.794 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:65] ReleaseDeviceRes] Clean mem block : {"addr_":0x12d100000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12d100000000,"max_addr_":0x12d100000200}.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.768 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.781 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.791 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.808 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.875.787 [p2p_mgmt.cc:178] [618674]disable p2p: local logic id:7, remote physic id:2.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.798 [api_impl.cc:3184] 618674 DisableP2P: Disable P2P devIdDes=7, phyIdSrc=2.
[INFO] DRV(618674,python3.9):2025-04-03-09:27:49.875.812 [devdrv_pcie.c:890][ascend][curpid:618674,618674][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=7; peer_phy_devid=2.)
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.782 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.794 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.805 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.816 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.786 [api_impl.cc:3184] 618662 DisableP2P: Disable P2P devIdDes=4, phyIdSrc=5.
[INFO] DRV(618662,python3.9):2025-04-03-09:27:49.875.802 [devdrv_pcie.c:890][ascend][curpid:618662,618662][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=4; peer_phy_devid=5.)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.814 [api_impl.cc:3100] 618662 GetDevicePhyIdByIndex: get PhyId by Index=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.824 [api_impl.cc:3111] 618662 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=4
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.812 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:191] FreeDeviceMem] Max actual used memory size is 4194304
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.829 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:194] FreeDeviceMem] Max peak used memory size is 1024
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.845 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:69] ReleaseDeviceRes] Delete mem block : {"addr_":0x12d100000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12d100000000,"max_addr_":0x12d100000200}.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.823 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.835 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.845 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.855 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.823 [api_impl.cc:3100] 618674 GetDevicePhyIdByIndex: get PhyId by Index=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.835 [api_impl.cc:3111] 618674 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.847 [api_impl.cc:3130] 618674 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=7
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.875.857 [p2p_mgmt.cc:171] [618674]local logic id:7, local physic id:7.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.828 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.840 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.852 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.862 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.873 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.836 [api_impl.cc:3130] 618662 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=4
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.875.847 [p2p_mgmt.cc:171] [618662]local logic id:4, local physic id:4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.857 [api_impl.cc:3520] 618662 GetPhyDeviceInfo: get phy device info, phyId=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.870 [api_impl.cc:3520] 618662 GetPhyDeviceInfo: get phy device info, phyId=6
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.860 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:74] ReleaseDeviceRes] Free mem buf size : 0.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.875 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:80] ReleaseDeviceRes] Eager free mem buf size : 1.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.869 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.881 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.891 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.868 [api_impl.cc:3520] 618674 GetPhyDeviceInfo: get phy device info, phyId=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.892 [api_impl.cc:3520] 618674 GetPhyDeviceInfo: get phy device info, phyId=3
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.875.904 [p2p_mgmt.cc:178] [618674]disable p2p: local logic id:7, remote physic id:3.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.885 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.898 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.909 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.875.883 [p2p_mgmt.cc:178] [618662]disable p2p: local logic id:4, remote physic id:6.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.896 [api_impl.cc:3184] 618662 DisableP2P: Disable P2P devIdDes=4, phyIdSrc=6.
[INFO] DRV(618662,python3.9):2025-04-03-09:27:49.875.917 [devdrv_pcie.c:890][ascend][curpid:618662,618662][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=4; peer_phy_devid=6.)
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.923 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.943 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.890 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:62] ReleaseDeviceRes] Release device resource for allocator, Mem buf allocator, is persistent : 1, stream id : 0., mem_blocks_ size : 1.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.908 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:65] ReleaseDeviceRes] Clean mem block : {"addr_":0x12c2c0000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12c2c0000000,"max_addr_":0x12c2c0000200}.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.922 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:191] FreeDeviceMem] Max actual used memory size is 4194304
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.903 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.914 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.925 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.937 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.916 [api_impl.cc:3184] 618674 DisableP2P: Disable P2P devIdDes=7, phyIdSrc=3.
[INFO] DRV(618674,python3.9):2025-04-03-09:27:49.875.932 [devdrv_pcie.c:890][ascend][curpid:618674,618674][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=7; peer_phy_devid=3.)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.945 [api_impl.cc:3100] 618674 GetDevicePhyIdByIndex: get PhyId by Index=7.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.931 [api_impl.cc:3100] 618662 GetDevicePhyIdByIndex: get PhyId by Index=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.944 [api_impl.cc:3111] 618662 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.956 [api_impl.cc:3130] 618662 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=4
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.957 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.875.971 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.936 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:194] FreeDeviceMem] Max peak used memory size is 1024
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.953 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:69] ReleaseDeviceRes] Delete mem block : {"addr_":0x12c2c0000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12c2c0000000,"max_addr_":0x12c2c0000200}.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.967 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:74] ReleaseDeviceRes] Free mem buf size : 0.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.948 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.960 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.875.970 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.980 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.957 [api_impl.cc:3111] 618674 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.970 [api_impl.cc:3130] 618674 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=7
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.875.980 [p2p_mgmt.cc:171] [618674]local logic id:7, local physic id:7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.875.992 [api_impl.cc:3520] 618674 GetPhyDeviceInfo: get phy device info, phyId=7
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.875.968 [p2p_mgmt.cc:171] [618662]local logic id:4, local physic id:4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.981 [api_impl.cc:3520] 618662 GetPhyDeviceInfo: get phy device info, phyId=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.875.993 [api_impl.cc:3520] 618662 GetPhyDeviceInfo: get phy device info, phyId=7
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.984 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.875.996 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.008 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.875.982 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:80] ReleaseDeviceRes] Eager free mem buf size : 1.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.876.011 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:45] ~MemBufAllocator] MemBufAllocator[0xfffeac100230] : Mem buf allocator, is persistent : 1, stream id : 0. deconstruct.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.875.995 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.009 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.021 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.876.003 [api_impl.cc:3520] 618674 GetPhyDeviceInfo: get phy device info, phyId=4
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.876.016 [p2p_mgmt.cc:178] [618674]disable p2p: local logic id:7, remote physic id:4.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.876.028 [api_impl.cc:3184] 618674 DisableP2P: Disable P2P devIdDes=7, phyIdSrc=4.
[INFO] DRV(618674,python3.9):2025-04-03-09:27:49.876.041 [devdrv_pcie.c:890][ascend][curpid:618674,618674][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=7; peer_phy_devid=4.)
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.876.004 [p2p_mgmt.cc:178] [618662]disable p2p: local logic id:4, remote physic id:7.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.876.018 [api_impl.cc:3184] 618662 DisableP2P: Disable P2P devIdDes=4, phyIdSrc=7.
[INFO] DRV(618662,python3.9):2025-04-03-09:27:49.876.031 [devdrv_pcie.c:890][ascend][curpid:618662,618662][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=4; peer_phy_devid=7.)
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.876.045 [hccl_communicator.cc:2043] [618662]Profiling is deinitiated.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.019 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.031 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.042 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.053 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.876.029 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:45] ~MemBufAllocator] MemBufAllocator[0xfffeac100b20] : Mem buf allocator, is persistent : 0, stream id : 0. deconstruct.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.876.055 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:222] DeInitialize] Ascend Memory Adapter deinitialize success, statistics:
Device MOC memory size: 62420M
MindSpore Used memory size: 58202M
Used peak memory usage (without fragments): 0M
Actual peak memory usage (with fragments): 4M

[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.032 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.044 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.056 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.067 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.876.057 [api_impl.cc:3100] 618674 GetDevicePhyIdByIndex: get PhyId by Index=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.876.068 [api_impl.cc:3111] 618674 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.876.080 [api_impl.cc:3130] 618674 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=7
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.876.058 [api_impl.cc:2003] 618662 DevFree: device free mem=0x12c280000000
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.876.079 [api_impl.cc:2003] 618662 DevFree: device free mem=0x12c280001000
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.065 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.078 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.090 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.876.079 [callback.cpp:37]618658 aclrtSetExceptionInfoCallback: start to execute aclrtSetExceptionInfoCallback.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.081 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.092 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.109 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.876.096 [p2p_mgmt.cc:171] [618674]local logic id:7, local physic id:7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.876.109 [api_impl.cc:3520] 618674 GetPhyDeviceInfo: get phy device info, phyId=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.876.119 [api_impl.cc:3520] 618674 GetPhyDeviceInfo: get phy device info, phyId=5
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.876.095 [api_impl.cc:2003] 618662 DevFree: device free mem=0x12c280002000
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.876.111 [opexecounter.cc:103] [618662]free counter mem resource
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:49.876.123 [atrace_api.c:118](tid:618662) AtraceDestroy start.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.103 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.116 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.127 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.876.103 [callback.cpp:44]618658 aclrtSetExceptionInfoCallback: successfully execute aclrtSetExceptionInfoCallback
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.120 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.133 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.145 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.876.133 [p2p_mgmt.cc:178] [618674]disable p2p: local logic id:7, remote physic id:5.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.876.144 [api_impl.cc:3184] 618674 DisableP2P: Disable P2P devIdDes=7, phyIdSrc=5.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:49.876.138 [tracer_mgr_operate.c:248](tid:618662) destroy object HCCL_618984_4, exitSave(true).
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:49.876.152 [atrace_api.c:120](tid:618662) AtraceDestroy end.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.876.178 [adapter_trace.cc:33] [618662]Call TraceDestroy, Params:handle[0xaaaaf7a97b08]
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.141 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.154 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.876.142 [context.cpp:72]618658 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.169 [api_impl.cc:3717] 618658 ContextSetCurrent: set context=aaab0b9e09a0, flag=0.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.876.190 [context.cpp:80]618658 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.166 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.188 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.201 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] DRV(618674,python3.9):2025-04-03-09:27:49.876.174 [devdrv_pcie.c:890][ascend][curpid:618674,618674][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=7; peer_phy_devid=5.)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.876.199 [api_impl.cc:3100] 618674 GetDevicePhyIdByIndex: get PhyId by Index=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.876.211 [api_impl.cc:3111] 618674 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=7
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.194 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.208 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.218 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.876.207 [stream.cpp:75]618658 aclrtDestroyStream: start to execute aclrtDestroyStream
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.214 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.226 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.236 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.876.223 [api_impl.cc:3130] 618674 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=7
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.876.235 [p2p_mgmt.cc:171] [618674]local logic id:7, local physic id:7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.876.247 [api_impl.cc:3520] 618674 GetPhyDeviceInfo: get phy device info, phyId=7
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.233 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.245 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] GE(618658,python3.9):2025-04-03-09:27:49.876.236 [stream_manage_func_registry.cc:22]618658 TryCallStreamMngFunc:Stream manage func is not found, FuncType is [0]
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.876.249 [stream.cpp:80]618658 aclrtDestroyStream: try to call stream manage function success, action type is DESTROY_STREAM.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.262 [api_impl.cc:1228] 618658 StreamDestroy: stream_id=2.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.247 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.259 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.270 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.876.260 [api_impl.cc:3520] 618674 GetPhyDeviceInfo: get phy device info, phyId=6
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.876.273 [p2p_mgmt.cc:178] [618674]disable p2p: local logic id:7, remote physic id:6.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.281 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.293 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.304 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.256 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.267 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.286 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.876.277 [acl_resource_manager.cpp:814]618658 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] GE(618658,python3.9):2025-04-03-09:27:49.876.292 [single_op_manager.cc:50]618658 ReleaseResource:ReleaseResource in. resource id = 0xaaab0bb0bf40
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.876.292 [api_impl.cc:3184] 618674 DisableP2P: Disable P2P devIdDes=7, phyIdSrc=6.
[INFO] DRV(618674,python3.9):2025-04-03-09:27:49.876.308 [devdrv_pcie.c:890][ascend][curpid:618674,618674][drv][devmng][drvP2PAttrOp]Disable P2P. (logic_devid=7; peer_phy_devid=6.)
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.317 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.298 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.311 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.322 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] GE(618658,python3.9):2025-04-03-09:27:49.876.306 [caching_allocator.cc:402]618658 TryFreeBlocks:Try free blocks.
[INFO] GE(618658,python3.9):2025-04-03-09:27:49.876.319 [caching_allocator.cc:358]618658 FreeCachedBlocks:Free cached blocks
[INFO] GE(618658,python3.9):2025-04-03-09:27:49.876.328 [npu_memory_allocator.cc:72]618658 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.876.320 [api_impl.cc:3100] 618674 GetDevicePhyIdByIndex: get PhyId by Index=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.876.332 [api_impl.cc:3111] 618674 GetDevicePhyIdByIndex: GetDevicePhyIdByIndex, device_mode=0, device_id=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.876.341 [api_impl.cc:3130] 618674 GetDevicePhyIdByIndex: cloud v2, device_mode=0, device_id=7
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.329 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.342 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.353 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.336 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.348 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.359 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.370 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.876.340 [stream_executor.cpp:197]618658 RemoveExecutor: To remove executor by stream = 187651612262208
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.876.354 [acl_resource_manager.cpp:823]618658 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.366 [stream.cc:852] 618658 TearDown: stream_id=2, sqId=2, pendingNum=0, isForceRecycle_=0, flag=0, failMode=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.378 [stream.cc:938] 618658 TearDown: stream_id=2, delay recycle task num=0.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.876.353 [p2p_mgmt.cc:171] [618674]local logic id:7, local physic id:7.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.876.368 [hccl_communicator.cc:2043] [618674]Profiling is deinitiated.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.876.379 [api_impl.cc:2003] 618674 DevFree: device free mem=0x12c280000000
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.366 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.379 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.390 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.383 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.396 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.397 [event.cc:1036] 618658 WaitForBusy: device_id=3, event_id=0 finished map already empty.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.876.399 [api_impl.cc:2003] 618674 DevFree: device free mem=0x12c280001000
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.876.415 [api_impl.cc:2003] 618674 DevFree: device free mem=0x12c280002000
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.401 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.412 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.433 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.408 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.419 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.430 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.441 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.446 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.457 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.876.431 [opexecounter.cc:103] [618674]free counter mem resource
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:49.876.445 [atrace_api.c:118](tid:618674) AtraceDestroy start.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.414 [npu_driver.cc:626] 618658 EventIdFree: event id free begin, device_id=3, event_id=0, ts_id=0, remote_event_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.440 [raw_device.cc:1158] 618658 FreeEventIdFromDrv: device_id=3, event_id=0 tear down.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.453 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.465 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.468 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:49.876.459 [tracer_mgr_operate.c:248](tid:618674) destroy object HCCL_618985_7, exitSave(true).
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:49.876.471 [atrace_api.c:120](tid:618674) AtraceDestroy end.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.876.481 [adapter_trace.cc:33] [618674]Call TraceDestroy, Params:handle[0xaaaaf04c3c38]
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.471 [event.cc:61] 618658 ~Event: device_id=3, event deconstruct, recordSize=0, waitSize=0, idSize=0
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.477 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.491 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.502 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.481 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.494 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.505 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.505 [npu_driver.cc:3803] 618658 SqCqFree: deviceId=3, tsId=0, sqId=787, cqId=787
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.514 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.527 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.537 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.519 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.530 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.540 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.551 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.548 [subscribe.cc:244] 618658 Delete: delete callback subscribe: groupId=64, threadId=281471973191584, devId=3, tsId=0, streamId=2, sqId=787, cqId=787
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:49.876.552 [trs_sqcq.c:1491][ascend][curpid:618658,618774][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.564 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.548 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.560 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.569 [stream.cc:1507] 618658 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.578 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.589 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.583 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.595 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.582 [npu_driver.cc:3833] 618774 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.602 [api_impl.cc:5058] 618774 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.602 [stream_sqcq_manage.cc:451] 618658 FreeLogicCq: Return(0), threadIdentifier(281473716280800), devId(3), tsId(0), cqId(1040), isFastCq(0).
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.604 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.616 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.608 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.620 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.876.616 [callback.cpp:132]618774 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.627 [npu_driver.cc:6163] 618658 StreamUnBindLogicCq: success: deviceId=3, tsId=0, streamId=2, logicCq=1040.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.876.635 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.628 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.640 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.651 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.633 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.646 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.656 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.654 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.664 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.669 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.677 [stream.cc:237] 618670 FreeStreamId: Free stream_id=2.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.668 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.671 [npu_driver.cc:1180] 618658 LogicCqFree: Succ:device_id=3,ts_id=0,type=2,logic_cq_id=1040, drvFlag=0.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.676 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.691 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.683 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.694 [stream_sqcq_manage.cc:216] 618670 DeAllocStreamSqCq: deviceId=6, tsId=0, drvFlag=0
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.697 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.876.689 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.876.705 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.707 [npu_driver.cc:966] 618670 NormalSqCqFree: Normal sqcq free, sqId=2, cqId=2, device_id=6, tsId=0, drvFlag=0
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.712 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.726 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.704 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.717 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.719 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.732 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.737 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.730 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.746 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.876.744 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.876.756 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.751 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.764 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.759 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.772 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.769 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.781 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.775 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.787 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.786 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.876.793 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.876.804 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.800 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.812 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.799 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.812 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.818 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.825 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.839 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.824 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.838 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.851 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.841 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.876.854 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.852 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.865 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.876.865 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.879 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.871 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.884 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.878 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.892 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.893 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.896 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.908 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.903 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.916 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.876.905 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.876.918 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.922 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.934 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.930 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.944 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.876.954 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.929 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.940 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.950 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.946 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.958 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.876.965 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.876.964 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.976 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.972 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.876.984 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.979 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.876.991 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.876.988 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.000 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.876.997 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.008 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.002 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.013 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.013 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.021 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.032 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.026 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.038 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.027 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.041 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.045 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.056 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.049 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.063 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.066 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.068 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.080 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.073 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.086 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.081 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.095 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.091 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.103 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.097 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.110 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.106 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.118 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.115 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.127 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.121 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] [INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.130 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.143 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.155 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.134 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.156 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.167 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.139 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.150 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.161 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.170 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.179 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.181 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.190 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.203 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.184 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.197 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.195 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.207 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.213 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.209 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.221 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.221 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.226 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.238 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.234 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.249 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.234 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.239 [npu_driver.cc:974] 618670 NormalSqCqFree: Normal sqcq free success, sqId=2, cqId=2, device_id=6, tsId=0, drvFlag=0
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.248 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.256 [stream_sqcq_manage.cc:228] 618670 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=2, cq_id=2, stream_id=2, is_sq_need_release=1, drvFlag=0.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.262 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.262 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.275 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.250 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.263 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.273 [npu_driver.cc:432] 618670 StreamIdFree: stream id free begin, device_id=6, stream_id=2, ts_id=0, remote_stream_id=0
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.278 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.290 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.274 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.286 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.296 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.306 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.292 [npu_driver.cc:441] 618670 StreamIdFree: Stream id free success, stream_id=2, device_id=6, tsId=0, streamFlag=1536
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.293 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.311 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.303 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.315 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.319 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.322 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.331 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.344 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.354 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.327 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.339 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.350 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.335 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.347 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.359 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.366 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.372 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.378 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.390 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.363 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.375 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.385 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.402 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.403 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.421 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.398 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.410 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.421 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.417 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.430 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.435 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.434 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.446 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.443 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.455 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.467 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.461 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.472 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.467 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.479 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.481 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.484 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.495 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.493 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.506 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.493 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.508 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.509 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.520 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.523 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.535 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.522 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.537 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.532 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.546 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.550 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.550 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.563 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.573 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.584 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.556 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.568 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.579 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.590 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.567 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.581 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.592 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.603 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.595 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.608 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.603 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.617 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.617 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.629 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.619 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.632 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.631 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.645 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.643 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.654 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.646 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.660 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.659 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.673 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.666 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.677 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.687 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.673 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.686 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.686 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.702 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.700 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.712 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.698 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.710 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.725 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.726 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.715 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.740 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.737 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.752 [callback.cpp:130]618774 aclrtProc.727 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.767 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.753 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.765 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessRepoessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.782 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.795 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
rt, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.787 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.798 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.775 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.789 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.800 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.810 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.811 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.824 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.811 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.825 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.826 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.839 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.837 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.838 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.850 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.853 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.865 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.850 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.865 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.862 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.874 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.881 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.878 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.890 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.886 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.897 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.908 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.893 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.907 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.918 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.904 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.917 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.927 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.921 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.933 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.939 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.950 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.932 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.946 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.877.925 [api_impl.cc:2003] 618674 DevFree: device free mem=0x12c280147000
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.945 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.959 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.962 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.961 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.877.974 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.877.959 [api_impl.cc:2003] 618674 DevFree: device free mem=0x12c100c00000
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.877.971 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.982 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.877.990 [queue_notify_manager.cc:100] [618674]QueueNotifyManager Destroy.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.878.004 [queue_notify_manager.cc:106] [618674]QueueNotifyManager Destroy success.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.877.975 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.877.989 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.877.988 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.001 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.011 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.877.991 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.004 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.017 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.028 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.003 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.018 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.030 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.042 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.878.012 [stream.cc:237] 618666 FreeStreamId: Free stream_id=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.878.040 [stream_sqcq_manage.cc:216] 618666 DeAllocStreamSqCq: deviceId=5, tsId=0, drvFlag=0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.022 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.036 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.046 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.039 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.052 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.054 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.066 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.878.057 [npu_driver.cc:966] 618666 NormalSqCqFree: Normal sqcq free, sqId=5, cqId=5, device_id=5, tsId=0, drvFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.878.060 [api_impl.cc:2003] 618662 DevFree: device free mem=0x12c280147000
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.063 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.085 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.095 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.878.097 [api_impl.cc:2003] 618662 DevFree: device free mem=0x12c100c00000
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.878.123 [queue_notify_manager.cc:100] [618662]QueueNotifyManager Destroy.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.057 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.071 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.083 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.078 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.091 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.107 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.119 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.132 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.144 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.878.092 [api_impl.cc:2003] 618654 DevFree: device free mem=0x12c280147000
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.111 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.123 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.878.137 [queue_notify_manager.cc:106] [618662]QueueNotifyManager Destroy success.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.117 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.131 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.143 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.154 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.878.138 [queue_notify_manager.cc:100] [618674]QueueNotifyManager Destroy.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.878.156 [queue_notify_manager.cc:106] [618674]QueueNotifyManager Destroy success.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.159 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.878.133 [api_impl.cc:2003] 618654 DevFree: device free mem=0x12c100c00000
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.878.159 [queue_notify_manager.cc:100] [618654]QueueNotifyManager Destroy.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.878.171 [queue_notify_manager.cc:106] [618654]QueueNotifyManager Destroy success.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.136 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.150 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.160 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.173 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.164 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.177 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.188 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.175 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.189 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.200 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.213 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.878.209 [ccl_buffer_manager.cc:125] [618674][HCCL_TRACE][ReleaseCCLbuffer]CCLBuffer is null, no need to release.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.184 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.197 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.207 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.217 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.227 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.878.230 [ccl_buffer_manager.cc:147] [618674][HCCL_TRACE][ReleaseCCLbuffer]CCLBuffer is null, no need to release.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.878.245 [ccl_buffer_manager.cc:160] [618674][HCCL_TRACE][ReleaseAIVbuffer]Release inAIVbuffer. buffer ptr[(nil)], size[0]
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.199 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.212 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.224 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.235 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.226 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.241 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.241 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.253 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.878.258 [ccl_buffer_manager.cc:163] [618674][HCCL_TRACE][ReleaseAIVbuffer]Release outAIVbuffer. buffer ptr[(nil)], size[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.878.267 [queue_notify_manager.cc:100] [618662]QueueNotifyManager Destroy.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.878.284 [queue_notify_manager.cc:106] [618662]QueueNotifyManager Destroy success.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.248 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.259 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.271 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.282 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.293 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.253 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.266 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.278 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.290 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.301 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.264 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.277 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.287 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.298 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.309 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.878.297 [queue_notify_manager.cc:100] [618654]QueueNotifyManager Destroy.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.878.316 [queue_notify_manager.cc:106] [618654]QueueNotifyManager Destroy success.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.878.276 [ccl_buffer_manager.cc:166] [618674][HCCL_TRACE][ReleaseAIVbuffer]Release AIV buffer success.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.878.312 [op_base.cc:128] [618674][HcclGetDeviceId] deviceLogicId[7] 
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.305 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.320 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.332 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.311 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.325 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.336 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.320 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.333 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.345 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.878.352 [ccl_buffer_manager.cc:125] [618662][HCCL_TRACE][ReleaseCCLbuffer]CCLBuffer is null, no need to release.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.878.328 [op_base.cc:2196] [618674]op_base comm destroy complete, take time [77022]us, group[192.168.0.44%enp67s0f5_60008_0_1743643662827273], deviceLogicId[7].
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.878.345 [device.cpp:183]618674 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.878.362 [api_impl.cc:3419] 618674 DeviceReset: reset device, device_id=7.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.345 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.358 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.369 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.380 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.878.387 [runtime.cc:3444] 618674 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0xa, reset:0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.878.400 [api_impl.cc:3449] 618674 DeviceReset: Succ, userDeviceId=7.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.878.410 [device.cpp:189]618674 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 7.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.348 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.363 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.374 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.384 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.396 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=28147[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.358 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.372 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.392 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.404 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.878.382 [ccl_buffer_manager.cc:125] [618654][HCCL_TRACE][ReleaseCCLbuffer]CCLBuffer is null, no need to release.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.878.401 [ccl_buffer_manager.cc:147] [618654][HCCL_TRACE][ReleaseCCLbuffer]CCLBuffer is null, no need to release.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.878.370 [ccl_buffer_manager.cc:147] [618662][HCCL_TRACE][ReleaseCCLbuffer]CCLBuffer is null, no need to release.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.878.386 [ccl_buffer_manager.cc:160] [618662][HCCL_TRACE][ReleaseAIVbuffer]Release inAIVbuffer. buffer ptr[(nil)], size[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.878.399 [ccl_buffer_manager.cc:163] [618662][HCCL_TRACE][ReleaseAIVbuffer]Release outAIVbuffer. buffer ptr[(nil)], size[0]
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.393 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.406 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
1881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.416 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.427 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.440 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.449 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.418 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.429 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.441 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.452 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.878.415 [ccl_buffer_manager.cc:160] [618654][HCCL_TRACE][ReleaseAIVbuffer]Release inAIVbuffer. buffer ptr[(nil)], size[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.878.429 [ccl_buffer_manager.cc:163] [618654][HCCL_TRACE][ReleaseAIVbuffer]Release outAIVbuffer. buffer ptr[(nil)], size[0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.878.442 [ccl_buffer_manager.cc:166] [618654][HCCL_TRACE][ReleaseAIVbuffer]Release AIV buffer success.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.878.424 [ccl_buffer_manager.cc:166] [618662][HCCL_TRACE][ReleaseAIVbuffer]Release AIV buffer success.
[INFO] HCCL_ADPT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.878.453 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:364] FinalizeHccl] Start destroy hccl adapter for GE_MODE
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.441 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.453 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.465 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.476 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.462 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.474 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.485 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.464 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.478 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.489 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.878.475 [op_base.cc:128] [618654][HcclGetDeviceId] deviceLogicId[2] 
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.878.492 [op_base.cc:2196] [618654]op_base comm destroy complete, take time [78377]us, group[192.168.0.44%enp67s0f5_60008_0_1743643662827273], deviceLogicId[2].
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.878.472 [op_base.cc:128] [618662][HcclGetDeviceId] deviceLogicId[4] 
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.878.492 [op_base.cc:2196] [618662]op_base comm destroy complete, take time [77684]us, group[192.168.0.44%enp67s0f5_60008_0_1743643662827273], deviceLogicId[4].
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.878.509 [device.cpp:183]618662 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 4.
[INFO] HCCL_ADPT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.878.482 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:806] FinalizeHcclExec] Start finalize hccl exec.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.878.495 [hcom_executor.cc:40] [618674]Hcom Excutor Finalize start.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.490 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.503 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.515 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.525 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.498 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.509 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.521 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.533 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.503 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.516 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.527 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.539 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.878.509 [device.cpp:183]618654 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.878.525 [api_impl.cc:3419] 618654 DeviceReset: reset device, device_id=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.878.538 [runtime.cc:3444] 618654 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0xa, reset:0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.878.554 [api_impl.cc:3449] 618654 DeviceReset: Succ, userDeviceId=2.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.878.526 [api_impl.cc:3419] 618662 DeviceReset: reset device, device_id=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.878.541 [runtime.cc:3444] 618662 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0xa, reset:0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.878.554 [api_impl.cc:3449] 618662 DeviceReset: Succ, userDeviceId=4.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.538 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.551 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.562 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.573 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.544 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.549 [stream.cc:237] 618650 FreeStreamId: Free stream_id=2.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.558 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.575 [stream_sqcq_manage.cc:216] 618650 DeAllocStreamSqCq: deviceId=1, tsId=0, drvFlag=0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.584 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.553 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.567 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.577 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.587 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.599 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.878.569 [device.cpp:189]618654 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 2.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.878.574 [api_impl.cc:3419] 618891 DeviceReset: reset device, device_id=7.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.878.567 [device.cpp:189]618662 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 4.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.585 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.597 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.609 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.595 [npu_driver.cc:966] 618650 NormalSqCqFree: Normal sqcq free, sqId=2, cqId=2, device_id=1, tsId=0, drvFlag=0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.605 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.614 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.622 [stream.cc:237] 618658 FreeStreamId: Free stream_id=2.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.627 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.630 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.643 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.654 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.665 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.878.618 [npu_driver.cc:974] 618666 NormalSqCqFree: Normal sqcq free success, sqId=5, cqId=5, device_id=5, tsId=0, drvFlag=0
[INFO] HCCL_ADPT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.878.610 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:364] FinalizeHccl] Start destroy hccl adapter for GE_MODE
[INFO] HCCL_ADPT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.878.637 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:806] FinalizeHcclExec] Start finalize hccl exec.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.878.606 [runtime.cc:3444] 618891 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x9, reset:0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.878.624 [api_impl.cc:3449] 618891 DeviceReset: Succ, userDeviceId=7.
[INFO] HCCL_ADPT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.878.610 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:364] FinalizeHccl] Start destroy hccl adapter for GE_MODE
[INFO] HCCL_ADPT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.878.636 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:806] FinalizeHcclExec] Start finalize hccl exec.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.878.648 [hcom_executor.cc:40] [618662]Hcom Excutor Finalize start.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.622 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.636 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.648 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.660 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.642 [stream_sqcq_manage.cc:216] 618658 DeAllocStreamSqCq: deviceId=3, tsId=0, drvFlag=0
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.650 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.662 [npu_driver.cc:966] 618658 NormalSqCqFree: Normal sqcq free, sqId=2, cqId=2, device_id=3, tsId=0, drvFlag=0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.87[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.678 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.878.639 [stream_sqcq_manage.cc:228] 618666 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=5, cq_id=5, stream_id=5, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.878.657 [npu_driver.cc:432] 618666 StreamIdFree: stream id free begin, device_id=5, stream_id=5, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.878.676 [npu_driver.cc:441] 618666 StreamIdFree: Stream id free success, stream_id=5, device_id=5, tsId=0, streamFlag=1536
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.878.652 [hcom_executor.cc:40] [618654]Hcom Excutor Finalize start.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.672 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.684 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.694 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.705 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.716 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.727 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
8.671 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.701 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.712 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.723 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.734 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.695 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.708 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.720 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.738 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.750 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.878.709 [api_impl.cc:3419] 618888 DeviceReset: reset device, device_id=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.878.749 [runtime.cc:3444] 618888 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x8, reset:0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.878.766 [api_impl.cc:3449] 618888 DeviceReset: Succ, userDeviceId=7.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.878.708 [api_impl.cc:3419] 618953 DeviceReset: reset device, device_id=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.878.708 [api_impl.cc:3419] 618955 DeviceReset: reset device, device_id=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.878.734 [runtime.cc:3444] 618953 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x9, reset:0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.878.745 [runtime.cc:3444] 618955 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x8, reset:0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.878.751 [api_impl.cc:3449] 618953 DeviceReset: Succ, userDeviceId=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.878.761 [api_impl.cc:3449] 618955 DeviceReset: Succ, userDeviceId=2.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.749 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.764 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.746 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.761 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.771 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.768 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.781 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.795 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.878.717 [api_impl.cc:3419] 618890 DeviceReset: reset device, device_id=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.878.744 [runtime.cc:3444] 618890 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x9, reset:0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.878.761 [api_impl.cc:3449] 618890 DeviceReset: Succ, userDeviceId=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.878.782 [api_impl.cc:3419] 618894 DeviceReset: reset device, device_id=4.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.780 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.795 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.807 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.781 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.795 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.806 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.818 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.811 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.822 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.878.802 [runtime.cc:3444] 618894 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x8, reset:0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.878.820 [api_impl.cc:3449] 618894 DeviceReset: Succ, userDeviceId=4.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.819 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.832 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.843 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.829 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.842 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.854 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.834 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.849 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.859 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.856 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.869 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.880 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.865 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.878 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.871 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.885 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.897 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.893 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.905 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.888 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.902 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.910 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.919 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.931 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.913 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.927 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.938 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.943 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.955 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.922 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.935 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.946 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.951 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.959 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.972 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.878.962 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.975 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.968 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.878.982 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.878.984 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.878.994 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.878.987 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.012 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.878.997 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.010 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.008 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.022 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.025 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.022 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.036 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.036 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.048 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.039 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.050 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.879.036 [api_impl.cc:3419] 618893 DeviceReset: reset device, device_id=7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.879.037 [api_impl.cc:3419] 618889 DeviceReset: reset device, device_id=7.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.065 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576

[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.071 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.063 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.076 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.879.067 [runtime.cc:3444] 618893 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x7, reset:0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.879.083 [runtime.cc:3444] 618889 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x6, reset:0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.879.091 [api_impl.cc:3449] 618893 DeviceReset: Succ, userDeviceId=7.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.079 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.090 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.083 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.095 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.107 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.088 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.102 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.114 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.879.099 [api_impl.cc:3449] 618889 DeviceReset: Succ, userDeviceId=7.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.879.093 [api_impl.cc:3419] 618895 DeviceReset: reset device, device_id=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.879.108 [api_impl.cc:3419] 618892 DeviceReset: reset device, device_id=4.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.879.080 [api_impl.cc:3419] 618954 DeviceReset: reset device, device_id=2.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.102 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.102 [npu_driver.cc:974] 618650 NormalSqCqFree: Normal sqcq free success, sqId=2, cqId=2, device_id=1, tsId=0, drvFlag=0
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.118 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.119 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.132 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.132 [stream_sqcq_manage.cc:228] 618650 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=2, cq_id=2, stream_id=2, is_sq_need_release=1, drvFlag=0.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.140 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.153 [npu_driver.cc:432] 618650 StreamIdFree: stream id free begin, device_id=1, stream_id=2, ts_id=0, remote_stream_id=0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.161 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.177 [npu_driver.cc:441] 618650 StreamIdFree: Stream id free success, stream_id=2, device_id=1, tsId=0, streamFlag=1536
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.181 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.128 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.141 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.154 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.879.124 [runtime.cc:3444] 618895 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x7, reset:0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.879.136 [runtime.cc:3444] 618892 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x6, reset:0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.879.143 [api_impl.cc:3449] 618895 DeviceReset: Succ, userDeviceId=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.879.151 [api_impl.cc:3449] 618892 DeviceReset: Succ, userDeviceId=4.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.879.128 [runtime.cc:3444] 618954 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x7, reset:0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.879.130 [api_impl.cc:3419] 618956 DeviceReset: reset device, device_id=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.879.146 [api_impl.cc:3449] 618954 DeviceReset: Succ, userDeviceId=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.879.157 [runtime.cc:3444] 618956 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x6, reset:0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.879.172 [api_impl.cc:3449] 618956 DeviceReset: Succ, userDeviceId=2.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.142 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.155 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.166 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.179 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.190 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.205 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.164 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.163 [npu_driver.cc:974] 618658 NormalSqCqFree: Normal sqcq free success, sqId=2, cqId=2, device_id=3, tsId=0, drvFlag=0
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.177 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.189 [stream_sqcq_manage.cc:228] 618658 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=2, cq_id=2, stream_id=2, is_sq_need_release=1, drvFlag=0.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.197 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.208 [npu_driver.cc:432] 618658 StreamIdFree: stream id free begin, device_id=3, stream_id=2, ts_id=0, remote_stream_id=0
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.201 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.215 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.227 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.238 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.220 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.232 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.243 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.217 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.231 [npu_driver.cc:441] 618658 StreamIdFree: Stream id free success, stream_id=2, device_id=3, tsId=0, streamFlag=1536
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.235 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.257 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.250 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.262 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.256 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.270 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.270 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.281 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.274 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.286 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.879.279 [stream.cc:185] [618666][HCCL_TRACE]StreamDestroy, streamPtr[0xaaab022b3ae0], stream id[5]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.879.300 [api_impl.cc:3717] 618666 ContextSetCurrent: set context=aaaaf6e2dcc0, flag=0.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.284 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.297 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.301 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.297 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.310 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.879.299 [api_impl.cc:3717] 618662 ContextSetCurrent: set context=aaab087d6320, flag=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.879.299 [api_impl.cc:3717] 618654 ContextSetCurrent: set context=aaaaf5082ff0, flag=0.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.879.317 [adapter_rts.cc:321] [618666][hrtCtxSetCurrent] success
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.879.324 [adapter_rts.cc:321] [618654][hrtCtxSetCurrent] success
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.879.342 [stream.cc:182] [618654]Switch Ctx ret[0], curCtx[0xaaaaf5082ff0], setCtx[0xaaaaf5082ff0], stream id[5]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.879.358 [api_impl.cc:1228] 618654 StreamDestroy: stream_id=5.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.309 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.325 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.312 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.325 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.339 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.324 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.340 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.879.324 [adapter_rts.cc:321] [618662][hrtCtxSetCurrent] success
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.879.341 [stream.cc:182] [618662]Switch Ctx ret[0], curCtx[0xaaab087d6320], setCtx[0xaaab087d6320], stream id[5]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.879.389 [api_impl.cc:3717] 618674 ContextSetCurrent: set context=aaab0103b880, flag=0.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.879.330 [stream.cc:193] [618666]Restore Ctx ret[0], setCtx[0xaaaaf6e2dcc0], stream id[5]
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.879.375 [acl_resource_manager.cpp:814]618654 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.339 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.353 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.366 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.386 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.352 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.365 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.376 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.387 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.397 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.352 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.367 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.385 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.396 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.407 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.879.359 [api_impl.cc:1228] 618662 StreamDestroy: stream_id=5.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.879.378 [acl_resource_manager.cpp:814]618662 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.879.411 [adapter_rts.cc:321] [618674][hrtCtxSetCurrent] success
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.879.380 [api_impl.cc:3717] 618666 ContextSetCurrent: set context=aaaaf6e2dcc0, flag=0.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.879.397 [adapter_rts.cc:321] [618666][hrtCtxSetCurrent] success
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.879.410 [stream.cc:182] [618666]Switch Ctx ret[0], curCtx[0xaaaaf6e2dcc0], setCtx[0xaaaaf6e2dcc0], stream id[4]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.879.424 [api_impl.cc:1228] 618666 StreamDestroy: stream_id=4.
[INFO] GE(618654,python3.9):2025-04-03-09:27:49.879.417 [single_op_manager.cc:50]618654 ReleaseResource:ReleaseResource in. resource id = 0xaaab005099e0
[INFO] GE(618654,python3.9):2025-04-03-09:27:49.879.436 [caching_allocator.cc:402]618654 TryFreeBlocks:Try free blocks.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.401 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.413 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.424 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.439 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.449 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.409 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.423 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.436 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.448 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.460 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.419 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.433 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.444 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.455 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.467 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] GE(618662,python3.9):2025-04-03-09:27:49.879.417 [single_op_manager.cc:50]618662 ReleaseResource:ReleaseResource in. resource id = 0xaaab13a98190
[INFO] GE(618662,python3.9):2025-04-03-09:27:49.879.450 [caching_allocator.cc:402]618662 TryFreeBlocks:Try free blocks.
[INFO] GE(618662,python3.9):2025-04-03-09:27:49.879.465 [caching_allocator.cc:358]618662 FreeCachedBlocks:Free cached blocks
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.879.429 [stream.cc:182] [618674]Switch Ctx ret[0], curCtx[0xaaab0103b880], setCtx[0xaaab0103b880], stream id[5]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.879.450 [api_impl.cc:1228] 618674 StreamDestroy: stream_id=5.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.879.466 [acl_resource_manager.cpp:814]618674 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.879.441 [acl_resource_manager.cpp:814]618666 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] GE(618666,python3.9):2025-04-03-09:27:49.879.456 [single_op_manager.cc:50]618666 ReleaseResource:ReleaseResource in. resource id = 0xaaab02237a80
[INFO] GE(618666,python3.9):2025-04-03-09:27:49.879.471 [caching_allocator.cc:402]618666 TryFreeBlocks:Try free blocks.
[INFO] GE(618654,python3.9):2025-04-03-09:27:49.879.448 [caching_allocator.cc:358]618654 FreeCachedBlocks:Free cached blocks
[INFO] GE(618654,python3.9):2025-04-03-09:27:49.879.486 [npu_memory_allocator.cc:72]618654 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.879.500 [stream_executor.cpp:197]618654 RemoveExecutor: To remove executor by stream = 187651421411808
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.463 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.474 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.486 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.497 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.507 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.474 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.488 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.502 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.512 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.523 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.481 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.492 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.503 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.515 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.527 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] GE(618662,python3.9):2025-04-03-09:27:49.879.494 [npu_memory_allocator.cc:72]618662 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.879.509 [stream_executor.cpp:197]618662 RemoveExecutor: To remove executor by stream = 187651746005392
[INFO] GE(618674,python3.9):2025-04-03-09:27:49.879.485 [single_op_manager.cc:50]618674 ReleaseResource:ReleaseResource in. resource id = 0xaaab0c4c3470
[INFO] GE(618674,python3.9):2025-04-03-09:27:49.879.506 [caching_allocator.cc:402]618674 TryFreeBlocks:Try free blocks.
[INFO] GE(618674,python3.9):2025-04-03-09:27:49.879.519 [caching_allocator.cc:358]618674 FreeCachedBlocks:Free cached blocks
[INFO] GE(618666,python3.9):2025-04-03-09:27:49.879.503 [caching_allocator.cc:358]618666 FreeCachedBlocks:Free cached blocks
[INFO] GE(618666,python3.9):2025-04-03-09:27:49.879.517 [npu_memory_allocator.cc:72]618666 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.879.529 [stream_executor.cpp:197]618666 RemoveExecutor: To remove executor by stream = 187651452009088
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.879.541 [acl_resource_manager.cpp:823]618666 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.879.554 [stream.cc:852] 618666 TearDown: stream_id=4, sqId=4, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.879.535 [acl_resource_manager.cpp:823]618654 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.879.553 [stream.cc:852] 618654 TearDown: stream_id=5, sqId=5, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:49.879.523 [awatchdog_monitor.c:160](tid:618680) thread 618973 not exist
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:49.879.560 [awatchdog_monitor.c:160](tid:618680) thread 618975 not exist
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.518 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.532 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.543 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.554 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.565 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.576 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.535 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.548 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.558 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.571 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.582 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.539 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.552 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.564 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.576 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.588 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.879.540 [acl_resource_manager.cpp:823]618662 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.879.558 [stream.cc:852] 618662 TearDown: stream_id=5, sqId=5, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.879.573 [stream.cc:938] 618662 TearDown: stream_id=5, delay recycle task num=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.879.586 [stream.cc:1507] 618662 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] GE(618674,python3.9):2025-04-03-09:27:49.879.551 [npu_memory_allocator.cc:72]618674 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.879.568 [stream_executor.cpp:197]618674 RemoveExecutor: To remove executor by stream = 187651622450288
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.879.595 [acl_resource_manager.cpp:823]618674 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.879.570 [stream.cc:938] 618666 TearDown: stream_id=4, delay recycle task num=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.879.585 [stream.cc:1507] 618666 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.879.607 [stream_sqcq_manage.cc:451] 618666 FreeLogicCq: Return(0), threadIdentifier(281473067970016), devId(5), tsId(0), cqId(361), isFastCq(0).
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.879.568 [stream.cc:938] 618654 TearDown: stream_id=5, delay recycle task num=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.879.582 [stream.cc:1507] 618654 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.879.606 [stream_sqcq_manage.cc:451] 618654 FreeLogicCq: Return(0), threadIdentifier(281473077956064), devId(2), tsId(0), cqId(1001), isFastCq(0).
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.879.627 [npu_driver.cc:6163] 618654 StreamUnBindLogicCq: success: deviceId=2, tsId=0, streamId=5, logicCq=1001.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:49.879.581 [awatchdog_monitor.c:160](tid:618680) thread 618974 not exist
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:49.879.602 [awatchdog_monitor.c:160](tid:618680) thread 618976 not exist
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.591 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.602 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.614 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.625 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.636 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.598 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.617 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.628 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.640 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.652 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.600 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.614 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.626 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.639 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.651 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.879.616 [stream_sqcq_manage.cc:451] 618662 FreeLogicCq: Return(0), threadIdentifier(281473748110816), devId(4), tsId(0), cqId(315), isFastCq(0).
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.879.639 [npu_driver.cc:6163] 618662 StreamUnBindLogicCq: success: deviceId=4, tsId=0, streamId=5, logicCq=315.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.879.608 [stream.cc:852] 618674 TearDown: stream_id=5, sqId=5, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.879.625 [stream.cc:938] 618674 TearDown: stream_id=5, delay recycle task num=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.879.636 [stream.cc:1507] 618674 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.879.670 [stream_sqcq_manage.cc:451] 618674 FreeLogicCq: Return(0), threadIdentifier(281473023856096), devId(7), tsId(0), cqId(335), isFastCq(0).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.879.629 [npu_driver.cc:6163] 618666 StreamUnBindLogicCq: success: deviceId=5, tsId=0, streamId=4, logicCq=361.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.879.666 [npu_driver.cc:1180] 618666 LogicCqFree: Succ:device_id=5,ts_id=0,type=2,logic_cq_id=361, drvFlag=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.879.662 [npu_driver.cc:1180] 618654 LogicCqFree: Succ:device_id=2,ts_id=0,type=2,logic_cq_id=1001, drvFlag=0.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.648 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.662 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.684 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.696 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.708 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.665 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.678 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.691 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.702 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.712 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.664 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.677 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.695 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.707 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.718 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.728 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.879.675 [npu_driver.cc:1180] 618662 LogicCqFree: Succ:device_id=4,ts_id=0,type=2,logic_cq_id=315, drvFlag=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.879.690 [npu_driver.cc:6163] 618674 StreamUnBindLogicCq: success: deviceId=7, tsId=0, streamId=5, logicCq=335.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.879.723 [npu_driver.cc:1180] 618674 LogicCqFree: Succ:device_id=7,ts_id=0,type=2,logic_cq_id=335, drvFlag=0.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.721 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.734 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.745 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.756 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.768 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.723 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.736 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.747 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.759 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.770 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.780 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.740 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.753 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.763 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.774 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.785 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.779 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.794 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.805 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.793 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.806 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.818 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.798 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.809 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.821 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.817 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.831 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.842 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.831 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.843 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.854 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.833 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.846 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.858 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.869 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.854 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.868 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.870 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.883 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.880 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.891 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.880 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.895 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.895 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.902 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.909 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.909 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.921 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.932 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.917 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.931 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.945 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.931 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.945 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.945 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.879.958 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.958 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.879.971 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.973 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.879.961 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.984 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.976 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.879.987 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.879.985 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.879.997 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.005 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.880.010 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.011 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.024 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.019 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.032 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.880.023 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.037 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.038 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.049 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.045 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.058 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.050 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.880.063 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.061 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.072 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.069 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.082 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.880.074 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.087 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.098 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.084 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.096 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.093 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.107 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.880.111 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.108 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.120 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.119 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.133 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.880.126 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.139 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.132 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.145 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.165 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.147 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.179 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.150 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.880.179 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.880.192 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.181 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.195 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.199 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.205 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.205 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.219 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.216 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.228 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.218 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.880.232 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.231 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.242 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.254 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.880.244 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.257 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.252 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.264 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.268 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.281 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.292 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.269 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.880.282 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.880.294 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.305 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.275 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.286 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.296 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.307 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.318 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.303 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.316 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.320 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.330 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(6[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.343 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
18670,python3.9):2025-04-03-09:27:49.880.333 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.880.359 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.329 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.341 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.355 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.369 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.374 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.370 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.384 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.381 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.393 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.388 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.880.401 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.403 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.416 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.396 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.410 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.880.406 [stream.cpp:87]618670 aclrtDestroyStream: aclrtDestroyStream success
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.880.412 [callback.cpp:116]618822 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.427 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.422 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.436 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.432 [subscribe.cc:308] 618822 GetGroupIdByThreadId: can not find subscribe info, threadId=281471545700256
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.445 [api_impl.cc:5043] 618822 ProcessReport: get groupId fail, threadIdentifier=281471545700256, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.440 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.452 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.447 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.460 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.880.451 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:137] UnRegCallback] Unregister callback thread, stream : 0xaaaada9cc680.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.880.457 [callback.cpp:130]618822 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.464 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.474 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.473 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.880.471 [stream.cpp:75]618670 aclrtDestroyStream: start to execute aclrtDestroyStream
[INFO] GE(618670,python3.9):2025-04-03-09:27:49.880.491 [stream_manage_func_registry.cc:22]618670 TryCallStreamMngFunc:Stream manage func is not found, FuncType is [0]
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.489 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.501 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.490 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.504 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.880.505 [stream.cpp:80]618670 aclrtDestroyStream: try to call stream manage function success, action type is DESTROY_STREAM.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.515 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.525 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.515 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.531 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.521 [api_impl.cc:1228] 618670 StreamDestroy: stream_id=3.
[INFO] DEVICE(618670,ffff337eefa0,python3.9):2025-04-03-09:27:49.880.516 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/callback_thread.cc:42] callback_thread_func] Exit callback thread loop.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.880.537 [acl_resource_manager.cpp:814]618670 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.539 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.544 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.554 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] GE(618670,python3.9):2025-04-03-09:27:49.880.553 [single_op_manager.cc:50]618670 ReleaseResource:ReleaseResource in. resource id = 0xaaaadaafcb60
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.559 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.571 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.570 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] GE(618670,python3.9):2025-04-03-09:27:49.880.570 [caching_allocator.cc:402]618670 TryFreeBlocks:Try free blocks.
[INFO] GE(618670,python3.9):2025-04-03-09:27:49.880.584 [caching_allocator.cc:358]618670 FreeCachedBlocks:Free cached blocks
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.584 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.600 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.611 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.585 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.598 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.610 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] GE(618670,python3.9):2025-04-03-09:27:49.880.596 [npu_memory_allocator.cc:72]618670 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.880.610 [stream_executor.cpp:197]618670 RemoveExecutor: To remove executor by stream = 187650790116192
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.880.623 [acl_resource_manager.cpp:823]618670 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.625 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.625 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.636 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.637 [stream.cc:852] 618670 TearDown: stream_id=3, sqId=3, pendingNum=0, isForceRecycle_=0, flag=0, failMode=1.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.640 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.655 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.647 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.659 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.653 [stream.cc:938] 618670 TearDown: stream_id=3, delay recycle task num=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.667 [event.cc:1036] 618670 WaitForBusy: device_id=6, e[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.671 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.683 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.668 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.681 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
vent_id=1 finished map already empty.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.693 [npu_driver.cc:626] 618670 EventIdFree: event id free begin, device_id=6, event_id=1, ts_id=0, remote_event_id=0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.695 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.710 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.693 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.714 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.725 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.717 [raw_device.cc:1158] 618670 FreeEventIdFromDrv: device_id=6, event_id=1 tear down.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.731 [event.cc:61] 618670 ~Event: device_id=6, event deconstruct, recordSize=0, waitSize=0, idSize=0
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.723 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.734 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.744 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.737 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.749 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.747 [npu_driver.cc:3803] 618670 SqCqFree: deviceId=6, tsId=0, sqId=90, cqId=90
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.757 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.763 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.774 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.769 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.781 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.779 [subscribe.cc:244] 618670 Delete: delete callback subscribe: groupId=65, threadId=281471537246112, devId=6, tsId=0, streamId=3, sqId=90, cqId=90
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:49.880.783 [trs_sqcq.c:1491][ascend][curpid:618670,618823][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=6; type=1; ret=16)
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.788 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.799 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.793 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.805 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.800 [stream.cc:1507] 618670 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.808 [npu_driver.cc:3833] 618823 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=6, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.818 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.829 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.840 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.813 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.824 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.823 [api_impl.cc:5058] 618823 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.826 [stream_sqcq_manage.cc:451] 618670 FreeLogicCq: Return(0), threadIdentifier(281473556700640), devId(6), tsId(0), cqId(299), isFastCq(0).
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.880.839 [callback.cpp:132]618823 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.847 [npu_driver.cc:6163] 618670 StreamUnBindLogicCq: success: deviceId=6, tsId=0, streamId=3, logicCq=299.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.839 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.851 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.862 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.880.856 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.854 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.877 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.871 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.880 [npu_driver.cc:1180] 618670 LogicCqFree: Succ:device_id=6,ts_id=0,type=2,logic_cq_id=299, drvFlag=0.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.876 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.891 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.883 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.890 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.903 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.905 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.880.904 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.880.919 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.916 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.928 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.918 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.933 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.932 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.946 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.945 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.959 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.939 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.951 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.880.959 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.880.971 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.964 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.880.977 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.880.971 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.985 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.985 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.880.998 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.880.988 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.002 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.880.998 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.010 [callback.cpp:130]618823 aclrtPr[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.012 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.015 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
ocessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.022 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.035 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.046 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.041 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.055 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.039 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.052 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.062 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.058 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.070 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.066 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.079 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.090 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.073 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.087 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.099 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.081 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.094 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.104 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.104 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.112 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.119 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.125 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.138 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.117 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.133 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.131 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.145 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.149 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.147 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.158 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.170 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.157 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.167 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,pytho[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.163 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.175 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.184 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
n3.9):2025-04-03-09:27:49.881.178 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.199 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.191 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.197 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.211 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.212 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.204 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.217 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.223 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.235 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.225 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.228 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.241 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.246 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.254 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.266 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.278 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.237 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.251 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.262 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.273 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.260 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.275 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.286 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.289 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.297 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.308 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.302 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.314 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.288 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.299 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.318 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.325 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.331 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.343 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.312 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.324 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.336 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.339 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.354 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.360 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.373 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.359 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.373 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.384 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.366 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.378 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.388 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.387 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.399 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.397 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.402 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.413 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.411 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.424 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.414 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.427 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.426 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.439 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.437 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.449 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.441 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.453 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.452 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.463 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.462 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.474 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.466 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.477 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.479 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.491 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.485 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.497 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.499 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.505 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.516 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.510 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.521 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.511 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.523 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.530 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.533 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.535 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.547 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.542 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.555 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.545 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.559 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.560 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.571 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.567 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.580 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.590 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.570 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.583 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.594 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.585 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.596 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.608 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.603 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.615 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.606 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.619 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.620 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.628 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.633 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.645 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.633 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.646 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.640 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.655 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.658 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.666 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.686 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.658 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.671 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.677 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.689 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.699 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.684 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.695 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.705 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.716 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.702 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.715 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.712 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.726 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.729 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.739 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.725 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.738 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.738 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.752 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.753 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.750 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.764 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.767 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.766 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.776 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.787 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.783 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.796 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.781 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.793 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.810 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.799 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.813 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.807 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.820 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.822 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.834 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.825 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.838 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.831 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.844 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.846 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.857 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.849 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.862 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.855 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.868 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.870 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.874 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.883 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.895 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.906 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.879 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.891 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.888 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.900 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.912 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.902 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.915 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.926 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.918 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.924 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.937 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.939 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.934 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.948 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.881.950 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.959 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.881.971 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.953 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.966 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.982 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.964 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.881.990 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.881.995 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.007 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.881.980 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.881.991 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.003 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.015 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.019 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.010 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.025 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.036 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.027 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.039 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.031 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.043 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.050 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.052 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.065 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.054 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.067 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.063 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.077 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.078 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.080 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.089 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.101 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.882.081 [stream.cc:237] 618674 FreeStreamId: Free stream_id=5.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.090 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.105 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.092 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.105 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.112 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.127 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.116 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.129 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.140 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.882.134 [stream_sqcq_manage.cc:216] 618674 DeAllocStreamSqCq: deviceId=7, tsId=0, drvFlag=0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.125 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.141 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.153 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.140 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.154 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.153 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.168 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.882.154 [npu_driver.cc:966] 618674 NormalSqCqFree: Normal sqcq free, sqId=5, cqId=5, device_id=7, tsId=0, drvFlag=0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.167 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.178 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.168 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.183 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.182 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.195 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.882.204 [stream.cc:237] 618666 FreeStreamId: Free stream_id=4.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.882.228 [stream_sqcq_manage.cc:216] 618666 DeAllocStreamSqCq: deviceId=5, tsId=0, drvFlag=0
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.189 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.201 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.211 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.224 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.196 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.209 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.223 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.235 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.206 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.220 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.231 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.242 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.882.245 [npu_driver.cc:966] 618666 NormalSqCqFree: Normal sqcq free, sqId=4, cqId=4, device_id=5, tsId=0, drvFlag=0
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.239 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.249 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.248 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.262 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.255 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.266 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.276 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.261 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.274 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.285 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.276 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.290 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.301 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.287 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.306 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.318 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.296 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.308 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.319 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.331 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.333 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.315 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.326 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.345 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.344 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.351 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.362 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.359 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.372 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.358 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.370 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.377 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.384 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.382 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.395 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.405 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.389 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.403 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.414 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.397 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.409 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.420 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.431 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.416 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.424 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.437 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.443 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.442 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.455 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.456 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.469 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.448 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.462 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.468 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.480 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.481 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.474 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.486 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.495 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.495 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.508 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.519 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.497 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.512 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.523 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.506 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.519 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.531 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.532 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.545 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.534 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.549 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.542 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.555 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.557 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.568 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.561 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.573 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.581 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.566 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.578 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.585 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.597 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.597 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.590 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.603 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.605 [stream.cpp:87]618658 aclrtDestroyStream: aclrtDestroyStream success
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.610 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.623 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.634 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.611 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.630 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.642 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.613 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.638 [callback.cpp:116]618774 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.647 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.653 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.650 [subscribe.cc:308] 618774 GetGroupIdByThreadId: can not find subscribe info, threadId=281471973191584
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.882.655 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:137] UnRegCallback] Unregister callback thread, stream : 0xaaab0bb0bf40.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.669 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.665 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.677 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.663 [api_impl.cc:5043] 618774 ProcessReport: get groupId fail, threadIdentifier=281471973191584, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.679 [stream.cpp:75]618658 aclrtDestroyStream: start to execute aclrtDestroyStream
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.683 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.696 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.693 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.704 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.685 [callback.cpp:130]618774 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] GE(618658,python3.9):2025-04-03-09:27:49.882.703 [stream_manage_func_registry.cc:22]618658 TryCallStreamMngFunc:Stream manage func is not found, FuncType is [0]
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.716 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.728 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.739 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.882.699 [npu_driver.cc:974] 618666 NormalSqCqFree: Normal sqcq free success, sqId=4, cqId=4, device_id=5, tsId=0, drvFlag=0
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.709 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.720 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.730 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.751 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.722 [stream.cpp:80]618658 aclrtDestroyStream: try to call stream manage function success, action type is DESTROY_STREAM.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.755 [api_impl.cc:1228] 618658 StreamDestroy: stream_id=3.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.764 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.775 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.882.718 [stream_sqcq_manage.cc:228] 618666 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=4, cq_id=4, stream_id=4, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.882.735 [npu_driver.cc:432] 618666 StreamIdFree: stream id free begin, device_id=5, stream_id=4, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.882.751 [npu_driver.cc:441] 618666 StreamIdFree: Stream id free success, stream_id=4, device_id=5, tsId=0, streamFlag=1536
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.745 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.758 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.770 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.882.762 [npu_driver.cc:974] 618674 NormalSqCqFree: Normal sqcq free success, sqId=5, cqId=5, device_id=7, tsId=0, drvFlag=0
[INFO] DEVICE(618658,ffff4cf9efa0,python3.9):2025-04-03-09:27:49.882.766 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/callback_thread.cc:42] callback_thread_func] Exit callback thread loop.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.774 [acl_resource_manager.cpp:814]618658 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.787 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.803 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.780 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.793 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.804 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.816 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.882.793 [stream_sqcq_manage.cc:228] 618674 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=5, cq_id=5, stream_id=5, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.882.812 [npu_driver.cc:432] 618674 StreamIdFree: stream id free begin, device_id=7, stream_id=5, ts_id=0, remote_stream_id=0
[INFO] GE(618658,python3.9):2025-04-03-09:27:49.882.804 [single_op_manager.cc:50]618658 ReleaseResource:ReleaseResource in. resource id = 0xaaab0bc3ae30
[INFO] GE(618658,python3.9):2025-04-03-09:27:49.882.820 [caching_allocator.cc:402]618658 TryFreeBlocks:Try free blocks.
[INFO] GE(618658,python3.9):2025-04-03-09:27:49.882.831 [caching_allocator.cc:358]618658 FreeCachedBlocks:Free cached blocks
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.816 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.828 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.839 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.831 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.843 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.854 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.882.834 [npu_driver.cc:441] 618674 StreamIdFree: Stream id free success, stream_id=5, device_id=7, tsId=0, streamFlag=1536
[INFO] GE(618658,python3.9):2025-04-03-09:27:49.882.843 [npu_memory_allocator.cc:72]618658 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.855 [stream_executor.cpp:197]618658 RemoveExecutor: To remove executor by stream = 187651613503024
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.882.866 [acl_resource_manager.cpp:823]618658 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.850 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.862 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.873 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.867 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.878 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.879 [stream.cc:852] 618658 TearDown: stream_id=3, sqId=3, pendingNum=0, isForceRecycle_=0, flag=0, failMode=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.894 [stream.cc:938] 618658 TearDown: stream_id=3, delay recycle task num=0.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.886 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.898 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.908 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.889 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.902 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.913 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.923 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.908 [event.cc:1036] 618658 WaitForBusy: device_id=3, event_id=1 finished map already empty.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.923 [npu_driver.cc:626] 618658 EventIdFree: event id free begin, device_id=3, event_id=1, ts_id=0, remote_event_id=0
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.919 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.937 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.946 [raw_device.cc:1158] 618658 FreeEventIdFromDrv: device_id=3, event_id=1 tear down.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.941 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.953 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.951 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.960 [event.cc:61] 618658 ~Event: device_id=3, event deconstruct, recordSize=0, waitSize=0, idSize=0
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.965 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.882.978 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.882.970 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.985 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.882.976 [npu_driver.cc:3803] 618658 SqCqFree: deviceId=3, tsId=0, sqId=788, cqId=788
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.882.991 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.882.997 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.009 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.008 [subscribe.cc:244] 618658 Delete: delete callback subscribe: groupId=65, threadId=281471352827808, devId=3, tsId=0, streamId=3, sqId=788, cqId=788
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:49.883.015 [trs_sqcq.c:1491][ascend][curpid:618658,618775][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=3; type=1; ret=16)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.004 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.016 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.028 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.022 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.034 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.025 [stream.cc:1507] 618658 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.037 [npu_driver.cc:3833] 618775 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=3, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.039 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.051 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.044 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.041 [stream.cpp:87]618650 aclrtDestroyStream: aclrtDestroyStream success
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.053 [api_impl.cc:5058] 618775 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.070 [callback.cpp:132]618775 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.063 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.076 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.059 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.082 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.883.057 [stream.cc:237] 618662 FreeStreamId: Free stream_id=5.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.069 [stream_sqcq_manage.cc:451] 618658 FreeLogicCq: Return(0), threadIdentifier(281473716280800), devId(3), tsId(0), cqId(1041), isFastCq(0).
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.085 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.093 [npu_driver.cc:6163] 618658 StreamUnBindLogicCq: success: deviceId=3, tsId=0, streamId=3, logicCq=1041.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.088 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.100 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.092 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.883.094 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:137] UnRegCallback] Unregister callback thread, stream : 0xaaab322faa00.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.883.090 [stream_sqcq_manage.cc:216] 618662 DeAllocStreamSqCq: deviceId=4, tsId=0, drvFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.883.107 [npu_driver.cc:966] 618662 NormalSqCqFree: Normal sqcq free, sqId=5, cqId=5, device_id=4, tsId=0, drvFlag=0
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.100 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.130 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.132 [npu_driver.cc:1180] 618658 LogicCqFree: Succ:device_id=3,ts_id=0,type=2,logic_cq_id=1041, drvFlag=0.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.114 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.125 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.136 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.146 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.159 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.105 [callback.cpp:116]618828 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.121 [stream.cpp:75]618650 aclrtDestroyStream: start to execute aclrtDestroyStream
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.128 [subscribe.cc:308] 618828 GetGroupIdByThreadId: can not find subscribe info, threadId=281471881244576
[INFO] GE(618650,python3.9):2025-04-03-09:27:49.883.145 [stream_manage_func_registry.cc:22]618650 TryCallStreamMngFunc:Stream manage func is not found, FuncType is [0]
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.147 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.161 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.172 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.151 [api_impl.cc:5043] 618828 ProcessReport: get groupId fail, threadIdentifier=281471881244576, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.164 [stream.cpp:80]618650 aclrtDestroyStream: try to call stream manage function success, action type is DESTROY_STREAM.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.176 [callback.cpp:130]618828 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.172 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.186 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.186 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.199 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.188 [api_impl.cc:1228] 618650 StreamDestroy: stream_id=3.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.210 [acl_resource_manager.cpp:814]618650 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.198 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.210 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.221 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.213 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.225 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[INFO] GE(618650,python3.9):2025-04-03-09:27:49.883.224 [single_op_manager.cc:50]618650 ReleaseResource:ReleaseResource in. resource id = 0xaaab3242b9f0
[INFO] GE(618650,python3.9):2025-04-03-09:27:49.883.239 [caching_allocator.cc:402]618650 TryFreeBlocks:Try free blocks.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.236 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.238 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.252 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] GE(618650,python3.9):2025-04-03-09:27:49.883.252 [caching_allocator.cc:358]618650 FreeCachedBlocks:Free cached blocks
[INFO] GE(618650,python3.9):2025-04-03-09:27:49.883.263 [npu_memory_allocator.cc:72]618650 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.256 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.269 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.265 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.278 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[INFO] DEVICE(618650,ffff477eefa0,python3.9):2025-04-03-09:27:49.883.257 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/callback_thread.cc:42] callback_thread_func] Exit callback thread loop.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.280 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.293 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.288 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.300 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.275 [stream_executor.cpp:197]618650 RemoveExecutor: To remove executor by stream = 187652259363312
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.310 [acl_resource_manager.cpp:823]618650 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.304 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.317 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.327 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.311 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.324 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.337 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.322 [stream.cc:852] 618650 TearDown: stream_id=3, sqId=3, pendingNum=0, isForceRecycle_=0, flag=0, failMode=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.337 [stream.cc:938] 618650 TearDown: stream_id=3, delay recycle task num=0.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.340 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.353 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.350 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.349 [event.cc:1036] 618650 WaitForBusy: device_id=1, event_id=1 finished map already empty.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.362 [npu_driver.cc:626] 618650 EventIdFree: event id free begin, device_id=1, event_id=1, ts_id=0, remote_event_id=0
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.366 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.363 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.379 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.382 [raw_device.cc:1158] 618650 FreeEventIdFromDrv: device_id=1, event_id=1 tear down.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.378 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.391 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.393 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.395 [event.cc:61] 618650 ~Event: device_id=1, event deconstruct, recordSize=0, waitSize=0, idSize=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.411 [npu_driver.cc:3803] 618650 SqCqFree: deviceId=1, tsId=0, sqId=132, cqId=132
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.401 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.414 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.406 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.418 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.427 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.440 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.440 [subscribe.cc:244] 618650 Delete: delete callback subscribe: groupId=321, threadId=281471872790432, devId=1, tsId=0, streamId=3, sqId=132, cqId=132
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:49.883.448 [trs_sqcq.c:1491][ascend][curpid:618650,618829][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=1; type=1; ret=16)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.432 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.453 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.450 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.459 [stream.cc:1507] 618650 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.463 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.476 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.467 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.883.461 [stream.cc:185] [618666][HCCL_TRACE]StreamDestroy, streamPtr[0xaaab02237a80], stream id[4]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.883.481 [api_impl.cc:3717] 618666 ContextSetCurrent: set context=aaaaf6e2dcc0, flag=0.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.470 [npu_driver.cc:3833] 618829 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=1, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.483 [api_impl.cc:5058] 618829 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.483 [stream_sqcq_manage.cc:451] 618650 FreeLogicCq: Return(0), threadIdentifier(281473891839456), devId(1), tsId(0), cqId(403), isFastCq(0).
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.489 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.481 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.495 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.883.500 [adapter_rts.cc:321] [618666][hrtCtxSetCurrent] success
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.883.512 [stream.cc:193] [618666]Restore Ctx ret[0], setCtx[0xaaaaf6e2dcc0], stream id[4]
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.498 [callback.cpp:132]618829 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.506 [npu_driver.cc:6163] 618650 StreamUnBindLogicCq: success: deviceId=1, tsId=0, streamId=3, logicCq=403.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.511 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.503 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.516 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.527 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.508 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.522 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.533 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.883.545 [hcom_executor.cc:45] [618666][Finalize][HcomExecutor]Hcom Excutor Finalize end. ret[0]
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.525 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.539 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.542 [npu_driver.cc:1180] 618650 LogicCqFree: Succ:device_id=1,ts_id=0,type=2,logic_cq_id=403, drvFlag=0.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.552 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.564 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.540 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.560 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.573 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.545 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.559 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.570 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.582 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.575 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.586 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] HCCL_ADPT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.883.583 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:814] FinalizeHcclExec] HcclExec destroy success
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.586 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.600 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.610 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.593 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.606 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.617 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.613 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.625 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL_ADPT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.883.611 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:616] FinalizeKernelInfoStore] Start destroy hccl kernel info store.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.883.624 [hcom_ops_kernel_info_store.cc:3423] [618666]finalize hccl kernel info store.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.622 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.633 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.644 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.655 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.629 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.641 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.652 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.637 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.648 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.659 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.669 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.883.652 [hcom_common.cc:85] [618666][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[5] 
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.667 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.680 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.664 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.677 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.688 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.694 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.708 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.718 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.729 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.683 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.693 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.883.692 [plugin_manager.cc:56] [618666]hccl ops plugin finalize start.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.883.711 [hcom_plugin.cc:90] [618666]Finalize start.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.699 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.712 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.724 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.735 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.741 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.704 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.716 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.727 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.738 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.749 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.747 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.767 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.753 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.766 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.776 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.883.742 [npu_driver.cc:974] 618662 NormalSqCqFree: Normal sqcq free success, sqId=5, cqId=5, device_id=4, tsId=0, drvFlag=0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.761 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.772 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.782 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.781 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.883.773 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[0].isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.883.791 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.790 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.802 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.883.778 [stream_sqcq_manage.cc:228] 618662 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=5, cq_id=5, stream_id=5, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.883.799 [npu_driver.cc:432] 618662 StreamIdFree: stream id free begin, device_id=4, stream_id=5, ts_id=0, remote_stream_id=0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.796 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.808 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.796 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.810 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.823 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.883.807 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.883.820 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.883.831 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[1].isHcomInit is false.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.883.823 [npu_driver.cc:441] 618662 StreamIdFree: Stream id free success, stream_id=5, device_id=4, tsId=0, streamFlag=1536
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.814 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.825 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.837 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.847 [api_impl.cc:5043] 618823 ProcessReport: get groupId[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.822 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.833 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.844 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.856 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.836 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.850 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.862 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.883.842 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.883.856 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.883.870 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
 fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.869 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.880 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.868 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.879 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.890 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.905 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.874 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.888 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.899 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.910 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.921 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.883.883 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[2].isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.883.896 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.883.907 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.883.919 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.883.930 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[3].isHcomInit is false.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.893 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.906 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.917 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.929 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.940 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.917 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.927 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.939 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.935 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.950 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.883.944 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.883.954 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.953 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.965 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.883.977 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.948 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.960 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.883.971 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.982 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.883.963 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.976 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.883.987 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.883.967 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.883.980 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[4].isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.883.991 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.002 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.883.989 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.002 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.884.022 [stream.cc:185] [618674][HCCL_TRACE]StreamDestroy, streamPtr[0xaaab0c4c3470], stream id[5]
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.883.993 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.005 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.017 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.000 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.014 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.025 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.017 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.030 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[5].isHcomInit is false.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.014 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.029 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.041 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.884.046 [api_impl.cc:3717] 618674 ContextSetCurrent: set context=aaab0103b880, flag=0.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.053 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.068 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.080 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.095 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.031 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.043 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.055 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.066 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.037 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.049 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.061 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.073 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.043 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.057 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.068 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.080 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[6].isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.884.064 [adapter_rts.cc:321] [618674][hrtCtxSetCurrent] success
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.884.076 [stream.cc:193] [618674]Restore Ctx ret[0], setCtx[0xaaab0103b880], stream id[5]
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.107 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.080 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.093 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.103 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.114 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.097 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.112 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.123 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.098 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.110 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.120 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.132 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[7].isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.144 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.119 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.131 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.142 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.152 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.178 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.125 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.136 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.148 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.169 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.187 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.134 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.149 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.185 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.200 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.884.186 [api_impl.cc:3717] 618674 ContextSetCurrent: set context=aaab0103b880, flag=0.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.155 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.186 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.206 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[8].isHcomInit is false.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.201 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.216 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.214 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.226 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.237 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.219 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.232 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.244 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.884.212 [adapter_rts.cc:321] [618674][hrtCtxSetCurrent] success
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.884.224 [stream.cc:182] [618674]Switch Ctx ret[0], curCtx[0xaaab0103b880], setCtx[0xaaab0103b880], stream id[4]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.884.242 [api_impl.cc:1228] 618674 StreamDestroy: stream_id=4.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.220 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.234 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.246 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.258 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[9].isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.269 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.229 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.240 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.251 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.262 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.273 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.248 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.260 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.272 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.284 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.254 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.267 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.277 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.288 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.884.260 [acl_resource_manager.cpp:814]618674 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] GE(618674,python3.9):2025-04-03-09:27:49.884.276 [single_op_manager.cc:50]618674 ReleaseResource:ReleaseResource in. resource id = 0xaaab0c447410
[INFO] GE(618674,python3.9):2025-04-03-09:27:49.884.297 [caching_allocator.cc:402]618674 TryFreeBlocks:Try free blocks.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.300 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.313 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.324 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.335 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.345 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.280 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.293 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.303 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[10].isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.315 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.285 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.298 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.309 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.320 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.331 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.295 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.306 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.318 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.329 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.340 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] GE(618674,python3.9):2025-04-03-09:27:49.884.311 [caching_allocator.cc:358]618674 FreeCachedBlocks:Free cached blocks
[INFO] GE(618674,python3.9):2025-04-03-09:27:49.884.323 [npu_memory_allocator.cc:72]618674 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.884.352 [stream_executor.cpp:197]618674 RemoveExecutor: To remove executor by stream = 187651621942288
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.358 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.327 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.340 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.354 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[11].isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.368 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.344 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.357 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.368 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.379 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.390 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.352 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.363 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.374 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.384 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.395 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.884.370 [acl_resource_manager.cpp:823]618674 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.884.384 [stream.cc:852] 618674 TearDown: stream_id=4, sqId=4, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.884.401 [stream.cc:938] 618674 TearDown: stream_id=4, delay recycle task num=0.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.381 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.393 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.404 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[12].isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.416 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.374 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.388 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.399 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.410 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.402 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.414 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.425 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.406 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.418 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.429 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.884.413 [stream.cc:1507] 618674 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.884.444 [stream_sqcq_manage.cc:451] 618674 FreeLogicCq: Return(0), threadIdentifier(281473023856096), devId(7), tsId(0), cqId(334), isFastCq(0).
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.427 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.440 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.451 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[13].isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.463 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.435 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.450 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.463 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.436 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.450 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.461 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.471 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.440 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.453 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.464 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.479 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.884.464 [npu_driver.cc:6163] 618674 StreamUnBindLogicCq: success: deviceId=7, tsId=0, streamId=4, logicCq=334.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.476 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.487 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.498 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[14].isHcomInit is false.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.478 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.492 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.504 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.514 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.482 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.501 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.512 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.524 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.491 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.511 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.526 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.884.510 [npu_driver.cc:1180] 618674 LogicCqFree: Succ:device_id=7,ts_id=0,type=2,logic_cq_id=334, drvFlag=0.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.511 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.525 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.538 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.549 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[15].isHcomInit is false.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.528 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.540 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.551 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.536 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.551 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.566 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.537 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.550 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.564 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.563 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.575 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.587 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.566 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.580 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.593 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.604 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.578 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.590 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.602 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.613 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.575 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.586 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.598 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.609 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.601 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[16].isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.614 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.618 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.631 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.626 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.638 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.619 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.632 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.645 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.634 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.648 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.660 [hcom_plugin.cc:119] [618666]Finalize: HcomDestroy success.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.641 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.655 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.665 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.650 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.663 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.673 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.657 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.668 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.679 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.672 [plugin_manager.cc:62] [618666]hccl ops plugin finalize end. ret[0]
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.677 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.689 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.700 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.685 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.698 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.708 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.691 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.703 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.714 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.712 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.726 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.720 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.732 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL_ADPT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.884.732 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:638] FinalizeKernelInfoStore] Destroy hccl kernel info store success.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.725 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.737 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.748 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.739 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.764 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.744 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.756 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.768 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.777 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.789 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL_ADPT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.884.759 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:695] FinalizeHcclComm] Start finalize hccl comm.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.773 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[0].isHcomInit is false.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.759 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.770 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.782 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.781 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.794 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.787 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.799 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.809 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.800 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.817 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.795 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.815 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.826 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.814 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.828 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.820 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[1].isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.833 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.846 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.856 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.830 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.843 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.854 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.838 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.849 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.860 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.871 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.840 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.853 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.863 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.873 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.885 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.869 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[2].isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.883 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.867 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.884 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.899 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.883 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.896 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.908 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.898 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.912 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:49.884.877 [awatchdog_monitor.c:160](tid:618684) thread 618953 not exist
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:49.884.914 [awatchdog_monitor.c:160](tid:618684) thread 618955 not exist
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.925 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.937 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.948 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.959 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.895 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.909 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.920 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[3].isHcomInit is false.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.913 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.926 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.939 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.921 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.932 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.944 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:49.884.935 [awatchdog_monitor.c:160](tid:618684) thread 618954 not exist
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:49.884.953 [awatchdog_monitor.c:160](tid:618684) thread 618956 not exist
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.971 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.931 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.945 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.957 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.966 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[4].isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.976 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.884.987 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.950 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.884.966 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.978 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.884.989 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.957 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.968 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.884.980 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.884.991 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.884.983 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.884.996 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.006 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.002 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.012 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[5].isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.022 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.032 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.043 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.002 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.016 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.028 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.037 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.048 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.003 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.016 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.029 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.040 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.051 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.019 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.033 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.044 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.055 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.065 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.057 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[6].isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.067 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.059 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.073 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.062 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.074 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.086 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.097 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.076 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.089 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.108 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.090 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.102 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.113 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[7].isHcomInit is false.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.096 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.110 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.120 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.117 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.128 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.120 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.133 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.145 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.124 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.136 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.147 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.132 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.147 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.160 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.138 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.149 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.161 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.174 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.157 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.169 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.179 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.190 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.159 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[8].isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.173 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.183 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.193 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.176 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.189 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.201 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.186 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.196 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.208 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.204 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.217 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.205 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[9].isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.219 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.229 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.212 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.225 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.236 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.220 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.233 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.244 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.228 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.240 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.251 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.262 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.243 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.254 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[10].isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.264 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.249 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.262 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.275 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.255 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.267 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.279 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.274 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.288 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.885.279 [stream.cc:237] 618654 FreeStreamId: Free stream_id=5.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.276 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.291 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.305 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[11].isHcomInit is false.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.290 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.301 [stream.cc:237] 618658 FreeStreamId: Free stream_id=3.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.305 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.291 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.304 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.317 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.300 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.311 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.322 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.335 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.885.306 [stream_sqcq_manage.cc:216] 618654 DeAllocStreamSqCq: deviceId=2, tsId=0, drvFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.885.322 [npu_driver.cc:966] 618654 NormalSqCqFree: Normal sqcq free, sqId=5, cqId=5, device_id=2, tsId=0, drvFlag=0
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.318 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.330 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.341 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.352 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[12].isHcomInit is false.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.316 [stream_sqcq_manage.cc:216] 618658 DeAllocStreamSqCq: deviceId=3, tsId=0, drvFlag=0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.321 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.332 [npu_driver.cc:966] 618658 NormalSqCqFree: Normal sqcq free, sqId=3, cqId=3, device_id=3, tsId=0, drvFlag=0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.337 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.351 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.361 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.329 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.342 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.353 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.364 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.348 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.360 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.371 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.366 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.377 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.389 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.375 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.395 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.375 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.386 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.404 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.416 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.383 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.396 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.415 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.426 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.400 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[13].isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.412 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.424 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.435 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.409 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.422 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.433 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.429 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.440 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.438 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.450 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.447 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[14].isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.459 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.444 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.458 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.469 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.451 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.464 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.476 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.487 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.463 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.477 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.489 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.472 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.492 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.503 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[15].isHcomInit is false.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.480 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.494 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.505 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.500 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.513 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.499 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.514 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.524 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.515 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.527 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.538 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.517 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.531 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.543 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.524 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.536 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.547 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.538 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.551 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.562 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.550 [hcom_common.cc:958] [618666][Destroy][Result]hcomInfo[16].isHcomInit is false.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.563 [hcom_common.cc:961] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.574 [hcom.cc:337] [618666][Destroy][Result]hcomInfo.isHcomInit is false.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.554 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.567 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.577 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.557 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.569 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.580 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.591 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.573 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.587 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.597 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:49.885.586 [hcom.cc:340] [618666]Entry-HcomDestroy:void skip
[INFO] HCCL_ADPT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.885.609 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:377] FinalizeHccl] Destroy hccl adapter success.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.589 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.605 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.616 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.603 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.614 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.624 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.609 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.623 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.634 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.885.629 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:613] DestroyHccl] Hccl destroy successful.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.645 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.658 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.669 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.679 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.690 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.629 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.641 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.653 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.664 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.635 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.646 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.659 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.670 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.681 [callback.cpp:130]618829 aclrtProcessReport: no subscribe[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.703[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.676 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.689 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.707 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
report info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.696 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.709 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.720 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.727 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.739 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.720 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.734 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.744 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.754 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.731 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.742 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.758 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.766 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.753 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.766 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.778 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.770 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.784 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.779 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.792 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.789 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.799 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.787 [npu_driver.cc:974] 618658 NormalSqCqFree: Normal sqcq free success, sqId=3, cqId=3, device_id=3, tsId=0, drvFlag=0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.796 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.808 [stream_sqcq_manage.cc:228] 618658 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=3, cq_id=3, stream_id=3, is_sq_need_release=1, drvFlag=0.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.805 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.885.798 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	In used mem buf info for Mem buf allocator, is persistent : 1, stream id : 0., mem_bufs size : 1
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.813 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.826 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.815 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.825 [npu_driver.cc:432] 618658 StreamIdFree: stream id free begin, device_id=3, stream_id=3, ts_id=0, remote_stream_id=0
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.832 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.841 [npu_driver.cc:441] 618658 StreamIdFree: Stream id free success, stream_id=3, device_id=3, tsId=0, streamFlag=1536
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.817 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.831 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.843 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.885.822 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	In used mem buf info for Mem buf allocator, is persistent : 0, stream id : 0., mem_bufs size : 1
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.885.839 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] stream id : 0, is persistent : 0
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.885.855 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] Dump state info for Mem buf allocator, is persistent : 0, stream id : 0.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.836 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.849 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.859 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.846 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.862 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.853 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.866 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.877 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.885.871 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block info - total count : 1
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.885.886 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 		{"addr_":0x12d100000000,"size_":61027123200,"stream_id_":0,"min_addr_":0x12d100000000,"max_addr_":0x12d100000200}
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.870 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.882 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.893 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.873 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.885 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.898 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.911 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.890 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.901 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.912 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.885.900 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block total size : 61027123200
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.885.916 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Free mem buf total size : 0, total count : 0
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.885.931 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Eager free mem buf total size : 61027122688, total count : 1
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.903 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.914 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.927 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.922 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.935 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.945 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.925 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.939 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.950 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.885.947 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] stream id : 0, is persistent : 1
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.885.961 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] Dump state info for Mem buf allocator, is persistent : 1, stream id : 0.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.885.922 [stream.cc:185] [618662][HCCL_TRACE]StreamDestroy, streamPtr[0xaaab13a98190], stream id[5]
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.940 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.951 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.965 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.885.948 [npu_driver.cc:974] 618654 NormalSqCqFree: Normal sqcq free success, sqId=5, cqId=5, device_id=2, tsId=0, drvFlag=0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.885.959 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.979 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.963 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.885.976 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.988 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.885.975 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block info - total count : 1
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.886.001 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 		{"addr_":0x12c2c0000000,"size_":61027123200,"stream_id_":0,"min_addr_":0x12c2c0000000,"max_addr_":0x12c2c0000200}
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.885.959 [api_impl.cc:3717] 618662 ContextSetCurrent: set context=aaab087d6320, flag=0.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.885.983 [adapter_rts.cc:321] [618662][hrtCtxSetCurrent] success
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.885.998 [stream.cc:193] [618662]Restore Ctx ret[0], setCtx[0xaaab087d6320], stream id[5]
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.885.976 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.885.996 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.007 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.885.970 [stream_sqcq_manage.cc:228] 618654 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=5, cq_id=5, stream_id=5, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.885.989 [npu_driver.cc:432] 618654 StreamIdFree: stream id free begin, device_id=2, stream_id=5, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.886.005 [npu_driver.cc:441] 618654 StreamIdFree: Stream id free success, stream_id=5, device_id=2, tsId=0, streamFlag=1536
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.885.992 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.004 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.015 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.026 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.885.999 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.013 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.023 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.886.017 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block total size : 61027123200
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.886.033 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Free mem buf total size : 0, total count : 0
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.886.048 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Eager free mem buf total size : 61027122688, total count : 1
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.019 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.030 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.042 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.052 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.062 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.037 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.049 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.060 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.071 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.081 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.044 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.057 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.068 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.078 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.090 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.886.064 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] The dynamic memory pool[DefaultAscendMemoryPool] stat info : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":116400.00MB,"idle mem":116399.99MB,"used by event mem":0.00MB,"eager free mem":116399.99MB}, actual peak used mem:4M. Weight used size:0M, constant value used size:0M, kernel output used size:0M, other used size:0M.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.886.091 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:430] ReleaseDeviceRes] Release device resource for DefaultAscendMemoryPool : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":116400.00MB,"idle mem":116399.99MB,"used by event mem":0.00MB,"eager free mem":116399.99MB}.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.886.094 [stream.cc:237] 618674 FreeStreamId: Free stream_id=4.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.074 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.085 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.097 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.108 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.093 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.108 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.121 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.102 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.114 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.125 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.886.109 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:62] ReleaseDeviceRes] Release device resource for allocator, Mem buf allocator, is persistent : 0, stream id : 0., mem_blocks_ size : 1.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.886.129 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:65] ReleaseDeviceRes] Clean mem block : {"addr_":0x12d100000000,"size_":61027123200,"stream_id_":0,"min_addr_":0x12d100000000,"max_addr_":0x12d100000200}.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.886.115 [stream_sqcq_manage.cc:216] 618674 DeAllocStreamSqCq: deviceId=7, tsId=0, drvFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.886.128 [npu_driver.cc:966] 618674 NormalSqCqFree: Normal sqcq free, sqId=4, cqId=4, device_id=7, tsId=0, drvFlag=0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.122 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.133 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.143 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.154 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.135 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.148 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.158 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.886.144 [api_impl.cc:3717] 618662 ContextSetCurrent: set context=aaab087d6320, flag=0.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.136 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.149 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.161 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.172 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.886.144 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:191] FreeDeviceMem] Max actual used memory size is 4194304
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.886.162 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:194] FreeDeviceMem] Max peak used memory size is 1024
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.886.181 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:69] ReleaseDeviceRes] Delete mem block : {"addr_":0x12d100000000,"size_":61027123200,"stream_id_":0,"min_addr_":0x12d100000000,"max_addr_":0x12d100000200}.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.164 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.175 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.185 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.196 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.172 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.186 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.200 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.211 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.886.169 [adapter_rts.cc:321] [618662][hrtCtxSetCurrent] success
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.886.182 [stream.cc:182] [618662]Switch Ctx ret[0], curCtx[0xaaab087d6320], setCtx[0xaaab087d6320], stream id[4]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.886.214 [api_impl.cc:1228] 618662 StreamDestroy: stream_id=4.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.186 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.199 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.210 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.222 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.886.198 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:74] ReleaseDeviceRes] Free mem buf size : 0.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.886.214 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:80] ReleaseDeviceRes] Eager free mem buf size : 1.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.886.230 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:62] ReleaseDeviceRes] Release device resource for allocator, Mem buf allocator, is persistent : 1, stream id : 0., mem_blocks_ size : 1.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.208 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.220 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.230 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.241 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.226 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.237 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.249 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.886.234 [acl_resource_manager.cpp:814]618662 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.234 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.245 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.258 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.886.247 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:65] ReleaseDeviceRes] Clean mem block : {"addr_":0x12c2c0000000,"size_":61027123200,"stream_id_":0,"min_addr_":0x12c2c0000000,"max_addr_":0x12c2c0000200}.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.886.264 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:191] FreeDeviceMem] Max actual used memory size is 4194304
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.252 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.264 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.284 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.262 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.276 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.294 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] GE(618662,python3.9):2025-04-03-09:27:49.886.265 [single_op_manager.cc:50]618662 ReleaseResource:ReleaseResource in. resource id = 0xaaab13a1c130
[INFO] GE(618662,python3.9):2025-04-03-09:27:49.886.285 [caching_allocator.cc:402]618662 TryFreeBlocks:Try free blocks.
[INFO] GE(618662,python3.9):2025-04-03-09:27:49.886.300 [caching_allocator.cc:358]618662 FreeCachedBlocks:Free cached blocks
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.272 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.285 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.293 [stream.cc:237] 618670 FreeStreamId: Free stream_id=3.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.298 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.886.287 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:194] FreeDeviceMem] Max peak used memory size is 1024
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.886.307 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:69] ReleaseDeviceRes] Delete mem block : {"addr_":0x12c2c0000000,"size_":61027123200,"stream_id_":0,"min_addr_":0x12c2c0000000,"max_addr_":0x12c2c0000200}.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.886.321 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:74] ReleaseDeviceRes] Free mem buf size : 0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.310 [stream_sqcq_manage.cc:216] 618670 DeAllocStreamSqCq: deviceId=6, tsId=0, drvFlag=0
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.314 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.324 [npu_driver.cc:966] 618670 NormalSqCqFree: Normal sqcq free, sqId=3, cqId=3, device_id=6, tsId=0, drvFlag=0
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.338 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.352 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.296 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.310 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.321 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.332 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.311 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.325 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.337 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[INFO] GE(618662,python3.9):2025-04-03-09:27:49.886.315 [npu_memory_allocator.cc:72]618662 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.886.328 [stream_executor.cpp:197]618662 RemoveExecutor: To remove executor by stream = 187651745497392
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.886.342 [acl_resource_manager.cpp:823]618662 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.886.336 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:80] ReleaseDeviceRes] Eager free mem buf size : 1.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.886.353 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:45] ~MemBufAllocator] MemBufAllocator[0xfffe88100230] : Mem buf allocator, is persistent : 1, stream id : 0. deconstruct.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.364 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.343 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.355 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.366 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.377 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.348 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.363 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.373 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.385 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.395 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.886.373 [stream.cc:852] 618662 TearDown: stream_id=4, sqId=4, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.886.390 [stream.cc:938] 618662 TearDown: stream_id=4, delay recycle task num=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.886.402 [stream.cc:1507] 618662 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.886.371 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:45] ~MemBufAllocator] MemBufAllocator[0xfffe88100b20] : Mem buf allocator, is persistent : 0, stream id : 0. deconstruct.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.886.393 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:222] DeInitialize] Ascend Memory Adapter deinitialize success, statistics:
Device MOC memory size: 62420M
MindSpore Used memory size: 58200M
Used peak memory usage (without fragments): 0M
Actual peak memory usage (with fragments): 4M

[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.378 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.391 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.404 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.414 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.389 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.400 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.412 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.423 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.408 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.420 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.431 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.886.437 [stream_sqcq_manage.cc:451] 618662 FreeLogicCq: Return(0), threadIdentifier(281473748110816), devId(4), tsId(0), cqId(314), isFastCq(0).
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.886.414 [callback.cpp:37]618666 aclrtSetExceptionInfoCallback: start to execute aclrtSetExceptionInfoCallback.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.886.435 [callback.cpp:44]618666 aclrtSetExceptionInfoCallback: successfully execute aclrtSetExceptionInfoCallback
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.886.453 [context.cpp:72]618666 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.425 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.439 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.451 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.461 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.473 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.886.472 [api_impl.cc:3717] 618666 ContextSetCurrent: set context=aaaaf6e2dcc0, flag=0.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.886.489 [context.cpp:80]618666 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.433 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.445 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.457 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.469 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.442 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.455 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.466 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.476 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.488 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.886.457 [npu_driver.cc:6163] 618662 StreamUnBindLogicCq: success: deviceId=4, tsId=0, streamId=4, logicCq=314.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.487 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.502 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.886.503 [npu_driver.cc:1180] 618662 LogicCqFree: Succ:device_id=4,ts_id=0,type=2,logic_cq_id=314, drvFlag=0.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.886.503 [stream.cpp:75]618666 aclrtDestroyStream: start to execute aclrtDestroyStream
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.480 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.491 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.504 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.517 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.527 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.503 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.520 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.531 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.543 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.513 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.525 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.536 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.547 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.558 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] GE(618666,python3.9):2025-04-03-09:27:49.886.526 [stream_manage_func_registry.cc:22]618666 TryCallStreamMngFunc:Stream manage func is not found, FuncType is [0]
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.886.541 [stream.cpp:80]618666 aclrtDestroyStream: try to call stream manage function success, action type is DESTROY_STREAM.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.886.555 [api_impl.cc:1228] 618666 StreamDestroy: stream_id=2.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.886.568 [acl_resource_manager.cpp:814]618666 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.538 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.549 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.560 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.581 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.886.571 [npu_driver.cc:974] 618674 NormalSqCqFree: Normal sqcq free success, sqId=4, cqId=4, device_id=7, tsId=0, drvFlag=0
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.556 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.567 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.580 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-0[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.571 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.583 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.595 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] GE(618666,python3.9):2025-04-03-09:27:49.886.584 [single_op_manager.cc:50]618666 ReleaseResource:ReleaseResource in. resource id = 0xaaaaf7e7d290
[INFO] GE(618666,python3.9):2025-04-03-09:27:49.886.598 [caching_allocator.cc:402]618666 TryFreeBlocks:Try free blocks.
[INFO] GE(618666,python3.9):2025-04-03-09:27:49.886.609 [caching_allocator.cc:358]618666 FreeCachedBlocks:Free cached blocks
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.593 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.605 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.617 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.886.604 [stream.cc:185] [618654][HCCL_TRACE]StreamDestroy, streamPtr[0xaaab005099e0], stream id[5]
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.886.589 [stream_sqcq_manage.cc:228] 618674 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=4, cq_id=4, stream_id=4, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.886.602 [npu_driver.cc:432] 618674 StreamIdFree: stream id free begin, device_id=7, stream_id=4, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.886.619 [npu_driver.cc:441] 618674 StreamIdFree: Stream id free success, stream_id=4, device_id=7, tsId=0, streamFlag=1536
9:27:49.886.591 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.618 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.630 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.642 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.606 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.619 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.639 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] GE(618666,python3.9):2025-04-03-09:27:49.886.623 [npu_memory_allocator.cc:72]618666 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.886.636 [stream_executor.cpp:197]618666 RemoveExecutor: To remove executor by stream = 187651280327312
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.626 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.638 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.652 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.661 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.886.629 [api_impl.cc:3717] 618654 ContextSetCurrent: set context=aaaaf5082ff0, flag=0.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.886.646 [adapter_rts.cc:321] [618654][hrtCtxSetCurrent] success
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.886.660 [stream.cc:193] [618654]Restore Ctx ret[0], setCtx[0xaaaaf5082ff0], stream id[5]
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.656 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.668 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.678 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.691 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.653 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.665 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.677 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.688 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.886.658 [acl_resource_manager.cpp:823]618666 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.886.674 [stream.cc:852] 618666 TearDown: stream_id=2, sqId=2, pendingNum=0, isForceRecycle_=0, flag=0, failMode=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.886.690 [stream.cc:938] 618666 TearDown: stream_id=2, delay recycle task num=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.886.702 [event.cc:1036] 618666 WaitForBusy: device_id=5, event_id=0 finished map already empty.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.673 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.684 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.695 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.707 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.886.710 [api_impl.cc:3717] 618654 ContextSetCurrent: set context=aaaaf5082ff0, flag=0.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.704 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.717 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.700 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.711 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.722 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.733 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.886.717 [npu_driver.cc:626] 618666 EventIdFree: event id free begin, device_id=5, event_id=0, ts_id=0, remote_event_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.886.739 [raw_device.cc:1158] 618666 FreeEventIdFromDrv: device_id=5, event_id=0 tear down.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.718 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.730 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.742 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.753 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.886.729 [adapter_rts.cc:321] [618654][hrtCtxSetCurrent] success
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.886.745 [stream.cc:182] [618654]Switch Ctx ret[0], curCtx[0xaaaaf5082ff0], setCtx[0xaaaaf5082ff0], stream id[4]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.886.760 [api_impl.cc:1228] 618654 StreamDestroy: stream_id=4.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.730 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.746 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.759 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.771 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.744 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.757 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.768 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.778 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.886.751 [event.cc:61] 618666 ~Event: device_id=5, event deconstruct, recordSize=0, waitSize=0, idSize=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.886.768 [npu_driver.cc:3803] 618666 SqCqFree: deviceId=5, tsId=0, sqId=118, cqId=118
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.764 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.776 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.789 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.886.774 [acl_resource_manager.cpp:814]618654 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] GE(618654,python3.9):2025-04-03-09:27:49.886.790 [single_op_manager.cc:50]618654 ReleaseResource:ReleaseResource in. resource id = 0xaaab0048d980
[INFO] GE(618654,python3.9):2025-04-03-09:27:49.886.804 [caching_allocator.cc:402]618654 TryFreeBlocks:Try free blocks.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.785 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.797 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.807 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.820 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.791 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.803 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.814 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.825 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.886.802 [subscribe.cc:244] 618666 Delete: delete callback subscribe: groupId=64, threadId=281471193247648, devId=5, tsId=0, streamId=2, sqId=118, cqId=118
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:49.886.806 [trs_sqcq.c:1491][ascend][curpid:618666,618808][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.886.820 [stream.cc:1507] 618666 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.886.830 [npu_driver.cc:3833] 618808 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.799 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.811 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.822 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.834 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.886.847 [api_impl.cc:5058] 618808 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.886.846 [stream_sqcq_manage.cc:451] 618666 FreeLogicCq: Return(0), threadIdentifier(281473067970016), devId(5), tsId(0), cqId(359), isFastCq(0).
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.886.864 [callback.cpp:132]618808 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.886.872 [npu_driver.cc:6163] 618666 StreamUnBindLogicCq: success: deviceId=5, tsId=0, streamId=2, logicCq=359.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.886.879 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] GE(618654,python3.9):2025-04-03-09:27:49.886.820 [caching_allocator.cc:358]618654 FreeCachedBlocks:Free cached blocks
[INFO] GE(618654,python3.9):2025-04-03-09:27:49.886.835 [npu_memory_allocator.cc:72]618654 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.886.848 [stream_executor.cpp:197]618654 RemoveExecutor: To remove executor by stream = 187651420903808
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.835 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.848 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.838 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.850 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.850 [npu_driver.cc:974] 618670 NormalSqCqFree: Normal sqcq free success, sqId=3, cqId=3, device_id=6, tsId=0, drvFlag=0
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.863 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.846 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.864 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.876 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.889 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.886.897 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.886.865 [acl_resource_manager.cpp:823]618654 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.886.882 [stream.cc:852] 618654 TearDown: stream_id=4, sqId=4, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.886.898 [stream.cc:938] 618654 TearDown: stream_id=4, delay recycle task num=0.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.864 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.879 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.891 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.903 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.872 [stream_sqcq_manage.cc:228] 618670 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=3, cq_id=3, stream_id=3, is_sq_need_release=1, drvFlag=0.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.881 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.888 [npu_driver.cc:432] 618670 StreamIdFree: stream id free begin, device_id=6, stream_id=3, ts_id=0, remote_stream_id=0
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.895 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.917 [npu_driver.cc:441] 618670 StreamIdFree: Stream id free success, stream_id=3, device_id=6, tsId=0, streamFlag=1536
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.899 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.912 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.923 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.886.906 [npu_driver.cc:1180] 618666 LogicCqFree: Succ:device_id=5,ts_id=0,type=2,logic_cq_id=359, drvFlag=0.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.886.913 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.886.932 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.886.914 [stream.cc:1507] 618654 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.886.939 [stream_sqcq_manage.cc:451] 618654 FreeLogicCq: Return(0), threadIdentifier(281473077956064), devId(2), tsId(0), cqId(1000), isFastCq(0).
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.915 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.929 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.948 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.919 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.937 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.949 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.962 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.933 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.945 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.957 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.886.967 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.886.946 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.886.961 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.886.974 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.886.957 [npu_driver.cc:6163] 618654 StreamUnBindLogicCq: success: deviceId=2, tsId=0, streamId=4, logicCq=1000.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.963 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.886.976 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.886.989 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.886.975 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.987 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.886.998 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.979 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.886.991 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.004 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.016 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.011 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.022 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.033 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.044 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.886.989 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.017 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.886.991 [npu_driver.cc:1180] 618654 LogicCqFree: Succ:device_id=2,ts_id=0,type=2,logic_cq_id=1000, drvFlag=0.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.001 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.015 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.027 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.038 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.029 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.040 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.051 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.056 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.031 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.045 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.058 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.070 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.068 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.082 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.093 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.104 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.050 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.065 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.076 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.088 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.115 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.063 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.074 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.084 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.096 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.081 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.095 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.107 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.102 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.115 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.127 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.127 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.108 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.121 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.131 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.141 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.121 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.135 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.145 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.157 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.141 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.154 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.166 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.140 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.154 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.164 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.174 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.159 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.170 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.172 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.184 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.179 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.192 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.187 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.181 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.194 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.205 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.196 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.209 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.220 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.202 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.216 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.227 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.209 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.222 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.234 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.217 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.230 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.243 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.245 [stream.cc:237] 618650 FreeStreamId: Free stream_id=3.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.232 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.245 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.257 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.239 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.260 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.246 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.260 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.270 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.254 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.263 [stream_sqcq_manage.cc:216] 618650 DeAllocStreamSqCq: deviceId=1, tsId=0, drvFlag=0
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.265 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.276 [npu_driver.cc:966] 618650 NormalSqCqFree: Normal sqcq free, sqId=3, cqId=3, device_id=1, tsId=0, drvFlag=0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.268 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.282 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.292 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.273 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.286 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.296 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.283 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.296 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.307 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.283 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.297 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.310 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.321 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.304 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.316 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.309 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.324 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.337 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.318 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.332 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.342 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.333 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.343 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.335 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.347 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.358 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.350 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.362 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.374 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.354 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.366 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.377 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.354 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.367 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.379 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.389 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.370 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.383 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.394 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.386 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.399 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.410 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.388 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.402 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.414 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.402 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.414 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.404 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.417 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.428 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.426 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.439 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.426 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.441 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.452 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.431 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.442 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.455 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.441 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.456 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.468 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.452 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.467 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.479 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.463 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.475 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.485 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.469 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.481 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.493 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.481 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.494 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.506 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.491 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.506 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.497 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.523 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.504 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.515 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.526 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.519 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.532 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.543 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.516 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.530 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.541 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.551 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.535 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.549 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.536 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.547 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.559 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.555 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.567 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.564 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.584 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.561 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.573 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.585 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.570 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.582 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.593 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.604 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.579 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.590 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.602 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.612 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(61[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.597 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.609 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.621 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.632 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.597 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.611 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.622 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.634 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.615 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.627 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.639 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
8666,python3.9):2025-04-03-09:27:49.887.625 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.648 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.643 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.657 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.645 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.657 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.668 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.649 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.662 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.673 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.661 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.675 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.687 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.670 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.682 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.695 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.682 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.696 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.684 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.696 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.708 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.699 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.712 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.725 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.708 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.722 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.710 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.723 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.734 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.730 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.742 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.745 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.758 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.769 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.780 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.740 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.753 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.764 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.736 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.749 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.760 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.767 [event.cc:61] 618658 ~Event: device_id=3, event deconstruct, recordSize=0, waitSize=0, idSize=0
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.754 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.766 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.766 [npu_driver.cc:974] 618650 NormalSqCqFree: Normal sqcq free success, sqId=3, cqId=3, device_id=1, tsId=0, drvFlag=0
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.779 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.771 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.796 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.810 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.780 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.796 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.795 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.812 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe i[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.788 [stream_sqcq_manage.cc:228] 618650 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=3, cq_id=3, stream_id=3, is_sq_need_release=1, drvFlag=0.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.791 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.802 [npu_driver.cc:432] 618650 StreamIdFree: stream id free begin, device_id=1, stream_id=3, ts_id=0, remote_stream_id=0
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.806 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.810 [stream.cpp:87]618658 aclrtDestroyStream: aclrtDestroyStream success
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.825 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.810 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.824 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.836 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.887.831 [stream.cc:185] [618674][HCCL_TRACE]StreamDestroy, streamPtr[0xaaab0c447410], stream id[4]
nfo, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.835 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.850 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.817 [npu_driver.cc:441] 618650 StreamIdFree: Stream id free success, stream_id=3, device_id=1, tsId=0, streamFlag=1536
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.818 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.837 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.850 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.861 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.843 [callback.cpp:116]618775 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.857 [subscribe.cc:308] 618775 GetGroupIdByThreadId: can not find subscribe info, threadId=281471352827808
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.887.855 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:137] UnRegCallback] Unregister callback thread, stream : 0xaaab0bc3ae30.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.852 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.864 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.876 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.887.853 [api_impl.cc:3717] 618674 ContextSetCurrent: set context=aaab0103b880, flag=0.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.887.869 [adapter_rts.cc:321] [618674][hrtCtxSetCurrent] success
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.887.880 [stream.cc:193] [618674]Restore Ctx ret[0], setCtx[0xaaab0103b880], stream id[4]
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.863 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.876 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.887 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.873 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.886 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.896 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.869 [api_impl.cc:5043] 618775 ProcessReport: get groupId fail, threadIdentifier=281471352827808, reCode=0x7160004
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.884 [device.cpp:183]618658 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 3.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.899 [callback.cpp:130]618775 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.909 [api_impl.cc:3419] 618658 DeviceReset: reset device, device_id=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.922 [runtime.cc:3444] 618658 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x5, reset:0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.889 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.902 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.913 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.925 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.887.917 [hcom_executor.cc:45] [618674][Finalize][HcomExecutor]Hcom Excutor Finalize end. ret[0]
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.898 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.912 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.925 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.938 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.907 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.918 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.928 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.939 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.953 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.951 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.887.965 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.977 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.887.989 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:49.887.940 [api_impl.cc:3449] 618658 DeviceReset: Succ, userDeviceId=3.
[INFO] DEVICE(618658,ffff27ffefa0,python3.9):2025-04-03-09:27:49.887.951 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/callback_thread.cc:42] callback_thread_func] Exit callback thread loop.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.887.954 [device.cpp:189]618658 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 3.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.939 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.955 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.887.972 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] HCCL_ADPT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.887.977 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:814] FinalizeHcclExec] HcclExec destroy success
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.887.965 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.887.990 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.002 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.003 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.887.991 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:206] ReleaseDeviceRes] Ascend finalize end
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.985 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.887.998 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.010 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.021 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] HCCL_ADPT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.888.008 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:616] FinalizeKernelInfoStore] Start destroy hccl kernel info store.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.022 [hcom_ops_kernel_info_store.cc:3423] [618674]finalize hccl kernel info store.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.014 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.025 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.037 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.016 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.029 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.039 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.051 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.888.039 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] The dynamic memory pool[DefaultAscendMemoryPool] stat info : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":0.00MB,"idle mem":0.00MB,"used by event mem":0.00MB,"eager free mem":0.00MB}, actual peak used mem:4M. Weight used size:0M, constant value used size:0M, kernel output used size:0M, other used size:0M.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.032 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.044 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.057 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.068 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.080 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.043 [hcom_common.cc:85] [618674][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[7] 
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.070 [plugin_manager.cc:56] [618674]hccl ops plugin finalize start.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.048 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.060 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.071 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.083 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.097 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.063 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.075 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.086 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.096 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.107 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.888.067 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:430] ReleaseDeviceRes] Release device resource for DefaultAscendMemoryPool : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":0.00MB,"idle mem":0.00MB,"used by event mem":0.00MB,"eager free mem":0.00MB}.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.888.086 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:217] DeInitialize] DeInitialize Ascend Memory Adapter when it is not initialize
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.888.101 [callback.cpp:37]618658 aclrtSetExceptionInfoCallback: start to execute aclrtSetExceptionInfoCallback.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.092 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.106 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.117 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.091 [hcom_plugin.cc:90] [618674]Finalize start.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.120 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.135 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.154 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.110 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.121 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.133 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.143 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:49.888.118 [callback.cpp:44]618658 aclrtSetExceptionInfoCallback: successfully execute aclrtSetExceptionInfoCallback
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.888.141 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ascend_deprecated_interface.cc:118] CloseTsd] Start to close tsd, ref = 1
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.128 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.141 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.173 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.183 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.196 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.193 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.206 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.219 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.234 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.207 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.220 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.232 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.244 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.173 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.190 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.200 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:49.888.197 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel _npu_log begins the destruction process.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.205 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[0].isHcomInit is false.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.246 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.255 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.259 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.272 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.282 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.210 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.223 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.235 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.248 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.260 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.267 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.282 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.294 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.319 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.270 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.281 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.293 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.310 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.321 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.332 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.235 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.306 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.319 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.331 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[1].isHcomInit is false.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.295 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.341 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.335 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.346 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.343 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.354 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.342 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.354 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.366 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.357 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.368 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.357 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.370 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.382 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.367 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.378 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.390 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.378 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[2].isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.391 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.381 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.394 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.405 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.416 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.395 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.407 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.417 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.400 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.411 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.421 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.432 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.402 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.413 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.425 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[3].isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.438 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.429 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.442 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.429 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.444 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.456 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.444 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.457 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.448 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.459 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.473 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[4].isHcomInit is false.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.454 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.467 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.479 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.471 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.482 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.493 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.472 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.486 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.498 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.509 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.485 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.496 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.507 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.519 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[5].isHcomInit is false.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.490 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.501 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.520 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.504 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.518 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.529 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.521 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.534 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.531 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.542 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.535 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.547 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.543 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.557 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.569 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.545 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.557 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.569 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.583 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.552 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.562 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[6].isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.573 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.583 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.558 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.571 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.583 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.596 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.584 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.598 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.596 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.616 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.597 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.609 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[7].isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.620 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.610 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.623 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.612 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.626 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.628 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.640 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.630 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.642 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.652 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[8].isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.663 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.634 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.647 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.659 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.670 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.644 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.658 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.669 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.682 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.649 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.660 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.671 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.682 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.695 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.681 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.692 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.702 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[9].isHcomInit is false.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.684 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.696 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.709 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.696 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.708 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.720 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.707 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.718 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.728 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.713 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.723 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.735 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.749 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[10].isHcomInit is false.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.721 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.733 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.744 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.755 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.733 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.746 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.757 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.768 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.740 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.751 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.763 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.773 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.761 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.771 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.783 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.765 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.778 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.789 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.783 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.798 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.801 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.813 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.833 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.810 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.822 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.834 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.845 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.784 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.796 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.808 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.819 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.795 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[11].isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.807 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.817 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.827 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.844 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.856 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.858 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.830 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.841 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.851 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.863 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.839 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[12].isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.852 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.864 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.876 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.869 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.880 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.871 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.884 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.895 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.875 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.887 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.907 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.888 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[13].isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.900 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.910 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.893 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.907 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.919 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.909 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.920 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.933 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.919 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.934 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.922 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.936 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[14].isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.949 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.933 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.947 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.960 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.946 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.967 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.945 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.956 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.967 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.888.977 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.961 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.971 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.983 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[15].isHcomInit is false.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.888.974 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.986 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.888.997 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.888.980 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.888.993 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.003 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.988 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.888.999 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.010 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.888.994 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.005 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.016 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.889.008 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.889.022 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.889.033 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.014 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.027 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.039 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.020 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.032 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.042 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.028 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[16].isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.041 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.051 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.060 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.889.045 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.889.057 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.889.067 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.049 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.063 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.074 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.053 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.065 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.079 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.089 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.080 [hcom_plugin.cc:119] [618674]Finalize: HcomDestroy success.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.092 [plugin_manager.cc:62] [618674]hccl ops plugin finalize end. ret[0]
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.889.080 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.889.093 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.889.105 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.084 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.097 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.108 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.889.117 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.889.139 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.889.149 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.100 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.111 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.122 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.118 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.132 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.142 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.152 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.889.162 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.133 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.144 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.155 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.166 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.164 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.177 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL_ADPT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.889.177 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:638] FinalizeKernelInfoStore] Destroy hccl kernel info store success.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.889.174 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.889.187 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.178 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.197 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.190 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.203 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] HCCL_ADPT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.889.202 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:695] FinalizeHcclComm] Start finalize hccl comm.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.214 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[0].isHcomInit is false.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.889.198 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.889.211 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.889.222 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.889.233 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.208 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.220 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.230 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.242 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.227 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.238 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.249 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.259 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[1].isHcomInit is false.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.214 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.228 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.241 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.253 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.889.245 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.889.256 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.889.267 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.254 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.266 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.276 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.269 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.280 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.277 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.292 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.889.281 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.889.293 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.286 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.297 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.308 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.320 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.291 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.303 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[2].isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.315 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.325 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.305 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.320 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.332 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.342 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.889.306 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.889.318 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.889.330 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.889.340 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.889.350 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.355 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.366 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.376 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.334 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.345 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.357 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.335 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.348 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[3].isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.358 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.889.362 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.889.374 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.889.385 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.389 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.400 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.370 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.382 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.392 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.404 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.369 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.380 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.391 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[4].isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.402 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.413 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.889.397 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.889.408 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.889.419 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.413 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.426 [stream.cc:237] 618666 FreeStreamId: Free stream_id=2.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.427 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.415 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.428 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.438 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.425 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.435 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[5].isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.445 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.889.437 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.889.452 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.889.455 [event.cc:61] 618670 ~Event: device_id=6, event deconstruct, recordSize=0, waitSize=0, idSize=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.443 [stream_sqcq_manage.cc:216] 618666 DeAllocStreamSqCq: deviceId=5, tsId=0, drvFlag=0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.448 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.459 [npu_driver.cc:966] 618666 NormalSqCqFree: Normal sqcq free, sqId=2, cqId=2, device_id=5, tsId=0, drvFlag=0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.464 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.481 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.450 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.461 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.481 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.456 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.468 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.479 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[6].isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.489 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.889.462 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.889.483 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.889.495 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.889.500 [stream.cpp:87]618670 aclrtDestroyStream: aclrtDestroyStream success
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.494 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.508 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.495 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.509 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.498 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.510 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.889.508 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.889.523 [callback.cpp:116]618823 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.889.534 [subscribe.cc:308] 618823 GetGroupIdByThreadId: can not find subscribe info, threadId=281471537246112
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.521 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.534 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.545 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.522 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.535 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.548 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.559 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.542 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[7].isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.553 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.565 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.889.537 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:137] UnRegCallback] Unregister callback thread, stream : 0xaaaadaafcb60.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:49.889.547 [api_impl.cc:5043] 618823 ProcessReport: get groupId fail, threadIdentifier=281471537246112, reCode=0x7160004
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.889.564 [callback.cpp:130]618823 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.889.563 [device.cpp:183]618670 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 6.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.556 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.579 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.591 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.570 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.581 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.592 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.577 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.587 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[8].isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.598 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.889.588 [api_impl.cc:3419] 618670 DeviceReset: reset device, device_id=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.889.602 [runtime.cc:3444] 618670 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x5, reset:0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:49.889.617 [api_impl.cc:3449] 618670 DeviceReset: Succ, userDeviceId=6.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.605 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.618 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.605 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.617 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.628 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.638 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.606 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.620 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.632 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[9].isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.643 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.652 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] DEVICE(618670,ffff32fdefa0,python3.9):2025-04-03-09:27:49.889.615 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/callback_thread.cc:42] callback_thread_func] Exit callback thread loop.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.889.632 [device.cpp:189]618670 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 6.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.889.658 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:206] ReleaseDeviceRes] Ascend finalize end
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.634 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.646 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.657 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.669 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.649 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.660 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.671 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.663 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.674 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[10].isHcomInit is false.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.683 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.697 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.889.668 [stream.cc:237] 618662 FreeStreamId: Free stream_id=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.889.704 [stream_sqcq_manage.cc:216] 618662 DeAllocStreamSqCq: deviceId=4, tsId=0, drvFlag=0
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.889.700 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] The dynamic memory pool[DefaultAscendMemoryPool] stat info : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":0.00MB,"idle mem":0.00MB,"used by event mem":0.00MB,"eager free mem":0.00MB}, actual peak used mem:4M. Weight used size:0M, constant value used size:0M, kernel output used size:0M, other used size:0M.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.682 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.695 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.706 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.685 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.698 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.709 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.720 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[11].isHcomInit is false.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.711 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.723 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.733 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.889.723 [npu_driver.cc:966] 618662 NormalSqCqFree: Normal sqcq free, sqId=4, cqId=4, device_id=4, tsId=0, drvFlag=0
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.889.728 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:430] ReleaseDeviceRes] Release device resource for DefaultAscendMemoryPool : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":0.00MB,"idle mem":0.00MB,"used by event mem":0.00MB,"eager free mem":0.00MB}.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.717 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.728 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.742 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.754 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.731 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.742 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.752 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.763 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[12].isHcomInit is false.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.745 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.756 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.769 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.889.759 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:217] DeInitialize] DeInitialize Ascend Memory Adapter when it is not initialize
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.889.774 [callback.cpp:37]618670 aclrtSetExceptionInfoCallback: start to execute aclrtSetExceptionInfoCallback.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.765 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.781 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.794 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.804 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.772 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.783 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.796 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.806 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[13].isHcomInit is false.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.781 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.796 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.808 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.819 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:49.889.790 [callback.cpp:44]618670 aclrtSetExceptionInfoCallback: successfully execute aclrtSetExceptionInfoCallback
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.889.813 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ascend_deprecated_interface.cc:118] CloseTsd] Start to close tsd, ref = 1
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.814 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.827 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.838 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.817 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.828 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.839 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.831 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.844 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.855 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:49.889.836 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel _npu_log begins the destruction process.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.851 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.862 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.872 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.849 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[14].isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.860 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.870 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.883 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.867 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.878 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.896 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.882 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.895 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.907 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.896 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[15].isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.914 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.907 [npu_driver.cc:974] 618666 NormalSqCqFree: Normal sqcq free success, sqId=2, cqId=2, device_id=5, tsId=0, drvFlag=0
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.910 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.924 [stream_sqcq_manage.cc:228] 618666 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=2, cq_id=2, stream_id=2, is_sq_need_release=1, drvFlag=0.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.930 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.917 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.929 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.939 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.925 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.936 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.947 [hcom_common.cc:958] [618674][Destroy][Result]hcomInfo[16].isHcomInit is false.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.939 [npu_driver.cc:432] 618666 StreamIdFree: stream id free begin, device_id=5, stream_id=2, ts_id=0, remote_stream_id=0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.946 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.956 [npu_driver.cc:441] 618666 StreamIdFree: Stream id free success, stream_id=2, device_id=5, tsId=0, streamFlag=1536
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.960 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.950 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.961 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.974 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.961 [hcom_common.cc:961] [618674]Entry-HcomDestroy:void skip
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.972 [hcom.cc:337] [618674][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:49.889.983 [hcom.cc:340] [618674]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.889.975 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.989 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.889.999 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.889.984 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.889.996 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.890.006 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL_ADPT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.006 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:377] FinalizeHccl] Destroy hccl adapter success.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.013 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.024 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.890.018 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.890.029 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.026 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:613] DestroyHccl] Hccl destroy successful.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.039 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.050 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.890.040 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.890.051 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.890.067 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.064 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.076 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.087 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.890.078 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.890.090 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.890.100 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.098 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.890.113 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.112 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.125 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.890.123 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.890.119 [event.cc:61] 618650 ~Event: device_id=1, event deconstruct, recordSize=0, waitSize=0, idSize=0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.138 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.890.133 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.890.146 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.150 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.890.157 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.172 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.890.165 [stream.cpp:87]618650 aclrtDestroyStream: aclrtDestroyStream success
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.890.167 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.890.180 [npu_driver.cc:974] 618662 NormalSqCqFree: Normal sqcq free success, sqId=4, cqId=4, device_id=4, tsId=0, drvFlag=0
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.187 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.201 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.890.185 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.890.198 [callback.cpp:116]618829 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.890.200 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:137] UnRegCallback] Unregister callback thread, stream : 0xaaab3242b9f0.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.890.210 [subscribe.cc:308] 618829 GetGroupIdByThreadId: can not find subscribe info, threadId=281471872790432
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.890.203 [stream_sqcq_manage.cc:228] 618662 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=4, cq_id=4, stream_id=4, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.890.222 [npu_driver.cc:432] 618662 StreamIdFree: stream id free begin, device_id=4, stream_id=4, ts_id=0, remote_stream_id=0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.212 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.224 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.237 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:49.890.221 [api_impl.cc:5043] 618829 ProcessReport: get groupId fail, threadIdentifier=281471872790432, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.890.220 [device.cpp:183]618650 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 1.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.890.232 [callback.cpp:130]618829 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.890.241 [api_impl.cc:3419] 618650 DeviceReset: reset device, device_id=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.890.244 [npu_driver.cc:441] 618662 StreamIdFree: Stream id free success, stream_id=4, device_id=4, tsId=0, streamFlag=1536
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.250 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.890.255 [runtime.cc:3444] 618650 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x5, reset:0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:49.890.268 [api_impl.cc:3449] 618650 DeviceReset: Succ, userDeviceId=1.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.263 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.276 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.890.279 [device.cpp:189]618650 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 1.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.287 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.300 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] DEVICE(618650,ffff46fdefa0,python3.9):2025-04-03-09:27:49.890.289 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/callback_thread.cc:42] callback_thread_func] Exit callback thread loop.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.890.304 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:206] ReleaseDeviceRes] Ascend finalize end
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.311 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.324 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.338 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.348 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.360 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.890.362 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] The dynamic memory pool[DefaultAscendMemoryPool] stat info : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":0.00MB,"idle mem":0.00MB,"used by event mem":0.00MB,"eager free mem":0.00MB}, actual peak used mem:4M. Weight used size:0M, constant value used size:0M, kernel output used size:0M, other used size:0M.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.374 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.386 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.890.390 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:430] ReleaseDeviceRes] Release device resource for DefaultAscendMemoryPool : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":0.00MB,"idle mem":0.00MB,"used by event mem":0.00MB,"eager free mem":0.00MB}.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.398 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.890.409 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:217] DeInitialize] DeInitialize Ascend Memory Adapter when it is not initialize
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.412 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.425 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.890.422 [callback.cpp:37]618650 aclrtSetExceptionInfoCallback: start to execute aclrtSetExceptionInfoCallback.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.438 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:49.890.438 [callback.cpp:44]618650 aclrtSetExceptionInfoCallback: successfully execute aclrtSetExceptionInfoCallback
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.449 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.463 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.890.461 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ascend_deprecated_interface.cc:118] CloseTsd] Start to close tsd, ref = 1
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:49.890.482 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel _npu_log begins the destruction process.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.477 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.494 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.503 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.511 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.524 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.536 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.549 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.561 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.558 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	In used mem buf info for Mem buf allocator, is persistent : 1, stream id : 0., mem_bufs size : 1
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.574 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.581 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	In used mem buf info for Mem buf allocator, is persistent : 0, stream id : 0., mem_bufs size : 1
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.586 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.595 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] stream id : 0, is persistent : 0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.599 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.609 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] Dump state info for Mem buf allocator, is persistent : 0, stream id : 0.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.613 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.622 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block info - total count : 1
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.628 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.635 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 		{"addr_":0x12d100000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12d100000000,"max_addr_":0x12d100000200}
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.642 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.648 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block total size : 61029220352
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.662 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Free mem buf total size : 0, total count : 0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.655 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.668 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.680 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.675 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Eager free mem buf total size : 61029219840, total count : 1
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.688 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] stream id : 0, is persistent : 1
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.692 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.702 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] Dump state info for Mem buf allocator, is persistent : 1, stream id : 0.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.706 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.715 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block info - total count : 1
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.721 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.728 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 		{"addr_":0x12c2c0000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12c2c0000000,"max_addr_":0x12c2c0000200}
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.735 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.890.699 [stream.cc:237] 618654 FreeStreamId: Free stream_id=4.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.890.725 [stream_sqcq_manage.cc:216] 618654 DeAllocStreamSqCq: deviceId=2, tsId=0, drvFlag=0
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.747 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.754 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block total size : 61029220352
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.890.764 [npu_driver.cc:966] 618654 NormalSqCqFree: Normal sqcq free, sqId=4, cqId=4, device_id=2, tsId=0, drvFlag=0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.760 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.770 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.770 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Free mem buf total size : 0, total count : 0
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.784 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Eager free mem buf total size : 61029219840, total count : 1
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.785 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.803 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.797 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] The dynamic memory pool[DefaultAscendMemoryPool] stat info : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":116404.00MB,"idle mem":116403.99MB,"used by event mem":0.00MB,"eager free mem":116403.99MB}, actual peak used mem:4M. Weight used size:0M, constant value used size:0M, kernel output used size:0M, other used size:0M.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.816 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.828 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.823 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:430] ReleaseDeviceRes] Release device resource for DefaultAscendMemoryPool : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":116404.00MB,"idle mem":116403.99MB,"used by event mem":0.00MB,"eager free mem":116403.99MB}.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.841 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.840 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:62] ReleaseDeviceRes] Release device resource for allocator, Mem buf allocator, is persistent : 0, stream id : 0., mem_blocks_ size : 1.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.855 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.857 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:65] ReleaseDeviceRes] Clean mem block : {"addr_":0x12d100000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12d100000000,"max_addr_":0x12d100000200}.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.868 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.873 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:191] FreeDeviceMem] Max actual used memory size is 4194304
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.879 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.887 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:194] FreeDeviceMem] Max peak used memory size is 1024
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.890.873 [stream.cc:185] [618662][HCCL_TRACE]StreamDestroy, streamPtr[0xaaab13a1c130], stream id[4]
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.890.897 [api_impl.cc:3717] 618662 ContextSetCurrent: set context=aaab087d6320, flag=0.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.893 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.903 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:69] ReleaseDeviceRes] Delete mem block : {"addr_":0x12d100000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12d100000000,"max_addr_":0x12d100000200}.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.907 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.921 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.933 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.890.917 [adapter_rts.cc:321] [618662][hrtCtxSetCurrent] success
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.917 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:74] ReleaseDeviceRes] Free mem buf size : 0.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.930 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:80] ReleaseDeviceRes] Eager free mem buf size : 1.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.890.935 [stream.cc:193] [618662]Restore Ctx ret[0], setCtx[0xaaab087d6320], stream id[4]
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.946 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.946 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:62] ReleaseDeviceRes] Release device resource for allocator, Mem buf allocator, is persistent : 1, stream id : 0., mem_blocks_ size : 1.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.961 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:65] ReleaseDeviceRes] Clean mem block : {"addr_":0x12c2c0000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12c2c0000000,"max_addr_":0x12c2c0000200}.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.957 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.969 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.976 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:191] FreeDeviceMem] Max actual used memory size is 4194304
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.890.980 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.890.989 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:194] FreeDeviceMem] Max peak used memory size is 1024
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.890.985 [hcom_executor.cc:45] [618662][Finalize][HcomExecutor]Hcom Excutor Finalize end. ret[0]
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.890.994 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.010 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.891.013 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:69] ReleaseDeviceRes] Delete mem block : {"addr_":0x12c2c0000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12c2c0000000,"max_addr_":0x12c2c0000200}.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.025 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.891.030 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:74] ReleaseDeviceRes] Free mem buf size : 0.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.038 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL_ADPT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.891.024 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:814] FinalizeHcclExec] HcclExec destroy success
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.891.046 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:80] ReleaseDeviceRes] Eager free mem buf size : 1.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.050 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.062 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.891.061 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:45] ~MemBufAllocator] MemBufAllocator[0xfffe84100230] : Mem buf allocator, is persistent : 1, stream id : 0. deconstruct.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.891.078 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:45] ~MemBufAllocator] MemBufAllocator[0xfffe84100b20] : Mem buf allocator, is persistent : 0, stream id : 0. deconstruct.
[INFO] HCCL_ADPT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.891.053 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:616] FinalizeKernelInfoStore] Start destroy hccl kernel info store.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.073 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.085 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.098 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.891.100 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:222] DeInitialize] Ascend Memory Adapter deinitialize success, statistics:
Device MOC memory size: 62420M
MindSpore Used memory size: 58202M
Used peak memory usage (without fragments): 0M
Actual peak memory usage (with fragments): 4M

[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.093 [hcom_ops_kernel_info_store.cc:3423] [618662]finalize hccl kernel info store.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.112 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.134 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.128 [callback.cpp:37]618674 aclrtSetExceptionInfoCallback: start to execute aclrtSetExceptionInfoCallback.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.129 [hcom_common.cc:85] [618662][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[4] 
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.148 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.148 [callback.cpp:44]618674 aclrtSetExceptionInfoCallback: successfully execute aclrtSetExceptionInfoCallback
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.154 [plugin_manager.cc:56] [618662]hccl ops plugin finalize start.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.163 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.170 [context.cpp:72]618674 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.173 [hcom_plugin.cc:90] [618662]Finalize start.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.176 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.189 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.185 [api_impl.cc:3717] 618674 ContextSetCurrent: set context=aaab0103b880, flag=0.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.199 [context.cpp:80]618674 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.201 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.214 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.224 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.213 [stream.cpp:75]618674 aclrtDestroyStream: start to execute aclrtDestroyStream
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.891.211 [npu_driver.cc:974] 618654 NormalSqCqFree: Normal sqcq free success, sqId=4, cqId=4, device_id=2, tsId=0, drvFlag=0
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.237 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] GE(618674,python3.9):2025-04-03-09:27:49.891.232 [stream_manage_func_registry.cc:22]618674 TryCallStreamMngFunc:Stream manage func is not found, FuncType is [0]
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.243 [stream.cpp:80]618674 aclrtDestroyStream: try to call stream manage function success, action type is DESTROY_STREAM.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.250 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.261 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.891.232 [stream_sqcq_manage.cc:228] 618654 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=4, cq_id=4, stream_id=4, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.891.252 [npu_driver.cc:432] 618654 StreamIdFree: stream id free begin, device_id=2, stream_id=4, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.255 [api_impl.cc:1228] 618674 StreamDestroy: stream_id=2.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.255 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[0].isHcomInit is false.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.274 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.891.271 [npu_driver.cc:441] 618654 StreamIdFree: Stream id free success, stream_id=4, device_id=2, tsId=0, streamFlag=1536
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.268 [acl_resource_manager.cpp:814]618674 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] GE(618674,python3.9):2025-04-03-09:27:49.891.281 [single_op_manager.cc:50]618674 ReleaseResource:ReleaseResource in. resource id = 0xaaab0208b2f0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.273 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.290 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.286 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.298 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.310 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] GE(618674,python3.9):2025-04-03-09:27:49.891.294 [caching_allocator.cc:402]618674 TryFreeBlocks:Try free blocks.
[INFO] GE(618674,python3.9):2025-04-03-09:27:49.891.305 [caching_allocator.cc:358]618674 FreeCachedBlocks:Free cached blocks
[INFO] GE(618674,python3.9):2025-04-03-09:27:49.891.317 [npu_memory_allocator.cc:72]618674 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.302 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.328 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[1].isHcomInit is false.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.322 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.333 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.344 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.327 [stream_executor.cpp:197]618674 RemoveExecutor: To remove executor by stream = 187651450254064
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.338 [acl_resource_manager.cpp:823]618674 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.343 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.357 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.358 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.351 [stream.cc:852] 618674 TearDown: stream_id=2, sqId=2, pendingNum=0, isForceRecycle_=0, flag=0, failMode=1.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.370 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.383 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.370 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.374 [stream.cc:938] 618674 TearDown: stream_id=2, delay recycle task num=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.390 [event.cc:1036] 618674 WaitForBusy: device_id=7, event_id=0 finished map already empty.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.394 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.390 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[2].isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.405 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.404 [npu_driver.cc:626] 618674 EventIdFree: event id free begin, device_id=7, event_id=0, ts_id=0, remote_event_id=0
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.416 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.429 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.409 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.422 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.426 [raw_device.cc:1158] 618674 FreeEventIdFromDrv: device_id=7, event_id=0 tear down.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.434 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.457 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.470 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.442 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[3].isHcomInit is false.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.439 [event.cc:61] 618674 ~Event: device_id=7, event deconstruct, recordSize=0, waitSize=0, idSize=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.454 [npu_driver.cc:3803] 618674 SqCqFree: deviceId=7, tsId=0, sqId=116, cqId=116
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.482 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.496 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.456 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.468 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.479 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.489 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[4].isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.500 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.487 [subscribe.cc:244] 618674 Delete: delete callback subscribe: groupId=64, threadId=281471008829344, devId=7, tsId=0, streamId=2, sqId=116, cqId=116
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:49.891.488 [trs_sqcq.c:1491][ascend][curpid:618674,618818][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.504 [stream.cc:1507] 618674 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.510 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.514 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.526 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.511 [npu_driver.cc:3833] 618818 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=64, drvRetCode=16.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.524 [api_impl.cc:5058] 618818 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.523 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.538 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.539 [callback.cpp:132]618818 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.544 [stream_sqcq_manage.cc:451] 618674 FreeLogicCq: Return(0), threadIdentifier(281473023856096), devId(7), tsId(0), cqId(332), isFastCq(0).
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.552 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.549 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.562 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.553 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[5].isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.570 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.561 [npu_driver.cc:6163] 618674 StreamUnBindLogicCq: success: deviceId=7, tsId=0, streamId=2, logicCq=332.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.565 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.583 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.595 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.577 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.588 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.578 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.592 [npu_driver.cc:1180] 618674 LogicCqFree: Succ:device_id=7,ts_id=0,type=2,logic_cq_id=332, drvFlag=0.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.596 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.600 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.613 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.611 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.622 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.618 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[6].isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.634 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.625 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.633 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.649 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.638 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.651 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.650 [stream.cpp:87]618666 aclrtDestroyStream: aclrtDestroyStream success
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.644 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.655 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.661 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.663 [callback.cpp:116]618808 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.681 [subscribe.cc:308] 618808 GetGroupIdByThreadId: can not find subscribe info, threadId=281471193247648
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.666 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.687 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.694 [api_impl.cc:5043] 618808 ProcessReport: get groupId fail, threadIdentifier=281471193247648, reCode=0x7160004
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.891.699 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:137] UnRegCallback] Unregister callback thread, stream : 0xaaaaf7e7d290.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.705 [callback.cpp:130]618808 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.685 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[7].isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.716 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.698 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.711 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.719 [stream.cpp:75]618666 aclrtDestroyStream: start to execute aclrtDestroyStream
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.729 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.722 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.734 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.742 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.744 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.756 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] GE(618666,python3.9):2025-04-03-09:27:49.891.739 [stream_manage_func_registry.cc:22]618666 TryCallStreamMngFunc:Stream manage func is not found, FuncType is [0]
[INFO] ASCENDCL(618666,python[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.767 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.777 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
3.9):2025-04-03-09:27:49.891.752 [stream.cpp:80]618666 aclrtDestroyStream: try to call stream manage function success, action type is DESTROY_STREAM.
[INFO] DEVICE(618666,ffff1e7cefa0,python3.9):2025-04-03-09:27:49.891.776 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/callback_thread.cc:42] callback_thread_func] Exit callback thread loop.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.771 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[8].isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.788 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.789 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.791 [api_impl.cc:1228] 618666 StreamDestroy: stream_id=3.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.809 [acl_resource_manager.cpp:814]618666 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.802 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.816 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.801 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.812 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.823 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] GE(618666,python3.9):2025-04-03-09:27:49.891.822 [single_op_manager.cc:50]618666 ReleaseResource:ReleaseResource in. resource id = 0xaaaaf7fac160
[INFO] GE(618666,python3.9):2025-04-03-09:27:49.891.837 [caching_allocator.cc:402]618666 TryFreeBlocks:Try free blocks.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.840 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[9].isHcomInit is false.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.834 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.845 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] GE(618666,python3.9):2025-04-03-09:27:49.891.851 [caching_allocator.cc:358]618666 FreeCachedBlocks:Free cached blocks
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.855 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.856 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.869 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] GE(618666,python3.9):2025-04-03-09:27:49.891.862 [npu_memory_allocator.cc:72]618666 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.875 [stream_executor.cpp:197]618666 RemoveExecutor: To remove executor by stream = 187651281568096
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.867 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.883 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.881 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.891 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.891.887 [acl_resource_manager.cpp:823]618666 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.901 [stream.cc:852] 618666 TearDown: stream_id=3, sqId=3, pendingNum=0, isForceRecycle_=0, flag=0, failMode=1.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.902 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.914 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.917 [stream.cc:938] 618666 TearDown: stream_id=3, delay recycle task num=0.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.924 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.934 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.926 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[10].isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.943 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.930 [event.cc:1036] 618666 WaitForBusy: device_id=5, event_id=1 finished map already empty.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.944 [npu_driver.cc:626] 618666 EventIdFree: event id free begin, device_id=5, event_id=1, ts_id=0, remote_event_id=0
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.946 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.957 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.968 [raw_device.cc:1158] 618666 FreeEventIdFromDrv: device_id=5, event_id=1 tear down.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.891.968 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.981 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.970 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.891.974 [stream.cc:185] [618654][HCCL_TRACE]StreamDestroy, streamPtr[0xaaab0048d980], stream id[4]
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.891.994 [api_impl.cc:3717] 618654 ContextSetCurrent: set context=aaaaf5082ff0, flag=0.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.891.992 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.982 [event.cc:61] 618666 ~Event: device_id=5, event deconstruct, recordSize=0, waitSize=0, idSize=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.891.996 [npu_driver.cc:3803] 618666 SqCqFree: deviceId=5, tsId=0, sqId=119, cqId=119
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.891.997 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[11].isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.013 [adapter_rts.cc:321] [618654][hrtCtxSetCurrent] success
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.003 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.013 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.013 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.027 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.038 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.028 [stream.cc:193] [618654]Restore Ctx ret[0], setCtx[0xaaaaf5082ff0], stream id[4]
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.029 [subscribe.cc:244] 618666 Delete: delete callback subscribe: groupId=65, threadId=281471184793504, devId=5, tsId=0, streamId=3, sqId=119, cqId=119
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:49.892.037 [trs_sqcq.c:1491][ascend][curpid:618666,618809][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=5; type=1; ret=16)
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.025 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.036 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.048 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.059 [hcom_executor.cc:45] [618654][Finalize][HcomExecutor]Hcom Excutor Finalize end. ret[0]
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.062 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[12].isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.080 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.047 [stream.cc:1507] 618666 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.058 [npu_driver.cc:3833] 618809 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=5, tsId=0, groupId=65, drvRetCode=16.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.073 [stream_sqcq_manage.cc:451] 618666 FreeLogicCq: Return(0), threadIdentifier(281473067970016), devId(5), tsId(0), cqId(360), isFastCq(0).
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.077 [api_impl.cc:5058] 618809 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.059 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.070 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.081 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.095 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.092 [npu_driver.cc:6163] 618666 StreamUnBindLogicCq: success: deviceId=5, tsId=0, streamId=3, logicCq=360.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.098 [callback.cpp:132]618809 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.093 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.106 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] HCCL_ADPT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.892.100 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:814] FinalizeHcclExec] HcclExec destroy success
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.109 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.117 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.128 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.114 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.123 [npu_driver.cc:1180] 618666 LogicCqFree: Succ:device_id=5,ts_id=0,type=2,logic_cq_id=360, drvFlag=0.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.143 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.137 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[13].isHcomInit is false.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.140 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.152 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.150 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.183 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.192 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.175 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.187 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.198 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.209 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.221 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.214 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[14].isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.231 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.217 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.232 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL_ADPT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.892.127 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:616] FinalizeKernelInfoStore] Start destroy hccl kernel info store.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.142 [hcom_ops_kernel_info_store.cc:3423] [618654]finalize hccl kernel info store.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.246 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.238 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.252 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.245 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.255 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.261 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.284 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[15].isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.173 [hcom_common.cc:85] [618654][HcomGetCurHcomCtx] hrtGetDevice deviceLogicId[2] 
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.194 [plugin_manager.cc:56] [618654]hccl ops plugin finalize start.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.208 [hcom_plugin.cc:90] [618654]Finalize start.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.289 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[0].isHcomInit is false.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.265 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.278 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.290 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.274 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.284 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.296 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.298 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.306 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.322 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.334 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.304 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.317 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.328 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.339 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.350 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.306 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.319 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.330 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.341 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.352 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.322 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.335 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.345 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[16].isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.355 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.366 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.346 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[1].isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.359 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.368 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.366 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.379 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.366 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.378 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.380 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.396 [hcom_plugin.cc:119] [618662]Finalize: HcomDestroy success.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.382 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.393 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[2].isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.406 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.393 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.406 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.419 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.389 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.399 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.411 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.423 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.409 [plugin_manager.cc:62] [618662]hccl ops plugin finalize end. ret[0]
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.434 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.447 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.435 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.445 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.419 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.432 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.463 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.457 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.467 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.476 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.477 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.490 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] HCCL_ADPT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.892.478 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:638] FinalizeKernelInfoStore] Destroy hccl kernel info store success.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.490 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.504 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.500 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.511 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL_ADPT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.892.502 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:695] FinalizeHcclComm] Start finalize hccl comm.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.516 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[0].isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.512 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[3].isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.530 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.521 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.532 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.517 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.547 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.532 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.546 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.545 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.559 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.544 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.562 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.561 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.575 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.558 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.571 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[1].isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.581 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.574 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.586 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.596 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.588 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.601 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.593 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[4].isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.611 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.593 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.605 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.608 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.619 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.629 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.611 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.625 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.635 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.627 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.639 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.618 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[2].isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.632 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.644 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.642 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.655 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.647 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.658 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.670 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.656 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.669 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[3].isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.681 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.668 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[5].isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.684 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.665 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.676 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.687 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.683 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.696 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.693 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.704 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.700 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.713 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.700 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.712 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.722 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.707 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.719 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.731 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.716 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[4].isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.727 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.739 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.746 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[6].isHcomInit is false.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.733 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.745 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.743 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.755 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.752 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.762 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[5].isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.772 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.761 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.772 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.756 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.768 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.778 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.769 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.782 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.794 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.786 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.784 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.814 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[7].isHcomInit is false.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.789 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.786 [stream.cc:237] 618674 FreeStreamId: Free stream_id=2.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.800 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.808 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.822 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.806 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.820 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[6].isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.829 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.829 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.840 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.817 [stream_sqcq_manage.cc:216] 618674 DeAllocStreamSqCq: deviceId=7, tsId=0, drvFlag=0
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.825 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.842 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.855 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.836 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.849 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.854 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.838 [npu_driver.cc:966] 618674 NormalSqCqFree: Normal sqcq free, sqId=2, cqId=2, device_id=7, tsId=0, drvFlag=0
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.854 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.866 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[7].isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.880 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.872 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.884 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.881 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[8].isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.895 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.875 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.887 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.898 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.892 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.904 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.897 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.912 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.923 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.906 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.919 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.910 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.920 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.931 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.915 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[8].isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.930 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.943 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.936 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.947 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.943 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.956 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.957 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.969 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[9].isHcomInit is false.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.959 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.892.972 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.945 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[9].isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.964 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.975 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.892.985 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.892.966 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.978 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.985 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.984 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.892.997 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.892.988 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.000 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.011 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.892.998 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.012 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.025 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[10].isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.013 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[10].isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.030 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.008 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.024 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.024 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.037 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.040 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.042 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.053 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.051 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.067 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.040 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.054 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.047 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.058 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.068 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.079 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[11].isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.096 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.085 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[11].isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.10[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.110 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.122 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
2 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.126 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.066 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.080 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.094 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.104 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.080 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.095 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.107 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.134 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[12].isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.138 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.116 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.129 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.142 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.152 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.118 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.130 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.151 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.147 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.158 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.169 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[12].isHcomInit is false.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.166 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.177 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.161 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.172 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.184 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.194 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.171 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.186 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[13].isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.197 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.185 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.197 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.208 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.201 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.214 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.205 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.216 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.227 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.210 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.222 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.236 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[13].isHcomInit is false.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.225 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.238 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.249 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.239 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.251 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.241 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[14].isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.255 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.266 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.248 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.259 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.270 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.261 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.276 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.262 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.274 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.284 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.294 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.279 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.292 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[15].isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.302 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.302 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[14].isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.315 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.331 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.287 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.301 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.312 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.305 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.316 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.324 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.335 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.346 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.315 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.331 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.342 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.342 [hcom_common.cc:958] [618662][Destroy][Result]hcomInfo[16].isHcomInit is false.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.328 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.339 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.338 [npu_driver.cc:974] 618674 NormalSqCqFree: Normal sqcq free success, sqId=2, cqId=2, device_id=7, tsId=0, drvFlag=0
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.351 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.355 [hcom_common.cc:961] [618662]Entry-HcomDestroy:void skip
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.366 [hcom.cc:337] [618662][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:49.893.377 [hcom.cc:340] [618662]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.358 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.372 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.374 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[15].isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.388 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.364 [stream_sqcq_manage.cc:228] 618674 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=2, cq_id=2, stream_id=2, is_sq_need_release=1, drvFlag=0.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.375 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.386 [npu_driver.cc:432] 618674 StreamIdFree: stream id free begin, device_id=7, stream_id=2, ts_id=0, remote_stream_id=0
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.393 [callback.cpp:130]618818 aclrtProcessReport: no subscriberepo[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.386 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.397 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.408 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL_ADPT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.893.401 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:377] FinalizeHccl] Destroy hccl adapter success.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.401 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.413 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
rt info, runtime errorCode = 107012
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.412 [npu_driver.cc:441] 618674 StreamIdFree: Stream id free success, stream_id=2, device_id=7, tsId=0, streamFlag=1536
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.419 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.433 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.893.426 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:613] DestroyHccl] Hccl destroy successful.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.425 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[16].isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.440 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.422 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.443 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.451 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.467 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.479 [hcom_plugin.cc:119] [618654]Finalize: HcomDestroy success.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.445 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.458 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.468 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.453 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.465 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.475 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.486 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.491 [plugin_manager.cc:62] [618654]hccl ops plugin finalize end. ret[0]
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.496 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.508 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.480 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.500 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.517 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.512 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.526 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.528 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.538 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.539 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.551 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.553 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL_ADPT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.893.541 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:638] FinalizeKernelInfoStore] Destroy hccl kernel info store success.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.562 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.565 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.578 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[INFO] HCCL_ADPT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.893.568 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:695] FinalizeHcclComm] Start finalize hccl comm.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.583 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[0].isHcomInit is false.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.572 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.583 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.594 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.590 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.602 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.600 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.605 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.615 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.613 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.627 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.616 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.629 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.632 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.893.631 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	In used mem buf info for Mem buf allocator, is persistent : 1, stream id : 0., mem_bufs size : 1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.638 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[1].isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.651 [hcom_common.cc:961] [INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.639 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.651 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.647 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.659 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.893.655 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	In used mem buf info for Mem buf allocator, is persistent : 0, stream id : 0., mem_bufs size : 1
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.893.671 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] stream id : 0, is persistent : 0
[618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.675 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.664 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.675 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.686 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.670 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.683 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.694 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.893.686 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] Dump state info for Mem buf allocator, is persistent : 0, stream id : 0.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.893.703 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block info - total count : 1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.689 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.701 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[2].isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.712 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.708 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.706 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.712 [stream.cc:237] 618666 FreeStreamId: Free stream_id=3.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.718 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.728 [stream_sqcq_manage.cc:216] 618666 DeAllocStreamSqCq: deviceId=5, tsId=0, drvFlag=0
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.893.719 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 		{"addr_":0x12d100000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12d100000000,"max_addr_":0x12d100000200}
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.893.735 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block total size : 61029220352
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.726 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.738 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.720 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.731 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.744 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.734 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.743 [npu_driver.cc:966] 618666 NormalSqCqFree: Normal sqcq free, sqId=3, cqId=3, device_id=5, tsId=0, drvFlag=0
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.751 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.893.750 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Free mem buf total size : 0, total count : 0
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.893.765 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Eager free mem buf total size : 61029219840, total count : 1
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.750 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[3].isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.761 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.772 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.754 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.766 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.777 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.764 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.779 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.785 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.797 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[4].isHcomInit is false.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.792 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.803 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.893.779 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] stream id : 0, is persistent : 1
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.893.792 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] Dump state info for Mem buf allocator, is persistent : 1, stream id : 0.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.791 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.813 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.810 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.821 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.816 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.893.823 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block info - total count : 1
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.893.837 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 		{"addr_":0x12c2c0000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12c2c0000000,"max_addr_":0x12c2c0000200}
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.827 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.841 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.835 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.846 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[5].isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.858 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.827 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.839 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.849 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.861 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.893.852 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block total size : 61029220352
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.893.867 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Free mem buf total size : 0, total count : 0
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.853 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.865 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.877 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.870 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.882 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.872 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.883 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.893.884 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Eager free mem buf total size : 61029219840, total count : 1
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.893.898 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] The dynamic memory pool[DefaultAscendMemoryPool] stat info : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":116404.00MB,"idle mem":116403.99MB,"used by event mem":0.00MB,"eager free mem":116403.99MB}, actual peak used mem:4M. Weight used size:0M, constant value used size:0M, kernel output used size:0M, other used size:0M.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.888 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.900 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.894 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[6].isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.908 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.894 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.906 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.916 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.893.924 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:430] ReleaseDeviceRes] Release device resource for DefaultAscendMemoryPool : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":116404.00MB,"idle mem":116403.99MB,"used by event mem":0.00MB,"eager free mem":116403.99MB}.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.911 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.925 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.936 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.921 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.934 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.945 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[7].isHcomInit is false.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.927 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.939 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.950 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.893.940 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:62] ReleaseDeviceRes] Release device resource for allocator, Mem buf allocator, is persistent : 0, stream id : 0., mem_blocks_ size : 1.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.893.960 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:65] ReleaseDeviceRes] Clean mem block : {"addr_":0x12d100000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12d100000000,"max_addr_":0x12d100000200}.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.948 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.962 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.956 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.970 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.893.961 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.972 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.893.976 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:191] FreeDeviceMem] Max actual used memory size is 4194304
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.974 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.893.988 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.893.999 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.983 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.893.997 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[8].isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.009 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.893.983 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.002 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.013 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.893.996 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:194] FreeDeviceMem] Max peak used memory size is 1024
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.894.016 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:69] ReleaseDeviceRes] Delete mem block : {"addr_":0x12d100000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12d100000000,"max_addr_":0x12d100000200}.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.013 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.027 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.020 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.032 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.042 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[9].isHcomInit is false.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.026 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.039 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.894.034 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:74] ReleaseDeviceRes] Free mem buf size : 0.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.894.050 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:80] ReleaseDeviceRes] Eager free mem buf size : 1.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.040 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.054 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.057 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.069 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.049 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.060 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.071 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.894.065 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:62] ReleaseDeviceRes] Release device resource for allocator, Mem buf allocator, is persistent : 1, stream id : 0., mem_blocks_ size : 1.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.064 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.079 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.090 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.084 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.105 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[10].isHcomInit is false.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.083 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.095 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.107 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.894.095 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:65] ReleaseDeviceRes] Clean mem block : {"addr_":0x12c2c0000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12c2c0000000,"max_addr_":0x12c2c0000200}.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.894.112 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:191] FreeDeviceMem] Max actual used memory size is 4194304
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.103 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.116 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.119 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.133 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.119 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.130 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.894.128 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:194] FreeDeviceMem] Max peak used memory size is 1024
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.141 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.148 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.158 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[11].isHcomInit is false.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.142 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.154 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.894.148 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:69] ReleaseDeviceRes] Delete mem block : {"addr_":0x12c2c0000000,"size_":61029220352,"stream_id_":0,"min_addr_":0x12c2c0000000,"max_addr_":0x12c2c0000200}.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.894.164 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:74] ReleaseDeviceRes] Free mem buf size : 0.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.894.176 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:80] ReleaseDeviceRes] Eager free mem buf size : 1.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.156 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.169 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.180 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.171 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.184 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.196 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.164 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.175 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.186 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.197 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.894.193 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:45] ~MemBufAllocator] MemBufAllocator[0xfffeb0100230] : Mem buf allocator, is persistent : 1, stream id : 0. deconstruct.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.192 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.207 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.209 [npu_driver.cc:974] 618666 NormalSqCqFree: Normal sqcq free success, sqId=3, cqId=3, device_id=5, tsId=0, drvFlag=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.209 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[12].isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.222 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.208 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.219 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.894.213 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:45] ~MemBufAllocator] MemBufAllocator[0xfffeb0100b20] : Mem buf allocator, is persistent : 0, stream id : 0. deconstruct.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.894.235 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:222] DeInitialize] Ascend Memory Adapter deinitialize success, statistics:
Device MOC memory size: 62420M
MindSpore Used memory size: 58202M
Used peak memory usage (without fragments): 0M
Actual peak memory usage (with fragments): 4M

[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.218 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.226 [stream_sqcq_manage.cc:228] 618666 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=3, cq_id=3, stream_id=3, is_sq_need_release=1, drvFlag=0.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.236 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.244 [npu_driver.cc:432] 618666 StreamIdFree: stream id free begin, device_id=5, stream_id=3, ts_id=0, remote_stream_id=0
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.236 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.250 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.229 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.240 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.251 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.894.255 [callback.cpp:37]618662 aclrtSetExceptionInfoCallback: start to execute aclrtSetExceptionInfoCallback.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.251 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.260 [npu_driver.cc:441] 618666 StreamIdFree: Stream id free success, stream_id=3, device_id=5, tsId=0, streamFlag=1536
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.265 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.279 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.264 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[13].isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.278 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.264 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.278 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.894.276 [callback.cpp:44]618662 aclrtSetExceptionInfoCallback: successfully execute aclrtSetExceptionInfoCallback
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.293 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.307 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.291 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.306 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.316 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[14].isHcomInit is false.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.295 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.308 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.319 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.894.310 [context.cpp:72]618662 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.321 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.334 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.345 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.330 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.341 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.352 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.331 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.343 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.354 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.894.328 [api_impl.cc:3717] 618662 ContextSetCurrent: set context=aaab087d6320, flag=0.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.894.345 [context.cpp:80]618662 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.894.359 [stream.cpp:75]618662 aclrtDestroyStream: start to execute aclrtDestroyStream
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.360 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.372 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.364 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[15].isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.377 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.365 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.379 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] GE(618662,python3.9):2025-04-03-09:27:49.894.380 [stream_manage_func_registry.cc:22]618662 TryCallStreamMngFunc:Stream manage func is not found, FuncType is [0]
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.390 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.403 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.385 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.397 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.390 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.402 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.894.394 [stream.cpp:80]618662 aclrtDestroyStream: try to call stream manage function success, action type is DESTROY_STREAM.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.894.410 [api_impl.cc:1228] 618662 StreamDestroy: stream_id=2.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.416 [hcom_common.cc:958] [618654][Destroy][Result]hcomInfo[16].isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.429 [hcom_common.cc:961] [618654]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.418 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.431 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.443 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.413 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.425 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.435 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.446 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.442 [hcom.cc:337] [618654][Destroy][Result]hcomInfo.isHcomInit is false.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:49.894.456 [hcom.cc:340] [618654]Entry-HcomDestroy:void skip
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.894.426 [acl_resource_manager.cpp:814]618662 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] GE(618662,python3.9):2025-04-03-09:27:49.894.441 [single_op_manager.cc:50]618662 ReleaseResource:ReleaseResource in. resource id = 0xaaab0965fde0
[INFO] GE(618662,python3.9):2025-04-03-09:27:49.894.459 [caching_allocator.cc:402[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.458 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.472 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.457 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.469 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
]618662 TryFreeBlocks:Try free blocks.
[INFO] GE(618662,python3.9):2025-04-03-09:27:49.894.487 [caching_allocator.cc:358]618662 FreeCachedBlocks:Free cached blocks
[INFO] HCCL_ADPT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.894.478 [mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.cc:377] FinalizeHccl] Destroy hccl adapter success.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.486 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.498 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.479 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.491 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.502 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] GE(618662,python3.9):2025-04-03-09:27:49.894.501 [npu_memory_allocator.cc:72]618662 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.894.503 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:613] DestroyHccl] Hccl destroy successful.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.511 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.522 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.533 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.514 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.525 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.535 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.894.516 [stream_executor.cpp:197]618662 RemoveExecutor: To remove executor by stream = 187651573808608
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.894.531 [acl_resource_manager.cpp:823]618662 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.894.544 [stream.cc:852] 618662 TearDown: stream_id=2, sqId=2, pendingNum=0, isForceRecycle_=0, flag=0, failMode=1.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.545 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.558 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.546 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.560 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.894.563 [stream.cc:938] 618662 TearDown: stream_id=2, delay recycle task num=0.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.572 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.585 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.578 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.590 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.894.579 [event.cc:1036] 618662 WaitForBusy: device_id=4, event_id=0 finished map already empty.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.894.597 [npu_driver.cc:626] 618662 EventIdFree: event id free begin, device_id=4, event_id=0, ts_id=0, remote_event_id=0
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.598 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.601 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.614 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.625 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.894.623 [raw_device.cc:1158] 618662 FreeEventIdFromDrv: device_id=4, event_id=0 tear down.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.612 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.627 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.639 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.636 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.647 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.894.638 [event.cc:61] 618662 ~Event: device_id=4, event deconstruct, recordSize=0, waitSize=0, idSize=0
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.653 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.659 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.894.657 [npu_driver.cc:3803] 618662 SqCqFree: deviceId=4, tsId=0, sqId=82, cqId=82
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.666 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.678 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.670 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.681 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.690 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.705 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.691 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.705 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.718 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.894.689 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	In used mem buf info for Mem buf allocator, is persistent : 1, stream id : 0., mem_bufs size : 1
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.715 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.894.707 [subscribe.cc:244] 618662 Delete: delete callback subscribe: groupId=832, threadId=281471738572704, devId=4, tsId=0, streamId=2, sqId=82, cqId=82
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:49.894.712 [trs_sqcq.c:1491][ascend][curpid:618662,618816][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.732 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.894.725 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	In used mem buf info for Mem buf allocator, is persistent : 0, stream id : 0., mem_bufs size : 1
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.894.744 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] stream id : 0, is persistent : 0
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.726 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.737 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.750 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.894.728 [stream.cc:1507] 618662 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.894.744 [npu_driver.cc:3833] 618816 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=832, drvRetCode=16.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.894.759 [api_impl.cc:5058] 618816 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.752 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.765 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.894.759 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] Dump state info for Mem buf allocator, is persistent : 0, stream id : 0.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.894.776 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block info - total count : 1
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.760 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.772 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.782 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.894.767 [stream_sqcq_manage.cc:451] 618662 FreeLogicCq: Return(0), threadIdentifier(281473748110816), devId(4), tsId(0), cqId(312), isFastCq(0).
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.894.774 [callback.cpp:132]618816 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.894.789 [npu_driver.cc:6163] 618662 StreamUnBindLogicCq: success: deviceId=4, tsId=0, streamId=2, logicCq=312.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.776 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.789 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.800 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.894.790 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 		{"addr_":0x12d100000000,"size_":61022928896,"stream_id_":0,"min_addr_":0x12d100000000,"max_addr_":0x12d100000200}
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.894.806 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block total size : 61022928896
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.794 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.805 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.894.793 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.894.812 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.894.823 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.814 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.826 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.894.824 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Free mem buf total size : 0, total count : 0
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.894.837 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Eager free mem buf total size : 61022928384, total count : 1
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.818 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.830 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.841 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.894.825 [npu_driver.cc:1180] 618662 LogicCqFree: Succ:device_id=4,ts_id=0,type=2,logic_cq_id=312, drvFlag=0.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.894.841 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.894.855 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.838 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.851 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.894.851 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] stream id : 0, is persistent : 1
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.894.866 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] Dump state info for Mem buf allocator, is persistent : 1, stream id : 0.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.851 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.869 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.894.868 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.865 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.878 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.894.879 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block info - total count : 1
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.894.895 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 		{"addr_":0x12c2c0000000,"size_":61022928896,"stream_id_":0,"min_addr_":0x12c2c0000000,"max_addr_":0x12c2c0000200}
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.882 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.895 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.894.894 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.894.908 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.891 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.906 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.917 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.919 [event.cc:61] 618666 ~Event: device_id=5, event deconstruct, recordSize=0, waitSize=0, idSize=0
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.894.912 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Mem block total size : 61022928896
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.894.928 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Free mem buf total size : 0, total count : 0
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.907 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.919 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.930 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.894.921 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.894.935 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.930 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.944 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.894.945 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] 	Eager free mem buf total size : 61022928384, total count : 1
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.942 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.955 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.894.947 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.894.960 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.894.971 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.944 [stream.cpp:87]618666 aclrtDestroyStream: aclrtDestroyStream success
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.957 [callback.cpp:116]618809 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.969 [subscribe.cc:308] 618809 GetGroupIdByThreadId: can not find subscribe info, threadId=281471184793504
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.894.980 [api_impl.cc:5043] 618809 ProcessReport: get groupId fail, threadIdentifier=281471184793504, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.966 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.894.978 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.894.988 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.894.984 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.894.996 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.894.961 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] The dynamic memory pool[DefaultAscendMemoryPool] stat info : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":116392.00MB,"idle mem":116391.99MB,"used by event mem":0.00MB,"eager free mem":116391.99MB}, actual peak used mem:4M. Weight used size:0M, constant value used size:0M, kernel output used size:0M, other used size:0M.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.894.989 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:430] ReleaseDeviceRes] Release device resource for DefaultAscendMemoryPool : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":116392.00MB,"idle mem":116391.99MB,"used by event mem":0.00MB,"eager free mem":116391.99MB}.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.009 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.023 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.894.985 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:137] UnRegCallback] Unregister callback thread, stream : 0xaaaaf7fac160.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.894.993 [callback.cpp:130]618809 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.895.007 [device.cpp:183]618666 aclrtResetDevice: start to execut[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.000 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.011 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.895.021 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:62] ReleaseDeviceRes] Release device resource for allocator, Mem buf allocator, is persistent : 0, stream id : 0., mem_blocks_ size : 1.
e aclrtResetDevice, deviceId = 5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.895.040 [api_impl.cc:3419] 618666 DeviceReset: reset device, device_id=5.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.039 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.056 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.022 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.037 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.047 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.059 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.895.041 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:65] ReleaseDeviceRes] Clean mem block : {"addr_":0x12d100000000,"size_":61022928896,"stream_id_":0,"min_addr_":0x12d100000000,"max_addr_":0x12d100000200}.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.895.061 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:191] FreeDeviceMem] Max actual used memory size is 4194304
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.069 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.080 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.091 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.895.056 [runtime.cc:3444] 618666 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x5, reset:0
[INFO] DEVICE(618666,ffff1dfbefa0,python3.9):2025-04-03-09:27:49.895.058 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/callback_thread.cc:42] callback_thread_func] Exit callback thread loop.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.895.074 [api_impl.cc:3449] 618666 DeviceReset: Succ, userDeviceId=5.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.073 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.084 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.895.077 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:194] FreeDeviceMem] Max peak used memory size is 1024
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.895.097 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:69] ReleaseDeviceRes] Delete mem block : {"addr_":0x12d100000000,"size_":61022928896,"stream_id_":0,"min_addr_":0x12d100000000,"max_addr_":0x12d100000200}.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.895.092 [device.cpp:189]618666 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 5.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.102 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.098 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.109 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.120 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.895.114 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:74] ReleaseDeviceRes] Free mem buf size : 0.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.895.130 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:80] ReleaseDeviceRes] Eager free mem buf size : 1.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.895.118 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:206] ReleaseDeviceRes] Ascend finalize end
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.115 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.127 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.139 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.150 [cal[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.132 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.144 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.156 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.895.149 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:62] ReleaseDeviceRes] Release device resource for allocator, Mem buf allocator, is persistent : 1, stream id : 0., mem_blocks_ size : 1.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.895.166 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:65] ReleaseDeviceRes] Clean mem block : {"addr_":0x12c2c0000000,"size_":61022928896,"stream_id_":0,"min_addr_":0x12c2c0000000,"max_addr_":0x12c2c0000200}.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.895.160 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] The dynamic memory pool[DefaultAscendMemoryPool] stat info : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":0.00MB,"idle mem":0.00MB,"used by event mem":0.00MB,"eager free mem":0.00MB}, actual peak used mem:4M. Weight used size:0M, constant value used size:0M, kernel output used size:0M, other used size:0M.
lback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.169 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.170 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.183 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.895.183 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:191] FreeDeviceMem] Max actual used memory size is 4194304
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.895.185 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:430] ReleaseDeviceRes] Release device resource for DefaultAscendMemoryPool : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":0.00MB,"idle mem":0.00MB,"used by event mem":0.00MB,"eager free mem":0.00MB}.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.180 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.193 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.204 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.195 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.215 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.895.199 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/abstract_ascend_memory_pool_support.cc:194] FreeDeviceMem] Max peak used memory size is 1024
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.895.217 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:69] ReleaseDeviceRes] Delete mem block : {"addr_":0x12c2c0000000,"size_":61022928896,"stream_id_":0,"min_addr_":0x12c2c0000000,"max_addr_":0x12c2c0000200}.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.895.233 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:74] ReleaseDeviceRes] Free mem buf size : 0.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.895.205 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:217] DeInitialize] DeInitialize Ascend Memory Adapter when it is not initialize
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.895.222 [callback.cpp:37]618666 aclrtSetExceptionInfoCallback: start to execute aclrtSetExceptionInfoCallback.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.216 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.229 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.239 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.229 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.243 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.895.249 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:80] ReleaseDeviceRes] Eager free mem buf size : 1.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.895.237 [callback.cpp:44]618666 aclrtSetExceptionInfoCallback: successfully execute aclrtSetExceptionInfoCallback
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.895.262 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ascend_deprecated_interface.cc:118] CloseTsd] Start to close tsd, ref = 1
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.251 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.261 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.255 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.268 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.278 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.895.265 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:45] ~MemBufAllocator] MemBufAllocator[0xfffe88100230] : Mem buf allocator, is persistent : 1, stream id : 0. deconstruct.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.895.285 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:45] ~MemBufAllocator] MemBufAllocator[0xfffe88100b20] : Mem buf allocator, is persistent : 0, stream id : 0. deconstruct.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.895.284 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel _npu_log begins the destruction process.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.273 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.284 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.296 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.306 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.291 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.304 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.315 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.895.306 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:222] DeInitialize] Ascend Memory Adapter deinitialize success, statistics:
Device MOC memory size: 62420M
MindSpore Used memory size: 58196M
Used peak memory usage (without fragments): 0M
Actual peak memory usage (with fragments): 4M

[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.318 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.329 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.328 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.340 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.342 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.895.336 [callback.cpp:37]618654 aclrtSetExceptionInfoCallback: start to execute aclrtSetExceptionInfoCallback.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.354 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.355 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.368 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.895.361 [callback.cpp:44]618654 aclrtSetExceptionInfoCallback: successfully execute aclrtSetExceptionInfoCallback
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.365 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.378 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.390 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.380 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.392 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.404 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.401 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.414 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.895.397 [context.cpp:72]618654 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.895.418 [api_impl.cc:3717] 618654 ContextSetCurrent: set context=aaaaf5082ff0, flag=0.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.416 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.424 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.435 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.429 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.442 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.895.435 [context.cpp:80]618654 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.895.455 [stream.cpp:75]618654 aclrtDestroyStream: start to execute aclrtDestroyStream
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.455 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.446 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.468 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.465 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.476 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.481 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] GE(618654,python3.9):2025-04-03-09:27:49.895.475 [stream_manage_func_registry.cc:22]618654 TryCallStreamMngFunc:Stream manage func is not found, FuncType is [0]
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.895.492 [stream.cpp:80]618654 aclrtDestroyStream: try to call stream manage function success, action type is DESTROY_STREAM.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.487 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.497 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.496 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.895.508 [api_impl.cc:1228] 618654 StreamDestroy: stream_id=2.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.509 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.512 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.525 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threa[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.895.525 [acl_resource_manager.cpp:814]618654 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.520 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.531 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] GE(618654,python3.9):2025-04-03-09:27:49.895.541 [single_op_manager.cc:50]618654 ReleaseResource:ReleaseResource in. resource id = 0xaaaaf60d2940
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.542 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
dIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.550 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] GE(618654,python3.9):2025-04-03-09:27:49.895.558 [caching_allocator.cc:402]618654 TryFreeBlocks:Try free blocks.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.553 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.563 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] GE(618654,python3.9):2025-04-03-09:27:49.895.572 [caching_allocator.cc:358]618654 FreeCachedBlocks:Free cached blocks
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.564 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.576 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.576 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[INFO] GE(618654,python3.9):2025-04-03-09:27:49.895.584 [npu_memory_allocator.cc:72]618654 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.589 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.590 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.600 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.610 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.895.597 [stream_executor.cpp:197]618654 RemoveExecutor: To remove executor by stream = 187651249219904
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.895.611 [acl_resource_manager.cpp:823]618654 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.605 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.620 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.621 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.895.626 [stream.cc:852] 618654 TearDown: stream_id=2, sqId=2, pendingNum=0, isForceRecycle_=0, flag=0, failMode=1.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.632 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.632 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.643 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.645 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.659 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.654 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.665 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.895.643 [stream.cc:938] 618654 TearDown: stream_id=2, delay recycle task num=0.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.670 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.895.659 [event.cc:1036] 618654 WaitForBusy: device_id=2, event_id=0 finished map already empty.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.895.674 [npu_driver.cc:626] 618654 EventIdFree: event id free begin, device_id=2, event_id=0, ts_id=0, remote_event_id=0
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.677 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.684 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.690 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.696 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.700 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.895.692 [raw_device.cc:1158] 618654 FreeEventIdFromDrv: device_id=2, event_id=0 tear down.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.895.710 [event.cc:61] 618654 ~Event: device_id=2, event deconstruct, recordSize=0, waitSize=0, idSize=0
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.708 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.722 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.712 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.723 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARN[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.895.729 [npu_driver.cc:3803] 618654 SqCqFree: deviceId=2, tsId=0, sqId=456, cqId=456
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.734 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.749 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
ING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.736 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.764 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.754 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.766 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.779 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.895.761 [subscribe.cc:244] 618654 Delete: delete callback subscribe: groupId=320, threadId=281471067484064, devId=2, tsId=0, streamId=2, sqId=456, cqId=456
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:49.895.765 [trs_sqcq.c:1491][ascend][curpid:618654,618832][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.779 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.794 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.795 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.809 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.895.784 [stream.cc:1507] 618654 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.806 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.818 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.829 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.895.795 [npu_driver.cc:3833] 618832 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=320, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.895.827 [api_impl.cc:5058] 618832 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.895.829 [stream_sqcq_manage.cc:451] 618654 FreeLogicCq: Return(0), threadIdentifier(281473077956064), devId(2), tsId(0), cqId(998), isFastCq(0).
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.823 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.841 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.840 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.895.842 [callback.cpp:132]618832 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.895.851 [npu_driver.cc:6163] 618654 StreamUnBindLogicCq: success: deviceId=2, tsId=0, streamId=2, logicCq=998.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.851 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.862 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.854 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.895.856 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.872 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.867 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.895.872 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.895.885 [npu_driver.cc:1180] 618654 LogicCqFree: Succ:device_id=2,ts_id=0,type=2,logic_cq_id=998, drvFlag=0.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.883 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.881 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.895.887 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.895 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.907 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.902 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.916 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.919 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.930 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.895.913 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.895.931 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.931 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.943 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.895.946 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.895.957 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.940 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.952 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.957 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.895.971 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.961 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.973 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.970 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.895.985 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.895.985 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.895.985 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.895.999 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.895.995 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.896.006 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.000 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.011 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.012 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.025 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.016 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.039 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.026 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.040 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.039 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.896.050 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.053 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.065 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.896.062 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.073 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.056 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.066 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.077 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.083 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.079 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.089 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.896.094 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.093 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.107 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threa[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.103 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.116 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.896.105 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.118 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.131 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.131 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
dId=281471067484064
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.142 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.146 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.185 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.896.143 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.174 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.190 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.202 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.216 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.201 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.218 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.896.153 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.177 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.188 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.896.201 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.896.212 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.223 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.231 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.230 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.234 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.246 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.896.246 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.896.255 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.246 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.263 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.266 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.261 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.277 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.278 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.284 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.296 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.292 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.303 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.896.290 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.896.301 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.301 [stream.cc:237] 618662 FreeStreamId: Free stream_id=2.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.308 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.312 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.318 [stream_sqcq_manage.cc:216] 618662 DeAllocStreamSqCq: deviceId=4, tsId=0, drvFlag=0
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.321 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.323 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.319 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.337 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.335 [npu_driver.cc:966] 618662 NormalSqCqFree: Normal sqcq free, sqId=2, cqId=2, device_id=4, tsId=0, drvFlag=0
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.896.322 [stream.cpp:87]618674 aclrtDestroyStream: aclrtDestroyStream success
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.352 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.342 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.358 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.896.351 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.363 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.369 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.896.373 [callback.cpp:116]618818 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.378 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.381 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.395 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.385 [subscribe.cc:308] 618818 GetGroupIdByThreadId: can not find subscribe info, threadId=281471008829344
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.896.389 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:137] UnRegCallback] Unregister callback thread, stream : 0xaaab0208b2f0.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.407 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.419 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.391 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.405 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.417 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.396 [api_impl.cc:5043] 618818 ProcessReport: get groupId fail, threadIdentifier=281471008829344, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.896.414 [stream.cpp:75]618674 aclrtDestroyStream: start to execute aclrtDestroyStream
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.896.417 [callback.cpp:130]618818 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.431 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.431 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.443 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] GE(618674,python3.9):2025-04-03-09:27:49.896.438 [stream_manage_func_registry.cc:22]618674 TryCallStreamMngFunc:Stream manage func is not found, FuncType is [0]
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.445 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.456 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.456 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.896.455 [stream.cpp:80]618674 aclrtDestroyStream: try to call stream manage function success, action type is DESTROY_STREAM.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.469 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.470 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.471 [api_impl.cc:1228] 618674 StreamDestroy: stream_id=3.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.482 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.483 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.495 [api_impl.cc:5043] 618832 ProcessReport: get g[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.896.488 [acl_resource_manager.cpp:814]618674 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.494 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.506 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] DEVICE(618674,ffff137eefa0,python3.9):2025-04-03-09:27:49.896.495 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/callback_thread.cc:42] callback_thread_func] Exit callback thread loop.
[INFO] GE(618674,python3.9):2025-04-03-09:27:49.896.504 [single_op_manager.cc:50]618674 ReleaseResource:ReleaseResource in. resource id = 0xaaab021bc480
roupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.519 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.519 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] GE(618674,python3.9):2025-04-03-09:27:49.896.533 [caching_allocator.cc:402]618674 TryFreeBlocks:Try free blocks.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.534 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.531 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.544 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[INFO] GE(618674,python3.9):2025-04-03-09:27:49.896.547 [caching_allocator.cc:358]618674 FreeCachedBlocks:Free cached blocks
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.546 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.555 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] GE(618674,python3.9):2025-04-03-09:27:49.896.559 [npu_memory_allocator.cc:72]618674 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.558 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.572 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.896.571 [stream_executor.cpp:197]618674 RemoveExecutor: To remove executor by stream = 187651451503744
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.896.586 [acl_resource_manager.cpp:823]618674 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.577 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.584 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.589 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.602 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.597 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.611 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.598 [stream.cc:852] 618674 TearDown: stream_id=3, sqId=3, pendingNum=0, isForceRecycle_=0, flag=0, failMode=1.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.613 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.624 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.634 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.618 [stream.cc:938] 618674 TearDown: stream_id=3, delay recycle task num=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.633 [event.cc:1036] 618674 WaitForBusy: device_id=7, event_id=1 finished map already empty.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.626 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.638 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.648 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.647 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.647 [npu_driver.cc:626] 618674 EventIdFree: event id free begin, device_id=7, event_id=1, ts_id=0, remote_event_id=0
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.660 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.660 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.673 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.670 [raw_device.cc:1158] 618674 FreeEventIdFromDrv: device_id=7, event_id=1 tear down.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.672 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.684 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.686 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.686 [event.cc:61] 618674 ~Event: device_id=7, event deconstruct, recordSize=0, waitSize=0, idSize=0
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.701 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.701 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.713 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.714 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.702 [npu_driver.cc:3803] 618674 SqCqFree: deviceId=7, tsId=0, sqId=117, cqId=117
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.726 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.727 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.739 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.739 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.753 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.754 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.764 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.755 [subscribe.cc:244] 618674 Delete: delete callback subscribe: groupId=65, threadId=281471000375200, devId=7, tsId=0, streamId=3, sqId=117, cqId=117
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:49.896.759 [trs_sqcq.c:1491][ascend][curpid:618674,618819][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=7; type=1; ret=16)
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.764 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.777 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.776 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.774 [stream.cc:1507] 618674 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.790 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.790 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.786 [npu_driver.cc:3833] 618819 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=7, tsId=0, groupId=65, drvRetCode=16.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.807 [api_impl.cc:5058] 618819 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.804 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.804 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.803 [npu_driver.cc:974] 618662 NormalSqCqFree: Normal sqcq free success, sqId=2, cqId=2, device_id=4, tsId=0, drvFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.810 [stream_sqcq_manage.cc:451] 618674 FreeLogicCq: Return(0), threadIdentifier(281473023856096), devId(7), tsId(0), cqId(333), isFastCq(0).
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.817 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.817 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.824 [stream_sqcq_manage.cc:228] 618662 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=2, cq_id=2, stream_id=2, is_sq_need_release=1, drvFlag=0.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.896.823 [callback.cpp:132]618819 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.837 [npu_driver.cc:6163] 618674 StreamUnBindLogicCq: success: deviceId=7, tsId=0, streamId=3, logicCq=333.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.831 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.854 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.832 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.842 [npu_driver.cc:432] 618662 StreamIdFree: stream id free begin, device_id=4, stream_id=2, ts_id=0, remote_stream_id=0
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.896.844 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.868 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.846 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.870 [npu_driver.cc:441] 618662 StreamIdFree: Stream id free success, stream_id=2, device_id=4, tsId=0, streamFlag=1536
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.874 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.865 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.879 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.882 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.892 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.896.895 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.894 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.905 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.908 [npu_driver.cc:1180] 618674 LogicCqFree: Succ:device_id=7,ts_id=0,type=2,logic_cq_id=333, drvFlag=0.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.908 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.922 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.919 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.896.910 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.937 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.935 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.932 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.944 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.951 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.950 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.962 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.956 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.896.969 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.973 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.896.985 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.896.965 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.896.978 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.982 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.896.996 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.896.990 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.008 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.896.996 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.011 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.011 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.023 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.024 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.038 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.038 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.050 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.051 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.022 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.043 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.055 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.063 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.063 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.080 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.066 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.095 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.078 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.091 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.101 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.094 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.104 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.114 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.107 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.119 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.112 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.124 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.127 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.138 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.130 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.142 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.136 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.149 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.152 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.153 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.165 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.160 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.164 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.187 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.181 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.194 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.204 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.177 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.188 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.199 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.213 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.216 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.200 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.212 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.223 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.227 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.227 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.239 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.243 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.255 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.234 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.245 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.252 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.264 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.270 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.256 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.269 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.276 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.287 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.284 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.296 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.279 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.290 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.302 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.300 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.314 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.308 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.320 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.311 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.322 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.326 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.338 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.334 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.349 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.361 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.333 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.346 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.348 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.361 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.374 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.356 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.368 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.373 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.387 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.401 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.387 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.400 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.387 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.400 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.411 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.415 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.412 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.425 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.421 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.432 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.426 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.439 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.438 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.442 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.453 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.451 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.465 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.451 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.465 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.467 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.480 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.480 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.491 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.481 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.502 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.494 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.506 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.504 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.518 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.525 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.538 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.518 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.529 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.532 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.545 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.549 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.541 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.552 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.558 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.570 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.562 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.576 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.563 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.576 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.582 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.593 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.589 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.600 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.589 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.602 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.615 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.605 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.617 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.628 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.615 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.627 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.638 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.628 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.641 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.642 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.655 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.650 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.662 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.652 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.663 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.668 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.676 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.675 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.680 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.693 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.703 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.689 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.702 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.695 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.706 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.717 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.716 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.729 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.715 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.731 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.728 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.742 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.743 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.756 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.743 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.757 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.751 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.762 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.771 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.770 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.769 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.783 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.783 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.794 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.782 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.795 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.796 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.808 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.806 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.817 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.807 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.827 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.837 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.816 [stream.cc:237] 618654 FreeStreamId: Free stream_id=2.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.821 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.835 [stream_sqcq_manage.cc:216] 618654 DeAllocStreamSqCq: deviceId=2, tsId=0, drvFlag=0
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.845 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.829 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.841 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.851 [npu_driver.cc:966] 618654 NormalSqCqFree: Normal sqcq free, sqId=2, cqId=2, device_id=2, tsId=0, drvFlag=0
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.860 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.849 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.861 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.851 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.863 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.872 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.890 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.875 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.887 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.875 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.889 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.903 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.901 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.913 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.900 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.911 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.922 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.915 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.926 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.938 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.925 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.939 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.932 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.942 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.952 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.950 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.964 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.953 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.965 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.964 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.897.979 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.897.977 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.897.990 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.897.984 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.897.995 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.897.991 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.003 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.002 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.014 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.006 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.018 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.015 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.026 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.038 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.025 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.038 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.028 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.040 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.052 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.050 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.066 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.052 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.065 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.066 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.080 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.079 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.092 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.076 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.087 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.091 [stream.cc:237] 618674 FreeStreamId: Free stream_id=3.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.094 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.106 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.106 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.097 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.112 [stream_sqcq_manage.cc:216] 618674 DeAllocStreamSqCq: deviceId=7, tsId=0, drvFlag=0
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.120 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.121 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.121 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.141 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.130 [npu_driver.cc:966] 618674 NormalSqCqFree: Normal sqcq free, sqId=3, cqId=3, device_id=7, tsId=0, drvFlag=0
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.139 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.141 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.155 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.153 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.165 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.158 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.169 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.166 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.180 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.177 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.189 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.182 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.193 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.190 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.202 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.201 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.214 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.204 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.214 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.226 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.215 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.228 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.239 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.228 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.240 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.236 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.247 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.253 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.265 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.252 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.266 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.280 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.267 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.279 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.293 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.280 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.290 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.301 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.293 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.306 [npu_driver.cc:974] 618654 NormalSqCqFree: Normal sqcq free success, sqId=2, cqId=2, device_id=2, tsId=0, drvFlag=0
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.307 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.319 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.311 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.323 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.311 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.322 [stream_sqcq_manage.cc:228] 618654 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=2, cq_id=2, stream_id=2, is_sq_need_release=1, drvFlag=0.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.328 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.339 [npu_driver.cc:432] 618654 StreamIdFree: stream id free begin, device_id=2, stream_id=2, ts_id=0, remote_stream_id=0
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.332 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.342 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.333 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.345 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.356 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.343 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.357 [npu_driver.cc:441] 618654 StreamIdFree: Stream id free success, stream_id=2, device_id=2, tsId=0, streamFlag=1536
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.360 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.352 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.365 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.376 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.367 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.379 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.377 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.391 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.391 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.389 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.401 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.405 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.416 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.405 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.418 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.428 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.411 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.422 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.433 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.437 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.439 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.449 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.462 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.443 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.456 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.459 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.474 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.466 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.477 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.488 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.474 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.490 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.487 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.499 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.504 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.514 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.501 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.514 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.526 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.508 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.520 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.530 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.525 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.539 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.538 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.551 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.546 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.556 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.551 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.565 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.564 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.576 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.567 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.569 [npu_driver.cc:974] 618674 NormalSqCqFree: Normal sqcq free success, sqId=3, cqId=3, device_id=7, tsId=0, drvFlag=0
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.578 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.579 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.592 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.588 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.601 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.591 [stream_sqcq_manage.cc:228] 618674 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=3, cq_id=3, stream_id=3, is_sq_need_release=1, drvFlag=0.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.599 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.604 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.614 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.623 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.633 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.612 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.623 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.632 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.611 [npu_driver.cc:432] 618674 StreamIdFree: stream id free begin, device_id=7, stream_id=3, ts_id=0, remote_stream_id=0
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.619 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.631 [npu_driver.cc:441] 618674 StreamIdFree: Stream id free success, stream_id=3, device_id=7, tsId=0, streamFlag=1536
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.638 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.645 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.657 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.644 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.658 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.672 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.657 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.670 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.673 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.681 [stream.cpp:87]618662 aclrtDestroyStream: aclrtDestroyStream success
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.684 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.680 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.691 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.701 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.686 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.708 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.718 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.698 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.710 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.722 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.712 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.724 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.734 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.898.721 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:137] UnRegCallback] Unregister callback thread, stream : 0xaaab0965fde0.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.733 [callback.cpp:116]618816 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.732 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.746 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.754 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.767 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.745 [subscribe.cc:308] 618816 GetGroupIdByThreadId: can not find subscribe info, threadId=281471738572704
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.743 [stream.cpp:75]618662 aclrtDestroyStream: start to execute aclrtDestroyStream
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.769 [api_impl.cc:5043] 618816 ProcessReport: get groupId fail, threadIdentifier=281471738572704, reCode=0x7160004
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.758 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.769 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.777 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] GE(618662,python3.9):2025-04-03-09:27:49.898.779 [stream_manage_func_registry.cc:22]618662 TryCallStreamMngFunc:Stream manage func is not found, FuncType is [0]
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.783 [callback.cpp:130]618816 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.793 [stream.cpp:80]618662 aclrtDestroyStream: try to call stream manage function success, action type is DESTROY_STREAM.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.792 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.805 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.815 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.779 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.791 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.809 [api_impl.cc:1228] 618662 StreamDestroy: stream_id=3.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.829 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.809 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.821 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.832 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.826 [acl_resource_manager.cpp:814]618662 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] GE(618662,python3.9):2025-04-03-09:27:49.898.842 [single_op_manager.cc:50]618662 ReleaseResource:ReleaseResource in. resource id = 0xaaab09790360
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.843 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.856 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.842 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.853 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[INFO] DEVICE(618662,ffff3efdefa0,python3.9):2025-04-03-09:27:49.898.846 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/callback_thread.cc:42] callback_thread_func] Exit callback thread loop.
[INFO] GE(618662,python3.9):2025-04-03-09:27:49.898.858 [caching_allocator.cc:402]618662 TryFreeBlocks:Try free blocks.
[INFO] GE(618662,python3.9):2025-04-03-09:27:49.898.870 [caching_allocator.cc:358]618662 FreeCachedBlocks:Free cached blocks
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.869 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.881 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.864 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.875 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.885 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] GE(618662,python3.9):2025-04-03-09:27:49.898.883 [npu_memory_allocator.cc:72]618662 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.895 [stream_executor.cpp:197]618662 RemoveExecutor: To remove executor by stream = 187651575055200
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.896 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.898.909 [acl_resource_manager.cpp:823]618662 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.924 [stream.cc:852] 618662 TearDown: stream_id=3, sqId=3, pendingNum=0, isForceRecycle_=0, flag=0, failMode=1.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.897 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.909 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.910 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.924 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.939 [stream.cc:938] 618662 TearDown: stream_id=3, delay recycle task num=0.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.919 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.930 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.941 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.935 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.949 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.958 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.955 [event.cc:1036] 618662 WaitForBusy: device_id=4, event_id=1 finished map already empty.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.951 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.962 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.971 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.970 [npu_driver.cc:626] 618662 EventIdFree: event id free begin, device_id=4, event_id=1, ts_id=0, remote_event_id=0
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.898.973 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.986 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.898.983 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.898.998 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.898.992 [raw_device.cc:1158] 618662 FreeEventIdFromDrv: device_id=4, event_id=1 tear down.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.007 [event.cc:61] 618662 ~Event: device_id=4, event deconstruct, recordSize=0, waitSize=0, idSize=0
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.012 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.024 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.898.998 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.010 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.021 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.022 [npu_driver.cc:3803] 618662 SqCqFree: deviceId=4, tsId=0, sqId=83, cqId=83
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.031 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.040 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.051 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.037 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.057 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, [INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.060 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
threadId=281471067484064
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.078 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.059 [subscribe.cc:244] 618662 Delete: delete callback subscribe: groupId=833, threadId=281471730118560, devId=4, tsId=0, streamId=3, sqId=83, cqId=83
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:49.899.065 [trs_sqcq.c:1491][ascend][curpid:618662,618817][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=4; type=1; ret=16)
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.092 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.080 [stream.cc:1507] 618662 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.092 [npu_driver.cc:3833] 618817 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=4, tsId=0, groupId=833, drvRetCode=16.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.072 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.105 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.098 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.110 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.122 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.119 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.132 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.107 [api_impl.cc:5058] 618817 ProcessReport: CqReportIrqWait, retCode=0x711000c
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.109 [stream_sqcq_manage.cc:451] 618662 FreeLogicCq: Return(0), threadIdentifier(281473748110816), devId(4), tsId(0), cqId(313), isFastCq(0).
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.134 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.145 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.144 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.155 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.138 [callback.cpp:132]618817 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.145 [npu_driver.cc:6163] 618662 StreamUnBindLogicCq: success: deviceId=4, tsId=0, streamId=3, logicCq=313.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.155 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.157 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.169 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.169 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.170 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.176 [npu_driver.cc:1180] 618662 LogicCqFree: Succ:device_id=4,ts_id=0,type=2,logic_cq_id=313, drvFlag=0.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.184 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.180 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.191 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.182 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.195 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.197 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.209 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.201 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.212 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.208 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.222 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.223 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.235 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.246 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.236 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.249 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.261 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.223 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.236 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.248 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.262 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.274 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.260 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.271 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.281 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.275 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.287 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.289 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.299 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.291 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.302 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.300 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.313 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.314 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.314 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.327 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.324 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.335 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.345 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.327 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.340 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.352 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.338 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.350 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.360 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.358 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.365 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.376 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.372 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.371 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.384 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.395 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 10[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.388 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
7012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.390 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.401 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.407 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.421 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.420 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.411 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.422 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.435 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.434 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.447 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.445 [stream.cpp:87]618654 aclrtDestroyStream: aclrtDestroyStream success
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.457 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.436 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.449 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.459 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.444 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.455 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.466 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.473 [callback.cpp:116]618832 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.484 [subscribe.cc:308] 618832 GetGroupIdByThreadId: can not find subscribe info, threadId=281471067484064
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.473 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.486 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.475 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.488 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.899.487 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:137] UnRegCallback] Unregister callback thread, stream : 0xaaaaf60d2940.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.500 [api_impl.cc:5043] 618832 ProcessReport: get groupId fail, threadIdentifier=281471067484064, reCode=0x7160004
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.497 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.508 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.500 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.513 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.510 [stream.cpp:75]618654 aclrtDestroyStream: start to execute aclrtDestroyStream
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.512 [callback.cpp:130]618832 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] GE(618654,python3.9):2025-04-03-09:27:49.899.529 [stream_manage_func_registry.cc:22]618654 TryCallStreamMngFunc:Stream manage func is not found, FuncType is [0]
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.520 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.533 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.543 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.523 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.535 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.547 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.545 [stream.cpp:80]618654 aclrtDestroyStream: try to call stream manage function success, action type is DESTROY_STREAM.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.560 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.558 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.569 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.561 [api_impl.cc:1228] 618654 StreamDestroy: stream_id=3.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.578 [acl_resource_manager.cpp:814]618654 HandleReleaseSourceByStream: start to execute HandleReleaseSourceByStream.
[INFO] DEVICE(618654,ffff16fdefa0,python3.9):2025-04-03-09:27:49.899.579 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/callback_thread.cc:42] callback_thread_func] Exit callback thread loop.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.572 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.586 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.579 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.592 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[INFO] GE(618654,python3.9):2025-04-03-09:27:49.899.592 [single_op_manager.cc:50]618654 ReleaseResource:ReleaseResource in. resource id = 0xaaaaf6202300
[INFO] GE(618654,python3.9):2025-04-03-09:27:49.899.607 [caching_allocator.cc:402]618654 TryFreeBlocks:Try free blocks.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.596 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.610 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.602 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.613 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] GE(618654,python3.9):2025-04-03-09:27:49.899.621 [caching_allocator.cc:358]618654 FreeCachedBlocks:Free cached blocks
[INFO] GE(618654,python3.9):2025-04-03-09:27:49.899.633 [npu_memory_allocator.cc:72]618654 FreeCachedMem:NpuMemoryAllocators start free cached mem.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.620 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.636 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.622 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.634 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.648 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.648 [stream_executor.cpp:197]618654 RemoveExecutor: To remove executor by stream = 187651250463488
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.662 [acl_resource_manager.cpp:823]618654 HandleReleaseSourceByStream: successfully execute HandleReleaseSourceByStream.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.648 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.662 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.665 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.678 [stream.cc:852] 618654 TearDown: stream_id=3, sqId=3, pendingNum=0, isForceRecycle_=0, flag=0, failMode=1.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.674 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.687 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.676 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.689 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.695 [stream.cc:938] 618654 TearDown: stream_id=3, delay recycle task num=0.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.698 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.710 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.700 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.711 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.725 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.722 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.733 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.746 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.709 [event.cc:1036] 618654 WaitForBusy: device_id=2, event_id=1 finished map already empty.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.746 [npu_driver.cc:626] 618654 EventIdFree: event id free begin, device_id=2, event_id=1, ts_id=0, remote_event_id=0
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.748 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.760 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.756 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.768 [raw_device.cc:1158] 618654 FreeEventIdFromDrv: device_id=2, event_id=1 tear down.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.775 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.766 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.778 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.789 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.782 [event.cc:61] 618654 ~Event: device_id=2, event deconstruct, recordSize=0, waitSize=0, idSize=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.797 [npu_driver.cc:3803] 618654 SqCqFree: deviceId=2, tsId=0, sqId=457, cqId=457
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.787 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.801 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.802 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.813 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.825 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.813 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.824 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.838 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.834 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.846 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.828 [subscribe.cc:244] 618654 Delete: delete callback subscribe: groupId=321, threadId=281471059029920, devId=2, tsId=0, streamId=3, sqId=457, cqId=457
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:49.899.836 [trs_sqcq.c:1491][ascend][curpid:618654,618833][drv][tsdrv][trsCbCqRecv]Recv warn. (devId=2; type=1; ret=16)
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.853 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.857 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.868 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.848 [stream.cc:1507] 618654 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.862 [npu_driver.cc:3833] 618833 CqReportIrqWait: [drv api] halCqReportIrqWait: device_id=2, tsId=0, groupId=321, drvRetCode=16.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.878 [api_impl.cc:5058] 618833 ProcessReport: CqReportIrqWait, retCode=0x711000c
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.864 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.876 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.886 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.878 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.891 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.878 [stream_sqcq_manage.cc:451] 618654 FreeLogicCq: Return(0), threadIdentifier(281473077956064), devId(2), tsId(0), cqId(999), isFastCq(0).
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.893 [callback.cpp:132]618833 aclrtProcessReport: wait subscribereport timeout, runtime errorCode = 507012
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.900 [npu_driver.cc:6163] 618654 StreamUnBindLogicCq: success: deviceId=2, tsId=0, streamId=3, logicCq=999.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.908 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.896 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.909 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.901 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.912 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.922 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.921 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.936 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.922 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.933 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.932 [npu_driver.cc:1180] 618654 LogicCqFree: Succ:device_id=2,ts_id=0,type=2,logic_cq_id=999, drvFlag=0.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.936 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.953 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.948 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.959 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.969 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.950 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.962 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.899.972 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.899.967 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.980 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.899.991 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.899.981 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.899.993 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.982 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.899.995 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.006 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.005 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.019 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.019 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.033 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.900.007 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.900.017 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.032 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.900.028 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.900.039 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.900.050 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.046 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[I[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.047 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.066 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.900.062 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.900.073 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
NFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.066 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.079 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.090 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.900.084 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.900.095 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.090 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.103 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.101 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.114 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.900.105 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.900.116 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.114 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.128 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.129 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.139 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.141 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.166 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.182 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.192 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.151 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.173 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.183 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.193 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.206 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.207 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.222 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.900.123 [event.cc:61] 618674 ~Event: device_id=7, event deconstruct, recordSize=0, waitSize=0, idSize=0
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.900.126 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.900.154 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.221 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.236 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.236 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.900.176 [stream.cpp:87]618674 aclrtDestroyStream: aclrtDestroyStream success
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.900.180 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.900.205 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.900.215 [callback.cpp:116]618819 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.900.214 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:137] UnRegCallback] Unregister callback thread, stream : 0xaaab021bc480.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.900.228 [subscribe.cc:308] 618819 GetGroupIdByThreadId: can not find subscribe info, threadId=281471000375200
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.900.242 [device.cpp:183]618674 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 7.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.251 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.250 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.264 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.900.255 [api_impl.cc:5043] 618819 ProcessReport: get groupId fail, threadIdentifier=281471000375200, reCode=0x7160004
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.900.271 [api_impl.cc:3419] 618674 DeviceReset: reset device, device_id=7.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.264 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.278 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.288 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.276 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.289 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.300 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.900.276 [callback.cpp:130]618819 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.900.289 [runtime.cc:3444] 618674 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x5, reset:0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.900.305 [api_impl.cc:3449] 618674 DeviceReset: Succ, userDeviceId=7.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.301 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.313 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.311 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.322 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.900.315 [device.cpp:189]618674 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 7.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.900.338 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:206] ReleaseDeviceRes] Ascend finalize end
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.325 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.337 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.334 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.347 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.347 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.360 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.358 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.9[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.372 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.388 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] DEVICE(618674,ffff12fdefa0,python3.9):2025-04-03-09:27:49.900.358 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/callback_thread.cc:42] callback_thread_func] Exit callback thread loop.
00.372 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.396 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.900.383 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] The dynamic memory pool[DefaultAscendMemoryPool] stat info : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":0.00MB,"idle mem":0.00MB,"used by event mem":0.00MB,"eager free mem":0.00MB}, actual peak used mem:4M. Weight used size:0M, constant value used size:0M, kernel output used size:0M, other used size:0M.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.900.410 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:430] ReleaseDeviceRes] Release device resource for DefaultAscendMemoryPool : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":0.00MB,"idle mem":0.00MB,"used by event mem":0.00MB,"eager free mem":0.00MB}.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.409 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.900.427 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:217] DeInitialize] DeInitialize Ascend Memory Adapter when it is not initialize
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.402 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.428 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.421 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.434 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.900.440 [callback.cpp:37]618674 aclrtSetExceptionInfoCallback: start to execute aclrtSetExceptionInfoCallback.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.442 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.452 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.447 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.458 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.900.457 [callback.cpp:44]618674 aclrtSetExceptionInfoCallback: successfully execute aclrtSetExceptionInfoCallback
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.465 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.476 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.471 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.482 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.489 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.500 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.496 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.508 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.900.478 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ascend_deprecated_interface.cc:118] CloseTsd] Start to close tsd, ref = 1
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.511 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.519 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.900.499 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel _npu_log begins the destruction process.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.525 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.538 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.532 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.545 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.549 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.561 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.556 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.570 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.572 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.581 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.585 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.593 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.597 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.606 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.610 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.613 [stream.cc:237] 618662 FreeStreamId: Free stream_id=3.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.619 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.629 [stream_sqcq_manage.cc:216] 618662 DeAllocStreamSqCq: deviceId=4, tsId=0, drvFlag=0
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.622 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.635 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.637 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.643 [npu_driver.cc:966] 618662 NormalSqCqFree: Normal sqcq free, sqId=3, cqId=3, device_id=4, tsId=0, drvFlag=0
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.647 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.650 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.659 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.672 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.665 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.685 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.691 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.698 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.704 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.710 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.717 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.731 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.723 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.743 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.747 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.757 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.769 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.760 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.776 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.781 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.789 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.797 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.804 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.809 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.817 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.824 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.830 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.837 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.843 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.851 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.856 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.863 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.868 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.876 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.880 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.888 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.892 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.901 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.905 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.914 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.918 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.926 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.930 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.938 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.942 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.955 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.951 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.900.963 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.900.966 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.975 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.978 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.900.988 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.900.990 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.002 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.014 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
49.901.000 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.024 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.028 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.038 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.040 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.050 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.063 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.076 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.078 [npu_driver.cc:974] 618662 NormalSqCqFree: Normal sqcq free success, sqId=3, cqId=3, device_id=4, tsId=0, drvFlag=0
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.090 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.053 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.083 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.096 [stream_sqcq_manage.cc:228] 618662 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=3, cq_id=3, stream_id=3, is_sq_need_release=1, drvFlag=0.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.102 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.112 [npu_driver.cc:432] 618662 StreamIdFree: stream id free begin, device_id=4, stream_id=3, ts_id=0, remote_stream_id=0
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.117 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.127 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.127 [npu_driver.cc:441] 618662 StreamIdFree: Stream id free success, stream_id=3, device_id=4, tsId=0, streamFlag=1536
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.136 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.094 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.103 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.113 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.122 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.130 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.142 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.147 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.151 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.160 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.161 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.172 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.175 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.180 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.190 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.189 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.203 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.203 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.212 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.218 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.229 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.241 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.221 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.232 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.241 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.252 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.251 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.261 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.263 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.272 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.283 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.281 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.292 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.296 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.303 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.308 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.312 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.322 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.334 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.321 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.337 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.346 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.346 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.358 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.357 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.368 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.377 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.371 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.382 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.385 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.393 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.395 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.406 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.406 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.418 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.415 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.429 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.425 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.435 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.444 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.440 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.453 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.456 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.468 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.462 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.473 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.480 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.481 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.492 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.503 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.491 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.502 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.512 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.513 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.522 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.526 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.538 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.531 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.541 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.550 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.550 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.561 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.560 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.574 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.575 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.585 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.596 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.595 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.608 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.605 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.615 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.621 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.624 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.634 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.633 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.645 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.644 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.655 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.655 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.667 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.665 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.679 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.675 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.685 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.691 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.694 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.702 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.703 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.714 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.717 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.723 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.732 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.733 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.743 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.745 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.752 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.758 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.761 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.771 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.772 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.783 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.793 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.780 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.791 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.805 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.800 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.811 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.808 [event.cc:61] 618662 ~Event: device_id=4, event deconstruct, recordSize=0, waitSize=0, idSize=0
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.816 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.812 [stream.cc:237] 618654 FreeStreamId: Free stream_id=3.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.825 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.832 [stream_sqcq_manage.cc:216] 618654 DeAllocStreamSqCq: deviceId=2, tsId=0, drvFlag=0
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.835 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.828 [stream.cpp:87]618662 aclrtDestroyStream: aclrtDestroyStream success
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.829 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.845 [npu_driver.cc:966] 618654 NormalSqCqFree: Normal sqcq free, sqId=3, cqId=3, device_id=2, tsId=0, drvFlag=0
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.848 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.847 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.859 [callback.cpp:116]618817 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.861 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.870 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.880 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.901.859 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:137] UnRegCallback] Unregister callback thread, stream : 0xaaab09790360.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.872 [subscribe.cc:308] 618817 GetGroupIdByThreadId: can not find subscribe info, threadId=281471730118560
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.888 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.900 [api_impl.cc:5043] 618817 ProcessReport: get groupId fail, threadIdentifier=281471730118560, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.899 [device.cpp:183]618662 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 4.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.913 [callback.cpp:130]618817 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.902 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.913 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.922 [api_impl.cc:3419] 618662 DeviceReset: reset device, device_id=4.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.922 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.932 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.937 [runtime.cc:3444] 618662 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x5, reset:0
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.941 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.950 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.901.953 [api_impl.cc:3449] 618662 DeviceReset: Succ, userDeviceId=4.
[INFO] DEVICE(618662,ffff3e7cefa0,python3.9):2025-04-03-09:27:49.901.959 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/callback_thread.cc:42] callback_thread_func] Exit callback thread loop.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.961 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.901.966 [device.cpp:189]618662 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 4.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.970 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.979 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.901.989 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.901.999 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.901.989 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:206] ReleaseDeviceRes] Ascend finalize end
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.008 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.020 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.902.027 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] The dynamic memory pool[DefaultAscendMemoryPool] stat info : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":0.00MB,"idle mem":0.00MB,"used by event mem":0.00MB,"eager free mem":0.00MB}, actual peak used mem:4M. Weight used size:0M, constant value used size:0M, kernel output used size:0M, other used size:0M.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.029 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.039 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.056 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.902.052 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:430] ReleaseDeviceRes] Release device resource for DefaultAscendMemoryPool : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":0.00MB,"idle mem":0.00MB,"used by event mem":0.00MB,"eager free mem":0.00MB}.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.066 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.902.071 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:217] DeInitialize] DeInitialize Ascend Memory Adapter when it is not initialize
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.075 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.086 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.097 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.902.085 [callback.cpp:37]618662 aclrtSetExceptionInfoCallback: start to execute aclrtSetExceptionInfoCallback.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.106 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.902.103 [callback.cpp:44]618662 aclrtSetExceptionInfoCallback: successfully execute aclrtSetExceptionInfoCallback
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.118 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.902.123 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ascend_deprecated_interface.cc:118] CloseTsd] Start to close tsd, ref = 1
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.127 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.137 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.902.141 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel _npu_log begins the destruction process.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.146 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.156 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.170 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.179 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:49.902.151 [awatchdog_monitor.c:160](tid:618698) thread 618888 not exist
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.188 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:49.902.185 [awatchdog_monitor.c:160](tid:618698) thread 618891 not exist
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.200 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.210 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:49.902.201 [awatchdog_monitor.c:160](tid:618698) thread 618889 not exist
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.221 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:49.902.218 [awatchdog_monitor.c:160](tid:618698) thread 618893 not exist
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.231 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.242 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.252 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.261 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.271 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.271 [npu_driver.cc:974] 618654 NormalSqCqFree: Normal sqcq free success, sqId=3, cqId=3, device_id=2, tsId=0, drvFlag=0
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.281 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.286 [stream_sqcq_manage.cc:228] 618654 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=3, cq_id=3, stream_id=3, is_sq_need_release=1, drvFlag=0.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.290 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.309 [npu_driver.cc:432] 618654 StreamIdFree: stream id free begin, device_id=2, stream_id=3, ts_id=0, remote_stream_id=0
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.311 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.326 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.327 [npu_driver.cc:441] 618654 StreamIdFree: Stream id free success, stream_id=3, device_id=2, tsId=0, streamFlag=1536
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.336 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.346 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.355 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.365 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.373 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.382 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.392 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.402 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.411 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.421 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.431 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.440 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.450 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.460 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.470 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.479 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.489 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.499 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.508 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.522 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.532 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.542 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.552 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.562 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.572 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.582 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.591 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.601 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.611 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.620 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.629 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.640 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.649 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.659 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.669 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.678 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.688 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.698 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.708 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.717 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.727 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.737 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.746 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.756 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.770 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.780 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.790 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.800 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.809 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.819 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.829 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.838 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.848 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.858 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.866 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.877 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.886 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.896 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.906 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.915 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.925 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.935 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.937 [event.cc:61] 618654 ~Event: device_id=2, event deconstruct, recordSize=0, waitSize=0, idSize=0
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.944 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.953 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.954 [stream.cpp:87]618654 aclrtDestroyStream: aclrtDestroyStream success
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.963 [callback.cpp:116]618833 aclrtProcessReport: start to execute aclrtProcessReport, timeout is 500ms.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.972 [subscribe.cc:308] 618833 GetGroupIdByThreadId: can not find subscribe info, threadId=281471059029920
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:49.902.982 [api_impl.cc:5043] 618833 ProcessReport: get groupId fail, threadIdentifier=281471059029920, reCode=0x7160004
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.902.984 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.cc:137] UnRegCallback] Unregister callback thread, stream : 0xaaaaf6202300.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.902.995 [callback.cpp:130]618833 aclrtProcessReport: no subscribereport info, runtime errorCode = 107012
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.903.005 [device.cpp:183]618654 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.903.022 [api_impl.cc:3419] 618654 DeviceReset: reset device, device_id=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.903.035 [runtime.cc:3444] 618654 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x5, reset:0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:49.903.047 [api_impl.cc:3449] 618654 DeviceReset: Succ, userDeviceId=2.
[INFO] DEVICE(618654,ffff167cefa0,python3.9):2025-04-03-09:27:49.903.054 [mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/callback_thread.cc:42] callback_thread_func] Exit callback thread loop.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.903.058 [device.cpp:189]618654 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 2.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.903.084 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:206] ReleaseDeviceRes] Ascend finalize end
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.903.121 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:948] SplitAndDumpLog] The dynamic memory pool[DefaultAscendMemoryPool] stat info : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":0.00MB,"idle mem":0.00MB,"used by event mem":0.00MB,"eager free mem":0.00MB}, actual peak used mem:4M. Weight used size:0M, constant value used size:0M, kernel output used size:0M, other used size:0M.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.903.145 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:430] ReleaseDeviceRes] Release device resource for DefaultAscendMemoryPool : {"in used mem":0.00MB,"peak used mem":0.00MB,"alloc mem":0.00MB,"idle mem":0.00MB,"used by event mem":0.00MB,"eager free mem":0.00MB}.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.903.161 [mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_adapter.cc:217] DeInitialize] DeInitialize Ascend Memory Adapter when it is not initialize
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.903.172 [callback.cpp:37]618654 aclrtSetExceptionInfoCallback: start to execute aclrtSetExceptionInfoCallback.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:49.903.187 [callback.cpp:44]618654 aclrtSetExceptionInfoCallback: successfully execute aclrtSetExceptionInfoCallback
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.903.206 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ascend_deprecated_interface.cc:118] CloseTsd] Start to close tsd, ref = 1
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:49.903.225 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel _npu_log begins the destruction process.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:49.918.803 [awatchdog_monitor.c:160](tid:618689) thread 618890 not exist
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:49.918.843 [awatchdog_monitor.c:160](tid:618689) thread 618894 not exist
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:49.918.859 [awatchdog_monitor.c:160](tid:618689) thread 618892 not exist
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:49.918.874 [awatchdog_monitor.c:160](tid:618689) thread 618895 not exist
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:49.920.180 [queue_client_comm.c:114][ascend][curpid:618666,618841][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:49.920.182 [queue_client_comm.c:114][ascend][curpid:618666,618845][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:49.920.184 [queue_client_comm.c:114][ascend][curpid:618666,618849][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.920.290 [npu_driver.cc:4338] 618841 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.920.304 [tensor_data_transfer.cpp:612]618841 acltdtReceiveTensorV2: queue is empty, device is 5, name is _npu_log
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.920.329 [npu_driver.cc:4338] 618845 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.920.345 [tensor_data_transfer.cpp:612]618845 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_tensor_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.920.360 [tensor_data_transfer.cpp:1054]618845 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_tensor_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.920.385 [tensor_data_transfer.cpp:1056]618845 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.920.373 [npu_driver.cc:4338] 618849 MemQueuePeek: queue empty
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.920.399 [api_impl.cc:6121] 618845 MemQueuePeek: Start to peek queue on devId 5, qid is 2.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.920.403 [tensor_data_transfer.cpp:612]618849 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_scalar_summary
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.920.410 [npu_driver.cc:4330] 618845 MemQueuePeek: peek mem queue, deviceId=5, qid=2, timeout=800.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.920.416 [tensor_data_transfer.cpp:1054]618849 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 5, name is ms_scalar_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.920.427 [tensor_data_transfer.cpp:1056]618849 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.920.441 [api_impl.cc:6121] 618849 MemQueuePeek: Start to peek queue on devId 5, qid is 4.
[INFO] DEVICE(618666,fffeec47dfa0,python3.9):2025-04-03-09:27:49.920.459 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.920.467 [npu_driver.cc:4330] 618849 MemQueuePeek: peek mem queue, deviceId=5, qid=4, timeout=800.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.920.569 [tensor_data_transfer.cpp:973]618666 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 5, name is _npu_log
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.920.594 [api_impl.cc:6065] 618666 MemQueueDestroy: Start to destroy queue on devId 5, qid is 0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.920.610 [npu_driver.cc:3989] 618666 MemQueueDestroy: deviceId=5, qid=0.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.921.004 [tensor_data_transfer.cpp:977]618666 acltdtDestroyChannel: acltdtDestroyChannel success, device is 5, name is _npu_log
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.921.038 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_histogram_summary channel is being destroyed.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.921.059 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_histogram_summary begins the destruction process.
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:49.924.175 [queue_client_comm.c:114][ascend][curpid:618666,618851][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:49.924.174 [queue_client_comm.c:114][ascend][curpid:618666,618843][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:49.924.179 [queue_client_comm.c:114][ascend][curpid:618666,618847][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.924.271 [npu_driver.cc:4338] 618851 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.924.286 [tensor_data_transfer.cpp:612]618851 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_histogram_summary
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.924.300 [npu_driver.cc:4338] 618843 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.924.315 [tensor_data_transfer.cpp:612]618843 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_tensor_dump
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:49.924.330 [npu_driver.cc:4338] 618847 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.924.344 [tensor_data_transfer.cpp:612]618847 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_image_summary
[INFO] DEVICE(618666,fffeccf9efa0,python3.9):2025-04-03-09:27:49.924.390 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] DEVICE(618666,fffecefdefa0,python3.9):2025-04-03-09:27:49.924.449 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] DEVICE(618666,fffee53e8fa0,python3.9):2025-04-03-09:27:49.924.438 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.924.570 [tensor_data_transfer.cpp:973]618666 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 5, name is ms_histogram_summary
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.924.595 [api_impl.cc:6065] 618666 MemQueueDestroy: Start to destroy queue on devId 5, qid is 5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:49.924.609 [npu_driver.cc:3989] 618666 MemQueueDestroy: deviceId=5, qid=5.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:49.924.962 [tensor_data_transfer.cpp:977]618666 acltdtDestroyChannel: acltdtDestroyChannel success, device is 5, name is ms_histogram_summary
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.924.998 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_scalar_summary channel is being destroyed.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:49.925.022 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_scalar_summary begins the destruction process.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:49.931.094 [awatchdog_monitor.c:160](tid:618682) thread 618933 not exist
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:49.931.123 [awatchdog_monitor.c:160](tid:618682) thread 618935 not exist
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:49.931.137 [awatchdog_monitor.c:160](tid:618682) thread 618934 not exist
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:49.931.152 [awatchdog_monitor.c:160](tid:618682) thread 618936 not exist
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:49.984.180 [queue_client_comm.c:114][ascend][curpid:618662,618864][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:49.984.181 [queue_client_comm.c:114][ascend][curpid:618662,618872][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:49.984.177 [queue_client_comm.c:114][ascend][curpid:618674,618881][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:49.984.177 [queue_client_comm.c:114][ascend][curpid:618674,618866][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:49.984.181 [queue_client_comm.c:114][ascend][curpid:618674,618873][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.984.298 [npu_driver.cc:4338] 618881 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.984.327 [tensor_data_transfer.cpp:612]618881 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_scalar_summary
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.984.330 [npu_driver.cc:4338] 618866 MemQueuePeek: queue empty
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.984.322 [npu_driver.cc:4338] 618864 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.984.344 [tensor_data_transfer.cpp:1054]618881 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_scalar_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.984.344 [tensor_data_transfer.cpp:612]618864 acltdtReceiveTensorV2: queue is empty, device is 4, name is _npu_log
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.984.347 [tensor_data_transfer.cpp:612]618866 acltdtReceiveTensorV2: queue is empty, device is 7, name is _npu_log
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.984.361 [npu_driver.cc:4338] 618872 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.984.379 [tensor_data_transfer.cpp:612]618872 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_tensor_summary
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.984.354 [tensor_data_transfer.cpp:1056]618881 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.984.383 [api_impl.cc:6121] 618881 MemQueuePeek: Start to peek queue on devId 7, qid is 4.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.984.385 [npu_driver.cc:4338] 618873 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.984.406 [tensor_data_transfer.cpp:612]618873 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_tensor_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.984.394 [tensor_data_transfer.cpp:1054]618872 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 4, name is ms_tensor_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.984.411 [tensor_data_transfer.cpp:1056]618872 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.984.409 [npu_driver.cc:4330] 618881 MemQueuePeek: peek mem queue, deviceId=7, qid=4, timeout=800.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.984.425 [api_impl.cc:6121] 618872 MemQueuePeek: Start to peek queue on devId 4, qid is 2.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.984.423 [tensor_data_transfer.cpp:1054]618873 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 7, name is ms_tensor_summary
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.984.437 [npu_driver.cc:4330] 618872 MemQueuePeek: peek mem queue, deviceId=4, qid=2, timeout=800.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.984.438 [tensor_data_transfer.cpp:1056]618873 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.984.452 [api_impl.cc:6121] 618873 MemQueuePeek: Start to peek queue on devId 7, qid is 2.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.984.465 [npu_driver.cc:4330] 618873 MemQueuePeek: peek mem queue, deviceId=7, qid=2, timeout=800.
[INFO] DEVICE(618674,fffee95d6fa0,python3.9):2025-04-03-09:27:49.984.465 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] DEVICE(618662,ffff14cdefa0,python3.9):2025-04-03-09:27:49.984.467 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.984.610 [tensor_data_transfer.cpp:973]618662 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 4, name is _npu_log
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.984.614 [tensor_data_transfer.cpp:973]618674 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 7, name is _npu_log
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.984.638 [api_impl.cc:6065] 618674 MemQueueDestroy: Start to destroy queue on devId 7, qid is 0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.984.636 [api_impl.cc:6065] 618662 MemQueueDestroy: Start to destroy queue on devId 4, qid is 0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.984.653 [npu_driver.cc:3989] 618662 MemQueueDestroy: deviceId=4, qid=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.984.652 [npu_driver.cc:3989] 618674 MemQueueDestroy: deviceId=7, qid=0.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.985.051 [tensor_data_transfer.cpp:977]618674 acltdtDestroyChannel: acltdtDestroyChannel success, device is 7, name is _npu_log
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.985.090 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_histogram_summary channel is being destroyed.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.985.095 [tensor_data_transfer.cpp:977]618662 acltdtDestroyChannel: acltdtDestroyChannel success, device is 4, name is _npu_log
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.985.115 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_histogram_summary begins the destruction process.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.985.132 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_histogram_summary channel is being destroyed.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.985.155 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_histogram_summary begins the destruction process.
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:49.988.176 [queue_client_comm.c:114][ascend][curpid:618662,618880][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:49.988.182 [queue_client_comm.c:114][ascend][curpid:618662,618876][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:49.988.186 [queue_client_comm.c:114][ascend][curpid:618662,618885][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:49.988.178 [queue_client_comm.c:114][ascend][curpid:618674,618870][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:49.988.183 [queue_client_comm.c:114][ascend][curpid:618674,618884][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:49.988.192 [queue_client_comm.c:114][ascend][curpid:618674,618878][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:49.988.191 [queue_client_comm.c:114][ascend][curpid:618662,618868][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.988.286 [npu_driver.cc:4338] 618880 MemQueuePeek: queue empty
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.988.293 [npu_driver.cc:4338] 618870 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.988.311 [tensor_data_transfer.cpp:612]618870 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_tensor_dump
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.988.327 [npu_driver.cc:4338] 618884 MemQueuePeek: queue empty
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.988.307 [npu_driver.cc:4338] 618876 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.988.347 [tensor_data_transfer.cpp:612]618884 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_histogram_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.988.307 [tensor_data_transfer.cpp:612]618880 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_scalar_summary
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.988.338 [npu_driver.cc:4338] 618885 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.988.375 [tensor_data_transfer.cpp:612]618876 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_image_summary
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:49.988.366 [npu_driver.cc:4338] 618878 MemQueuePeek: queue empty
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:49.988.386 [npu_driver.cc:4338] 618868 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.988.392 [tensor_data_transfer.cpp:612]618878 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_image_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.988.390 [tensor_data_transfer.cpp:612]618885 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_histogram_summary
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.988.411 [tensor_data_transfer.cpp:612]618868 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_tensor_dump
[INFO] DEVICE(618674,fffee2541fa0,python3.9):2025-04-03-09:27:49.988.438 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] DEVICE(618674,fffec1fbefa0,python3.9):2025-04-03-09:27:49.988.456 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] DEVICE(618662,fffef57aefa0,python3.9):2025-04-03-09:27:49.988.518 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] DEVICE(618662,fffef77eefa0,python3.9):2025-04-03-09:27:49.988.536 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] DEVICE(618662,fffef67cefa0,python3.9):2025-04-03-09:27:49.988.508 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] DEVICE(618674,fffec3ffefa0,python3.9):2025-04-03-09:27:49.988.556 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] DEVICE(618662,ffff0dc49fa0,python3.9):2025-04-03-09:27:49.988.594 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.988.749 [tensor_data_transfer.cpp:973]618662 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 4, name is ms_histogram_summary
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.988.779 [api_impl.cc:6065] 618662 MemQueueDestroy: Start to destroy queue on devId 4, qid is 5.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.988.797 [npu_driver.cc:3989] 618662 MemQueueDestroy: deviceId=4, qid=5.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.988.781 [tensor_data_transfer.cpp:973]618674 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 7, name is ms_histogram_summary
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.988.806 [api_impl.cc:6065] 618674 MemQueueDestroy: Start to destroy queue on devId 7, qid is 5.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:49.988.820 [npu_driver.cc:3989] 618674 MemQueueDestroy: deviceId=7, qid=5.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:49.989.185 [tensor_data_transfer.cpp:977]618674 acltdtDestroyChannel: acltdtDestroyChannel success, device is 7, name is ms_histogram_summary
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.989.221 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_scalar_summary channel is being destroyed.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.989.229 [tensor_data_transfer.cpp:977]618662 acltdtDestroyChannel: acltdtDestroyChannel success, device is 4, name is ms_histogram_summary
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:49.989.245 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_scalar_summary begins the destruction process.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.989.266 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_scalar_summary channel is being destroyed.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.989.290 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_scalar_summary begins the destruction process.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.989.334 [tensor_data_transfer.cpp:973]618662 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 4, name is ms_scalar_summary
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.989.354 [api_impl.cc:6065] 618662 MemQueueDestroy: Start to destroy queue on devId 4, qid is 4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.989.368 [npu_driver.cc:3989] 618662 MemQueueDestroy: deviceId=4, qid=4.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.989.760 [tensor_data_transfer.cpp:977]618662 acltdtDestroyChannel: acltdtDestroyChannel success, device is 4, name is ms_scalar_summary
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.989.790 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_image_summary channel is being destroyed.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.989.812 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_image_summary begins the destruction process.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.989.873 [tensor_data_transfer.cpp:973]618662 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 4, name is ms_image_summary
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.989.906 [api_impl.cc:6065] 618662 MemQueueDestroy: Start to destroy queue on devId 4, qid is 3.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:49.989.919 [npu_driver.cc:3989] 618662 MemQueueDestroy: deviceId=4, qid=3.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:49.990.282 [tensor_data_transfer.cpp:977]618662 acltdtDestroyChannel: acltdtDestroyChannel success, device is 4, name is ms_image_summary
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.990.310 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_tensor_summary channel is being destroyed.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:49.990.331 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_tensor_summary begins the destruction process.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.996.717 [runtime.cc:5239] 618834 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:49.996.747 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618834] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:49.996.759 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618834] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:49.996.776 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618834] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.996.800 [runtime.cc:3077] 618834 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=0, devId=0, tdt status=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:49.996.886 [npu_driver.cc:551] 618834 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:50.015.833 [awatchdog_monitor.c:160](tid:618694) thread 618913 not exist
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:50.015.867 [awatchdog_monitor.c:160](tid:618694) thread 618914 not exist
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:50.015.881 [awatchdog_monitor.c:160](tid:618694) thread 618915 not exist
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:50.015.895 [awatchdog_monitor.c:160](tid:618694) thread 618916 not exist
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:50.020.170 [queue_client_comm.c:114][ascend][curpid:618670,618909][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:50.020.172 [queue_client_comm.c:114][ascend][curpid:618670,618903][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:50.020.171 [queue_client_comm.c:114][ascend][curpid:618670,618901][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:50.020.172 [queue_client_comm.c:114][ascend][curpid:618670,618907][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:50.020.172 [queue_client_comm.c:114][ascend][curpid:618670,618905][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:50.020.175 [queue_client_comm.c:114][ascend][curpid:618670,618911][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:50.020.273 [npu_driver.cc:4338] 618909 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.020.291 [tensor_data_transfer.cpp:612]618909 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_scalar_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.020.304 [tensor_data_transfer.cpp:1054]618909 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_scalar_summary
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:50.020.308 [npu_driver.cc:4338] 618903 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.020.319 [tensor_data_transfer.cpp:1056]618909 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.020.326 [tensor_data_transfer.cpp:612]618903 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_tensor_dump
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:50.020.330 [api_impl.cc:6121] 618909 MemQueuePeek: Start to peek queue on devId 6, qid is 4.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.020.340 [tensor_data_transfer.cpp:1054]618903 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_tensor_dump
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:50.020.349 [npu_driver.cc:4330] 618909 MemQueuePeek: peek mem queue, deviceId=6, qid=4, timeout=800.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:50.020.365 [npu_driver.cc:4338] 618901 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.020.373 [tensor_data_transfer.cpp:1056]618903 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.020.384 [tensor_data_transfer.cpp:612]618901 acltdtReceiveTensorV2: queue is empty, device is 6, name is _npu_log
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:50.020.392 [api_impl.cc:6121] 618903 MemQueuePeek: Start to peek queue on devId 6, qid is 1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:50.020.404 [npu_driver.cc:4330] 618903 MemQueuePeek: peek mem queue, deviceId=6, qid=1, timeout=800.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:50.020.406 [npu_driver.cc:4338] 618907 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.020.426 [tensor_data_transfer.cpp:612]618907 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_image_summary
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.020.439 [tensor_data_transfer.cpp:1054]618907 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_image_summary
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:50.020.444 [npu_driver.cc:4338] 618905 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.020.455 [tensor_data_transfer.cpp:1056]618907 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.020.461 [tensor_data_transfer.cpp:612]618905 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_tensor_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:50.020.466 [api_impl.cc:6121] 618907 MemQueuePeek: Start to peek queue on devId 6, qid is 3.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.020.473 [tensor_data_transfer.cpp:1054]618905 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_tensor_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:50.020.479 [npu_driver.cc:4330] 618907 MemQueuePeek: peek mem queue, deviceId=6, qid=3, timeout=800.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:50.020.482 [npu_driver.cc:4338] 618911 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.020.487 [tensor_data_transfer.cpp:1056]618905 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.020.499 [tensor_data_transfer.cpp:612]618911 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_histogram_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:50.020.504 [api_impl.cc:6121] 618905 MemQueuePeek: Start to peek queue on devId 6, qid is 2.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.020.513 [tensor_data_transfer.cpp:1054]618911 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 6, name is ms_histogram_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:50.020.522 [npu_driver.cc:4330] 618905 MemQueuePeek: peek mem queue, deviceId=6, qid=2, timeout=800.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.020.526 [tensor_data_transfer.cpp:1056]618911 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:50.020.540 [api_impl.cc:6121] 618911 MemQueuePeek: Start to peek queue on devId 6, qid is 5.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:50.020.556 [npu_driver.cc:4330] 618911 MemQueuePeek: peek mem queue, deviceId=6, qid=5, timeout=800.
[INFO] DEVICE(618670,ffff095d6fa0,python3.9):2025-04-03-09:27:50.020.561 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.020.669 [tensor_data_transfer.cpp:973]618670 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 6, name is _npu_log
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:50.020.704 [api_impl.cc:6065] 618670 MemQueueDestroy: Start to destroy queue on devId 6, qid is 0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:50.020.722 [npu_driver.cc:3989] 618670 MemQueueDestroy: deviceId=6, qid=0.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.021.145 [tensor_data_transfer.cpp:977]618670 acltdtDestroyChannel: acltdtDestroyChannel success, device is 6, name is _npu_log
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.021.192 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_histogram_summary channel is being destroyed.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.021.219 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_histogram_summary begins the destruction process.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:50.021.557 [awatchdog_monitor.c:160](tid:618693) thread 618853 not exist
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:50.021.590 [awatchdog_monitor.c:160](tid:618693) thread 618855 not exist
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:50.021.610 [awatchdog_monitor.c:160](tid:618693) thread 618856 not exist
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:50.021.628 [awatchdog_monitor.c:160](tid:618693) thread 618854 not exist
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:50.116.172 [queue_client_comm.c:114][ascend][curpid:618650,618923][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:50.116.170 [queue_client_comm.c:114][ascend][curpid:618650,618931][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:50.116.176 [queue_client_comm.c:114][ascend][curpid:618650,618929][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:50.116.176 [queue_client_comm.c:114][ascend][curpid:618650,618921][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:50.116.178 [queue_client_comm.c:114][ascend][curpid:618650,618925][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:50.116.181 [queue_client_comm.c:114][ascend][curpid:618650,618927][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:50.116.279 [npu_driver.cc:4338] 618923 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.116.294 [tensor_data_transfer.cpp:612]618923 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_tensor_dump
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.116.305 [tensor_data_transfer.cpp:1054]618923 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_tensor_dump
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.116.328 [tensor_data_transfer.cpp:1056]618923 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:50.116.338 [api_impl.cc:6121] 618923 MemQueuePeek: Start to peek queue on devId 1, qid is 1.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:50.116.339 [npu_driver.cc:4338] 618931 MemQueuePeek: queue empty
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:50.116.350 [npu_driver.cc:4330] 618923 MemQueuePeek: peek mem queue, deviceId=1, qid=1, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.116.363 [tensor_data_transfer.cpp:612]618931 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_histogram_summary
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:50.116.376 [npu_driver.cc:4338] 618929 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.116.381 [tensor_data_transfer.cpp:1054]618931 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_histogram_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.116.399 [tensor_data_transfer.cpp:1056]618931 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.116.393 [tensor_data_transfer.cpp:612]618929 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_scalar_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:50.116.413 [api_impl.cc:6121] 618931 MemQueuePeek: Start to peek queue on devId 1, qid is 5.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:50.116.425 [npu_driver.cc:4338] 618921 MemQueuePeek: queue empty
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:50.116.436 [npu_driver.cc:4330] 618931 MemQueuePeek: peek mem queue, deviceId=1, qid=5, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.116.429 [tensor_data_transfer.cpp:1054]618929 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_scalar_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.116.445 [tensor_data_transfer.cpp:612]618921 acltdtReceiveTensorV2: queue is empty, device is 1, name is _npu_log
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:50.116.460 [npu_driver.cc:4338] 618925 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.116.484 [tensor_data_transfer.cpp:612]618925 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_tensor_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.116.464 [tensor_data_transfer.cpp:1056]618929 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.116.499 [tensor_data_transfer.cpp:1054]618925 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_tensor_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:50.116.549 [api_impl.cc:6121] 618929 MemQueuePeek: Start to peek queue on devId 1, qid is 4.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:50.116.501 [npu_driver.cc:4338] 618927 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.116.558 [tensor_data_transfer.cpp:1056]618925 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.116.596 [tensor_data_transfer.cpp:612]618927 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_image_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:50.116.599 [api_impl.cc:6121] 618925 MemQueuePeek: Start to peek queue on devId 1, qid is 2.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:50.116.585 [npu_driver.cc:4330] 618929 MemQueuePeek: peek mem queue, deviceId=1, qid=4, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.116.608 [tensor_data_transfer.cpp:1054]618927 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 1, name is ms_image_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:50.116.611 [npu_driver.cc:4330] 618925 MemQueuePeek: peek mem queue, deviceId=1, qid=2, timeout=800.
[INFO] DEVICE(618650,ffff1d5d6fa0,python3.9):2025-04-03-09:27:50.116.618 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.116.629 [tensor_data_transfer.cpp:1056]618927 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:50.116.672 [api_impl.cc:6121] 618927 MemQueuePeek: Start to peek queue on devId 1, qid is 3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:50.116.684 [npu_driver.cc:4330] 618927 MemQueuePeek: peek mem queue, deviceId=1, qid=3, timeout=800.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.116.792 [tensor_data_transfer.cpp:973]618650 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 1, name is _npu_log
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:50.116.816 [api_impl.cc:6065] 618650 MemQueueDestroy: Start to destroy queue on devId 1, qid is 0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:50.116.829 [npu_driver.cc:3989] 618650 MemQueueDestroy: deviceId=1, qid=0.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.117.219 [tensor_data_transfer.cpp:977]618650 acltdtDestroyChannel: acltdtDestroyChannel success, device is 1, name is _npu_log
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.117.257 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_histogram_summary channel is being destroyed.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.117.279 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_histogram_summary begins the destruction process.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:50.184.734 [runtime.cc:5239] 618772 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:50.184.766 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618772] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:50.184.787 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618772] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:50.184.803 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618772] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:50.184.823 [runtime.cc:3077] 618772 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=3, devId=3, tdt status=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:50.184.913 [npu_driver.cc:551] 618772 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:50.188.725 [runtime.cc:5239] 618826 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:50.188.751 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618826] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:50.188.764 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618826] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:50.188.730 [runtime.cc:5239] 618820 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:50.188.756 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618820] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:50.188.772 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618820] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:50.188.784 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618820] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:50.188.776 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618826] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:50.188.795 [runtime.cc:3077] 618826 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=1, devId=1, tdt status=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:50.188.804 [runtime.cc:3077] 618820 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=6, devId=6, tdt status=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:50.188.862 [npu_driver.cc:551] 618826 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:50.188.879 [npu_driver.cc:551] 618820 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:50.208.177 [queue_client_comm.c:114][ascend][curpid:618654,618951][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:50.208.177 [queue_client_comm.c:114][ascend][curpid:618654,618947][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:50.208.181 [queue_client_comm.c:114][ascend][curpid:618654,618949][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:50.208.179 [queue_client_comm.c:114][ascend][curpid:618654,618943][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:50.208.180 [queue_client_comm.c:114][ascend][curpid:618654,618941][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:50.208.181 [queue_client_comm.c:114][ascend][curpid:618654,618945][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:50.208.298 [npu_driver.cc:4338] 618951 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:50.208.314 [tensor_data_transfer.cpp:612]618951 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_histogram_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:50.208.326 [tensor_data_transfer.cpp:1054]618951 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_histogram_summary
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:50.208.334 [npu_driver.cc:4338] 618947 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:50.208.339 [tensor_data_transfer.cpp:1056]618951 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:50.208.346 [tensor_data_transfer.cpp:612]618947 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_image_summary
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:50.208.349 [api_impl.cc:6121] 618951 MemQueuePeek: Start to peek queue on devId 2, qid is 5.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:50.208.357 [tensor_data_transfer.cpp:1054]618947 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_image_summary
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:50.208.359 [npu_driver.cc:4330] 618951 MemQueuePeek: peek mem queue, deviceId=2, qid=5, timeout=800.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:50.208.368 [tensor_data_transfer.cpp:1056]618947 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:50.208.375 [npu_driver.cc:4338] 618949 MemQueuePeek: queue empty
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:50.208.378 [api_impl.cc:6121] 618947 MemQueuePeek: Start to peek queue on devId 2, qid is 3.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:50.208.388 [tensor_data_transfer.cpp:612]618949 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_scalar_summary
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:50.208.390 [npu_driver.cc:4330] 618947 MemQueuePeek: peek mem queue, deviceId=2, qid=3, timeout=800.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:50.208.400 [tensor_data_transfer.cpp:1054]618949 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_scalar_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:50.208.411 [tensor_data_transfer.cpp:1056]618949 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:50.208.422 [api_impl.cc:6121] 618949 MemQueuePeek: Start to peek queue on devId 2, qid is 4.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:50.208.424 [npu_driver.cc:4338] 618943 MemQueuePeek: queue empty
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:50.208.432 [npu_driver.cc:4330] 618949 MemQueuePeek: peek mem queue, deviceId=2, qid=4, timeout=800.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:50.208.437 [tensor_data_transfer.cpp:612]618943 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_tensor_dump
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:50.208.451 [tensor_data_transfer.cpp:1054]618943 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_tensor_dump
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:50.208.462 [npu_driver.cc:4338] 618941 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:50.208.463 [tensor_data_transfer.cpp:1056]618943 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:50.208.474 [tensor_data_transfer.cpp:612]618941 acltdtReceiveTensorV2: queue is empty, device is 2, name is _npu_log
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:50.208.486 [api_impl.cc:6121] 618943 MemQueuePeek: Start to peek queue on devId 2, qid is 1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:50.208.497 [npu_driver.cc:4330] 618943 MemQueuePeek: peek mem queue, deviceId=2, qid=1, timeout=800.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:50.208.504 [npu_driver.cc:4338] 618945 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:50.208.520 [tensor_data_transfer.cpp:612]618945 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_tensor_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:50.208.535 [tensor_data_transfer.cpp:1054]618945 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 2, name is ms_tensor_summary
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:50.208.547 [tensor_data_transfer.cpp:1056]618945 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:50.208.558 [api_impl.cc:6121] 618945 MemQueuePeek: Start to peek queue on devId 2, qid is 2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:50.208.568 [npu_driver.cc:4330] 618945 MemQueuePeek: peek mem queue, deviceId=2, qid=2, timeout=800.
[INFO] DEVICE(618654,fffeeccdefa0,python3.9):2025-04-03-09:27:50.208.631 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:50.208.759 [tensor_data_transfer.cpp:973]618654 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 2, name is _npu_log
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:50.208.778 [api_impl.cc:6065] 618654 MemQueueDestroy: Start to destroy queue on devId 2, qid is 0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:50.208.791 [npu_driver.cc:3989] 618654 MemQueueDestroy: deviceId=2, qid=0.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:50.209.207 [tensor_data_transfer.cpp:977]618654 acltdtDestroyChannel: acltdtDestroyChannel success, device is 2, name is _npu_log
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:50.209.241 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_histogram_summary channel is being destroyed.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:50.209.260 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_histogram_summary begins the destruction process.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:50.216.720 [runtime.cc:5239] 618812 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:50.216.745 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618812] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:50.216.755 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618812] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:50.216.765 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618812] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:50.216.779 [runtime.cc:3077] 618812 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=7, devId=7, tdt status=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:50.216.830 [npu_driver.cc:551] 618812 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:50.220.720 [runtime.cc:5239] 618830 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:50.220.720 [runtime.cc:5239] 618806 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:50.220.720 [runtime.cc:5239] 618814 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:50.220.753 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618814] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:50.220.751 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618830] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:50.220.766 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618830] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:50.220.754 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618806] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:50.220.769 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618806] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:50.220.771 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618814] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:50.220.787 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618814] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:50.220.778 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618830] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:50.220.795 [runtime.cc:3077] 618830 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=2, devId=2, tdt status=0
[INFO] TDT(618666,python3.9):2025-04-03-09:27:50.220.781 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618806] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:50.220.799 [runtime.cc:3077] 618806 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=5, devId=5, tdt status=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:50.220.805 [runtime.cc:3077] 618814 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=4, devId=4, tdt status=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:50.220.860 [npu_driver.cc:551] 618830 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:50.220.871 [npu_driver.cc:551] 618806 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:50.220.874 [npu_driver.cc:551] 618814 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:50.276.180 [queue_client_comm.c:114][ascend][curpid:618646,618963][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:50.276.186 [queue_client_comm.c:114][ascend][curpid:618646,618961][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:50.276.189 [queue_client_comm.c:114][ascend][curpid:618646,618965][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:50.276.309 [npu_driver.cc:4338] 618963 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:50.276.334 [tensor_data_transfer.cpp:612]618963 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_tensor_dump
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:50.276.335 [npu_driver.cc:4338] 618961 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:50.276.355 [tensor_data_transfer.cpp:1054]618963 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_tensor_dump
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:50.276.364 [npu_driver.cc:4338] 618965 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:50.276.365 [tensor_data_transfer.cpp:612]618961 acltdtReceiveTensorV2: queue is empty, device is 0, name is _npu_log
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:50.276.373 [tensor_data_transfer.cpp:1056]618963 acltdtReceiveTensor: new process, use queue process
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:50.276.383 [tensor_data_transfer.cpp:612]618965 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_tensor_summary
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:50.276.415 [api_impl.cc:6121] 618963 MemQueuePeek: Start to peek queue on devId 0, qid is 1.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:50.276.423 [tensor_data_transfer.cpp:1054]618965 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 0, name is ms_tensor_summary
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:50.276.433 [npu_driver.cc:4330] 618963 MemQueuePeek: peek mem queue, deviceId=0, qid=1, timeout=800.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:50.276.440 [tensor_data_transfer.cpp:1056]618965 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:50.276.461 [api_impl.cc:6121] 618965 MemQueuePeek: Start to peek queue on devId 0, qid is 2.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:50.276.473 [npu_driver.cc:4330] 618965 MemQueuePeek: peek mem queue, deviceId=0, qid=2, timeout=800.
[INFO] DEVICE(618646,fffee3c1cfa0,python3.9):2025-04-03-09:27:50.276.510 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:50.276.708 [tensor_data_transfer.cpp:973]618646 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 0, name is _npu_log
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:50.276.739 [api_impl.cc:6065] 618646 MemQueueDestroy: Start to destroy queue on devId 0, qid is 0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:50.276.753 [npu_driver.cc:3989] 618646 MemQueueDestroy: deviceId=0, qid=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:50.277.197 [tensor_data_transfer.cpp:977]618646 acltdtDestroyChannel: acltdtDestroyChannel success, device is 0, name is _npu_log
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:50.277.246 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_histogram_summary channel is being destroyed.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:50.277.268 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_histogram_summary begins the destruction process.
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:50.304.177 [queue_client_comm.c:114][ascend][curpid:618646,618971][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:50.304.273 [npu_driver.cc:4338] 618971 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:50.304.293 [tensor_data_transfer.cpp:612]618971 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_histogram_summary
[INFO] DEVICE(618646,fffeabffefa0,python3.9):2025-04-03-09:27:50.304.435 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:50.304.708 [tensor_data_transfer.cpp:973]618646 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 0, name is ms_histogram_summary
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:50.304.731 [api_impl.cc:6065] 618646 MemQueueDestroy: Start to destroy queue on devId 0, qid is 5.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:50.304.744 [npu_driver.cc:3989] 618646 MemQueueDestroy: deviceId=0, qid=5.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:50.305.150 [tensor_data_transfer.cpp:977]618646 acltdtDestroyChannel: acltdtDestroyChannel success, device is 0, name is ms_histogram_summary
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:50.305.178 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_scalar_summary channel is being destroyed.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:50.305.207 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_scalar_summary begins the destruction process.
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:50.308.179 [queue_client_comm.c:114][ascend][curpid:618646,618967][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:50.308.179 [queue_client_comm.c:114][ascend][curpid:618646,618969][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:50.308.277 [npu_driver.cc:4338] 618967 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:50.308.293 [tensor_data_transfer.cpp:612]618967 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_image_summary
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:50.308.305 [npu_driver.cc:4338] 618969 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:50.308.321 [tensor_data_transfer.cpp:612]618969 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_scalar_summary
[INFO] DEVICE(618646,fffece7cefa0,python3.9):2025-04-03-09:27:50.308.411 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] DEVICE(618646,fffecd7aefa0,python3.9):2025-04-03-09:27:50.308.420 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:50.308.525 [tensor_data_transfer.cpp:973]618646 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 0, name is ms_scalar_summary
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:50.308.542 [api_impl.cc:6065] 618646 MemQueueDestroy: Start to destroy queue on devId 0, qid is 4.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:50.308.555 [npu_driver.cc:3989] 618646 MemQueueDestroy: deviceId=0, qid=4.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:50.308.923 [tensor_data_transfer.cpp:977]618646 acltdtDestroyChannel: acltdtDestroyChannel success, device is 0, name is ms_scalar_summary
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:50.308.952 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_image_summary channel is being destroyed.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:50.308.971 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_image_summary begins the destruction process.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:50.309.056 [tensor_data_transfer.cpp:973]618646 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 0, name is ms_image_summary
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:50.309.071 [api_impl.cc:6065] 618646 MemQueueDestroy: Start to destroy queue on devId 0, qid is 3.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:50.309.082 [npu_driver.cc:3989] 618646 MemQueueDestroy: deviceId=0, qid=3.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:50.309.402 [tensor_data_transfer.cpp:977]618646 acltdtDestroyChannel: acltdtDestroyChannel success, device is 0, name is ms_image_summary
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:50.309.427 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_tensor_summary channel is being destroyed.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:50.309.445 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_tensor_summary begins the destruction process.
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:50.688.183 [queue_client_comm.c:114][ascend][curpid:618658,618783][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:50.688.303 [npu_driver.cc:4338] 618783 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:50.688.325 [tensor_data_transfer.cpp:612]618783 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_tensor_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:50.688.342 [tensor_data_transfer.cpp:1054]618783 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_tensor_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:50.688.357 [tensor_data_transfer.cpp:1056]618783 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:50.688.369 [api_impl.cc:6121] 618783 MemQueuePeek: Start to peek queue on devId 3, qid is 2.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:50.688.382 [npu_driver.cc:4330] 618783 MemQueuePeek: peek mem queue, deviceId=3, qid=2, timeout=800.
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:50.692.171 [queue_client_comm.c:114][ascend][curpid:618658,618779][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:50.692.178 [queue_client_comm.c:114][ascend][curpid:618658,618787][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=33; gid=44; tid=5; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:50.692.178 [queue_client_comm.c:114][ascend][curpid:618658,618781][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:50.692.179 [queue_client_comm.c:114][ascend][curpid:618658,618785][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:50.692.194 [queue_client_comm.c:114][ascend][curpid:618658,618789][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:50.692.269 [npu_driver.cc:4338] 618779 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:50.692.289 [tensor_data_transfer.cpp:612]618779 acltdtReceiveTensorV2: queue is empty, device is 3, name is _npu_log
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:50.692.303 [npu_driver.cc:4338] 618787 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:50.692.324 [tensor_data_transfer.cpp:612]618787 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_scalar_summary
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:50.692.329 [npu_driver.cc:4338] 618781 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:50.692.345 [tensor_data_transfer.cpp:1054]618787 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_scalar_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:50.692.356 [tensor_data_transfer.cpp:612]618781 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_tensor_dump
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:50.692.363 [tensor_data_transfer.cpp:1056]618787 acltdtReceiveTensor: new process, use queue process
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:50.692.363 [npu_driver.cc:4338] 618785 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:50.692.377 [tensor_data_transfer.cpp:1054]618781 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_tensor_dump
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:50.692.386 [api_impl.cc:6121] 618787 MemQueuePeek: Start to peek queue on devId 3, qid is 4.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:50.692.391 [npu_driver.cc:4338] 618789 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:50.692.397 [tensor_data_transfer.cpp:612]618785 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_image_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:50.692.405 [tensor_data_transfer.cpp:1056]618781 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:50.692.441 [npu_driver.cc:4330] 618787 MemQueuePeek: peek mem queue, deviceId=3, qid=4, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:50.692.454 [tensor_data_transfer.cpp:612]618789 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_histogram_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:50.692.466 [tensor_data_transfer.cpp:1054]618785 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_image_summary
[INFO] DEVICE(618658,ffff12d7dfa0,python3.9):2025-04-03-09:27:50.692.472 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:50.692.476 [api_impl.cc:6121] 618781 MemQueuePeek: Start to peek queue on devId 3, qid is 1.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:50.692.498 [tensor_data_transfer.cpp:1054]618789 acltdtReceiveTensor: start to execute acltdtReceiveTensor, device is 3, name is ms_histogram_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:50.692.506 [tensor_data_transfer.cpp:1056]618785 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:50.692.527 [npu_driver.cc:4330] 618781 MemQueuePeek: peek mem queue, deviceId=3, qid=1, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:50.692.538 [tensor_data_transfer.cpp:1056]618789 acltdtReceiveTensor: new process, use queue process
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:50.692.554 [api_impl.cc:6121] 618785 MemQueuePeek: Start to peek queue on devId 3, qid is 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:50.692.577 [api_impl.cc:6121] 618789 MemQueuePeek: Start to peek queue on devId 3, qid is 5.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:50.692.586 [npu_driver.cc:4330] 618785 MemQueuePeek: peek mem queue, deviceId=3, qid=3, timeout=800.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:50.692.598 [npu_driver.cc:4330] 618789 MemQueuePeek: peek mem queue, deviceId=3, qid=5, timeout=800.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:50.692.622 [tensor_data_transfer.cpp:973]618658 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 3, name is _npu_log
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:50.692.648 [api_impl.cc:6065] 618658 MemQueueDestroy: Start to destroy queue on devId 3, qid is 0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:50.692.666 [npu_driver.cc:3989] 618658 MemQueueDestroy: deviceId=3, qid=0.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:50.693.109 [tensor_data_transfer.cpp:977]618658 acltdtDestroyChannel: acltdtDestroyChannel success, device is 3, name is _npu_log
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:50.693.149 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_histogram_summary channel is being destroyed.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:50.693.172 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_histogram_summary begins the destruction process.
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:50.756.177 [queue_client_comm.c:114][ascend][curpid:618666,618845][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618666,python3.9):2025-04-03-09:27:50.756.189 [queue_client_comm.c:114][ascend][curpid:618666,618849][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:50.756.280 [npu_driver.cc:4338] 618845 MemQueuePeek: queue empty
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:50.756.307 [npu_driver.cc:4338] 618849 MemQueuePeek: queue empty
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:50.756.308 [tensor_data_transfer.cpp:612]618845 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_tensor_summary
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:50.756.326 [tensor_data_transfer.cpp:612]618849 acltdtReceiveTensorV2: queue is empty, device is 5, name is ms_scalar_summary
[INFO] DEVICE(618666,fffecfffefa0,python3.9):2025-04-03-09:27:50.756.441 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] DEVICE(618666,fffecdfbefa0,python3.9):2025-04-03-09:27:50.756.454 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:50.756.674 [tensor_data_transfer.cpp:973]618666 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 5, name is ms_scalar_summary
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:50.756.701 [api_impl.cc:6065] 618666 MemQueueDestroy: Start to destroy queue on devId 5, qid is 4.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:50.756.714 [npu_driver.cc:3989] 618666 MemQueueDestroy: deviceId=5, qid=4.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:50.757.064 [tensor_data_transfer.cpp:977]618666 acltdtDestroyChannel: acltdtDestroyChannel success, device is 5, name is ms_scalar_summary
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.757.099 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_image_summary channel is being destroyed.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.757.121 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_image_summary begins the destruction process.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:50.757.178 [tensor_data_transfer.cpp:973]618666 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 5, name is ms_image_summary
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:50.757.196 [api_impl.cc:6065] 618666 MemQueueDestroy: Start to destroy queue on devId 5, qid is 3.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:50.757.208 [npu_driver.cc:3989] 618666 MemQueueDestroy: deviceId=5, qid=3.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:50.757.545 [tensor_data_transfer.cpp:977]618666 acltdtDestroyChannel: acltdtDestroyChannel success, device is 5, name is ms_image_summary
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.757.573 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_tensor_summary channel is being destroyed.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.757.591 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_tensor_summary begins the destruction process.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:50.757.630 [tensor_data_transfer.cpp:973]618666 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 5, name is ms_tensor_summary
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:50.757.646 [api_impl.cc:6065] 618666 MemQueueDestroy: Start to destroy queue on devId 5, qid is 2.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:50.757.658 [npu_driver.cc:3989] 618666 MemQueueDestroy: deviceId=5, qid=2.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:50.758.089 [tensor_data_transfer.cpp:977]618666 acltdtDestroyChannel: acltdtDestroyChannel success, device is 5, name is ms_tensor_summary
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.758.113 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_tensor_dump channel is being destroyed.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.758.131 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_tensor_dump begins the destruction process.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:50.758.177 [tensor_data_transfer.cpp:973]618666 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 5, name is ms_tensor_dump
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:50.758.192 [api_impl.cc:6065] 618666 MemQueueDestroy: Start to destroy queue on devId 5, qid is 1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:50.758.204 [npu_driver.cc:3989] 618666 MemQueueDestroy: deviceId=5, qid=1.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:50.758.562 [tensor_data_transfer.cpp:977]618666 acltdtDestroyChannel: acltdtDestroyChannel success, device is 5, name is ms_tensor_dump
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:50.758.580 [device.cpp:183]618666 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:50.758.597 [api_impl.cc:3419] 618666 DeviceReset: reset device, device_id=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:50.758.608 [runtime.cc:3444] 618666 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x4, reset:0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:50.758.621 [api_impl.cc:3449] 618666 DeviceReset: Succ, userDeviceId=5.
[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:50.758.630 [device.cpp:189]618666 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 5.
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.758.652 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ascend_deprecated_interface.cc:136] CloseTsd] Call aclrtResetDevice, destroy and close tsd successful, ret[0]
[INFO] ME(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.758.675 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:401] ClearDeviceContexts] Release device CPU_0
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.758.705 [mindspore/ccsrc/pybind_api/resource/manager.cc:167] ClearResPart2] End clear device context.
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.758.720 [mindspore/ccsrc/pybind_api/resource/manager.cc:169] ClearResPart2] Start clear kernel runtime...
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.758.736 [mindspore/ccsrc/runtime/device/kernel_runtime_manager.cc:26] ClearRuntimeResource] Release device Ascend_5
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.758.751 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:178] ReleaseDeviceRes] Ascend finalize start
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.758.771 [mindspore/ccsrc/pybind_api/resource/manager.cc:171] ClearResPart2] End clear kernel runtime.
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.758.784 [mindspore/ccsrc/pybind_api/resource/manager.cc:173] ClearResPart2] Start clear CollectiveManager...
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.758.803 [mindspore/ccsrc/distributed/collective/collective_manager.cc:539] Finalize] Begin finalize collective manager.
[INFO] DISTRIBUTED(618666,fffee4bd8fa0,python3.9):2025-04-03-09:27:50.758.955 [mindspore/ccsrc/distributed/collective/collective_manager.cc:513] operator()] Start finalizing host communication lib.
[INFO] DEVICE(618666,fffee4bd8fa0,python3.9):2025-04-03-09:27:50.758.982 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:64] Finish] Begin to finish the cpu collective node.
[INFO] DEVICE(618666,fffee4bd8fa0,python3.9):2025-04-03-09:27:50.758.997 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:69] Finish] The cpu collective node has been finished successfully.
[INFO] PS(618666,fffee4bd8fa0,python3.9):2025-04-03-09:27:50.759.012 [mindspore/ccsrc/ps/core/ps_worker_node.cc:45] Stop] Stop worker node!
[INFO] PS(618666,fffee4bd8fa0,python3.9):2025-04-03-09:27:50.759.030 [mindspore/ccsrc/ps/core/communicator/tcp_client.cc:176] Stop] Stop tcp client!
[INFO] PS(618666,fffee4bd8fa0,python3.9):2025-04-03-09:27:50.759.061 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:232] Stop] Stop tcp server!
[INFO] DISTRIBUTED(618666,fffee4bd8fa0,python3.9):2025-04-03-09:27:50.759.080 [mindspore/ccsrc/distributed/collective/collective_manager.cc:517] operator()] End finalizing host communication lib.
[INFO] PS(618666,ffff1efdefa0,python3.9):2025-04-03-09:27:50.759.102 [mindspore/ccsrc/ps/core/communicator/tcp_client.cc:318] Start] Event base dispatch success!
[INFO] DISTRIBUTED(618666,fffee4bd8fa0,python3.9):2025-04-03-09:27:50.759.093 [mindspore/ccsrc/distributed/collective/collective_manager.cc:522] operator()] Start finalizing device communication lib.
[INFO] PS(618666,ffff1f7eefa0,python3.9):2025-04-03-09:27:50.759.101 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:220] Start] Event base dispatch success!
[INFO] DISTRIBUTED(618666,fffee4bd8fa0,python3.9):2025-04-03-09:27:50.759.133 [mindspore/ccsrc/distributed/collective/collective_manager.cc:526] operator()] End finalizing device communication lib.
[INFO] DISTRIBUTED(618666,fffeb17aefa0,python3.9):2025-04-03-09:27:50.759.176 [mindspore/ccsrc/distributed/collective/collective_manager.cc:960] RunInitCommTasks] Initialize communciator thread is stopped.
[INFO] DISTRIBUTED(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.759.254 [mindspore/ccsrc/distributed/collective/collective_manager.cc:547] Finalize] End finalize collective manager.
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.759.272 [mindspore/ccsrc/pybind_api/resource/manager.cc:176] ClearResPart2] End clear CollectiveManager.
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.759.286 [mindspore/ccsrc/pybind_api/resource/manager.cc:178] ClearResPart2] Start clear AnalysisResultCacheMgr...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.759.303 [mindspore/ccsrc/pybind_api/resource/manager.cc:180] ClearResPart2] End clear AnalysisResultCacheMgr.
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.759.317 [mindspore/ccsrc/pybind_api/resource/manager.cc:182] ClearResPart2] Start clear AnalysisContext...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.759.331 [mindspore/ccsrc/pybind_api/resource/manager.cc:184] ClearResPart2] End clear AnalysisContext...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.759.344 [mindspore/ccsrc/pybind_api/resource/manager.cc:186] ClearResPart2] Start clear AnalysisSchedule...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.759.446 [mindspore/ccsrc/pybind_api/resource/manager.cc:188] ClearResPart2] End clear AnalysisSchedule...
[INFO] DEBUG(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.759.467 [mindspore/ccsrc/debug/debugger/debugger.cc:149] Reset] Release Debugger resource.
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.759.500 [mindspore/ccsrc/pybind_api/resource/manager.cc:200] ClearResPart3] Start clear ClearObjectCache...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.759.516 [mindspore/ccsrc/pybind_api/resource/manager.cc:202] ClearResPart3] End clear ClearObjectCache...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.759.529 [mindspore/ccsrc/pybind_api/resource/manager.cc:204] ClearResPart3] Start clear Parser...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.759.544 [mindspore/ccsrc/pybind_api/resource/manager.cc:206] ClearResPart3] End clear Parser...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.759.557 [mindspore/ccsrc/pybind_api/resource/manager.cc:208] ClearResPart3] Start ClearTraceStack...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.759.617 [mindspore/ccsrc/pybind_api/resource/manager.cc:210] ClearResPart3] End ClearTraceStack...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.759.631 [mindspore/ccsrc/pybind_api/resource/manager.cc:212] ClearResPart3] Start clear InterpretNodeRecorder...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.759.645 [mindspore/ccsrc/pybind_api/resource/manager.cc:214] ClearResPart3] End clear InterpretNodeRecorder...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.759.670 [mindspore/ccsrc/pybind_api/resource/manager.cc:216] ClearResPart3] Start clear parallel::entire_costgraph...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.759.685 [mindspore/ccsrc/pybind_api/resource/manager.cc:218] ClearResPart3] End clear parallel::entire_costgraph...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.759.699 [mindspore/ccsrc/pybind_api/resource/manager.cc:220] ClearResPart3] Start clear ProtobufLibrary...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.759.862 [mindspore/ccsrc/pybind_api/resource/manager.cc:222] ClearResPart3] End clear ProtobufLibrary...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.759.879 [mindspore/ccsrc/pybind_api/resource/manager.cc:224] ClearResPart3] Start clear ParserDefaultObjects ...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.759.894 [mindspore/ccsrc/pybind_api/resource/manager.cc:226] ClearResPart3] End clear ParserDefaultObjects...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.759.908 [mindspore/ccsrc/pybind_api/resource/manager.cc:231] ClearResPart3] Start clear python_adapter...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.759.922 [mindspore/ccsrc/pybind_api/resource/manager.cc:233] ClearResPart3] End clear python_adapter.
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.759.936 [mindspore/ccsrc/pybind_api/resource/manager.cc:237] ClearSingleton] Start clear singleton...
[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:50.760.000 [mindspore/ccsrc/pybind_api/resource/manager.cc:255] ClearSingleton] End clear singleton.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:50.789.709 [awatchdog_monitor.c:160](tid:618693) thread 618857 not exist
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:50.816.193 [queue_client_comm.c:114][ascend][curpid:618674,618881][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:50.816.298 [npu_driver.cc:4338] 618881 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:50.816.314 [tensor_data_transfer.cpp:612]618881 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_scalar_summary
[INFO] DEVICE(618674,fffec2fdefa0,python3.9):2025-04-03-09:27:50.816.420 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:50.816.541 [tensor_data_transfer.cpp:973]618674 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 7, name is ms_scalar_summary
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:50.816.568 [api_impl.cc:6065] 618674 MemQueueDestroy: Start to destroy queue on devId 7, qid is 4.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:50.816.581 [npu_driver.cc:3989] 618674 MemQueueDestroy: deviceId=7, qid=4.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:50.817.018 [tensor_data_transfer.cpp:977]618674 acltdtDestroyChannel: acltdtDestroyChannel success, device is 7, name is ms_scalar_summary
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.817.047 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_image_summary channel is being destroyed.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.817.070 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_image_summary begins the destruction process.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:50.817.119 [tensor_data_transfer.cpp:973]618674 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 7, name is ms_image_summary
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:50.817.139 [api_impl.cc:6065] 618674 MemQueueDestroy: Start to destroy queue on devId 7, qid is 3.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:50.817.152 [npu_driver.cc:3989] 618674 MemQueueDestroy: deviceId=7, qid=3.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:50.817.519 [tensor_data_transfer.cpp:977]618674 acltdtDestroyChannel: acltdtDestroyChannel success, device is 7, name is ms_image_summary
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.817.546 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_tensor_summary channel is being destroyed.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.817.567 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_tensor_summary begins the destruction process.
[WARNING] DRV(618674,python3.9):2025-04-03-09:27:50.820.199 [queue_client_comm.c:114][ascend][curpid:618674,618873][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618662,python3.9):2025-04-03-09:27:50.820.207 [queue_client_comm.c:114][ascend][curpid:618662,618872][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:50.820.309 [npu_driver.cc:4338] 618873 MemQueuePeek: queue empty
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:50.820.331 [tensor_data_transfer.cpp:612]618873 acltdtReceiveTensorV2: queue is empty, device is 7, name is ms_tensor_summary
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:50.820.322 [npu_driver.cc:4338] 618872 MemQueuePeek: queue empty
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:50.820.345 [tensor_data_transfer.cpp:612]618872 acltdtReceiveTensorV2: queue is empty, device is 4, name is ms_tensor_summary
[INFO] DEVICE(618674,fffee1521fa0,python3.9):2025-04-03-09:27:50.820.454 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] DEVICE(618662,ffff0cc29fa0,python3.9):2025-04-03-09:27:50.820.455 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:50.820.561 [tensor_data_transfer.cpp:973]618674 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 7, name is ms_tensor_summary
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:50.820.581 [api_impl.cc:6065] 618674 MemQueueDestroy: Start to destroy queue on devId 7, qid is 2.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:50.820.594 [npu_driver.cc:3989] 618674 MemQueueDestroy: deviceId=7, qid=2.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:50.820.628 [tensor_data_transfer.cpp:973]618662 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 4, name is ms_tensor_summary
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:50.820.656 [api_impl.cc:6065] 618662 MemQueueDestroy: Start to destroy queue on devId 4, qid is 2.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:50.820.670 [npu_driver.cc:3989] 618662 MemQueueDestroy: deviceId=4, qid=2.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:50.820.993 [tensor_data_transfer.cpp:977]618674 acltdtDestroyChannel: acltdtDestroyChannel success, device is 7, name is ms_tensor_summary
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.821.022 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_tensor_dump channel is being destroyed.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.821.043 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_tensor_dump begins the destruction process.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:50.821.070 [tensor_data_transfer.cpp:977]618662 acltdtDestroyChannel: acltdtDestroyChannel success, device is 4, name is ms_tensor_summary
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.821.109 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_tensor_dump channel is being destroyed.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.821.135 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_tensor_dump begins the destruction process.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:50.821.154 [tensor_data_transfer.cpp:973]618674 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 7, name is ms_tensor_dump
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:50.821.174 [api_impl.cc:6065] 618674 MemQueueDestroy: Start to destroy queue on devId 7, qid is 1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:50.821.188 [npu_driver.cc:3989] 618674 MemQueueDestroy: deviceId=7, qid=1.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:50.821.190 [tensor_data_transfer.cpp:973]618662 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 4, name is ms_tensor_dump
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:50.821.222 [api_impl.cc:6065] 618662 MemQueueDestroy: Start to destroy queue on devId 4, qid is 1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:50.821.235 [npu_driver.cc:3989] 618662 MemQueueDestroy: deviceId=4, qid=1.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:50.821.542 [tensor_data_transfer.cpp:977]618674 acltdtDestroyChannel: acltdtDestroyChannel success, device is 7, name is ms_tensor_dump
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:50.821.565 [device.cpp:183]618674 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 7.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:50.821.587 [api_impl.cc:3419] 618674 DeviceReset: reset device, device_id=7.
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:50.821.587 [tensor_data_transfer.cpp:977]618662 acltdtDestroyChannel: acltdtDestroyChannel success, device is 4, name is ms_tensor_dump
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:50.821.603 [runtime.cc:3444] 618674 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x4, reset:0
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:50.821.608 [device.cpp:183]618662 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 4.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:50.821.617 [api_impl.cc:3449] 618674 DeviceReset: Succ, userDeviceId=7.
[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:50.821.629 [device.cpp:189]618674 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 7.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:50.821.626 [api_impl.cc:3419] 618662 DeviceReset: reset device, device_id=4.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:50.821.639 [runtime.cc:3444] 618662 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x4, reset:0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:50.821.652 [api_impl.cc:3449] 618662 DeviceReset: Succ, userDeviceId=4.
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.821.654 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ascend_deprecated_interface.cc:136] CloseTsd] Call aclrtResetDevice, destroy and close tsd successful, ret[0]
[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:50.821.664 [device.cpp:189]618662 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 4.
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.821.688 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ascend_deprecated_interface.cc:136] CloseTsd] Call aclrtResetDevice, destroy and close tsd successful, ret[0]
[INFO] ME(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.821.683 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:401] ClearDeviceContexts] Release device CPU_0
[INFO] ME(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.821.712 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:401] ClearDeviceContexts] Release device CPU_0
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.821.729 [mindspore/ccsrc/pybind_api/resource/manager.cc:167] ClearResPart2] End clear device context.
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.821.745 [mindspore/ccsrc/pybind_api/resource/manager.cc:167] ClearResPart2] End clear device context.
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.821.749 [mindspore/ccsrc/pybind_api/resource/manager.cc:169] ClearResPart2] Start clear kernel runtime...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.821.765 [mindspore/ccsrc/pybind_api/resource/manager.cc:169] ClearResPart2] Start clear kernel runtime...
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.821.774 [mindspore/ccsrc/runtime/device/kernel_runtime_manager.cc:26] ClearRuntimeResource] Release device Ascend_7
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.821.784 [mindspore/ccsrc/runtime/device/kernel_runtime_manager.cc:26] ClearRuntimeResource] Release device Ascend_4
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.821.790 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:178] ReleaseDeviceRes] Ascend finalize start
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.821.800 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:178] ReleaseDeviceRes] Ascend finalize start
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.821.819 [mindspore/ccsrc/pybind_api/resource/manager.cc:171] ClearResPart2] End clear kernel runtime.
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.821.811 [mindspore/ccsrc/pybind_api/resource/manager.cc:171] ClearResPart2] End clear kernel runtime.
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.821.827 [mindspore/ccsrc/pybind_api/resource/manager.cc:173] ClearResPart2] Start clear CollectiveManager...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.821.835 [mindspore/ccsrc/pybind_api/resource/manager.cc:173] ClearResPart2] Start clear CollectiveManager...
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.821.852 [mindspore/ccsrc/distributed/collective/collective_manager.cc:539] Finalize] Begin finalize collective manager.
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.821.857 [mindspore/ccsrc/distributed/collective/collective_manager.cc:539] Finalize] Begin finalize collective manager.
[INFO] DISTRIBUTED(618662,ffff0d439fa0,python3.9):2025-04-03-09:27:50.822.029 [mindspore/ccsrc/distributed/collective/collective_manager.cc:513] operator()] Start finalizing host communication lib.
[INFO] DISTRIBUTED(618674,fffee1d31fa0,python3.9):2025-04-03-09:27:50.822.045 [mindspore/ccsrc/distributed/collective/collective_manager.cc:513] operator()] Start finalizing host communication lib.
[INFO] DEVICE(618662,ffff0d439fa0,python3.9):2025-04-03-09:27:50.822.061 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:64] Finish] Begin to finish the cpu collective node.
[INFO] DEVICE(618662,ffff0d439fa0,python3.9):2025-04-03-09:27:50.822.081 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:69] Finish] The cpu collective node has been finished successfully.
[INFO] PS(618662,ffff0d439fa0,python3.9):2025-04-03-09:27:50.822.098 [mindspore/ccsrc/ps/core/ps_worker_node.cc:45] Stop] Stop worker node!
[INFO] DEVICE(618674,fffee1d31fa0,python3.9):2025-04-03-09:27:50.822.074 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:64] Finish] Begin to finish the cpu collective node.
[INFO] DEVICE(618674,fffee1d31fa0,python3.9):2025-04-03-09:27:50.822.105 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:69] Finish] The cpu collective node has been finished successfully.
[INFO] PS(618662,ffff0d439fa0,python3.9):2025-04-03-09:27:50.822.123 [mindspore/ccsrc/ps/core/communicator/tcp_client.cc:176] Stop] Stop tcp client!
[INFO] PS(618674,fffee1d31fa0,python3.9):2025-04-03-09:27:50.822.125 [mindspore/ccsrc/ps/core/ps_worker_node.cc:45] Stop] Stop worker node!
[INFO] PS(618674,fffee1d31fa0,python3.9):2025-04-03-09:27:50.822.151 [mindspore/ccsrc/ps/core/communicator/tcp_client.cc:176] Stop] Stop tcp client!
[INFO] PS(618662,ffff0d439fa0,python3.9):2025-04-03-09:27:50.822.152 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:232] Stop] Stop tcp server!
[INFO] PS(618674,fffee1d31fa0,python3.9):2025-04-03-09:27:50.822.175 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:232] Stop] Stop tcp server!
[INFO] DISTRIBUTED(618662,ffff0d439fa0,python3.9):2025-04-03-09:27:50.822.177 [mindspore/ccsrc/distributed/collective/collective_manager.cc:517] operator()] End finalizing host communication lib.
[INFO] DISTRIBUTED(618674,fffee1d31fa0,python3.9):2025-04-03-09:27:50.822.200 [mindspore/ccsrc/distributed/collective/collective_manager.cc:517] operator()] End finalizing host communication lib.
[INFO] DISTRIBUTED(618662,ffff0d439fa0,python3.9):2025-04-03-09:27:50.822.195 [mindspore/ccsrc/distributed/collective/collective_manager.cc:522] operator()] Start finalizing device communication lib.
[INFO] PS(618662,ffff3f7eefa0,python3.9):2025-04-03-09:27:50.822.212 [mindspore/ccsrc/ps/core/communicator/tcp_client.cc:318] Start] Event base dispatch success!
[INFO] DISTRIBUTED(618674,fffee1d31fa0,python3.9):2025-04-03-09:27:50.822.218 [mindspore/ccsrc/distributed/collective/collective_manager.cc:522] operator()] Start finalizing device communication lib.
[INFO] PS(618674,ffff13ffefa0,python3.9):2025-04-03-09:27:50.822.220 [mindspore/ccsrc/ps/core/communicator/tcp_client.cc:318] Start] Event base dispatch success!
[INFO] PS(618662,ffff3fffefa0,python3.9):2025-04-03-09:27:50.822.206 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:220] Start] Event base dispatch success!
[INFO] PS(618674,ffff29003fa0,python3.9):2025-04-03-09:27:50.822.230 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:220] Start] Event base dispatch success!
[INFO] DISTRIBUTED(618662,ffff0d439fa0,python3.9):2025-04-03-09:27:50.822.227 [mindspore/ccsrc/distributed/collective/collective_manager.cc:526] operator()] End finalizing device communication lib.
[INFO] DISTRIBUTED(618674,fffee1d31fa0,python3.9):2025-04-03-09:27:50.822.234 [mindspore/ccsrc/distributed/collective/collective_manager.cc:526] operator()] End finalizing device communication lib.
[INFO] DISTRIBUTED(618662,fffed1fbefa0,python3.9):2025-04-03-09:27:50.822.300 [mindspore/ccsrc/distributed/collective/collective_manager.cc:960] RunInitCommTasks] Initialize communciator thread is stopped.
[INFO] DISTRIBUTED(618674,fffea67cefa0,python3.9):2025-04-03-09:27:50.822.313 [mindspore/ccsrc/distributed/collective/collective_manager.cc:960] RunInitCommTasks] Initialize communciator thread is stopped.
[INFO] DISTRIBUTED(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.822.394 [mindspore/ccsrc/distributed/collective/collective_manager.cc:547] Finalize] End finalize collective manager.
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.822.420 [mindspore/ccsrc/pybind_api/resource/manager.cc:176] ClearResPart2] End clear CollectiveManager.
[INFO] DISTRIBUTED(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.822.417 [mindspore/ccsrc/distributed/collective/collective_manager.cc:547] Finalize] End finalize collective manager.
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.822.436 [mindspore/ccsrc/pybind_api/resource/manager.cc:178] ClearResPart2] Start clear AnalysisResultCacheMgr...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.822.443 [mindspore/ccsrc/pybind_api/resource/manager.cc:176] ClearResPart2] End clear CollectiveManager.
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.822.462 [mindspore/ccsrc/pybind_api/resource/manager.cc:178] ClearResPart2] Start clear AnalysisResultCacheMgr...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.822.461 [mindspore/ccsrc/pybind_api/resource/manager.cc:180] ClearResPart2] End clear AnalysisResultCacheMgr.
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.822.479 [mindspore/ccsrc/pybind_api/resource/manager.cc:182] ClearResPart2] Start clear AnalysisContext...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.822.491 [mindspore/ccsrc/pybind_api/resource/manager.cc:180] ClearResPart2] End clear AnalysisResultCacheMgr.
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.822.496 [mindspore/ccsrc/pybind_api/resource/manager.cc:184] ClearResPart2] End clear AnalysisContext...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.822.509 [mindspore/ccsrc/pybind_api/resource/manager.cc:182] ClearResPart2] Start clear AnalysisContext...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.822.510 [mindspore/ccsrc/pybind_api/resource/manager.cc:186] ClearResPart2] Start clear AnalysisSchedule...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.822.525 [mindspore/ccsrc/pybind_api/resource/manager.cc:184] ClearResPart2] End clear AnalysisContext...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.822.540 [mindspore/ccsrc/pybind_api/resource/manager.cc:186] ClearResPart2] Start clear AnalysisSchedule...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.822.628 [mindspore/ccsrc/pybind_api/resource/manager.cc:188] ClearResPart2] End clear AnalysisSchedule...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.822.645 [mindspore/ccsrc/pybind_api/resource/manager.cc:188] ClearResPart2] End clear AnalysisSchedule...
[INFO] DEBUG(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.822.657 [mindspore/ccsrc/debug/debugger/debugger.cc:149] Reset] Release Debugger resource.
[INFO] DEBUG(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.822.671 [mindspore/ccsrc/debug/debugger/debugger.cc:149] Reset] Release Debugger resource.
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.822.703 [mindspore/ccsrc/pybind_api/resource/manager.cc:200] ClearResPart3] Start clear ClearObjectCache...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.822.707 [mindspore/ccsrc/pybind_api/resource/manager.cc:200] ClearResPart3] Start clear ClearObjectCache...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.822.723 [mindspore/ccsrc/pybind_api/resource/manager.cc:202] ClearResPart3] End clear ClearObjectCache...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.822.725 [mindspore/ccsrc/pybind_api/resource/manager.cc:202] ClearResPart3] End clear ClearObjectCache...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.822.741 [mindspore/ccsrc/pybind_api/resource/manager.cc:204] ClearResPart3] Start clear Parser...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.822.738 [mindspore/ccsrc/pybind_api/resource/manager.cc:204] ClearResPart3] Start clear Parser...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.822.757 [mindspore/ccsrc/pybind_api/resource/manager.cc:206] ClearResPart3] End clear Parser...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.822.757 [mindspore/ccsrc/pybind_api/resource/manager.cc:206] ClearResPart3] End clear Parser...
[INFO] COMMON(618674,ffff8b99cde0,p[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.822.774 [mindspore/ccsrc/pybind_api/resource/manager.cc:208] ClearResPart3] Start ClearTraceStack...
ython3.9):2025-04-03-09:27:50.822.774 [mindspore/ccsrc/pybind_api/resource/manager.cc:208] ClearResPart3] Start ClearTraceStack...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.822.821 [mindspore/ccsrc/pybind_api/resource/manager.cc:210] ClearResPart3] End ClearTraceStack...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.822.839 [mindspore/ccsrc/pybind_api/resource/manager.cc:212] ClearResPart3] Start clear InterpretNodeRecorder...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.822.849 [mindspore/ccsrc/pybind_api/resource/manager.cc:210] ClearResPart3] End ClearTraceStack...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.822.859 [mindspore/ccsrc/pybind_api/resource/manager.cc:214] ClearResPart3] End clear InterpretNodeRecorder...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.822.867 [mindspore/ccsrc/pybind_api/resource/manager.cc:212] ClearResPart3] Start clear InterpretNodeRecorder...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.822.876 [mindspore/ccsrc/pybind_api/resource/manager.cc:216] ClearResPart3] Start clear parallel::entire_costgraph...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.822.883 [mindspore/ccsrc/pybind_api/resource/manager.cc:214] ClearResPart3] End clear InterpretNodeRecorder...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.822.897 [mindspore/ccsrc/pybind_api/resource/manager.cc:216] ClearResPart3] Start clear parallel::entire_costgraph...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.822.895 [mindspore/ccsrc/pybind_api/resource/manager.cc:218] ClearResPart3] End clear parallel::entire_costgraph...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.822.909 [mindspore/ccsrc/pybind_api/resource/manager.cc:220] ClearResPart3] Start clear ProtobufLibrary...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.822.938 [mindspore/ccsrc/pybind_api/resource/manager.cc:218] ClearResPart3] End clear parallel::entire_costgraph...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.822.965 [mindspore/ccsrc/pybind_api/resource/manager.cc:220] ClearResPart3] Start clear ProtobufLibrary...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.823.175 [mindspore/ccsrc/pybind_api/resource/manager.cc:222] ClearResPart3] End clear ProtobufLibrary...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.823.196 [mindspore/ccsrc/pybind_api/resource/manager.cc:224] ClearResPart3] Start clear ParserDefaultObjects ...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.823.220 [mindspore/ccsrc/pybind_api/resource/manager.cc:226] ClearResPart3] End clear ParserDefaultObjects...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.823.240 [mindspore/ccsrc/pybind_api/resource/manager.cc:231] ClearResPart3] Start clear python_adapter...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.823.236 [mindspore/ccsrc/pybind_api/resource/manager.cc:222] ClearResPart3] End clear ProtobufLibrary...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.823.257 [mindspore/ccsrc/pybind_api/resource/manager.cc:233] ClearResPart3] End clear python_adapter.
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.823.260 [mindspore/ccsrc/pybind_api/resource/manager.cc:224] ClearResPart3] Start clear ParserDefaultObjects ...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.823.276 [mindspore/ccsrc/pybind_api/resource/manager.cc:237] ClearSingleton] Start clear singleton...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.823.296 [mindspore/ccsrc/pybind_api/resource/manager.cc:226] ClearResPart3] End clear ParserDefaultObjects...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.823.316 [mindspore/ccsrc/pybind_api/resource/manager.cc:231] ClearResPart3] Start clear python_adapter...
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.823.332 [mindspore/ccsrc/pybind_api/resource/manager.cc:233] ClearResPart3] End clear python_adapter.
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.823.347 [mindspore/ccsrc/pybind_api/resource/manager.cc:237] ClearSingleton] Start clear singleton...
[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:50.823.375 [mindspore/ccsrc/pybind_api/resource/manager.cc:255] ClearSingleton] End clear singleton.
[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:50.823.663 [mindspore/ccsrc/pybind_api/resource/manager.cc:255] ClearSingleton] End clear singleton.
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:50.848.173 [queue_client_comm.c:114][ascend][curpid:618670,618903][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:50.848.257 [npu_driver.cc:4338] 618903 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.848.272 [tensor_data_transfer.cpp:612]618903 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_tensor_dump
[INFO] DEVICE(618670,ffff02541fa0,python3.9):2025-04-03-09:27:50.848.374 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:50.852.164 [queue_client_comm.c:114][ascend][curpid:618670,618909][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:50.852.166 [queue_client_comm.c:114][ascend][curpid:618670,618907][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:50.852.170 [queue_client_comm.c:114][ascend][curpid:618670,618905][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618670,python3.9):2025-04-03-09:27:50.852.174 [queue_client_comm.c:114][ascend][curpid:618670,618911][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:50.852.253 [npu_driver.cc:4338] 618909 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.852.270 [tensor_data_transfer.cpp:612]618909 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_scalar_summary
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:50.852.285 [npu_driver.cc:4338] 618907 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.852.298 [tensor_data_transfer.cpp:612]618907 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_image_summary
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:50.852.317 [npu_driver.cc:4338] 618905 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.852.330 [tensor_data_transfer.cpp:612]618905 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_tensor_summary
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:50.852.351 [npu_driver.cc:4338] 618911 MemQueuePeek: queue empty
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.852.367 [tensor_data_transfer.cpp:612]618911 acltdtReceiveTensorV2: queue is empty, device is 6, name is ms_histogram_summary
[INFO] DEVICE(618670,fffee2fdefa0,python3.9):2025-04-03-09:27:50.852.422 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] DEVICE(618670,fffee3ffefa0,python3.9):2025-04-03-09:27:50.852.436 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] DEVICE(618670,ffff01521fa0,python3.9):2025-04-03-09:27:50.852.445 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] DEVICE(618670,fffee1fbefa0,python3.9):2025-04-03-09:27:50.852.459 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.852.695 [tensor_data_transfer.cpp:973]618670 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 6, name is ms_histogram_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:50.852.722 [api_impl.cc:6065] 618670 MemQueueDestroy: Start to destroy queue on devId 6, qid is 5.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:50.852.736 [npu_driver.cc:3989] 618670 MemQueueDestroy: deviceId=6, qid=5.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.853.103 [tensor_data_transfer.cpp:977]618670 acltdtDestroyChannel: acltdtDestroyChannel success, device is 6, name is ms_histogram_summary
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.853.149 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_scalar_summary channel is being destroyed.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.853.177 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_scalar_summary begins the destruction process.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.853.220 [tensor_data_transfer.cpp:973]618670 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 6, name is ms_scalar_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:50.853.240 [api_impl.cc:6065] 618670 MemQueueDestroy: Start to destroy queue on devId 6, qid is 4.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:50.853.251 [npu_driver.cc:3989] 618670 MemQueueDestroy: deviceId=6, qid=4.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.853.587 [tensor_data_transfer.cpp:977]618670 acltdtDestroyChannel: acltdtDestroyChannel success, device is 6, name is ms_scalar_summary
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.853.616 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_image_summary channel is being destroyed.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.853.638 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_image_summary begins the destruction process.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.853.683 [tensor_data_transfer.cpp:973]618670 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 6, name is ms_image_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:50.853.702 [api_impl.cc:6065] 618670 MemQueueDestroy: Start to destroy queue on devId 6, qid is 3.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:50.853.726 [npu_driver.cc:3989] 618670 MemQueueDestroy: deviceId=6, qid=3.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.854.127 [tensor_data_transfer.cpp:977]618670 acltdtDestroyChannel: acltdtDestroyChannel success, device is 6, name is ms_image_summary
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.854.155 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_tensor_summary channel is being destroyed.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.854.176 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_tensor_summary begins the destruction process.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.854.215 [tensor_data_transfer.cpp:973]618670 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 6, name is ms_tensor_summary
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:50.854.234 [api_impl.cc:6065] 618670 MemQueueDestroy: Start to destroy queue on devId 6, qid is 2.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:50.854.244 [npu_driver.cc:3989] 618670 MemQueueDestroy: deviceId=6, qid=2.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.854.586 [tensor_data_transfer.cpp:977]618670 acltdtDestroyChannel: acltdtDestroyChannel success, device is 6, name is ms_tensor_summary
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.854.613 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_tensor_dump channel is being destroyed.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.854.634 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_tensor_dump begins the destruction process.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.854.700 [tensor_data_transfer.cpp:973]618670 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 6, name is ms_tensor_dump
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:50.854.719 [api_impl.cc:6065] 618670 MemQueueDestroy: Start to destroy queue on devId 6, qid is 1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:50.854.731 [npu_driver.cc:3989] 618670 MemQueueDestroy: deviceId=6, qid=1.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.855.125 [tensor_data_transfer.cpp:977]618670 acltdtDestroyChannel: acltdtDestroyChannel success, device is 6, name is ms_tensor_dump
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.855.147 [device.cpp:183]618670 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:50.855.168 [api_impl.cc:3419] 618670 DeviceReset: reset device, device_id=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:50.855.181 [runtime.cc:3444] 618670 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x4, reset:0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:50.855.197 [api_impl.cc:3449] 618670 DeviceReset: Succ, userDeviceId=6.
[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:50.855.207 [device.cpp:189]618670 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 6.
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.855.231 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ascend_deprecated_interface.cc:136] CloseTsd] Call aclrtResetDevice, destroy and close tsd successful, ret[0]
[INFO] ME(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.855.259 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:401] ClearDeviceContexts] Release device CPU_0
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.855.302 [mindspore/ccsrc/pybind_api/resource/manager.cc:167] ClearResPart2] End clear device context.
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.855.322 [mindspore/ccsrc/pybind_api/resource/manager.cc:169] ClearResPart2] Start clear kernel runtime...
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.855.342 [mindspore/ccsrc/runtime/device/kernel_runtime_manager.cc:26] ClearRuntimeResource] Release device Ascend_6
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.855.370 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:178] ReleaseDeviceRes] Ascend finalize start
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.855.391 [mindspore/ccsrc/pybind_api/resource/manager.cc:171] ClearResPart2] End clear kernel runtime.
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.855.408 [mindspore/ccsrc/pybind_api/resource/manager.cc:173] ClearResPart2] Start clear CollectiveManager...
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.855.433 [mindspore/ccsrc/distributed/collective/collective_manager.cc:539] Finalize] Begin finalize collective manager.
[INFO] DISTRIBUTED(618670,ffff01d31fa0,python3.9):2025-04-03-09:27:50.855.598 [mindspore/ccsrc/distributed/collective/collective_manager.cc:513] operator()] Start finalizing host communication lib.
[INFO] DEVICE(618670,ffff01d31fa0,python3.9):2025-04-03-09:27:50.855.635 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:64] Finish] Begin to finish the cpu collective node.
[INFO] DEVICE(618670,ffff01d31fa0,python3.9):2025-04-03-09:27:50.855.655 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:69] Finish] The cpu collective node has been finished successfully.
[INFO] PS(618670,ffff01d31fa0,python3.9):2025-04-03-09:27:50.855.672 [mindspore/ccsrc/ps/core/ps_worker_node.cc:45] Stop] Stop worker node!
[INFO] PS(618670,ffff01d31fa0,python3.9):2025-04-03-09:27:50.855.696 [mindspore/ccsrc/ps/core/communicator/tcp_client.cc:176] Stop] Stop tcp client!
[INFO] PS(618670,ffff01d31fa0,python3.9):2025-04-03-09:27:50.855.723 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:232] Stop] Stop tcp server!
[INFO] DISTRIBUTED(618670,ffff01d31fa0,python3.9):2025-04-03-09:27:50.855.748 [mindspore/ccsrc/distributed/collective/collective_manager.cc:517] operator()] End finalizing host communication lib.
[INFO] PS(618670,ffff33ffefa0,python3.9):2025-04-03-09:27:50.855.762 [mindspore/ccsrc/ps/core/communicator/tcp_client.cc:318] Start] Event base dispatch success!
[INFO] DISTRIBUTED(618670,ffff01d31fa0,python3.9):2025-04-03-09:27:50.855.765 [mindspore/ccsrc/distributed/collective/collective_manager.cc:522] operator()] Start finalizing device communication lib.
[INFO] PS(618670,ffff48c2cfa0,python3.9):2025-04-03-09:27:50.855.781 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:220] Start] Event base dispatch success!
[INFO] DISTRIBUTED(618670,ffff01d31fa0,python3.9):2025-04-03-09:27:50.855.802 [mindspore/ccsrc/distributed/collective/collective_manager.cc:526] operator()] End finalizing device communication lib.
[INFO] DISTRIBUTED(618670,fffec67cefa0,python3.9):2025-04-03-09:27:50.855.862 [mindspore/ccsrc/distributed/collective/collective_manager.cc:960] RunInitCommTasks] Initialize communciator thread is stopped.
[INFO] DISTRIBUTED(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.855.967 [mindspore/ccsrc/distributed/collective/collective_manager.cc:547] Finalize] End finalize collective manager.
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.855.998 [mindspore/ccsrc/pybind_api/resource/manager.cc:176] ClearResPart2] End clear CollectiveManager.
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.856.014 [mindspore/ccsrc/pybind_api/resource/manager.cc:178] ClearResPart2] Start clear AnalysisResultCacheMgr...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.856.033 [mindspore/ccsrc/pybind_api/resource/manager.cc:180] ClearResPart2] End clear AnalysisResultCacheMgr.
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.856.050 [mindspore/ccsrc/pybind_api/resource/manager.cc:182] ClearResPart2] Start clear AnalysisContext...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.856.065 [mindspore/ccsrc/pybind_api/resource/manager.cc:184] ClearResPart2] End clear AnalysisContext...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.856.082 [mindspore/ccsrc/pybind_api/resource/manager.cc:186] ClearResPart2] Start clear AnalysisSchedule...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.856.230 [mindspore/ccsrc/pybind_api/resource/manager.cc:188] ClearResPart2] End clear AnalysisSchedule...
[INFO] DEBUG(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.856.260 [mindspore/ccsrc/debug/debugger/debugger.cc:149] Reset] Release Debugger resource.
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.856.303 [mindspore/ccsrc/pybind_api/resource/manager.cc:200] ClearResPart3] Start clear ClearObjectCache...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.856.322 [mindspore/ccsrc/pybind_api/resource/manager.cc:202] ClearResPart3] End clear ClearObjectCache...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.856.337 [mindspore/ccsrc/pybind_api/resource/manager.cc:204] ClearResPart3] Start clear Parser...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.856.367 [mindspore/ccsrc/pybind_api/resource/manager.cc:206] ClearResPart3] End clear Parser...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.856.384 [mindspore/ccsrc/pybind_api/resource/manager.cc:208] ClearResPart3] Start ClearTraceStack...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.856.437 [mindspore/ccsrc/pybind_api/resource/manager.cc:210] ClearResPart3] End ClearTraceStack...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.856.454 [mindspore/ccsrc/pybind_api/resource/manager.cc:212] ClearResPart3] Start clear InterpretNodeRecorder...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.856.469 [mindspore/ccsrc/pybind_api/resource/manager.cc:214] ClearResPart3] End clear InterpretNodeRecorder...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.856.486 [mindspore/ccsrc/pybind_api/resource/manager.cc:216] ClearResPart3] Start clear parallel::entire_costgraph...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.856.520 [mindspore/ccsrc/pybind_api/resource/manager.cc:218] ClearResPart3] End clear parallel::entire_costgraph...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.856.537 [mindspore/ccsrc/pybind_api/resource/manager.cc:220] ClearResPart3] Start clear ProtobufLibrary...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.856.871 [mindspore/ccsrc/pybind_api/resource/manager.cc:222] ClearResPart3] End clear ProtobufLibrary...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.856.891 [mindspore/ccsrc/pybind_api/resource/manager.cc:224] ClearResPart3] Start clear ParserDefaultObjects ...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.856.922 [mindspore/ccsrc/pybind_api/resource/manager.cc:226] ClearResPart3] End clear ParserDefaultObjects...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.856.941 [mindspore/ccsrc/pybind_api/resource/manager.cc:231] ClearResPart3] Start clear python_adapter...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.856.955 [mindspore/ccsrc/pybind_api/resource/manager.cc:233] ClearResPart3] End clear python_adapter.
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.856.969 [mindspore/ccsrc/pybind_api/resource/manager.cc:237] ClearSingleton] Start clear singleton...
[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:50.857.215 [mindspore/ccsrc/pybind_api/resource/manager.cc:255] ClearSingleton] End clear singleton.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:50.861.410 [awatchdog_monitor.c:160](tid:618698) thread 618897 not exist
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:50.875.078 [awatchdog_monitor.c:160](tid:618689) thread 618896 not exist
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:50.944.178 [queue_client_comm.c:114][ascend][curpid:618650,618929][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:50.944.184 [queue_client_comm.c:114][ascend][curpid:618650,618927][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:50.944.188 [queue_client_comm.c:114][ascend][curpid:618650,618923][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:50.944.189 [queue_client_comm.c:114][ascend][curpid:618650,618925][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618650,python3.9):2025-04-03-09:27:50.944.200 [queue_client_comm.c:114][ascend][curpid:618650,618931][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:50.944.280 [npu_driver.cc:4338] 618929 MemQueuePeek: queue empty
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:50.944.320 [npu_driver.cc:4338] 618927 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.944.337 [tensor_data_transfer.cpp:612]618927 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_image_summary
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.944.344 [tensor_data_transfer.cpp:612]618929 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_scalar_summary
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:50.944.352 [npu_driver.cc:4338] 618923 MemQueuePeek: queue empty
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:50.944.384 [npu_driver.cc:4338] 618925 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.944.391 [tensor_data_transfer.cpp:612]618923 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_tensor_dump
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.944.398 [tensor_data_transfer.cpp:612]618925 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_tensor_summary
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:50.944.426 [npu_driver.cc:4338] 618931 MemQueuePeek: queue empty
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.944.454 [tensor_data_transfer.cpp:612]618931 acltdtReceiveTensorV2: queue is empty, device is 1, name is ms_histogram_summary
[INFO] DEVICE(618650,fffef7ffefa0,python3.9):2025-04-03-09:27:50.944.486 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] DEVICE(618650,ffff16541fa0,python3.9):2025-04-03-09:27:50.944.509 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] DEVICE(618650,ffff15521fa0,python3.9):2025-04-03-09:27:50.944.514 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] DEVICE(618650,fffef6fdefa0,python3.9):2025-04-03-09:27:50.944.572 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] DEVICE(618650,fffef5fbefa0,python3.9):2025-04-03-09:27:50.944.667 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.944.917 [tensor_data_transfer.cpp:973]618650 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 1, name is ms_histogram_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:50.944.943 [api_impl.cc:6065] 618650 MemQueueDestroy: Start to destroy queue on devId 1, qid is 5.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:50.944.957 [npu_driver.cc:3989] 618650 MemQueueDestroy: deviceId=1, qid=5.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.945.393 [tensor_data_transfer.cpp:977]618650 acltdtDestroyChannel: acltdtDestroyChannel success, device is 1, name is ms_histogram_summary
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.945.426 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_scalar_summary channel is being destroyed.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.945.449 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_scalar_summary begins the destruction process.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.945.494 [tensor_data_transfer.cpp:973]618650 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 1, name is ms_scalar_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:50.945.510 [api_impl.cc:6065] 618650 MemQueueDestroy: Start to destroy queue on devId 1, qid is 4.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:50.945.521 [npu_driver.cc:3989] 618650 MemQueueDestroy: deviceId=1, qid=4.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.945.904 [tensor_data_transfer.cpp:977]618650 acltdtDestroyChannel: acltdtDestroyChannel success, device is 1, name is ms_scalar_summary
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.945.942 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_image_summary channel is being destroyed.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.945.960 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_image_summary begins the destruction process.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.946.014 [tensor_data_transfer.cpp:973]618650 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 1, name is ms_image_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:50.946.030 [api_impl.cc:6065] 618650 MemQueueDestroy: Start to destroy queue on devId 1, qid is 3.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:50.946.041 [npu_driver.cc:3989] 618650 MemQueueDestroy: deviceId=1, qid=3.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.946.392 [tensor_data_transfer.cpp:977]618650 acltdtDestroyChannel: acltdtDestroyChannel success, device is 1, name is ms_image_summary
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.946.416 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_tensor_summary channel is being destroyed.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.946.434 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_tensor_summary begins the destruction process.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.946.481 [tensor_data_transfer.cpp:973]618650 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 1, name is ms_tensor_summary
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:50.946.497 [api_impl.cc:6065] 618650 MemQueueDestroy: Start to destroy queue on devId 1, qid is 2.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:50.946.507 [npu_driver.cc:3989] 618650 MemQueueDestroy: deviceId=1, qid=2.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.946.897 [tensor_data_transfer.cpp:977]618650 acltdtDestroyChannel: acltdtDestroyChannel success, device is 1, name is ms_tensor_summary
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.946.920 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_tensor_dump channel is being destroyed.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.946.936 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_tensor_dump begins the destruction process.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.946.989 [tensor_data_transfer.cpp:973]618650 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 1, name is ms_tensor_dump
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:50.947.005 [api_impl.cc:6065] 618650 MemQueueDestroy: Start to destroy queue on devId 1, qid is 1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:50.947.016 [npu_driver.cc:3989] 618650 MemQueueDestroy: deviceId=1, qid=1.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.947.363 [tensor_data_transfer.cpp:977]618650 acltdtDestroyChannel: acltdtDestroyChannel success, device is 1, name is ms_tensor_dump
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.947.382 [device.cpp:183]618650 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:50.947.400 [api_impl.cc:3419] 618650 DeviceReset: reset device, device_id=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:50.947.411 [runtime.cc:3444] 618650 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x4, reset:0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:50.947.423 [api_impl.cc:3449] 618650 DeviceReset: Succ, userDeviceId=1.
[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:50.947.432 [device.cpp:189]618650 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 1.
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.947.466 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ascend_deprecated_interface.cc:136] CloseTsd] Call aclrtResetDevice, destroy and close tsd successful, ret[0]
[INFO] ME(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.947.491 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:401] ClearDeviceContexts] Release device CPU_0
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.947.535 [mindspore/ccsrc/pybind_api/resource/manager.cc:167] ClearResPart2] End clear device context.
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.947.552 [mindspore/ccsrc/pybind_api/resource/manager.cc:169] ClearResPart2] Start clear kernel runtime...
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.947.572 [mindspore/ccsrc/runtime/device/kernel_runtime_manager.cc:26] ClearRuntimeResource] Release device Ascend_1
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.947.587 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:178] ReleaseDeviceRes] Ascend finalize start
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.947.606 [mindspore/ccsrc/pybind_api/resource/manager.cc:171] ClearResPart2] End clear kernel runtime.
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.947.620 [mindspore/ccsrc/pybind_api/resource/manager.cc:173] ClearResPart2] Start clear CollectiveManager...
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.947.641 [mindspore/ccsrc/distributed/collective/collective_manager.cc:539] Finalize] Begin finalize collective manager.
[INFO] DISTRIBUTED(618650,ffff15d31fa0,python3.9):2025-04-03-09:27:50.947.798 [mindspore/ccsrc/distributed/collective/collective_manager.cc:513] operator()] Start finalizing host communication lib.
[INFO] DEVICE(618650,ffff15d31fa0,python3.9):2025-04-03-09:27:50.947.836 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:64] Finish] Begin to finish the cpu collective node.
[INFO] DEVICE(618650,ffff15d31fa0,python3.9):2025-04-03-09:27:50.947.853 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:69] Finish] The cpu collective node has been finished successfully.
[INFO] PS(618650,ffff15d31fa0,python3.9):2025-04-03-09:27:50.947.869 [mindspore/ccsrc/ps/core/ps_worker_node.cc:45] Stop] Stop worker node!
[INFO] PS(618650,ffff15d31fa0,python3.9):2025-04-03-09:27:50.947.888 [mindspore/ccsrc/ps/core/communicator/tcp_client.cc:176] Stop] Stop tcp client!
[INFO] PS(618650,ffff15d31fa0,python3.9):2025-04-03-09:27:50.947.914 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:232] Stop] Stop tcp server!
[INFO] DISTRIBUTED(618650,ffff15d31fa0,python3.9):2025-04-03-09:27:50.947.934 [mindspore/ccsrc/distributed/collective/collective_manager.cc:517] operator()] End finalizing host communication lib.
[INFO] DISTRIBUTED(618650,ffff15d31fa0,python3.9):2025-04-03-09:27:50.947.949 [mindspore/ccsrc/distributed/collective/collective_manager.cc:522] operator()] Start finalizing device communication lib.
[INFO] DISTRIBUTED(618650,ffff15d31fa0,python3.9):2025-04-03-09:27:50.947.964 [mindspore/ccsrc/distributed/collective/collective_manager.cc:526] operator()] End finalizing device communication lib.
[INFO] PS(618650,ffff47ffefa0,python3.9):2025-04-03-09:27:50.947.961 [mindspore/ccsrc/ps/core/communicator/tcp_client.cc:318] Start] Event base dispatch success!
[INFO] PS(618650,ffff5cbc9fa0,python3.9):2025-04-03-09:27:50.947.965 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:220] Start] Event base dispatch success!
[INFO] DISTRIBUTED(618650,fffeda7cefa0,python3.9):2025-04-03-09:27:50.948.019 [mindspore/ccsrc/distributed/collective/collective_manager.cc:960] RunInitCommTasks] Initialize communciator thread is stopped.
[INFO] DISTRIBUTED(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.948.116 [mindspore/ccsrc/distributed/collective/collective_manager.cc:547] Finalize] End finalize collective manager.
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.948.136 [mindspore/ccsrc/pybind_api/resource/manager.cc:176] ClearResPart2] End clear CollectiveManager.
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.948.184 [mindspore/ccsrc/pybind_api/resource/manager.cc:178] ClearResPart2] Start clear AnalysisResultCacheMgr...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.948.206 [mindspore/ccsrc/pybind_api/resource/manager.cc:180] ClearResPart2] End clear AnalysisResultCacheMgr.
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.948.220 [mindspore/ccsrc/pybind_api/resource/manager.cc:182] ClearResPart2] Start clear AnalysisContext...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.948.233 [mindspore/ccsrc/pybind_api/resource/manager.cc:184] ClearResPart2] End clear AnalysisContext...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.948.246 [mindspore/ccsrc/pybind_api/resource/manager.cc:186] ClearResPart2] Start clear AnalysisSchedule...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.948.389 [mindspore/ccsrc/pybind_api/resource/manager.cc:188] ClearResPart2] End clear AnalysisSchedule...
[INFO] DEBUG(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.948.413 [mindspore/ccsrc/debug/debugger/debugger.cc:149] Reset] Release Debugger resource.
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.948.455 [mindspore/ccsrc/pybind_api/resource/manager.cc:200] ClearResPart3] Start clear ClearObjectCache...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.948.474 [mindspore/ccsrc/pybind_api/resource/manager.cc:202] ClearResPart3] End clear ClearObjectCache...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.948.487 [mindspore/ccsrc/pybind_api/resource/manager.cc:204] ClearResPart3] Start clear Parser...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.948.506 [mindspore/ccsrc/pybind_api/resource/manager.cc:206] ClearResPart3] End clear Parser...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.948.520 [mindspore/ccsrc/pybind_api/resource/manager.cc:208] ClearResPart3] Start ClearTraceStack...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.948.549 [mindspore/ccsrc/pybind_api/resource/manager.cc:210] ClearResPart3] End ClearTraceStack...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.948.563 [mindspore/ccsrc/pybind_api/resource/manager.cc:212] ClearResPart3] Start clear InterpretNodeRecorder...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.948.577 [mindspore/ccsrc/pybind_api/resource/manager.cc:214] ClearResPart3] End clear InterpretNodeRecorder...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.948.591 [mindspore/ccsrc/pybind_api/resource/manager.cc:216] ClearResPart3] Start clear parallel::entire_costgraph...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.948.622 [mindspore/ccsrc/pybind_api/resource/manager.cc:218] ClearResPart3] End clear parallel::entire_costgraph...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.948.637 [mindspore/ccsrc/pybind_api/resource/manager.cc:220] ClearResPart3] Start clear ProtobufLibrary...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.948.930 [mindspore/ccsrc/pybind_api/resource/manager.cc:222] ClearResPart3] End clear ProtobufLibrary...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.948.948 [mindspore/ccsrc/pybind_api/resource/manager.cc:224] ClearResPart3] Start clear ParserDefaultObjects ...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.948.977 [mindspore/ccsrc/pybind_api/resource/manager.cc:226] ClearResPart3] End clear ParserDefaultObjects...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.948.992 [mindspore/ccsrc/pybind_api/resource/manager.cc:231] ClearResPart3] Start clear python_adapter...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.949.007 [mindspore/ccsrc/pybind_api/resource/manager.cc:233] ClearResPart3] End clear python_adapter.
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.949.034 [mindspore/ccsrc/pybind_api/resource/manager.cc:237] ClearSingleton] Start clear singleton...
[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:50.949.266 [mindspore/ccsrc/pybind_api/resource/manager.cc:255] ClearSingleton] End clear singleton.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:50.974.728 [awatchdog_monitor.c:160](tid:618694) thread 618917 not exist
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:51.040.208 [queue_client_comm.c:114][ascend][curpid:618654,618943][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:51.040.199 [queue_client_comm.c:114][ascend][curpid:618654,618951][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:51.040.213 [queue_client_comm.c:114][ascend][curpid:618654,618947][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:51.040.199 [queue_client_comm.c:114][ascend][curpid:618654,618945][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618654,python3.9):2025-04-03-09:27:51.040.199 [queue_client_comm.c:114][ascend][curpid:618654,618949][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:51.040.385 [npu_driver.cc:4338] 618943 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:51.040.405 [tensor_data_transfer.cpp:612]618943 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_tensor_dump
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:51.040.417 [npu_driver.cc:4338] 618951 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:51.040.436 [tensor_data_transfer.cpp:612]618951 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_histogram_summary
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:51.040.440 [npu_driver.cc:4338] 618947 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:51.040.454 [tensor_data_transfer.cpp:612]618947 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_image_summary
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:51.040.479 [npu_driver.cc:4338] 618945 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:51.040.496 [tensor_data_transfer.cpp:612]618945 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_tensor_summary
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:51.040.510 [npu_driver.cc:4338] 618949 MemQueuePeek: queue empty
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:51.040.528 [tensor_data_transfer.cpp:612]618949 acltdtReceiveTensorV2: queue is empty, device is 2, name is ms_scalar_summary
[INFO] DEVICE(618654,fffee5c49fa0,python3.9):2025-04-03-09:27:51.040.647 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] DEVICE(618654,fffee4c29fa0,python3.9):2025-04-03-09:27:51.040.671 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] DEVICE(618654,fffece7cefa0,python3.9):2025-04-03-09:27:51.040.653 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] DEVICE(618654,fffecd7aefa0,python3.9):2025-04-03-09:27:51.040.630 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] DEVICE(618654,fffecf7eefa0,python3.9):2025-04-03-09:27:51.040.630 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:51.040.891 [tensor_data_transfer.cpp:973]618654 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 2, name is ms_histogram_summary
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:51.040.922 [api_impl.cc:6065] 618654 MemQueueDestroy: Start to destroy queue on devId 2, qid is 5.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:51.040.939 [npu_driver.cc:3989] 618654 MemQueueDestroy: deviceId=2, qid=5.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:51.041.402 [tensor_data_transfer.cpp:977]618654 acltdtDestroyChannel: acltdtDestroyChannel success, device is 2, name is ms_histogram_summary
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.041.564 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_scalar_summary channel is being destroyed.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.041.647 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_scalar_summary begins the destruction process.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:51.041.736 [tensor_data_transfer.cpp:973]618654 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 2, name is ms_scalar_summary
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:51.041.767 [api_impl.cc:6065] 618654 MemQueueDestroy: Start to destroy queue on devId 2, qid is 4.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:51.041.787 [npu_driver.cc:3989] 618654 MemQueueDestroy: deviceId=2, qid=4.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:51.042.190 [tensor_data_transfer.cpp:977]618654 acltdtDestroyChannel: acltdtDestroyChannel success, device is 2, name is ms_scalar_summary
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.042.225 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_image_summary channel is being destroyed.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.042.249 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_image_summary begins the destruction process.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:51.042.305 [tensor_data_transfer.cpp:973]618654 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 2, name is ms_image_summary
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:51.042.326 [api_impl.cc:6065] 618654 MemQueueDestroy: Start to destroy queue on devId 2, qid is 3.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:51.042.339 [npu_driver.cc:3989] 618654 MemQueueDestroy: deviceId=2, qid=3.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:51.042.700 [tensor_data_transfer.cpp:977]618654 acltdtDestroyChannel: acltdtDestroyChannel success, device is 2, name is ms_image_summary
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.042.765 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_tensor_summary channel is being destroyed.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.042.789 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_tensor_summary begins the destruction process.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:51.042.843 [tensor_data_transfer.cpp:973]618654 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 2, name is ms_tensor_summary
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:51.042.864 [api_impl.cc:6065] 618654 MemQueueDestroy: Start to destroy queue on devId 2, qid is 2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:51.042.877 [npu_driver.cc:3989] 618654 MemQueueDestroy: deviceId=2, qid=2.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:51.043.224 [tensor_data_transfer.cpp:977]618654 acltdtDestroyChannel: acltdtDestroyChannel success, device is 2, name is ms_tensor_summary
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.043.256 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_tensor_dump channel is being destroyed.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.043.278 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_tensor_dump begins the destruction process.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:51.043.328 [tensor_data_transfer.cpp:973]618654 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 2, name is ms_tensor_dump
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:51.043.348 [api_impl.cc:6065] 618654 MemQueueDestroy: Start to destroy queue on devId 2, qid is 1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:51.043.361 [npu_driver.cc:3989] 618654 MemQueueDestroy: deviceId=2, qid=1.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:51.043.733 [tensor_data_transfer.cpp:977]618654 acltdtDestroyChannel: acltdtDestroyChannel success, device is 2, name is ms_tensor_dump
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:51.043.766 [device.cpp:183]618654 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:51.043.792 [api_impl.cc:3419] 618654 DeviceReset: reset device, device_id=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:51.043.810 [runtime.cc:3444] 618654 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x4, reset:0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:51.043.827 [api_impl.cc:3449] 618654 DeviceReset: Succ, userDeviceId=2.
[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:51.043.844 [device.cpp:189]618654 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 2.
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.043.871 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ascend_deprecated_interface.cc:136] CloseTsd] Call aclrtResetDevice, destroy and close tsd successful, ret[0]
[INFO] ME(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.043.907 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:401] ClearDeviceContexts] Release device CPU_0
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.043.957 [mindspore/ccsrc/pybind_api/resource/manager.cc:167] ClearResPart2] End clear device context.
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.043.979 [mindspore/ccsrc/pybind_api/resource/manager.cc:169] ClearResPart2] Start clear kernel runtime...
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.044.002 [mindspore/ccsrc/runtime/device/kernel_runtime_manager.cc:26] ClearRuntimeResource] Release device Ascend_2
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.044.018 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:178] ReleaseDeviceRes] Ascend finalize start
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.044.045 [mindspore/ccsrc/pybind_api/resource/manager.cc:171] ClearResPart2] End clear kernel runtime.
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.044.063 [mindspore/ccsrc/pybind_api/resource/manager.cc:173] ClearResPart2] Start clear CollectiveManager...
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.044.089 [mindspore/ccsrc/distributed/collective/collective_manager.cc:539] Finalize] Begin finalize collective manager.
[INFO] DISTRIBUTED(618654,fffee5439fa0,python3.9):2025-04-03-09:27:51.044.315 [mindspore/ccsrc/distributed/collective/collective_manager.cc:513] operator()] Start finalizing host communication lib.
[INFO] DEVICE(618654,fffee5439fa0,python3.9):2025-04-03-09:27:51.044.353 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:64] Finish] Begin to finish the cpu collective node.
[INFO] DEVICE(618654,fffee5439fa0,python3.9):2025-04-03-09:27:51.044.373 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:69] Finish] The cpu collective node has been finished successfully.
[INFO] PS(618654,fffee5439fa0,python3.9):2025-04-03-09:27:51.044.390 [mindspore/ccsrc/ps/core/ps_worker_node.cc:45] Stop] Stop worker node!
[INFO] PS(618654,fffee5439fa0,python3.9):2025-04-03-09:27:51.044.416 [mindspore/ccsrc/ps/core/communicator/tcp_client.cc:176] Stop] Stop tcp client!
[INFO] PS(618654,fffee5439fa0,python3.9):2025-04-03-09:27:51.044.446 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:232] Stop] Stop tcp server!
[INFO] DISTRIBUTED(618654,fffee5439fa0,python3.9):2025-04-03-09:27:51.044.471 [mindspore/ccsrc/distributed/collective/collective_manager.cc:517] operator()] End finalizing host communication lib.
[INFO] DISTRIBUTED(618654,fffee5439fa0,python3.9):2025-04-03-09:27:51.044.489 [mindspore/ccsrc/distributed/collective/collective_manager.cc:522] operator()] Start finalizing device communication lib.
[INFO] DISTRIBUTED(618654,fffee5439fa0,python3.9):2025-04-03-09:27:51.044.523 [mindspore/ccsrc/distributed/collective/collective_manager.cc:526] operator()] End finalizing device communication lib.
[INFO] PS(618654,ffff177eefa0,python3.9):2025-04-03-09:27:51.044.517 [mindspore/ccsrc/ps/core/communicator/tcp_client.cc:318] Start] Event base dispatch success!
[INFO] PS(618654,ffff17ffefa0,python3.9):2025-04-03-09:27:51.044.519 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:220] Start] Event base dispatch success!
[INFO] DISTRIBUTED(618654,fffea9fbefa0,python3.9):2025-04-03-09:27:51.044.571 [mindspore/ccsrc/distributed/collective/collective_manager.cc:960] RunInitCommTasks] Initialize communciator thread is stopped.
[INFO] DISTRIBUTED(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.044.697 [mindspore/ccsrc/distributed/collective/collective_manager.cc:547] Finalize] End finalize collective manager.
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.044.729 [mindspore/ccsrc/pybind_api/resource/manager.cc:176] ClearResPart2] End clear CollectiveManager.
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.044.749 [mindspore/ccsrc/pybind_api/resource/manager.cc:178] ClearResPart2] Start clear AnalysisResultCacheMgr...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.044.773 [mindspore/ccsrc/pybind_api/resource/manager.cc:180] ClearResPart2] End clear AnalysisResultCacheMgr.
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.044.792 [mindspore/ccsrc/pybind_api/resource/manager.cc:182] ClearResPart2] Start clear AnalysisContext...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.044.807 [mindspore/ccsrc/pybind_api/resource/manager.cc:184] ClearResPart2] End clear AnalysisContext...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.044.823 [mindspore/ccsrc/pybind_api/resource/manager.cc:186] ClearResPart2] Start clear AnalysisSchedule...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.044.964 [mindspore/ccsrc/pybind_api/resource/manager.cc:188] ClearResPart2] End clear AnalysisSchedule...
[INFO] DEBUG(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.044.996 [mindspore/ccsrc/debug/debugger/debugger.cc:149] Reset] Release Debugger resource.
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.045.049 [mindspore/ccsrc/pybind_api/resource/manager.cc:200] ClearResPart3] Start clear ClearObjectCache...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.045.070 [mindspore/ccsrc/pybind_api/resource/manager.cc:202] ClearResPart3] End clear ClearObjectCache...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.045.086 [mindspore/ccsrc/pybind_api/resource/manager.cc:204] ClearResPart3] Start clear Parser...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.045.109 [mindspore/ccsrc/pybind_api/resource/manager.cc:206] ClearResPart3] End clear Parser...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.045.127 [mindspore/ccsrc/pybind_api/resource/manager.cc:208] ClearResPart3] Start ClearTraceStack...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.045.189 [mindspore/ccsrc/pybind_api/resource/manager.cc:210] ClearResPart3] End ClearTraceStack...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.045.208 [mindspore/ccsrc/pybind_api/resource/manager.cc:212] ClearResPart3] Start clear InterpretNodeRecorder...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.045.224 [mindspore/ccsrc/pybind_api/resource/manager.cc:214] ClearResPart3] End clear InterpretNodeRecorder...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.045.242 [mindspore/ccsrc/pybind_api/resource/manager.cc:216] ClearResPart3] Start clear parallel::entire_costgraph...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.045.259 [mindspore/ccsrc/pybind_api/resource/manager.cc:218] ClearResPart3] End clear parallel::entire_costgraph...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.045.277 [mindspore/ccsrc/pybind_api/resource/manager.cc:220] ClearResPart3] Start clear ProtobufLibrary...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.045.589 [mindspore/ccsrc/pybind_api/resource/manager.cc:222] ClearResPart3] End clear ProtobufLibrary...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.045.612 [mindspore/ccsrc/pybind_api/resource/manager.cc:224] ClearResPart3] Start clear ParserDefaultObjects ...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.045.648 [mindspore/ccsrc/pybind_api/resource/manager.cc:226] ClearResPart3] End clear ParserDefaultObjects...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.045.669 [mindspore/ccsrc/pybind_api/resource/manager.cc:231] ClearResPart3] Start clear python_adapter...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.045.685 [mindspore/ccsrc/pybind_api/resource/manager.cc:233] ClearResPart3] End clear python_adapter.
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.045.704 [mindspore/ccsrc/pybind_api/resource/manager.cc:237] ClearSingleton] Start clear singleton...
[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.045.917 [mindspore/ccsrc/pybind_api/resource/manager.cc:255] ClearSingleton] End clear singleton.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:51.075.902 [awatchdog_monitor.c:160](tid:618682) thread 618937 not exist
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:51.104.208 [queue_client_comm.c:114][ascend][curpid:618646,618965][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] DRV(618646,python3.9):2025-04-03-09:27:51.104.213 [queue_client_comm.c:114][ascend][curpid:618646,618963][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:51.104.415 [npu_driver.cc:4338] 618965 MemQueuePeek: queue empty
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:51.104.427 [npu_driver.cc:4338] 618963 MemQueuePeek: queue empty
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:51.104.437 [tensor_data_transfer.cpp:612]618965 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_tensor_summary
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:51.104.456 [tensor_data_transfer.cpp:612]618963 acltdtReceiveTensorV2: queue is empty, device is 0, name is ms_tensor_dump
[INFO] DEVICE(618646,fffecf7eefa0,python3.9):2025-04-03-09:27:51.104.631 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] DEVICE(618646,fffedcb87fa0,python3.9):2025-04-03-09:27:51.104.655 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:51.104.798 [tensor_data_transfer.cpp:973]618646 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 0, name is ms_tensor_summary
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:51.104.846 [api_impl.cc:6065] 618646 MemQueueDestroy: Start to destroy queue on devId 0, qid is 2.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:51.104.861 [npu_driver.cc:3989] 618646 MemQueueDestroy: deviceId=0, qid=2.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:51.105.237 [tensor_data_transfer.cpp:977]618646 acltdtDestroyChannel: acltdtDestroyChannel success, device is 0, name is ms_tensor_summary
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.105.291 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_tensor_dump channel is being destroyed.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.105.316 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_tensor_dump begins the destruction process.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:51.105.364 [tensor_data_transfer.cpp:973]618646 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 0, name is ms_tensor_dump
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:51.105.379 [api_impl.cc:6065] 618646 MemQueueDestroy: Start to destroy queue on devId 0, qid is 1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:51.105.391 [npu_driver.cc:3989] 618646 MemQueueDestroy: deviceId=0, qid=1.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:51.105.726 [tensor_data_transfer.cpp:977]618646 acltdtDestroyChannel: acltdtDestroyChannel success, device is 0, name is ms_tensor_dump
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:51.105.750 [device.cpp:183]618646 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:51.105.770 [api_impl.cc:3419] 618646 DeviceReset: reset device, device_id=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:51.105.784 [runtime.cc:3444] 618646 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x4, reset:0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:51.105.797 [api_impl.cc:3449] 618646 DeviceReset: Succ, userDeviceId=0.
[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:51.105.807 [device.cpp:189]618646 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 0.
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.105.831 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ascend_deprecated_interface.cc:136] CloseTsd] Call aclrtResetDevice, destroy and close tsd successful, ret[0]
[INFO] ME(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.105.869 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:401] ClearDeviceContexts] Release device CPU_0
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.105.901 [mindspore/ccsrc/pybind_api/resource/manager.cc:167] ClearResPart2] End clear device context.
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.105.916 [mindspore/ccsrc/pybind_api/resource/manager.cc:169] ClearResPart2] Start clear kernel runtime...
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.105.932 [mindspore/ccsrc/runtime/device/kernel_runtime_manager.cc:26] ClearRuntimeResource] Release device Ascend_0
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.105.947 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:178] ReleaseDeviceRes] Ascend finalize start
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.105.966 [mindspore/ccsrc/pybind_api/resource/manager.cc:171] ClearResPart2] End clear kernel runtime.
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.105.979 [mindspore/ccsrc/pybind_api/resource/manager.cc:173] ClearResPart2] Start clear CollectiveManager...
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.106.010 [mindspore/ccsrc/distributed/collective/collective_manager.cc:539] Finalize] Begin finalize collective manager.
[INFO] DISTRIBUTED(618646,fffecfffefa0,python3.9):2025-04-03-09:27:51.106.190 [mindspore/ccsrc/distributed/collective/collective_manager.cc:513] operator()] Start finalizing host communication lib.
[INFO] DEVICE(618646,fffecfffefa0,python3.9):2025-04-03-09:27:51.106.220 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:64] Finish] Begin to finish the cpu collective node.
[INFO] DEVICE(618646,fffecfffefa0,python3.9):2025-04-03-09:27:51.106.235 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:69] Finish] The cpu collective node has been finished successfully.
[INFO] PS(618646,fffecfffefa0,python3.9):2025-04-03-09:27:51.106.249 [mindspore/ccsrc/ps/core/ps_worker_node.cc:45] Stop] Stop worker node!
[INFO] PS(618646,fffecfffefa0,python3.9):2025-04-03-09:27:51.106.270 [mindspore/ccsrc/ps/core/communicator/tcp_client.cc:176] Stop] Stop tcp client!
[INFO] PS(618646,fffecfffefa0,python3.9):2025-04-03-09:27:51.106.295 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:232] Stop] Stop tcp server!
[INFO] DISTRIBUTED(618646,fffecfffefa0,python3.9):2025-04-03-09:27:51.106.316 [mindspore/ccsrc/distributed/collective/collective_manager.cc:517] operator()] End finalizing host communication lib.
[INFO] DISTRIBUTED(618646,fffecfffefa0,python3.9):2025-04-03-09:27:51.106.329 [mindspore/ccsrc/distributed/collective/collective_manager.cc:522] operator()] Start finalizing device communication lib.
[INFO] DISTRIBUTED(618646,fffecfffefa0,python3.9):2025-04-03-09:27:51.106.357 [mindspore/ccsrc/distributed/collective/collective_manager.cc:526] operator()] End finalizing device communication lib.
[INFO] PS(618646,ffff167cefa0,python3.9):2025-04-03-09:27:51.106.355 [mindspore/ccsrc/ps/core/communicator/tcp_client.cc:318] Start] Event base dispatch success!
[INFO] PS(618646,ffff16fdefa0,python3.9):2025-04-03-09:27:51.106.355 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:220] Start] Event base dispatch success!
[INFO] DISTRIBUTED(618646,fffea8f9efa0,python3.9):2025-04-03-09:27:51.106.413 [mindspore/ccsrc/distributed/collective/collective_manager.cc:960] RunInitCommTasks] Initialize communciator thread is stopped.
[INFO] DISTRIBUTED(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.106.537 [mindspore/ccsrc/distributed/collective/collective_manager.cc:547] Finalize] End finalize collective manager.
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.106.555 [mindspore/ccsrc/pybind_api/resource/manager.cc:176] ClearResPart2] End clear CollectiveManager.
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.106.569 [mindspore/ccsrc/pybind_api/resource/manager.cc:178] ClearResPart2] Start clear AnalysisResultCacheMgr...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.106.598 [mindspore/ccsrc/pybind_api/resource/manager.cc:180] ClearResPart2] End clear AnalysisResultCacheMgr.
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.106.611 [mindspore/ccsrc/pybind_api/resource/manager.cc:182] ClearResPart2] Start clear AnalysisContext...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.106.623 [mindspore/ccsrc/pybind_api/resource/manager.cc:184] ClearResPart2] End clear AnalysisContext...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.106.636 [mindspore/ccsrc/pybind_api/resource/manager.cc:186] ClearResPart2] Start clear AnalysisSchedule...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.106.753 [mindspore/ccsrc/pybind_api/resource/manager.cc:188] ClearResPart2] End clear AnalysisSchedule...
[INFO] DEBUG(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.106.778 [mindspore/ccsrc/debug/debugger/debugger.cc:149] Reset] Release Debugger resource.
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.106.813 [mindspore/ccsrc/pybind_api/resource/manager.cc:200] ClearResPart3] Start clear ClearObjectCache...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.106.827 [mindspore/ccsrc/pybind_api/resource/manager.cc:202] ClearResPart3] End clear ClearObjectCache...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.106.841 [mindspore/ccsrc/pybind_api/resource/manager.cc:204] ClearResPart3] Start clear Parser...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.106.856 [mindspore/ccsrc/pybind_api/resource/manager.cc:206] ClearResPart3] End clear Parser...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.106.869 [mindspore/ccsrc/pybind_api/resource/manager.cc:208] ClearResPart3] Start ClearTraceStack...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.106.930 [mindspore/ccsrc/pybind_api/resource/manager.cc:210] ClearResPart3] End ClearTraceStack...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.106.943 [mindspore/ccsrc/pybind_api/resource/manager.cc:212] ClearResPart3] Start clear InterpretNodeRecorder...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.106.958 [mindspore/ccsrc/pybind_api/resource/manager.cc:214] ClearResPart3] End clear InterpretNodeRecorder...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.106.970 [mindspore/ccsrc/pybind_api/resource/manager.cc:216] ClearResPart3] Start clear parallel::entire_costgraph...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.107.022 [mindspore/ccsrc/pybind_api/resource/manager.cc:218] ClearResPart3] End clear parallel::entire_costgraph...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.107.036 [mindspore/ccsrc/pybind_api/resource/manager.cc:220] ClearResPart3] Start clear ProtobufLibrary...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.107.274 [mindspore/ccsrc/pybind_api/resource/manager.cc:222] ClearResPart3] End clear ProtobufLibrary...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.107.292 [mindspore/ccsrc/pybind_api/resource/manager.cc:224] ClearResPart3] Start clear ParserDefaultObjects ...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.107.320 [mindspore/ccsrc/pybind_api/resource/manager.cc:226] ClearResPart3] End clear ParserDefaultObjects...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.107.334 [mindspore/ccsrc/pybind_api/resource/manager.cc:231] ClearResPart3] Start clear python_adapter...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.107.348 [mindspore/ccsrc/pybind_api/resource/manager.cc:233] ClearResPart3] End clear python_adapter.
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.107.361 [mindspore/ccsrc/pybind_api/resource/manager.cc:237] ClearSingleton] Start clear singleton...
[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.107.557 [mindspore/ccsrc/pybind_api/resource/manager.cc:255] ClearSingleton] End clear singleton.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:51.171.751 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:591] DoFreeTensorMem] Free tensor mem failed, can not find address : 0x12d100000000.
[INFO] PRE_ACT(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:51.171.892 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:591] DoFreeTensorMem] Free tensor mem failed, can not find address : 0x12c2c0000000.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:51.208.503 [awatchdog_monitor.c:160](tid:618680) thread 618977 not exist
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:51.208.797 [runtime.cc:5239] 618834 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:51.208.877 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618834] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:51.208.897 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618834] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:51.208.911 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618834] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:51.208.945 [runtime.cc:3077] 618834 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=0, devId=0, tdt status=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:51.209.083 [npu_driver.cc:551] 618834 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:51.227.250 [awatchdog_monitor.c:160](tid:618684) thread 618957 not exist
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:51.252.564 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:591] DoFreeTensorMem] Free tensor mem failed, can not find address : 0x12d100000000.
[INFO] PRE_ACT(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:51.252.709 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:591] DoFreeTensorMem] Free tensor mem failed, can not find address : 0x12c2c0000000.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:51.268.541 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:591] DoFreeTensorMem] Free tensor mem failed, can not find address : 0x12d100000000.
[INFO] PRE_ACT(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:51.268.707 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:591] DoFreeTensorMem] Free tensor mem failed, can not find address : 0x12c2c0000000.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:51.270.222 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:591] DoFreeTensorMem] Free tensor mem failed, can not find address : 0x12d100000000.
[INFO] PRE_ACT(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:51.270.350 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:591] DoFreeTensorMem] Free tensor mem failed, can not find address : 0x12c2c0000000.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:51.369.258 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:591] DoFreeTensorMem] Free tensor mem failed, can not find address : 0x12d100000000.
[INFO] PRE_ACT(618650,ffffbf562de0,python3.9):2025-04-03-09:27:51.369.408 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:591] DoFreeTensorMem] Free tensor mem failed, can not find address : 0x12c2c0000000.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:51.400.765 [runtime.cc:5239] 618820 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:51.400.823 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618820] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:51.400.841 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618820] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:51.400.853 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618820] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:51.400.794 [runtime.cc:5239] 618826 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:51.400.862 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618826] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:51.400.879 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618826] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:51.400.888 [runtime.cc:3077] 618820 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=6, devId=6, tdt status=0
[INFO] TDT(618650,python3.9):2025-04-03-09:27:51.400.892 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618826] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:51.400.918 [runtime.cc:3077] 618826 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=1, devId=1, tdt status=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:51.400.821 [runtime.cc:5239] 618772 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:51.400.903 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618772] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:51.400.921 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618772] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:51.401.001 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618772] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:51.401.031 [runtime.cc:3077] 618772 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=3, devId=3, tdt status=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:51.401.037 [npu_driver.cc:551] 618826 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:51.401.036 [npu_driver.cc:551] 618820 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:51.401.175 [npu_driver.cc:551] 618772 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:51.432.712 [runtime.cc:5239] 618812 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:51.432.732 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618812] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:51.432.742 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618812] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:51.432.751 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618812] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:51.432.764 [runtime.cc:3077] 618812 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=7, devId=7, tdt status=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:51.432.807 [npu_driver.cc:551] 618812 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:51.432.807 [runtime.cc:5239] 618806 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:51.432.870 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618806] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:51.432.886 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618806] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:51.432.896 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618806] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:51.432.815 [runtime.cc:5239] 618814 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:51.432.887 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618814] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:51.432.903 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618814] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:51.432.811 [runtime.cc:5239] 618830 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:51.432.886 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618830] [TsdClient] g_userDeviceInfo is empty.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:51.432.903 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618830] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:51.432.928 [runtime.cc:3077] 618806 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=5, devId=5, tdt status=0
[INFO] TDT(618662,python3.9):2025-04-03-09:27:51.432.917 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618814] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:51.432.942 [runtime.cc:3077] 618814 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=4, devId=4, tdt status=0
[INFO] TDT(618654,python3.9):2025-04-03-09:27:51.432.918 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618830] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:51.432.940 [runtime.cc:3077] 618830 GetHdcConctStatus: tsdGetHdcConctStatus success, userDeviceId=2, devId=2, tdt status=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:51.433.042 [npu_driver.cc:551] 618806 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:51.433.057 [npu_driver.cc:551] 618814 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:51.433.057 [npu_driver.cc:551] 618830 ReadFaultEvent: read fault event, device_id=-1, filterFlag=9, event_id=2162263040, timeout=1000ms.
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:51.520.198 [queue_client_comm.c:114][ascend][curpid:618658,618781][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=29; gid=44; tid=1; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:51.520.199 [queue_client_comm.c:114][ascend][curpid:618658,618789][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=32; gid=44; tid=4; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:51.520.199 [queue_client_comm.c:114][ascend][curpid:618658,618783][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=31; gid=44; tid=3; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:51.520.200 [queue_client_comm.c:114][ascend][curpid:618658,618785][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=30; gid=44; tid=2; timeout=800ms)
[WARNING] DRV(618658,python3.9):2025-04-03-09:27:51.520.200 [queue_client_comm.c:114][ascend][curpid:618658,618787][drv][queuemng][QueueWaitEvent]HalEschedWaitEvent invalid. (ret=16; event_id=28; gid=44; tid=0; timeout=800ms)
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:51.520.388 [npu_driver.cc:4338] 618789 MemQueuePeek: queue empty
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:51.520.407 [npu_driver.cc:4338] 618781 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:51.520.419 [tensor_data_transfer.cpp:612]618789 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_histogram_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:51.520.426 [tensor_data_transfer.cpp:612]618781 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_tensor_dump
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:51.520.441 [npu_driver.cc:4338] 618783 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:51.520.458 [tensor_data_transfer.cpp:612]618783 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_tensor_summary
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:51.520.477 [npu_driver.cc:4338] 618785 MemQueuePeek: queue empty
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:51.520.508 [npu_driver.cc:4338] 618787 MemQueuePeek: queue empty
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:51.520.508 [tensor_data_transfer.cpp:612]618785 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_image_summary
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:51.520.529 [tensor_data_transfer.cpp:612]618787 acltdtReceiveTensorV2: queue is empty, device is 3, name is ms_scalar_summary
[INFO] DEVICE(618658,ffff077eefa0,python3.9):2025-04-03-09:27:51.520.631 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] DEVICE(618658,fffee2fdefa0,python3.9):2025-04-03-09:27:51.520.631 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] DEVICE(618658,ffff067cefa0,python3.9):2025-04-03-09:27:51.520.644 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] DEVICE(618658,fffee3ffefa0,python3.9):2025-04-03-09:27:51.520.709 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] DEVICE(618658,ffff057aefa0,python3.9):2025-04-03-09:27:51.520.703 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:152] ~AclDatasetInfo] AcltdtDestroyDataset succeeded.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:51.521.042 [tensor_data_transfer.cpp:973]618658 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 3, name is ms_histogram_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:51.521.084 [api_impl.cc:6065] 618658 MemQueueDestroy: Start to destroy queue on devId 3, qid is 5.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:51.521.103 [npu_driver.cc:3989] 618658 MemQueueDestroy: deviceId=3, qid=5.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:51.521.479 [tensor_data_transfer.cpp:977]618658 acltdtDestroyChannel: acltdtDestroyChannel success, device is 3, name is ms_histogram_summary
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.521.542 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_scalar_summary channel is being destroyed.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.521.574 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_scalar_summary begins the destruction process.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:51.521.655 [tensor_data_transfer.cpp:973]618658 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 3, name is ms_scalar_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:51.521.678 [api_impl.cc:6065] 618658 MemQueueDestroy: Start to destroy queue on devId 3, qid is 4.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:51.521.691 [npu_driver.cc:3989] 618658 MemQueueDestroy: deviceId=3, qid=4.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:51.522.052 [tensor_data_transfer.cpp:977]618658 acltdtDestroyChannel: acltdtDestroyChannel success, device is 3, name is ms_scalar_summary
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.522.085 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_image_summary channel is being destroyed.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.522.110 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_image_summary begins the destruction process.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:51.522.161 [tensor_data_transfer.cpp:973]618658 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 3, name is ms_image_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:51.522.183 [api_impl.cc:6065] 618658 MemQueueDestroy: Start to destroy queue on devId 3, qid is 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:51.522.195 [npu_driver.cc:3989] 618658 MemQueueDestroy: deviceId=3, qid=3.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:51.522.636 [tensor_data_transfer.cpp:977]618658 acltdtDestroyChannel: acltdtDestroyChannel success, device is 3, name is ms_image_summary
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.522.668 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_tensor_summary channel is being destroyed.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.522.691 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_tensor_summary begins the destruction process.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:51.522.802 [tensor_data_transfer.cpp:973]618658 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 3, name is ms_tensor_summary
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:51.522.822 [api_impl.cc:6065] 618658 MemQueueDestroy: Start to destroy queue on devId 3, qid is 2.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:51.522.835 [npu_driver.cc:3989] 618658 MemQueueDestroy: deviceId=3, qid=2.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:51.523.191 [tensor_data_transfer.cpp:977]618658 acltdtDestroyChannel: acltdtDestroyChannel success, device is 3, name is ms_tensor_summary
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.523.250 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h:252] DestoryHandler] The thread of ms_tensor_dump channel is being destroyed.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.523.272 [mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.cc:325] ~MbufDataHandler] Channel ms_tensor_dump begins the destruction process.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:51.523.331 [tensor_data_transfer.cpp:973]618658 acltdtDestroyChannel: start to acltdtDestroyChannel, device is 3, name is ms_tensor_dump
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:51.523.351 [api_impl.cc:6065] 618658 MemQueueDestroy: Start to destroy queue on devId 3, qid is 1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:51.523.363 [npu_driver.cc:3989] 618658 MemQueueDestroy: deviceId=3, qid=1.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:51.523.713 [tensor_data_transfer.cpp:977]618658 acltdtDestroyChannel: acltdtDestroyChannel success, device is 3, name is ms_tensor_dump
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:51.523.745 [device.cpp:183]618658 aclrtResetDevice: start to execute aclrtResetDevice, deviceId = 3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:51.523.772 [api_impl.cc:3419] 618658 DeviceReset: reset device, device_id=3.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:51.523.790 [runtime.cc:3444] 618658 PrimaryContextRelease: Context TryDecRef, ts_id=0, count=0x4, reset:0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:51.523.809 [api_impl.cc:3449] 618658 DeviceReset: Succ, userDeviceId=3.
[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:51.523.820 [device.cpp:189]618658 aclrtResetDevice: successfully execute aclrtResetDevice, reset device 3.
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.523.847 [mindspore/ccsrc/plugin/device/ascend/hal/hardware/ascend_deprecated_interface.cc:136] CloseTsd] Call aclrtResetDevice, destroy and close tsd successful, ret[0]
[INFO] ME(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.523.883 [mindspore/ccsrc/runtime/hardware/device_context_manager.cc:401] ClearDeviceContexts] Release device CPU_0
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.523.935 [mindspore/ccsrc/pybind_api/resource/manager.cc:167] ClearResPart2] End clear device context.
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.523.954 [mindspore/ccsrc/pybind_api/resource/manager.cc:169] ClearResPart2] Start clear kernel runtime...
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.523.978 [mindspore/ccsrc/runtime/device/kernel_runtime_manager.cc:26] ClearRuntimeResource] Release device Ascend_3
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.523.998 [mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.cc:178] ReleaseDeviceRes] Ascend finalize start
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.524.025 [mindspore/ccsrc/pybind_api/resource/manager.cc:171] ClearResPart2] End clear kernel runtime.
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.524.044 [mindspore/ccsrc/pybind_api/resource/manager.cc:173] ClearResPart2] Start clear CollectiveManager...
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.524.071 [mindspore/ccsrc/distributed/collective/collective_manager.cc:539] Finalize] Begin finalize collective manager.
[INFO] DISTRIBUTED(618658,ffff06fdefa0,python3.9):2025-04-03-09:27:51.524.318 [mindspore/ccsrc/distributed/collective/collective_manager.cc:513] operator()] Start finalizing host communication lib.
[INFO] DEVICE(618658,ffff06fdefa0,python3.9):2025-04-03-09:27:51.524.363 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:64] Finish] Begin to finish the cpu collective node.
[INFO] DEVICE(618658,ffff06fdefa0,python3.9):2025-04-03-09:27:51.524.386 [mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_node.cc:69] Finish] The cpu collective node has been finished successfully.
[INFO] PS(618658,ffff06fdefa0,python3.9):2025-04-03-09:27:51.524.424 [mindspore/ccsrc/ps/core/ps_worker_node.cc:45] Stop] Stop worker node!
[INFO] PS(618658,ffff06fdefa0,python3.9):2025-04-03-09:27:51.524.451 [mindspore/ccsrc/ps/core/communicator/tcp_client.cc:176] Stop] Stop tcp client!
[INFO] PS(618658,ffff06fdefa0,python3.9):2025-04-03-09:27:51.524.486 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:232] Stop] Stop tcp server!
[INFO] DISTRIBUTED(618658,ffff06fdefa0,python3.9):2025-04-03-09:27:51.524.513 [mindspore/ccsrc/distributed/collective/collective_manager.cc:517] operator()] End finalizing host communication lib.
[INFO] DISTRIBUTED(618658,ffff06fdefa0,python3.9):2025-04-03-09:27:51.524.531 [mindspore/ccsrc/distributed/collective/collective_manager.cc:522] operator()] Start finalizing device communication lib.
[INFO] PS(618658,ffff4d7aefa0,python3.9):2025-04-03-09:27:51.524.553 [mindspore/ccsrc/ps/core/communicator/tcp_client.cc:318] Start] Event base dispatch success!
[INFO] PS(618658,ffff4dfbefa0,python3.9):2025-04-03-09:27:51.524.543 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:220] Start] Event base dispatch success!
[INFO] DISTRIBUTED(618658,ffff06fdefa0,python3.9):2025-04-03-09:27:51.524.565 [mindspore/ccsrc/distributed/collective/collective_manager.cc:526] operator()] End finalizing device communication lib.
[INFO] DISTRIBUTED(618658,fffec77eefa0,python3.9):2025-04-03-09:27:51.524.655 [mindspore/ccsrc/distributed/collective/collective_manager.cc:960] RunInitCommTasks] Initialize communciator thread is stopped.
[INFO] DISTRIBUTED(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.524.758 [mindspore/ccsrc/distributed/collective/collective_manager.cc:547] Finalize] End finalize collective manager.
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.524.784 [mindspore/ccsrc/pybind_api/resource/manager.cc:176] ClearResPart2] End clear CollectiveManager.
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.524.802 [mindspore/ccsrc/pybind_api/resource/manager.cc:178] ClearResPart2] Start clear AnalysisResultCacheMgr...
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.524.825 [mindspore/ccsrc/pybind_api/resource/manager.cc:180] ClearResPart2] End clear AnalysisResultCacheMgr.
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.524.843 [mindspore/ccsrc/pybind_api/resource/manager.cc:182] ClearResPart2] Start clear AnalysisContext...
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.524.861 [mindspore/ccsrc/pybind_api/resource/manager.cc:184] ClearResPart2] End clear AnalysisContext...
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.524.875 [mindspore/ccsrc/pybind_api/resource/manager.cc:186] ClearResPart2] Start clear AnalysisSchedule...
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.524.989 [mindspore/ccsrc/pybind_api/resource/manager.cc:188] ClearResPart2] End clear AnalysisSchedule...
[INFO] DEBUG(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.525.021 [mindspore/ccsrc/debug/debugger/debugger.cc:149] Reset] Release Debugger resource.
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.525.077 [mindspore/ccsrc/pybind_api/resource/manager.cc:200] ClearResPart3] Start clear ClearObjectCache...
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.525.097 [mindspore/ccsrc/pybind_api/resource/manager.cc:202] ClearResPart3] End clear ClearObjectCache...
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.525.118 [mindspore/ccsrc/pybind_api/resource/manager.cc:204] ClearResPart3] Start clear Parser...
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.525.152 [mindspore/ccsrc/pybind_api/resource/manager.cc:206] ClearResPart3] End clear Parser...
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.525.169 [mindspore/ccsrc/pybind_api/resource/manager.cc:208] ClearResPart3] Start ClearTraceStack...
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.525.206 [mindspore/ccsrc/pybind_api/resource/manager.cc:210] ClearResPart3] End ClearTraceStack...
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.525.237 [mindspore/ccsrc/pybind_api/resource/manager.cc:212] ClearResPart3] Start clear InterpretNodeRecorder...
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.525.256 [mindspore/ccsrc/pybind_api/resource/manager.cc:214] ClearResPart3] End clear InterpretNodeRecorder...
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.525.274 [mindspore/ccsrc/pybind_api/resource/manager.cc:216] ClearResPart3] Start clear parallel::entire_costgraph...
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.525.314 [mindspore/ccsrc/pybind_api/resource/manager.cc:218] ClearResPart3] End clear parallel::entire_costgraph...
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.525.333 [mindspore/ccsrc/pybind_api/resource/manager.cc:220] ClearResPart3] Start clear ProtobufLibrary...
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.525.666 [mindspore/ccsrc/pybind_api/resource/manager.cc:222] ClearResPart3] End clear ProtobufLibrary...
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.525.688 [mindspore/ccsrc/pybind_api/resource/manager.cc:224] ClearResPart3] Start clear ParserDefaultObjects ...
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.525.725 [mindspore/ccsrc/pybind_api/resource/manager.cc:226] ClearResPart3] End clear ParserDefaultObjects...
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.525.746 [mindspore/ccsrc/pybind_api/resource/manager.cc:231] ClearResPart3] Start clear python_adapter...
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.525.764 [mindspore/ccsrc/pybind_api/resource/manager.cc:233] ClearResPart3] End clear python_adapter.
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.525.785 [mindspore/ccsrc/pybind_api/resource/manager.cc:237] ClearSingleton] Start clear singleton...
[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.526.033 [mindspore/ccsrc/pybind_api/resource/manager.cc:255] ClearSingleton] End clear singleton.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.536.955 [heartbeat.cc:145] [618666][DeInit]heartbeat deinit begin
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.537.099 [heartbeat.cc:183] [618666][DeInit]heartbeat deinit end
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.537.126 [heartbeat.cc:145] [618666][DeInit]heartbeat deinit begin
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.537.440 [heartbeat.cc:183] [618666][DeInit]heartbeat deinit end
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.537.457 [heartbeat.cc:145] [618666][DeInit]heartbeat deinit begin
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.537.876 [heartbeat.cc:183] [618666][DeInit]heartbeat deinit end
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.537.911 [heartbeat.cc:145] [618666][DeInit]heartbeat deinit begin
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.538.012 [heartbeat.cc:183] [618666][DeInit]heartbeat deinit end
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.538.026 [heartbeat.cc:145] [618666][DeInit]heartbeat deinit begin
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.538.039 [heartbeat.cc:183] [618666][DeInit]heartbeat deinit end
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.538.052 [heartbeat.cc:145] [618666][DeInit]heartbeat deinit begin
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.538.073 [heartbeat.cc:183] [618666][DeInit]heartbeat deinit end
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.538.085 [heartbeat.cc:145] [618666][DeInit]heartbeat deinit begin
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.538.344 [heartbeat.cc:183] [618666][DeInit]heartbeat deinit end
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.538.359 [heartbeat.cc:145] [618666][DeInit]heartbeat deinit begin
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.538.612 [heartbeat.cc:183] [618666][DeInit]heartbeat deinit end
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.538.627 [heartbeat.cc:145] [618666][DeInit]heartbeat deinit begin
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.538.916 [heartbeat.cc:183] [618666][DeInit]heartbeat deinit end
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.538.932 [heartbeat.cc:145] [618666][DeInit]heartbeat deinit begin
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.539.286 [heartbeat.cc:183] [618666][DeInit]heartbeat deinit end
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.539.302 [heartbeat.cc:145] [618666][DeInit]heartbeat deinit begin
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.539.395 [heartbeat.cc:183] [618666][DeInit]heartbeat deinit end
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.539.409 [heartbeat.cc:145] [618666][DeInit]heartbeat deinit begin
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.539.420 [heartbeat.cc:183] [618666][DeInit]heartbeat deinit end
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.539.430 [heartbeat.cc:145] [618666][DeInit]heartbeat deinit begin
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.539.441 [heartbeat.cc:183] [618666][DeInit]heartbeat deinit end
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.539.451 [heartbeat.cc:145] [618666][DeInit]heartbeat deinit begin
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.539.462 [heartbeat.cc:183] [618666][DeInit]heartbeat deinit end
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.539.475 [heartbeat.cc:145] [618666][DeInit]heartbeat deinit begin
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.539.485 [heartbeat.cc:183] [618666][DeInit]heartbeat deinit end
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.539.497 [heartbeat.cc:145] [618666][DeInit]heartbeat deinit begin
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:51.539.508 [heartbeat.cc:183] [618666][DeInit]heartbeat deinit end
[INFO] DEVICE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:51.539.752 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:67] ~HcclWatchDogHandler] HcclWatchDogHandler thread exit, rank id: 5, group name: hccl_world_group
[INFO] PROFILING(618666,python3.9):2025-04-03-09:27:51.539.812 [hash_data.cpp:63] >>> (tid:618666) HashData uninitialize success
[INFO] PROFILING(618666,python3.9):2025-04-03-09:27:51.539.832 [msprof_reporter_mgr.cpp:270] >>> (tid:618666) The reporter isn't started, don't need to be stopped.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:51.542.100 [api_impl.cc:2003] 618666 DevFree: device free mem=0x12c041200000
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.543.398 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:591] DoFreeTensorMem] Free tensor mem failed, can not find address : 0x12d100000000.
[INFO] PRE_ACT(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.543.500 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:591] DoFreeTensorMem] Free tensor mem failed, can not find address : 0x12c2c0000000.
[INFO] CORE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:51.544.440 [mindspore/core/utils/temp_file_manager.cc:59] CleanTempFiles] Start delete temp files.
[INFO] CORE(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:51.544.471 [mindspore/core/utils/temp_file_manager.cc:63] CleanTempFiles] End delete temp files.
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:51.544.641 [adx_dump_record.cpp:229][tid:618666] start to dump uninit
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:51.544.686 [adx_dump_record.cpp:239][tid:618666] dump uninit success
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:51.544.697 [adx_dump_record.cpp:674][tid:618839] exit record file thread
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.568.072 [heartbeat.cc:145] [618670][DeInit]heartbeat deinit begin
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.568.521 [heartbeat.cc:183] [618670][DeInit]heartbeat deinit end
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.568.558 [heartbeat.cc:145] [618670][DeInit]heartbeat deinit begin
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.568.963 [heartbeat.cc:183] [618670][DeInit]heartbeat deinit end
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.568.984 [heartbeat.cc:145] [618670][DeInit]heartbeat deinit begin
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.569.077 [heartbeat.cc:183] [618670][DeInit]heartbeat deinit end
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.569.093 [heartbeat.cc:145] [618670][DeInit]heartbeat deinit begin
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.569.105 [heartbeat.cc:183] [618670][DeInit]heartbeat deinit end
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.569.117 [heartbeat.cc:145] [618670][DeInit]heartbeat deinit begin
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.569.142 [heartbeat.cc:183] [618670][DeInit]heartbeat deinit end
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.569.157 [heartbeat.cc:145] [618670][DeInit]heartbeat deinit begin
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.569.439 [heartbeat.cc:183] [618670][DeInit]heartbeat deinit end
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.569.457 [heartbeat.cc:145] [618670][DeInit]heartbeat deinit begin
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.569.488 [heartbeat.cc:183] [618670][DeInit]heartbeat deinit end
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.569.504 [heartbeat.cc:145] [618670][DeInit]heartbeat deinit begin
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.569.521 [heartbeat.cc:183] [618670][DeInit]heartbeat deinit end
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.569.535 [heartbeat.cc:145] [618670][DeInit]heartbeat deinit begin
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.569.905 [heartbeat.cc:183] [618670][DeInit]heartbeat deinit end
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.569.924 [heartbeat.cc:145] [618670][DeInit]heartbeat deinit begin
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.570.056 [heartbeat.cc:183] [618670][DeInit]heartbeat deinit end
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.570.073 [heartbeat.cc:145] [618670][DeInit]heartbeat deinit begin
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.570.418 [heartbeat.cc:183] [618670][DeInit]heartbeat deinit end
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.570.437 [heartbeat.cc:145] [618670][DeInit]heartbeat deinit begin
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.570.470 [heartbeat.cc:183] [618670][DeInit]heartbeat deinit end
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.570.488 [heartbeat.cc:145] [618670][DeInit]heartbeat deinit begin
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.570.499 [heartbeat.cc:183] [618670][DeInit]heartbeat deinit end
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.570.512 [heartbeat.cc:145] [618670][DeInit]heartbeat deinit begin
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.570.558 [heartbeat.cc:183] [618670][DeInit]heartbeat deinit end
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.570.572 [heartbeat.cc:145] [618670][DeInit]heartbeat deinit begin
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.570.584 [heartbeat.cc:183] [618670][DeInit]heartbeat deinit end
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.570.596 [heartbeat.cc:145] [618670][DeInit]heartbeat deinit begin
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:51.570.612 [heartbeat.cc:183] [618670][DeInit]heartbeat deinit end
[INFO] DEVICE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:51.570.958 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:67] ~HcclWatchDogHandler] HcclWatchDogHandler thread exit, rank id: 6, group name: hccl_world_group
[INFO] PROFILING(618670,python3.9):2025-04-03-09:27:51.571.033 [hash_data.cpp:63] >>> (tid:618670) HashData uninitialize success
[INFO] PROFILING(618670,python3.9):2025-04-03-09:27:51.571.059 [msprof_reporter_mgr.cpp:270] >>> (tid:618670) The reporter isn't started, don't need to be stopped.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:51.573.250 [api_impl.cc:2003] 618670 DevFree: device free mem=0x12c041200000
[INFO] CORE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:51.575.153 [mindspore/core/utils/temp_file_manager.cc:59] CleanTempFiles] Start delete temp files.
[INFO] CORE(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:51.575.183 [mindspore/core/utils/temp_file_manager.cc:63] CleanTempFiles] End delete temp files.
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:51.575.337 [adx_dump_record.cpp:229][tid:618670] start to dump uninit
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:51.575.369 [adx_dump_record.cpp:239][tid:618670] dump uninit success
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:51.575.389 [adx_dump_record.cpp:674][tid:618899] exit record file thread
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.577.522 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:591] DoFreeTensorMem] Free tensor mem failed, can not find address : 0x12d100000000.
[INFO] PRE_ACT(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.577.667 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:591] DoFreeTensorMem] Free tensor mem failed, can not find address : 0x12c2c0000000.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:51.585.369 [awatchdog_monitor.c:160](tid:618687) thread 618795 not exist
[INFO] GE(618666,python3.9):2025-04-03-09:27:51.599.487 [operator_factory_impl.cc:392]618666 ReleaseRegInfo:Release ops proto reg info success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:51.613.414 [operator_factory_impl.cc:392]618666 ReleaseRegInfo:Release ops proto reg info success.
[INFO] GE(618666,python3.9):2025-04-03-09:27:51.613.490 [opsproto_manager.cc:66]618666 Finalize:close opsprotomanager handler success
[INFO] GE(618666,python3.9):2025-04-03-09:27:51.613.502 [opsproto_manager.cc:66]618666 Finalize:close opsprotomanager handler success
[INFO] GE(618666,python3.9):2025-04-03-09:27:51.613.513 [opsproto_manager.cc:66]618666 Finalize:close opsprotomanager handler success
[INFO] GE(618666,python3.9):2025-04-03-09:27:51.613.523 [opsproto_manager.cc:66]618666 Finalize:close opsprotomanager handler success
[INFO] GE(618666,python3.9):2025-04-03-09:27:51.613.532 [opsproto_manager.cc:66]618666 Finalize:close opsprotomanager handler success
[INFO] GE(618666,python3.9):2025-04-03-09:27:51.613.543 [opsproto_manager.cc:66]618666 Finalize:close opsprotomanager handler success
[INFO] GE(618666,python3.9):2025-04-03-09:27:51.613.552 [opsproto_manager.cc:66]618666 Finalize:close opsprotomanager handler success
[INFO] GE(618666,python3.9):2025-04-03-09:27:51.613.563 [opsproto_manager.cc:66]618666 Finalize:close opsprotomanager handler success
[INFO] GE(618666,python3.9):2025-04-03-09:27:51.634.747 [opsproto_manager.cc:66]618666 Finalize:close opsprotomanager handler success
[INFO] GE(618666,python3.9):2025-04-03-09:27:51.634.946 [opsproto_manager.cc:66]618666 Finalize:close opsprotomanager handler success
[INFO] GE(618666,python3.9):2025-04-03-09:27:51.634.996 [opsproto_manager.cc:66]618666 Finalize:close opsprotomanager handler success
[INFO] GE(618670,python3.9):2025-04-03-09:27:51.639.497 [operator_factory_impl.cc:392]618670 ReleaseRegInfo:Release ops proto reg info success.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.653.123 [heartbeat.cc:145] [618674][DeInit]heartbeat deinit begin
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.653.335 [heartbeat.cc:183] [618674][DeInit]heartbeat deinit end
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.653.404 [heartbeat.cc:145] [618674][DeInit]heartbeat deinit begin
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.653.657 [heartbeat.cc:183] [618674][DeInit]heartbeat deinit end
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.653.677 [heartbeat.cc:145] [618674][DeInit]heartbeat deinit begin
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.653.755 [heartbeat.cc:183] [618674][DeInit]heartbeat deinit end
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.653.772 [heartbeat.cc:145] [618674][DeInit]heartbeat deinit begin
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.654.200 [heartbeat.cc:183] [618674][DeInit]heartbeat deinit end
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.654.221 [heartbeat.cc:145] [618674][DeInit]heartbeat deinit begin
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.654.324 [heartbeat.cc:183] [618674][DeInit]heartbeat deinit end
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.654.341 [heartbeat.cc:145] [618674][DeInit]heartbeat deinit begin
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.654.357 [heartbeat.cc:183] [618674][DeInit]heartbeat deinit end
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.654.373 [heartbeat.cc:145] [618674][DeInit]heartbeat deinit begin
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.654.403 [heartbeat.cc:183] [618674][DeInit]heartbeat deinit end
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.654.420 [heartbeat.cc:145] [618674][DeInit]heartbeat deinit begin
[INFO] GE(618670,python3.9):2025-04-03-09:27:51.654.526 [operator_factory_impl.cc:392]618670 ReleaseRegInfo:Release ops proto reg info success.
[INFO] GE(618670,python3.9):2025-04-03-09:27:51.654.572 [opsproto_manager.cc:66]618670 Finalize:close opsprotomanager handler success
[INFO] GE(618670,python3.9):2025-04-03-09:27:51.654.588 [opsproto_manager.cc:66]618670 Finalize:close opsprotomanager handler success
[INFO] GE(618670,python3.9):2025-04-03-09:27:51.654.605 [opsproto_manager.cc:66]618670 Finalize:close opsprotomanager handler success
[INFO] GE(618670,python3.9):2025-04-03-09:27:51.654.616 [opsproto_manager.cc:66]618670 Finalize:close opsprotomanager handler success
[INFO] GE(618670,python3.9):2025-04-03-09:27:51.654.627 [opsproto_manager.cc:66]618670 Finalize:close opsprotomanager handler success
[INFO] GE(618670,python3.9):2025-04-03-09:27:51.654.639 [opsproto_manager.cc:66]618670 Finalize:close opsprotomanager handler success
[INFO] GE(618670,python3.9):2025-04-03-09:27:51.654.650 [opsproto_manager.cc:66]618670 Finalize:close opsprotomanager handler success
[INFO] GE(618670,python3.9):2025-04-03-09:27:51.654.661 [opsproto_manager.cc:66]618670 Finalize:close opsprotomanager handler success
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.654.765 [heartbeat.cc:183] [618674][DeInit]heartbeat deinit end
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.654.785 [heartbeat.cc:145] [618674][DeInit]heartbeat deinit begin
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.654.821 [heartbeat.cc:183] [618674][DeInit]heartbeat deinit end
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.654.838 [heartbeat.cc:145] [618674][DeInit]heartbeat deinit begin
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.654.880 [heartbeat.cc:183] [618674][DeInit]heartbeat deinit end
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.654.897 [heartbeat.cc:145] [618674][DeInit]heartbeat deinit begin
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.655.090 [heartbeat.cc:183] [618674][DeInit]heartbeat deinit end
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.655.108 [heartbeat.cc:145] [618674][DeInit]heartbeat deinit begin
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.655.229 [heartbeat.cc:183] [618674][DeInit]heartbeat deinit end
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.655.247 [heartbeat.cc:145] [618674][DeInit]heartbeat deinit begin
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.655.337 [heartbeat.cc:183] [618674][DeInit]heartbeat deinit end
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.655.354 [heartbeat.cc:145] [618674][DeInit]heartbeat deinit begin
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.655.722 [heartbeat.cc:183] [618674][DeInit]heartbeat deinit end
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.655.744 [heartbeat.cc:145] [618674][DeInit]heartbeat deinit begin
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.655.835 [heartbeat.cc:183] [618674][DeInit]heartbeat deinit end
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.655.854 [heartbeat.cc:145] [618674][DeInit]heartbeat deinit begin
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:51.655.892 [heartbeat.cc:183] [618674][DeInit]heartbeat deinit end
[INFO] DEVICE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:51.656.268 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:67] ~HcclWatchDogHandler] HcclWatchDogHandler thread exit, rank id: 7, group name: hccl_world_group
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.656.288 [heartbeat.cc:145] [618662][DeInit]heartbeat deinit begin
[INFO] PROFILING(618674,python3.9):2025-04-03-09:27:51.656.351 [hash_data.cpp:63] >>> (tid:618674) HashData uninitialize success
[INFO] PROFILING(618674,python3.9):2025-04-03-09:27:51.656.379 [msprof_reporter_mgr.cpp:270] >>> (tid:618674) The reporter isn't started, don't need to be stopped.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.656.669 [heartbeat.cc:183] [618662][DeInit]heartbeat deinit end
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.656.696 [heartbeat.cc:145] [618662][DeInit]heartbeat deinit begin
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.656.773 [heartbeat.cc:183] [618662][DeInit]heartbeat deinit end
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.656.786 [heartbeat.cc:145] [618662][DeInit]heartbeat deinit begin
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.657.199 [heartbeat.cc:183] [618662][DeInit]heartbeat deinit end
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.657.213 [heartbeat.cc:145] [618662][DeInit]heartbeat deinit begin
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.657.307 [heartbeat.cc:183] [618662][DeInit]heartbeat deinit end
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.657.319 [heartbeat.cc:145] [618662][DeInit]heartbeat deinit begin
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.657.330 [heartbeat.cc:183] [618662][DeInit]heartbeat deinit end
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.657.356 [heartbeat.cc:145] [618662][DeInit]heartbeat deinit begin
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.657.378 [heartbeat.cc:183] [618662][DeInit]heartbeat deinit end
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.657.390 [heartbeat.cc:145] [618662][DeInit]heartbeat deinit begin
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.657.921 [heartbeat.cc:183] [618662][DeInit]heartbeat deinit end
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.657.939 [heartbeat.cc:145] [618662][DeInit]heartbeat deinit begin
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.658.245 [heartbeat.cc:183] [618662][DeInit]heartbeat deinit end
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.658.260 [heartbeat.cc:145] [618662][DeInit]heartbeat deinit begin
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.658.288 [heartbeat.cc:183] [618662][DeInit]heartbeat deinit end
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.658.300 [heartbeat.cc:145] [618662][DeInit]heartbeat deinit begin
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.658.397 [heartbeat.cc:183] [618662][DeInit]heartbeat deinit end
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.658.409 [heartbeat.cc:145] [618662][DeInit]heartbeat deinit begin
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:51.658.508 [api_impl.cc:2003] 618674 DevFree: device free mem=0x12c041200000
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.658.563 [heartbeat.cc:183] [618662][DeInit]heartbeat deinit end
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.658.578 [heartbeat.cc:145] [618662][DeInit]heartbeat deinit begin
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.658.667 [heartbeat.cc:183] [618662][DeInit]heartbeat deinit end
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.658.680 [heartbeat.cc:145] [618662][DeInit]heartbeat deinit begin
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.658.736 [heartbeat.cc:183] [618662][DeInit]heartbeat deinit end
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.658.748 [heartbeat.cc:145] [618662][DeInit]heartbeat deinit begin
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.658.775 [heartbeat.cc:183] [618662][DeInit]heartbeat deinit end
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.658.787 [heartbeat.cc:145] [618662][DeInit]heartbeat deinit begin
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.658.886 [heartbeat.cc:183] [618662][DeInit]heartbeat deinit end
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.658.899 [heartbeat.cc:145] [618662][DeInit]heartbeat deinit begin
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:51.658.909 [heartbeat.cc:183] [618662][DeInit]heartbeat deinit end
[INFO] DEVICE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:51.659.206 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:67] ~HcclWatchDogHandler] HcclWatchDogHandler thread exit, rank id: 4, group name: hccl_world_group
[INFO] PROFILING(618662,python3.9):2025-04-03-09:27:51.659.263 [hash_data.cpp:63] >>> (tid:618662) HashData uninitialize success
[INFO] PROFILING(618662,python3.9):2025-04-03-09:27:51.659.283 [msprof_reporter_mgr.cpp:270] >>> (tid:618662) The reporter isn't started, don't need to be stopped.
[INFO] CORE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:51.660.328 [mindspore/core/utils/temp_file_manager.cc:59] CleanTempFiles] Start delete temp files.
[INFO] CORE(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:51.660.361 [mindspore/core/utils/temp_file_manager.cc:63] CleanTempFiles] End delete temp files.
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:51.660.598 [adx_dump_record.cpp:229][tid:618674] start to dump uninit
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:51.660.632 [adx_dump_record.cpp:239][tid:618674] dump uninit success
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:51.660.653 [adx_dump_record.cpp:674][tid:618861] exit record file thread
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:51.661.175 [api_impl.cc:2003] 618662 DevFree: device free mem=0x12c041200000
[INFO] CORE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:51.662.688 [mindspore/core/utils/temp_file_manager.cc:59] CleanTempFiles] Start delete temp files.
[INFO] CORE(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:51.662.714 [mindspore/core/utils/temp_file_manager.cc:63] CleanTempFiles] End delete temp files.
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:51.662.882 [adx_dump_record.cpp:229][tid:618662] start to dump uninit
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:51.662.907 [adx_dump_record.cpp:239][tid:618662] dump uninit success
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:51.662.925 [adx_dump_record.cpp:674][tid:618860] exit record file thread
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:51.692.605 [api_impl.cc:7151] 618666 UnmapMem: device free mem=0x12c2c0000000
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:51.692.834 [api_impl.cc:7135] 618666 FreePhysical: Start to FreePhysical
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:51.694.624 [api_impl.cc:7151] 618666 UnmapMem: device free mem=0x12d100000000
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:51.694.777 [api_impl.cc:7135] 618666 FreePhysical: Start to FreePhysical
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:51.696.901 [api_impl.cc:7121] 618666 ReleaseMemAddress: device free mem=0x12c2c0000000
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.699.789 [heartbeat.cc:145] [618650][DeInit]heartbeat deinit begin
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.700.287 [heartbeat.cc:183] [618650][DeInit]heartbeat deinit end
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.700.325 [heartbeat.cc:145] [618650][DeInit]heartbeat deinit begin
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:51.700.532 [api_impl.cc:7121] 618666 ReleaseMemAddress: device free mem=0x12d100000000
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.700.751 [heartbeat.cc:183] [618650][DeInit]heartbeat deinit end
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.700.772 [heartbeat.cc:145] [618650][DeInit]heartbeat deinit begin
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.700.864 [heartbeat.cc:183] [618650][DeInit]heartbeat deinit end
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.700.878 [heartbeat.cc:145] [618650][DeInit]heartbeat deinit begin
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.700.889 [heartbeat.cc:183] [618650][DeInit]heartbeat deinit end
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.700.901 [heartbeat.cc:145] [618650][DeInit]heartbeat deinit begin
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.700.922 [heartbeat.cc:183] [618650][DeInit]heartbeat deinit end
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.700.933 [heartbeat.cc:145] [618650][DeInit]heartbeat deinit begin
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.701.224 [heartbeat.cc:183] [618650][DeInit]heartbeat deinit end
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.701.240 [heartbeat.cc:145] [618650][DeInit]heartbeat deinit begin
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.701.283 [heartbeat.cc:183] [618650][DeInit]heartbeat deinit end
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.701.296 [heartbeat.cc:145] [618650][DeInit]heartbeat deinit begin
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.701.540 [heartbeat.cc:183] [618650][DeInit]heartbeat deinit end
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.701.555 [heartbeat.cc:145] [618650][DeInit]heartbeat deinit begin
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.701.764 [heartbeat.cc:183] [618650][DeInit]heartbeat deinit end
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.701.779 [heartbeat.cc:145] [618650][DeInit]heartbeat deinit begin
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.701.951 [heartbeat.cc:183] [618650][DeInit]heartbeat deinit end
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.701.968 [heartbeat.cc:145] [618650][DeInit]heartbeat deinit begin
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.702.061 [heartbeat.cc:183] [618650][DeInit]heartbeat deinit end
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.702.075 [heartbeat.cc:145] [618650][DeInit]heartbeat deinit begin
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.702.167 [heartbeat.cc:183] [618650][DeInit]heartbeat deinit end
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.702.180 [heartbeat.cc:145] [618650][DeInit]heartbeat deinit begin
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.702.209 [heartbeat.cc:183] [618650][DeInit]heartbeat deinit end
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.702.221 [heartbeat.cc:145] [618650][DeInit]heartbeat deinit begin
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.702.371 [heartbeat.cc:183] [618650][DeInit]heartbeat deinit end
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.702.385 [heartbeat.cc:145] [618650][DeInit]heartbeat deinit begin
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.702.396 [heartbeat.cc:183] [618650][DeInit]heartbeat deinit end
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.702.408 [heartbeat.cc:145] [618650][DeInit]heartbeat deinit begin
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:51.702.418 [heartbeat.cc:183] [618650][DeInit]heartbeat deinit end
[INFO] DEVICE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:51.702.757 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:67] ~HcclWatchDogHandler] HcclWatchDogHandler thread exit, rank id: 1, group name: hccl_world_group
[INFO] PROFILING(618650,python3.9):2025-04-03-09:27:51.702.906 [hash_data.cpp:63] >>> (tid:618650) HashData uninitialize success
[INFO] PROFILING(618650,python3.9):2025-04-03-09:27:51.702.932 [msprof_reporter_mgr.cpp:270] >>> (tid:618650) The reporter isn't started, don't need to be stopped.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:51.705.314 [api_impl.cc:2003] 618650 DevFree: device free mem=0x12c041200000
[INFO] CORE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:51.706.656 [mindspore/core/utils/temp_file_manager.cc:59] CleanTempFiles] Start delete temp files.
[INFO] CORE(618650,ffffbf562de0,python3.9):2025-04-03-09:27:51.706.689 [mindspore/core/utils/temp_file_manager.cc:63] CleanTempFiles] End delete temp files.
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:51.706.838 [adx_dump_record.cpp:229][tid:618650] start to dump uninit
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:51.706.866 [adx_dump_record.cpp:239][tid:618650] dump uninit success
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:51.706.884 [adx_dump_record.cpp:674][tid:618919] exit record file thread
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:51.708.665 [osal.cc:321] 618666 ThreadExit: ThreadExit start.
[INFO] GE(618674,python3.9):2025-04-03-09:27:51.731.564 [operator_factory_impl.cc:392]618674 ReleaseRegInfo:Release ops proto reg info success.
[INFO] GE(618662,python3.9):2025-04-03-09:27:51.734.007 [operator_factory_impl.cc:392]618662 ReleaseRegInfo:Release ops proto reg info success.
[INFO] GE(618670,python3.9):2025-04-03-09:27:51.747.454 [opsproto_manager.cc:66]618670 Finalize:close opsprotomanager handler success
[INFO] GE(618674,python3.9):2025-04-03-09:27:51.747.486 [operator_factory_impl.cc:392]618674 ReleaseRegInfo:Release ops proto reg info success.
[INFO] GE(618674,python3.9):2025-04-03-09:27:51.747.561 [opsproto_manager.cc:66]618674 Finalize:close opsprotomanager handler success
[INFO] GE(618674,python3.9):2025-04-03-09:27:51.747.579 [opsproto_manager.cc:66]618674 Finalize:close opsprotomanager handler success
[INFO] GE(618674,python3.9):2025-04-03-09:27:51.747.595 [opsproto_manager.cc:66]618674 Finalize:close opsprotomanager handler success
[INFO] GE(618674,python3.9):2025-04-03-09:27:51.747.607 [opsproto_manager.cc:66]618674 Finalize:close opsprotomanager handler success
[INFO] GE(618674,python3.9):2025-04-03-09:27:51.747.619 [opsproto_manager.cc:66]618674 Finalize:close opsprotomanager handler success
[INFO] GE(618674,python3.9):2025-04-03-09:27:51.747.634 [opsproto_manager.cc:66]618674 Finalize:close opsprotomanager handler success
[INFO] GE(618674,python3.9):2025-04-03-09:27:51.747.645 [opsproto_manager.cc:66]618674 Finalize:close opsprotomanager handler success
[INFO] GE(618674,python3.9):2025-04-03-09:27:51.747.657 [opsproto_manager.cc:66]618674 Finalize:close opsprotomanager handler success
[INFO] GE(618670,python3.9):2025-04-03-09:27:51.747.658 [opsproto_manager.cc:66]618670 Finalize:close opsprotomanager handler success
[INFO] GE(618670,python3.9):2025-04-03-09:27:51.747.710 [opsproto_manager.cc:66]618670 Finalize:close opsprotomanager handler success
[INFO] GE(618662,python3.9):2025-04-03-09:27:51.749.677 [operator_factory_impl.cc:392]618662 ReleaseRegInfo:Release ops proto reg info success.
[INFO] GE(618662,python3.9):2025-04-03-09:27:51.749.734 [opsproto_manager.cc:66]618662 Finalize:close opsprotomanager handler success
[INFO] GE(618662,python3.9):2025-04-03-09:27:51.749.745 [opsproto_manager.cc:66]618662 Finalize:close opsprotomanager handler success
[INFO] GE(618662,python3.9):2025-04-03-09:27:51.749.756 [opsproto_manager.cc:66]618662 Finalize:close opsprotomanager handler success
[INFO] GE(618662,python3.9):2025-04-03-09:27:51.749.766 [opsproto_manager.cc:66]618662 Finalize:close opsprotomanager handler success
[INFO] GE(618662,python3.9):2025-04-03-09:27:51.749.775 [opsproto_manager.cc:66]618662 Finalize:close opsprotomanager handler success
[INFO] GE(618662,python3.9):2025-04-03-09:27:51.749.783 [opsproto_manager.cc:66]618662 Finalize:close opsprotomanager handler success
[INFO] GE(618662,python3.9):2025-04-03-09:27:51.749.794 [opsproto_manager.cc:66]618662 Finalize:close opsprotomanager handler success
[INFO] GE(618662,python3.9):2025-04-03-09:27:51.749.803 [opsproto_manager.cc:66]618662 Finalize:close opsprotomanager handler success
[INFO] GE(618650,python3.9):2025-04-03-09:27:51.772.784 [operator_factory_impl.cc:392]618650 ReleaseRegInfo:Release ops proto reg info success.
[INFO] GE(618650,python3.9):2025-04-03-09:27:51.788.373 [operator_factory_impl.cc:392]618650 ReleaseRegInfo:Release ops proto reg info success.
[INFO] GE(618650,python3.9):2025-04-03-09:27:51.788.431 [opsproto_manager.cc:66]618650 Finalize:close opsprotomanager handler success
[INFO] GE(618650,python3.9):2025-04-03-09:27:51.788.444 [opsproto_manager.cc:66]618650 Finalize:close opsprotomanager handler success
[INFO] GE(618650,python3.9):2025-04-03-09:27:51.788.455 [opsproto_manager.cc:66]618650 Finalize:close opsprotomanager handler success
[INFO] GE(618650,python3.9):2025-04-03-09:27:51.788.465 [opsproto_manager.cc:66]618650 Finalize:close opsprotomanager handler success
[INFO] GE(618650,python3.9):2025-04-03-09:27:51.788.475 [opsproto_manager.cc:66]618650 Finalize:close opsprotomanager handler success
[INFO] GE(618650,python3.9):2025-04-03-09:27:51.788.487 [opsproto_manager.cc:66]618650 Finalize:close opsprotomanager handler success
[INFO] GE(618650,python3.9):2025-04-03-09:27:51.788.498 [opsproto_manager.cc:66]618650 Finalize:close opsprotomanager handler success
[INFO] GE(618650,python3.9):2025-04-03-09:27:51.788.507 [opsproto_manager.cc:66]618650 Finalize:close opsprotomanager handler success
[INFO] GE(618674,python3.9):2025-04-03-09:27:51.801.440 [opsproto_manager.cc:66]618674 Finalize:close opsprotomanager handler success
[INFO] GE(618674,python3.9):2025-04-03-09:27:51.801.661 [opsproto_manager.cc:66]618674 Finalize:close opsprotomanager handler success
[INFO] GE(618674,python3.9):2025-04-03-09:27:51.801.715 [opsproto_manager.cc:66]618674 Finalize:close opsprotomanager handler success
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:51.804.942 [api_impl.cc:7151] 618670 UnmapMem: device free mem=0x12c2c0000000
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:51.805.153 [api_impl.cc:7135] 618670 FreePhysical: Start to FreePhysical
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:51.807.128 [api_impl.cc:7151] 618670 UnmapMem: device free mem=0x12d100000000
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:51.807.294 [api_impl.cc:7135] 618670 FreePhysical: Start to FreePhysical
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:51.809.310 [api_impl.cc:7121] 618670 ReleaseMemAddress: device free mem=0x12c2c0000000
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:51.813.002 [api_impl.cc:7121] 618670 ReleaseMemAddress: device free mem=0x12d100000000
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:51.819.744 [osal.cc:321] 618670 ThreadExit: ThreadExit start.
[INFO] GE(618662,python3.9):2025-04-03-09:27:51.859.021 [opsproto_manager.cc:66]618662 Finalize:close opsprotomanager handler success
[INFO] GE(618662,python3.9):2025-04-03-09:27:51.859.243 [opsproto_manager.cc:66]618662 Finalize:close opsprotomanager handler success
[INFO] GE(618662,python3.9):2025-04-03-09:27:51.859.293 [opsproto_manager.cc:66]618662 Finalize:close opsprotomanager handler success
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:51.865.218 [api_impl.cc:7151] 618674 UnmapMem: device free mem=0x12c2c0000000
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:51.865.454 [api_impl.cc:7135] 618674 FreePhysical: Start to FreePhysical
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:51.867.598 [api_impl.cc:7151] 618674 UnmapMem: device free mem=0x12d100000000
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:51.867.775 [api_impl.cc:7135] 618674 FreePhysical: Start to FreePhysical
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:51.869.966 [api_impl.cc:7121] 618674 ReleaseMemAddress: device free mem=0x12c2c0000000
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:51.873.647 [api_impl.cc:7121] 618674 ReleaseMemAddress: device free mem=0x12d100000000
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.879.107 [heartbeat.cc:145] [618646][DeInit]heartbeat deinit begin
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.879.488 [heartbeat.cc:183] [618646][DeInit]heartbeat deinit end
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.879.521 [heartbeat.cc:145] [618646][DeInit]heartbeat deinit begin
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.879.592 [heartbeat.cc:183] [618646][DeInit]heartbeat deinit end
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.879.606 [heartbeat.cc:145] [618646][DeInit]heartbeat deinit begin
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.879.878 [heartbeat.cc:183] [618646][DeInit]heartbeat deinit end
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.879.892 [heartbeat.cc:145] [618646][DeInit]heartbeat deinit begin
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.879.974 [heartbeat.cc:183] [618646][DeInit]heartbeat deinit end
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.879.988 [heartbeat.cc:145] [618646][DeInit]heartbeat deinit begin
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.879.999 [heartbeat.cc:183] [618646][DeInit]heartbeat deinit end
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.880.011 [heartbeat.cc:145] [618646][DeInit]heartbeat deinit begin
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.880.031 [heartbeat.cc:183] [618646][DeInit]heartbeat deinit end
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.880.042 [heartbeat.cc:145] [618646][DeInit]heartbeat deinit begin
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.880.479 [heartbeat.cc:183] [618646][DeInit]heartbeat deinit end
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.880.500 [heartbeat.cc:145] [618646][DeInit]heartbeat deinit begin
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.880.567 [heartbeat.cc:183] [618646][DeInit]heartbeat deinit end
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.880.579 [heartbeat.cc:145] [618646][DeInit]heartbeat deinit begin
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.880.642 [heartbeat.cc:183] [618646][DeInit]heartbeat deinit end
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.880.654 [heartbeat.cc:145] [618646][DeInit]heartbeat deinit begin
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.880.865 [heartbeat.cc:183] [618646][DeInit]heartbeat deinit end
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.880.879 [heartbeat.cc:145] [618646][DeInit]heartbeat deinit begin
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.881.060 [heartbeat.cc:183] [618646][DeInit]heartbeat deinit end
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.881.076 [heartbeat.cc:145] [618646][DeInit]heartbeat deinit begin
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.881.198 [heartbeat.cc:183] [618646][DeInit]heartbeat deinit end
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.881.212 [heartbeat.cc:145] [618646][DeInit]heartbeat deinit begin
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.881.532 [heartbeat.cc:183] [618646][DeInit]heartbeat deinit end
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.881.548 [heartbeat.cc:145] [618646][DeInit]heartbeat deinit begin
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.881.565 [heartbeat.cc:183] [618646][DeInit]heartbeat deinit end
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.881.576 [heartbeat.cc:145] [618646][DeInit]heartbeat deinit begin
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.881.586 [heartbeat.cc:183] [618646][DeInit]heartbeat deinit end
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.881.597 [heartbeat.cc:145] [618646][DeInit]heartbeat deinit begin
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:51.881.608 [heartbeat.cc:183] [618646][DeInit]heartbeat deinit end
[INFO] DEVICE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.881.874 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:67] ~HcclWatchDogHandler] HcclWatchDogHandler thread exit, rank id: 0, group name: hccl_world_group
[INFO] PROFILING(618646,python3.9):2025-04-03-09:27:51.881.939 [hash_data.cpp:63] >>> (tid:618646) HashData uninitialize success
[INFO] PROFILING(618646,python3.9):2025-04-03-09:27:51.881.959 [msprof_reporter_mgr.cpp:270] >>> (tid:618646) The reporter isn't started, don't need to be stopped.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:51.882.468 [osal.cc:321] 618674 ThreadExit: ThreadExit start.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:51.884.152 [api_impl.cc:2003] 618646 DevFree: device free mem=0x12c041200000
[INFO] CORE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.885.302 [mindspore/core/utils/temp_file_manager.cc:59] CleanTempFiles] Start delete temp files.
[INFO] CORE(618646,ffff85d12de0,python3.9):2025-04-03-09:27:51.885.329 [mindspore/core/utils/temp_file_manager.cc:63] CleanTempFiles] End delete temp files.
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:51.885.462 [adx_dump_record.cpp:229][tid:618646] start to dump uninit
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:51.885.489 [adx_dump_record.cpp:239][tid:618646] dump uninit success
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:51.885.502 [adx_dump_record.cpp:674][tid:618959] exit record file thread
[INFO] GE(618650,python3.9):2025-04-03-09:27:51.894.153 [opsproto_manager.cc:66]618650 Finalize:close opsprotomanager handler success
[INFO] GE(618650,python3.9):2025-04-03-09:27:51.894.342 [opsproto_manager.cc:66]618650 Finalize:close opsprotomanager handler success
[INFO] GE(618650,python3.9):2025-04-03-09:27:51.894.393 [opsproto_manager.cc:66]618650 Finalize:close opsprotomanager handler success
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:51.919.855 [api_impl.cc:7151] 618662 UnmapMem: device free mem=0x12c2c0000000
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:51.920.141 [api_impl.cc:7135] 618662 FreePhysical: Start to FreePhysical
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:51.922.345 [api_impl.cc:7151] 618662 UnmapMem: device free mem=0x12d100000000
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:51.922.518 [api_impl.cc:7135] 618662 FreePhysical: Start to FreePhysical
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:51.924.507 [api_impl.cc:7121] 618662 ReleaseMemAddress: device free mem=0x12c2c0000000
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:51.928.190 [api_impl.cc:7121] 618662 ReleaseMemAddress: device free mem=0x12d100000000
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:51.936.744 [osal.cc:321] 618662 ThreadExit: ThreadExit start.
[INFO] GE(618646,python3.9):2025-04-03-09:27:51.947.539 [operator_factory_impl.cc:392]618646 ReleaseRegInfo:Release ops proto reg info success.
[INFO] GE(618646,python3.9):2025-04-03-09:27:51.962.304 [operator_factory_impl.cc:392]618646 ReleaseRegInfo:Release ops proto reg info success.
[INFO] GE(618646,python3.9):2025-04-03-09:27:51.962.351 [opsproto_manager.cc:66]618646 Finalize:close opsprotomanager handler success
[INFO] GE(618646,python3.9):2025-04-03-09:27:51.962.363 [opsproto_manager.cc:66]618646 Finalize:close opsprotomanager handler success
[INFO] GE(618646,python3.9):2025-04-03-09:27:51.962.374 [opsproto_manager.cc:66]618646 Finalize:close opsprotomanager handler success
[INFO] GE(618646,python3.9):2025-04-03-09:27:51.962.383 [opsproto_manager.cc:66]618646 Finalize:close opsprotomanager handler success
[INFO] GE(618646,python3.9):2025-04-03-09:27:51.962.392 [opsproto_manager.cc:66]618646 Finalize:close opsprotomanager handler success
[INFO] GE(618646,python3.9):2025-04-03-09:27:51.962.401 [opsproto_manager.cc:66]618646 Finalize:close opsprotomanager handler success
[INFO] GE(618646,python3.9):2025-04-03-09:27:51.962.412 [opsproto_manager.cc:66]618646 Finalize:close opsprotomanager handler success
[INFO] GE(618646,python3.9):2025-04-03-09:27:51.962.421 [opsproto_manager.cc:66]618646 Finalize:close opsprotomanager handler success
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.977.834 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:591] DoFreeTensorMem] Free tensor mem failed, can not find address : 0x12d100000000.
[INFO] PRE_ACT(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:51.977.977 [mindspore/ccsrc/memory/mem_pool/abstract_dynamic_mem_pool.cc:591] DoFreeTensorMem] Free tensor mem failed, can not find address : 0x12c2c0000000.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.987.932 [heartbeat.cc:145] [618654][DeInit]heartbeat deinit begin
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.988.450 [heartbeat.cc:183] [618654][DeInit]heartbeat deinit end
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.988.490 [heartbeat.cc:145] [618654][DeInit]heartbeat deinit begin
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.988.980 [heartbeat.cc:183] [618654][DeInit]heartbeat deinit end
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.989.002 [heartbeat.cc:145] [618654][DeInit]heartbeat deinit begin
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.989.115 [heartbeat.cc:183] [618654][DeInit]heartbeat deinit end
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.989.133 [heartbeat.cc:145] [618654][DeInit]heartbeat deinit begin
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.989.148 [heartbeat.cc:183] [618654][DeInit]heartbeat deinit end
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.989.161 [heartbeat.cc:145] [618654][DeInit]heartbeat deinit begin
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.989.186 [heartbeat.cc:183] [618654][DeInit]heartbeat deinit end
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.989.203 [heartbeat.cc:145] [618654][DeInit]heartbeat deinit begin
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.989.503 [heartbeat.cc:183] [618654][DeInit]heartbeat deinit end
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.989.525 [heartbeat.cc:145] [618654][DeInit]heartbeat deinit begin
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.989.571 [heartbeat.cc:183] [618654][DeInit]heartbeat deinit end
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.989.589 [heartbeat.cc:145] [618654][DeInit]heartbeat deinit begin
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.989.608 [heartbeat.cc:183] [618654][DeInit]heartbeat deinit end
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.989.625 [heartbeat.cc:145] [618654][DeInit]heartbeat deinit begin
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.989.748 [heartbeat.cc:183] [618654][DeInit]heartbeat deinit end
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.989.765 [heartbeat.cc:145] [618654][DeInit]heartbeat deinit begin
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.989.931 [heartbeat.cc:183] [618654][DeInit]heartbeat deinit end
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.989.951 [heartbeat.cc:145] [618654][DeInit]heartbeat deinit begin
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.990.183 [heartbeat.cc:183] [618654][DeInit]heartbeat deinit end
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.990.202 [heartbeat.cc:145] [618654][DeInit]heartbeat deinit begin
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.990.269 [heartbeat.cc:183] [618654][DeInit]heartbeat deinit end
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.990.287 [heartbeat.cc:145] [618654][DeInit]heartbeat deinit begin
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.990.400 [heartbeat.cc:183] [618654][DeInit]heartbeat deinit end
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.990.418 [heartbeat.cc:145] [618654][DeInit]heartbeat deinit begin
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.990.522 [heartbeat.cc:183] [618654][DeInit]heartbeat deinit end
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.990.540 [heartbeat.cc:145] [618654][DeInit]heartbeat deinit begin
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.990.804 [heartbeat.cc:183] [618654][DeInit]heartbeat deinit end
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.990.823 [heartbeat.cc:145] [618654][DeInit]heartbeat deinit begin
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:51.990.836 [heartbeat.cc:183] [618654][DeInit]heartbeat deinit end
[INFO] DEVICE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.991.138 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:67] ~HcclWatchDogHandler] HcclWatchDogHandler thread exit, rank id: 2, group name: hccl_world_group
[INFO] PROFILING(618654,python3.9):2025-04-03-09:27:51.991.203 [hash_data.cpp:63] >>> (tid:618654) HashData uninitialize success
[INFO] PROFILING(618654,python3.9):2025-04-03-09:27:51.991.227 [msprof_reporter_mgr.cpp:270] >>> (tid:618654) The reporter isn't started, don't need to be stopped.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:51.993.058 [api_impl.cc:2003] 618654 DevFree: device free mem=0x12c041200000
[INFO] CORE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.994.076 [mindspore/core/utils/temp_file_manager.cc:59] CleanTempFiles] Start delete temp files.
[INFO] CORE(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:51.994.110 [mindspore/core/utils/temp_file_manager.cc:63] CleanTempFiles] End delete temp files.
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:51.994.246 [adx_dump_record.cpp:229][tid:618654] start to dump uninit
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:51.994.276 [adx_dump_record.cpp:239][tid:618654] dump uninit success
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:51.994.299 [adx_dump_record.cpp:674][tid:618939] exit record file thread
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:52.000.187 [api_impl.cc:7151] 618650 UnmapMem: device free mem=0x12c2c0000000
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:52.000.420 [api_impl.cc:7135] 618650 FreePhysical: Start to FreePhysical
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:52.005.142 [api_impl.cc:7151] 618650 UnmapMem: device free mem=0x12d100000000
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:52.005.303 [api_impl.cc:7135] 618650 FreePhysical: Start to FreePhysical
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:52.009.735 [api_impl.cc:7121] 618650 ReleaseMemAddress: device free mem=0x12c2c0000000
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:52.013.975 [api_impl.cc:7121] 618650 ReleaseMemAddress: device free mem=0x12d100000000
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:52.022.134 [osal.cc:321] 618650 ThreadExit: ThreadExit start.
[INFO] GE(618646,python3.9):2025-04-03-09:27:52.047.552 [opsproto_manager.cc:66]618646 Finalize:close opsprotomanager handler success
[INFO] GE(618646,python3.9):2025-04-03-09:27:52.047.768 [opsproto_manager.cc:66]618646 Finalize:close opsprotomanager handler success
[INFO] GE(618646,python3.9):2025-04-03-09:27:52.047.818 [opsproto_manager.cc:66]618646 Finalize:close opsprotomanager handler success
[INFO] GE(618654,python3.9):2025-04-03-09:27:52.053.595 [operator_factory_impl.cc:392]618654 ReleaseRegInfo:Release ops proto reg info success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:52.068.453 [operator_factory_impl.cc:392]618654 ReleaseRegInfo:Release ops proto reg info success.
[INFO] GE(618654,python3.9):2025-04-03-09:27:52.068.496 [opsproto_manager.cc:66]618654 Finalize:close opsprotomanager handler success
[INFO] GE(618654,python3.9):2025-04-03-09:27:52.068.529 [opsproto_manager.cc:66]618654 Finalize:close opsprotomanager handler success
[INFO] GE(618654,python3.9):2025-04-03-09:27:52.068.547 [opsproto_manager.cc:66]618654 Finalize:close opsprotomanager handler success
[INFO] GE(618654,python3.9):2025-04-03-09:27:52.068.559 [opsproto_manager.cc:66]618654 Finalize:close opsprotomanager handler success
[INFO] GE(618654,python3.9):2025-04-03-09:27:52.068.570 [opsproto_manager.cc:66]618654 Finalize:close opsprotomanager handler success
[INFO] GE(618654,python3.9):2025-04-03-09:27:52.068.582 [opsproto_manager.cc:66]618654 Finalize:close opsprotomanager handler success
[INFO] GE(618654,python3.9):2025-04-03-09:27:52.068.594 [opsproto_manager.cc:66]618654 Finalize:close opsprotomanager handler success
[INFO] GE(618654,python3.9):2025-04-03-09:27:52.068.605 [opsproto_manager.cc:66]618654 Finalize:close opsprotomanager handler success
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:52.102.901 [api_impl.cc:7151] 618646 UnmapMem: device free mem=0x12c2c0000000
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:52.103.104 [api_impl.cc:7135] 618646 FreePhysical: Start to FreePhysical
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:52.105.139 [api_impl.cc:7151] 618646 UnmapMem: device free mem=0x12d100000000
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:52.105.284 [api_impl.cc:7135] 618646 FreePhysical: Start to FreePhysical
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:52.107.382 [api_impl.cc:7121] 618646 ReleaseMemAddress: device free mem=0x12c2c0000000
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:52.110.987 [api_impl.cc:7121] 618646 ReleaseMemAddress: device free mem=0x12d100000000
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:52.117.917 [osal.cc:321] 618646 ThreadExit: ThreadExit start.
[INFO] GE(618654,python3.9):2025-04-03-09:27:52.140.356 [opsproto_manager.cc:66]618654 Finalize:close opsprotomanager handler success
[INFO] GE(618654,python3.9):2025-04-03-09:27:52.140.571 [opsproto_manager.cc:66]618654 Finalize:close opsprotomanager handler success
[INFO] GE(618654,python3.9):2025-04-03-09:27:52.140.625 [opsproto_manager.cc:66]618654 Finalize:close opsprotomanager handler success
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:52.194.744 [api_impl.cc:7151] 618654 UnmapMem: device free mem=0x12c2c0000000
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:52.194.955 [api_impl.cc:7135] 618654 FreePhysical: Start to FreePhysical
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:52.196.973 [api_impl.cc:7151] 618654 UnmapMem: device free mem=0x12d100000000
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:52.197.140 [api_impl.cc:7135] 618654 FreePhysical: Start to FreePhysical
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:52.200.151 [api_impl.cc:7121] 618654 ReleaseMemAddress: device free mem=0x12c2c0000000
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:52.203.832 [api_impl.cc:7121] 618654 ReleaseMemAddress: device free mem=0x12d100000000
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:52.211.089 [osal.cc:321] 618654 ThreadExit: ThreadExit start.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.302.528 [heartbeat.cc:145] [618658][DeInit]heartbeat deinit begin
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.302.688 [heartbeat.cc:183] [618658][DeInit]heartbeat deinit end
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.302.720 [heartbeat.cc:145] [618658][DeInit]heartbeat deinit begin
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.303.032 [heartbeat.cc:183] [618658][DeInit]heartbeat deinit end
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.303.054 [heartbeat.cc:145] [618658][DeInit]heartbeat deinit begin
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.303.327 [heartbeat.cc:183] [618658][DeInit]heartbeat deinit end
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.303.346 [heartbeat.cc:145] [618658][DeInit]heartbeat deinit begin
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.303.434 [heartbeat.cc:183] [618658][DeInit]heartbeat deinit end
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.303.451 [heartbeat.cc:145] [618658][DeInit]heartbeat deinit begin
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.303.465 [heartbeat.cc:183] [618658][DeInit]heartbeat deinit end
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.303.479 [heartbeat.cc:145] [618658][DeInit]heartbeat deinit begin
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.303.507 [heartbeat.cc:183] [618658][DeInit]heartbeat deinit end
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.303.554 [heartbeat.cc:145] [618658][DeInit]heartbeat deinit begin
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.303.931 [heartbeat.cc:183] [618658][DeInit]heartbeat deinit end
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.303.951 [heartbeat.cc:145] [618658][DeInit]heartbeat deinit begin
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.304.039 [heartbeat.cc:183] [618658][DeInit]heartbeat deinit end
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.304.056 [heartbeat.cc:145] [618658][DeInit]heartbeat deinit begin
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.304.180 [heartbeat.cc:183] [618658][DeInit]heartbeat deinit end
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.304.201 [heartbeat.cc:145] [618658][DeInit]heartbeat deinit begin
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.304.414 [heartbeat.cc:183] [618658][DeInit]heartbeat deinit end
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.304.433 [heartbeat.cc:145] [618658][DeInit]heartbeat deinit begin
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.304.560 [heartbeat.cc:183] [618658][DeInit]heartbeat deinit end
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.304.578 [heartbeat.cc:145] [618658][DeInit]heartbeat deinit begin
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.304.805 [heartbeat.cc:183] [618658][DeInit]heartbeat deinit end
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.304.824 [heartbeat.cc:145] [618658][DeInit]heartbeat deinit begin
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.305.092 [heartbeat.cc:183] [618658][DeInit]heartbeat deinit end
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.305.111 [heartbeat.cc:145] [618658][DeInit]heartbeat deinit begin
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.305.127 [heartbeat.cc:183] [618658][DeInit]heartbeat deinit end
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.305.143 [heartbeat.cc:145] [618658][DeInit]heartbeat deinit begin
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.305.155 [heartbeat.cc:183] [618658][DeInit]heartbeat deinit end
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.305.168 [heartbeat.cc:145] [618658][DeInit]heartbeat deinit begin
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:52.305.185 [heartbeat.cc:183] [618658][DeInit]heartbeat deinit end
[INFO] DEVICE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:52.305.517 [mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.cc:67] ~HcclWatchDogHandler] HcclWatchDogHandler thread exit, rank id: 3, group name: hccl_world_group
[INFO] PROFILING(618658,python3.9):2025-04-03-09:27:52.305.624 [hash_data.cpp:63] >>> (tid:618658) HashData uninitialize success
[INFO] PROFILING(618658,python3.9):2025-04-03-09:27:52.305.652 [msprof_reporter_mgr.cpp:270] >>> (tid:618658) The reporter isn't started, don't need to be stopped.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:52.307.343 [api_impl.cc:2003] 618658 DevFree: device free mem=0x12c041200000
[INFO] CORE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:52.308.272 [mindspore/core/utils/temp_file_manager.cc:59] CleanTempFiles] Start delete temp files.
[INFO] CORE(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:52.308.304 [mindspore/core/utils/temp_file_manager.cc:63] CleanTempFiles] End delete temp files.
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:52.308.471 [adx_dump_record.cpp:229][tid:618658] start to dump uninit
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:52.308.508 [adx_dump_record.cpp:239][tid:618658] dump uninit success
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:52.308.524 [adx_dump_record.cpp:674][tid:618777] exit record file thread
[INFO] GE(618658,python3.9):2025-04-03-09:27:52.373.137 [operator_factory_impl.cc:392]618658 ReleaseRegInfo:Release ops proto reg info success.
[INFO] GE(618658,python3.9):2025-04-03-09:27:52.388.468 [operator_factory_impl.cc:392]618658 ReleaseRegInfo:Release ops proto reg info success.
[INFO] GE(618658,python3.9):2025-04-03-09:27:52.388.515 [opsproto_manager.cc:66]618658 Finalize:close opsprotomanager handler success
[INFO] GE(618658,python3.9):2025-04-03-09:27:52.388.535 [opsproto_manager.cc:66]618658 Finalize:close opsprotomanager handler success
[INFO] GE(618658,python3.9):2025-04-03-09:27:52.388.579 [opsproto_manager.cc:66]618658 Finalize:close opsprotomanager handler success
[INFO] GE(618658,python3.9):2025-04-03-09:27:52.388.591 [opsproto_manager.cc:66]618658 Finalize:close opsprotomanager handler success
[INFO] GE(618658,python3.9):2025-04-03-09:27:52.388.604 [opsproto_manager.cc:66]618658 Finalize:close opsprotomanager handler success
[INFO] GE(618658,python3.9):2025-04-03-09:27:52.388.616 [opsproto_manager.cc:66]618658 Finalize:close opsprotomanager handler success
[INFO] GE(618658,python3.9):2025-04-03-09:27:52.388.632 [opsproto_manager.cc:66]618658 Finalize:close opsprotomanager handler success
[INFO] GE(618658,python3.9):2025-04-03-09:27:52.388.644 [opsproto_manager.cc:66]618658 Finalize:close opsprotomanager handler success
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:52.428.743 [stars_engine.cc:1833] 618834 MonitoringRun: g_hbmRasCheckDeviceId has change to -1, dev_id=-1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:52.428.783 [stars_engine.cc:1836] 618834 MonitoringRun: Starts Monitor thread has finished, ts_id=0.
[INFO] PS(618646,ffff85d12de0,python3.9):2025-04-03-09:27:52.428.999 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:232] Stop] Stop tcp server!
[INFO] GE(618646,python3.9):2025-04-03-09:27:52.463.173 [ops_kernel_builder_registry.cc:71]618646 ~OpsKernelBuilderRegistrar:Unregister kernel lib name = ops_kernel_info_hccl
[INFO] GE(618646,python3.9):2025-04-03-09:27:52.463.239 [ops_kernel_builder_registry.cc:41]618646 Unregister:OpsKernelBuilder of ops_kernel_info_hccl is unregistered
[INFO] GE(618658,python3.9):2025-04-03-09:27:52.468.313 [opsproto_manager.cc:66]618658 Finalize:close opsprotomanager handler success
[INFO] GE(618658,python3.9):2025-04-03-09:27:52.468.519 [opsproto_manager.cc:66]618658 Finalize:close opsprotomanager handler success
[INFO] GE(618658,python3.9):2025-04-03-09:27:52.468.573 [opsproto_manager.cc:66]618658 Finalize:close opsprotomanager handler success
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:52.525.924 [api_impl.cc:7151] 618658 UnmapMem: device free mem=0x12c2c0000000
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:52.526.166 [api_impl.cc:7135] 618658 FreePhysical: Start to FreePhysical
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:52.528.589 [api_impl.cc:7151] 618658 UnmapMem: device free mem=0x12d100000000
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:52.528.759 [api_impl.cc:7135] 618658 FreePhysical: Start to FreePhysical
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:52.536.201 [api_impl.cc:7121] 618658 ReleaseMemAddress: device free mem=0x12c2c0000000
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:52.539.809 [api_impl.cc:7121] 618658 ReleaseMemAddress: device free mem=0x12d100000000
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:52.547.747 [osal.cc:321] 618658 ThreadExit: ThreadExit start.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:52.620.729 [stars_engine.cc:1833] 618826 MonitoringRun: g_hbmRasCheckDeviceId has change to -1, dev_id=-1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:52.620.767 [stars_engine.cc:1836] 618826 MonitoringRun: Starts Monitor thread has finished, ts_id=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:52.620.760 [stars_engine.cc:1833] 618820 MonitoringRun: g_hbmRasCheckDeviceId has change to -1, dev_id=-1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:52.620.799 [stars_engine.cc:1836] 618820 MonitoringRun: Starts Monitor thread has finished, ts_id=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:52.620.785 [stars_engine.cc:1833] 618772 MonitoringRun: g_hbmRasCheckDeviceId has change to -1, dev_id=-1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:52.620.828 [stars_engine.cc:1836] 618772 MonitoringRun: Starts Monitor thread has finished, ts_id=0.
[INFO] PS(618650,ffffbf562de0,python3.9):2025-04-03-09:27:52.620.977 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:232] Stop] Stop tcp server!
[INFO] PS(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:52.621.001 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:232] Stop] Stop tcp server!
[INFO] PS(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:52.621.061 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:232] Stop] Stop tcp server!
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:52.648.712 [stars_engine.cc:1833] 618812 MonitoringRun: g_hbmRasCheckDeviceId has change to -1, dev_id=-1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:52.648.734 [stars_engine.cc:1836] 618812 MonitoringRun: Starts Monitor thread has finished, ts_id=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:52.648.746 [stars_engine.cc:1833] 618806 MonitoringRun: g_hbmRasCheckDeviceId has change to -1, dev_id=-1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:52.648.786 [stars_engine.cc:1836] 618806 MonitoringRun: Starts Monitor thread has finished, ts_id=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:52.648.762 [stars_engine.cc:1833] 618830 MonitoringRun: g_hbmRasCheckDeviceId has change to -1, dev_id=-1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:52.648.821 [stars_engine.cc:1836] 618830 MonitoringRun: Starts Monitor thread has finished, ts_id=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:52.648.763 [stars_engine.cc:1833] 618814 MonitoringRun: g_hbmRasCheckDeviceId has change to -1, dev_id=-1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:52.648.821 [stars_engine.cc:1836] 618814 MonitoringRun: Starts Monitor thread has finished, ts_id=0.
[INFO] PS(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:52.648.984 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:232] Stop] Stop tcp server!
[INFO] PS(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:52.649.039 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:232] Stop] Stop tcp server!
[INFO] PS(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:52.649.039 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:232] Stop] Stop tcp server!
[INFO] PS(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:52.649.065 [mindspore/ccsrc/ps/core/communicator/tcp_server.cc:232] Stop] Stop tcp server!
[INFO] GE(618670,python3.9):2025-04-03-09:27:52.660.050 [ops_kernel_builder_registry.cc:71]618670 ~OpsKernelBuilderRegistrar:Unregister kernel lib name = ops_kernel_info_hccl
[INFO] GE(618670,python3.9):2025-04-03-09:27:52.660.136 [ops_kernel_builder_registry.cc:41]618670 Unregister:OpsKernelBuilder of ops_kernel_info_hccl is unregistered
[INFO] GE(618658,python3.9):2025-04-03-09:27:52.664.426 [ops_kernel_builder_registry.cc:71]618658 ~OpsKernelBuilderRegistrar:Unregister kernel lib name = ops_kernel_info_hccl
[INFO] GE(618658,python3.9):2025-04-03-09:27:52.664.531 [ops_kernel_builder_registry.cc:41]618658 Unregister:OpsKernelBuilder of ops_kernel_info_hccl is unregistered
[INFO] GE(618674,python3.9):2025-04-03-09:27:52.694.477 [ops_kernel_builder_registry.cc:71]618674 ~OpsKernelBuilderRegistrar:Unregister kernel lib name = ops_kernel_info_hccl
[INFO] GE(618674,python3.9):2025-04-03-09:27:52.694.580 [ops_kernel_builder_registry.cc:41]618674 Unregister:OpsKernelBuilder of ops_kernel_info_hccl is unregistered
[INFO] GE(618666,python3.9):2025-04-03-09:27:52.695.047 [ops_kernel_builder_registry.cc:71]618666 ~OpsKernelBuilderRegistrar:Unregister kernel lib name = ops_kernel_info_hccl
[INFO] GE(618666,python3.9):2025-04-03-09:27:52.695.127 [ops_kernel_builder_registry.cc:41]618666 Unregister:OpsKernelBuilder of ops_kernel_info_hccl is unregistered
[INFO] GE(618662,python3.9):2025-04-03-09:27:52.695.145 [ops_kernel_builder_registry.cc:71]618662 ~OpsKernelBuilderRegistrar:Unregister kernel lib name = ops_kernel_info_hccl
[INFO] GE(618662,python3.9):2025-04-03-09:27:52.695.201 [ops_kernel_builder_registry.cc:41]618662 Unregister:OpsKernelBuilder of ops_kernel_info_hccl is unregistered
[INFO] GE(618650,python3.9):2025-04-03-09:27:52.696.893 [ops_kernel_builder_registry.cc:71]618650 ~OpsKernelBuilderRegistrar:Unregister kernel lib name = ops_kernel_info_hccl
[INFO] GE(618650,python3.9):2025-04-03-09:27:52.696.984 [ops_kernel_builder_registry.cc:41]618650 Unregister:OpsKernelBuilder of ops_kernel_info_hccl is unregistered
[INFO] GE(618654,python3.9):2025-04-03-09:27:52.719.083 [ops_kernel_builder_registry.cc:71]618654 ~OpsKernelBuilderRegistrar:Unregister kernel lib name = ops_kernel_info_hccl
[INFO] GE(618654,python3.9):2025-04-03-09:27:52.719.170 [ops_kernel_builder_registry.cc:41]618654 Unregister:OpsKernelBuilder of ops_kernel_info_hccl is unregistered
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:53.188.204 [adx_server_manager.cpp:236][tid:618840] server manager stop
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:53.252.272 [adx_server_manager.cpp:236][tid:618863] server manager stop
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:53.572.210 [adx_server_manager.cpp:236][tid:618960] server manager stop
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:53.594.462 [adx_hdc_epoll.cpp:57][tid:618666] start to close hdc epoll
[INFO] GE(618666,python3.9):2025-04-03-09:27:53.624.614 [op_impl_registry_holder_manager.cc:31]618666 CloseHandle:start close handle, handle[0xaaaafcadecd0].
[INFO] GE(618666,python3.9):2025-04-03-09:27:53.626.633 [op_impl_registry_holder_manager.cc:31]618666 CloseHandle:start close handle, handle[0xaaaafcae3300].
[INFO] GE(618666,python3.9):2025-04-03-09:27:53.629.378 [op_impl_registry_holder_manager.cc:31]618666 CloseHandle:start close handle, handle[0xaaaafcb0d780].
[INFO] GE(618666,python3.9):2025-04-03-09:27:53.632.568 [op_impl_registry_holder_manager.cc:31]618666 CloseHandle:start close handle, handle[0xaaaafcae0310].
[INFO] GE(618666,python3.9):2025-04-03-09:27:53.633.522 [op_impl_registry_holder_manager.cc:31]618666 CloseHandle:start close handle, handle[0xaaaafdf19900].
[INFO] GE(618666,python3.9):2025-04-03-09:27:53.634.449 [op_impl_registry_holder_manager.cc:31]618666 CloseHandle:start close handle, handle[0xaaaafdf418f0].
[INFO] GE(618666,python3.9):2025-04-03-09:27:53.635.726 [op_impl_registry_holder_manager.cc:31]618666 CloseHandle:start close handle, handle[0xaaaafe004f70].
[INFO] GE(618666,python3.9):2025-04-03-09:27:53.646.943 [mem_manager.cc:118]618666 Finalize:MemManager Finalize.
[INFO] GE(618666,python3.9):2025-04-03-09:27:53.646.994 [session_scope_mem_allocator.cc:73]618666 FreeAllMemory:Free all memory
[INFO] GE(618666,python3.9):2025-04-03-09:27:53.648.959 [session_scope_mem_allocator.cc:73]618666 FreeAllMemory:Free all memory
[INFO] GE(618666,python3.9):2025-04-03-09:27:53.648.990 [caching_allocator.cc:474]618666 PrintStatics:Called counts[malloc:          0 free:          0].
[INFO] GE(618666,python3.9):2025-04-03-09:27:53.649.022 [caching_allocator.cc:391]618666 FreeBlocks:Free blocks.
[INFO] GE(618666,python3.9):2025-04-03-09:27:53.649.036 [caching_allocator.cc:358]618666 FreeCachedBlocks:Free cached blocks
[INFO] GE(618666,python3.9):2025-04-03-09:27:53.649.046 [caching_allocator.cc:422]618666 FreeBlockBins:Free block bins.
[INFO] GE(618666,python3.9):2025-04-03-09:27:53.649.058 [caching_allocator.cc:474]618666 PrintStatics:Called counts[malloc:          0 free:          0].
[INFO] GE(618666,python3.9):2025-04-03-09:27:53.649.071 [caching_allocator.cc:391]618666 FreeBlocks:Free blocks.
[INFO] GE(618666,python3.9):2025-04-03-09:27:53.649.080 [caching_allocator.cc:358]618666 FreeCachedBlocks:Free cached blocks
[INFO] GE(618666,python3.9):2025-04-03-09:27:53.649.091 [caching_allocator.cc:422]618666 FreeBlockBins:Free block bins.
[INFO] GE(618666,python3.9):2025-04-03-09:27:53.649.113 [mem_manager.cc:145]618666 ReleaseResource:MemManager ReleaseResource device id = 0.
[INFO] GE(618666,python3.9):2025-04-03-09:27:53.649.126 [rts_caching_mem_allocator.cc:150]618666 ReleaseResource:RtsAllocatorManager ReleaseResource device id:0.
[INFO] GE(618666,python3.9):2025-04-03-09:27:53.649.142 [rts_caching_mem_allocator.cc:136]618666 Finalize:RtsAllocatorManager Finalize.
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:53.674.468 [adx_hdc_epoll.cpp:57][tid:618674] start to close hdc epoll
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:53.696.206 [adx_server_manager.cpp:236][tid:618778] server manager stop
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:53.702.650 [adx_hdc_epoll.cpp:57][tid:618646] start to close hdc epoll
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:53.703.943 [network_manager.cc:875] [618666]destroy all nic/vnic.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:53.703.994 [network_manager.cc:875] [618666]destroy all nic/vnic.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:53.704.005 [network_manager.cc:875] [618666]destroy all nic/vnic.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:53.704.015 [network_manager.cc:875] [618666]destroy all nic/vnic.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:53.704.026 [network_manager.cc:875] [618666]destroy all nic/vnic.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:53.704.035 [network_manager.cc:875] [618666]destroy all nic/vnic.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:53.704.048 [network_manager.cc:875] [618666]destroy all nic/vnic.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:53.704.060 [network_manager.cc:875] [618666]destroy all nic/vnic.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:53.704.069 [network_manager.cc:875] [618666]destroy all nic/vnic.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:53.704.078 [network_manager.cc:875] [618666]destroy all nic/vnic.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:53.704.086 [network_manager.cc:875] [618666]destroy all nic/vnic.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:53.704.094 [network_manager.cc:875] [618666]destroy all nic/vnic.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:53.704.118 [network_manager.cc:875] [618666]destroy all nic/vnic.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:53.704.127 [network_manager.cc:875] [618666]destroy all nic/vnic.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:53.704.136 [network_manager.cc:875] [618666]destroy all nic/vnic.
[INFO] HCCL(618666,python3.9):2025-04-03-09:27:53.704.146 [network_manager.cc:875] [618666]destroy all nic/vnic.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.710.255 [runtime.cc:1570] 618666 ~Runtime: deconstruct runtime
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.710.293 [runtime.cc:1577] 618666 ~Runtime: wait monitor success, use=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.710.551 [raw_device.cc:262] 618666 SetDevProfStatus: devProfStatus_=0, profConfigType=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.710.581 [engine.cc:188] 618666 SubmitTaskNormal: stream_id=0,task_id=5,task_type=83 (DEVICE_RINGBUFFER_CONTROL).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.710.604 [ringbuffer_maintain_task.cc:83] 618666 ConstructSqeForRingBufferMaintainTask: RingBufferMaintainTask stream_id:0, task_id:5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.710.618 [stream.cc:1400] 618666 AddTaskToList: public task, stream_id=0, task_id=5, task_type=83 (DEVICE_RINGBUFFER_CONTROL), head=5, tail=6
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.710.632 [stream.cc:2595] 618666 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=5, type=83(DEVICE_RINGBUFFER_CONTROL), head=5, tail=6, sqe_num=1, lastTail=5, device_id=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.710.655 [npu_driver.cc:751] 618666 SqTaskSend: device_id=5, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.710.668 [stars_engine.cc:893] 618666 SendTask: Sq task send finished, device_id=5, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=5, task_type=83(DEVICE_RINGBUFFER_CONTROL).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.710.683 [stream.cc:1494] 618666 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.710.700 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=0, head=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.710.714 [stream.cc:2886] 618666 StarsWaitForTask: No.0 stream_id=0, taskId=5, currentId=4
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.710.728 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=0, head=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.710.740 [stream.cc:2886] 618666 StarsWaitForTask: No.1 stream_id=0, taskId=5, currentId=4
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.710.751 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=0, head=6.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.710.764 [task.cc:185] 618666 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.710.776 [task.cc:185] 618666 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.710.789 [logger.cc:152] 618666 TaskFinished: device_id=5, stream_id=0, task_id=5, task_type=83 (DEVICE_RINGBUFFER_CONTROL), task_finish_num=16
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.710.808 [stars_engine.cc:437] 618666 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=5, sqHead=6, endTaskId=5, recycleTaskId=5.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.710.822 [stream.cc:2886] 618666 StarsWaitForTask: No.2 stream_id=0, taskId=5, currentId=5
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.710.836 [stars_engine.cc:524] 618666 TaskReclaim: Travel all streams, num=2.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.710.847 [npu_driver.cc:5547] 618666 GetSqHead: deviceId=5, tsId=0, sqId=0, head=6.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.710.864 [stream.cc:852] 618666 TearDown: stream_id=0, sqId=0, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.710.890 [stream.cc:938] 618666 TearDown: stream_id=0, delay recycle task num=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.710.903 [stream.cc:1507] 618666 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.714.545 [stream_sqcq_manage.cc:451] 618666 FreeLogicCq: Return(0), threadIdentifier(281473067970016), devId(5), tsId(0), cqId(358), isFastCq(0).
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.714.598 [npu_driver.cc:6163] 618666 StreamUnBindLogicCq: success: deviceId=5, tsId=0, streamId=0, logicCq=358.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.714.652 [npu_driver.cc:1180] 618666 LogicCqFree: Succ:device_id=5,ts_id=0,type=2,logic_cq_id=358, drvFlag=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.714.668 [stream.cc:237] 618666 FreeStreamId: Free stream_id=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.714.682 [stream_sqcq_manage.cc:216] 618666 DeAllocStreamSqCq: deviceId=5, tsId=0, drvFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.714.695 [npu_driver.cc:966] 618666 NormalSqCqFree: Normal sqcq free, sqId=0, cqId=0, device_id=5, tsId=0, drvFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.715.333 [npu_driver.cc:974] 618666 NormalSqCqFree: Normal sqcq free success, sqId=0, cqId=0, device_id=5, tsId=0, drvFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.715.351 [stream_sqcq_manage.cc:228] 618666 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=0, cq_id=0, stream_id=0, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.715.366 [npu_driver.cc:432] 618666 StreamIdFree: stream id free begin, device_id=5, stream_id=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.715.386 [npu_driver.cc:441] 618666 StreamIdFree: Stream id free success, stream_id=0, device_id=5, tsId=0, streamFlag=192
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.715.450 [stars_engine.cc:206] 618807 RecycleThreadRun: RecycleThreadRun thread leave.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.715.594 [stars_engine.cc:191] 618666 DestroyRecycleThread: Stars engine joined recycle thread OK.
[WARNING] RUNTIME(618666,python3.9):2025-04-03-09:27:53.715.608 [osal.cc:225] 618666 Join: mmJoinTask failed, thread=281471421652896 does not exist!
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.715.620 [stars_engine.cc:150] 618666 Stop: Startsengine joined monitor thread OK.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.715.638 [runtime.cc:5239] 618666 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
[INFO] TDT(618666,python3.9):2025-04-03-09:27:53.715.655 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618666] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.715.669 [runtime.cc:3003] 618666 StopAicpuExecutor: TsdClose success, userDeviceId=5, devId=5, tdt status=0
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:53.715.684 [atrace_api.c:118](tid:618666) AtraceDestroy start.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:53.715.700 [tracer_mgr_operate.c:248](tid:618666) destroy object RUNTIME_ATRACE_DEV5_TS0, exitSave(false).
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:53.715.715 [atrace_api.c:120](tid:618666) AtraceDestroy end.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.715.734 [stream.cc:237] 618666 FreeStreamId: Free stream_id=1.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.715.746 [stream_sqcq_manage.cc:216] 618666 DeAllocStreamSqCq: deviceId=5, tsId=0, drvFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.715.757 [npu_driver.cc:966] 618666 NormalSqCqFree: Normal sqcq free, sqId=1, cqId=1, device_id=5, tsId=0, drvFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.715.959 [npu_driver.cc:974] 618666 NormalSqCqFree: Normal sqcq free success, sqId=1, cqId=1, device_id=5, tsId=0, drvFlag=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.715.975 [stream_sqcq_manage.cc:228] 618666 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=1, cq_id=1, stream_id=1, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.716.001 [npu_driver.cc:432] 618666 StreamIdFree: stream id free begin, device_id=5, stream_id=1, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.716.016 [npu_driver.cc:441] 618666 StreamIdFree: Stream id free success, stream_id=1, device_id=5, tsId=0, streamFlag=0
[INFO] GE(618674,python3.9):2025-04-03-09:27:53.716.249 [op_impl_registry_holder_manager.cc:31]618674 CloseHandle:start close handle, handle[0xaaab06cee660].
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.725.181 [stars_engine.cc:58] 618666 ~StarsEngine: Destructor.
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.725.217 [engine.cc:84] 618666 ~Engine: Destructor.
[INFO] DRV(618666,python3.9):2025-04-03-09:27:53.726.080 [trs_dev_drv.c:370][ascend][curpid:618666,618666][drv][tsdrv][drvDeviceCloseComm]Close success. (devid=5; fd=36; mmapFd=37)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:53.726.104 [devmm_svm.c:2238][ascend][curpid:618666,618666][drv][devmm][drvMemDeviceCloseInner]DrvMemDeviceClose. (devid=5)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:53.726.121 [svm_mem_statistics.c:140][ascend][curpid:618666,618666][drv][devmm][_svm_mem_stats_show]SVM_MEM Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=2965372928; alloc_cnt=7; free_cnt=7)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:53.726.139 [svm_mem_statistics.c:140][ascend][curpid:618666,618666][drv][devmm][_svm_mem_stats_show]HOST_MEM Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=4096; alloc_cnt=2; free_cnt=2)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:53.726.154 [svm_mem_statistics.c:140][ascend][curpid:618666,618666][drv][devmm][_svm_mem_stats_show]HOST_MEM Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=11341824; alloc_cnt=3; free_cnt=3)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:53.726.170 [svm_mem_statistics.c:146][ascend][curpid:618666,618666][drv][devmm][_svm_mem_stats_show]HOST_MEM Cached_size:12582912Bytes
[INFO] DRV(618666,python3.9):2025-04-03-09:27:53.726.183 [svm_mem_statistics.c:140][ascend][curpid:618666,618666][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_HBM dev5 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=94208; alloc_cnt=10; free_cnt=10)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:53.726.199 [svm_mem_statistics.c:140][ascend][curpid:618666,618666][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_HBM dev5 Mem stats (Bytes). (module_name=APP; module_id=33; current_alloced_size=135168; alloced_peak_size=135168; alloc_cnt=1; free_cnt=0)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:53.726.215 [svm_mem_statistics.c:146][ascend][curpid:618666,618666][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_HBM dev5 Cached_size:1961984Bytes
[INFO] DRV(618666,python3.9):2025-04-03-09:27:53.726.225 [svm_mem_statistics.c:140][ascend][curpid:618666,618666][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_DDR dev5 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=16384; alloc_cnt=1; free_cnt=1)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:53.726.241 [svm_mem_statistics.c:146][ascend][curpid:618666,618666][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_DDR dev5 Cached_size:2097152Bytes
[INFO] DRV(618666,python3.9):2025-04-03-09:27:53.726.254 [svm_mem_statistics.c:140][ascend][curpid:618666,618666][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_P2P_HBM dev5 Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=1343488; alloc_cnt=8; free_cnt=8)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:53.726.270 [svm_mem_statistics.c:146][ascend][curpid:618666,618666][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_P2P_HBM dev5 Cached_size:2097152Bytes
[INFO] DRV(618666,python3.9):2025-04-03-09:27:53.726.282 [svm_mem_statistics.c:140][ascend][curpid:618666,618666][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev5 Mem stats (Bytes). (module_name=UNKNOWN; module_id=0; current_alloced_size=0; alloced_peak_size=2097152; alloc_cnt=1; free_cnt=1)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:53.726.310 [svm_mem_statistics.c:140][ascend][curpid:618666,618666][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev5 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=20971520; alloc_cnt=8; free_cnt=8)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:53.726.326 [svm_mem_statistics.c:140][ascend][curpid:618666,618666][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev5 Mem stats (Bytes). (module_name=APP; module_id=33; current_alloced_size=0; alloced_peak_size=429916160; alloc_cnt=3; free_cnt=3)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:53.726.341 [svm_mem_statistics.c:146][ascend][curpid:618666,618666][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev5 Cached_size:23068672Bytes
[INFO] DRV(618666,python3.9):2025-04-03-09:27:53.726.353 [svm_mem_statistics.c:140][ascend][curpid:618666,618666][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_DDR dev5 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=6291456; alloc_cnt=2; free_cnt=2)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:53.726.369 [svm_mem_statistics.c:146][ascend][curpid:618666,618666][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_DDR dev5 Cached_size:6291456Bytes
[INFO] DRV(618666,python3.9):2025-04-03-09:27:53.726.381 [svm_mem_statistics.c:140][ascend][curpid:618666,618666][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_P2P_HBM dev5 Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=4194304; alloc_cnt=1; free_cnt=1)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:53.726.395 [svm_mem_statistics.c:140][ascend][curpid:618666,618666][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_P2P_HBM dev5 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=12582912; alloc_cnt=5; free_cnt=5)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:53.726.411 [svm_mem_statistics.c:146][ascend][curpid:618666,618666][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_P2P_HBM dev5 Cached_size:16777216Bytes
[INFO] GE(618674,python3.9):2025-04-03-09:27:53.726.406 [op_impl_registry_holder_manager.cc:31]618674 CloseHandle:start close handle, handle[0xaaab06cf2c90].
[INFO] GE(618674,python3.9):2025-04-03-09:27:53.729.262 [op_impl_registry_holder_manager.cc:31]618674 CloseHandle:start close handle, handle[0xaaab06d1d110].
[INFO] GE(618674,python3.9):2025-04-03-09:27:53.732.850 [op_impl_registry_holder_manager.cc:31]618674 CloseHandle:start close handle, handle[0xaaab06cefca0].
[INFO] GE(618674,python3.9):2025-04-03-09:27:53.733.798 [op_impl_registry_holder_manager.cc:31]618674 CloseHandle:start close handle, handle[0xaaab08129290].
[INFO] GE(618674,python3.9):2025-04-03-09:27:53.734.712 [op_impl_registry_holder_manager.cc:31]618674 CloseHandle:start close handle, handle[0xaaab08151280].
[INFO] GE(618674,python3.9):2025-04-03-09:27:53.736.009 [op_impl_registry_holder_manager.cc:31]618674 CloseHandle:start close handle, handle[0xaaab08214900].
[INFO] GE(618646,python3.9):2025-04-03-09:27:53.745.604 [op_impl_registry_holder_manager.cc:31]618646 CloseHandle:start close handle, handle[0xaaab0c93bff0].
[INFO] GE(618646,python3.9):2025-04-03-09:27:53.747.783 [op_impl_registry_holder_manager.cc:31]618646 CloseHandle:start close handle, handle[0xaaab0c940690].
[INFO] GE(618674,python3.9):2025-04-03-09:27:53.750.654 [mem_manager.cc:118]618674 Finalize:MemManager Finalize.
[INFO] GE(618674,python3.9):2025-04-03-09:27:53.750.700 [session_scope_mem_allocator.cc:73]618674 FreeAllMemory:Free all memory
[INFO] GE(618646,python3.9):2025-04-03-09:27:53.751.013 [op_impl_registry_holder_manager.cc:31]618646 CloseHandle:start close handle, handle[0xaaab0c96ab10].
[INFO] GE(618674,python3.9):2025-04-03-09:27:53.752.962 [session_scope_mem_allocator.cc:73]618674 FreeAllMemory:Free all memory
[INFO] GE(618674,python3.9):2025-04-03-09:27:53.752.997 [caching_allocator.cc:474]618674 PrintStatics:Called counts[malloc:          0 free:          0].
[INFO] GE(618674,python3.9):2025-04-03-09:27:53.753.034 [caching_allocator.cc:391]618674 FreeBlocks:Free blocks.
[INFO] GE(618674,python3.9):2025-04-03-09:27:53.753.052 [caching_allocator.cc:358]618674 FreeCachedBlocks:Free cached blocks
[INFO] GE(618674,python3.9):2025-04-03-09:27:53.753.064 [caching_allocator.cc:422]618674 FreeBlockBins:Free block bins.
[INFO] GE(618674,python3.9):2025-04-03-09:27:53.753.078 [caching_allocator.cc:474]618674 PrintStatics:Called counts[malloc:          0 free:          0].
[INFO] GE(618674,python3.9):2025-04-03-09:27:53.753.095 [caching_allocator.cc:391]618674 FreeBlocks:Free blocks.
[INFO] GE(618674,python3.9):2025-04-03-09:27:53.753.106 [caching_allocator.cc:358]618674 FreeCachedBlocks:Free cached blocks
[INFO] GE(618674,python3.9):2025-04-03-09:27:53.753.118 [caching_allocator.cc:422]618674 FreeBlockBins:Free block bins.
[INFO] GE(618674,python3.9):2025-04-03-09:27:53.753.142 [mem_manager.cc:145]618674 ReleaseResource:MemManager ReleaseResource device id = 0.
[INFO] GE(618674,python3.9):2025-04-03-09:27:53.753.163 [rts_caching_mem_allocator.cc:150]618674 ReleaseResource:RtsAllocatorManager ReleaseResource device id:0.
[INFO] GE(618674,python3.9):2025-04-03-09:27:53.753.208 [rts_caching_mem_allocator.cc:136]618674 Finalize:RtsAllocatorManager Finalize.
[INFO] GE(618646,python3.9):2025-04-03-09:27:53.756.383 [op_impl_registry_holder_manager.cc:31]618646 CloseHandle:start close handle, handle[0xaaab0c93d600].
[INFO] GE(618646,python3.9):2025-04-03-09:27:53.758.031 [op_impl_registry_holder_manager.cc:31]618646 CloseHandle:start close handle, handle[0xaaab0dd76be0].
[INFO] GE(618646,python3.9):2025-04-03-09:27:53.759.632 [op_impl_registry_holder_manager.cc:31]618646 CloseHandle:start close handle, handle[0xaaab0dd9ebd0].
[INFO] GE(618646,python3.9):2025-04-03-09:27:53.761.033 [op_impl_registry_holder_manager.cc:31]618646 CloseHandle:start close handle, handle[0xaaab0de62240].
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:53.764.208 [adx_server_manager.cpp:236][tid:618862] server manager stop
[INFO] GE(618646,python3.9):2025-04-03-09:27:53.778.133 [mem_manager.cc:118]618646 Finalize:MemManager Finalize.
[INFO] GE(618646,python3.9):2025-04-03-09:27:53.778.173 [session_scope_mem_allocator.cc:73]618646 FreeAllMemory:Free all memory
[INFO] GE(618646,python3.9):2025-04-03-09:27:53.780.539 [session_scope_mem_allocator.cc:73]618646 FreeAllMemory:Free all memory
[INFO] GE(618646,python3.9):2025-04-03-09:27:53.780.572 [caching_allocator.cc:474]618646 PrintStatics:Called counts[malloc:          0 free:          0].
[INFO] GE(618646,python3.9):2025-04-03-09:27:53.780.607 [caching_allocator.cc:391]618646 FreeBlocks:Free blocks.
[INFO] GE(618646,python3.9):2025-04-03-09:27:53.780.624 [caching_allocator.cc:358]618646 FreeCachedBlocks:Free cached blocks
[INFO] GE(618646,python3.9):2025-04-03-09:27:53.780.656 [caching_allocator.cc:422]618646 FreeBlockBins:Free block bins.
[INFO] GE(618646,python3.9):2025-04-03-09:27:53.780.671 [caching_allocator.cc:474]618646 PrintStatics:Called counts[malloc:          0 free:          0].
[INFO] GE(618646,python3.9):2025-04-03-09:27:53.780.687 [caching_allocator.cc:391]618646 FreeBlocks:Free blocks.
[INFO] GE(618646,python3.9):2025-04-03-09:27:53.780.697 [caching_allocator.cc:358]618646 FreeCachedBlocks:Free cached blocks
[INFO] GE(618646,python3.9):2025-04-03-09:27:53.780.709 [caching_allocator.cc:422]618646 FreeBlockBins:Free block bins.
[INFO] GE(618646,python3.9):2025-04-03-09:27:53.780.730 [mem_manager.cc:145]618646 ReleaseResource:MemManager ReleaseResource device id = 0.
[INFO] GE(618646,python3.9):2025-04-03-09:27:53.780.744 [rts_caching_mem_allocator.cc:150]618646 ReleaseResource:RtsAllocatorManager ReleaseResource device id:0.
[INFO] GE(618646,python3.9):2025-04-03-09:27:53.780.759 [rts_caching_mem_allocator.cc:136]618646 Finalize:RtsAllocatorManager Finalize.
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:53.796.194 [adx_server_manager.cpp:236][tid:618900] server manager stop
[INFO] DRV(618666,python3.9):2025-04-03-09:27:53.816.591 [drv_log_user.c:623][ascend][curpid:618666,618666][drv][devmm][share_log_read_in_single_module]Close logical_device. (logical_devid=5; phyid=5; vfid=0; hostpid=618666; devpid=30062)
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.816.656 [npu_driver.cc:3045] 618666 DeviceClose: Close device success, device_id=5, tsId=0
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.816.673 [raw_device.cc:125] 618666 ~Device: deconstruct device
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:53.840.055 [network_manager.cc:875] [618674]destroy all nic/vnic.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:53.840.150 [network_manager.cc:875] [618674]destroy all nic/vnic.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:53.840.177 [network_manager.cc:875] [618674]destroy all nic/vnic.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:53.840.192 [network_manager.cc:875] [618674]destroy all nic/vnic.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:53.840.217 [network_manager.cc:875] [618674]destroy all nic/vnic.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:53.840.234 [network_manager.cc:875] [618674]destroy all nic/vnic.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:53.840.246 [network_manager.cc:875] [618674]destroy all nic/vnic.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:53.840.288 [network_manager.cc:875] [618674]destroy all nic/vnic.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:53.840.302 [network_manager.cc:875] [618674]destroy all nic/vnic.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:53.840.314 [network_manager.cc:875] [618674]destroy all nic/vnic.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:53.840.327 [network_manager.cc:875] [618674]destroy all nic/vnic.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:53.840.338 [network_manager.cc:875] [618674]destroy all nic/vnic.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:53.840.353 [network_manager.cc:875] [618674]destroy all nic/vnic.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:53.840.364 [network_manager.cc:875] [618674]destroy all nic/vnic.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:53.840.376 [network_manager.cc:875] [618674]destroy all nic/vnic.
[INFO] HCCL(618674,python3.9):2025-04-03-09:27:53.840.392 [network_manager.cc:875] [618674]destroy all nic/vnic.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.846.180 [runtime.cc:1570] 618674 ~Runtime: deconstruct runtime
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.846.220 [runtime.cc:1577] 618674 ~Runtime: wait monitor success, use=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.846.962 [raw_device.cc:262] 618674 SetDevProfStatus: devProfStatus_=0, profConfigType=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.847.002 [engine.cc:188] 618674 SubmitTaskNormal: stream_id=0,task_id=5,task_type=83 (DEVICE_RINGBUFFER_CONTROL).
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.847.031 [ringbuffer_maintain_task.cc:83] 618674 ConstructSqeForRingBufferMaintainTask: RingBufferMaintainTask stream_id:0, task_id:5
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.847.049 [stream.cc:1400] 618674 AddTaskToList: public task, stream_id=0, task_id=5, task_type=83 (DEVICE_RINGBUFFER_CONTROL), head=5, tail=6
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.847.067 [stream.cc:2595] 618674 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=5, type=83(DEVICE_RINGBUFFER_CONTROL), head=5, tail=6, sqe_num=1, lastTail=5, device_id=7
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.847.096 [npu_driver.cc:751] 618674 SqTaskSend: device_id=7, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.847.115 [stars_engine.cc:893] 618674 SendTask: Sq task send finished, device_id=7, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=5, task_type=83(DEVICE_RINGBUFFER_CONTROL).
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.847.133 [stream.cc:1494] 618674 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=5.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.847.151 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=0, head=5.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.847.169 [stream.cc:2886] 618674 StarsWaitForTask: No.0 stream_id=0, taskId=5, currentId=4
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.847.187 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=0, head=6.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.847.202 [task.cc:185] 618674 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.847.220 [task.cc:185] 618674 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.847.238 [logger.cc:152] 618674 TaskFinished: device_id=7, stream_id=0, task_id=5, task_type=83 (DEVICE_RINGBUFFER_CONTROL), task_finish_num=16
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.847.263 [stars_engine.cc:437] 618674 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=5, sqHead=6, endTaskId=5, recycleTaskId=5.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.847.280 [stream.cc:2886] 618674 StarsWaitForTask: No.1 stream_id=0, taskId=5, currentId=5
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.847.296 [stars_engine.cc:524] 618674 TaskReclaim: Travel all streams, num=2.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.847.312 [npu_driver.cc:5547] 618674 GetSqHead: deviceId=7, tsId=0, sqId=0, head=6.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.847.348 [stream.cc:852] 618674 TearDown: stream_id=0, sqId=0, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.847.367 [stream.cc:938] 618674 TearDown: stream_id=0, delay recycle task num=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.847.379 [stream.cc:1507] 618674 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.850.853 [stream_sqcq_manage.cc:451] 618674 FreeLogicCq: Return(0), threadIdentifier(281473023856096), devId(7), tsId(0), cqId(331), isFastCq(0).
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.850.905 [npu_driver.cc:6163] 618674 StreamUnBindLogicCq: success: deviceId=7, tsId=0, streamId=0, logicCq=331.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.850.966 [npu_driver.cc:1180] 618674 LogicCqFree: Succ:device_id=7,ts_id=0,type=2,logic_cq_id=331, drvFlag=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.850.986 [stream.cc:237] 618674 FreeStreamId: Free stream_id=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.851.004 [stream_sqcq_manage.cc:216] 618674 DeAllocStreamSqCq: deviceId=7, tsId=0, drvFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.851.020 [npu_driver.cc:966] 618674 NormalSqCqFree: Normal sqcq free, sqId=0, cqId=0, device_id=7, tsId=0, drvFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.851.644 [npu_driver.cc:974] 618674 NormalSqCqFree: Normal sqcq free success, sqId=0, cqId=0, device_id=7, tsId=0, drvFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.851.665 [stream_sqcq_manage.cc:228] 618674 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=0, cq_id=0, stream_id=0, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.851.685 [npu_driver.cc:432] 618674 StreamIdFree: stream id free begin, device_id=7, stream_id=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.851.708 [npu_driver.cc:441] 618674 StreamIdFree: Stream id free success, stream_id=0, device_id=7, tsId=0, streamFlag=192
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.851.876 [stars_engine.cc:206] 618813 RecycleThreadRun: RecycleThreadRun thread leave.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.852.018 [stars_engine.cc:191] 618674 DestroyRecycleThread: Stars engine joined recycle thread OK.
[WARNING] RUNTIME(618674,python3.9):2025-04-03-09:27:53.852.037 [osal.cc:225] 618674 Join: mmJoinTask failed, thread=281471360630688 does not exist!
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.852.050 [stars_engine.cc:150] 618674 Stop: Startsengine joined monitor thread OK.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.852.089 [runtime.cc:5239] 618674 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
[INFO] TDT(618674,python3.9):2025-04-03-09:27:53.852.111 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618674] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.852.128 [runtime.cc:3003] 618674 StopAicpuExecutor: TsdClose success, userDeviceId=7, devId=7, tdt status=0
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:53.852.147 [atrace_api.c:118](tid:618674) AtraceDestroy start.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:53.852.205 [tracer_mgr_operate.c:248](tid:618674) destroy object RUNTIME_ATRACE_DEV7_TS0, exitSave(false).
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:53.852.229 [atrace_api.c:120](tid:618674) AtraceDestroy end.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.852.249 [stream.cc:237] 618674 FreeStreamId: Free stream_id=1.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.852.265 [stream_sqcq_manage.cc:216] 618674 DeAllocStreamSqCq: deviceId=7, tsId=0, drvFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.852.276 [npu_driver.cc:966] 618674 NormalSqCqFree: Normal sqcq free, sqId=1, cqId=1, device_id=7, tsId=0, drvFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.852.605 [npu_driver.cc:974] 618674 NormalSqCqFree: Normal sqcq free success, sqId=1, cqId=1, device_id=7, tsId=0, drvFlag=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.852.625 [stream_sqcq_manage.cc:228] 618674 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=1, cq_id=1, stream_id=1, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.852.640 [npu_driver.cc:432] 618674 StreamIdFree: stream id free begin, device_id=7, stream_id=1, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.852.659 [npu_driver.cc:441] 618674 StreamIdFree: Stream id free success, stream_id=1, device_id=7, tsId=0, streamFlag=0
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:53.853.741 [network_manager.cc:875] [618646]destroy all nic/vnic.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:53.853.788 [network_manager.cc:875] [618646]destroy all nic/vnic.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:53.853.804 [network_manager.cc:875] [618646]destroy all nic/vnic.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:53.853.818 [network_manager.cc:875] [618646]destroy all nic/vnic.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:53.853.830 [network_manager.cc:875] [618646]destroy all nic/vnic.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:53.853.845 [network_manager.cc:875] [618646]destroy all nic/vnic.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:53.853.855 [network_manager.cc:875] [618646]destroy all nic/vnic.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:53.853.867 [network_manager.cc:875] [618646]destroy all nic/vnic.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:53.853.880 [network_manager.cc:875] [618646]destroy all nic/vnic.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:53.853.891 [network_manager.cc:875] [618646]destroy all nic/vnic.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:53.853.903 [network_manager.cc:875] [618646]destroy all nic/vnic.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:53.853.917 [network_manager.cc:875] [618646]destroy all nic/vnic.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:53.853.927 [network_manager.cc:875] [618646]destroy all nic/vnic.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:53.853.940 [network_manager.cc:875] [618646]destroy all nic/vnic.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:53.853.953 [network_manager.cc:875] [618646]destroy all nic/vnic.
[INFO] HCCL(618646,python3.9):2025-04-03-09:27:53.853.964 [network_manager.cc:875] [618646]destroy all nic/vnic.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.858.159 [runtime.cc:1570] 618646 ~Runtime: deconstruct runtime
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.858.188 [runtime.cc:1577] 618646 ~Runtime: wait monitor success, use=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.858.599 [raw_device.cc:262] 618646 SetDevProfStatus: devProfStatus_=0, profConfigType=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.858.632 [engine.cc:188] 618646 SubmitTaskNormal: stream_id=0,task_id=5,task_type=83 (DEVICE_RINGBUFFER_CONTROL).
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.858.658 [ringbuffer_maintain_task.cc:83] 618646 ConstructSqeForRingBufferMaintainTask: RingBufferMaintainTask stream_id:0, task_id:5
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.858.675 [stream.cc:1400] 618646 AddTaskToList: public task, stream_id=0, task_id=5, task_type=83 (DEVICE_RINGBUFFER_CONTROL), head=5, tail=6
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.858.691 [stream.cc:2595] 618646 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=5, type=83(DEVICE_RINGBUFFER_CONTROL), head=5, tail=6, sqe_num=1, lastTail=5, device_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.858.717 [npu_driver.cc:751] 618646 SqTaskSend: device_id=0, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.858.748 [stars_engine.cc:893] 618646 SendTask: Sq task send finished, device_id=0, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=5, task_type=83(DEVICE_RINGBUFFER_CONTROL).
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.858.767 [stream.cc:1494] 618646 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=5.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.858.787 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=0, head=5.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.858.804 [stream.cc:2886] 618646 StarsWaitForTask: No.0 stream_id=0, taskId=5, currentId=4
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.858.820 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=0, head=6.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.858.834 [task.cc:185] 618646 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.858.851 [task.cc:185] 618646 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.858.868 [logger.cc:152] 618646 TaskFinished: device_id=0, stream_id=0, task_id=5, task_type=83 (DEVICE_RINGBUFFER_CONTROL), task_finish_num=16
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.858.889 [stars_engine.cc:437] 618646 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=5, sqHead=6, endTaskId=5, recycleTaskId=5.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.858.905 [stream.cc:2886] 618646 StarsWaitForTask: No.1 stream_id=0, taskId=5, currentId=5
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.858.920 [stars_engine.cc:524] 618646 TaskReclaim: Travel all streams, num=2.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.858.935 [npu_driver.cc:5547] 618646 GetSqHead: deviceId=0, tsId=0, sqId=0, head=6.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.858.957 [stream.cc:852] 618646 TearDown: stream_id=0, sqId=0, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.858.975 [stream.cc:938] 618646 TearDown: stream_id=0, delay recycle task num=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.858.991 [stream.cc:1507] 618646 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.861.088 [stars_engine.cc:58] 618674 ~StarsEngine: Destructor.
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.861.121 [engine.cc:84] 618674 ~Engine: Destructor.
[INFO] DRV(618674,python3.9):2025-04-03-09:27:53.861.999 [trs_dev_drv.c:370][ascend][curpid:618674,618674][drv][tsdrv][drvDeviceCloseComm]Close success. (devid=7; fd=36; mmapFd=37)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:53.862.028 [devmm_svm.c:2238][ascend][curpid:618674,618674][drv][devmm][drvMemDeviceCloseInner]DrvMemDeviceClose. (devid=7)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.862.027 [stream_sqcq_manage.cc:451] 618646 FreeLogicCq: Return(0), threadIdentifier(281472926821856), devId(0), tsId(0), cqId(488), isFastCq(0).
[INFO] DRV(618674,python3.9):2025-04-03-09:27:53.862.045 [svm_mem_statistics.c:140][ascend][curpid:618674,618674][drv][devmm][_svm_mem_stats_show]SVM_MEM Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=2965372928; alloc_cnt=7; free_cnt=7)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:53.862.067 [svm_mem_statistics.c:140][ascend][curpid:618674,618674][drv][devmm][_svm_mem_stats_show]HOST_MEM Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=4096; alloc_cnt=2; free_cnt=2)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.862.069 [npu_driver.cc:6163] 618646 StreamUnBindLogicCq: success: deviceId=0, tsId=0, streamId=0, logicCq=488.
[INFO] DRV(618674,python3.9):2025-04-03-09:27:53.862.088 [svm_mem_statistics.c:140][ascend][curpid:618674,618674][drv][devmm][_svm_mem_stats_show]HOST_MEM Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=11341824; alloc_cnt=3; free_cnt=3)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:53.862.109 [svm_mem_statistics.c:146][ascend][curpid:618674,618674][drv][devmm][_svm_mem_stats_show]HOST_MEM Cached_size:12582912Bytes
[INFO] DRV(618674,python3.9):2025-04-03-09:27:53.862.123 [svm_mem_statistics.c:140][ascend][curpid:618674,618674][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_HBM dev7 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=94208; alloc_cnt=10; free_cnt=10)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.862.131 [npu_driver.cc:1180] 618646 LogicCqFree: Succ:device_id=0,ts_id=0,type=2,logic_cq_id=488, drvFlag=0.
[INFO] DRV(618674,python3.9):2025-04-03-09:27:53.862.143 [svm_mem_statistics.c:140][ascend][curpid:618674,618674][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_HBM dev7 Mem stats (Bytes). (module_name=APP; module_id=33; current_alloced_size=135168; alloced_peak_size=135168; alloc_cnt=1; free_cnt=0)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.862.150 [stream.cc:237] 618646 FreeStreamId: Free stream_id=0.
[INFO] DRV(618674,python3.9):2025-04-03-09:27:53.862.164 [svm_mem_statistics.c:146][ascend][curpid:618674,618674][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_HBM dev7 Cached_size:1961984Bytes
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.862.168 [stream_sqcq_manage.cc:216] 618646 DeAllocStreamSqCq: deviceId=0, tsId=0, drvFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.862.181 [npu_driver.cc:966] 618646 NormalSqCqFree: Normal sqcq free, sqId=0, cqId=0, device_id=0, tsId=0, drvFlag=0
[INFO] DRV(618674,python3.9):2025-04-03-09:27:53.862.179 [svm_mem_statistics.c:140][ascend][curpid:618674,618674][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_DDR dev7 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=16384; alloc_cnt=1; free_cnt=1)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:53.862.202 [svm_mem_statistics.c:146][ascend][curpid:618674,618674][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_DDR dev7 Cached_size:2097152Bytes
[INFO] DRV(618674,python3.9):2025-04-03-09:27:53.862.216 [svm_mem_statistics.c:140][ascend][curpid:618674,618674][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_P2P_HBM dev7 Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=1343488; alloc_cnt=8; free_cnt=8)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:53.862.236 [svm_mem_statistics.c:146][ascend][curpid:618674,618674][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_P2P_HBM dev7 Cached_size:2097152Bytes
[INFO] DRV(618674,python3.9):2025-04-03-09:27:53.862.269 [svm_mem_statistics.c:140][ascend][curpid:618674,618674][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev7 Mem stats (Bytes). (module_name=UNKNOWN; module_id=0; current_alloced_size=0; alloced_peak_size=2097152; alloc_cnt=1; free_cnt=1)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:53.862.286 [svm_mem_statistics.c:140][ascend][curpid:618674,618674][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev7 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=20971520; alloc_cnt=8; free_cnt=8)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:53.862.303 [svm_mem_statistics.c:140][ascend][curpid:618674,618674][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev7 Mem stats (Bytes). (module_name=APP; module_id=33; current_alloced_size=0; alloced_peak_size=429916160; alloc_cnt=3; free_cnt=3)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:53.862.323 [svm_mem_statistics.c:146][ascend][curpid:618674,618674][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev7 Cached_size:23068672Bytes
[INFO] DRV(618674,python3.9):2025-04-03-09:27:53.862.337 [svm_mem_statistics.c:140][ascend][curpid:618674,618674][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_DDR dev7 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=6291456; alloc_cnt=2; free_cnt=2)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:53.862.357 [svm_mem_statistics.c:146][ascend][curpid:618674,618674][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_DDR dev7 Cached_size:6291456Bytes
[INFO] DRV(618674,python3.9):2025-04-03-09:27:53.862.372 [svm_mem_statistics.c:140][ascend][curpid:618674,618674][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_P2P_HBM dev7 Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=4194304; alloc_cnt=1; free_cnt=1)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:53.862.391 [svm_mem_statistics.c:140][ascend][curpid:618674,618674][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_P2P_HBM dev7 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=12582912; alloc_cnt=5; free_cnt=5)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:53.862.411 [svm_mem_statistics.c:146][ascend][curpid:618674,618674][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_P2P_HBM dev7 Cached_size:16777216Bytes
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.862.773 [npu_driver.cc:974] 618646 NormalSqCqFree: Normal sqcq free success, sqId=0, cqId=0, device_id=0, tsId=0, drvFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.862.792 [stream_sqcq_manage.cc:228] 618646 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=0, cq_id=0, stream_id=0, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.862.809 [npu_driver.cc:432] 618646 StreamIdFree: stream id free begin, device_id=0, stream_id=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.862.830 [npu_driver.cc:441] 618646 StreamIdFree: Stream id free success, stream_id=0, device_id=0, tsId=0, streamFlag=192
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.863.030 [stars_engine.cc:206] 618835 RecycleThreadRun: RecycleThreadRun thread leave.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.863.147 [stars_engine.cc:191] 618646 DestroyRecycleThread: Stars engine joined recycle thread OK.
[WARNING] RUNTIME(618646,python3.9):2025-04-03-09:27:53.863.168 [osal.cc:225] 618646 Join: mmJoinTask failed, thread=281471288958880 does not exist!
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.863.182 [stars_engine.cc:150] 618646 Stop: Startsengine joined monitor thread OK.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.863.212 [runtime.cc:5239] 618646 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
[INFO] TDT(618646,python3.9):2025-04-03-09:27:53.863.233 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618646] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.863.251 [runtime.cc:3003] 618646 StopAicpuExecutor: TsdClose success, userDeviceId=0, devId=0, tdt status=0
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:53.863.266 [atrace_api.c:118](tid:618646) AtraceDestroy start.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:53.863.284 [tracer_mgr_operate.c:248](tid:618646) destroy object RUNTIME_ATRACE_DEV0_TS0, exitSave(false).
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:53.863.302 [atrace_api.c:120](tid:618646) AtraceDestroy end.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.863.321 [stream.cc:237] 618646 FreeStreamId: Free stream_id=1.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.863.337 [stream_sqcq_manage.cc:216] 618646 DeAllocStreamSqCq: deviceId=0, tsId=0, drvFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.863.350 [npu_driver.cc:966] 618646 NormalSqCqFree: Normal sqcq free, sqId=1, cqId=1, device_id=0, tsId=0, drvFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.863.568 [npu_driver.cc:974] 618646 NormalSqCqFree: Normal sqcq free success, sqId=1, cqId=1, device_id=0, tsId=0, drvFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.863.587 [stream_sqcq_manage.cc:228] 618646 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=1, cq_id=1, stream_id=1, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.863.604 [npu_driver.cc:432] 618646 StreamIdFree: stream id free begin, device_id=0, stream_id=1, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.863.623 [npu_driver.cc:441] 618646 StreamIdFree: Stream id free success, stream_id=1, device_id=0, tsId=0, streamFlag=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.871.883 [stars_engine.cc:58] 618646 ~StarsEngine: Destructor.
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.871.913 [engine.cc:84] 618646 ~Engine: Destructor.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:53.872.769 [trs_dev_drv.c:370][ascend][curpid:618646,618646][drv][tsdrv][drvDeviceCloseComm]Close success. (devid=0; fd=36; mmapFd=37)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:53.872.797 [devmm_svm.c:2238][ascend][curpid:618646,618646][drv][devmm][drvMemDeviceCloseInner]DrvMemDeviceClose. (devid=0)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:53.872.817 [svm_mem_statistics.c:140][ascend][curpid:618646,618646][drv][devmm][_svm_mem_stats_show]SVM_MEM Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=2965372928; alloc_cnt=7; free_cnt=7)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:53.872.838 [svm_mem_statistics.c:140][ascend][curpid:618646,618646][drv][devmm][_svm_mem_stats_show]HOST_MEM Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=4096; alloc_cnt=10; free_cnt=10)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:53.872.858 [svm_mem_statistics.c:140][ascend][curpid:618646,618646][drv][devmm][_svm_mem_stats_show]HOST_MEM Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=11341824; alloc_cnt=3; free_cnt=3)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:53.872.878 [svm_mem_statistics.c:146][ascend][curpid:618646,618646][drv][devmm][_svm_mem_stats_show]HOST_MEM Cached_size:12582912Bytes
[INFO] DRV(618646,python3.9):2025-04-03-09:27:53.872.909 [svm_mem_statistics.c:140][ascend][curpid:618646,618646][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_HBM dev0 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=94208; alloc_cnt=10; free_cnt=10)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:53.872.929 [svm_mem_statistics.c:140][ascend][curpid:618646,618646][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_HBM dev0 Mem stats (Bytes). (module_name=APP; module_id=33; current_alloced_size=135168; alloced_peak_size=135168; alloc_cnt=1; free_cnt=0)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:53.872.948 [svm_mem_statistics.c:146][ascend][curpid:618646,618646][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_HBM dev0 Cached_size:1961984Bytes
[INFO] DRV(618646,python3.9):2025-04-03-09:27:53.872.965 [svm_mem_statistics.c:140][ascend][curpid:618646,618646][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_DDR dev0 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=16384; alloc_cnt=1; free_cnt=1)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:53.872.982 [svm_mem_statistics.c:146][ascend][curpid:618646,618646][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_DDR dev0 Cached_size:2097152Bytes
[INFO] DRV(618646,python3.9):2025-04-03-09:27:53.872.994 [svm_mem_statistics.c:140][ascend][curpid:618646,618646][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_P2P_HBM dev0 Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=1343488; alloc_cnt=8; free_cnt=8)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:53.873.013 [svm_mem_statistics.c:146][ascend][curpid:618646,618646][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_P2P_HBM dev0 Cached_size:2097152Bytes
[INFO] DRV(618646,python3.9):2025-04-03-09:27:53.873.031 [svm_mem_statistics.c:140][ascend][curpid:618646,618646][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev0 Mem stats (Bytes). (module_name=UNKNOWN; module_id=0; current_alloced_size=0; alloced_peak_size=2097152; alloc_cnt=1; free_cnt=1)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:53.873.049 [svm_mem_statistics.c:140][ascend][curpid:618646,618646][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev0 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=20971520; alloc_cnt=8; free_cnt=8)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:53.873.068 [svm_mem_statistics.c:140][ascend][curpid:618646,618646][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev0 Mem stats (Bytes). (module_name=APP; module_id=33; current_alloced_size=0; alloced_peak_size=429916160; alloc_cnt=3; free_cnt=3)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:53.873.086 [svm_mem_statistics.c:146][ascend][curpid:618646,618646][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev0 Cached_size:23068672Bytes
[INFO] DRV(618646,python3.9):2025-04-03-09:27:53.873.102 [svm_mem_statistics.c:140][ascend][curpid:618646,618646][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_DDR dev0 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=6291456; alloc_cnt=2; free_cnt=2)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:53.873.121 [svm_mem_statistics.c:146][ascend][curpid:618646,618646][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_DDR dev0 Cached_size:6291456Bytes
[INFO] DRV(618646,python3.9):2025-04-03-09:27:53.873.138 [svm_mem_statistics.c:140][ascend][curpid:618646,618646][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_P2P_HBM dev0 Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=4194304; alloc_cnt=1; free_cnt=1)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:53.873.156 [svm_mem_statistics.c:140][ascend][curpid:618646,618646][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_P2P_HBM dev0 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=12582912; alloc_cnt=5; free_cnt=5)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:53.873.175 [svm_mem_statistics.c:146][ascend][curpid:618646,618646][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_P2P_HBM dev0 Cached_size:16777216Bytes
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:53.892.191 [adx_server_manager.cpp:236][tid:618920] server manager stop
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.924.543 [plugin_old_arch.cc:25] 618666 DestructorRuntimeImpl: RuntimeImpl destructor success
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.924.599 [runtime_keeper.cc:167] 618666 DestoryRuntimeImpl: Destory Runtime success
[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:53.925.418 [task_fail_callback_data_manager.cc:63] 618666 ~TaskFailCallBackManager: Destructor.
[INFO] DRV(618674,python3.9):2025-04-03-09:27:53.934.422 [drv_log_user.c:623][ascend][curpid:618674,618674][drv][devmm][share_log_read_in_single_module]Close logical_device. (logical_devid=7; phyid=7; vfid=0; hostpid=618674; devpid=29919)
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.934.464 [npu_driver.cc:3045] 618674 DeviceClose: Close device success, device_id=7, tsId=0
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:53.934.483 [raw_device.cc:125] 618674 ~Device: deconstruct device
[INFO] DRV(618646,python3.9):2025-04-03-09:27:53.943.211 [drv_log_user.c:623][ascend][curpid:618646,618646][drv][devmm][share_log_read_in_single_module]Close logical_device. (logical_devid=0; phyid=0; vfid=0; hostpid=618646; devpid=31737)
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.943.262 [npu_driver.cc:3045] 618646 DeviceClose: Close device success, device_id=0, tsId=0
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:53.943.279 [raw_device.cc:125] 618646 ~Device: deconstruct device
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:53.990.615 [stacktrace_signal.c:188](tid:618666) unregister all signo sigaction, can not capture signal.
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:54.005.606 [adx_hdc_epoll.cpp:57][tid:618650] start to close hdc epoll
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:54.020.196 [adx_server_manager.cpp:236][tid:618940] server manager stop
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:54.035.034 [adx_hdc_epoll.cpp:57][tid:618658] start to close hdc epoll
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:54.042.389 [plugin_old_arch.cc:25] 618674 DestructorRuntimeImpl: RuntimeImpl destructor success
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:54.042.422 [runtime_keeper.cc:167] 618674 DestoryRuntimeImpl: Destory Runtime success
[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:54.043.369 [task_fail_callback_data_manager.cc:63] 618674 ~TaskFailCallBackManager: Destructor.
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:54.050.130 [adx_hdc_epoll.cpp:57][tid:618654] start to close hdc epoll
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:54.051.515 [plugin_old_arch.cc:25] 618646 DestructorRuntimeImpl: RuntimeImpl destructor success
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:54.051.547 [runtime_keeper.cc:167] 618646 DestoryRuntimeImpl: Destory Runtime success
[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:54.052.658 [task_fail_callback_data_manager.cc:63] 618646 ~TaskFailCallBackManager: Destructor.
[INFO] GE(618650,python3.9):2025-04-03-09:27:54.072.464 [op_impl_registry_holder_manager.cc:31]618650 CloseHandle:start close handle, handle[0xaaab36f5e3e0].
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:54.073.342 [atrace_client_communication.c:141](tid:618666) send [end] msg.
[INFO] DRV(618666,python3.9):2025-04-03-09:27:54.075.143 [hdc_core.c:1982][ascend][curpid:618666,618666][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4203; pid=618666)
[INFO] IDEDD(618666,python3.9):2025-04-03-09:27:54.075.175 [hdc_api.cpp:671][tid:618666] connect succ, peer_node: 0, peer_devid: 5
[INFO] DRV(618666,python3.9):2025-04-03-09:27:54.075.562 [hdc_client.c:417][ascend][curpid:618666,618666][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4203)
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:54.075.634 [atrace_client_communication.c:164](tid:618666) send [end] msg success.
[INFO] GE(618650,python3.9):2025-04-03-09:27:54.080.020 [op_impl_registry_holder_manager.cc:31]618650 CloseHandle:start close handle, handle[0xaaab36f62a10].
[INFO] GE(618650,python3.9):2025-04-03-09:27:54.083.500 [op_impl_registry_holder_manager.cc:31]618650 CloseHandle:start close handle, handle[0xaaab36f8ce90].
[INFO] GE(618650,python3.9):2025-04-03-09:27:54.087.764 [op_impl_registry_holder_manager.cc:31]618650 CloseHandle:start close handle, handle[0xaaab36f5fa20].
[INFO] GE(618650,python3.9):2025-04-03-09:27:54.088.837 [op_impl_registry_holder_manager.cc:31]618650 CloseHandle:start close handle, handle[0xaaab38399010].
[INFO] GE(618650,python3.9):2025-04-03-09:27:54.089.888 [op_impl_registry_holder_manager.cc:31]618650 CloseHandle:start close handle, handle[0xaaab383c1000].
[INFO] GE(618650,python3.9):2025-04-03-09:27:54.091.777 [op_impl_registry_holder_manager.cc:31]618650 CloseHandle:start close handle, handle[0xaaab38484680].
[INFO] GE(618650,python3.9):2025-04-03-09:27:54.110.623 [mem_manager.cc:118]618650 Finalize:MemManager Finalize.
[INFO] GE(618650,python3.9):2025-04-03-09:27:54.110.658 [session_scope_mem_allocator.cc:73]618650 FreeAllMemory:Free all memory
[INFO] GE(618650,python3.9):2025-04-03-09:27:54.113.244 [session_scope_mem_allocator.cc:73]618650 FreeAllMemory:Free all memory
[INFO] GE(618650,python3.9):2025-04-03-09:27:54.113.275 [caching_allocator.cc:474]618650 PrintStatics:Called counts[malloc:          0 free:          0].
[INFO] GE(618650,python3.9):2025-04-03-09:27:54.113.307 [caching_allocator.cc:391]618650 FreeBlocks:Free blocks.
[INFO] GE(618650,python3.9):2025-04-03-09:27:54.113.344 [caching_allocator.cc:358]618650 FreeCachedBlocks:Free cached blocks
[INFO] GE(618650,python3.9):2025-04-03-09:27:54.113.357 [caching_allocator.cc:422]618650 FreeBlockBins:Free block bins.
[INFO] GE(618650,python3.9):2025-04-03-09:27:54.113.371 [caching_allocator.cc:474]618650 PrintStatics:Called counts[malloc:          0 free:          0].
[INFO] GE(618650,python3.9):2025-04-03-09:27:54.113.385 [caching_allocator.cc:391]618650 FreeBlocks:Free blocks.
[INFO] GE(618650,python3.9):2025-04-03-09:27:54.113.397 [caching_allocator.cc:358]618650 FreeCachedBlocks:Free cached blocks
[INFO] GE(618650,python3.9):2025-04-03-09:27:54.113.408 [caching_allocator.cc:422]618650 FreeBlockBins:Free block bins.
[INFO] GE(618650,python3.9):2025-04-03-09:27:54.113.431 [mem_manager.cc:145]618650 ReleaseResource:MemManager ReleaseResource device id = 0.
[INFO] GE(618650,python3.9):2025-04-03-09:27:54.113.451 [rts_caching_mem_allocator.cc:150]618650 ReleaseResource:RtsAllocatorManager ReleaseResource device id:0.
[INFO] GE(618650,python3.9):2025-04-03-09:27:54.113.472 [rts_caching_mem_allocator.cc:136]618650 Finalize:RtsAllocatorManager Finalize.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:54.116.424 [stacktrace_signal.c:188](tid:618646) unregister all signo sigaction, can not capture signal.
[INFO] GE(618658,python3.9):2025-04-03-09:27:54.124.612 [op_impl_registry_holder_manager.cc:31]618658 CloseHandle:start close handle, handle[0xaaab1076dec0].
[INFO] GE(618658,python3.9):2025-04-03-09:27:54.126.591 [op_impl_registry_holder_manager.cc:31]618658 CloseHandle:start close handle, handle[0xaaab107724f0].
[INFO] GE(618658,python3.9):2025-04-03-09:27:54.129.342 [op_impl_registry_holder_manager.cc:31]618658 CloseHandle:start close handle, handle[0xaaab1079c970].
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:54.131.955 [stacktrace_signal.c:188](tid:618674) unregister all signo sigaction, can not capture signal.
[INFO] GE(618658,python3.9):2025-04-03-09:27:54.134.137 [op_impl_registry_holder_manager.cc:31]618658 CloseHandle:start close handle, handle[0xaaab1076f500].
[INFO] GE(618658,python3.9):2025-04-03-09:27:54.135.105 [op_impl_registry_holder_manager.cc:31]618658 CloseHandle:start close handle, handle[0xaaab11ba8af0].
[INFO] GE(618658,python3.9):2025-04-03-09:27:54.136.041 [op_impl_registry_holder_manager.cc:31]618658 CloseHandle:start close handle, handle[0xaaab11bd0ae0].
[INFO] GE(618658,python3.9):2025-04-03-09:27:54.137.364 [op_impl_registry_holder_manager.cc:31]618658 CloseHandle:start close handle, handle[0xaaab11c94160].
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:54.139.434 [adx_hdc_epoll.cpp:57][tid:618670] start to close hdc epoll
[INFO] GE(618654,python3.9):2025-04-03-09:27:54.145.358 [op_impl_registry_holder_manager.cc:31]618654 CloseHandle:start close handle, handle[0xaaaafad34bd0].
[INFO] GE(618654,python3.9):2025-04-03-09:27:54.147.488 [op_impl_registry_holder_manager.cc:31]618654 CloseHandle:start close handle, handle[0xaaaafad39200].
[INFO] GE(618654,python3.9):2025-04-03-09:27:54.150.373 [op_impl_registry_holder_manager.cc:31]618654 CloseHandle:start close handle, handle[0xaaaafad63680].
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:54.150.485 [atrace_client_communication.c:141](tid:618674) send [end] msg.
[INFO] GE(618654,python3.9):2025-04-03-09:27:54.154.851 [op_impl_registry_holder_manager.cc:31]618654 CloseHandle:start close handle, handle[0xaaaafad36210].
[INFO] GE(618658,python3.9):2025-04-03-09:27:54.155.438 [mem_manager.cc:118]618658 Finalize:MemManager Finalize.
[INFO] GE(618658,python3.9):2025-04-03-09:27:54.155.479 [session_scope_mem_allocator.cc:73]618658 FreeAllMemory:Free all memory
[INFO] GE(618654,python3.9):2025-04-03-09:27:54.155.797 [op_impl_registry_holder_manager.cc:31]618654 CloseHandle:start close handle, handle[0xaaaafc16f800].
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:54.155.971 [adx_hdc_epoll.cpp:57][tid:618662] start to close hdc epoll
[INFO] GE(618654,python3.9):2025-04-03-09:27:54.156.775 [op_impl_registry_holder_manager.cc:31]618654 CloseHandle:start close handle, handle[0xaaaafc1977f0].
[INFO] GE(618654,python3.9):2025-04-03-09:27:54.158.146 [op_impl_registry_holder_manager.cc:31]618654 CloseHandle:start close handle, handle[0xaaaafc25ae70].
[INFO] DRV(618674,python3.9):2025-04-03-09:27:54.158.465 [hdc_core.c:1982][ascend][curpid:618674,618674][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4204; pid=618674)
[INFO] IDEDD(618674,python3.9):2025-04-03-09:27:54.158.504 [hdc_api.cpp:671][tid:618674] connect succ, peer_node: 0, peer_devid: 7
[INFO] DRV(618674,python3.9):2025-04-03-09:27:54.158.596 [hdc_client.c:417][ascend][curpid:618674,618674][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4204)
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:54.158.670 [atrace_client_communication.c:164](tid:618674) send [end] msg success.
[INFO] GE(618658,python3.9):2025-04-03-09:27:54.161.065 [session_scope_mem_allocator.cc:73]618658 FreeAllMemory:Free all memory
[INFO] GE(618658,python3.9):2025-04-03-09:27:54.161.097 [caching_allocator.cc:474]618658 PrintStatics:Called counts[malloc:          0 free:          0].
[INFO] GE(618658,python3.9):2025-04-03-09:27:54.161.136 [caching_allocator.cc:391]618658 FreeBlocks:Free blocks.
[INFO] GE(618658,python3.9):2025-04-03-09:27:54.161.154 [caching_allocator.cc:358]618658 FreeCachedBlocks:Free cached blocks
[INFO] GE(618658,python3.9):2025-04-03-09:27:54.161.166 [caching_allocator.cc:422]618658 FreeBlockBins:Free block bins.
[INFO] GE(618658,python3.9):2025-04-03-09:27:54.161.180 [caching_allocator.cc:474]618658 PrintStatics:Called counts[malloc:          0 free:          0].
[INFO] GE(618658,python3.9):2025-04-03-09:27:54.161.194 [caching_allocator.cc:391]618658 FreeBlocks:Free blocks.
[INFO] GE(618658,python3.9):2025-04-03-09:27:54.161.206 [caching_allocator.cc:358]618658 FreeCachedBlocks:Free cached blocks
[INFO] GE(618658,python3.9):2025-04-03-09:27:54.161.218 [caching_allocator.cc:422]618658 FreeBlockBins:Free block bins.
[INFO] GE(618658,python3.9):2025-04-03-09:27:54.161.241 [mem_manager.cc:145]618658 ReleaseResource:MemManager ReleaseResource device id = 0.
[INFO] GE(618658,python3.9):2025-04-03-09:27:54.161.260 [rts_caching_mem_allocator.cc:150]618658 ReleaseResource:RtsAllocatorManager ReleaseResource device id:0.
[INFO] GE(618658,python3.9):2025-04-03-09:27:54.161.308 [rts_caching_mem_allocator.cc:136]618658 Finalize:RtsAllocatorManager Finalize.
[INFO] GE(618654,python3.9):2025-04-03-09:27:54.178.360 [mem_manager.cc:118]618654 Finalize:MemManager Finalize.
[INFO] GE(618654,python3.9):2025-04-03-09:27:54.178.395 [session_scope_mem_allocator.cc:73]618654 FreeAllMemory:Free all memory
[INFO] GE(618654,python3.9):2025-04-03-09:27:54.180.688 [session_scope_mem_allocator.cc:73]618654 FreeAllMemory:Free all memory
[INFO] GE(618654,python3.9):2025-04-03-09:27:54.180.721 [caching_allocator.cc:474]618654 PrintStatics:Called counts[malloc:          0 free:          0].
[INFO] GE(618654,python3.9):2025-04-03-09:27:54.180.758 [caching_allocator.cc:391]618654 FreeBlocks:Free blocks.
[INFO] GE(618654,python3.9):2025-04-03-09:27:54.180.776 [caching_allocator.cc:358]618654 FreeCachedBlocks:Free cached blocks
[INFO] GE(618654,python3.9):2025-04-03-09:27:54.180.788 [caching_allocator.cc:422]618654 FreeBlockBins:Free block bins.
[INFO] GE(618654,python3.9):2025-04-03-09:27:54.180.801 [caching_allocator.cc:474]618654 PrintStatics:Called counts[malloc:          0 free:          0].
[INFO] GE(618654,python3.9):2025-04-03-09:27:54.180.816 [caching_allocator.cc:391]618654 FreeBlocks:Free blocks.
[INFO] GE(618654,python3.9):2025-04-03-09:27:54.180.828 [caching_allocator.cc:358]618654 FreeCachedBlocks:Free cached blocks
[INFO] GE(618654,python3.9):2025-04-03-09:27:54.180.839 [caching_allocator.cc:422]618654 FreeBlockBins:Free block bins.
[INFO] GE(618654,python3.9):2025-04-03-09:27:54.180.869 [mem_manager.cc:145]618654 ReleaseResource:MemManager ReleaseResource device id = 0.
[INFO] GE(618654,python3.9):2025-04-03-09:27:54.180.891 [rts_caching_mem_allocator.cc:150]618654 ReleaseResource:RtsAllocatorManager ReleaseResource device id:0.
[INFO] GE(618654,python3.9):2025-04-03-09:27:54.180.950 [rts_caching_mem_allocator.cc:136]618654 Finalize:RtsAllocatorManager Finalize.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:54.201.977 [network_manager.cc:875] [618650]destroy all nic/vnic.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:54.202.033 [network_manager.cc:875] [618650]destroy all nic/vnic.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:54.202.047 [network_manager.cc:875] [618650]destroy all nic/vnic.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:54.202.059 [network_manager.cc:875] [618650]destroy all nic/vnic.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:54.202.073 [network_manager.cc:875] [618650]destroy all nic/vnic.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:54.202.083 [network_manager.cc:875] [618650]destroy all nic/vnic.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:54.202.094 [network_manager.cc:875] [618650]destroy all nic/vnic.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:54.202.105 [network_manager.cc:875] [618650]destroy all nic/vnic.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:54.202.120 [network_manager.cc:875] [618650]destroy all nic/vnic.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:54.202.131 [network_manager.cc:875] [618650]destroy all nic/vnic.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:54.202.142 [network_manager.cc:875] [618650]destroy all nic/vnic.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:54.202.155 [network_manager.cc:875] [618650]destroy all nic/vnic.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:54.202.170 [network_manager.cc:875] [618650]destroy all nic/vnic.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:54.202.182 [network_manager.cc:875] [618650]destroy all nic/vnic.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:54.202.193 [network_manager.cc:875] [618650]destroy all nic/vnic.
[INFO] HCCL(618650,python3.9):2025-04-03-09:27:54.202.207 [network_manager.cc:875] [618650]destroy all nic/vnic.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.208.105 [runtime.cc:1570] 618650 ~Runtime: deconstruct runtime
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.208.140 [runtime.cc:1577] 618650 ~Runtime: wait monitor success, use=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.208.615 [raw_device.cc:262] 618650 SetDevProfStatus: devProfStatus_=0, profConfigType=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.208.681 [engine.cc:188] 618650 SubmitTaskNormal: stream_id=0,task_id=5,task_type=83 (DEVICE_RINGBUFFER_CONTROL).
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.208.710 [ringbuffer_maintain_task.cc:83] 618650 ConstructSqeForRingBufferMaintainTask: RingBufferMaintainTask stream_id:0, task_id:5
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.208.728 [stream.cc:1400] 618650 AddTaskToList: public task, stream_id=0, task_id=5, task_type=83 (DEVICE_RINGBUFFER_CONTROL), head=5, tail=6
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.208.745 [stream.cc:2595] 618650 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=5, type=83(DEVICE_RINGBUFFER_CONTROL), head=5, tail=6, sqe_num=1, lastTail=5, device_id=1
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.208.792 [npu_driver.cc:751] 618650 SqTaskSend: device_id=1, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.208.808 [stars_engine.cc:893] 618650 SendTask: Sq task send finished, device_id=1, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=5, task_type=83(DEVICE_RINGBUFFER_CONTROL).
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.208.826 [stream.cc:1494] 618650 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=5.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.208.847 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=0, head=5.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.208.859 [stream.cc:2886] 618650 StarsWaitForTask: No.0 stream_id=0, taskId=5, currentId=4
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.208.878 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=0, head=5.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.208.890 [stream.cc:2886] 618650 StarsWaitForTask: No.1 stream_id=0, taskId=5, currentId=4
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.208.903 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=0, head=6.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.208.919 [task.cc:185] 618650 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.208.936 [task.cc:185] 618650 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.208.952 [logger.cc:152] 618650 TaskFinished: device_id=1, stream_id=0, task_id=5, task_type=83 (DEVICE_RINGBUFFER_CONTROL), task_finish_num=16
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.208.977 [stars_engine.cc:437] 618650 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=5, sqHead=6, endTaskId=5, recycleTaskId=5.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.208.994 [stream.cc:2886] 618650 StarsWaitForTask: No.2 stream_id=0, taskId=5, currentId=5
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.209.010 [stars_engine.cc:524] 618650 TaskReclaim: Travel all streams, num=2.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.209.027 [npu_driver.cc:5547] 618650 GetSqHead: deviceId=1, tsId=0, sqId=0, head=6.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.209.045 [stream.cc:852] 618650 TearDown: stream_id=0, sqId=0, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.209.062 [stream.cc:938] 618650 TearDown: stream_id=0, delay recycle task num=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.209.074 [stream.cc:1507] 618650 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.212.438 [stream_sqcq_manage.cc:451] 618650 FreeLogicCq: Return(0), threadIdentifier(281473891839456), devId(1), tsId(0), cqId(401), isFastCq(0).
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.212.482 [npu_driver.cc:6163] 618650 StreamUnBindLogicCq: success: deviceId=1, tsId=0, streamId=0, logicCq=401.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.212.548 [npu_driver.cc:1180] 618650 LogicCqFree: Succ:device_id=1,ts_id=0,type=2,logic_cq_id=401, drvFlag=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.212.568 [stream.cc:237] 618650 FreeStreamId: Free stream_id=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.212.586 [stream_sqcq_manage.cc:216] 618650 DeAllocStreamSqCq: deviceId=1, tsId=0, drvFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.212.601 [npu_driver.cc:966] 618650 NormalSqCqFree: Normal sqcq free, sqId=0, cqId=0, device_id=1, tsId=0, drvFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.213.248 [npu_driver.cc:974] 618650 NormalSqCqFree: Normal sqcq free success, sqId=0, cqId=0, device_id=1, tsId=0, drvFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.213.269 [stream_sqcq_manage.cc:228] 618650 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=0, cq_id=0, stream_id=0, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.213.302 [npu_driver.cc:432] 618650 StreamIdFree: stream id free begin, device_id=1, stream_id=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.213.321 [npu_driver.cc:441] 618650 StreamIdFree: Stream id free success, stream_id=0, device_id=1, tsId=0, streamFlag=192
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.213.468 [stars_engine.cc:206] 618827 RecycleThreadRun: RecycleThreadRun thread leave.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.213.627 [stars_engine.cc:191] 618650 DestroyRecycleThread: Stars engine joined recycle thread OK.
[WARNING] RUNTIME(618650,python3.9):2025-04-03-09:27:54.213.648 [osal.cc:225] 618650 Join: mmJoinTask failed, thread=281472228614048 does not exist!
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.213.663 [stars_engine.cc:150] 618650 Stop: Startsengine joined monitor thread OK.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.213.688 [runtime.cc:5239] 618650 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
[INFO] TDT(618650,python3.9):2025-04-03-09:27:54.213.707 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618650] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.213.723 [runtime.cc:3003] 618650 StopAicpuExecutor: TsdClose success, userDeviceId=1, devId=1, tdt status=0
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:54.213.742 [atrace_api.c:118](tid:618650) AtraceDestroy start.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:54.213.764 [tracer_mgr_operate.c:248](tid:618650) destroy object RUNTIME_ATRACE_DEV1_TS0, exitSave(false).
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:54.213.786 [atrace_api.c:120](tid:618650) AtraceDestroy end.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.213.807 [stream.cc:237] 618650 FreeStreamId: Free stream_id=1.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.213.823 [stream_sqcq_manage.cc:216] 618650 DeAllocStreamSqCq: deviceId=1, tsId=0, drvFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.213.835 [npu_driver.cc:966] 618650 NormalSqCqFree: Normal sqcq free, sqId=1, cqId=1, device_id=1, tsId=0, drvFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.214.050 [npu_driver.cc:974] 618650 NormalSqCqFree: Normal sqcq free success, sqId=1, cqId=1, device_id=1, tsId=0, drvFlag=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.214.068 [stream_sqcq_manage.cc:228] 618650 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=1, cq_id=1, stream_id=1, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.214.084 [npu_driver.cc:432] 618650 StreamIdFree: stream id free begin, device_id=1, stream_id=1, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.214.102 [npu_driver.cc:441] 618650 StreamIdFree: Stream id free success, stream_id=1, device_id=1, tsId=0, streamFlag=0
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:54.214.482 [atrace_client_communication.c:141](tid:618646) send [end] msg.
[INFO] DRV(618646,python3.9):2025-04-03-09:27:54.215.898 [hdc_core.c:1982][ascend][curpid:618646,618646][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4205; pid=618646)
[INFO] IDEDD(618646,python3.9):2025-04-03-09:27:54.215.930 [hdc_api.cpp:671][tid:618646] connect succ, peer_node: 0, peer_devid: 0
[INFO] DRV(618646,python3.9):2025-04-03-09:27:54.217.416 [hdc_client.c:417][ascend][curpid:618646,618646][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4205)
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:54.217.489 [atrace_client_communication.c:164](tid:618646) send [end] msg success.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.230.275 [stars_engine.cc:58] 618650 ~StarsEngine: Destructor.
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.230.305 [engine.cc:84] 618650 ~Engine: Destructor.
[INFO] DRV(618650,python3.9):2025-04-03-09:27:54.231.393 [trs_dev_drv.c:370][ascend][curpid:618650,618650][drv][tsdrv][drvDeviceCloseComm]Close success. (devid=1; fd=36; mmapFd=37)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:54.231.420 [devmm_svm.c:2238][ascend][curpid:618650,618650][drv][devmm][drvMemDeviceCloseInner]DrvMemDeviceClose. (devid=1)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:54.231.440 [svm_mem_statistics.c:140][ascend][curpid:618650,618650][drv][devmm][_svm_mem_stats_show]SVM_MEM Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=2965372928; alloc_cnt=7; free_cnt=7)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:54.231.463 [svm_mem_statistics.c:140][ascend][curpid:618650,618650][drv][devmm][_svm_mem_stats_show]HOST_MEM Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=4096; alloc_cnt=2; free_cnt=2)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:54.231.491 [svm_mem_statistics.c:140][ascend][curpid:618650,618650][drv][devmm][_svm_mem_stats_show]HOST_MEM Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=11341824; alloc_cnt=3; free_cnt=3)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:54.231.513 [svm_mem_statistics.c:146][ascend][curpid:618650,618650][drv][devmm][_svm_mem_stats_show]HOST_MEM Cached_size:12582912Bytes
[INFO] DRV(618650,python3.9):2025-04-03-09:27:54.231.529 [svm_mem_statistics.c:140][ascend][curpid:618650,618650][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_HBM dev1 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=94208; alloc_cnt=10; free_cnt=10)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:54.231.549 [svm_mem_statistics.c:140][ascend][curpid:618650,618650][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_HBM dev1 Mem stats (Bytes). (module_name=APP; module_id=33; current_alloced_size=135168; alloced_peak_size=135168; alloc_cnt=1; free_cnt=0)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:54.231.566 [svm_mem_statistics.c:146][ascend][curpid:618650,618650][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_HBM dev1 Cached_size:1961984Bytes
[INFO] DRV(618650,python3.9):2025-04-03-09:27:54.231.583 [svm_mem_statistics.c:140][ascend][curpid:618650,618650][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_DDR dev1 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=16384; alloc_cnt=1; free_cnt=1)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:54.231.601 [svm_mem_statistics.c:146][ascend][curpid:618650,618650][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_DDR dev1 Cached_size:2097152Bytes
[INFO] DRV(618650,python3.9):2025-04-03-09:27:54.231.618 [svm_mem_statistics.c:140][ascend][curpid:618650,618650][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_P2P_HBM dev1 Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=1343488; alloc_cnt=8; free_cnt=8)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:54.231.636 [svm_mem_statistics.c:146][ascend][curpid:618650,618650][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_P2P_HBM dev1 Cached_size:2097152Bytes
[INFO] DRV(618650,python3.9):2025-04-03-09:27:54.231.656 [svm_mem_statistics.c:140][ascend][curpid:618650,618650][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev1 Mem stats (Bytes). (module_name=UNKNOWN; module_id=0; current_alloced_size=0; alloced_peak_size=2097152; alloc_cnt=1; free_cnt=1)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:54.231.674 [svm_mem_statistics.c:140][ascend][curpid:618650,618650][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev1 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=20971520; alloc_cnt=8; free_cnt=8)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:54.231.691 [svm_mem_statistics.c:140][ascend][curpid:618650,618650][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev1 Mem stats (Bytes). (module_name=APP; module_id=33; current_alloced_size=0; alloced_peak_size=429916160; alloc_cnt=3; free_cnt=3)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:54.231.711 [svm_mem_statistics.c:146][ascend][curpid:618650,618650][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev1 Cached_size:23068672Bytes
[INFO] DRV(618650,python3.9):2025-04-03-09:27:54.231.724 [svm_mem_statistics.c:140][ascend][curpid:618650,618650][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_DDR dev1 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=6291456; alloc_cnt=2; free_cnt=2)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:54.231.745 [svm_mem_statistics.c:146][ascend][curpid:618650,618650][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_DDR dev1 Cached_size:6291456Bytes
[INFO] DRV(618650,python3.9):2025-04-03-09:27:54.231.759 [svm_mem_statistics.c:140][ascend][curpid:618650,618650][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_P2P_HBM dev1 Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=4194304; alloc_cnt=1; free_cnt=1)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:54.231.785 [svm_mem_statistics.c:140][ascend][curpid:618650,618650][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_P2P_HBM dev1 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=12582912; alloc_cnt=5; free_cnt=5)
[INFO] DRV(618650,python3.9):2025-04-03-09:27:54.231.803 [svm_mem_statistics.c:146][ascend][curpid:618650,618650][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_P2P_HBM dev1 Cached_size:16777216Bytes
[INFO] GE(618662,python3.9):2025-04-03-09:27:54.249.035 [op_impl_registry_holder_manager.cc:31]618662 CloseHandle:start close handle, handle[0xaaab0e2c3380].
[INFO] GE(618670,python3.9):2025-04-03-09:27:54.250.797 [op_impl_registry_holder_manager.cc:31]618670 CloseHandle:start close handle, handle[0xaaaadf62f610].
[INFO] GE(618662,python3.9):2025-04-03-09:27:54.254.290 [op_impl_registry_holder_manager.cc:31]618662 CloseHandle:start close handle, handle[0xaaab0e2c79b0].
[INFO] GE(618670,python3.9):2025-04-03-09:27:54.255.996 [op_impl_registry_holder_manager.cc:31]618670 CloseHandle:start close handle, handle[0xaaaadf633c40].
[INFO] GE(618662,python3.9):2025-04-03-09:27:54.257.126 [op_impl_registry_holder_manager.cc:31]618662 CloseHandle:start close handle, handle[0xaaab0e2f1e30].
[INFO] GE(618670,python3.9):2025-04-03-09:27:54.258.741 [op_impl_registry_holder_manager.cc:31]618670 CloseHandle:start close handle, handle[0xaaaadf65e0c0].
[INFO] GE(618662,python3.9):2025-04-03-09:27:54.260.825 [op_impl_registry_holder_manager.cc:31]618662 CloseHandle:start close handle, handle[0xaaab0e2c49c0].
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:54.261.246 [network_manager.cc:875] [618658]destroy all nic/vnic.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:54.261.284 [network_manager.cc:875] [618658]destroy all nic/vnic.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:54.261.294 [network_manager.cc:875] [618658]destroy all nic/vnic.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:54.261.312 [network_manager.cc:875] [618658]destroy all nic/vnic.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:54.261.326 [network_manager.cc:875] [618658]destroy all nic/vnic.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:54.261.342 [network_manager.cc:875] [618658]destroy all nic/vnic.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:54.261.355 [network_manager.cc:875] [618658]destroy all nic/vnic.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:54.261.370 [network_manager.cc:875] [618658]destroy all nic/vnic.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:54.261.382 [network_manager.cc:875] [618658]destroy all nic/vnic.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:54.261.394 [network_manager.cc:875] [618658]destroy all nic/vnic.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:54.261.407 [network_manager.cc:875] [618658]destroy all nic/vnic.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:54.261.419 [network_manager.cc:875] [618658]destroy all nic/vnic.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:54.261.431 [network_manager.cc:875] [618658]destroy all nic/vnic.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:54.261.443 [network_manager.cc:875] [618658]destroy all nic/vnic.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:54.261.455 [network_manager.cc:875] [618658]destroy all nic/vnic.
[INFO] HCCL(618658,python3.9):2025-04-03-09:27:54.261.467 [network_manager.cc:875] [618658]destroy all nic/vnic.
[INFO] GE(618662,python3.9):2025-04-03-09:27:54.261.818 [op_impl_registry_holder_manager.cc:31]618662 CloseHandle:start close handle, handle[0xaaab0f6fdfb0].
[INFO] GE(618662,python3.9):2025-04-03-09:27:54.262.771 [op_impl_registry_holder_manager.cc:31]618662 CloseHandle:start close handle, handle[0xaaab0f725fa0].
[INFO] GE(618670,python3.9):2025-04-03-09:27:54.264.018 [op_impl_registry_holder_manager.cc:31]618670 CloseHandle:start close handle, handle[0xaaaadf630c50].
[INFO] GE(618662,python3.9):2025-04-03-09:27:54.264.048 [op_impl_registry_holder_manager.cc:31]618662 CloseHandle:start close handle, handle[0xaaab0f7e9620].
[INFO] GE(618670,python3.9):2025-04-03-09:27:54.264.963 [op_impl_registry_holder_manager.cc:31]618670 CloseHandle:start close handle, handle[0xaaaae0a6a240].
[INFO] GE(618670,python3.9):2025-04-03-09:27:54.265.883 [op_impl_registry_holder_manager.cc:31]618670 CloseHandle:start close handle, handle[0xaaaae0a92230].
[INFO] GE(618670,python3.9):2025-04-03-09:27:54.267.146 [op_impl_registry_holder_manager.cc:31]618670 CloseHandle:start close handle, handle[0xaaaae0b558b0].
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.267.635 [runtime.cc:1570] 618658 ~Runtime: deconstruct runtime
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.267.670 [runtime.cc:1577] 618658 ~Runtime: wait monitor success, use=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.268.474 [raw_device.cc:262] 618658 SetDevProfStatus: devProfStatus_=0, profConfigType=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.268.569 [engine.cc:188] 618658 SubmitTaskNormal: stream_id=0,task_id=5,task_type=83 (DEVICE_RINGBUFFER_CONTROL).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.268.602 [ringbuffer_maintain_task.cc:83] 618658 ConstructSqeForRingBufferMaintainTask: RingBufferMaintainTask stream_id:0, task_id:5
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.268.621 [stream.cc:1400] 618658 AddTaskToList: public task, stream_id=0, task_id=5, task_type=83 (DEVICE_RINGBUFFER_CONTROL), head=5, tail=6
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.268.641 [stream.cc:2595] 618658 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=5, type=83(DEVICE_RINGBUFFER_CONTROL), head=5, tail=6, sqe_num=1, lastTail=5, device_id=3
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.268.687 [npu_driver.cc:751] 618658 SqTaskSend: device_id=3, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.268.705 [stars_engine.cc:893] 618658 SendTask: Sq task send finished, device_id=3, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=5, task_type=83(DEVICE_RINGBUFFER_CONTROL).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.268.726 [stream.cc:1494] 618658 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=5.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.268.746 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=0, head=5.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.268.766 [stream.cc:2886] 618658 StarsWaitForTask: No.0 stream_id=0, taskId=5, currentId=4
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.268.783 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=0, head=6.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.268.801 [task.cc:185] 618658 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.268.819 [task.cc:185] 618658 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.268.838 [logger.cc:152] 618658 TaskFinished: device_id=3, stream_id=0, task_id=5, task_type=83 (DEVICE_RINGBUFFER_CONTROL), task_finish_num=16
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.268.864 [stars_engine.cc:437] 618658 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=5, sqHead=6, endTaskId=5, recycleTaskId=5.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.268.882 [stream.cc:2886] 618658 StarsWaitForTask: No.1 stream_id=0, taskId=5, currentId=5
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.268.898 [stars_engine.cc:524] 618658 TaskReclaim: Travel all streams, num=2.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.268.913 [npu_driver.cc:5547] 618658 GetSqHead: deviceId=3, tsId=0, sqId=0, head=6.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.268.937 [stream.cc:852] 618658 TearDown: stream_id=0, sqId=0, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.268.956 [stream.cc:938] 618658 TearDown: stream_id=0, delay recycle task num=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.268.969 [stream.cc:1507] 618658 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.272.936 [stream_sqcq_manage.cc:451] 618658 FreeLogicCq: Return(0), threadIdentifier(281473716280800), devId(3), tsId(0), cqId(1039), isFastCq(0).
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.272.983 [npu_driver.cc:6163] 618658 StreamUnBindLogicCq: success: deviceId=3, tsId=0, streamId=0, logicCq=1039.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.273.079 [npu_driver.cc:1180] 618658 LogicCqFree: Succ:device_id=3,ts_id=0,type=2,logic_cq_id=1039, drvFlag=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.273.100 [stream.cc:237] 618658 FreeStreamId: Free stream_id=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.273.115 [stream_sqcq_manage.cc:216] 618658 DeAllocStreamSqCq: deviceId=3, tsId=0, drvFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.273.142 [npu_driver.cc:966] 618658 NormalSqCqFree: Normal sqcq free, sqId=0, cqId=0, device_id=3, tsId=0, drvFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.273.765 [npu_driver.cc:974] 618658 NormalSqCqFree: Normal sqcq free success, sqId=0, cqId=0, device_id=3, tsId=0, drvFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.273.788 [stream_sqcq_manage.cc:228] 618658 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=0, cq_id=0, stream_id=0, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.273.808 [npu_driver.cc:432] 618658 StreamIdFree: stream id free begin, device_id=3, stream_id=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.273.829 [npu_driver.cc:441] 618658 StreamIdFree: Stream id free success, stream_id=0, device_id=3, tsId=0, streamFlag=192
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.274.003 [stars_engine.cc:206] 618773 RecycleThreadRun: RecycleThreadRun thread leave.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.274.145 [stars_engine.cc:191] 618658 DestroyRecycleThread: Stars engine joined recycle thread OK.
[WARNING] RUNTIME(618658,python3.9):2025-04-03-09:27:54.274.164 [osal.cc:225] 618658 Join: mmJoinTask failed, thread=281472095326112 does not exist!
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.274.177 [stars_engine.cc:150] 618658 Stop: Startsengine joined monitor thread OK.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.274.214 [runtime.cc:5239] 618658 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
[INFO] TDT(618658,python3.9):2025-04-03-09:27:54.274.236 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618658] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.274.255 [runtime.cc:3003] 618658 StopAicpuExecutor: TsdClose success, userDeviceId=3, devId=3, tdt status=0
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:54.274.273 [atrace_api.c:118](tid:618658) AtraceDestroy start.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:54.274.295 [tracer_mgr_operate.c:248](tid:618658) destroy object RUNTIME_ATRACE_DEV3_TS0, exitSave(false).
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:54.274.315 [atrace_api.c:120](tid:618658) AtraceDestroy end.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.274.338 [stream.cc:237] 618658 FreeStreamId: Free stream_id=1.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.274.355 [stream_sqcq_manage.cc:216] 618658 DeAllocStreamSqCq: deviceId=3, tsId=0, drvFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.274.367 [npu_driver.cc:966] 618658 NormalSqCqFree: Normal sqcq free, sqId=1, cqId=1, device_id=3, tsId=0, drvFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.274.585 [npu_driver.cc:974] 618658 NormalSqCqFree: Normal sqcq free success, sqId=1, cqId=1, device_id=3, tsId=0, drvFlag=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.274.606 [stream_sqcq_manage.cc:228] 618658 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=1, cq_id=1, stream_id=1, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.274.623 [npu_driver.cc:432] 618658 StreamIdFree: stream id free begin, device_id=3, stream_id=1, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.274.639 [npu_driver.cc:441] 618658 StreamIdFree: Stream id free success, stream_id=1, device_id=3, tsId=0, streamFlag=0
[INFO] GE(618662,python3.9):2025-04-03-09:27:54.281.781 [mem_manager.cc:118]618662 Finalize:MemManager Finalize.
[INFO] GE(618662,python3.9):2025-04-03-09:27:54.281.823 [session_scope_mem_allocator.cc:73]618662 FreeAllMemory:Free all memory
[INFO] GE(618662,python3.9):2025-04-03-09:27:54.284.491 [session_scope_mem_allocator.cc:73]618662 FreeAllMemory:Free all memory
[INFO] GE(618662,python3.9):2025-04-03-09:27:54.284.521 [caching_allocator.cc:474]618662 PrintStatics:Called counts[malloc:          0 free:          0].
[INFO] GE(618662,python3.9):2025-04-03-09:27:54.284.553 [caching_allocator.cc:391]618662 FreeBlocks:Free blocks.
[INFO] GE(618662,python3.9):2025-04-03-09:27:54.284.567 [caching_allocator.cc:358]618662 FreeCachedBlocks:Free cached blocks
[INFO] GE(618662,python3.9):2025-04-03-09:27:54.284.576 [caching_allocator.cc:422]618662 FreeBlockBins:Free block bins.
[INFO] GE(618662,python3.9):2025-04-03-09:27:54.284.587 [caching_allocator.cc:474]618662 PrintStatics:Called counts[malloc:          0 free:          0].
[INFO] GE(618662,python3.9):2025-04-03-09:27:54.284.598 [caching_allocator.cc:391]618662 FreeBlocks:Free blocks.
[INFO] GE(618662,python3.9):2025-04-03-09:27:54.284.607 [caching_allocator.cc:358]618662 FreeCachedBlocks:Free cached blocks
[INFO] GE(618662,python3.9):2025-04-03-09:27:54.284.615 [caching_allocator.cc:422]618662 FreeBlockBins:Free block bins.
[INFO] GE(618662,python3.9):2025-04-03-09:27:54.284.638 [mem_manager.cc:145]618662 ReleaseResource:MemManager ReleaseResource device id = 0.
[INFO] GE(618662,python3.9):2025-04-03-09:27:54.284.653 [rts_caching_mem_allocator.cc:150]618662 ReleaseResource:RtsAllocatorManager ReleaseResource device id:0.
[INFO] GE(618662,python3.9):2025-04-03-09:27:54.284.700 [rts_caching_mem_allocator.cc:136]618662 Finalize:RtsAllocatorManager Finalize.
[INFO] GE(618670,python3.9):2025-04-03-09:27:54.288.001 [mem_manager.cc:118]618670 Finalize:MemManager Finalize.
[INFO] GE(618670,python3.9):2025-04-03-09:27:54.288.042 [session_scope_mem_allocator.cc:73]618670 FreeAllMemory:Free all memory
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.288.808 [stars_engine.cc:58] 618658 ~StarsEngine: Destructor.
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.288.839 [engine.cc:84] 618658 ~Engine: Destructor.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:54.289.733 [trs_dev_drv.c:370][ascend][curpid:618658,618658][drv][tsdrv][drvDeviceCloseComm]Close success. (devid=3; fd=36; mmapFd=37)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:54.289.761 [devmm_svm.c:2238][ascend][curpid:618658,618658][drv][devmm][drvMemDeviceCloseInner]DrvMemDeviceClose. (devid=3)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:54.289.797 [svm_mem_statistics.c:140][ascend][curpid:618658,618658][drv][devmm][_svm_mem_stats_show]SVM_MEM Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=2965372928; alloc_cnt=7; free_cnt=7)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:54.289.820 [svm_mem_statistics.c:140][ascend][curpid:618658,618658][drv][devmm][_svm_mem_stats_show]HOST_MEM Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=4096; alloc_cnt=2; free_cnt=2)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:54.289.841 [svm_mem_statistics.c:140][ascend][curpid:618658,618658][drv][devmm][_svm_mem_stats_show]HOST_MEM Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=11341824; alloc_cnt=3; free_cnt=3)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:54.289.862 [svm_mem_statistics.c:146][ascend][curpid:618658,618658][drv][devmm][_svm_mem_stats_show]HOST_MEM Cached_size:12582912Bytes
[INFO] DRV(618658,python3.9):2025-04-03-09:27:54.289.875 [svm_mem_statistics.c:140][ascend][curpid:618658,618658][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_HBM dev3 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=94208; alloc_cnt=10; free_cnt=10)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:54.289.892 [svm_mem_statistics.c:140][ascend][curpid:618658,618658][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_HBM dev3 Mem stats (Bytes). (module_name=APP; module_id=33; current_alloced_size=135168; alloced_peak_size=135168; alloc_cnt=1; free_cnt=0)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:54.289.912 [svm_mem_statistics.c:146][ascend][curpid:618658,618658][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_HBM dev3 Cached_size:1961984Bytes
[INFO] DRV(618658,python3.9):2025-04-03-09:27:54.289.925 [svm_mem_statistics.c:140][ascend][curpid:618658,618658][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_DDR dev3 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=16384; alloc_cnt=1; free_cnt=1)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:54.289.945 [svm_mem_statistics.c:146][ascend][curpid:618658,618658][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_DDR dev3 Cached_size:2097152Bytes
[INFO] DRV(618658,python3.9):2025-04-03-09:27:54.289.958 [svm_mem_statistics.c:140][ascend][curpid:618658,618658][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_P2P_HBM dev3 Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=1343488; alloc_cnt=8; free_cnt=8)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:54.289.979 [svm_mem_statistics.c:146][ascend][curpid:618658,618658][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_P2P_HBM dev3 Cached_size:2097152Bytes
[INFO] DRV(618658,python3.9):2025-04-03-09:27:54.289.994 [svm_mem_statistics.c:140][ascend][curpid:618658,618658][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev3 Mem stats (Bytes). (module_name=UNKNOWN; module_id=0; current_alloced_size=0; alloced_peak_size=2097152; alloc_cnt=1; free_cnt=1)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:54.290.013 [svm_mem_statistics.c:140][ascend][curpid:618658,618658][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev3 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=20971520; alloc_cnt=8; free_cnt=8)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:54.290.034 [svm_mem_statistics.c:140][ascend][curpid:618658,618658][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev3 Mem stats (Bytes). (module_name=APP; module_id=33; current_alloced_size=0; alloced_peak_size=429916160; alloc_cnt=3; free_cnt=3)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:54.290.053 [svm_mem_statistics.c:146][ascend][curpid:618658,618658][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev3 Cached_size:23068672Bytes
[INFO] DRV(618658,python3.9):2025-04-03-09:27:54.290.067 [svm_mem_statistics.c:140][ascend][curpid:618658,618658][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_DDR dev3 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=6291456; alloc_cnt=2; free_cnt=2)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:54.290.092 [svm_mem_statistics.c:146][ascend][curpid:618658,618658][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_DDR dev3 Cached_size:6291456Bytes
[INFO] DRV(618658,python3.9):2025-04-03-09:27:54.290.106 [svm_mem_statistics.c:140][ascend][curpid:618658,618658][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_P2P_HBM dev3 Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=4194304; alloc_cnt=1; free_cnt=1)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:54.290.126 [svm_mem_statistics.c:140][ascend][curpid:618658,618658][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_P2P_HBM dev3 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=12582912; alloc_cnt=5; free_cnt=5)
[INFO] DRV(618658,python3.9):2025-04-03-09:27:54.290.146 [svm_mem_statistics.c:146][ascend][curpid:618658,618658][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_P2P_HBM dev3 Cached_size:16777216Bytes
[INFO] GE(618670,python3.9):2025-04-03-09:27:54.290.303 [session_scope_mem_allocator.cc:73]618670 FreeAllMemory:Free all memory
[INFO] GE(618670,python3.9):2025-04-03-09:27:54.290.333 [caching_allocator.cc:474]618670 PrintStatics:Called counts[malloc:          0 free:          0].
[INFO] GE(618670,python3.9):2025-04-03-09:27:54.290.366 [caching_allocator.cc:391]618670 FreeBlocks:Free blocks.
[INFO] GE(618670,python3.9):2025-04-03-09:27:54.290.383 [caching_allocator.cc:358]618670 FreeCachedBlocks:Free cached blocks
[INFO] GE(618670,python3.9):2025-04-03-09:27:54.290.393 [caching_allocator.cc:422]618670 FreeBlockBins:Free block bins.
[INFO] GE(618670,python3.9):2025-04-03-09:27:54.290.405 [caching_allocator.cc:474]618670 PrintStatics:Called counts[malloc:          0 free:          0].
[INFO] GE(618670,python3.9):2025-04-03-09:27:54.290.418 [caching_allocator.cc:391]618670 FreeBlocks:Free blocks.
[INFO] GE(618670,python3.9):2025-04-03-09:27:54.290.432 [caching_allocator.cc:358]618670 FreeCachedBlocks:Free cached blocks
[INFO] GE(618670,python3.9):2025-04-03-09:27:54.290.443 [caching_allocator.cc:422]618670 FreeBlockBins:Free block bins.
[INFO] GE(618670,python3.9):2025-04-03-09:27:54.290.467 [mem_manager.cc:145]618670 ReleaseResource:MemManager ReleaseResource device id = 0.
[INFO] GE(618670,python3.9):2025-04-03-09:27:54.290.506 [rts_caching_mem_allocator.cc:150]618670 ReleaseResource:RtsAllocatorManager ReleaseResource device id:0.
[INFO] GE(618670,python3.9):2025-04-03-09:27:54.290.562 [rts_caching_mem_allocator.cc:136]618670 Finalize:RtsAllocatorManager Finalize.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:54.301.091 [network_manager.cc:875] [618654]destroy all nic/vnic.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:54.301.162 [network_manager.cc:875] [618654]destroy all nic/vnic.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:54.301.176 [network_manager.cc:875] [618654]destroy all nic/vnic.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:54.301.190 [network_manager.cc:875] [618654]destroy all nic/vnic.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:54.301.206 [network_manager.cc:875] [618654]destroy all nic/vnic.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:54.301.217 [network_manager.cc:875] [618654]destroy all nic/vnic.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:54.301.228 [network_manager.cc:875] [618654]destroy all nic/vnic.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:54.301.240 [network_manager.cc:875] [618654]destroy all nic/vnic.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:54.301.252 [network_manager.cc:875] [618654]destroy all nic/vnic.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:54.301.264 [network_manager.cc:875] [618654]destroy all nic/vnic.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:54.301.276 [network_manager.cc:875] [618654]destroy all nic/vnic.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:54.301.286 [network_manager.cc:875] [618654]destroy all nic/vnic.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:54.301.298 [network_manager.cc:875] [618654]destroy all nic/vnic.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:54.301.309 [network_manager.cc:875] [618654]destroy all nic/vnic.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:54.301.319 [network_manager.cc:875] [618654]destroy all nic/vnic.
[INFO] HCCL(618654,python3.9):2025-04-03-09:27:54.301.331 [network_manager.cc:875] [618654]destroy all nic/vnic.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.308.586 [runtime.cc:1570] 618654 ~Runtime: deconstruct runtime
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.308.655 [runtime.cc:1577] 618654 ~Runtime: wait monitor success, use=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.308.973 [raw_device.cc:262] 618654 SetDevProfStatus: devProfStatus_=0, profConfigType=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.309.011 [engine.cc:188] 618654 SubmitTaskNormal: stream_id=0,task_id=5,task_type=83 (DEVICE_RINGBUFFER_CONTROL).
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.309.039 [ringbuffer_maintain_task.cc:83] 618654 ConstructSqeForRingBufferMaintainTask: RingBufferMaintainTask stream_id:0, task_id:5
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.309.056 [stream.cc:1400] 618654 AddTaskToList: public task, stream_id=0, task_id=5, task_type=83 (DEVICE_RINGBUFFER_CONTROL), head=5, tail=6
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.309.072 [stream.cc:2595] 618654 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=5, type=83(DEVICE_RINGBUFFER_CONTROL), head=5, tail=6, sqe_num=1, lastTail=5, device_id=2
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.309.101 [npu_driver.cc:751] 618654 SqTaskSend: device_id=2, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.309.118 [stars_engine.cc:893] 618654 SendTask: Sq task send finished, device_id=2, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=5, task_type=83(DEVICE_RINGBUFFER_CONTROL).
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.309.135 [stream.cc:1494] 618654 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=5.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.309.156 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=0, head=5.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.309.174 [stream.cc:2886] 618654 StarsWaitForTask: No.0 stream_id=0, taskId=5, currentId=4
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.309.189 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=0, head=5.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.309.203 [stream.cc:2886] 618654 StarsWaitForTask: No.1 stream_id=0, taskId=5, currentId=4
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.309.217 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=0, head=6.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.309.263 [task.cc:185] 618654 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.309.282 [task.cc:185] 618654 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.309.297 [logger.cc:152] 618654 TaskFinished: device_id=2, stream_id=0, task_id=5, task_type=83 (DEVICE_RINGBUFFER_CONTROL), task_finish_num=16
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.309.322 [stars_engine.cc:437] 618654 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=5, sqHead=6, endTaskId=5, recycleTaskId=5.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.309.340 [stream.cc:2886] 618654 StarsWaitForTask: No.2 stream_id=0, taskId=5, currentId=5
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.309.372 [stars_engine.cc:524] 618654 TaskReclaim: Travel all streams, num=2.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.309.389 [npu_driver.cc:5547] 618654 GetSqHead: deviceId=2, tsId=0, sqId=0, head=6.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.309.407 [stream.cc:852] 618654 TearDown: stream_id=0, sqId=0, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.309.426 [stream.cc:938] 618654 TearDown: stream_id=0, delay recycle task num=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.309.439 [stream.cc:1507] 618654 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.312.970 [stream_sqcq_manage.cc:451] 618654 FreeLogicCq: Return(0), threadIdentifier(281473077956064), devId(2), tsId(0), cqId(997), isFastCq(0).
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.313.019 [npu_driver.cc:6163] 618654 StreamUnBindLogicCq: success: deviceId=2, tsId=0, streamId=0, logicCq=997.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.313.093 [npu_driver.cc:1180] 618654 LogicCqFree: Succ:device_id=2,ts_id=0,type=2,logic_cq_id=997, drvFlag=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.313.114 [stream.cc:237] 618654 FreeStreamId: Free stream_id=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.313.130 [stream_sqcq_manage.cc:216] 618654 DeAllocStreamSqCq: deviceId=2, tsId=0, drvFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.313.144 [npu_driver.cc:966] 618654 NormalSqCqFree: Normal sqcq free, sqId=0, cqId=0, device_id=2, tsId=0, drvFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.313.805 [npu_driver.cc:974] 618654 NormalSqCqFree: Normal sqcq free success, sqId=0, cqId=0, device_id=2, tsId=0, drvFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.313.827 [stream_sqcq_manage.cc:228] 618654 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=0, cq_id=0, stream_id=0, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.313.846 [npu_driver.cc:432] 618654 StreamIdFree: stream id free begin, device_id=2, stream_id=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.313.864 [npu_driver.cc:441] 618654 StreamIdFree: Stream id free success, stream_id=0, device_id=2, tsId=0, streamFlag=192
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.313.987 [stars_engine.cc:206] 618831 RecycleThreadRun: RecycleThreadRun thread leave.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.314.139 [stars_engine.cc:191] 618654 DestroyRecycleThread: Stars engine joined recycle thread OK.
[WARNING] RUNTIME(618654,python3.9):2025-04-03-09:27:54.314.162 [osal.cc:225] 618654 Join: mmJoinTask failed, thread=281471423184800 does not exist!
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.314.174 [stars_engine.cc:150] 618654 Stop: Startsengine joined monitor thread OK.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.314.216 [runtime.cc:5239] 618654 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
[INFO] TDT(618654,python3.9):2025-04-03-09:27:54.314.241 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618654] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.314.260 [runtime.cc:3003] 618654 StopAicpuExecutor: TsdClose success, userDeviceId=2, devId=2, tdt status=0
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:54.314.279 [atrace_api.c:118](tid:618654) AtraceDestroy start.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:54.314.302 [tracer_mgr_operate.c:248](tid:618654) destroy object RUNTIME_ATRACE_DEV2_TS0, exitSave(false).
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:54.314.324 [atrace_api.c:120](tid:618654) AtraceDestroy end.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.314.395 [stream.cc:237] 618654 FreeStreamId: Free stream_id=1.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.314.415 [stream_sqcq_manage.cc:216] 618654 DeAllocStreamSqCq: deviceId=2, tsId=0, drvFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.314.428 [npu_driver.cc:966] 618654 NormalSqCqFree: Normal sqcq free, sqId=1, cqId=1, device_id=2, tsId=0, drvFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.314.652 [npu_driver.cc:974] 618654 NormalSqCqFree: Normal sqcq free success, sqId=1, cqId=1, device_id=2, tsId=0, drvFlag=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.314.671 [stream_sqcq_manage.cc:228] 618654 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=1, cq_id=1, stream_id=1, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.314.685 [npu_driver.cc:432] 618654 StreamIdFree: stream id free begin, device_id=2, stream_id=1, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.314.702 [npu_driver.cc:441] 618654 StreamIdFree: Stream id free success, stream_id=1, device_id=2, tsId=0, streamFlag=0
[INFO] DRV(618650,python3.9):2025-04-03-09:27:54.314.835 [drv_log_user.c:623][ascend][curpid:618650,618650][drv][devmm][share_log_read_in_single_module]Close logical_device. (logical_devid=1; phyid=1; vfid=0; hostpid=618650; devpid=30483)
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.314.890 [npu_driver.cc:3045] 618650 DeviceClose: Close device success, device_id=1, tsId=0
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.314.913 [raw_device.cc:125] 618650 ~Device: deconstruct device
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.325.135 [stars_engine.cc:58] 618654 ~StarsEngine: Destructor.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.325.181 [engine.cc:84] 618654 ~Engine: Destructor.
[INFO] DRV(618654,python3.9):2025-04-03-09:27:54.326.113 [trs_dev_drv.c:370][ascend][curpid:618654,618654][drv][tsdrv][drvDeviceCloseComm]Close success. (devid=2; fd=36; mmapFd=37)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:54.326.142 [devmm_svm.c:2238][ascend][curpid:618654,618654][drv][devmm][drvMemDeviceCloseInner]DrvMemDeviceClose. (devid=2)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:54.326.161 [svm_mem_statistics.c:140][ascend][curpid:618654,618654][drv][devmm][_svm_mem_stats_show]SVM_MEM Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=2965372928; alloc_cnt=7; free_cnt=7)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:54.326.184 [svm_mem_statistics.c:140][ascend][curpid:618654,618654][drv][devmm][_svm_mem_stats_show]HOST_MEM Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=4096; alloc_cnt=2; free_cnt=2)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:54.326.202 [svm_mem_statistics.c:140][ascend][curpid:618654,618654][drv][devmm][_svm_mem_stats_show]HOST_MEM Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=11341824; alloc_cnt=3; free_cnt=3)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:54.326.223 [svm_mem_statistics.c:146][ascend][curpid:618654,618654][drv][devmm][_svm_mem_stats_show]HOST_MEM Cached_size:12582912Bytes
[INFO] DRV(618654,python3.9):2025-04-03-09:27:54.326.236 [svm_mem_statistics.c:140][ascend][curpid:618654,618654][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_HBM dev2 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=94208; alloc_cnt=10; free_cnt=10)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:54.326.254 [svm_mem_statistics.c:140][ascend][curpid:618654,618654][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_HBM dev2 Mem stats (Bytes). (module_name=APP; module_id=33; current_alloced_size=135168; alloced_peak_size=135168; alloc_cnt=1; free_cnt=0)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:54.326.274 [svm_mem_statistics.c:146][ascend][curpid:618654,618654][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_HBM dev2 Cached_size:1961984Bytes
[INFO] DRV(618654,python3.9):2025-04-03-09:27:54.326.287 [svm_mem_statistics.c:140][ascend][curpid:618654,618654][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_DDR dev2 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=16384; alloc_cnt=1; free_cnt=1)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:54.326.305 [svm_mem_statistics.c:146][ascend][curpid:618654,618654][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_DDR dev2 Cached_size:2097152Bytes
[INFO] DRV(618654,python3.9):2025-04-03-09:27:54.326.320 [svm_mem_statistics.c:140][ascend][curpid:618654,618654][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_P2P_HBM dev2 Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=1343488; alloc_cnt=8; free_cnt=8)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:54.326.340 [svm_mem_statistics.c:146][ascend][curpid:618654,618654][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_P2P_HBM dev2 Cached_size:2097152Bytes
[INFO] DRV(618654,python3.9):2025-04-03-09:27:54.326.355 [svm_mem_statistics.c:140][ascend][curpid:618654,618654][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev2 Mem stats (Bytes). (module_name=UNKNOWN; module_id=0; current_alloced_size=0; alloced_peak_size=2097152; alloc_cnt=1; free_cnt=1)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:54.326.375 [svm_mem_statistics.c:140][ascend][curpid:618654,618654][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev2 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=20971520; alloc_cnt=8; free_cnt=8)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:54.326.393 [svm_mem_statistics.c:140][ascend][curpid:618654,618654][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev2 Mem stats (Bytes). (module_name=APP; module_id=33; current_alloced_size=0; alloced_peak_size=429916160; alloc_cnt=3; free_cnt=3)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:54.326.424 [svm_mem_statistics.c:146][ascend][curpid:618654,618654][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev2 Cached_size:23068672Bytes
[INFO] DRV(618654,python3.9):2025-04-03-09:27:54.326.438 [svm_mem_statistics.c:140][ascend][curpid:618654,618654][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_DDR dev2 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=6291456; alloc_cnt=2; free_cnt=2)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:54.326.455 [svm_mem_statistics.c:146][ascend][curpid:618654,618654][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_DDR dev2 Cached_size:6291456Bytes
[INFO] DRV(618654,python3.9):2025-04-03-09:27:54.326.470 [svm_mem_statistics.c:140][ascend][curpid:618654,618654][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_P2P_HBM dev2 Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=4194304; alloc_cnt=1; free_cnt=1)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:54.326.489 [svm_mem_statistics.c:140][ascend][curpid:618654,618654][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_P2P_HBM dev2 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=12582912; alloc_cnt=5; free_cnt=5)
[INFO] DRV(618654,python3.9):2025-04-03-09:27:54.326.508 [svm_mem_statistics.c:146][ascend][curpid:618654,618654][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_P2P_HBM dev2 Cached_size:16777216Bytes
[INFO] DRV(618658,python3.9):2025-04-03-09:27:54.362.527 [drv_log_user.c:623][ascend][curpid:618658,618658][drv][devmm][share_log_read_in_single_module]Close logical_device. (logical_devid=3; phyid=3; vfid=0; hostpid=618658; devpid=30107)
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.362.577 [npu_driver.cc:3045] 618658 DeviceClose: Close device success, device_id=3, tsId=0
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.362.605 [raw_device.cc:125] 618658 ~Device: deconstruct device
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:54.371.710 [network_manager.cc:875] [618662]destroy all nic/vnic.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:54.371.759 [network_manager.cc:875] [618662]destroy all nic/vnic.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:54.371.770 [network_manager.cc:875] [618662]destroy all nic/vnic.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:54.371.780 [network_manager.cc:875] [618662]destroy all nic/vnic.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:54.371.789 [network_manager.cc:875] [618662]destroy all nic/vnic.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:54.371.812 [network_manager.cc:875] [618662]destroy all nic/vnic.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:54.371.826 [network_manager.cc:875] [618662]destroy all nic/vnic.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:54.371.835 [network_manager.cc:875] [618662]destroy all nic/vnic.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:54.371.844 [network_manager.cc:875] [618662]destroy all nic/vnic.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:54.371.853 [network_manager.cc:875] [618662]destroy all nic/vnic.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:54.371.862 [network_manager.cc:875] [618662]destroy all nic/vnic.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:54.371.870 [network_manager.cc:875] [618662]destroy all nic/vnic.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:54.371.879 [network_manager.cc:875] [618662]destroy all nic/vnic.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:54.371.887 [network_manager.cc:875] [618662]destroy all nic/vnic.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:54.371.895 [network_manager.cc:875] [618662]destroy all nic/vnic.
[INFO] HCCL(618662,python3.9):2025-04-03-09:27:54.371.904 [network_manager.cc:875] [618662]destroy all nic/vnic.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.377.497 [runtime.cc:1570] 618662 ~Runtime: deconstruct runtime
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.377.532 [runtime.cc:1577] 618662 ~Runtime: wait monitor success, use=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.377.806 [raw_device.cc:262] 618662 SetDevProfStatus: devProfStatus_=0, profConfigType=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.377.841 [engine.cc:188] 618662 SubmitTaskNormal: stream_id=0,task_id=5,task_type=83 (DEVICE_RINGBUFFER_CONTROL).
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.377.864 [ringbuffer_maintain_task.cc:83] 618662 ConstructSqeForRingBufferMaintainTask: RingBufferMaintainTask stream_id:0, task_id:5
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.377.878 [stream.cc:1400] 618662 AddTaskToList: public task, stream_id=0, task_id=5, task_type=83 (DEVICE_RINGBUFFER_CONTROL), head=5, tail=6
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.377.892 [stream.cc:2595] 618662 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=5, type=83(DEVICE_RINGBUFFER_CONTROL), head=5, tail=6, sqe_num=1, lastTail=5, device_id=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.377.914 [npu_driver.cc:751] 618662 SqTaskSend: device_id=4, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.377.926 [stars_engine.cc:893] 618662 SendTask: Sq task send finished, device_id=4, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=5, task_type=83(DEVICE_RINGBUFFER_CONTROL).
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.377.941 [stream.cc:1494] 618662 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=5.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.377.957 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=0, head=5.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.377.971 [stream.cc:2886] 618662 StarsWaitForTask: No.0 stream_id=0, taskId=5, currentId=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.377.985 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=0, head=5.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.377.995 [stream.cc:2886] 618662 StarsWaitForTask: No.1 stream_id=0, taskId=5, currentId=4
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.378.006 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=0, head=6.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.378.020 [task.cc:185] 618662 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.378.032 [task.cc:185] 618662 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.378.045 [logger.cc:152] 618662 TaskFinished: device_id=4, stream_id=0, task_id=5, task_type=83 (DEVICE_RINGBUFFER_CONTROL), task_finish_num=16
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.378.066 [stars_engine.cc:437] 618662 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=5, sqHead=6, endTaskId=5, recycleTaskId=5.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.378.078 [stream.cc:2886] 618662 StarsWaitForTask: No.2 stream_id=0, taskId=5, currentId=5
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.378.092 [stars_engine.cc:524] 618662 TaskReclaim: Travel all streams, num=2.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.378.103 [npu_driver.cc:5547] 618662 GetSqHead: deviceId=4, tsId=0, sqId=0, head=6.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.378.120 [stream.cc:852] 618662 TearDown: stream_id=0, sqId=0, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.378.134 [stream.cc:938] 618662 TearDown: stream_id=0, delay recycle task num=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.378.144 [stream.cc:1507] 618662 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.381.699 [stream_sqcq_manage.cc:451] 618662 FreeLogicCq: Return(0), threadIdentifier(281473748110816), devId(4), tsId(0), cqId(311), isFastCq(0).
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.381.752 [npu_driver.cc:6163] 618662 StreamUnBindLogicCq: success: deviceId=4, tsId=0, streamId=0, logicCq=311.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.381.802 [npu_driver.cc:1180] 618662 LogicCqFree: Succ:device_id=4,ts_id=0,type=2,logic_cq_id=311, drvFlag=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.381.818 [stream.cc:237] 618662 FreeStreamId: Free stream_id=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.381.830 [stream_sqcq_manage.cc:216] 618662 DeAllocStreamSqCq: deviceId=4, tsId=0, drvFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.381.842 [npu_driver.cc:966] 618662 NormalSqCqFree: Normal sqcq free, sqId=0, cqId=0, device_id=4, tsId=0, drvFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.382.468 [npu_driver.cc:974] 618662 NormalSqCqFree: Normal sqcq free success, sqId=0, cqId=0, device_id=4, tsId=0, drvFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.382.486 [stream_sqcq_manage.cc:228] 618662 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=0, cq_id=0, stream_id=0, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.382.501 [npu_driver.cc:432] 618662 StreamIdFree: stream id free begin, device_id=4, stream_id=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.382.518 [npu_driver.cc:441] 618662 StreamIdFree: Stream id free success, stream_id=0, device_id=4, tsId=0, streamFlag=192
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.382.579 [stars_engine.cc:206] 618815 RecycleThreadRun: RecycleThreadRun thread leave.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.382.725 [stars_engine.cc:191] 618662 DestroyRecycleThread: Stars engine joined recycle thread OK.
[WARNING] RUNTIME(618662,python3.9):2025-04-03-09:27:54.382.738 [osal.cc:225] 618662 Join: mmJoinTask failed, thread=281472093339552 does not exist!
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.382.749 [stars_engine.cc:150] 618662 Stop: Startsengine joined monitor thread OK.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.382.769 [runtime.cc:5239] 618662 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
[INFO] TDT(618662,python3.9):2025-04-03-09:27:54.382.784 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618662] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.382.798 [runtime.cc:3003] 618662 StopAicpuExecutor: TsdClose success, userDeviceId=4, devId=4, tdt status=0
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:54.382.816 [atrace_api.c:118](tid:618662) AtraceDestroy start.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:54.382.857 [tracer_mgr_operate.c:248](tid:618662) destroy object RUNTIME_ATRACE_DEV4_TS0, exitSave(false).
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:54.382.872 [atrace_api.c:120](tid:618662) AtraceDestroy end.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.382.888 [stream.cc:237] 618662 FreeStreamId: Free stream_id=1.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.382.901 [stream_sqcq_manage.cc:216] 618662 DeAllocStreamSqCq: deviceId=4, tsId=0, drvFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.382.910 [npu_driver.cc:966] 618662 NormalSqCqFree: Normal sqcq free, sqId=1, cqId=1, device_id=4, tsId=0, drvFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.383.142 [npu_driver.cc:974] 618662 NormalSqCqFree: Normal sqcq free success, sqId=1, cqId=1, device_id=4, tsId=0, drvFlag=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.383.155 [stream_sqcq_manage.cc:228] 618662 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=1, cq_id=1, stream_id=1, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.383.167 [npu_driver.cc:432] 618662 StreamIdFree: stream id free begin, device_id=4, stream_id=1, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.383.180 [npu_driver.cc:441] 618662 StreamIdFree: Stream id free success, stream_id=1, device_id=4, tsId=0, streamFlag=0
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:54.386.264 [network_manager.cc:875] [618670]destroy all nic/vnic.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:54.386.329 [network_manager.cc:875] [618670]destroy all nic/vnic.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:54.386.343 [network_manager.cc:875] [618670]destroy all nic/vnic.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:54.386.356 [network_manager.cc:875] [618670]destroy all nic/vnic.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:54.386.367 [network_manager.cc:875] [618670]destroy all nic/vnic.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:54.386.376 [network_manager.cc:875] [618670]destroy all nic/vnic.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:54.386.388 [network_manager.cc:875] [618670]destroy all nic/vnic.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:54.386.400 [network_manager.cc:875] [618670]destroy all nic/vnic.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:54.386.411 [network_manager.cc:875] [618670]destroy all nic/vnic.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:54.386.422 [network_manager.cc:875] [618670]destroy all nic/vnic.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:54.386.432 [network_manager.cc:875] [618670]destroy all nic/vnic.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:54.386.442 [network_manager.cc:875] [618670]destroy all nic/vnic.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:54.386.453 [network_manager.cc:875] [618670]destroy all nic/vnic.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:54.386.463 [network_manager.cc:875] [618670]destroy all nic/vnic.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:54.386.474 [network_manager.cc:875] [618670]destroy all nic/vnic.
[INFO] HCCL(618670,python3.9):2025-04-03-09:27:54.386.485 [network_manager.cc:875] [618670]destroy all nic/vnic.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.391.670 [runtime.cc:1570] 618670 ~Runtime: deconstruct runtime
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.391.707 [runtime.cc:1577] 618670 ~Runtime: wait monitor success, use=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.392.443 [raw_device.cc:262] 618670 SetDevProfStatus: devProfStatus_=0, profConfigType=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.392.488 [engine.cc:188] 618670 SubmitTaskNormal: stream_id=0,task_id=5,task_type=83 (DEVICE_RINGBUFFER_CONTROL).
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.392.493 [stars_engine.cc:58] 618662 ~StarsEngine: Destructor.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.392.521 [engine.cc:84] 618662 ~Engine: Destructor.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.392.516 [ringbuffer_maintain_task.cc:83] 618670 ConstructSqeForRingBufferMaintainTask: RingBufferMaintainTask stream_id:0, task_id:5
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.392.539 [stream.cc:1400] 618670 AddTaskToList: public task, stream_id=0, task_id=5, task_type=83 (DEVICE_RINGBUFFER_CONTROL), head=5, tail=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.392.554 [stream.cc:2595] 618670 StarsAddTaskToStream: single-operator flow stream, stream_id=0, task_id=5, type=83(DEVICE_RINGBUFFER_CONTROL), head=5, tail=6, sqe_num=1, lastTail=5, device_id=6
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.392.584 [npu_driver.cc:751] 618670 SqTaskSend: device_id=6, ts_id=0, sq_id=0, sqe_num=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.392.600 [stars_engine.cc:893] 618670 SendTask: Sq task send finished, device_id=6, ts_id=0, sq_id=0, cq_id=0, stream_id=0, task_id=5, task_type=83(DEVICE_RINGBUFFER_CONTROL).
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.392.615 [stream.cc:1494] 618670 IsNeedSendFlipTask: IsNeedSendFlipTask, preTaskId=5.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.392.632 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=0, head=5.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.392.649 [stream.cc:2886] 618670 StarsWaitForTask: No.0 stream_id=0, taskId=5, currentId=4
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.392.685 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=0, head=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.392.698 [task.cc:185] 618670 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.392.713 [task.cc:185] 618670 GetTask: this stream no taskRes, stream_id=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.392.727 [logger.cc:152] 618670 TaskFinished: device_id=6, stream_id=0, task_id=5, task_type=83 (DEVICE_RINGBUFFER_CONTROL), task_finish_num=16
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.392.751 [stars_engine.cc:437] 618670 FinishedTaskReclaim: recycle task, stream_id=0, limited=0, taskHead=5, sqHead=6, endTaskId=5, recycleTaskId=5.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.392.767 [stream.cc:2886] 618670 StarsWaitForTask: No.1 stream_id=0, taskId=5, currentId=5
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.392.782 [stars_engine.cc:524] 618670 TaskReclaim: Travel all streams, num=2.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.392.794 [npu_driver.cc:5547] 618670 GetSqHead: deviceId=6, tsId=0, sqId=0, head=6.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.392.815 [stream.cc:852] 618670 TearDown: stream_id=0, sqId=0, pendingNum=0, isForceRecycle_=1, flag=1, failMode=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.392.833 [stream.cc:938] 618670 TearDown: stream_id=0, delay recycle task num=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.392.844 [stream.cc:1507] 618670 IsNeedSendFlipTask: profiling TrackProfFlag closed=0.
[INFO] DRV(618662,python3.9):2025-04-03-09:27:54.393.383 [trs_dev_drv.c:370][ascend][curpid:618662,618662][drv][tsdrv][drvDeviceCloseComm]Close success. (devid=4; fd=36; mmapFd=37)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:54.393.405 [devmm_svm.c:2238][ascend][curpid:618662,618662][drv][devmm][drvMemDeviceCloseInner]DrvMemDeviceClose. (devid=4)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:54.393.420 [svm_mem_statistics.c:140][ascend][curpid:618662,618662][drv][devmm][_svm_mem_stats_show]SVM_MEM Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=2965372928; alloc_cnt=7; free_cnt=7)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:54.393.436 [svm_mem_statistics.c:140][ascend][curpid:618662,618662][drv][devmm][_svm_mem_stats_show]HOST_MEM Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=4096; alloc_cnt=2; free_cnt=2)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:54.393.451 [svm_mem_statistics.c:140][ascend][curpid:618662,618662][drv][devmm][_svm_mem_stats_show]HOST_MEM Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=11341824; alloc_cnt=3; free_cnt=3)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:54.393.466 [svm_mem_statistics.c:146][ascend][curpid:618662,618662][drv][devmm][_svm_mem_stats_show]HOST_MEM Cached_size:12582912Bytes
[INFO] DRV(618662,python3.9):2025-04-03-09:27:54.393.478 [svm_mem_statistics.c:140][ascend][curpid:618662,618662][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_HBM dev4 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=94208; alloc_cnt=10; free_cnt=10)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:54.393.493 [svm_mem_statistics.c:140][ascend][curpid:618662,618662][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_HBM dev4 Mem stats (Bytes). (module_name=APP; module_id=33; current_alloced_size=135168; alloced_peak_size=135168; alloc_cnt=1; free_cnt=0)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:54.393.508 [svm_mem_statistics.c:146][ascend][curpid:618662,618662][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_HBM dev4 Cached_size:1961984Bytes
[INFO] DRV(618662,python3.9):2025-04-03-09:27:54.393.519 [svm_mem_statistics.c:140][ascend][curpid:618662,618662][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_DDR dev4 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=16384; alloc_cnt=1; free_cnt=1)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:54.393.534 [svm_mem_statistics.c:146][ascend][curpid:618662,618662][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_DDR dev4 Cached_size:2097152Bytes
[INFO] DRV(618662,python3.9):2025-04-03-09:27:54.393.544 [svm_mem_statistics.c:140][ascend][curpid:618662,618662][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_P2P_HBM dev4 Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=1343488; alloc_cnt=8; free_cnt=8)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:54.393.558 [svm_mem_statistics.c:146][ascend][curpid:618662,618662][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_P2P_HBM dev4 Cached_size:2097152Bytes
[INFO] DRV(618662,python3.9):2025-04-03-09:27:54.393.570 [svm_mem_statistics.c:140][ascend][curpid:618662,618662][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev4 Mem stats (Bytes). (module_name=UNKNOWN; module_id=0; current_alloced_size=0; alloced_peak_size=2097152; alloc_cnt=1; free_cnt=1)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:54.393.583 [svm_mem_statistics.c:140][ascend][curpid:618662,618662][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev4 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=20971520; alloc_cnt=8; free_cnt=8)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:54.393.597 [svm_mem_statistics.c:140][ascend][curpid:618662,618662][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev4 Mem stats (Bytes). (module_name=APP; module_id=33; current_alloced_size=0; alloced_peak_size=429916160; alloc_cnt=3; free_cnt=3)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:54.393.619 [svm_mem_statistics.c:146][ascend][curpid:618662,618662][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev4 Cached_size:23068672Bytes
[INFO] DRV(618662,python3.9):2025-04-03-09:27:54.393.630 [svm_mem_statistics.c:140][ascend][curpid:618662,618662][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_DDR dev4 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=6291456; alloc_cnt=2; free_cnt=2)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:54.393.644 [svm_mem_statistics.c:146][ascend][curpid:618662,618662][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_DDR dev4 Cached_size:6291456Bytes
[INFO] DRV(618662,python3.9):2025-04-03-09:27:54.393.654 [svm_mem_statistics.c:140][ascend][curpid:618662,618662][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_P2P_HBM dev4 Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=4194304; alloc_cnt=1; free_cnt=1)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:54.393.668 [svm_mem_statistics.c:140][ascend][curpid:618662,618662][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_P2P_HBM dev4 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=12582912; alloc_cnt=5; free_cnt=5)
[INFO] DRV(618662,python3.9):2025-04-03-09:27:54.393.682 [svm_mem_statistics.c:146][ascend][curpid:618662,618662][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_P2P_HBM dev4 Cached_size:16777216Bytes
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.396.340 [stream_sqcq_manage.cc:451] 618670 FreeLogicCq: Return(0), threadIdentifier(281473556700640), devId(6), tsId(0), cqId(297), isFastCq(0).
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.396.388 [npu_driver.cc:6163] 618670 StreamUnBindLogicCq: success: deviceId=6, tsId=0, streamId=0, logicCq=297.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.396.443 [npu_driver.cc:1180] 618670 LogicCqFree: Succ:device_id=6,ts_id=0,type=2,logic_cq_id=297, drvFlag=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.396.462 [stream.cc:237] 618670 FreeStreamId: Free stream_id=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.396.474 [stream_sqcq_manage.cc:216] 618670 DeAllocStreamSqCq: deviceId=6, tsId=0, drvFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.396.487 [npu_driver.cc:966] 618670 NormalSqCqFree: Normal sqcq free, sqId=0, cqId=0, device_id=6, tsId=0, drvFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.397.113 [npu_driver.cc:974] 618670 NormalSqCqFree: Normal sqcq free success, sqId=0, cqId=0, device_id=6, tsId=0, drvFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.397.134 [stream_sqcq_manage.cc:228] 618670 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=0, cq_id=0, stream_id=0, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.397.149 [npu_driver.cc:432] 618670 StreamIdFree: stream id free begin, device_id=6, stream_id=0, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.397.167 [npu_driver.cc:441] 618670 StreamIdFree: Stream id free success, stream_id=0, device_id=6, tsId=0, streamFlag=192
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.397.225 [stars_engine.cc:206] 618821 RecycleThreadRun: RecycleThreadRun thread leave.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.397.368 [stars_engine.cc:191] 618670 DestroyRecycleThread: Stars engine joined recycle thread OK.
[WARNING] RUNTIME(618670,python3.9):2025-04-03-09:27:54.397.386 [osal.cc:225] 618670 Join: mmJoinTask failed, thread=281471893475232 does not exist!
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.397.397 [stars_engine.cc:150] 618670 Stop: Startsengine joined monitor thread OK.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.397.439 [runtime.cc:5239] 618670 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
[INFO] TDT(618670,python3.9):2025-04-03-09:27:54.397.467 [client_manager.cpp:635][ChangeUserDeviceIdToLogicDeviceId][tid:618670] [TsdClient] g_userDeviceInfo is empty.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.397.483 [runtime.cc:3003] 618670 StopAicpuExecutor: TsdClose success, userDeviceId=6, devId=6, tdt status=0
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:54.397.502 [atrace_api.c:118](tid:618670) AtraceDestroy start.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:54.397.542 [tracer_mgr_operate.c:248](tid:618670) destroy object RUNTIME_ATRACE_DEV6_TS0, exitSave(false).
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:54.397.562 [atrace_api.c:120](tid:618670) AtraceDestroy end.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.397.579 [stream.cc:237] 618670 FreeStreamId: Free stream_id=1.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.397.596 [stream_sqcq_manage.cc:216] 618670 DeAllocStreamSqCq: deviceId=6, tsId=0, drvFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.397.607 [npu_driver.cc:966] 618670 NormalSqCqFree: Normal sqcq free, sqId=1, cqId=1, device_id=6, tsId=0, drvFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.397.828 [npu_driver.cc:974] 618670 NormalSqCqFree: Normal sqcq free success, sqId=1, cqId=1, device_id=6, tsId=0, drvFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.397.846 [stream_sqcq_manage.cc:228] 618670 DeAllocStreamSqCq: [SqCqManage]success to release sq, sq_id=1, cq_id=1, stream_id=1, is_sq_need_release=1, drvFlag=0.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.397.860 [npu_driver.cc:432] 618670 StreamIdFree: stream id free begin, device_id=6, stream_id=1, ts_id=0, remote_stream_id=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.397.875 [npu_driver.cc:441] 618670 StreamIdFree: Stream id free success, stream_id=1, device_id=6, tsId=0, streamFlag=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.409.621 [stars_engine.cc:58] 618670 ~StarsEngine: Destructor.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.409.652 [engine.cc:84] 618670 ~Engine: Destructor.
[INFO] DRV(618670,python3.9):2025-04-03-09:27:54.410.541 [trs_dev_drv.c:370][ascend][curpid:618670,618670][drv][tsdrv][drvDeviceCloseComm]Close success. (devid=6; fd=36; mmapFd=37)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:54.410.568 [devmm_svm.c:2238][ascend][curpid:618670,618670][drv][devmm][drvMemDeviceCloseInner]DrvMemDeviceClose. (devid=6)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:54.410.586 [svm_mem_statistics.c:140][ascend][curpid:618670,618670][drv][devmm][_svm_mem_stats_show]SVM_MEM Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=2965372928; alloc_cnt=7; free_cnt=7)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:54.410.608 [svm_mem_statistics.c:140][ascend][curpid:618670,618670][drv][devmm][_svm_mem_stats_show]HOST_MEM Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=4096; alloc_cnt=2; free_cnt=2)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:54.410.625 [svm_mem_statistics.c:140][ascend][curpid:618670,618670][drv][devmm][_svm_mem_stats_show]HOST_MEM Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=11341824; alloc_cnt=3; free_cnt=3)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:54.410.642 [svm_mem_statistics.c:146][ascend][curpid:618670,618670][drv][devmm][_svm_mem_stats_show]HOST_MEM Cached_size:12582912Bytes
[INFO] DRV(618670,python3.9):2025-04-03-09:27:54.410.656 [svm_mem_statistics.c:140][ascend][curpid:618670,618670][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_HBM dev6 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=94208; alloc_cnt=10; free_cnt=10)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:54.410.675 [svm_mem_statistics.c:140][ascend][curpid:618670,618670][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_HBM dev6 Mem stats (Bytes). (module_name=APP; module_id=33; current_alloced_size=135168; alloced_peak_size=135168; alloc_cnt=1; free_cnt=0)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:54.410.707 [svm_mem_statistics.c:146][ascend][curpid:618670,618670][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_HBM dev6 Cached_size:1961984Bytes
[INFO] DRV(618670,python3.9):2025-04-03-09:27:54.410.719 [svm_mem_statistics.c:140][ascend][curpid:618670,618670][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_DDR dev6 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=16384; alloc_cnt=1; free_cnt=1)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:54.410.736 [svm_mem_statistics.c:146][ascend][curpid:618670,618670][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_DDR dev6 Cached_size:2097152Bytes
[INFO] DRV(618670,python3.9):2025-04-03-09:27:54.410.751 [svm_mem_statistics.c:140][ascend][curpid:618670,618670][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_P2P_HBM dev6 Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=1343488; alloc_cnt=8; free_cnt=8)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:54.410.768 [svm_mem_statistics.c:146][ascend][curpid:618670,618670][drv][devmm][_svm_mem_stats_show]MEM_DEV_SMALL_P2P_HBM dev6 Cached_size:2097152Bytes
[INFO] DRV(618670,python3.9):2025-04-03-09:27:54.410.782 [svm_mem_statistics.c:140][ascend][curpid:618670,618670][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev6 Mem stats (Bytes). (module_name=UNKNOWN; module_id=0; current_alloced_size=0; alloced_peak_size=2097152; alloc_cnt=1; free_cnt=1)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:54.410.800 [svm_mem_statistics.c:140][ascend][curpid:618670,618670][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev6 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=20971520; alloc_cnt=8; free_cnt=8)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:54.410.816 [svm_mem_statistics.c:140][ascend][curpid:618670,618670][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev6 Mem stats (Bytes). (module_name=APP; module_id=33; current_alloced_size=0; alloced_peak_size=429916160; alloc_cnt=3; free_cnt=3)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:54.410.835 [svm_mem_statistics.c:146][ascend][curpid:618670,618670][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_HBM dev6 Cached_size:23068672Bytes
[INFO] DRV(618670,python3.9):2025-04-03-09:27:54.410.846 [svm_mem_statistics.c:140][ascend][curpid:618670,618670][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_DDR dev6 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=6291456; alloc_cnt=2; free_cnt=2)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:54.410.862 [svm_mem_statistics.c:146][ascend][curpid:618670,618670][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_DDR dev6 Cached_size:6291456Bytes
[INFO] DRV(618670,python3.9):2025-04-03-09:27:54.410.878 [svm_mem_statistics.c:140][ascend][curpid:618670,618670][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_P2P_HBM dev6 Mem stats (Bytes). (module_name=HCCL; module_id=3; current_alloced_size=0; alloced_peak_size=4194304; alloc_cnt=1; free_cnt=1)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:54.410.893 [svm_mem_statistics.c:140][ascend][curpid:618670,618670][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_P2P_HBM dev6 Mem stats (Bytes). (module_name=RUNTIME; module_id=7; current_alloced_size=0; alloced_peak_size=12582912; alloc_cnt=5; free_cnt=5)
[INFO] DRV(618670,python3.9):2025-04-03-09:27:54.410.909 [svm_mem_statistics.c:146][ascend][curpid:618670,618670][drv][devmm][_svm_mem_stats_show]MEM_DEV_HUGE_P2P_HBM dev6 Cached_size:16777216Bytes
[INFO] DRV(618654,python3.9):2025-04-03-09:27:54.412.472 [drv_log_user.c:623][ascend][curpid:618654,618654][drv][devmm][share_log_read_in_single_module]Close logical_device. (logical_devid=2; phyid=2; vfid=0; hostpid=618654; devpid=5065)
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.412.523 [npu_driver.cc:3045] 618654 DeviceClose: Close device success, device_id=2, tsId=0
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.412.543 [raw_device.cc:125] 618654 ~Device: deconstruct device
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.424.957 [plugin_old_arch.cc:25] 618650 DestructorRuntimeImpl: RuntimeImpl destructor success
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.424.998 [runtime_keeper.cc:167] 618650 DestoryRuntimeImpl: Destory Runtime success
[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:54.426.474 [task_fail_callback_data_manager.cc:63] 618650 ~TaskFailCallBackManager: Destructor.
[INFO] DRV(618662,python3.9):2025-04-03-09:27:54.465.115 [drv_log_user.c:623][ascend][curpid:618662,618662][drv][devmm][share_log_read_in_single_module]Close logical_device. (logical_devid=4; phyid=4; vfid=0; hostpid=618662; devpid=29654)
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.465.152 [npu_driver.cc:3045] 618662 DeviceClose: Close device success, device_id=4, tsId=0
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.465.168 [raw_device.cc:125] 618662 ~Device: deconstruct device
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.473.806 [plugin_old_arch.cc:25] 618658 DestructorRuntimeImpl: RuntimeImpl destructor success
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.473.839 [runtime_keeper.cc:167] 618658 DestoryRuntimeImpl: Destory Runtime success
[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:54.474.988 [task_fail_callback_data_manager.cc:63] 618658 ~TaskFailCallBackManager: Destructor.
[INFO] DRV(618670,python3.9):2025-04-03-09:27:54.481.433 [drv_log_user.c:623][ascend][curpid:618670,618670][drv][devmm][share_log_read_in_single_module]Close logical_device. (logical_devid=6; phyid=6; vfid=0; hostpid=618670; devpid=29743)
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.481.483 [npu_driver.cc:3045] 618670 DeviceClose: Close device success, device_id=6, tsId=0
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.481.503 [raw_device.cc:125] 618670 ~Device: deconstruct device
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:54.518.593 [stacktrace_signal.c:188](tid:618650) unregister all signo sigaction, can not capture signal.
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.520.815 [plugin_old_arch.cc:25] 618654 DestructorRuntimeImpl: RuntimeImpl destructor success
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.520.848 [runtime_keeper.cc:167] 618654 DestoryRuntimeImpl: Destory Runtime success
[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:54.523.002 [task_fail_callback_data_manager.cc:63] 618654 ~TaskFailCallBackManager: Destructor.
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:54.554.879 [atrace_client_communication.c:141](tid:618650) send [end] msg.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:54.560.522 [stacktrace_signal.c:188](tid:618658) unregister all signo sigaction, can not capture signal.
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:54.566.708 [atrace_client_communication.c:141](tid:618658) send [end] msg.
[INFO] DRV(618658,python3.9):2025-04-03-09:27:54.568.141 [hdc_core.c:1982][ascend][curpid:618658,618658][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4207; pid=618658)
[INFO] IDEDD(618658,python3.9):2025-04-03-09:27:54.568.195 [hdc_api.cpp:671][tid:618658] connect succ, peer_node: 0, peer_devid: 3
[INFO] DRV(618658,python3.9):2025-04-03-09:27:54.568.281 [hdc_client.c:417][ascend][curpid:618658,618658][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4207)
[INFO] ATRACE(618658,python3.9):2025-04-03-09:27:54.568.338 [atrace_client_communication.c:164](tid:618658) send [end] msg success.
[INFO] DRV(618650,python3.9):2025-04-03-09:27:54.569.463 [hdc_core.c:1982][ascend][curpid:618650,618650][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4206; pid=618650)
[INFO] IDEDD(618650,python3.9):2025-04-03-09:27:54.569.499 [hdc_api.cpp:671][tid:618650] connect succ, peer_node: 0, peer_devid: 1
[INFO] DRV(618650,python3.9):2025-04-03-09:27:54.569.615 [hdc_client.c:417][ascend][curpid:618650,618650][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4206)
[INFO] ATRACE(618650,python3.9):2025-04-03-09:27:54.569.678 [atrace_client_communication.c:164](tid:618650) send [end] msg success.
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.573.909 [plugin_old_arch.cc:25] 618662 DestructorRuntimeImpl: RuntimeImpl destructor success
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.573.942 [runtime_keeper.cc:167] 618662 DestoryRuntimeImpl: Destory Runtime success
[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:54.575.090 [task_fail_callback_data_manager.cc:63] 618662 ~TaskFailCallBackManager: Destructor.
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.590.214 [plugin_old_arch.cc:25] 618670 DestructorRuntimeImpl: RuntimeImpl destructor success
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.590.248 [runtime_keeper.cc:167] 618670 DestoryRuntimeImpl: Destory Runtime success
[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:54.591.369 [task_fail_callback_data_manager.cc:63] 618670 ~TaskFailCallBackManager: Destructor.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:54.626.622 [stacktrace_signal.c:188](tid:618654) unregister all signo sigaction, can not capture signal.
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:54.644.216 [atrace_client_communication.c:141](tid:618654) send [end] msg.
[INFO] DRV(618654,python3.9):2025-04-03-09:27:54.666.801 [hdc_core.c:1982][ascend][curpid:618654,618654][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4208; pid=618654)
[INFO] IDEDD(618654,python3.9):2025-04-03-09:27:54.666.844 [hdc_api.cpp:671][tid:618654] connect succ, peer_node: 0, peer_devid: 2
[INFO] DRV(618654,python3.9):2025-04-03-09:27:54.667.026 [hdc_client.c:417][ascend][curpid:618654,618654][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4208)
[INFO] ATRACE(618654,python3.9):2025-04-03-09:27:54.667.089 [atrace_client_communication.c:164](tid:618654) send [end] msg success.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:54.677.151 [stacktrace_signal.c:188](tid:618662) unregister all signo sigaction, can not capture signal.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:54.695.643 [stacktrace_signal.c:188](tid:618670) unregister all signo sigaction, can not capture signal.
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:54.700.003 [atrace_client_communication.c:141](tid:618662) send [end] msg.
[INFO] DRV(618662,python3.9):2025-04-03-09:27:54.701.046 [hdc_core.c:1982][ascend][curpid:618662,618662][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4209; pid=618662)
[INFO] IDEDD(618662,python3.9):2025-04-03-09:27:54.701.075 [hdc_api.cpp:671][tid:618662] connect succ, peer_node: 0, peer_devid: 4
[INFO] DRV(618662,python3.9):2025-04-03-09:27:54.702.177 [hdc_client.c:417][ascend][curpid:618662,618662][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4209)
[INFO] ATRACE(618662,python3.9):2025-04-03-09:27:54.702.246 [atrace_client_communication.c:164](tid:618662) send [end] msg success.
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:54.773.720 [atrace_client_communication.c:141](tid:618670) send [end] msg.
[INFO] DRV(618670,python3.9):2025-04-03-09:27:54.775.395 [hdc_core.c:1982][ascend][curpid:618670,618670][drv][hdc][drvHdcSetSessionReference]Get pid number. (session=4210; pid=618670)
[INFO] IDEDD(618670,python3.9):2025-04-03-09:27:54.775.426 [hdc_api.cpp:671][tid:618670] connect succ, peer_node: 0, peer_devid: 6
[INFO] DRV(618670,python3.9):2025-04-03-09:27:54.777.516 [hdc_client.c:417][ascend][curpid:618670,618670][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4210)
[INFO] ATRACE(618670,python3.9):2025-04-03-09:27:54.777.587 [atrace_client_communication.c:164](tid:618670) send [end] msg success.
[INFO] DRV(618666,python3.9):2025-04-03-09:27:55.150.241 [hdc_client.c:417][ascend][curpid:618666,618797][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4147)
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:55.150.328 [atrace_client_core.c:127](tid:618797) atrace receive thread exited, devId=5.
[INFO] ATRACE(618666,python3.9):2025-04-03-09:27:55.150.913 [awatchdog_monitor.c:234](tid:618666) AwdMonitorExit
[INFO] DRV(618666,python3.9):2025-04-03-09:27:55.186.830 [uda_user.c:147][ascend][curpid:618666,618666][drv][devmng][uda_char_dev_open]The fd and pid info: (fd=3; pid=618666)
[INFO] DRV(618666,python3.9):2025-04-03-09:27:55.186.976 [uda_user.c:317][ascend][curpid:618666,618666][drv][devmng][_uda_init]User info. (admin_flag=1; local_flag=0; max_dev_num=100; max_udev_num=1124; uda_dev_num_davinci=8; uda_dev_num_kunpeng=0)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:55.210.234 [hdc_client.c:417][ascend][curpid:618674,618799][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4152)
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:55.210.302 [atrace_client_core.c:127](tid:618799) atrace receive thread exited, devId=7.
[INFO] ATRACE(618674,python3.9):2025-04-03-09:27:55.210.905 [awatchdog_monitor.c:234](tid:618674) AwdMonitorExit
[INFO] DRV(618674,python3.9):2025-04-03-09:27:55.252.540 [uda_user.c:147][ascend][curpid:618674,618674][drv][devmng][uda_char_dev_open]The fd and pid info: (fd=3; pid=618674)
[INFO] DRV(618674,python3.9):2025-04-03-09:27:55.252.711 [uda_user.c:317][ascend][curpid:618674,618674][drv][devmng][_uda_init]User info. (admin_flag=1; local_flag=0; max_dev_num=100; max_udev_num=1124; uda_dev_num_davinci=8; uda_dev_num_kunpeng=0)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:55.278.239 [hdc_client.c:417][ascend][curpid:618646,618825][drv][hdc][drvHdcClientSessionClose]Destroy client session. (sock=4177)
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:55.278.300 [atrace_client_core.c:127](tid:618825) atrace receive thread exited, devId=0.
[INFO] ATRACE(618646,python3.9):2025-04-03-09:27:55.278.745 [awatchdog_monitor.c:234](tid:618646) AwdMonitorExit
[INFO] DRV(618646,python3.9):2025-04-03-09:27:55.365.185 [uda_user.c:147][ascend][curpid:618646,618646][drv][devmng][uda_char_dev_open]The fd and pid info: (fd=3; pid=618646)
[INFO] DRV(618646,python3.9):2025-04-03-09:27:55.365.327 [uda_user.c:317][ascend][curpid:618646,618646][drv][devmng][_uda_init]User info. (admin_flag=1; local_flag=0; max_dev_num=100; max_udev_num=1124; uda_dev_num_davinci=8; uda_dev_num_kunpeng=0)
[ERROR] ME(618638:281473865735648,MainProcess):2025-04-03-09:27:55.567.355 [mindspore/parallel/cluster/process_entity/_api.py:335] Worker process 618666 exit with exception.
[WARNING] ME(618638:281473865735648,MainProcess):2025-04-03-09:27:55.567.691 [mindspore/parallel/cluster/process_entity/_api.py:341] There's worker exits with exception, kill all other workers.
[INFO] ME(618638:281473865735648,MainProcess):2025-04-03-09:27:55.568.712 [mindspore/parallel/cluster/process_entity/_api.py:357] Analyzing exception log...
[ERROR] ME(618638:281473865735648,MainProcess):2025-04-03-09:27:55.569.896 [mindspore/parallel/cluster/process_entity/_api.py:562] Time out nodes are []
./output_allreduce/worker_3.log-356-[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.602 [runtime.cc:5096] 618658 GetVisibleDevices: ASCEND_RT_VISIBLE_DEVICES param was not set
./output_allreduce/worker_3.log-357-[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.617 [runtime.cc:1173] 618658 InitApiImpile: ApiImpl:Runtime_alloc_size 8
./output_allreduce/worker_3.log-358-[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.629 [runtime.cc:1183] 618658 InitLogger: Logger:Runtime_alloc_size 32
./output_allreduce/worker_3.log-359-[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.651 [runtime.cc:1193] 618658 InitApiProfiler: RProfiler:Runtime_alloc_size 176
./output_allreduce/worker_3.log-360-[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.667 [profiler.cc:84] 618658 Init: Init ok, Runtime_alloc_size 48
./output_allreduce/worker_3.log:361:[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.688 [runtime.cc:1209] 618658 InitApiErrorDecorator: ApiErrorDecorator:Runtime_alloc_size 16.
./output_allreduce/worker_3.log-362-[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.714 [runtime.cc:1219] 618658 InitThreadGuard: Runtime init:new ThreadGuard ok, Runtime_alloc_size 104.
./output_allreduce/worker_3.log-363-[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.726 [runtime.cc:1230] 618658 InitStreamObserver: EngineStreamObserver:Runtime_alloc_size 8.
./output_allreduce/worker_3.log-364-[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.739 [runtime.cc:1242] 618658 InitAicpuStreamIdBitmap: Bitmap(1024):Runtime_alloc_size 72.
./output_allreduce/worker_3.log-365-[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.754 [runtime.cc:1264] 618658 InitCbSubscribe: The thread group num is 1024
./output_allreduce/worker_3.log-366-[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:26.106.768 [runtime.cc:1270] 618658 InitCbSubscribe: Runtime init:new CbSubscribe ok, Runtime_alloc_size 304.
--
./output_allreduce/worker_3.log-997-[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.027.767 [context.cpp:80]618658 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
./output_allreduce/worker_3.log-998-[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.027.790 [context.cpp:72]618658 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
./output_allreduce/worker_3.log-999-[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:39.027.809 [api_impl.cc:3717] 618658 ContextSetCurrent: set context=aaab0b9e09a0, flag=0.
./output_allreduce/worker_3.log-1000-[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.027.823 [context.cpp:80]618658 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
./output_allreduce/worker_3.log-1001-[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.027.978 [acl.cpp:288]618658 aclInit: start to execute aclInit
./output_allreduce/worker_3.log:1002:[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.028.015 [acl.cpp:298]618658 aclInit: call ErrorManager.Initialize
./output_allreduce/worker_3.log:1003:[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.028.107 [acl.cpp:242]618658 HandleErrorManagerConfig: err_msg mode is set ["1"].
./output_allreduce/worker_3.log-1004-[INFO] GE(618658,python3.9):2025-04-03-09:27:39.036.979 [error_manager.cc:673]618658 ParseJsonFile:Parse json file:/usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/../conf/error_manager/error_code.json success
./output_allreduce/worker_3.log-1005-[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:39.037.585 [acl.cpp:315]618658 aclInit: call ge interface executor.Initialize
./output_allreduce/worker_3.log-1006-[INFO] PROFILING(618658,python3.9):2025-04-03-09:27:39.037.649 [prof_atls_plugin.cpp:210] (tid:618658) Module[45] register callback of ctrl handle.
./output_allreduce/worker_3.log-1007-[INFO] GE(618658,python3.9):2025-04-03-09:27:39.037.688 [ge_executor.cc:273]618658 Initialize:Init GeExecutor begin.
./output_allreduce/worker_3.log-1008-[INFO] GE(618658,python3.9):2025-04-03-09:27:39.037.929 [op_lib_register.cc:117]618658 GetAllCustomOpApiSoPaths:value of env ASCEND_CUSTOM_OPP_PATH is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/ho
--
./output_allreduce/worker_3.log-8261-[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.838.781 [device_msg_handler.cc:110] 619017 HandleMsg: Begin to process device errMessage.
./output_allreduce/worker_3.log-8262-[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.839.563 [device_msg_handler.cc:127] 619017 HandleMsg: Finished to process device errInfo, retCode=0.
./output_allreduce/worker_3.log-8263-[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.839.622 [runtime.cc:5239] 619017 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
./output_allreduce/worker_3.log-8264-[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.839.662 [npu_driver.cc:500] 619017 GetFaultEvent: get fault event, device_id=3, filterFlag=8, outputLen=128.
./output_allreduce/worker_3.log-8265-[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.839.724 [acl.cpp:782]619017 GetFaultEventInfo: can not get fault event of device 3, runtime errorCode is 0
./output_allreduce/worker_3.log:8266:[INFO] GE(618658,python3.9):2025-04-03-09:27:47.839.756 [error_manager.cc:989]619017 GetRawErrorMessages:current work_stream_id:0
./output_allreduce/worker_3.log:8267:[CRITICAL] KERNEL(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.840.098 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
./output_allreduce/worker_3.log-8268-[INFO] DEBUG(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.840.150 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
./output_allreduce/worker_3.log-8269-[INFO] DEBUG(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.840.197 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
./output_allreduce/worker_3.log-8270-[INFO] DEBUG(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.840.216 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
./output_allreduce/worker_3.log-8271-[INFO] RUNTIME_FRAMEWORK(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.840.565 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.
./output_allreduce/worker_3.log-8272-
--
./output_allreduce/worker_3.log-8350-[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.842.691 [device_msg_handler.cc:110] 619017 HandleMsg: Begin to process device errMessage.
./output_allreduce/worker_3.log-8351-[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.843.067 [device_msg_handler.cc:127] 619017 HandleMsg: Finished to process device errInfo, retCode=0.
./output_allreduce/worker_3.log-8352-[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.843.100 [runtime.cc:5239] 619017 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
./output_allreduce/worker_3.log-8353-[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.843.132 [npu_driver.cc:500] 619017 GetFaultEvent: get fault event, device_id=3, filterFlag=8, outputLen=128.
./output_allreduce/worker_3.log-8354-[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.843.189 [acl.cpp:782]619017 GetFaultEventInfo: can not get fault event of device 3, runtime errorCode is 0
./output_allreduce/worker_3.log:8355:[INFO] GE(618658,python3.9):2025-04-03-09:27:47.843.209 [error_manager.cc:989]619017 GetRawErrorMessages:current work_stream_id:0
./output_allreduce/worker_3.log:8356:[CRITICAL] KERNEL(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.843.508 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
./output_allreduce/worker_3.log-8357-[INFO] DEBUG(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.843.542 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
./output_allreduce/worker_3.log-8358-[INFO] DEBUG(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.843.562 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
./output_allreduce/worker_3.log-8359-[INFO] DEBUG(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.843.579 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
./output_allreduce/worker_3.log-8360-[INFO] RUNTIME_FRAMEWORK(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.843.652 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.
./output_allreduce/worker_3.log-8361-
--
./output_allreduce/worker_3.log-8438-[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.845.678 [device_msg_handler.cc:110] 619017 HandleMsg: Begin to process device errMessage.
./output_allreduce/worker_3.log-8439-[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.846.056 [device_msg_handler.cc:127] 619017 HandleMsg: Finished to process device errInfo, retCode=0.
./output_allreduce/worker_3.log-8440-[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.846.090 [runtime.cc:5239] 619017 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=3, deviceId=3.
./output_allreduce/worker_3.log-8441-[INFO] RUNTIME(618658,python3.9):2025-04-03-09:27:47.846.112 [npu_driver.cc:500] 619017 GetFaultEvent: get fault event, device_id=3, filterFlag=8, outputLen=128.
./output_allreduce/worker_3.log-8442-[INFO] ASCENDCL(618658,python3.9):2025-04-03-09:27:47.846.170 [acl.cpp:782]619017 GetFaultEventInfo: can not get fault event of device 3, runtime errorCode is 0
./output_allreduce/worker_3.log:8443:[INFO] GE(618658,python3.9):2025-04-03-09:27:47.846.189 [error_manager.cc:989]619017 GetRawErrorMessages:current work_stream_id:0
./output_allreduce/worker_3.log:8444:[CRITICAL] KERNEL(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.846.487 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
./output_allreduce/worker_3.log-8445-[INFO] DEBUG(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.846.520 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
./output_allreduce/worker_3.log-8446-[INFO] DEBUG(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.846.542 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
./output_allreduce/worker_3.log-8447-[INFO] DEBUG(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.846.559 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
./output_allreduce/worker_3.log-8448-[INFO] RUNTIME_FRAMEWORK(618658,fffec6fdefa0,python3.9):2025-04-03-09:27:47.846.631 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.
./output_allreduce/worker_3.log-8449-
--
./output_allreduce/worker_3.log-8648-            [11.  2.]
./output_allreduce/worker_3.log-8649-        """
./output_allreduce/worker_3.log-8650-        if self.has_init:
./output_allreduce/worker_3.log-8651-            self.init_data()
./output_allreduce/worker_3.log-8652->       return TensorPy_.asnumpy(self)
./output_allreduce/worker_3.log:8653:E       RuntimeError: LCCL AllReduce failed.
./output_allreduce/worker_3.log-8654-E       
./output_allreduce/worker_3.log-8655-E       ----------------------------------------------------
./output_allreduce/worker_3.log-8656-E       - C++ Call Stack: (For framework developers)
./output_allreduce/worker_3.log-8657-E       ----------------------------------------------------
./output_allreduce/worker_3.log-8658-E       mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch
./output_allreduce/worker_3.log-8659-
./output_allreduce/worker_3.log:8660:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/common/tensor.py:989: RuntimeError
./output_allreduce/worker_3.log-8661-===================================================================================================================== warnings summary =====================================================================================================================
./output_allreduce/worker_3.log-8662-../../../../../../../../usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866
./output_allreduce/worker_3.log-8663-  /usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866: DeprecationWarning: invalid escape sequence \L
./output_allreduce/worker_3.log-8664-    if not dirpath.find("AppData\Local\Temp"):
./output_allreduce/worker_3.log-8665-
--
./output_allreduce/worker_3.log-8763-  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
./output_allreduce/worker_3.log-8764-    @fusion_manager.register("minmax_update_perlayer")
./output_allreduce/worker_3.log-8765-
./output_allreduce/worker_3.log-8766--- Docs: https://docs.pytest.org/en/stable/warnings.html
./output_allreduce/worker_3.log-8767-================================================================================================================= short test summary info ==================================================================================================================
./output_allreduce/worker_3.log:8768:FAILED test_lccl_allreduce.py::test_AllReduce - RuntimeError: LCCL AllReduce failed.
./output_allreduce/worker_3.log-8769-============================================================================================================= 1 failed, 26 warnings in 23.60s ==============================================================================================================
./output_allreduce/worker_3.log-8770-[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.426.394 [mindspore/ccsrc/pybind_api/init.cc:651] operator()] Start register...
./output_allreduce/worker_3.log-8771-[INFO] COMMON(618658,ffffb4df5de0,python3.9):2025-04-03-09:27:48.426.447 [mindspore/ccsrc/pybind_api/init.cc:654] operator()] Start mindspore.profiler...
./output_allreduce/worker_3.log-8772-[INFO] ME(618658:281473716280800,MainProcess):2025-04-03-09:27:48.426.531 [mindspore/profiler/envprofiler.py:57] analyse start
./output_allreduce/worker_3.log-8773-[INFO] ME(618658:281473716280800,MainProcess):2025-04-03-09:27:48.426.698 [mindspore/profiler/envprofiler.py:59] Profiler is not initialized, skip analyse.
--
./output_allreduce/worker_5.log-356-[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.205 [runtime.cc:5096] 618666 GetVisibleDevices: ASCEND_RT_VISIBLE_DEVICES param was not set
./output_allreduce/worker_5.log-357-[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.217 [runtime.cc:1173] 618666 InitApiImpile: ApiImpl:Runtime_alloc_size 8
./output_allreduce/worker_5.log-358-[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.229 [runtime.cc:1183] 618666 InitLogger: Logger:Runtime_alloc_size 32
./output_allreduce/worker_5.log-359-[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.244 [runtime.cc:1193] 618666 InitApiProfiler: RProfiler:Runtime_alloc_size 176
./output_allreduce/worker_5.log-360-[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.256 [profiler.cc:84] 618666 Init: Init ok, Runtime_alloc_size 48
./output_allreduce/worker_5.log:361:[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.272 [runtime.cc:1209] 618666 InitApiErrorDecorator: ApiErrorDecorator:Runtime_alloc_size 16.
./output_allreduce/worker_5.log-362-[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.297 [runtime.cc:1219] 618666 InitThreadGuard: Runtime init:new ThreadGuard ok, Runtime_alloc_size 104.
./output_allreduce/worker_5.log-363-[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.309 [runtime.cc:1230] 618666 InitStreamObserver: EngineStreamObserver:Runtime_alloc_size 8.
./output_allreduce/worker_5.log-364-[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.319 [runtime.cc:1242] 618666 InitAicpuStreamIdBitmap: Bitmap(1024):Runtime_alloc_size 72.
./output_allreduce/worker_5.log-365-[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.331 [runtime.cc:1264] 618666 InitCbSubscribe: The thread group num is 1024
./output_allreduce/worker_5.log-366-[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:26.173.340 [runtime.cc:1270] 618666 InitCbSubscribe: Runtime init:new CbSubscribe ok, Runtime_alloc_size 304.
--
./output_allreduce/worker_5.log-990-[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.558.404 [context.cpp:80]618666 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
./output_allreduce/worker_5.log-991-[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.558.421 [context.cpp:72]618666 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
./output_allreduce/worker_5.log-992-[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:41.558.435 [api_impl.cc:3717] 618666 ContextSetCurrent: set context=aaaaf6e2dcc0, flag=0.
./output_allreduce/worker_5.log-993-[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.558.447 [context.cpp:80]618666 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
./output_allreduce/worker_5.log-994-[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.558.601 [acl.cpp:288]618666 aclInit: start to execute aclInit
./output_allreduce/worker_5.log:995:[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.558.624 [acl.cpp:298]618666 aclInit: call ErrorManager.Initialize
./output_allreduce/worker_5.log:996:[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.558.713 [acl.cpp:242]618666 HandleErrorManagerConfig: err_msg mode is set ["1"].
./output_allreduce/worker_5.log-997-[INFO] GE(618666,python3.9):2025-04-03-09:27:41.567.493 [error_manager.cc:673]618666 ParseJsonFile:Parse json file:/usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/../conf/error_manager/error_code.json success
./output_allreduce/worker_5.log-998-[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:41.568.253 [acl.cpp:315]618666 aclInit: call ge interface executor.Initialize
./output_allreduce/worker_5.log-999-[INFO] PROFILING(618666,python3.9):2025-04-03-09:27:41.568.305 [prof_atls_plugin.cpp:210] (tid:618666) Module[45] register callback of ctrl handle.
./output_allreduce/worker_5.log-1000-[INFO] GE(618666,python3.9):2025-04-03-09:27:41.568.326 [ge_executor.cc:273]618666 Initialize:Init GeExecutor begin.
./output_allreduce/worker_5.log-1001-[INFO] GE(618666,python3.9):2025-04-03-09:27:41.568.381 [op_lib_register.cc:117]618666 GetAllCustomOpApiSoPaths:value of env ASCEND_CUSTOM_OPP_PATH is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/ho
--
./output_allreduce/worker_5.log-8043-[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.843.607 [device_msg_handler.cc:110] 619018 HandleMsg: Begin to process device errMessage.
./output_allreduce/worker_5.log-8044-[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.844.331 [device_msg_handler.cc:127] 619018 HandleMsg: Finished to process device errInfo, retCode=0.
./output_allreduce/worker_5.log-8045-[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.844.389 [runtime.cc:5239] 619018 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
./output_allreduce/worker_5.log-8046-[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.844.424 [npu_driver.cc:500] 619018 GetFaultEvent: get fault event, device_id=5, filterFlag=8, outputLen=128.
./output_allreduce/worker_5.log-8047-[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.844.493 [acl.cpp:782]619018 GetFaultEventInfo: can not get fault event of device 5, runtime errorCode is 0
./output_allreduce/worker_5.log:8048:[INFO] GE(618666,python3.9):2025-04-03-09:27:47.844.516 [error_manager.cc:989]619018 GetRawErrorMessages:current work_stream_id:0
./output_allreduce/worker_5.log:8049:[CRITICAL] KERNEL(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.844.837 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
./output_allreduce/worker_5.log-8050-[INFO] DEBUG(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.844.876 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
./output_allreduce/worker_5.log-8051-[INFO] DEBUG(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.844.899 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
./output_allreduce/worker_5.log-8052-[INFO] DEBUG(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.844.917 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
./output_allreduce/worker_5.log-8053-[INFO] RUNTIME_FRAMEWORK(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.845.200 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.
./output_allreduce/worker_5.log-8054-
--
./output_allreduce/worker_5.log-8134-[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.847.133 [device_msg_handler.cc:110] 619018 HandleMsg: Begin to process device errMessage.
./output_allreduce/worker_5.log-8135-[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.847.428 [device_msg_handler.cc:127] 619018 HandleMsg: Finished to process device errInfo, retCode=0.
./output_allreduce/worker_5.log-8136-[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.847.465 [runtime.cc:5239] 619018 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
./output_allreduce/worker_5.log-8137-[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.847.487 [npu_driver.cc:500] 619018 GetFaultEvent: get fault event, device_id=5, filterFlag=8, outputLen=128.
./output_allreduce/worker_5.log-8138-[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.847.541 [acl.cpp:782]619018 GetFaultEventInfo: can not get fault event of device 5, runtime errorCode is 0
./output_allreduce/worker_5.log:8139:[INFO] GE(618666,python3.9):2025-04-03-09:27:47.847.555 [error_manager.cc:989]619018 GetRawErrorMessages:current work_stream_id:0
./output_allreduce/worker_5.log:8140:[CRITICAL] KERNEL(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.847.837 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
./output_allreduce/worker_5.log-8141-[INFO] DEBUG(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.847.869 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
./output_allreduce/worker_5.log-8142-[INFO] DEBUG(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.847.886 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
./output_allreduce/worker_5.log-8143-[INFO] DEBUG(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.847.900 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
./output_allreduce/worker_5.log-8144-[INFO] RUNTIME_FRAMEWORK(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.847.967 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.
./output_allreduce/worker_5.log-8145-
--
./output_allreduce/worker_5.log-8222-[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.849.855 [device_msg_handler.cc:110] 619018 HandleMsg: Begin to process device errMessage.
./output_allreduce/worker_5.log-8223-[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.850.146 [device_msg_handler.cc:127] 619018 HandleMsg: Finished to process device errInfo, retCode=0.
./output_allreduce/worker_5.log-8224-[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.850.177 [runtime.cc:5239] 619018 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=5, deviceId=5.
./output_allreduce/worker_5.log-8225-[INFO] RUNTIME(618666,python3.9):2025-04-03-09:27:47.850.197 [npu_driver.cc:500] 619018 GetFaultEvent: get fault event, device_id=5, filterFlag=8, outputLen=128.
./output_allreduce/worker_5.log-8226-[INFO] ASCENDCL(618666,python3.9):2025-04-03-09:27:47.850.251 [acl.cpp:782]619018 GetFaultEventInfo: can not get fault event of device 5, runtime errorCode is 0
./output_allreduce/worker_5.log:8227:[INFO] GE(618666,python3.9):2025-04-03-09:27:47.850.267 [error_manager.cc:989]619018 GetRawErrorMessages:current work_stream_id:0
./output_allreduce/worker_5.log:8228:[CRITICAL] KERNEL(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.850.557 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
./output_allreduce/worker_5.log-8229-[INFO] DEBUG(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.850.588 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
./output_allreduce/worker_5.log-8230-[INFO] DEBUG(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.850.606 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
./output_allreduce/worker_5.log-8231-[INFO] DEBUG(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.850.621 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
./output_allreduce/worker_5.log-8232-[INFO] RUNTIME_FRAMEWORK(618666,fffeb0f9efa0,python3.9):2025-04-03-09:27:47.850.687 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.
./output_allreduce/worker_5.log-8233-
--
./output_allreduce/worker_5.log-8432-            [11.  2.]
./output_allreduce/worker_5.log-8433-        """
./output_allreduce/worker_5.log-8434-        if self.has_init:
./output_allreduce/worker_5.log-8435-            self.init_data()
./output_allreduce/worker_5.log-8436->       return TensorPy_.asnumpy(self)
./output_allreduce/worker_5.log:8437:E       RuntimeError: LCCL AllReduce failed.
./output_allreduce/worker_5.log-8438-E       
./output_allreduce/worker_5.log-8439-E       ----------------------------------------------------
./output_allreduce/worker_5.log-8440-E       - C++ Call Stack: (For framework developers)
./output_allreduce/worker_5.log-8441-E       ----------------------------------------------------
./output_allreduce/worker_5.log-8442-E       mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch
./output_allreduce/worker_5.log-8443-
./output_allreduce/worker_5.log:8444:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/common/tensor.py:989: RuntimeError
./output_allreduce/worker_5.log-8445-===================================================================================================================== warnings summary =====================================================================================================================
./output_allreduce/worker_5.log-8446-../../../../../../../../usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866
./output_allreduce/worker_5.log-8447-  /usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866: DeprecationWarning: invalid escape sequence \L
./output_allreduce/worker_5.log-8448-    if not dirpath.find("AppData\Local\Temp"):
./output_allreduce/worker_5.log-8449-
--
./output_allreduce/worker_5.log-8547-  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
./output_allreduce/worker_5.log-8548-    @fusion_manager.register("minmax_update_perlayer")
./output_allreduce/worker_5.log-8549-
./output_allreduce/worker_5.log-8550--- Docs: https://docs.pytest.org/en/stable/warnings.html
./output_allreduce/worker_5.log-8551-================================================================================================================= short test summary info ==================================================================================================================
./output_allreduce/worker_5.log:8552:FAILED test_lccl_allreduce.py::test_AllReduce - RuntimeError: LCCL AllReduce failed.
./output_allreduce/worker_5.log-8553-============================================================================================================= 1 failed, 26 warnings in 23.51s ==============================================================================================================
./output_allreduce/worker_5.log-8554-[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.435.900 [mindspore/ccsrc/pybind_api/init.cc:651] operator()] Start register...
./output_allreduce/worker_5.log-8555-[INFO] COMMON(618666,ffff8e3aede0,python3.9):2025-04-03-09:27:48.435.937 [mindspore/ccsrc/pybind_api/init.cc:654] operator()] Start mindspore.profiler...
./output_allreduce/worker_5.log-8556-[INFO] ME(618666:281473067970016,MainProcess):2025-04-03-09:27:48.436.012 [mindspore/profiler/envprofiler.py:57] analyse start
./output_allreduce/worker_5.log-8557-[INFO] ME(618666:281473067970016,MainProcess):2025-04-03-09:27:48.436.182 [mindspore/profiler/envprofiler.py:59] Profiler is not initialized, skip analyse.
--
./output_allreduce/worker_6.log-356-[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.233 [runtime.cc:5096] 618670 GetVisibleDevices: ASCEND_RT_VISIBLE_DEVICES param was not set
./output_allreduce/worker_6.log-357-[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.244 [runtime.cc:1173] 618670 InitApiImpile: ApiImpl:Runtime_alloc_size 8
./output_allreduce/worker_6.log-358-[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.256 [runtime.cc:1183] 618670 InitLogger: Logger:Runtime_alloc_size 32
./output_allreduce/worker_6.log-359-[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.268 [runtime.cc:1193] 618670 InitApiProfiler: RProfiler:Runtime_alloc_size 176
./output_allreduce/worker_6.log-360-[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.279 [profiler.cc:84] 618670 Init: Init ok, Runtime_alloc_size 48
./output_allreduce/worker_6.log:361:[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.296 [runtime.cc:1209] 618670 InitApiErrorDecorator: ApiErrorDecorator:Runtime_alloc_size 16.
./output_allreduce/worker_6.log-362-[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.317 [runtime.cc:1219] 618670 InitThreadGuard: Runtime init:new ThreadGuard ok, Runtime_alloc_size 104.
./output_allreduce/worker_6.log-363-[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.329 [runtime.cc:1230] 618670 InitStreamObserver: EngineStreamObserver:Runtime_alloc_size 8.
./output_allreduce/worker_6.log-364-[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.340 [runtime.cc:1242] 618670 InitAicpuStreamIdBitmap: Bitmap(1024):Runtime_alloc_size 72.
./output_allreduce/worker_6.log-365-[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.352 [runtime.cc:1264] 618670 InitCbSubscribe: The thread group num is 1024
./output_allreduce/worker_6.log-366-[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:26.173.363 [runtime.cc:1270] 618670 InitCbSubscribe: Runtime init:new CbSubscribe ok, Runtime_alloc_size 304.
--
./output_allreduce/worker_6.log-993-[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.663.312 [context.cpp:80]618670 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
./output_allreduce/worker_6.log-994-[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.663.349 [context.cpp:72]618670 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
./output_allreduce/worker_6.log-995-[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:41.663.368 [api_impl.cc:3717] 618670 ContextSetCurrent: set context=aaaad9a630c0, flag=0.
./output_allreduce/worker_6.log-996-[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.663.381 [context.cpp:80]618670 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
./output_allreduce/worker_6.log-997-[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.663.533 [acl.cpp:288]618670 aclInit: start to execute aclInit
./output_allreduce/worker_6.log:998:[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.663.575 [acl.cpp:298]618670 aclInit: call ErrorManager.Initialize
./output_allreduce/worker_6.log:999:[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.663.686 [acl.cpp:242]618670 HandleErrorManagerConfig: err_msg mode is set ["1"].
./output_allreduce/worker_6.log-1000-[INFO] GE(618670,python3.9):2025-04-03-09:27:41.672.692 [error_manager.cc:673]618670 ParseJsonFile:Parse json file:/usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/../conf/error_manager/error_code.json success
./output_allreduce/worker_6.log-1001-[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:41.673.449 [acl.cpp:315]618670 aclInit: call ge interface executor.Initialize
./output_allreduce/worker_6.log-1002-[INFO] PROFILING(618670,python3.9):2025-04-03-09:27:41.673.515 [prof_atls_plugin.cpp:210] (tid:618670) Module[45] register callback of ctrl handle.
./output_allreduce/worker_6.log-1003-[INFO] GE(618670,python3.9):2025-04-03-09:27:41.673.564 [ge_executor.cc:273]618670 Initialize:Init GeExecutor begin.
./output_allreduce/worker_6.log-1004-[INFO] GE(618670,python3.9):2025-04-03-09:27:41.673.621 [op_lib_register.cc:117]618670 GetAllCustomOpApiSoPaths:value of env ASCEND_CUSTOM_OPP_PATH is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/ho
--
./output_allreduce/worker_6.log-8046-[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.836.279 [device_msg_handler.cc:110] 619015 HandleMsg: Begin to process device errMessage.
./output_allreduce/worker_6.log-8047-[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.837.067 [device_msg_handler.cc:127] 619015 HandleMsg: Finished to process device errInfo, retCode=0.
./output_allreduce/worker_6.log-8048-[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.837.119 [runtime.cc:5239] 619015 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
./output_allreduce/worker_6.log-8049-[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.837.153 [npu_driver.cc:500] 619015 GetFaultEvent: get fault event, device_id=6, filterFlag=8, outputLen=128.
./output_allreduce/worker_6.log-8050-[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.837.220 [acl.cpp:782]619015 GetFaultEventInfo: can not get fault event of device 6, runtime errorCode is 0
./output_allreduce/worker_6.log:8051:[INFO] GE(618670,python3.9):2025-04-03-09:27:47.837.249 [error_manager.cc:989]619015 GetRawErrorMessages:current work_stream_id:0
./output_allreduce/worker_6.log:8052:[CRITICAL] KERNEL(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.837.606 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
./output_allreduce/worker_6.log-8053-[INFO] DEBUG(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.837.651 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
./output_allreduce/worker_6.log-8054-[INFO] DEBUG(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.837.675 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
./output_allreduce/worker_6.log-8055-[INFO] DEBUG(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.837.694 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
./output_allreduce/worker_6.log-8056-[INFO] RUNTIME_FRAMEWORK(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.838.002 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.
./output_allreduce/worker_6.log-8057-
--
./output_allreduce/worker_6.log-8135-[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.840.086 [device_msg_handler.cc:110] 619015 HandleMsg: Begin to process device errMessage.
./output_allreduce/worker_6.log-8136-[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.840.471 [device_msg_handler.cc:127] 619015 HandleMsg: Finished to process device errInfo, retCode=0.
./output_allreduce/worker_6.log-8137-[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.840.508 [runtime.cc:5239] 619015 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
./output_allreduce/worker_6.log-8138-[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.840.532 [npu_driver.cc:500] 619015 GetFaultEvent: get fault event, device_id=6, filterFlag=8, outputLen=128.
./output_allreduce/worker_6.log-8139-[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.840.589 [acl.cpp:782]619015 GetFaultEventInfo: can not get fault event of device 6, runtime errorCode is 0
./output_allreduce/worker_6.log:8140:[INFO] GE(618670,python3.9):2025-04-03-09:27:47.840.608 [error_manager.cc:989]619015 GetRawErrorMessages:current work_stream_id:0
./output_allreduce/worker_6.log:8141:[CRITICAL] KERNEL(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.840.927 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
./output_allreduce/worker_6.log-8142-[INFO] DEBUG(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.840.962 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
./output_allreduce/worker_6.log-8143-[INFO] DEBUG(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.840.981 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
./output_allreduce/worker_6.log-8144-[INFO] DEBUG(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.841.001 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
./output_allreduce/worker_6.log-8145-[INFO] RUNTIME_FRAMEWORK(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.841.071 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.
./output_allreduce/worker_6.log-8146-
--
./output_allreduce/worker_6.log-8223-[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.843.095 [device_msg_handler.cc:110] 619015 HandleMsg: Begin to process device errMessage.
./output_allreduce/worker_6.log-8224-[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.843.471 [device_msg_handler.cc:127] 619015 HandleMsg: Finished to process device errInfo, retCode=0.
./output_allreduce/worker_6.log-8225-[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.843.504 [runtime.cc:5239] 619015 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=6, deviceId=6.
./output_allreduce/worker_6.log-8226-[INFO] RUNTIME(618670,python3.9):2025-04-03-09:27:47.843.526 [npu_driver.cc:500] 619015 GetFaultEvent: get fault event, device_id=6, filterFlag=8, outputLen=128.
./output_allreduce/worker_6.log-8227-[INFO] ASCENDCL(618670,python3.9):2025-04-03-09:27:47.843.579 [acl.cpp:782]619015 GetFaultEventInfo: can not get fault event of device 6, runtime errorCode is 0
./output_allreduce/worker_6.log:8228:[INFO] GE(618670,python3.9):2025-04-03-09:27:47.843.597 [error_manager.cc:989]619015 GetRawErrorMessages:current work_stream_id:0
./output_allreduce/worker_6.log:8229:[CRITICAL] KERNEL(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.843.894 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
./output_allreduce/worker_6.log-8230-[INFO] DEBUG(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.843.925 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
./output_allreduce/worker_6.log-8231-[INFO] DEBUG(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.843.947 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
./output_allreduce/worker_6.log-8232-[INFO] DEBUG(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.843.964 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
./output_allreduce/worker_6.log-8233-[INFO] RUNTIME_FRAMEWORK(618670,fffec5fbefa0,python3.9):2025-04-03-09:27:47.844.028 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.
./output_allreduce/worker_6.log-8234-
--
./output_allreduce/worker_6.log-8433-            [11.  2.]
./output_allreduce/worker_6.log-8434-        """
./output_allreduce/worker_6.log-8435-        if self.has_init:
./output_allreduce/worker_6.log-8436-            self.init_data()
./output_allreduce/worker_6.log-8437->       return TensorPy_.asnumpy(self)
./output_allreduce/worker_6.log:8438:E       RuntimeError: LCCL AllReduce failed.
./output_allreduce/worker_6.log-8439-E       
./output_allreduce/worker_6.log-8440-E       ----------------------------------------------------
./output_allreduce/worker_6.log-8441-E       - C++ Call Stack: (For framework developers)
./output_allreduce/worker_6.log-8442-E       ----------------------------------------------------
./output_allreduce/worker_6.log-8443-E       mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch
./output_allreduce/worker_6.log-8444-
./output_allreduce/worker_6.log:8445:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/common/tensor.py:989: RuntimeError
./output_allreduce/worker_6.log-8446-===================================================================================================================== warnings summary =====================================================================================================================
./output_allreduce/worker_6.log-8447-../../../../../../../../usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866
./output_allreduce/worker_6.log-8448-  /usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866: DeprecationWarning: invalid escape sequence \L
./output_allreduce/worker_6.log-8449-    if not dirpath.find("AppData\Local\Temp"):
./output_allreduce/worker_6.log-8450-
--
./output_allreduce/worker_6.log-8548-  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
./output_allreduce/worker_6.log-8549-    @fusion_manager.register("minmax_update_perlayer")
./output_allreduce/worker_6.log-8550-
./output_allreduce/worker_6.log-8551--- Docs: https://docs.pytest.org/en/stable/warnings.html
./output_allreduce/worker_6.log-8552-================================================================================================================= short test summary info ==================================================================================================================
./output_allreduce/worker_6.log:8553:FAILED test_lccl_allreduce.py::test_AllReduce - RuntimeError: LCCL AllReduce failed.
./output_allreduce/worker_6.log-8554-============================================================================================================= 1 failed, 26 warnings in 23.48s ==============================================================================================================
./output_allreduce/worker_6.log-8555-[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.442.351 [mindspore/ccsrc/pybind_api/init.cc:651] operator()] Start register...
./output_allreduce/worker_6.log-8556-[INFO] COMMON(618670,ffffab5c5de0,python3.9):2025-04-03-09:27:48.442.393 [mindspore/ccsrc/pybind_api/init.cc:654] operator()] Start mindspore.profiler...
./output_allreduce/worker_6.log-8557-[INFO] ME(618670:281473556700640,MainProcess):2025-04-03-09:27:48.442.473 [mindspore/profiler/envprofiler.py:57] analyse start
./output_allreduce/worker_6.log-8558-[INFO] ME(618670:281473556700640,MainProcess):2025-04-03-09:27:48.442.636 [mindspore/profiler/envprofiler.py:59] Profiler is not initialized, skip analyse.
--
./output_allreduce/worker_4.log-356-[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.398 [runtime.cc:5096] 618662 GetVisibleDevices: ASCEND_RT_VISIBLE_DEVICES param was not set
./output_allreduce/worker_4.log-357-[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.412 [runtime.cc:1173] 618662 InitApiImpile: ApiImpl:Runtime_alloc_size 8
./output_allreduce/worker_4.log-358-[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.426 [runtime.cc:1183] 618662 InitLogger: Logger:Runtime_alloc_size 32
./output_allreduce/worker_4.log-359-[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.445 [runtime.cc:1193] 618662 InitApiProfiler: RProfiler:Runtime_alloc_size 176
./output_allreduce/worker_4.log-360-[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.460 [profiler.cc:84] 618662 Init: Init ok, Runtime_alloc_size 48
./output_allreduce/worker_4.log:361:[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.480 [runtime.cc:1209] 618662 InitApiErrorDecorator: ApiErrorDecorator:Runtime_alloc_size 16.
./output_allreduce/worker_4.log-362-[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.505 [runtime.cc:1219] 618662 InitThreadGuard: Runtime init:new ThreadGuard ok, Runtime_alloc_size 104.
./output_allreduce/worker_4.log-363-[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.517 [runtime.cc:1230] 618662 InitStreamObserver: EngineStreamObserver:Runtime_alloc_size 8.
./output_allreduce/worker_4.log-364-[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.530 [runtime.cc:1242] 618662 InitAicpuStreamIdBitmap: Bitmap(1024):Runtime_alloc_size 72.
./output_allreduce/worker_4.log-365-[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.544 [runtime.cc:1264] 618662 InitCbSubscribe: The thread group num is 1024
./output_allreduce/worker_4.log-366-[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:26.120.558 [runtime.cc:1270] 618662 InitCbSubscribe: Runtime init:new CbSubscribe ok, Runtime_alloc_size 304.
--
./output_allreduce/worker_4.log-995-[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.633.327 [context.cpp:80]618662 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
./output_allreduce/worker_4.log-996-[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.633.351 [context.cpp:72]618662 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
./output_allreduce/worker_4.log-997-[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:41.633.369 [api_impl.cc:3717] 618662 ContextSetCurrent: set context=aaab087d6320, flag=0.
./output_allreduce/worker_4.log-998-[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.633.381 [context.cpp:80]618662 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
./output_allreduce/worker_4.log-999-[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.633.533 [acl.cpp:288]618662 aclInit: start to execute aclInit
./output_allreduce/worker_4.log:1000:[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.633.573 [acl.cpp:298]618662 aclInit: call ErrorManager.Initialize
./output_allreduce/worker_4.log:1001:[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.633.685 [acl.cpp:242]618662 HandleErrorManagerConfig: err_msg mode is set ["1"].
./output_allreduce/worker_4.log-1002-[INFO] GE(618662,python3.9):2025-04-03-09:27:41.642.877 [error_manager.cc:673]618662 ParseJsonFile:Parse json file:/usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/../conf/error_manager/error_code.json success
./output_allreduce/worker_4.log-1003-[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:41.643.630 [acl.cpp:315]618662 aclInit: call ge interface executor.Initialize
./output_allreduce/worker_4.log-1004-[INFO] PROFILING(618662,python3.9):2025-04-03-09:27:41.643.708 [prof_atls_plugin.cpp:210] (tid:618662) Module[45] register callback of ctrl handle.
./output_allreduce/worker_4.log-1005-[INFO] GE(618662,python3.9):2025-04-03-09:27:41.643.768 [ge_executor.cc:273]618662 Initialize:Init GeExecutor begin.
./output_allreduce/worker_4.log-1006-[INFO] GE(618662,python3.9):2025-04-03-09:27:41.643.837 [op_lib_register.cc:117]618662 GetAllCustomOpApiSoPaths:value of env ASCEND_CUSTOM_OPP_PATH is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/ho
--
./output_allreduce/worker_4.log-8047-[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.851.921 [device_msg_handler.cc:110] 619021 HandleMsg: Begin to process device errMessage.
./output_allreduce/worker_4.log-8048-[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.852.668 [device_msg_handler.cc:127] 619021 HandleMsg: Finished to process device errInfo, retCode=0.
./output_allreduce/worker_4.log-8049-[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.852.724 [runtime.cc:5239] 619021 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
./output_allreduce/worker_4.log-8050-[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.852.759 [npu_driver.cc:500] 619021 GetFaultEvent: get fault event, device_id=4, filterFlag=8, outputLen=128.
./output_allreduce/worker_4.log-8051-[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.852.824 [acl.cpp:782]619021 GetFaultEventInfo: can not get fault event of device 4, runtime errorCode is 0
./output_allreduce/worker_4.log:8052:[INFO] GE(618662,python3.9):2025-04-03-09:27:47.852.851 [error_manager.cc:989]619021 GetRawErrorMessages:current work_stream_id:0
./output_allreduce/worker_4.log:8053:[CRITICAL] KERNEL(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.853.174 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
./output_allreduce/worker_4.log-8054-[INFO] DEBUG(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.853.214 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
./output_allreduce/worker_4.log-8055-[INFO] DEBUG(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.853.237 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
./output_allreduce/worker_4.log-8056-[INFO] DEBUG(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.853.268 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
./output_allreduce/worker_4.log-8057-[INFO] RUNTIME_FRAMEWORK(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.853.480 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.
./output_allreduce/worker_4.log-8058-
--
./output_allreduce/worker_4.log-8136-[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.855.592 [device_msg_handler.cc:110] 619021 HandleMsg: Begin to process device errMessage.
./output_allreduce/worker_4.log-8137-[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.855.908 [device_msg_handler.cc:127] 619021 HandleMsg: Finished to process device errInfo, retCode=0.
./output_allreduce/worker_4.log-8138-[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.855.942 [runtime.cc:5239] 619021 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
./output_allreduce/worker_4.log-8139-[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.855.964 [npu_driver.cc:500] 619021 GetFaultEvent: get fault event, device_id=4, filterFlag=8, outputLen=128.
./output_allreduce/worker_4.log-8140-[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.856.022 [acl.cpp:782]619021 GetFaultEventInfo: can not get fault event of device 4, runtime errorCode is 0
./output_allreduce/worker_4.log:8141:[INFO] GE(618662,python3.9):2025-04-03-09:27:47.856.040 [error_manager.cc:989]619021 GetRawErrorMessages:current work_stream_id:0
./output_allreduce/worker_4.log:8142:[CRITICAL] KERNEL(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.856.357 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
./output_allreduce/worker_4.log-8143-[INFO] DEBUG(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.856.391 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
./output_allreduce/worker_4.log-8144-[INFO] DEBUG(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.856.414 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
./output_allreduce/worker_4.log-8145-[INFO] DEBUG(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.856.431 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
./output_allreduce/worker_4.log-8146-[INFO] RUNTIME_FRAMEWORK(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.856.504 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.
./output_allreduce/worker_4.log-8147-
--
./output_allreduce/worker_4.log-8224-[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.858.598 [device_msg_handler.cc:110] 619021 HandleMsg: Begin to process device errMessage.
./output_allreduce/worker_4.log-8225-[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.858.913 [device_msg_handler.cc:127] 619021 HandleMsg: Finished to process device errInfo, retCode=0.
./output_allreduce/worker_4.log-8226-[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.858.947 [runtime.cc:5239] 619021 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=4, deviceId=4.
./output_allreduce/worker_4.log-8227-[INFO] RUNTIME(618662,python3.9):2025-04-03-09:27:47.858.968 [npu_driver.cc:500] 619021 GetFaultEvent: get fault event, device_id=4, filterFlag=8, outputLen=128.
./output_allreduce/worker_4.log-8228-[INFO] ASCENDCL(618662,python3.9):2025-04-03-09:27:47.859.025 [acl.cpp:782]619021 GetFaultEventInfo: can not get fault event of device 4, runtime errorCode is 0
./output_allreduce/worker_4.log:8229:[INFO] GE(618662,python3.9):2025-04-03-09:27:47.859.044 [error_manager.cc:989]619021 GetRawErrorMessages:current work_stream_id:0
./output_allreduce/worker_4.log:8230:[CRITICAL] KERNEL(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.859.339 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
./output_allreduce/worker_4.log-8231-[INFO] DEBUG(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.859.372 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
./output_allreduce/worker_4.log-8232-[INFO] DEBUG(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.859.393 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
./output_allreduce/worker_4.log-8233-[INFO] DEBUG(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.859.411 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
./output_allreduce/worker_4.log-8234-[INFO] RUNTIME_FRAMEWORK(618662,fffed17aefa0,python3.9):2025-04-03-09:27:47.859.484 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.
./output_allreduce/worker_4.log-8235-
--
./output_allreduce/worker_4.log-8433-            [11.  2.]
./output_allreduce/worker_4.log-8434-        """
./output_allreduce/worker_4.log-8435-        if self.has_init:
./output_allreduce/worker_4.log-8436-            self.init_data()
./output_allreduce/worker_4.log-8437->       return TensorPy_.asnumpy(self)
./output_allreduce/worker_4.log:8438:E       RuntimeError: LCCL AllReduce failed.
./output_allreduce/worker_4.log-8439-E       
./output_allreduce/worker_4.log-8440-E       ----------------------------------------------------
./output_allreduce/worker_4.log-8441-E       - C++ Call Stack: (For framework developers)
./output_allreduce/worker_4.log-8442-E       ----------------------------------------------------
./output_allreduce/worker_4.log-8443-E       mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch
./output_allreduce/worker_4.log-8444-
./output_allreduce/worker_4.log:8445:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/common/tensor.py:989: RuntimeError
./output_allreduce/worker_4.log-8446-===================================================================================================================== warnings summary =====================================================================================================================
./output_allreduce/worker_4.log-8447-../../../../../../../../usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866
./output_allreduce/worker_4.log-8448-  /usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866: DeprecationWarning: invalid escape sequence \L
./output_allreduce/worker_4.log-8449-    if not dirpath.find("AppData\Local\Temp"):
./output_allreduce/worker_4.log-8450-
--
./output_allreduce/worker_4.log-8548-  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
./output_allreduce/worker_4.log-8549-    @fusion_manager.register("minmax_update_perlayer")
./output_allreduce/worker_4.log-8550-
./output_allreduce/worker_4.log-8551--- Docs: https://docs.pytest.org/en/stable/warnings.html
./output_allreduce/worker_4.log-8552-================================================================================================================= short test summary info ==================================================================================================================
./output_allreduce/worker_4.log:8553:FAILED test_lccl_allreduce.py::test_AllReduce - RuntimeError: LCCL AllReduce failed.
./output_allreduce/worker_4.log-8554-============================================================================================================= 1 failed, 26 warnings in 23.57s ==============================================================================================================
./output_allreduce/worker_4.log-8555-[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.442.029 [mindspore/ccsrc/pybind_api/init.cc:651] operator()] Start register...
./output_allreduce/worker_4.log-8556-[INFO] COMMON(618662,ffffb6c50de0,python3.9):2025-04-03-09:27:48.442.069 [mindspore/ccsrc/pybind_api/init.cc:654] operator()] Start mindspore.profiler...
./output_allreduce/worker_4.log-8557-[INFO] ME(618662:281473748110816,MainProcess):2025-04-03-09:27:48.442.144 [mindspore/profiler/envprofiler.py:57] analyse start
./output_allreduce/worker_4.log-8558-[INFO] ME(618662:281473748110816,MainProcess):2025-04-03-09:27:48.442.302 [mindspore/profiler/envprofiler.py:59] Profiler is not initialized, skip analyse.
--
./output_allreduce/worker_1.log-356-[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.595 [runtime.cc:5096] 618650 GetVisibleDevices: ASCEND_RT_VISIBLE_DEVICES param was not set
./output_allreduce/worker_1.log-357-[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.612 [runtime.cc:1173] 618650 InitApiImpile: ApiImpl:Runtime_alloc_size 8
./output_allreduce/worker_1.log-358-[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.625 [runtime.cc:1183] 618650 InitLogger: Logger:Runtime_alloc_size 32
./output_allreduce/worker_1.log-359-[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.643 [runtime.cc:1193] 618650 InitApiProfiler: RProfiler:Runtime_alloc_size 176
./output_allreduce/worker_1.log-360-[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.660 [profiler.cc:84] 618650 Init: Init ok, Runtime_alloc_size 48
./output_allreduce/worker_1.log:361:[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.680 [runtime.cc:1209] 618650 InitApiErrorDecorator: ApiErrorDecorator:Runtime_alloc_size 16.
./output_allreduce/worker_1.log-362-[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.712 [runtime.cc:1219] 618650 InitThreadGuard: Runtime init:new ThreadGuard ok, Runtime_alloc_size 104.
./output_allreduce/worker_1.log-363-[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.727 [runtime.cc:1230] 618650 InitStreamObserver: EngineStreamObserver:Runtime_alloc_size 8.
./output_allreduce/worker_1.log-364-[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.740 [runtime.cc:1242] 618650 InitAicpuStreamIdBitmap: Bitmap(1024):Runtime_alloc_size 72.
./output_allreduce/worker_1.log-365-[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.756 [runtime.cc:1264] 618650 InitCbSubscribe: The thread group num is 1024
./output_allreduce/worker_1.log-366-[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:26.003.772 [runtime.cc:1270] 618650 InitCbSubscribe: Runtime init:new CbSubscribe ok, Runtime_alloc_size 304.
--
./output_allreduce/worker_1.log-994-[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.754.096 [context.cpp:80]618650 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
./output_allreduce/worker_1.log-995-[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.754.120 [context.cpp:72]618650 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
./output_allreduce/worker_1.log-996-[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:41.754.137 [api_impl.cc:3717] 618650 ContextSetCurrent: set context=aaab312ab590, flag=0.
./output_allreduce/worker_1.log-997-[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.754.150 [context.cpp:80]618650 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
./output_allreduce/worker_1.log-998-[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.754.285 [acl.cpp:288]618650 aclInit: start to execute aclInit
./output_allreduce/worker_1.log:999:[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.754.326 [acl.cpp:298]618650 aclInit: call ErrorManager.Initialize
./output_allreduce/worker_1.log:1000:[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.754.434 [acl.cpp:242]618650 HandleErrorManagerConfig: err_msg mode is set ["1"].
./output_allreduce/worker_1.log-1001-[INFO] GE(618650,python3.9):2025-04-03-09:27:41.763.250 [error_manager.cc:673]618650 ParseJsonFile:Parse json file:/usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/../conf/error_manager/error_code.json success
./output_allreduce/worker_1.log-1002-[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:41.763.997 [acl.cpp:315]618650 aclInit: call ge interface executor.Initialize
./output_allreduce/worker_1.log-1003-[INFO] PROFILING(618650,python3.9):2025-04-03-09:27:41.764.067 [prof_atls_plugin.cpp:210] (tid:618650) Module[45] register callback of ctrl handle.
./output_allreduce/worker_1.log-1004-[INFO] GE(618650,python3.9):2025-04-03-09:27:41.764.127 [ge_executor.cc:273]618650 Initialize:Init GeExecutor begin.
./output_allreduce/worker_1.log-1005-[INFO] GE(618650,python3.9):2025-04-03-09:27:41.764.207 [op_lib_register.cc:117]618650 GetAllCustomOpApiSoPaths:value of env ASCEND_CUSTOM_OPP_PATH is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/ho
--
./output_allreduce/worker_1.log-8034-[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.838.152 [device_msg_handler.cc:110] 619016 HandleMsg: Begin to process device errMessage.
./output_allreduce/worker_1.log-8035-[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.838.896 [device_msg_handler.cc:127] 619016 HandleMsg: Finished to process device errInfo, retCode=0.
./output_allreduce/worker_1.log-8036-[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.838.950 [runtime.cc:5239] 619016 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
./output_allreduce/worker_1.log-8037-[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.838.982 [npu_driver.cc:500] 619016 GetFaultEvent: get fault event, device_id=1, filterFlag=8, outputLen=128.
./output_allreduce/worker_1.log-8038-[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.839.052 [acl.cpp:782]619016 GetFaultEventInfo: can not get fault event of device 1, runtime errorCode is 0
./output_allreduce/worker_1.log:8039:[INFO] GE(618650,python3.9):2025-04-03-09:27:47.839.078 [error_manager.cc:989]619016 GetRawErrorMessages:current work_stream_id:0
./output_allreduce/worker_1.log:8040:[CRITICAL] KERNEL(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.839.417 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
./output_allreduce/worker_1.log-8041-[INFO] DEBUG(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.839.459 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
./output_allreduce/worker_1.log-8042-[INFO] DEBUG(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.839.484 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
./output_allreduce/worker_1.log-8043-[INFO] DEBUG(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.839.500 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
./output_allreduce/worker_1.log-8044-[INFO] RUNTIME_FRAMEWORK(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.839.825 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.
./output_allreduce/worker_1.log-8045-
--
./output_allreduce/worker_1.log-8123-[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.841.940 [device_msg_handler.cc:110] 619016 HandleMsg: Begin to process device errMessage.
./output_allreduce/worker_1.log-8124-[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.842.359 [device_msg_handler.cc:127] 619016 HandleMsg: Finished to process device errInfo, retCode=0.
./output_allreduce/worker_1.log-8125-[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.842.390 [runtime.cc:5239] 619016 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
./output_allreduce/worker_1.log-8126-[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.842.411 [npu_driver.cc:500] 619016 GetFaultEvent: get fault event, device_id=1, filterFlag=8, outputLen=128.
./output_allreduce/worker_1.log-8127-[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.842.467 [acl.cpp:782]619016 GetFaultEventInfo: can not get fault event of device 1, runtime errorCode is 0
./output_allreduce/worker_1.log:8128:[INFO] GE(618650,python3.9):2025-04-03-09:27:47.842.483 [error_manager.cc:989]619016 GetRawErrorMessages:current work_stream_id:0
./output_allreduce/worker_1.log:8129:[CRITICAL] KERNEL(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.842.779 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
./output_allreduce/worker_1.log-8130-[INFO] DEBUG(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.842.813 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
./output_allreduce/worker_1.log-8131-[INFO] DEBUG(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.842.834 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
./output_allreduce/worker_1.log-8132-[INFO] DEBUG(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.842.849 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
./output_allreduce/worker_1.log-8133-[INFO] RUNTIME_FRAMEWORK(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.842.918 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.
./output_allreduce/worker_1.log-8134-
--
./output_allreduce/worker_1.log-8211-[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.844.909 [device_msg_handler.cc:110] 619016 HandleMsg: Begin to process device errMessage.
./output_allreduce/worker_1.log-8212-[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.845.226 [device_msg_handler.cc:127] 619016 HandleMsg: Finished to process device errInfo, retCode=0.
./output_allreduce/worker_1.log-8213-[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.845.257 [runtime.cc:5239] 619016 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=1, deviceId=1.
./output_allreduce/worker_1.log-8214-[INFO] RUNTIME(618650,python3.9):2025-04-03-09:27:47.845.285 [npu_driver.cc:500] 619016 GetFaultEvent: get fault event, device_id=1, filterFlag=8, outputLen=128.
./output_allreduce/worker_1.log-8215-[INFO] ASCENDCL(618650,python3.9):2025-04-03-09:27:47.845.341 [acl.cpp:782]619016 GetFaultEventInfo: can not get fault event of device 1, runtime errorCode is 0
./output_allreduce/worker_1.log:8216:[INFO] GE(618650,python3.9):2025-04-03-09:27:47.845.360 [error_manager.cc:989]619016 GetRawErrorMessages:current work_stream_id:0
./output_allreduce/worker_1.log:8217:[CRITICAL] KERNEL(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.845.651 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
./output_allreduce/worker_1.log-8218-[INFO] DEBUG(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.845.683 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
./output_allreduce/worker_1.log-8219-[INFO] DEBUG(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.845.702 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
./output_allreduce/worker_1.log-8220-[INFO] DEBUG(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.845.717 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
./output_allreduce/worker_1.log-8221-[INFO] RUNTIME_FRAMEWORK(618650,fffed9fbefa0,python3.9):2025-04-03-09:27:47.845.785 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.
./output_allreduce/worker_1.log-8222-
--
./output_allreduce/worker_1.log-8385-            [11.  2.]
./output_allreduce/worker_1.log-8386-        """
./output_allreduce/worker_1.log-8387-        if self.has_init:
./output_allreduce/worker_1.log-8388-            self.init_data()
./output_allreduce/worker_1.log-8389->       return TensorPy_.asnumpy(self)
./output_allreduce/worker_1.log:8390:E       RuntimeError: LCCL AllReduce failed.
./output_allreduce/worker_1.log-8391-E       
./output_allreduce/worker_1.log-8392-E       ----------------------------------------------------
./output_allreduce/worker_1.log-8393-E       - C++ Call Stack: (For framework developers)
./output_allreduce/worker_1.log-8394-E       ----------------------------------------------------
./output_allreduce/worker_1.log-8395-E       mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch
./output_allreduce/worker_1.log-8396-
./output_allreduce/worker_1.log:8397:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/common/tensor.py:989: RuntimeError
./output_allreduce/worker_1.log-8398-===================================================================================================================== warnings summary =====================================================================================================================
./output_allreduce/worker_1.log-8399-../../../../../../../../usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866
./output_allreduce/worker_1.log-8400-  /usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866: DeprecationWarning: invalid escape sequence \L
./output_allreduce/worker_1.log-8401-    if not dirpath.find("AppData\Local\Temp"):
./output_allreduce/worker_1.log-8402-
--
./output_allreduce/worker_1.log-8500-  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
./output_allreduce/worker_1.log-8501-    @fusion_manager.register("minmax_update_perlayer")
./output_allreduce/worker_1.log-8502-
./output_allreduce/worker_1.log-8503--- Docs: https://docs.pytest.org/en/stable/warnings.html
./output_allreduce/worker_1.log-8504-================================================================================================================= short test summary info ==================================================================================================================
./output_allreduce/worker_1.log:8505:FAILED test_lccl_allreduce.py::test_AllReduce - RuntimeError: LCCL AllReduce failed.
./output_allreduce/worker_1.log-8506-============================================================================================================= 1 failed, 26 warnings in 23.71s ==============================================================================================================
./output_allreduce/worker_1.log-8507-[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.443.443 [mindspore/ccsrc/pybind_api/init.cc:651] operator()] Start register...
./output_allreduce/worker_1.log-8508-[INFO] COMMON(618650,ffffbf562de0,python3.9):2025-04-03-09:27:48.443.485 [mindspore/ccsrc/pybind_api/init.cc:654] operator()] Start mindspore.profiler...
./output_allreduce/worker_1.log-8509-[INFO] ME(618650:281473891839456,MainProcess):2025-04-03-09:27:48.443.574 [mindspore/profiler/envprofiler.py:57] analyse start
./output_allreduce/worker_1.log-8510-[INFO] ME(618650:281473891839456,MainProcess):2025-04-03-09:27:48.443.752 [mindspore/profiler/envprofiler.py:59] Profiler is not initialized, skip analyse.
--
./output_allreduce/worker_7.log-356-[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.086 [runtime.cc:5096] 618674 GetVisibleDevices: ASCEND_RT_VISIBLE_DEVICES param was not set
./output_allreduce/worker_7.log-357-[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.102 [runtime.cc:1173] 618674 InitApiImpile: ApiImpl:Runtime_alloc_size 8
./output_allreduce/worker_7.log-358-[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.116 [runtime.cc:1183] 618674 InitLogger: Logger:Runtime_alloc_size 32
./output_allreduce/worker_7.log-359-[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.135 [runtime.cc:1193] 618674 InitApiProfiler: RProfiler:Runtime_alloc_size 176
./output_allreduce/worker_7.log-360-[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.150 [profiler.cc:84] 618674 Init: Init ok, Runtime_alloc_size 48
./output_allreduce/worker_7.log:361:[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.170 [runtime.cc:1209] 618674 InitApiErrorDecorator: ApiErrorDecorator:Runtime_alloc_size 16.
./output_allreduce/worker_7.log-362-[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.205 [runtime.cc:1219] 618674 InitThreadGuard: Runtime init:new ThreadGuard ok, Runtime_alloc_size 104.
./output_allreduce/worker_7.log-363-[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.219 [runtime.cc:1230] 618674 InitStreamObserver: EngineStreamObserver:Runtime_alloc_size 8.
./output_allreduce/worker_7.log-364-[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.234 [runtime.cc:1242] 618674 InitAicpuStreamIdBitmap: Bitmap(1024):Runtime_alloc_size 72.
./output_allreduce/worker_7.log-365-[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.246 [runtime.cc:1264] 618674 InitCbSubscribe: The thread group num is 1024
./output_allreduce/worker_7.log-366-[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:26.278.259 [runtime.cc:1270] 618674 InitCbSubscribe: Runtime init:new CbSubscribe ok, Runtime_alloc_size 304.
--
./output_allreduce/worker_7.log-991-[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.639.093 [context.cpp:80]618674 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
./output_allreduce/worker_7.log-992-[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.639.124 [context.cpp:72]618674 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
./output_allreduce/worker_7.log-993-[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:41.639.140 [api_impl.cc:3717] 618674 ContextSetCurrent: set context=aaab0103b880, flag=0.
./output_allreduce/worker_7.log-994-[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.639.153 [context.cpp:80]618674 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
./output_allreduce/worker_7.log-995-[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.639.301 [acl.cpp:288]618674 aclInit: start to execute aclInit
./output_allreduce/worker_7.log:996:[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.639.336 [acl.cpp:298]618674 aclInit: call ErrorManager.Initialize
./output_allreduce/worker_7.log:997:[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.639.435 [acl.cpp:242]618674 HandleErrorManagerConfig: err_msg mode is set ["1"].
./output_allreduce/worker_7.log-998-[INFO] GE(618674,python3.9):2025-04-03-09:27:41.648.313 [error_manager.cc:673]618674 ParseJsonFile:Parse json file:/usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/../conf/error_manager/error_code.json success
./output_allreduce/worker_7.log-999-[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:41.649.070 [acl.cpp:315]618674 aclInit: call ge interface executor.Initialize
./output_allreduce/worker_7.log-1000-[INFO] PROFILING(618674,python3.9):2025-04-03-09:27:41.649.131 [prof_atls_plugin.cpp:210] (tid:618674) Module[45] register callback of ctrl handle.
./output_allreduce/worker_7.log-1001-[INFO] GE(618674,python3.9):2025-04-03-09:27:41.649.166 [ge_executor.cc:273]618674 Initialize:Init GeExecutor begin.
./output_allreduce/worker_7.log-1002-[INFO] GE(618674,python3.9):2025-04-03-09:27:41.649.216 [op_lib_register.cc:117]618674 GetAllCustomOpApiSoPaths:value of env ASCEND_CUSTOM_OPP_PATH is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/ho
--
./output_allreduce/worker_7.log-8042-[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.850.097 [device_msg_handler.cc:110] 619019 HandleMsg: Begin to process device errMessage.
./output_allreduce/worker_7.log-8043-[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.850.816 [device_msg_handler.cc:127] 619019 HandleMsg: Finished to process device errInfo, retCode=0.
./output_allreduce/worker_7.log-8044-[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.850.872 [runtime.cc:5239] 619019 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
./output_allreduce/worker_7.log-8045-[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.850.907 [npu_driver.cc:500] 619019 GetFaultEvent: get fault event, device_id=7, filterFlag=8, outputLen=128.
./output_allreduce/worker_7.log-8046-[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.850.978 [acl.cpp:782]619019 GetFaultEventInfo: can not get fault event of device 7, runtime errorCode is 0
./output_allreduce/worker_7.log:8047:[INFO] GE(618674,python3.9):2025-04-03-09:27:47.851.008 [error_manager.cc:989]619019 GetRawErrorMessages:current work_stream_id:0
./output_allreduce/worker_7.log:8048:[CRITICAL] KERNEL(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.851.374 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
./output_allreduce/worker_7.log-8049-[INFO] DEBUG(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.851.417 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
./output_allreduce/worker_7.log-8050-[INFO] DEBUG(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.851.443 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
./output_allreduce/worker_7.log-8051-[INFO] DEBUG(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.851.462 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
./output_allreduce/worker_7.log-8052-[INFO] RUNTIME_FRAMEWORK(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.851.791 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.
./output_allreduce/worker_7.log-8053-
--
./output_allreduce/worker_7.log-8131-[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.853.956 [device_msg_handler.cc:110] 619019 HandleMsg: Begin to process device errMessage.
./output_allreduce/worker_7.log-8132-[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.854.266 [device_msg_handler.cc:127] 619019 HandleMsg: Finished to process device errInfo, retCode=0.
./output_allreduce/worker_7.log-8133-[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.854.299 [runtime.cc:5239] 619019 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
./output_allreduce/worker_7.log-8134-[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.854.321 [npu_driver.cc:500] 619019 GetFaultEvent: get fault event, device_id=7, filterFlag=8, outputLen=128.
./output_allreduce/worker_7.log-8135-[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.854.390 [acl.cpp:782]619019 GetFaultEventInfo: can not get fault event of device 7, runtime errorCode is 0
./output_allreduce/worker_7.log:8136:[INFO] GE(618674,python3.9):2025-04-03-09:27:47.854.408 [error_manager.cc:989]619019 GetRawErrorMessages:current work_stream_id:0
./output_allreduce/worker_7.log:8137:[CRITICAL] KERNEL(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.854.701 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
./output_allreduce/worker_7.log-8138-[INFO] DEBUG(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.854.733 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
./output_allreduce/worker_7.log-8139-[INFO] DEBUG(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.854.755 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
./output_allreduce/worker_7.log-8140-[INFO] DEBUG(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.854.773 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
./output_allreduce/worker_7.log-8141-[INFO] RUNTIME_FRAMEWORK(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.854.844 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.
./output_allreduce/worker_7.log-8142-
--
./output_allreduce/worker_7.log-8219-[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.856.910 [device_msg_handler.cc:110] 619019 HandleMsg: Begin to process device errMessage.
./output_allreduce/worker_7.log-8220-[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.857.222 [device_msg_handler.cc:127] 619019 HandleMsg: Finished to process device errInfo, retCode=0.
./output_allreduce/worker_7.log-8221-[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.857.253 [runtime.cc:5239] 619019 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=7, deviceId=7.
./output_allreduce/worker_7.log-8222-[INFO] RUNTIME(618674,python3.9):2025-04-03-09:27:47.857.275 [npu_driver.cc:500] 619019 GetFaultEvent: get fault event, device_id=7, filterFlag=8, outputLen=128.
./output_allreduce/worker_7.log-8223-[INFO] ASCENDCL(618674,python3.9):2025-04-03-09:27:47.857.331 [acl.cpp:782]619019 GetFaultEventInfo: can not get fault event of device 7, runtime errorCode is 0
./output_allreduce/worker_7.log:8224:[INFO] GE(618674,python3.9):2025-04-03-09:27:47.857.348 [error_manager.cc:989]619019 GetRawErrorMessages:current work_stream_id:0
./output_allreduce/worker_7.log:8225:[CRITICAL] KERNEL(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.857.648 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
./output_allreduce/worker_7.log-8226-[INFO] DEBUG(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.857.680 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
./output_allreduce/worker_7.log-8227-[INFO] DEBUG(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.857.701 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
./output_allreduce/worker_7.log-8228-[INFO] DEBUG(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.857.719 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
./output_allreduce/worker_7.log-8229-[INFO] RUNTIME_FRAMEWORK(618674,fffea5fbefa0,python3.9):2025-04-03-09:27:47.857.788 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.
./output_allreduce/worker_7.log-8230-
--
./output_allreduce/worker_7.log-8429-            [11.  2.]
./output_allreduce/worker_7.log-8430-        """
./output_allreduce/worker_7.log-8431-        if self.has_init:
./output_allreduce/worker_7.log-8432-            self.init_data()
./output_allreduce/worker_7.log-8433->       return TensorPy_.asnumpy(self)
./output_allreduce/worker_7.log:8434:E       RuntimeError: LCCL AllReduce failed.
./output_allreduce/worker_7.log-8435-E       
./output_allreduce/worker_7.log-8436-E       ----------------------------------------------------
./output_allreduce/worker_7.log-8437-E       - C++ Call Stack: (For framework developers)
./output_allreduce/worker_7.log-8438-E       ----------------------------------------------------
./output_allreduce/worker_7.log-8439-E       mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch
./output_allreduce/worker_7.log-8440-
./output_allreduce/worker_7.log:8441:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/common/tensor.py:989: RuntimeError
./output_allreduce/worker_7.log-8442-===================================================================================================================== warnings summary =====================================================================================================================
./output_allreduce/worker_7.log-8443-../../../../../../../../usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866
./output_allreduce/worker_7.log-8444-  /usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866: DeprecationWarning: invalid escape sequence \L
./output_allreduce/worker_7.log-8445-    if not dirpath.find("AppData\Local\Temp"):
./output_allreduce/worker_7.log-8446-
--
./output_allreduce/worker_7.log-8544-  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
./output_allreduce/worker_7.log-8545-    @fusion_manager.register("minmax_update_perlayer")
./output_allreduce/worker_7.log-8546-
./output_allreduce/worker_7.log-8547--- Docs: https://docs.pytest.org/en/stable/warnings.html
./output_allreduce/worker_7.log-8548-================================================================================================================= short test summary info ==================================================================================================================
./output_allreduce/worker_7.log:8549:FAILED test_lccl_allreduce.py::test_AllReduce - RuntimeError: LCCL AllReduce failed.
./output_allreduce/worker_7.log-8550-============================================================================================================= 1 failed, 26 warnings in 23.42s ==============================================================================================================
./output_allreduce/worker_7.log-8551-[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.440.979 [mindspore/ccsrc/pybind_api/init.cc:651] operator()] Start register...
./output_allreduce/worker_7.log-8552-[INFO] COMMON(618674,ffff8b99cde0,python3.9):2025-04-03-09:27:48.441.017 [mindspore/ccsrc/pybind_api/init.cc:654] operator()] Start mindspore.profiler...
./output_allreduce/worker_7.log-8553-[INFO] ME(618674:281473023856096,MainProcess):2025-04-03-09:27:48.441.092 [mindspore/profiler/envprofiler.py:57] analyse start
./output_allreduce/worker_7.log-8554-[INFO] ME(618674:281473023856096,MainProcess):2025-04-03-09:27:48.441.247 [mindspore/profiler/envprofiler.py:59] Profiler is not initialized, skip analyse.
--
./output_allreduce/scheduler.log-354-[INFO] RUNTIME(618644,python3.9):2025-04-03-09:27:25.882.406 [runtime.cc:5096] 618644 GetVisibleDevices: ASCEND_RT_VISIBLE_DEVICES param was not set
./output_allreduce/scheduler.log-355-[INFO] RUNTIME(618644,python3.9):2025-04-03-09:27:25.882.415 [runtime.cc:1173] 618644 InitApiImpile: ApiImpl:Runtime_alloc_size 8
./output_allreduce/scheduler.log-356-[INFO] RUNTIME(618644,python3.9):2025-04-03-09:27:25.882.423 [runtime.cc:1183] 618644 InitLogger: Logger:Runtime_alloc_size 32
./output_allreduce/scheduler.log-357-[INFO] RUNTIME(618644,python3.9):2025-04-03-09:27:25.882.435 [runtime.cc:1193] 618644 InitApiProfiler: RProfiler:Runtime_alloc_size 176
./output_allreduce/scheduler.log-358-[INFO] RUNTIME(618644,python3.9):2025-04-03-09:27:25.882.444 [profiler.cc:84] 618644 Init: Init ok, Runtime_alloc_size 48
./output_allreduce/scheduler.log:359:[INFO] RUNTIME(618644,python3.9):2025-04-03-09:27:25.882.459 [runtime.cc:1209] 618644 InitApiErrorDecorator: ApiErrorDecorator:Runtime_alloc_size 16.
./output_allreduce/scheduler.log-360-[INFO] RUNTIME(618644,python3.9):2025-04-03-09:27:25.882.468 [runtime.cc:1219] 618644 InitThreadGuard: Runtime init:new ThreadGuard ok, Runtime_alloc_size 104.
./output_allreduce/scheduler.log-361-[INFO] RUNTIME(618644,python3.9):2025-04-03-09:27:25.882.476 [runtime.cc:1230] 618644 InitStreamObserver: EngineStreamObserver:Runtime_alloc_size 8.
./output_allreduce/scheduler.log-362-[INFO] RUNTIME(618644,python3.9):2025-04-03-09:27:25.882.497 [runtime.cc:1242] 618644 InitAicpuStreamIdBitmap: Bitmap(1024):Runtime_alloc_size 72.
./output_allreduce/scheduler.log-363-[INFO] RUNTIME(618644,python3.9):2025-04-03-09:27:25.882.508 [runtime.cc:1264] 618644 InitCbSubscribe: The thread group num is 1024
./output_allreduce/scheduler.log-364-[INFO] RUNTIME(618644,python3.9):2025-04-03-09:27:25.882.516 [runtime.cc:1270] 618644 InitCbSubscribe: Runtime init:new CbSubscribe ok, Runtime_alloc_size 304.
--
./output_allreduce/worker_0.log-356-[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.389 [runtime.cc:5096] 618646 GetVisibleDevices: ASCEND_RT_VISIBLE_DEVICES param was not set
./output_allreduce/worker_0.log-357-[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.406 [runtime.cc:1173] 618646 InitApiImpile: ApiImpl:Runtime_alloc_size 8
./output_allreduce/worker_0.log-358-[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.419 [runtime.cc:1183] 618646 InitLogger: Logger:Runtime_alloc_size 32
./output_allreduce/worker_0.log-359-[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.436 [runtime.cc:1193] 618646 InitApiProfiler: RProfiler:Runtime_alloc_size 176
./output_allreduce/worker_0.log-360-[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.455 [profiler.cc:84] 618646 Init: Init ok, Runtime_alloc_size 48
./output_allreduce/worker_0.log:361:[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.481 [runtime.cc:1209] 618646 InitApiErrorDecorator: ApiErrorDecorator:Runtime_alloc_size 16.
./output_allreduce/worker_0.log-362-[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.512 [runtime.cc:1219] 618646 InitThreadGuard: Runtime init:new ThreadGuard ok, Runtime_alloc_size 104.
./output_allreduce/worker_0.log-363-[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.525 [runtime.cc:1230] 618646 InitStreamObserver: EngineStreamObserver:Runtime_alloc_size 8.
./output_allreduce/worker_0.log-364-[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.539 [runtime.cc:1242] 618646 InitAicpuStreamIdBitmap: Bitmap(1024):Runtime_alloc_size 72.
./output_allreduce/worker_0.log-365-[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.554 [runtime.cc:1264] 618646 InitCbSubscribe: The thread group num is 1024
./output_allreduce/worker_0.log-366-[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:25.951.570 [runtime.cc:1270] 618646 InitCbSubscribe: Runtime init:new CbSubscribe ok, Runtime_alloc_size 304.
--
./output_allreduce/worker_0.log-992-[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.948.365 [context.cpp:80]618646 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
./output_allreduce/worker_0.log-993-[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.948.390 [context.cpp:72]618646 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
./output_allreduce/worker_0.log-994-[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:41.948.408 [api_impl.cc:3717] 618646 ContextSetCurrent: set context=aaab06c88220, flag=0.
./output_allreduce/worker_0.log-995-[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.948.421 [context.cpp:80]618646 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
./output_allreduce/worker_0.log-996-[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.948.589 [acl.cpp:288]618646 aclInit: start to execute aclInit
./output_allreduce/worker_0.log:997:[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.948.632 [acl.cpp:298]618646 aclInit: call ErrorManager.Initialize
./output_allreduce/worker_0.log:998:[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.948.754 [acl.cpp:242]618646 HandleErrorManagerConfig: err_msg mode is set ["1"].
./output_allreduce/worker_0.log-999-[INFO] GE(618646,python3.9):2025-04-03-09:27:41.957.779 [error_manager.cc:673]618646 ParseJsonFile:Parse json file:/usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/../conf/error_manager/error_code.json success
./output_allreduce/worker_0.log-1000-[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:41.958.551 [acl.cpp:315]618646 aclInit: call ge interface executor.Initialize
./output_allreduce/worker_0.log-1001-[INFO] PROFILING(618646,python3.9):2025-04-03-09:27:41.958.630 [prof_atls_plugin.cpp:210] (tid:618646) Module[45] register callback of ctrl handle.
./output_allreduce/worker_0.log-1002-[INFO] GE(618646,python3.9):2025-04-03-09:27:41.958.680 [ge_executor.cc:273]618646 Initialize:Init GeExecutor begin.
./output_allreduce/worker_0.log-1003-[INFO] GE(618646,python3.9):2025-04-03-09:27:41.958.751 [op_lib_register.cc:117]618646 GetAllCustomOpApiSoPaths:value of env ASCEND_CUSTOM_OPP_PATH is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/ho
--
./output_allreduce/worker_0.log-8253-[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.624.137 [device_msg_handler.cc:110] 619007 HandleMsg: Begin to process device errMessage.
./output_allreduce/worker_0.log-8254-[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.624.829 [device_msg_handler.cc:127] 619007 HandleMsg: Finished to process device errInfo, retCode=0.
./output_allreduce/worker_0.log-8255-[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.624.883 [runtime.cc:5239] 619007 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
./output_allreduce/worker_0.log-8256-[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.624.913 [npu_driver.cc:500] 619007 GetFaultEvent: get fault event, device_id=0, filterFlag=8, outputLen=128.
./output_allreduce/worker_0.log-8257-[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.624.976 [acl.cpp:782]619007 GetFaultEventInfo: can not get fault event of device 0, runtime errorCode is 0
./output_allreduce/worker_0.log:8258:[INFO] GE(618646,python3.9):2025-04-03-09:27:47.625.006 [error_manager.cc:989]619007 GetRawErrorMessages:current work_stream_id:0
./output_allreduce/worker_0.log:8259:[CRITICAL] KERNEL(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.625.335 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
./output_allreduce/worker_0.log-8260-[INFO] DEBUG(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.625.373 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
./output_allreduce/worker_0.log-8261-[INFO] DEBUG(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.625.392 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
./output_allreduce/worker_0.log-8262-[INFO] DEBUG(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.625.406 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
./output_allreduce/worker_0.log-8263-[INFO] RUNTIME_FRAMEWORK(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.625.629 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.
./output_allreduce/worker_0.log-8264-
--
./output_allreduce/worker_0.log-8342-[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.627.525 [device_msg_handler.cc:110] 619007 HandleMsg: Begin to process device errMessage.
./output_allreduce/worker_0.log-8343-[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.627.830 [device_msg_handler.cc:127] 619007 HandleMsg: Finished to process device errInfo, retCode=0.
./output_allreduce/worker_0.log-8344-[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.627.859 [runtime.cc:5239] 619007 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
./output_allreduce/worker_0.log-8345-[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.627.878 [npu_driver.cc:500] 619007 GetFaultEvent: get fault event, device_id=0, filterFlag=8, outputLen=128.
./output_allreduce/worker_0.log-8346-[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.627.927 [acl.cpp:782]619007 GetFaultEventInfo: can not get fault event of device 0, runtime errorCode is 0
./output_allreduce/worker_0.log:8347:[INFO] GE(618646,python3.9):2025-04-03-09:27:47.627.941 [error_manager.cc:989]619007 GetRawErrorMessages:current work_stream_id:0
./output_allreduce/worker_0.log:8348:[CRITICAL] KERNEL(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.628.245 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
./output_allreduce/worker_0.log-8349-[INFO] DEBUG(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.628.276 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
./output_allreduce/worker_0.log-8350-[INFO] DEBUG(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.628.296 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
./output_allreduce/worker_0.log-8351-[INFO] DEBUG(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.628.309 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
./output_allreduce/worker_0.log-8352-[INFO] RUNTIME_FRAMEWORK(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.628.373 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.
./output_allreduce/worker_0.log-8353-
--
./output_allreduce/worker_0.log-8430-[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.630.205 [device_msg_handler.cc:110] 619007 HandleMsg: Begin to process device errMessage.
./output_allreduce/worker_0.log-8431-[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.630.508 [device_msg_handler.cc:127] 619007 HandleMsg: Finished to process device errInfo, retCode=0.
./output_allreduce/worker_0.log-8432-[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.630.537 [runtime.cc:5239] 619007 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=0, deviceId=0.
./output_allreduce/worker_0.log-8433-[INFO] RUNTIME(618646,python3.9):2025-04-03-09:27:47.630.556 [npu_driver.cc:500] 619007 GetFaultEvent: get fault event, device_id=0, filterFlag=8, outputLen=128.
./output_allreduce/worker_0.log-8434-[INFO] ASCENDCL(618646,python3.9):2025-04-03-09:27:47.630.605 [acl.cpp:782]619007 GetFaultEventInfo: can not get fault event of device 0, runtime errorCode is 0
./output_allreduce/worker_0.log:8435:[INFO] GE(618646,python3.9):2025-04-03-09:27:47.630.620 [error_manager.cc:989]619007 GetRawErrorMessages:current work_stream_id:0
./output_allreduce/worker_0.log:8436:[CRITICAL] KERNEL(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.630.908 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
./output_allreduce/worker_0.log-8437-[INFO] DEBUG(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.630.937 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
./output_allreduce/worker_0.log-8438-[INFO] DEBUG(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.630.953 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
./output_allreduce/worker_0.log-8439-[INFO] DEBUG(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.630.967 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
./output_allreduce/worker_0.log-8440-[INFO] RUNTIME_FRAMEWORK(618646,fffe867cefa0,python3.9):2025-04-03-09:27:47.631.038 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.
./output_allreduce/worker_0.log-8441-
--
./output_allreduce/worker_0.log-8639-            [11.  2.]
./output_allreduce/worker_0.log-8640-        """
./output_allreduce/worker_0.log-8641-        if self.has_init:
./output_allreduce/worker_0.log-8642-            self.init_data()
./output_allreduce/worker_0.log-8643->       return TensorPy_.asnumpy(self)
./output_allreduce/worker_0.log:8644:E       RuntimeError: LCCL AllReduce failed.
./output_allreduce/worker_0.log-8645-E       
./output_allreduce/worker_0.log-8646-E       ----------------------------------------------------
./output_allreduce/worker_0.log-8647-E       - C++ Call Stack: (For framework developers)
./output_allreduce/worker_0.log-8648-E       ----------------------------------------------------
./output_allreduce/worker_0.log-8649-E       mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch
./output_allreduce/worker_0.log-8650-
./output_allreduce/worker_0.log:8651:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/common/tensor.py:989: RuntimeError
./output_allreduce/worker_0.log-8652-===================================================================================================================== warnings summary =====================================================================================================================
./output_allreduce/worker_0.log-8653-../../../../../../../../usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866
./output_allreduce/worker_0.log-8654-  /usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866: DeprecationWarning: invalid escape sequence \L
./output_allreduce/worker_0.log-8655-    if not dirpath.find("AppData\Local\Temp"):
./output_allreduce/worker_0.log-8656-
--
./output_allreduce/worker_0.log-8754-  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
./output_allreduce/worker_0.log-8755-    @fusion_manager.register("minmax_update_perlayer")
./output_allreduce/worker_0.log-8756-
./output_allreduce/worker_0.log-8757--- Docs: https://docs.pytest.org/en/stable/warnings.html
./output_allreduce/worker_0.log-8758-================================================================================================================= short test summary info ==================================================================================================================
./output_allreduce/worker_0.log:8759:FAILED test_lccl_allreduce.py::test_AllReduce - RuntimeError: LCCL AllReduce failed.
./output_allreduce/worker_0.log-8760-============================================================================================================= 1 failed, 26 warnings in 23.52s ==============================================================================================================
./output_allreduce/worker_0.log-8761-[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.186.029 [mindspore/ccsrc/pybind_api/init.cc:651] operator()] Start register...
./output_allreduce/worker_0.log-8762-[INFO] COMMON(618646,ffff85d12de0,python3.9):2025-04-03-09:27:48.186.068 [mindspore/ccsrc/pybind_api/init.cc:654] operator()] Start mindspore.profiler...
./output_allreduce/worker_0.log-8763-[INFO] ME(618646:281472926821856,MainProcess):2025-04-03-09:27:48.186.136 [mindspore/profiler/envprofiler.py:57] analyse start
./output_allreduce/worker_0.log-8764-[INFO] ME(618646:281472926821856,MainProcess):2025-04-03-09:27:48.186.291 [mindspore/profiler/envprofiler.py:59] Profiler is not initialized, skip analyse.
--
./output_allreduce/worker_2.log-356-[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.728 [runtime.cc:5096] 618654 GetVisibleDevices: ASCEND_RT_VISIBLE_DEVICES param was not set
./output_allreduce/worker_2.log-357-[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.739 [runtime.cc:1173] 618654 InitApiImpile: ApiImpl:Runtime_alloc_size 8
./output_allreduce/worker_2.log-358-[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.750 [runtime.cc:1183] 618654 InitLogger: Logger:Runtime_alloc_size 32
./output_allreduce/worker_2.log-359-[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.763 [runtime.cc:1193] 618654 InitApiProfiler: RProfiler:Runtime_alloc_size 176
./output_allreduce/worker_2.log-360-[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.774 [profiler.cc:84] 618654 Init: Init ok, Runtime_alloc_size 48
./output_allreduce/worker_2.log:361:[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.789 [runtime.cc:1209] 618654 InitApiErrorDecorator: ApiErrorDecorator:Runtime_alloc_size 16.
./output_allreduce/worker_2.log-362-[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.808 [runtime.cc:1219] 618654 InitThreadGuard: Runtime init:new ThreadGuard ok, Runtime_alloc_size 104.
./output_allreduce/worker_2.log-363-[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.818 [runtime.cc:1230] 618654 InitStreamObserver: EngineStreamObserver:Runtime_alloc_size 8.
./output_allreduce/worker_2.log-364-[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.828 [runtime.cc:1242] 618654 InitAicpuStreamIdBitmap: Bitmap(1024):Runtime_alloc_size 72.
./output_allreduce/worker_2.log-365-[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.838 [runtime.cc:1264] 618654 InitCbSubscribe: The thread group num is 1024
./output_allreduce/worker_2.log-366-[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:26.064.849 [runtime.cc:1270] 618654 InitCbSubscribe: Runtime init:new CbSubscribe ok, Runtime_alloc_size 304.
--
./output_allreduce/worker_2.log-993-[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.858.548 [context.cpp:80]618654 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
./output_allreduce/worker_2.log-994-[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.858.573 [context.cpp:72]618654 aclrtSetCurrentContext: start to execute aclrtSetCurrentContext.
./output_allreduce/worker_2.log-995-[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:41.858.591 [api_impl.cc:3717] 618654 ContextSetCurrent: set context=aaaaf5082ff0, flag=0.
./output_allreduce/worker_2.log-996-[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.858.610 [context.cpp:80]618654 aclrtSetCurrentContext: successfully execute aclrtSetCurrentContext
./output_allreduce/worker_2.log-997-[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.858.777 [acl.cpp:288]618654 aclInit: start to execute aclInit
./output_allreduce/worker_2.log:998:[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.858.828 [acl.cpp:298]618654 aclInit: call ErrorManager.Initialize
./output_allreduce/worker_2.log:999:[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.858.942 [acl.cpp:242]618654 HandleErrorManagerConfig: err_msg mode is set ["1"].
./output_allreduce/worker_2.log-1000-[INFO] GE(618654,python3.9):2025-04-03-09:27:41.867.941 [error_manager.cc:673]618654 ParseJsonFile:Parse json file:/usr/local/Ascend/ascend-toolkit/8.1.RC1/aarch64-linux/lib64/../conf/error_manager/error_code.json success
./output_allreduce/worker_2.log-1001-[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:41.868.724 [acl.cpp:315]618654 aclInit: call ge interface executor.Initialize
./output_allreduce/worker_2.log-1002-[INFO] PROFILING(618654,python3.9):2025-04-03-09:27:41.868.873 [prof_atls_plugin.cpp:210] (tid:618654) Module[45] register callback of ctrl handle.
./output_allreduce/worker_2.log-1003-[INFO] GE(618654,python3.9):2025-04-03-09:27:41.868.930 [ge_executor.cc:273]618654 Initialize:Init GeExecutor begin.
./output_allreduce/worker_2.log-1004-[INFO] GE(618654,python3.9):2025-04-03-09:27:41.869.110 [op_lib_register.cc:117]618654 GetAllCustomOpApiSoPaths:value of env ASCEND_CUSTOM_OPP_PATH is /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_ascendc_910b:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicore_ops:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/lib/plugin/ascend/custom_aicpu_ops:/ho
--
./output_allreduce/worker_2.log-8030-[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.851.414 [device_msg_handler.cc:110] 619020 HandleMsg: Begin to process device errMessage.
./output_allreduce/worker_2.log-8031-[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.852.112 [device_msg_handler.cc:127] 619020 HandleMsg: Finished to process device errInfo, retCode=0.
./output_allreduce/worker_2.log-8032-[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.852.187 [runtime.cc:5239] 619020 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
./output_allreduce/worker_2.log-8033-[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.852.227 [npu_driver.cc:500] 619020 GetFaultEvent: get fault event, device_id=2, filterFlag=8, outputLen=128.
./output_allreduce/worker_2.log-8034-[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.852.297 [acl.cpp:782]619020 GetFaultEventInfo: can not get fault event of device 2, runtime errorCode is 0
./output_allreduce/worker_2.log:8035:[INFO] GE(618654,python3.9):2025-04-03-09:27:47.852.324 [error_manager.cc:989]619020 GetRawErrorMessages:current work_stream_id:0
./output_allreduce/worker_2.log:8036:[CRITICAL] KERNEL(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.852.656 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
./output_allreduce/worker_2.log-8037-[INFO] DEBUG(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.852.699 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
./output_allreduce/worker_2.log-8038-[INFO] DEBUG(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.852.724 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
./output_allreduce/worker_2.log-8039-[INFO] DEBUG(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.852.743 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
./output_allreduce/worker_2.log-8040-[INFO] RUNTIME_FRAMEWORK(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.852.997 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.
./output_allreduce/worker_2.log-8041-
--
./output_allreduce/worker_2.log-8119-[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.855.057 [device_msg_handler.cc:110] 619020 HandleMsg: Begin to process device errMessage.
./output_allreduce/worker_2.log-8120-[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.855.362 [device_msg_handler.cc:127] 619020 HandleMsg: Finished to process device errInfo, retCode=0.
./output_allreduce/worker_2.log-8121-[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.855.394 [runtime.cc:5239] 619020 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
./output_allreduce/worker_2.log-8122-[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.855.418 [npu_driver.cc:500] 619020 GetFaultEvent: get fault event, device_id=2, filterFlag=8, outputLen=128.
./output_allreduce/worker_2.log-8123-[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.855.476 [acl.cpp:782]619020 GetFaultEventInfo: can not get fault event of device 2, runtime errorCode is 0
./output_allreduce/worker_2.log:8124:[INFO] GE(618654,python3.9):2025-04-03-09:27:47.855.495 [error_manager.cc:989]619020 GetRawErrorMessages:current work_stream_id:0
./output_allreduce/worker_2.log:8125:[CRITICAL] KERNEL(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.855.793 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
./output_allreduce/worker_2.log-8126-[INFO] DEBUG(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.855.826 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
./output_allreduce/worker_2.log-8127-[INFO] DEBUG(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.855.847 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
./output_allreduce/worker_2.log-8128-[INFO] DEBUG(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.855.866 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
./output_allreduce/worker_2.log-8129-[INFO] RUNTIME_FRAMEWORK(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.855.935 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.
./output_allreduce/worker_2.log-8130-
--
./output_allreduce/worker_2.log-8207-[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.857.973 [device_msg_handler.cc:110] 619020 HandleMsg: Begin to process device errMessage.
./output_allreduce/worker_2.log-8208-[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.858.279 [device_msg_handler.cc:127] 619020 HandleMsg: Finished to process device errInfo, retCode=0.
./output_allreduce/worker_2.log-8209-[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.858.312 [runtime.cc:5239] 619020 GetUserDevIdByDeviceId: No need to convert deviceId, userDevId=2, deviceId=2.
./output_allreduce/worker_2.log-8210-[INFO] RUNTIME(618654,python3.9):2025-04-03-09:27:47.858.335 [npu_driver.cc:500] 619020 GetFaultEvent: get fault event, device_id=2, filterFlag=8, outputLen=128.
./output_allreduce/worker_2.log-8211-[INFO] ASCENDCL(618654,python3.9):2025-04-03-09:27:47.858.391 [acl.cpp:782]619020 GetFaultEventInfo: can not get fault event of device 2, runtime errorCode is 0
./output_allreduce/worker_2.log:8212:[INFO] GE(618654,python3.9):2025-04-03-09:27:47.858.410 [error_manager.cc:989]619020 GetRawErrorMessages:current work_stream_id:0
./output_allreduce/worker_2.log:8213:[CRITICAL] KERNEL(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.858.721 [mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59] Launch] LCCL AllReduce failed.
./output_allreduce/worker_2.log-8214-[INFO] DEBUG(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.858.755 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:116] TraceGraphEval] Length of analysis graph stack is empty.
./output_allreduce/worker_2.log-8215-[INFO] DEBUG(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.858.777 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:670] GetEvalStackInfo] Get graph analysis information begin
./output_allreduce/worker_2.log-8216-[INFO] DEBUG(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.858.795 [mindspore/ccsrc/pipeline/jit/ps/debug/trace.cc:673] GetEvalStackInfo] Length of analysis information stack is empty.
./output_allreduce/worker_2.log-8217-[INFO] RUNTIME_FRAMEWORK(618654,fffea97aefa0,python3.9):2025-04-03-09:27:47.858.864 [mindspore/ccsrc/runtime/pipeline/async_rqueue.cc:133] WorkerLoop] Run task failed, error msg:LCCL AllReduce failed.
./output_allreduce/worker_2.log-8218-
--
./output_allreduce/worker_2.log-8375-            [11.  2.]
./output_allreduce/worker_2.log-8376-        """
./output_allreduce/worker_2.log-8377-        if self.has_init:
./output_allreduce/worker_2.log-8378-            self.init_data()
./output_allreduce/worker_2.log-8379->       return TensorPy_.asnumpy(self)
./output_allreduce/worker_2.log:8380:E       RuntimeError: LCCL AllReduce failed.
./output_allreduce/worker_2.log-8381-E       
./output_allreduce/worker_2.log-8382-E       ----------------------------------------------------
./output_allreduce/worker_2.log-8383-E       - C++ Call Stack: (For framework developers)
./output_allreduce/worker_2.log-8384-E       ----------------------------------------------------
./output_allreduce/worker_2.log-8385-E       mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_reduce.cc:59 Launch
./output_allreduce/worker_2.log-8386-
./output_allreduce/worker_2.log:8387:/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/common/tensor.py:989: RuntimeError
./output_allreduce/worker_2.log-8388-===================================================================================================================== warnings summary =====================================================================================================================
./output_allreduce/worker_2.log-8389-../../../../../../../../usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866
./output_allreduce/worker_2.log-8390-  /usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866: DeprecationWarning: invalid escape sequence \L
./output_allreduce/worker_2.log-8391-    if not dirpath.find("AppData\Local\Temp"):
./output_allreduce/worker_2.log-8392-
--
./output_allreduce/worker_2.log-8490-  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
./output_allreduce/worker_2.log-8491-    @fusion_manager.register("minmax_update_perlayer")
./output_allreduce/worker_2.log-8492-
./output_allreduce/worker_2.log-8493--- Docs: https://docs.pytest.org/en/stable/warnings.html
./output_allreduce/worker_2.log-8494-================================================================================================================= short test summary info ==================================================================================================================
./output_allreduce/worker_2.log:8495:FAILED test_lccl_allreduce.py::test_AllReduce - RuntimeError: LCCL AllReduce failed.
./output_allreduce/worker_2.log-8496-============================================================================================================= 1 failed, 26 warnings in 23.67s ==============================================================================================================
./output_allreduce/worker_2.log-8497-[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.435.497 [mindspore/ccsrc/pybind_api/init.cc:651] operator()] Start register...
./output_allreduce/worker_2.log-8498-[INFO] COMMON(618654,ffff8ed34de0,python3.9):2025-04-03-09:27:48.435.536 [mindspore/ccsrc/pybind_api/init.cc:654] operator()] Start mindspore.profiler...
./output_allreduce/worker_2.log-8499-[INFO] ME(618654:281473077956064,MainProcess):2025-04-03-09:27:48.435.616 [mindspore/profiler/envprofiler.py:57] analyse start
./output_allreduce/worker_2.log-8500-[INFO] ME(618654:281473077956064,MainProcess):2025-04-03-09:27:48.435.776 [mindspore/profiler/envprofiler.py:59] Profiler is not initialized, skip analyse.
Traceback (most recent call last):
  File "/home/jenkins/anaconda3/envs/ci39/bin/msrun", line 8, in <module>
    sys.exit(main())
  File "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/parallel/cluster/run.py", line 150, in main
    run(args)
  File "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/parallel/cluster/run.py", line 144, in run
    process_manager.run()
  File "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/parallel/cluster/process_entity/_api.py", line 247, in run
    self.join_processes()
  File "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/parallel/cluster/process_entity/_api.py", line 359, in join_processes
    raise RuntimeError("Distributed job exited with exception. Please check logs in "
RuntimeError: Distributed job exited with exception. Please check logs in directory: ./output_allreduce.
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.608.121 [mindspore/ccsrc/pybind_api/init.cc:651] operator()] Start register...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.608.190 [mindspore/ccsrc/pybind_api/init.cc:654] operator()] Start mindspore.profiler...
[INFO] ME(618638:281473865735648,MainProcess):2025-04-03-09:27:55.608.337 [mindspore/profiler/envprofiler.py:57] analyse start
[INFO] ME(618638:281473865735648,MainProcess):2025-04-03-09:27:55.608.470 [mindspore/profiler/envprofiler.py:59] Profiler is not initialized, skip analyse.
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.608.546 [mindspore/ccsrc/pybind_api/init.cc:661] operator()] Start EmbeddingCacheScheduler...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.608.594 [mindspore/ccsrc/pybind_api/init.cc:668] operator()] Start releasing dataset handles...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.608.657 [mindspore/ccsrc/pybind_api/init.cc:671] operator()] End release dataset handles.
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.608.677 [mindspore/ccsrc/pybind_api/resource/manager.cc:259] ClearResAtexit] Pipeline clear all resource
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.608.774 [mindspore/ccsrc/pybind_api/resource/manager.cc:82] RecordExitStatus] Status record: system exit.
[INFO] DEBUG(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.608.808 [mindspore/ccsrc/common/debug/env_config_parser.cc:152] ParseFromFile] The 'env_config_path' in 'mindspore.context.set_context(env_config_path={path})' is empty.
[INFO] ME(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.608.835 [mindspore/core/mindrt/src/actor/actormgr.cc:165] Finalize] mindrt Actors finish exiting.
[INFO] ME(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.608.849 [mindspore/core/mindrt/src/actor/actormgr.cc:168] Finalize] mindrt Threads finish exiting.
[INFO] ME(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.608.862 [mindspore/core/mindrt/src/actor/actormgr.cc:179] Finalize] mindrt IOMGRS finish exiting.
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.608.952 [mindspore/ccsrc/pybind_api/resource/manager.cc:134] ClearResPart1] Start Finalize StreamSynchronizer...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.608.972 [mindspore/ccsrc/pybind_api/resource/manager.cc:136] ClearResPart1] End Finalize StreamSynchronizer...
[INFO] PIPELINE(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.609.951 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:1000] ClearInfo] Clean graph resource!
[INFO] PIPELINE(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.609.982 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:1000] ClearInfo] Clean graph resource!
[INFO] PIPELINE(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.609.998 [mindspore/ccsrc/pipeline/jit/ps/pipeline.cc:995] ClearRes] Clean Graph executor resource!
[INFO] PIPELINE(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.610.011 [mindspore/ccsrc/pipeline/jit/ps/pipeline_jit.cc:426] ClearRes] Clean JIT executor resource!
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.610.027 [mindspore/ccsrc/pybind_api/resource/manager.cc:155] ClearResPart2] Start clear PyNativeExecutor...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.610.232 [mindspore/ccsrc/pybind_api/resource/manager.cc:157] ClearResPart2] End clear PyNativeExecutor.
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.610.249 [mindspore/ccsrc/pybind_api/resource/manager.cc:159] ClearResPart2] Start clear ConfigManager...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.610.261 [mindspore/ccsrc/pybind_api/resource/manager.cc:161] ClearResPart2] End clear ConfigManager.
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.610.319 [mindspore/ccsrc/common/thread_pool.cc:41] ThreadPool] Set max_thread_num_ to 4
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.610.335 [mindspore/ccsrc/pybind_api/resource/manager.cc:165] ClearResPart2] Start clear device context...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.610.349 [mindspore/ccsrc/pybind_api/resource/manager.cc:167] ClearResPart2] End clear device context.
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.610.362 [mindspore/ccsrc/pybind_api/resource/manager.cc:169] ClearResPart2] Start clear kernel runtime...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.610.379 [mindspore/ccsrc/pybind_api/resource/manager.cc:171] ClearResPart2] End clear kernel runtime.
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.610.392 [mindspore/ccsrc/pybind_api/resource/manager.cc:173] ClearResPart2] Start clear CollectiveManager...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.610.417 [mindspore/ccsrc/pybind_api/resource/manager.cc:176] ClearResPart2] End clear CollectiveManager.
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.610.430 [mindspore/ccsrc/pybind_api/resource/manager.cc:178] ClearResPart2] Start clear AnalysisResultCacheMgr...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.610.447 [mindspore/ccsrc/pybind_api/resource/manager.cc:180] ClearResPart2] End clear AnalysisResultCacheMgr.
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.610.460 [mindspore/ccsrc/pybind_api/resource/manager.cc:182] ClearResPart2] Start clear AnalysisContext...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.610.475 [mindspore/ccsrc/pybind_api/resource/manager.cc:184] ClearResPart2] End clear AnalysisContext...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.610.488 [mindspore/ccsrc/pybind_api/resource/manager.cc:186] ClearResPart2] Start clear AnalysisSchedule...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.610.805 [mindspore/ccsrc/pybind_api/resource/manager.cc:188] ClearResPart2] End clear AnalysisSchedule...
[INFO] DEBUG(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.610.839 [mindspore/ccsrc/debug/debugger/debugger.cc:149] Reset] Release Debugger resource.
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.610.871 [mindspore/ccsrc/pybind_api/resource/manager.cc:200] ClearResPart3] Start clear ClearObjectCache...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.610.886 [mindspore/ccsrc/pybind_api/resource/manager.cc:202] ClearResPart3] End clear ClearObjectCache...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.610.899 [mindspore/ccsrc/pybind_api/resource/manager.cc:204] ClearResPart3] Start clear Parser...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.610.923 [mindspore/ccsrc/pybind_api/resource/manager.cc:206] ClearResPart3] End clear Parser...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.610.936 [mindspore/ccsrc/pybind_api/resource/manager.cc:208] ClearResPart3] Start ClearTraceStack...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.610.990 [mindspore/ccsrc/pybind_api/resource/manager.cc:210] ClearResPart3] End ClearTraceStack...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.611.003 [mindspore/ccsrc/pybind_api/resource/manager.cc:212] ClearResPart3] Start clear InterpretNodeRecorder...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.611.019 [mindspore/ccsrc/pybind_api/resource/manager.cc:214] ClearResPart3] End clear InterpretNodeRecorder...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.611.042 [mindspore/ccsrc/pybind_api/resource/manager.cc:216] ClearResPart3] Start clear parallel::entire_costgraph...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.611.056 [mindspore/ccsrc/pybind_api/resource/manager.cc:218] ClearResPart3] End clear parallel::entire_costgraph...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.611.069 [mindspore/ccsrc/pybind_api/resource/manager.cc:220] ClearResPart3] Start clear ProtobufLibrary...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.611.237 [mindspore/ccsrc/pybind_api/resource/manager.cc:222] ClearResPart3] End clear ProtobufLibrary...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.611.253 [mindspore/ccsrc/pybind_api/resource/manager.cc:224] ClearResPart3] Start clear ParserDefaultObjects ...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.611.270 [mindspore/ccsrc/pybind_api/resource/manager.cc:226] ClearResPart3] End clear ParserDefaultObjects...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.611.286 [mindspore/ccsrc/pybind_api/resource/manager.cc:231] ClearResPart3] Start clear python_adapter...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.611.299 [mindspore/ccsrc/pybind_api/resource/manager.cc:233] ClearResPart3] End clear python_adapter.
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.611.311 [mindspore/ccsrc/pybind_api/resource/manager.cc:237] ClearSingleton] Start clear singleton...
[INFO] COMMON(618638,ffffbdc7dde0,python3.9):2025-04-03-09:27:55.611.411 [mindspore/ccsrc/pybind_api/resource/manager.cc:255] ClearSingleton] End clear singleton.
[INFO] GE(618638,python3.9):2025-04-03-09:27:56.375.844 [ops_kernel_builder_registry.cc:71]618638 ~OpsKernelBuilderRegistrar:Unregister kernel lib name = ops_kernel_info_hccl
[INFO] GE(618638,python3.9):2025-04-03-09:27:56.375.940 [ops_kernel_builder_registry.cc:41]618638 Unregister:OpsKernelBuilder of ops_kernel_info_hccl is unregistered
[INFO] GE(618638,python3.9):2025-04-03-09:27:56.859.609 [mem_manager.cc:118]618638 Finalize:MemManager Finalize.
[INFO] HCCL(618638,python3.9):2025-04-03-09:27:56.918.352 [network_manager.cc:875] [618638]destroy all nic/vnic.
[INFO] HCCL(618638,python3.9):2025-04-03-09:27:56.918.418 [network_manager.cc:875] [618638]destroy all nic/vnic.
[INFO] HCCL(618638,python3.9):2025-04-03-09:27:56.918.434 [network_manager.cc:875] [618638]destroy all nic/vnic.
[INFO] HCCL(618638,python3.9):2025-04-03-09:27:56.918.447 [network_manager.cc:875] [618638]destroy all nic/vnic.
[INFO] HCCL(618638,python3.9):2025-04-03-09:27:56.918.457 [network_manager.cc:875] [618638]destroy all nic/vnic.
[INFO] HCCL(618638,python3.9):2025-04-03-09:27:56.918.467 [network_manager.cc:875] [618638]destroy all nic/vnic.
[INFO] HCCL(618638,python3.9):2025-04-03-09:27:56.918.476 [network_manager.cc:875] [618638]destroy all nic/vnic.
[INFO] HCCL(618638,python3.9):2025-04-03-09:27:56.918.485 [network_manager.cc:875] [618638]destroy all nic/vnic.
[INFO] HCCL(618638,python3.9):2025-04-03-09:27:56.918.495 [network_manager.cc:875] [618638]destroy all nic/vnic.
[INFO] HCCL(618638,python3.9):2025-04-03-09:27:56.918.504 [network_manager.cc:875] [618638]destroy all nic/vnic.
[INFO] HCCL(618638,python3.9):2025-04-03-09:27:56.918.515 [network_manager.cc:875] [618638]destroy all nic/vnic.
[INFO] HCCL(618638,python3.9):2025-04-03-09:27:56.918.524 [network_manager.cc:875] [618638]destroy all nic/vnic.
[INFO] HCCL(618638,python3.9):2025-04-03-09:27:56.918.533 [network_manager.cc:875] [618638]destroy all nic/vnic.
[INFO] HCCL(618638,python3.9):2025-04-03-09:27:56.918.542 [network_manager.cc:875] [618638]destroy all nic/vnic.
[INFO] HCCL(618638,python3.9):2025-04-03-09:27:56.918.550 [network_manager.cc:875] [618638]destroy all nic/vnic.
[INFO] HCCL(618638,python3.9):2025-04-03-09:27:56.918.560 [network_manager.cc:875] [618638]destroy all nic/vnic.
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:56.922.054 [runtime.cc:1570] 618638 ~Runtime: deconstruct runtime
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:56.922.086 [runtime.cc:1577] 618638 ~Runtime: wait monitor success, use=0.
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:57.039.644 [plugin_old_arch.cc:25] 618638 DestructorRuntimeImpl: RuntimeImpl destructor success
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:57.039.683 [runtime_keeper.cc:167] 618638 DestoryRuntimeImpl: Destory Runtime success
[INFO] RUNTIME(618638,python3.9):2025-04-03-09:27:57.041.554 [task_fail_callback_data_manager.cc:63] 618638 ~TaskFailCallBackManager: Destructor.
[INFO] ATRACE(618638,python3.9):2025-04-03-09:27:57.172.008 [stacktrace_signal.c:188](tid:618638) unregister all signo sigaction, can not capture signal.
[INFO] ATRACE(618638,python3.9):2025-04-03-09:27:57.195.533 [awatchdog_monitor.c:234](tid:618638) AwdMonitorExit
F

=================================== FAILURES ===================================
_____________________________ test_lccl_allreduce ______________________________

    @arg_mark(plat_marks=['platform_ascend910b'], level_mark='level0', card_mark='allcards', essential_mark='essential')
    def test_lccl_allreduce():
        """
        Feature: lccl operator test.
        Description: msrun lccl all_reduce 8P case.
        Expectation: success
        """
        os.environ['MS_ENABLE_LCCL'] = "on"
        os.environ['GLOG_v'] = str(1)
        context.set_context(mode=context.GRAPH_MODE, device_target="Ascend",
                            jit_config={"jit_level": "O0", "infer_boost": "on"})
        return_code = os.system(
            "msrun --worker_num=8 --local_worker_num=8 --join=True --log_dir=./output_allreduce "\
            "pytest -s test_lccl_allreduce.py"
        )
        result = subprocess.getoutput("grep -rn 'Loading LCCL because' ./output_allreduce")
>       assert return_code == 0
E       assert 256 == 0

test_all.py:37: AssertionError
=============================== warnings summary ===============================
../../../../../../../../usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866
  /usr/local/Ascend/ascend-toolkit/8.1.RC1/python/site-packages/tbe/tvm/contrib/ccec.py:866: DeprecationWarning: invalid escape sequence \L
    if not dirpath.find("AppData\Local\Temp"):

../../../../../../../../usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/classifier/transdata/transdata_classifier.py:222
  /usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/classifier/transdata/transdata_classifier.py:222: DeprecationWarning: invalid escape sequence \B
    """

../../../../../../../../usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:143
  /usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:143: DeprecationWarning: invalid escape sequence \c
    """

../../../../../../../../usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:170
  /usr/local/Ascend/ascend-toolkit/latest/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:170: DeprecationWarning: invalid escape sequence \c
    """

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for <class 'numpy.float64'> type is zero.
    setattr(self, word, getattr(machar, word).flat[0])

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for <class 'numpy.float64'> type is zero.
    return self._float_to_str(self.smallest_subnormal)

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for <class 'numpy.float32'> type is zero.
    setattr(self, word, getattr(machar, word).flat[0])

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for <class 'numpy.float32'> type is zero.
    return self._float_to_str(self.smallest_subnormal)

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2.py:57
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2.py:57: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("batchnorm_fold2")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad.py:56
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad.py:56: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("batchnorm_fold2_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad_reduce.py:48
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad_reduce.py:48: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("batchnorm_fold2_grad_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul.py:51
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul.py:51: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("correction_mul")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:51
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:51: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("correction_mul_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:143
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:143: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("correction_mul_grad_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perlayer")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad.py:92
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad.py:92: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perlayer_grad_d")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad_reduce.py:49
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad_reduce.py:49: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perlayer_grad_d_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perchannel")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad.py:91
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad.py:91: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perchannel_grad_d")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad_reduce.py:48
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad_reduce.py:48: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_learned_scale_quant_perchannel_grad_d_reduce")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel.py:52
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel.py:52: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_perchannel")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel_grad.py:81
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel_grad.py:81: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_perchannel_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer.py:54
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer.py:54: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_per_layer")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer_grad.py:81
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer_grad.py:81: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("fake_quant_per_layer_grad")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perchannel.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perchannel.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("minmax_update_perchannel")

../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50
  /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute
    @fusion_manager.register("minmax_update_perlayer")

-- Docs: https://docs.pytest.org/en/stable/warnings.html
=========================== short test summary info ============================
FAILED test_all.py::test_lccl_allreduce - assert 256 == 0
======================= 1 failed, 26 warnings in 54.74s ========================
[INFO] GE(618570,python3.9):2025-04-03-09:27:58.747.463 [ops_kernel_builder_registry.cc:71]618570 ~OpsKernelBuilderRegistrar:Unregister kernel lib name = ops_kernel_info_hccl
[INFO] GE(618570,python3.9):2025-04-03-09:27:58.747.558 [ops_kernel_builder_registry.cc:41]618570 Unregister:OpsKernelBuilder of ops_kernel_info_hccl is unregistered
[INFO] GE(618570,python3.9):2025-04-03-09:27:59.204.307 [mem_manager.cc:118]618570 Finalize:MemManager Finalize.
[INFO] HCCL(618570,python3.9):2025-04-03-09:27:59.262.109 [network_manager.cc:875] [618570]destroy all nic/vnic.
[INFO] HCCL(618570,python3.9):2025-04-03-09:27:59.262.176 [network_manager.cc:875] [618570]destroy all nic/vnic.
[INFO] HCCL(618570,python3.9):2025-04-03-09:27:59.262.193 [network_manager.cc:875] [618570]destroy all nic/vnic.
[INFO] HCCL(618570,python3.9):2025-04-03-09:27:59.262.204 [network_manager.cc:875] [618570]destroy all nic/vnic.
[INFO] HCCL(618570,python3.9):2025-04-03-09:27:59.262.214 [network_manager.cc:875] [618570]destroy all nic/vnic.
[INFO] HCCL(618570,python3.9):2025-04-03-09:27:59.262.223 [network_manager.cc:875] [618570]destroy all nic/vnic.
[INFO] HCCL(618570,python3.9):2025-04-03-09:27:59.262.232 [network_manager.cc:875] [618570]destroy all nic/vnic.
[INFO] HCCL(618570,python3.9):2025-04-03-09:27:59.262.244 [network_manager.cc:875] [618570]destroy all nic/vnic.
[INFO] HCCL(618570,python3.9):2025-04-03-09:27:59.262.253 [network_manager.cc:875] [618570]destroy all nic/vnic.
[INFO] HCCL(618570,python3.9):2025-04-03-09:27:59.262.264 [network_manager.cc:875] [618570]destroy all nic/vnic.
[INFO] HCCL(618570,python3.9):2025-04-03-09:27:59.262.273 [network_manager.cc:875] [618570]destroy all nic/vnic.
[INFO] HCCL(618570,python3.9):2025-04-03-09:27:59.262.283 [network_manager.cc:875] [618570]destroy all nic/vnic.
[INFO] HCCL(618570,python3.9):2025-04-03-09:27:59.262.292 [network_manager.cc:875] [618570]destroy all nic/vnic.
[INFO] HCCL(618570,python3.9):2025-04-03-09:27:59.262.300 [network_manager.cc:875] [618570]destroy all nic/vnic.
[INFO] HCCL(618570,python3.9):2025-04-03-09:27:59.262.310 [network_manager.cc:875] [618570]destroy all nic/vnic.
[INFO] HCCL(618570,python3.9):2025-04-03-09:27:59.262.319 [network_manager.cc:875] [618570]destroy all nic/vnic.
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:59.265.675 [runtime.cc:1570] 618570 ~Runtime: deconstruct runtime
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:59.265.709 [runtime.cc:1577] 618570 ~Runtime: wait monitor success, use=0.
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:59.377.941 [plugin_old_arch.cc:25] 618570 DestructorRuntimeImpl: RuntimeImpl destructor success
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:59.377.972 [runtime_keeper.cc:167] 618570 DestoryRuntimeImpl: Destory Runtime success
[INFO] RUNTIME(618570,python3.9):2025-04-03-09:27:59.378.875 [task_fail_callback_data_manager.cc:63] 618570 ~TaskFailCallBackManager: Destructor.
[INFO] ATRACE(618570,python3.9):2025-04-03-09:27:59.483.166 [stacktrace_signal.c:188](tid:618570) unregister all signo sigaction, can not capture signal.
[INFO] ATRACE(618570,python3.9):2025-04-03-09:27:59.495.275 [awatchdog_monitor.c:234](tid:618570) AwdMonitorExit